2024-03-16T20:32:37.809 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-16T20:32:37.809 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi --owner scheduled_leonidus@teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} --archive /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166 -- /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166/orig.config.yaml 2024-03-16T20:32:37.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:32:37.967 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166 branch: wip-lusov-qdb-squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} email: null first_in_suite: false job_id: '7602166' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-qdb-squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync rbytes: false syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-qdb-squid sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b owner: scheduled_leonidus@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6918 sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b sleep_before_teardown: 0 subset: 111/10000 suite: fs suite_branch: wip-lusov-qdb-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCfTDvUVl/BtfiyDIkFB+3Fi9KEx93wUnd1OxusXCyTVLARbfqZ0/Q2G5YupuUUH7naljI/v5p2iqgpnSDJzX7U= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+5G+wNhTBmhRscoNwteZ6y57PF040mNwl59LqY8Axit6/FJUV2aAcYHBQLvLVkbkmP0U2KjgySvrAVN4nzgIc= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWGlPi7AvL0WRTNEN/i5gMbeKwyCuYHHvuMHHBoR66bzyAxHwCoBrmsG9afusaKCPiPAN5SDgo/zb0jfOwzj8c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-15_11:44:52 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-16T20:32:37.967 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/qa; will attempt to use it 2024-03-16T20:32:37.968 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/qa/tasks 2024-03-16T20:32:37.968 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-16T20:32:37.969 INFO:teuthology.task.internal:Checking packages... 2024-03-16T20:32:37.989 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b' 2024-03-16T20:32:37.990 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-16T20:32:37.990 INFO:teuthology.packaging:ref: None 2024-03-16T20:32:37.990 INFO:teuthology.packaging:tag: None 2024-03-16T20:32:37.990 INFO:teuthology.packaging:branch: wip-lusov-qdb-squid 2024-03-16T20:32:37.990 INFO:teuthology.packaging:sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:32:37.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-qdb-squid 2024-03-16T20:32:38.128 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1681.gaba3c1d2 2024-03-16T20:32:38.130 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-16T20:32:38.136 INFO:teuthology.task.internal:no buildpackages task found 2024-03-16T20:32:38.136 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-16T20:32:38.153 INFO:teuthology.task.internal:Saving configuration 2024-03-16T20:32:38.173 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-16T20:32:38.181 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-16T20:32:38.206 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 20:27:33.995424', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCfTDvUVl/BtfiyDIkFB+3Fi9KEx93wUnd1OxusXCyTVLARbfqZ0/Q2G5YupuUUH7naljI/v5p2iqgpnSDJzX7U='} 2024-03-16T20:32:38.228 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 20:27:33.992055', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+5G+wNhTBmhRscoNwteZ6y57PF040mNwl59LqY8Axit6/FJUV2aAcYHBQLvLVkbkmP0U2KjgySvrAVN4nzgIc='} 2024-03-16T20:32:38.250 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 20:27:33.993978', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWGlPi7AvL0WRTNEN/i5gMbeKwyCuYHHvuMHHBoR66bzyAxHwCoBrmsG9afusaKCPiPAN5SDgo/zb0jfOwzj8c='} 2024-03-16T20:32:38.251 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-16T20:32:38.258 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-03-16T20:32:38.258 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-03-16T20:32:38.258 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-03-16T20:32:38.258 INFO:teuthology.run_tasks:Running task console_log... 2024-03-16T20:32:38.404 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9439c180d0>, signals=[15]) 2024-03-16T20:32:38.405 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-16T20:32:38.412 INFO:teuthology.task.internal:Opening connections... 2024-03-16T20:32:38.412 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2024-03-16T20:32:38.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T20:32:38.518 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-03-16T20:32:38.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T20:32:38.605 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2024-03-16T20:32:38.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T20:32:38.694 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-16T20:32:38.699 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2024-03-16T20:32:38.718 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2024-03-16T20:32:38.718 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-03-16T20:32:38.775 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T20:32:38.776 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T20:32:38.777 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T20:32:38.777 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-03-16T20:32:38.809 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-03-16T20:32:38.827 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-03-16T20:32:38.827 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-03-16T20:32:38.883 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T20:32:38.884 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T20:32:38.885 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-03-16T20:32:38.917 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2024-03-16T20:32:38.934 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2024-03-16T20:32:38.934 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2024-03-16T20:32:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2024-03-16T20:32:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="9" 2024-03-16T20:32:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2024-03-16T20:32:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2024-03-16T20:32:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="9" 2024-03-16T20:32:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el9" 2024-03-16T20:32:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T20:32:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2024-03-16T20:32:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:LOGO="fedora-logo-icon" 2024-03-16T20:32:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T20:32:38.995 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2024-03-16T20:32:38.996 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T20:32:38.996 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T20:32:38.996 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T20:32:38.996 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2024-03-16T20:32:39.017 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-16T20:32:39.028 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-16T20:32:39.055 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-16T20:32:39.055 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2024-03-16T20:32:39.058 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-03-16T20:32:39.060 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2024-03-16T20:32:39.076 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-16T20:32:39.083 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-16T20:32:39.083 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2024-03-16T20:32:39.116 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-03-16T20:32:39.118 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2024-03-16T20:32:39.223 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-16T20:32:39.298 INFO:teuthology.run_tasks:Running task kernel... 2024-03-16T20:32:39.314 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-16T20:32:39.314 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-03-16T20:32:39.314 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-03-16T20:32:39.314 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-16T20:32:39.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T20:32:39.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-16T20:32:39.644 DEBUG:teuthology.task.kernel:sha1 for client.0 is 3845b7ac715a3ff198582638d199a90e30e254da 2024-03-16T20:32:39.644 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "3845b7ac715a3ff198582638d199a90e30e254da"... 2024-03-16T20:32:39.645 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2024-03-16T20:32:39.662 INFO:teuthology.orchestra.run.smithi008.stdout:5.14.0-361.el9.x86_64 2024-03-16T20:32:39.662 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3845b7ac715a3ff198582638d199a90e30e254da 2024-03-16T20:32:39.663 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-16T20:32:39.663 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum upgrade -y linux-firmware 2024-03-16T20:32:41.687 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-16T20:32:43.088 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.0 MB 00:00 2024-03-16T20:32:44.012 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-03-16T20:32:55.353 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - AppStream 1.8 MB/s | 19 MB 00:10 2024-03-16T20:32:59.998 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.1 MB 00:00 2024-03-16T20:33:01.472 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 15 kB 00:00 2024-03-16T20:33:09.064 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 2.8 MB/s | 21 MB 00:07 2024-03-16T20:33:14.265 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 50 kB/s | 1.7 kB 00:00 2024-03-16T20:33:16.637 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 1 Package 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 375 M 2024-03-16T20:33:16.645 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2024-03-16T20:33:24.607 INFO:teuthology.orchestra.run.smithi008.stdout:linux-firmware-20240219-143.el9.noarch.rpm 47 MB/s | 375 MB 00:07 2024-03-16T20:33:24.608 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2024-03-16T20:33:24.609 INFO:teuthology.orchestra.run.smithi008.stdout:Total 47 MB/s | 375 MB 00:07 2024-03-16T20:33:24.609 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2024-03-16T20:33:24.695 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2024-03-16T20:33:24.695 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2024-03-16T20:33:27.161 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2024-03-16T20:33:27.162 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2024-03-16T20:33:33.747 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2024-03-16T20:33:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-16T20:33:34.060 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-16T20:33:35.287 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-16T20:33:35.287 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-16T20:33:35.637 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-16T20:33:35.637 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:33:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2024-03-16T20:33:35.637 INFO:teuthology.orchestra.run.smithi008.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-16T20:33:35.637 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:33:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2024-03-16T20:33:35.920 INFO:teuthology.task.kernel:Downloading kernel 3845b7ac715a3ff198582638d199a90e30e254da on client.0... 2024-03-16T20:33:35.920 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3845b7ac715a3ff198582638d199a90e30e254da 2024-03-16T20:33:36.142 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/3845b7ac715a3ff198582638d199a90e30e254da/centos/9/flavors/default/x86_64/ 2024-03-16T20:33:36.143 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc7_g3845b7ac715a-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/3845b7ac715a3ff198582638d199a90e30e254da/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-16T20:33:36.145 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi008.front.sepia.ceph.com to complete... 2024-03-16T20:33:54.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16 20:33:54 URL:https://2.chacra.ceph.com/r/kernel/testing/3845b7ac715a3ff198582638d199a90e30e254da/centos/9/flavors/default/x86_64/kernel-6.8.0_rc7_g3845b7ac715a-1.x86_64.rpm [336075563/336075563] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-16T20:33:54.202 INFO:teuthology.orchestra.run.smithi008.stderr:FINISHED --2024-03-16 20:33:54-- 2024-03-16T20:33:54.202 INFO:teuthology.orchestra.run.smithi008.stderr:Total wall clock time: 18s 2024-03-16T20:33:54.202 INFO:teuthology.orchestra.run.smithi008.stderr:Downloaded: 1 files, 321M in 18s (18.1 MB/s) 2024-03-16T20:33:54.204 INFO:teuthology.task.kernel:Installing kernel 3845b7ac715a3ff198582638d199a90e30e254da on client.0... 2024-03-16T20:33:54.204 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-16T20:33:56.240 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying... ######################################## 2024-03-16T20:33:56.303 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing... ######################################## 2024-03-16T20:33:56.387 INFO:teuthology.orchestra.run.smithi008.stdout:Updating / installing... 2024-03-16T20:34:04.274 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-6.8.0_rc7_g3845b7ac715a-1 ######################################## 2024-03-16T20:34:20.485 INFO:teuthology.orchestra.run.smithi008.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-16T20:34:43.611 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-16T20:34:43.611 DEBUG:teuthology.orchestra.run.smithi008:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-16T20:34:43.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a 2024-03-16T20:34:43.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/System.map 2024-03-16T20:34:43.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/config 2024-03-16T20:34:43.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel 2024-03-16T20:34:43.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch 2024-03-16T20:34:43.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-16T20:34:43.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/kernel 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/kernel/cpu 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/kernel/cpu/mce 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-16T20:34:43.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/kvm 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/arch/x86/kvm/kvm.ko 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/ansi_cprng.ko 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/anubis.ko 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/arc4.ko 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/async_tx 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/async_tx/async_memcpy.ko 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/async_tx/async_pq.ko 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/async_tx/async_tx.ko 2024-03-16T20:34:43.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/async_tx/async_xor.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/async_tx/raid6test.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/authenc.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/authencesn.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/blake2b_generic.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/blowfish_common.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/blowfish_generic.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/camellia_generic.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/cast5_generic.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/cast6_generic.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/cast_common.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/ccm.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/cmac.ko 2024-03-16T20:34:43.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/crc32_generic.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/crypto_engine.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/crypto_user.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/cts.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/des_generic.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/dh_generic.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/echainiv.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/essiv.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/fcrypt.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/khazad.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/lz4.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/lz4hc.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/md4.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/michael_mic.ko 2024-03-16T20:34:43.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/pcbc.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/pcrypt.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/rmd160.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/seed.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/serpent_generic.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/tcrypt.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/tea.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/twofish_common.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/twofish_generic.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/vmac.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/wp512.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/xcbc.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/xor.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/crypto/xxhash_generic.ko 2024-03-16T20:34:43.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/acpi 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/acpi/acpi_pad.ko 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/acpi/custom_method.ko 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/acpi/ec_sys.ko 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/acpi/platform_profile.ko 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/acpi/sbs.ko 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/acpi/sbshc.ko 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/acpi/video.ko 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/acard-ahci.ko 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/ahci_platform.ko 2024-03-16T20:34:43.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/ata_generic.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/libahci_platform.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_acpi.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_ali.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_amd.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_artop.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_atiixp.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_atp867x.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_cmd640.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_cmd64x.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_cypress.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_efar.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_hpt366.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_hpt37x.ko 2024-03-16T20:34:43.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_it8213.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_it821x.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_jmicron.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_marvell.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_mpiix.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_netcell.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_ninja32.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_ns87410.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_ns87415.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_oldpiix.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_opti.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_optidma.ko 2024-03-16T20:34:43.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_pcmcia.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_piccolo.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_rdc.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_sch.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_serverworks.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_sil680.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_sis.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_sl82c105.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_triflex.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pata_via.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/pdc_adma.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_inic162x.ko 2024-03-16T20:34:43.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_mv.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_nv.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_promise.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_qstor.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_sil.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_sil24.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_sis.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_svw.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_sx4.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_uli.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_via.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ata/sata_vsc.ko 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/auxdisplay 2024-03-16T20:34:43.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/auxdisplay/ks0108.ko 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/base 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/base/regmap 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/bcma 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/bcma/bcma.ko 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/aoe 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/aoe/aoe.ko 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/brd.ko 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/drbd 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/drbd/drbd.ko 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/floppy.ko 2024-03-16T20:34:43.695 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/loop.ko 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/mtip32xx 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/nbd.ko 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/null_blk 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/null_blk/null_blk.ko 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/pktcdvd.ko 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/rbd.ko 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/virtio_blk.ko 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/xen-blkback 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/xen-blkfront.ko 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/zram 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/block/zram/zram.ko 2024-03-16T20:34:43.696 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/hangcheck-timer.ko 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/hw_random 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/hw_random/via-rng.ko 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/ipmi 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-16T20:34:43.697 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/lp.ko 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/mwave 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/mwave/mwave.ko 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/ppdev.ko 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/tlclk.ko 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/tpm 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/tpm/tpm.ko 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-16T20:34:43.698 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/uv_mmtimer.ko 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/char/virtio_console.ko 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/cpufreq 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/ccp 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/ccp/ccp.ko 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/intel 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/intel/qat 2024-03-16T20:34:43.699 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/intel/qat/qat_common 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/padlock-aes.ko 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/padlock-sha.ko 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/virtio 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/dca 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/dca/dca.ko 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/devfreq 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/dma 2024-03-16T20:34:43.700 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/dma/dw 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/dma/ioat 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/amd64_edac.ko 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/e752x_edac.ko 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/edac_mce_amd.ko 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/i3000_edac.ko 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/i3200_edac.ko 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/i5100_edac.ko 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/i5400_edac.ko 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/i7300_edac.ko 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/i7core_edac.ko 2024-03-16T20:34:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/i82975x_edac.ko 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/ie31200_edac.ko 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/sb_edac.ko 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/edac/x38_edac.ko 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/firmware 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/firmware/edd.ko 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/gpio 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/gpio/gpio-ich.ko 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-appleir.ko 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-aureal.ko 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-axff.ko 2024-03-16T20:34:43.702 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-dr.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-elecom.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-elo.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-emsff.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-gaff.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-gt683r.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-gyration.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-holtekff.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-hyperv.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-icade.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-keytouch.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-kye.ko 2024-03-16T20:34:43.703 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-lcpower.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-led.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-lenovo.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-multitouch.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-ortek.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-penmount.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-petalynx.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-picolcd.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-pl.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-plantronics.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-primax.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-rmi.ko 2024-03-16T20:34:43.704 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat-common.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-roccat.ko 2024-03-16T20:34:43.705 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-saitek.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-samsung.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-sjoy.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-sony.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-speedlink.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-steelseries.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-sunplus.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-tivo.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-tmff.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-topseed.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-twinhan.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-uclogic.ko 2024-03-16T20:34:43.706 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-waltop.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-wiimote.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-xinmo.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-zpff.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/hid-zydacron.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/uhid.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hid/wacom.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hv 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hv/hv_balloon.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hv/hv_utils.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hv/hv_vmbus.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/abituguru.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/abituguru3.ko 2024-03-16T20:34:43.707 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ad7414.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ad7418.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adc128d818.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adm1025.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adm1026.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adm1029.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adm1031.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adm9240.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ads7828.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adt7410.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adt7411.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adt7462.ko 2024-03-16T20:34:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adt7470.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adt7475.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/adt7x10.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/amc6821.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/applesmc.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/asb100.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/asc7621.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/atxp1.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/coretemp.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/dme1737.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ds1621.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ds620.ko 2024-03-16T20:34:43.709 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/emc1403.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/emc6w201.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/f71805f.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/f71882fg.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/f75375s.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/fam15h_power.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/fschmd.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/g760a.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/g762.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/gl518sm.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/gl520sm.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/i5500_temp.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/i5k_amb.ko 2024-03-16T20:34:43.710 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ibmaem.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ibmpex.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ina209.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ina2xx.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/it87.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/k10temp.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/k8temp.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lineage-pem.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm63.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm73.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm75.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm77.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm78.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm80.ko 2024-03-16T20:34:43.711 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm83.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm85.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm87.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm90.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm92.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm93.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm95234.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm95241.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/lm95245.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ltc2945.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ltc4151.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ltc4215.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ltc4222.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ltc4245.ko 2024-03-16T20:34:43.712 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ltc4260.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/ltc4261.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/max16065.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/max1619.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/max1668.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/max197.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/max6639.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/max6650.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/max6697.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/mcp3021.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/nct6683.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/nct6775-core.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/nct6775.ko 2024-03-16T20:34:43.713 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/nct7802.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pc87360.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pc87427.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pcf8591.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-16T20:34:43.714 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/powr1220.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/sch5627.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/sch5636.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/sht15.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/sht21.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/shtc1.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/sis5595.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/smsc47b397.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/smsc47m1.ko 2024-03-16T20:34:43.715 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/smsc47m192.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/thmc50.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/tmp102.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/tmp103.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/tmp401.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/tmp421.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/via-cputemp.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/via686a.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/vt1211.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/vt8231.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/w83627ehf.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/w83627hf.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/w83781d.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/w83791d.ko 2024-03-16T20:34:43.716 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/w83792d.ko 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/w83793.ko 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/w83795.ko 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/w83l785ts.ko 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/hwmon/w83l786ng.ko 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/algos 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-16T20:34:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-16T20:34:43.718 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/i2c-dev.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/i2c-mux.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/i2c-smbus.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/i2c/i2c-stub.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/core 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-16T20:34:43.719 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/core/ib_core.ko 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/hw 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/hw/cxgb4 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/hw/mlx4 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/hw/mlx5 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/hw/mthca 2024-03-16T20:34:43.720 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/ulp 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/ulp/ipoib 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/ulp/iser 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/ulp/isert 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/ulp/srp 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/ulp/srpt 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/gameport 2024-03-16T20:34:43.721 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/gameport/gameport.ko 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/joydev.ko 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/keyboard 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/mouse 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/mouse/appletouch.ko 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/mouse/bcm5974.ko 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/mouse/cyapatp.ko 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/mouse/sermouse.ko 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-16T20:34:43.722 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/rmi4 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/serio 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/serio/altera_ps2.ko 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/serio/arc_ps2.ko 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/serio/serio_raw.ko 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/input/sparse-keymap.ko 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/leds-blinkm.ko 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/leds-lm3530.ko 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/leds-lp3944.ko 2024-03-16T20:34:43.723 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/leds-ss4200.ko 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/trigger 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/bcache 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/bcache/bcache.ko 2024-03-16T20:34:43.724 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-bio-prison.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-cache-smq.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-cache.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-crypt.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-delay.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-flakey.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-log-userspace.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-multipath.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-queue-length.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-raid.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-round-robin.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-service-time.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-switch.ko 2024-03-16T20:34:43.725 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-thin-pool.ko 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/dm-verity.ko 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/persistent-data 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/raid0.ko 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/raid1.ko 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/raid10.ko 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/md/raid456.ko 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/message 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/message/fusion 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/message/fusion/mptbase.ko 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/message/fusion/mptctl.ko 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/message/fusion/mptfc.ko 2024-03-16T20:34:43.726 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/message/fusion/mptlan.ko 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/message/fusion/mptsas.ko 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/message/fusion/mptscsih.ko 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/message/fusion/mptspi.ko 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/mfd 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/mfd/lpc_ich.ko 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/mfd/lpc_sch.ko 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/mfd/mfd-core.ko 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/mfd/sm501.ko 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/mfd/viperboard.ko 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/mfd/vx855.ko 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/mfd/wl1273-core.ko 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/altera-stapl 2024-03-16T20:34:43.727 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/apds9802als.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/apds990x.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/bh1770glc.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/cb710 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/cb710/cb710.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/eeprom 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/eeprom/at24.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/eeprom/max6875.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/enclosure.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/hpilo.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/isl29003.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/isl29020.ko 2024-03-16T20:34:43.728 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/lis3lv02d 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/mei 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/mei/mei-me.ko 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/mei/mei-txe.ko 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/mei/mei.ko 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/sgi-gru 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/sgi-xp 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/tifm_7xx1.ko 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/tifm_core.ko 2024-03-16T20:34:43.729 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/tsl2550.ko 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/vmw_balloon.ko 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/vmw_vmci 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/bonding 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/bonding/bonding.ko 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/dsa 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/dsa/b53 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/dsa/mv88e6xxx 2024-03-16T20:34:43.730 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/dummy.ko 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/eql.ko 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/3com 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/8390 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-16T20:34:43.731 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/adaptec 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/agere 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/alteon 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/altera 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/amd 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/atheros 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/atheros/alx 2024-03-16T20:34:43.732 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/atheros/atlx 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/broadcom 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/broadcom/genet 2024-03-16T20:34:43.733 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/brocade 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/brocade/bna 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/chelsio 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-16T20:34:43.734 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/cisco 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/cisco/enic 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dec 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dec/tulip 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-16T20:34:43.735 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dlink 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/dnet.ko 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/emulex 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/emulex/benet 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/ethoc.ko 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/fealnx.ko 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/e1000 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/e1000e 2024-03-16T20:34:43.736 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/fm10k 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/i40e 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/iavf 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/igb 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/igbvf 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-16T20:34:43.737 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/jme.ko 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/marvell 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/mellanox 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-16T20:34:43.738 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/micrel 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/myricom 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/natsemi 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/neterion 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/nvidia 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-16T20:34:43.739 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/packetengines 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/qlogic 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/rdc 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/realtek 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-16T20:34:43.740 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/rocker 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/sfc 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/silan 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/sis 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/smsc 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-16T20:34:43.741 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/stmicro 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/sun 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/tehuti 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/ti 2024-03-16T20:34:43.742 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/via 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/wiznet 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/xircom 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/geneve.ko 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/hyperv 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ieee802154 2024-03-16T20:34:43.743 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ifb.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ipvlan 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/macvlan.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/macvtap.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/mdio 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/mdio.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/mii.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/net_failover.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/netconsole.ko 2024-03-16T20:34:43.744 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/nlmon.ko 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/pcs 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/amd.ko 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/bcm87xx.ko 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/broadcom.ko 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/cicada.ko 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/davicom.ko 2024-03-16T20:34:43.745 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/dp83640.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/et1011c.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/icplus.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/lxt.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/marvell.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/micrel.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/national.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/phylink.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/qsemi.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/realtek.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/smsc.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/ste10Xp.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/phy/vitesse.ko 2024-03-16T20:34:43.746 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ppp 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ppp/ppp_async.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ppp/pppoe.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ppp/pppox.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/ppp/pptp.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/slip 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/slip/slhc.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/slip/slip.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/sungem_phy.ko 2024-03-16T20:34:43.747 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/tap.ko 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/team 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/team/team.ko 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/team/team_mode_random.ko 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/tun.ko 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/veth.ko 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/virtio_net.ko 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/vmxnet3 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/vxlan 2024-03-16T20:34:43.748 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/vxlan/vxlan.ko 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/xen-netback 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/net/xen-netfront.ko 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ntb 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ntb/ntb.ko 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/nvme 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/nvme/host 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/nvme/host/nvme-core.ko 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/nvme/host/nvme.ko 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/parport 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/parport/parport.ko 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/parport/parport_cs.ko 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/parport/parport_pc.ko 2024-03-16T20:34:43.749 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/parport/parport_serial.ko 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pci 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pci/hotplug 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pci/pcie 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pci/xen-pcifront.ko 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pcmcia 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pcmcia/i82092.ko 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pcmcia/pd6729.ko 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pinctrl 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pinctrl/intel 2024-03-16T20:34:43.750 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/acerhdf.ko 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-16T20:34:43.751 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/hdaps.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/intel 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/intel_ips.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-16T20:34:43.752 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/platform/x86/wmi.ko 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/powercap 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pps 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pps/clients 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pps/clients/pps_parport.ko 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/pps/pps_core.ko 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ptp 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ptp/ptp.ko 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ptp/ptp_kvm.ko 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-16T20:34:43.753 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-em3027.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-16T20:34:43.754 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-max6900.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-16T20:34:43.755 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-16T20:34:43.756 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/rtc/rtc-x1205.ko 2024-03-16T20:34:43.756 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi 2024-03-16T20:34:43.756 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/3w-9xxx.ko 2024-03-16T20:34:43.756 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/3w-sas.ko 2024-03-16T20:34:43.756 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/3w-xxxx.ko 2024-03-16T20:34:43.757 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/BusLogic.ko 2024-03-16T20:34:43.757 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/a100u2w.ko 2024-03-16T20:34:43.757 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/aacraid 2024-03-16T20:34:43.757 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/advansys.ko 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/aic7xxx 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/am53c974.ko 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/arcmsr 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/atp870u.ko 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/be2iscsi 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/bfa 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/bfa/bfa.ko 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/bnx2fc 2024-03-16T20:34:43.758 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/bnx2i 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/ch.ko 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/csiostor 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/cxgbi 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/dc395x.ko 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/device_handler 2024-03-16T20:34:43.759 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/dmx3191d.ko 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/esas2r 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/esp_scsi.ko 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/fcoe 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/fnic 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/fnic/fnic.ko 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/hpsa.ko 2024-03-16T20:34:43.760 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/hptiop.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/hv_storvsc.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/initio.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/ipr.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/ips.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/isci 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/isci/isci.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/libfc 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/libfc/libfc.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/libiscsi.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/libsas 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/libsas/libsas.ko 2024-03-16T20:34:43.761 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/lpfc 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/megaraid 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/megaraid.ko 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/mpt3sas 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/mvsas 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/mvumi.ko 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/pm8001 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-16T20:34:43.762 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/pmcraid.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/qla1280.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/qla2xxx 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/qla4xxx 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/raid_class.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/scsi_debug.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-16T20:34:43.763 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/ses.ko 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/st.ko 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/stex.ko 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/sym53c8xx_2 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/virtio_scsi.ko 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/scsi/wd719x.ko 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ssb 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ssb/ssb.ko 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target/iscsi 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target/loopback 2024-03-16T20:34:43.764 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target/target_core_file.ko 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target/target_core_iblock.ko 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target/target_core_mod.ko 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target/target_core_pscsi.ko 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target/target_core_user.ko 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target/tcm_fc 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-16T20:34:43.765 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-16T20:34:43.766 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty/ipwireless 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty/n_gsm.ko 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty/n_hdlc.ko 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty/nozomi.ko 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty/serial 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty/serial/8250 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty/serial/arc_uart.ko 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty/serial/jsm 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-16T20:34:43.767 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ufs 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ufs/core 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ufs/host 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/uio 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/uio/uio.ko 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/uio/uio_aec.ko 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/uio/uio_cif.ko 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/uio/uio_pci_generic.ko 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/uio/uio_sercos3.ko 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/class 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/class/cdc-acm.ko 2024-03-16T20:34:43.768 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/class/usblp.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/class/usbtmc.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/host 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/image 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/image/mdc800.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/image/microtek.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/adutux.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/appledisplay.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/emi26.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/emi62.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/ezusb.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/idmouse.ko 2024-03-16T20:34:43.769 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/iowarrior.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/ldusb.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/legousbtower.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/sisusbvga 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/usb3503.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/usblcd.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/uss720.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/misc/yurex.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/phy 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/phy/phy-generic.ko 2024-03-16T20:34:43.770 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/aircable.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/ark3116.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/ch341.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/cp210x.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/cyberjack.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/empeg.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/io_ti.ko 2024-03-16T20:34:43.771 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/ipaq.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/ipw.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/ir-usb.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/keyspan.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/mct_u232.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/mos7720.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/mos7840.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/navman.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/omninet.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/opticon.ko 2024-03-16T20:34:43.772 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/option.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/oti6858.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/pl2303.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/qcaux.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/qcserial.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/quatech2.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/safe_serial.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/sierra.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/ssu100.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/symbolserial.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/usb_debug.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-16T20:34:43.773 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/visor.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/whiteheat.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/uas.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-karma.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-16T20:34:43.774 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/storage/usb-storage.ko 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/usbip 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/vfio 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/vfio/pci 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/vfio/vfio.ko 2024-03-16T20:34:43.775 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/vhost 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/vhost/vhost.ko 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/vhost/vhost_net.ko 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/vhost/vhost_scsi.ko 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/video 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/video/backlight 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/video/backlight/apple_bl.ko 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/video/backlight/lcd.ko 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/virtio 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/virtio/virtio.ko 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/virtio/virtio_balloon.ko 2024-03-16T20:34:43.776 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/virtio/virtio_mmio.ko 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/virtio/virtio_pci.ko 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/virtio/virtio_ring.ko 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/masters 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/masters/ds2482.ko 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/masters/ds2490.ko 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-16T20:34:43.777 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/w1/wire.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/hpwdt.ko 2024-03-16T20:34:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/i6300esb.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/ib700wdt.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/ibmasr.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/it87_wdt.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/machzwd.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/nv_tco.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-16T20:34:43.779 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/softdog.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/via_wdt.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/wdt_pci.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/watchdog/xen_wdt.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/xen 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/xen/xen-evtchn.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/xen/xen-gntalloc.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/xen/xen-gntdev.ko 2024-03-16T20:34:43.780 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/xen/xen-pciback 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/xen/xen-privcmd.ko 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/xen/xenfs 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/9p 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/9p/9p.ko 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/affs 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/affs/affs.ko 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/befs 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/befs/befs.ko 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/binfmt_misc.ko 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/btrfs 2024-03-16T20:34:43.781 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/btrfs/btrfs.ko 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/cachefiles 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/cachefiles/cachefiles.ko 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ceph 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ceph/ceph.ko 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/coda 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/coda/coda.ko 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/cramfs 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/cramfs/cramfs.ko 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/dlm 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/dlm/dlm.ko 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ecryptfs 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/f2fs 2024-03-16T20:34:43.782 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/f2fs/f2fs.ko 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/fat 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/fat/fat.ko 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/fat/msdos.ko 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/fat/vfat.ko 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/fuse 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/fuse/cuse.ko 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/fuse/fuse.ko 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/gfs2 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/gfs2/gfs2.ko 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/hfs 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/hfs/hfs.ko 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/hfsplus 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/hfsplus/hfsplus.ko 2024-03-16T20:34:43.783 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/isofs 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/isofs/isofs.ko 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/jfs 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/jfs/jfs.ko 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/lockd 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/lockd/lockd.ko 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/minix 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/minix/minix.ko 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/netfs 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/netfs/netfs.ko 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs/blocklayout 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-16T20:34:43.784 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs/filelayout 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs/flexfilelayout 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs/nfs.ko 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs/nfsv3.ko 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs/nfsv4.ko 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs_common 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs_common/grace.ko 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfs_common/nfs_acl.ko 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfsd 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nfsd/nfsd.ko 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nilfs2 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nilfs2/nilfs2.ko 2024-03-16T20:34:43.785 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/mac-celtic.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/mac-centeuro.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/mac-croatian.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/mac-cyrillic.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/mac-gaelic.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/mac-greek.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/mac-iceland.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/mac-inuit.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/mac-roman.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/mac-romanian.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/mac-turkish.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp1250.ko 2024-03-16T20:34:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp1251.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp1255.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp737.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp775.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp850.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp852.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp855.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp857.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp860.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp861.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp862.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp863.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp864.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp865.ko 2024-03-16T20:34:43.787 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp866.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp869.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp874.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp932.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp936.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp949.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_cp950.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_euc-jp.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_iso8859-1.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_iso8859-13.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_iso8859-14.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_iso8859-15.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_iso8859-2.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_iso8859-3.ko 2024-03-16T20:34:43.788 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_iso8859-4.ko 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_iso8859-5.ko 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_iso8859-6.ko 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_iso8859-7.ko 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_iso8859-9.ko 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_koi8-r.ko 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_koi8-ru.ko 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_koi8-u.ko 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/nls/nls_utf8.ko 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ocfs2 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ocfs2/cluster 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-16T20:34:43.789 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ocfs2/dlm 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ocfs2/dlmfs 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ocfs2/ocfs2.ko 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/overlayfs 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/overlayfs/overlay.ko 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/pstore 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/pstore/ramoops.ko 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/reiserfs 2024-03-16T20:34:43.790 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/reiserfs/reiserfs.ko 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/romfs 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/romfs/romfs.ko 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/smb 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/smb/client 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/smb/client/cifs.ko 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/smb/common 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/smb/common/cifs_arc4.ko 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/smb/common/cifs_md4.ko 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/squashfs 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/squashfs/squashfs.ko 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/sysv 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/sysv/sysv.ko 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/udf 2024-03-16T20:34:43.791 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/udf/udf.ko 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ufs 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/ufs/ufs.ko 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/xfs 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/fs/xfs/xfs.ko 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/kernel 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/kernel/rcu 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/kernel/rcu/rcutorture.ko 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/kernel/torture.ko 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/kernel/trace 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/asn1_encoder.ko 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/crc-itu-t.ko 2024-03-16T20:34:43.792 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/crc8.ko 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/crypto 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/crypto/libarc4.ko 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/crypto/libdes.ko 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/libcrc32c.ko 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/lru_cache.ko 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/lz4 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/lz4/lz4_compress.ko 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/lz4/lz4hc_compress.ko 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/math 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/math/cordic.ko 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/raid6 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/raid6/raid6_pq.ko 2024-03-16T20:34:43.793 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/reed_solomon 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/ts_bm.ko 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/ts_fsm.ko 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/ts_kmp.ko 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/zstd 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/lib/zstd/zstd_compress.ko 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/mm 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/mm/hwpoison-inject.ko 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/6lowpan 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/6lowpan/6lowpan.ko 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/6lowpan/nhc_dest.ko 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/6lowpan/nhc_fragment.ko 2024-03-16T20:34:43.794 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/6lowpan/nhc_hop.ko 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/6lowpan/nhc_mobility.ko 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/6lowpan/nhc_routing.ko 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/6lowpan/nhc_udp.ko 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/802 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/802/garp.ko 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/802/mrp.ko 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/802/p8022.ko 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/802/psnap.ko 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/802/stp.ko 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/8021q 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/8021q/8021q.ko 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/9p 2024-03-16T20:34:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/9p/9pnet.ko 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/9p/9pnet_fd.ko 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/9p/9pnet_rdma.ko 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/9p/9pnet_virtio.ko 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/batman-adv 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/batman-adv/batman-adv.ko 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/br_netfilter.ko 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/bridge.ko 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-16T20:34:43.796 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-16T20:34:43.797 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/ebtables.ko 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ceph 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ceph/libceph.ko 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/core 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/core/failover.ko 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/core/pktgen.ko 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dccp 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dccp/dccp.ko 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dccp/dccp_diag.ko 2024-03-16T20:34:43.798 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dccp/dccp_ipv4.ko 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dccp/dccp_ipv6.ko 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dns_resolver 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dns_resolver/dns_resolver.ko 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dsa 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dsa/dsa_core.ko 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dsa/tag_brcm.ko 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dsa/tag_dsa.ko 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dsa/tag_none.ko 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/dsa/tag_trailer.ko 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ieee802154 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ieee802154/6lowpan 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ieee802154/ieee802154.ko 2024-03-16T20:34:43.799 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/ah4.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/esp4.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/fou.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/gre.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/inet_diag.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/ip_gre.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/ip_tunnel.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/ip_vti.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/ipcomp.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/ipip.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-16T20:34:43.800 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-16T20:34:43.801 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_bic.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_dctcp.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_diag.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_highspeed.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_htcp.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_hybla.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_illinois.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_lp.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_scalable.ko 2024-03-16T20:34:43.802 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_vegas.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_veno.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_westwood.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tcp_yeah.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/tunnel4.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/udp_diag.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/udp_tunnel.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/ah6.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/esp6.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/fou6.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/ip6_tunnel.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/ip6_vti.ko 2024-03-16T20:34:43.803 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/ipcomp6.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-16T20:34:43.804 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/sit.ko 2024-03-16T20:34:43.805 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/tunnel6.ko 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/key 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/key/af_key.ko 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/l2tp 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/l2tp/l2tp_core.ko 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/l2tp/l2tp_eth.ko 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/l2tp/l2tp_ip.ko 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/l2tp/l2tp_ip6.ko 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/l2tp/l2tp_netlink.ko 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/l2tp/l2tp_ppp.ko 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/llc 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/llc/llc.ko 2024-03-16T20:34:43.806 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/mac802154 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/mac802154/mac802154.ko 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/mpls 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/mpls/mpls_gso.ko 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set.ko 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-16T20:34:43.807 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-16T20:34:43.808 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conncount.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-16T20:34:43.809 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_flow_table.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_log_syslog.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_nat.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-16T20:34:43.810 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_nat_irc.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_nat_sip.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nf_tables.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nfnetlink.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nfnetlink_log.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_chain_nat.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_compat.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_ct.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-16T20:34:43.811 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_fib.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_hash.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_limit.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_log.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_masq.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_nat.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_numgen.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_queue.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_quota.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_redir.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_reject.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_reject_inet.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_socket.ko 2024-03-16T20:34:43.812 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/nft_tunnel.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_AUDIT.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_CT.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_DSCP.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_HL.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_HMARK.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_LED.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_LOG.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_NETMAP.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_NFLOG.ko 2024-03-16T20:34:43.813 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_RATEEST.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_SECMARK.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_TEE.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_TPROXY.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_TRACE.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_addrtype.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_bpf.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_cgroup.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_cluster.ko 2024-03-16T20:34:43.814 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_comment.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_connbytes.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_connlabel.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_connlimit.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_connmark.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_conntrack.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_cpu.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_dccp.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_devgroup.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_dscp.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_ecn.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_esp.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_hashlimit.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_helper.ko 2024-03-16T20:34:43.815 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_hl.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_ipcomp.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_iprange.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_ipvs.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_l2tp.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_length.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_limit.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_mac.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_mark.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_multiport.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_nat.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_nfacct.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_osf.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_owner.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_physdev.ko 2024-03-16T20:34:43.816 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_pkttype.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_policy.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_quota.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_rateest.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_realm.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_recent.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_sctp.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_set.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_socket.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_state.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_statistic.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_string.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_tcpmss.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_time.ko 2024-03-16T20:34:43.817 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netfilter/xt_u32.ko 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netlink 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/netlink/netlink_diag.ko 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/nsh 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/nsh/nsh.ko 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/openvswitch 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/openvswitch/openvswitch.ko 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/openvswitch/vport-geneve.ko 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/openvswitch/vport-gre.ko 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/openvswitch/vport-vxlan.ko 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/packet 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/packet/af_packet_diag.ko 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/rds 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/rds/rds.ko 2024-03-16T20:34:43.818 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/rds/rds_rdma.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/rds/rds_tcp.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/act_csum.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/act_gact.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/act_mirred.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/act_nat.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/act_pedit.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/act_police.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/act_simple.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/act_skbedit.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/act_vlan.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/cls_basic.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/cls_bpf.ko 2024-03-16T20:34:43.819 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/cls_flow.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/cls_fw.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/cls_route.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/cls_u32.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/em_cmp.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/em_ipset.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/em_meta.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/em_nbyte.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/em_text.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/em_u32.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_choke.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_codel.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_drr.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_fq.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_gred.ko 2024-03-16T20:34:43.820 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_hfsc.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_hhf.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_htb.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_ingress.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_mqprio.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_mqprio_lib.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_multiq.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_netem.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_pie.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_plug.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_prio.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_qfq.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_red.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_sfb.ko 2024-03-16T20:34:43.821 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_sfq.ko 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_tbf.ko 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sched/sch_teql.ko 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sctp 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sctp/sctp.ko 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sctp/sctp_diag.ko 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sunrpc 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sunrpc/auth_gss 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sunrpc/sunrpc.ko 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sunrpc/xprtrdma 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/tipc 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/tipc/diag.ko 2024-03-16T20:34:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/tipc/tipc.ko 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/unix 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/unix/unix_diag.ko 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/vmw_vsock 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/vmw_vsock/vsock.ko 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/xfrm 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/security 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/security/keys 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/security/keys/encrypted-keys 2024-03-16T20:34:43.823 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/security/keys/trusted-keys 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/security/keys/trusted-keys/trusted.ko 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/virt 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/virt/lib 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/kernel/virt/lib/irqbypass.ko 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.alias 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.alias.bin 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.builtin 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.builtin.alias.bin 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.builtin.bin 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.builtin.modinfo 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.dep 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.dep.bin 2024-03-16T20:34:43.824 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.devname 2024-03-16T20:34:43.825 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.order 2024-03-16T20:34:43.825 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.softdep 2024-03-16T20:34:43.825 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.symbols 2024-03-16T20:34:43.825 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/modules.symbols.bin 2024-03-16T20:34:43.825 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.8.0-rc7-g3845b7ac715a/vmlinuz 2024-03-16T20:34:43.829 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-g3845b7ac715a 2024-03-16T20:34:43.829 DEBUG:teuthology.orchestra.run.smithi008:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-16T20:34:43.851 INFO:teuthology.orchestra.run.smithi008.stdout:postinstall scriptlet (using /bin/sh): 2024-03-16T20:34:43.851 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-16T20:34:43.851 INFO:teuthology.orchestra.run.smithi008.stdout: /usr/bin/kernel-install add 6.8.0-rc7-g3845b7ac715a /lib/modules/6.8.0-rc7-g3845b7ac715a/vmlinuz 2024-03-16T20:34:43.851 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2024-03-16T20:34:43.851 INFO:teuthology.orchestra.run.smithi008.stdout:for file in vmlinuz System.map config; do 2024-03-16T20:34:43.851 INFO:teuthology.orchestra.run.smithi008.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc7-g3845b7ac715a/${file}" "/boot/${file}-6.8.0-rc7-g3845b7ac715a"; then 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout: cp "/lib/modules/6.8.0-rc7-g3845b7ac715a/${file}" "/boot/${file}-6.8.0-rc7-g3845b7ac715a" 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout: fi 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:done 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:new-kernel-pkg --remove 6.8.0-rc7-g3845b7ac715a --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc7-g3845b7ac715a.img 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-install remove 6.8.0-rc7-g3845b7ac715a 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/update-bootloader --remove 6.8.0-rc7-g3845b7ac715a 2024-03-16T20:34:43.852 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2024-03-16T20:34:43.853 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2024-03-16T20:34:43.931 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2024-03-16T20:34:43.931 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2024-03-16T20:34:43.931 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.06 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 68.el9 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Group : Unspecified 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 8264254 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : builder@centos.org 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : CentOS 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-16T20:34:43.932 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2024-03-16T20:34:43.933 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2024-03-16T20:34:43.933 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:34:43.933 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-16T20:34:43.933 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-16T20:34:43.933 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-16T20:34:43.933 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2024-03-16T20:34:43.933 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:34:43.933 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2024-03-16T20:34:43.934 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-16T20:34:43.934 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 6.8.0-rc7-g3845b7ac715a 2024-03-16T20:34:43.934 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-16T20:34:44.513 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2024-03-16T20:34:45.953 INFO:teuthology.orchestra.run.smithi008.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-16T20:34:45.989 INFO:teuthology.orchestra.run.smithi008.stderr:done 2024-03-16T20:34:45.991 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2024-03-16T20:34:46.006 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.rklP8drQm5 2024-03-16T20:34:46.007 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rklP8drQm5 2024-03-16T20:34:46.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.rklP8drQm5 2024-03-16T20:34:46.225 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.rklP8drQm5 is 6KB 2024-03-16T20:34:46.248 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.rklP8drQm5 2024-03-16T20:34:46.263 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2024-03-16T20:34:46.331 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-16T20:34:46.331 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-16T20:34:46.331 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-16T20:34:46.332 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc7-g3845b7ac715a.conf 2024-03-16T20:34:46.333 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc7-g3845b7ac715a 2024-03-16T20:34:46.487 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2024-03-16T20:35:16.490 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-16T20:35:16.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-16T20:35:16.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T20:36:16.493 DEBUG:teuthology.orchestra.remote:timed out 2024-03-16T20:36:25.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-16T20:36:25.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T20:36:25.873 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-03-16T20:36:26.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-16T20:36:26.622 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc7-g3845b7ac715a"... 2024-03-16T20:36:26.622 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2024-03-16T20:36:26.661 INFO:teuthology.orchestra.run.smithi008.stdout:6.8.0-rc7-g3845b7ac715a 2024-03-16T20:36:26.661 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-g3845b7ac715a vs 6.8.0-rc7-g3845b7ac715a 2024-03-16T20:36:26.661 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-16T20:36:26.662 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-16T20:36:27.664 DEBUG:teuthology.parallel:result is None 2024-03-16T20:36:27.665 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-16T20:36:27.671 INFO:teuthology.task.internal:Creating test directory... 2024-03-16T20:36:27.671 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-16T20:36:27.679 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-16T20:36:27.682 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-16T20:36:27.718 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-16T20:36:27.726 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-16T20:36:27.766 INFO:teuthology.task.internal:Creating archive directory... 2024-03-16T20:36:27.766 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-16T20:36:27.773 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-16T20:36:27.775 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-16T20:36:27.821 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-16T20:36:27.828 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-16T20:36:27.829 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-16T20:36:27.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T20:36:27.868 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-16T20:36:27.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T20:36:27.884 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-16T20:36:27.891 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-16T20:36:27.911 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-16T20:36:27.943 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T20:36:27.964 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T20:36:27.987 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T20:36:28.008 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T20:36:28.026 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T20:36:28.106 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T20:36:28.111 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-16T20:36:28.118 INFO:teuthology.task.internal:Configuring sudo... 2024-03-16T20:36:28.118 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-16T20:36:28.124 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-16T20:36:28.126 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-16T20:36:28.208 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-16T20:36:28.217 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-16T20:36:28.217 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-16T20:36:28.224 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-16T20:36:28.227 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-16T20:36:28.268 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T20:36:28.343 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T20:36:28.443 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T20:36:28.514 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T20:36:28.601 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:36:28.601 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-16T20:36:28.728 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T20:36:28.772 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T20:36:28.834 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T20:36:28.876 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T20:36:28.921 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-03-16T20:36:28.921 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-16T20:36:28.989 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T20:36:29.035 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T20:36:29.096 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T20:36:29.140 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T20:36:29.184 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-16T20:36:29.184 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-16T20:36:29.253 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2024-03-16T20:36:29.259 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-03-16T20:36:29.262 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2024-03-16T20:36:29.298 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T20:36:29.329 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T20:36:29.379 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T20:36:29.671 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-16T20:36:29.679 INFO:teuthology.task.internal:Starting timer... 2024-03-16T20:36:29.679 INFO:teuthology.run_tasks:Running task pcp... 2024-03-16T20:36:29.728 INFO:teuthology.run_tasks:Running task selinux... 2024-03-16T20:36:29.761 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-03-16T20:36:29.761 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2024-03-16T20:36:29.871 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2024-03-16T20:36:29.875 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-03-16T20:36:29.939 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-03-16T20:36:29.941 DEBUG:teuthology.orchestra.run.smithi186:> sudo service auditd rotate 2024-03-16T20:36:29.987 INFO:teuthology.orchestra.run.smithi186.stdout:Rotating logs: 2024-03-16T20:36:29.989 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-16T20:36:29.989 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2024-03-16T20:36:30.047 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2024-03-16T20:36:30.047 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-03-16T20:36:30.073 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-03-16T20:36:30.074 DEBUG:teuthology.orchestra.run.smithi186:> /usr/sbin/getenforce 2024-03-16T20:36:30.098 INFO:teuthology.orchestra.run.smithi186.stdout:Permissive 2024-03-16T20:36:30.098 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi186.front.sepia.ceph.com': 'permissive'} 2024-03-16T20:36:30.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-16T20:36:30.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T20:36:30.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-16T20:36:30.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T20:36:30.211 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-16T20:36:30.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T20:36:30.240 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-16T20:36:30.240 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2024-03-16T20:36:30.351 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-03-16T20:36:30.392 DEBUG:teuthology.orchestra.run.smithi186:> sudo /usr/sbin/setenforce permissive 2024-03-16T20:36:30.425 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-16T20:36:30.436 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-16T20:36:30.441 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-16T20:36:30.572 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-16T20:36:30.589 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-16T20:36:30.590 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi170.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-16T20:42:32.643 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2024-03-16T20:42:32.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-16T20:42:32.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T20:42:32.789 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-03-16T20:42:32.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-16T20:42:32.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-03-16T20:42:32.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T20:42:33.030 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-03-16T20:42:33.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-03-16T20:42:33.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-03-16T20:42:33.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T20:42:33.187 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-03-16T20:42:33.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-03-16T20:42:33.259 INFO:teuthology.run_tasks:Running task clock... 2024-03-16T20:42:33.272 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-16T20:42:33.272 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-16T20:42:33.273 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T20:42:33.281 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-16T20:42:33.281 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T20:42:33.284 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-16T20:42:33.284 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T20:42:33.313 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-16T20:42:33.330 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-16T20:42:33.331 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-16T20:42:33.348 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-16T20:42:33.359 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-03-16T20:42:33.373 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-03-16T20:42:33.378 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: ntpd: command not found 2024-03-16T20:42:33.383 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-16T20:42:33.390 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-16T20:42:33.392 INFO:teuthology.orchestra.run.smithi186.stdout:506 Cannot talk to daemon 2024-03-16T20:42:33.406 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-16T20:42:33.409 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-16T20:42:33.425 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-16T20:42:33.438 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-16T20:42:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-03-16T20:42:33.453 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T20:42:33.453 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-03-16T20:42:33.453 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.453 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.453 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.453 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.469 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-03-16T20:42:33.472 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T20:42:33.472 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-03-16T20:42:33.472 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.472 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.472 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.472 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.537 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2024-03-16T20:42:33.582 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2024-03-16T20:42:33.637 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-16T20:42:33.693 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-16T20:42:33.828 INFO:teuthology.orchestra.run.smithi008.stderr:bash: line 1: ntpq: command not found 2024-03-16T20:42:33.838 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T20:42:33.838 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2024-03-16T20:42:33.838 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.838 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.838 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.838 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T20:42:33.839 INFO:teuthology.run_tasks:Running task install... 2024-03-16T20:42:33.847 DEBUG:teuthology.task.install:project ceph 2024-03-16T20:42:33.847 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b'}} 2024-03-16T20:42:33.847 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b'} 2024-03-16T20:42:33.848 INFO:teuthology.task.install:Using flavor: default 2024-03-16T20:42:33.855 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-16T20:42:33.855 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-16T20:42:33.855 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b', 'tag': None, 'wait_for_package': False} 2024-03-16T20:42:33.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:42:33.857 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b', 'tag': None, 'wait_for_package': False} 2024-03-16T20:42:33.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:42:33.858 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b', 'tag': None, 'wait_for_package': False} 2024-03-16T20:42:33.858 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:42:34.004 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/ 2024-03-16T20:42:34.004 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1681.gaba3c1d2 2024-03-16T20:42:34.081 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/ 2024-03-16T20:42:34.081 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1681.gaba3c1d2 2024-03-16T20:42:34.091 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/ 2024-03-16T20:42:34.091 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1681.gaba3c1d2 2024-03-16T20:42:34.115 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-16T20:42:34.115 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-03-16T20:42:34.115 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-16T20:42:34.150 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-16T20:42:34.150 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-16T20:42:34.190 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-16T20:42:34.190 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:42:34.190 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-16T20:42:34.201 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-16T20:42:34.201 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-16T20:42:34.201 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-16T20:42:34.218 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-16T20:42:34.232 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-16T20:42:34.232 DEBUG:teuthology.orchestra.run.smithi186:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-16T20:42:34.295 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-16T20:42:34.295 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-16T20:42:34.298 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-16T20:42:34.302 DEBUG:teuthology.orchestra.run.smithi186:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-16T20:42:34.365 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-03-16T20:42:34.367 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-03-16T20:42:34.384 DEBUG:teuthology.orchestra.run.smithi186:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-16T20:42:34.440 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-16T20:42:34.451 INFO:teuthology.orchestra.run.smithi186.stdout:check_obsoletes = 1 2024-03-16T20:42:34.453 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum clean all 2024-03-16T20:42:34.585 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-16T20:42:34.599 INFO:teuthology.orchestra.run.smithi170.stdout:74 files removed 2024-03-16T20:42:34.625 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-16T20:42:34.681 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2024-03-16T20:42:34.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2024-03-16T20:42:34.692 INFO:teuthology.orchestra.run.smithi186.stdout:74 files removed 2024-03-16T20:42:34.718 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-16T20:42:35.046 INFO:teuthology.orchestra.run.smithi008.stdout:74 files removed 2024-03-16T20:42:35.086 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-16T20:42:35.267 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 234 kB/s | 83 kB 00:00 2024-03-16T20:42:35.396 INFO:teuthology.orchestra.run.smithi186.stdout:ceph packages for x86_64 213 kB/s | 83 kB 00:00 2024-03-16T20:42:35.626 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 32 kB/s | 10 kB 00:00 2024-03-16T20:42:35.763 INFO:teuthology.orchestra.run.smithi186.stdout:ceph noarch packages 31 kB/s | 10 kB 00:00 2024-03-16T20:42:36.144 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-03-16T20:42:36.156 INFO:teuthology.orchestra.run.smithi186.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-03-16T20:42:36.169 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 149 kB/s | 83 kB 00:00 2024-03-16T20:42:36.525 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - AppStream 20 MB/s | 6.7 MB 00:00 2024-03-16T20:42:36.571 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - AppStream 17 MB/s | 6.7 MB 00:00 2024-03-16T20:42:36.678 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 24 kB/s | 10 kB 00:00 2024-03-16T20:42:37.270 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2024-03-16T20:42:37.882 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-16T20:42:37.900 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2024-03-16T20:42:37.980 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-03-16T20:42:38.783 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-03-16T20:42:39.198 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.0 MB 00:00 2024-03-16T20:42:39.524 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2024-03-16T20:42:41.138 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-03-16T20:42:41.195 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.0 MB 00:01 2024-03-16T20:42:41.859 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 19 MB 00:02 2024-03-16T20:42:43.246 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-03-16T20:42:45.971 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.1 MB 00:00 2024-03-16T20:42:47.286 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 15 kB 00:00 2024-03-16T20:42:47.930 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.1 MB 00:00 2024-03-16T20:42:48.648 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-03-16T20:42:48.797 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 6.1 MB 00:04 2024-03-16T20:42:50.051 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 15 kB 00:00 2024-03-16T20:42:50.273 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 15 kB 00:00 2024-03-16T20:42:51.524 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-03-16T20:42:51.900 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-03-16T20:42:53.754 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-03-16T20:42:56.209 INFO:teuthology.orchestra.run.smithi186.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T20:42:56.210 INFO:teuthology.orchestra.run.smithi186.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T20:42:56.224 INFO:teuthology.orchestra.run.smithi186.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-16T20:42:56.225 INFO:teuthology.orchestra.run.smithi186.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-16T20:42:56.226 INFO:teuthology.orchestra.run.smithi186.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-16T20:42:56.227 INFO:teuthology.orchestra.run.smithi186.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-16T20:42:56.229 INFO:teuthology.orchestra.run.smithi186.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-16T20:42:56.232 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-16T20:42:56.233 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-16T20:42:56.313 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-03-16T20:42:56.344 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================ 2024-03-16T20:42:56.344 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2024-03-16T20:42:56.344 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================ 2024-03-16T20:42:56.344 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-03-16T20:42:56.344 INFO:teuthology.orchestra.run.smithi186.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-16T20:42:56.344 INFO:teuthology.orchestra.run.smithi186.stdout: ceph x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 6.6 k 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 5.3 M 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 887 k 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 145 k 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 1.5 M 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 138 k 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 1.8 M 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 7.4 M 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 49 k 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 9.8 M 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 47 M 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 264 k 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 748 k 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 218 k 2024-03-16T20:42:56.345 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-shell x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 27 k 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 18 k 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 31 k 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 744 k 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 127 k 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-16T20:42:56.346 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 161 k 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 321 k 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 298 k 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 99 k 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 85 k 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.1 M 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 171 k 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrading: 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-16T20:42:56.347 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: librados2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.4 M 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.1 M 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-16T20:42:56.348 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 20 M 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 31 k 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 2.3 M 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 248 k 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 4.7 M 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 17 M 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 15 k 2024-03-16T20:42:56.349 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 25 k 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 163 k 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-16T20:42:56.350 INFO:teuthology.orchestra.run.smithi186.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 498 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 5.1 M 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-16T20:42:56.351 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 45 k 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 131 k 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-16T20:42:56.352 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-16T20:42:56.353 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-16T20:42:56.354 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-16T20:42:56.355 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-16T20:42:56.356 INFO:teuthology.orchestra.run.smithi186.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout:Installing weak dependencies: 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================ 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout:Install 150 Packages 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrade 24 Packages 2024-03-16T20:42:56.357 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:42:56.358 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 224 M 2024-03-16T20:42:56.358 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-03-16T20:42:56.499 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-16T20:42:56.969 INFO:teuthology.orchestra.run.smithi186.stdout:(1/174): ceph-19.0.0-1681.gaba3c1d2.el9.x86_64. 41 kB/s | 6.6 kB 00:00 2024-03-16T20:42:57.306 INFO:teuthology.orchestra.run.smithi186.stdout:(2/174): ceph-fuse-19.0.0-1681.gaba3c1d2.el9.x8 2.6 MB/s | 887 kB 00:00 2024-03-16T20:42:57.397 INFO:teuthology.orchestra.run.smithi186.stdout:(3/174): ceph-base-19.0.0-1681.gaba3c1d2.el9.x8 9.1 MB/s | 5.3 MB 00:00 2024-03-16T20:42:57.423 INFO:teuthology.orchestra.run.smithi186.stdout:(4/174): ceph-immutable-object-cache-19.0.0-168 1.2 MB/s | 145 kB 00:00 2024-03-16T20:42:57.598 INFO:teuthology.orchestra.run.smithi186.stdout:(5/174): ceph-mds-19.0.0-1681.gaba3c1d2.el9.x86 12 MB/s | 2.3 MB 00:00 2024-03-16T20:42:57.982 INFO:teuthology.orchestra.run.smithi186.stdout:(6/174): ceph-mgr-19.0.0-1681.gaba3c1d2.el9.x86 2.7 MB/s | 1.5 MB 00:00 2024-03-16T20:42:57.991 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-03-16T20:42:58.049 INFO:teuthology.orchestra.run.smithi186.stdout:(7/174): ceph-mon-19.0.0-1681.gaba3c1d2.el9.x86 10 MB/s | 4.7 MB 00:00 2024-03-16T20:42:58.824 INFO:teuthology.orchestra.run.smithi186.stdout:(8/174): ceph-common-19.0.0-1681.gaba3c1d2.el9. 10 MB/s | 20 MB 00:02 2024-03-16T20:42:58.882 INFO:teuthology.orchestra.run.smithi186.stdout:(9/174): ceph-selinux-19.0.0-1681.gaba3c1d2.el9 432 kB/s | 25 kB 00:00 2024-03-16T20:42:58.991 INFO:teuthology.orchestra.run.smithi186.stdout:(10/174): ceph-radosgw-19.0.0-1681.gaba3c1d2.el 10 MB/s | 9.8 MB 00:00 2024-03-16T20:42:59.013 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T20:42:59.014 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T20:42:59.029 INFO:teuthology.orchestra.run.smithi170.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-16T20:42:59.030 INFO:teuthology.orchestra.run.smithi170.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-16T20:42:59.031 INFO:teuthology.orchestra.run.smithi170.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-16T20:42:59.032 INFO:teuthology.orchestra.run.smithi170.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-16T20:42:59.034 INFO:teuthology.orchestra.run.smithi170.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-16T20:42:59.037 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-16T20:42:59.038 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-16T20:42:59.066 INFO:teuthology.orchestra.run.smithi186.stdout:(11/174): cephfs-mirror-19.0.0-1681.gaba3c1d2.e 2.9 MB/s | 218 kB 00:00 2024-03-16T20:42:59.121 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-03-16T20:42:59.125 INFO:teuthology.orchestra.run.smithi186.stdout:(12/174): cephfs-shell-19.0.0-1681.gaba3c1d2.el 462 kB/s | 27 kB 00:00 2024-03-16T20:42:59.132 INFO:teuthology.orchestra.run.smithi170.stdout:============================================================================================ 2024-03-16T20:42:59.132 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-03-16T20:42:59.132 INFO:teuthology.orchestra.run.smithi170.stdout:============================================================================================ 2024-03-16T20:42:59.132 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-03-16T20:42:59.132 INFO:teuthology.orchestra.run.smithi170.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-16T20:42:59.132 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 6.6 k 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 5.3 M 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 887 k 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 145 k 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 1.5 M 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 138 k 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 1.8 M 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 7.4 M 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 49 k 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 9.8 M 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 47 M 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 264 k 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 748 k 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 218 k 2024-03-16T20:42:59.133 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-shell x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 27 k 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 18 k 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 31 k 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 744 k 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 127 k 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-16T20:42:59.134 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 161 k 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 321 k 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 298 k 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 99 k 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 85 k 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.1 M 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 171 k 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-16T20:42:59.135 INFO:teuthology.orchestra.run.smithi170.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.4 M 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.1 M 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-16T20:42:59.136 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 20 M 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 31 k 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 2.3 M 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 248 k 2024-03-16T20:42:59.137 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 4.7 M 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 17 M 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 15 k 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 25 k 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-16T20:42:59.138 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 163 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 498 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 5.1 M 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-16T20:42:59.139 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-16T20:42:59.140 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 45 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 131 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-16T20:42:59.141 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-16T20:42:59.142 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-16T20:42:59.143 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-16T20:42:59.144 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout:============================================================================================ 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout:Install 150 Packages 2024-03-16T20:42:59.145 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 24 Packages 2024-03-16T20:42:59.146 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:42:59.146 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 224 M 2024-03-16T20:42:59.146 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-03-16T20:42:59.183 INFO:teuthology.orchestra.run.smithi186.stdout:(13/174): libcephfs-devel-19.0.0-1681.gaba3c1d2 537 kB/s | 31 kB 00:00 2024-03-16T20:42:59.301 INFO:teuthology.orchestra.run.smithi186.stdout:(14/174): libcephfs2-19.0.0-1681.gaba3c1d2.el9. 6.2 MB/s | 744 kB 00:00 2024-03-16T20:42:59.367 INFO:teuthology.orchestra.run.smithi186.stdout:(15/174): libcephsqlite-19.0.0-1681.gaba3c1d2.e 2.4 MB/s | 163 kB 00:00 2024-03-16T20:42:59.434 INFO:teuthology.orchestra.run.smithi186.stdout:(16/174): librados-devel-19.0.0-1681.gaba3c1d2. 1.9 MB/s | 127 kB 00:00 2024-03-16T20:42:59.526 INFO:teuthology.orchestra.run.smithi186.stdout:(17/174): libradosstriper1-19.0.0-1681.gaba3c1d 5.3 MB/s | 498 kB 00:00 2024-03-16T20:43:00.068 INFO:teuthology.orchestra.run.smithi186.stdout:(18/174): librgw2-19.0.0-1681.gaba3c1d2.el9.x86 9.5 MB/s | 5.1 MB 00:00 2024-03-16T20:43:00.127 INFO:teuthology.orchestra.run.smithi186.stdout:(19/174): python3-ceph-argparse-19.0.0-1681.gab 776 kB/s | 45 kB 00:00 2024-03-16T20:43:00.192 INFO:teuthology.orchestra.run.smithi170.stdout:(1/174): ceph-19.0.0-1681.gaba3c1d2.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-03-16T20:43:00.194 INFO:teuthology.orchestra.run.smithi186.stdout:(20/174): python3-ceph-common-19.0.0-1681.gaba3 1.9 MB/s | 131 kB 00:00 2024-03-16T20:43:00.269 INFO:teuthology.orchestra.run.smithi186.stdout:(21/174): python3-cephfs-19.0.0-1681.gaba3c1d2. 2.1 MB/s | 161 kB 00:00 2024-03-16T20:43:00.361 INFO:teuthology.orchestra.run.smithi186.stdout:(22/174): python3-rados-19.0.0-1681.gaba3c1d2.e 3.4 MB/s | 321 kB 00:00 2024-03-16T20:43:00.453 INFO:teuthology.orchestra.run.smithi186.stdout:(23/174): python3-rbd-19.0.0-1681.gaba3c1d2.el9 3.2 MB/s | 298 kB 00:00 2024-03-16T20:43:00.536 INFO:teuthology.orchestra.run.smithi186.stdout:(24/174): python3-rgw-19.0.0-1681.gaba3c1d2.el9 1.2 MB/s | 99 kB 00:00 2024-03-16T20:43:00.620 INFO:teuthology.orchestra.run.smithi186.stdout:(25/174): rbd-fuse-19.0.0-1681.gaba3c1d2.el9.x8 1.0 MB/s | 85 kB 00:00 2024-03-16T20:43:00.891 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T20:43:00.893 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T20:43:00.915 INFO:teuthology.orchestra.run.smithi008.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-16T20:43:00.917 INFO:teuthology.orchestra.run.smithi008.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-16T20:43:00.918 INFO:teuthology.orchestra.run.smithi008.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-16T20:43:00.920 INFO:teuthology.orchestra.run.smithi008.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-16T20:43:00.923 INFO:teuthology.orchestra.run.smithi008.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-16T20:43:00.926 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-16T20:43:00.928 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-16T20:43:01.029 INFO:teuthology.orchestra.run.smithi186.stdout:(26/174): rbd-mirror-19.0.0-1681.gaba3c1d2.el9. 7.6 MB/s | 3.1 MB 00:00 2024-03-16T20:43:01.030 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2024-03-16T20:43:01.047 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2024-03-16T20:43:01.047 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2024-03-16T20:43:01.047 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2024-03-16T20:43:01.047 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2024-03-16T20:43:01.047 INFO:teuthology.orchestra.run.smithi008.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 6.6 k 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 5.3 M 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 887 k 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 145 k 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 1.5 M 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 138 k 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 1.8 M 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 7.4 M 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 49 k 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 9.8 M 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 47 M 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 264 k 2024-03-16T20:43:01.048 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 748 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 218 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-shell x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 27 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 18 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 31 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 744 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 127 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-16T20:43:01.049 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 161 k 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 321 k 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 298 k 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 99 k 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 85 k 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.1 M 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 171 k 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-16T20:43:01.050 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-16T20:43:01.051 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-16T20:43:01.051 INFO:teuthology.orchestra.run.smithi008.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-16T20:43:01.051 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-16T20:43:01.051 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-16T20:43:01.051 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-16T20:43:01.051 INFO:teuthology.orchestra.run.smithi008.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-16T20:43:01.051 INFO:teuthology.orchestra.run.smithi008.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-16T20:43:01.051 INFO:teuthology.orchestra.run.smithi008.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-16T20:43:01.051 INFO:teuthology.orchestra.run.smithi008.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-16T20:43:01.051 INFO:teuthology.orchestra.run.smithi008.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-16T20:43:01.051 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.4 M 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.1 M 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-16T20:43:01.052 INFO:teuthology.orchestra.run.smithi008.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 20 M 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 31 k 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 2.3 M 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 248 k 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 4.7 M 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 17 M 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 15 k 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 25 k 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-16T20:43:01.053 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 163 k 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 498 k 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 5.1 M 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-16T20:43:01.054 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-16T20:43:01.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 45 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 131 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-16T20:43:01.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-16T20:43:01.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-16T20:43:01.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-16T20:43:01.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout:Installing weak dependencies: 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:43:01.060 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2024-03-16T20:43:01.061 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2024-03-16T20:43:01.061 INFO:teuthology.orchestra.run.smithi008.stdout:Install 150 Packages 2024-03-16T20:43:01.061 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 24 Packages 2024-03-16T20:43:01.061 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:43:01.061 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 224 M 2024-03-16T20:43:01.061 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2024-03-16T20:43:01.095 INFO:teuthology.orchestra.run.smithi186.stdout:(27/174): rbd-nbd-19.0.0-1681.gaba3c1d2.el9.x86 2.5 MB/s | 171 kB 00:00 2024-03-16T20:43:01.162 INFO:teuthology.orchestra.run.smithi186.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1681.g 472 kB/s | 31 kB 00:00 2024-03-16T20:43:01.221 INFO:teuthology.orchestra.run.smithi186.stdout:(29/174): ceph-mgr-cephadm-19.0.0-1681.gaba3c1d 2.3 MB/s | 138 kB 00:00 2024-03-16T20:43:01.225 INFO:teuthology.orchestra.run.smithi170.stdout:(2/174): ceph-base-19.0.0-1681.gaba3c1d2.el9.x8 4.0 MB/s | 5.3 MB 00:01 2024-03-16T20:43:01.250 INFO:teuthology.orchestra.run.smithi170.stdout:(3/174): ceph-fuse-19.0.0-1681.gaba3c1d2.el9.x8 838 kB/s | 887 kB 00:01 2024-03-16T20:43:01.309 INFO:teuthology.orchestra.run.smithi170.stdout:(4/174): ceph-immutable-object-cache-19.0.0-168 1.7 MB/s | 145 kB 00:00 2024-03-16T20:43:01.480 INFO:teuthology.orchestra.run.smithi186.stdout:(30/174): ceph-mgr-dashboard-19.0.0-1681.gaba3c 6.9 MB/s | 1.8 MB 00:00 2024-03-16T20:43:01.717 INFO:teuthology.orchestra.run.smithi170.stdout:(5/174): ceph-mgr-19.0.0-1681.gaba3c1d2.el9.x86 3.6 MB/s | 1.5 MB 00:00 2024-03-16T20:43:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:(1/174): ceph-19.0.0-1681.gaba3c1d2.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-03-16T20:43:02.063 INFO:teuthology.orchestra.run.smithi186.stdout:(31/174): ceph-osd-19.0.0-1681.gaba3c1d2.el9.x8 4.1 MB/s | 17 MB 00:04 2024-03-16T20:43:02.238 INFO:teuthology.orchestra.run.smithi186.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1681.gab 1.4 MB/s | 248 kB 00:00 2024-03-16T20:43:02.330 INFO:teuthology.orchestra.run.smithi186.stdout:(33/174): ceph-mgr-rook-19.0.0-1681.gaba3c1d2.e 539 kB/s | 49 kB 00:00 2024-03-16T20:43:02.464 INFO:teuthology.orchestra.run.smithi186.stdout:(34/174): ceph-mgr-diskprediction-local-19.0.0- 7.5 MB/s | 7.4 MB 00:00 2024-03-16T20:43:02.481 INFO:teuthology.orchestra.run.smithi186.stdout:(35/174): ceph-prometheus-alerts-19.0.0-1681.ga 102 kB/s | 15 kB 00:00 2024-03-16T20:43:02.567 INFO:teuthology.orchestra.run.smithi170.stdout:(6/174): ceph-mon-19.0.0-1681.gaba3c1d2.el9.x86 5.5 MB/s | 4.7 MB 00:00 2024-03-16T20:43:02.634 INFO:teuthology.orchestra.run.smithi008.stdout:(2/174): ceph-fuse-19.0.0-1681.gaba3c1d2.el9.x8 1.3 MB/s | 887 kB 00:00 2024-03-16T20:43:02.726 INFO:teuthology.orchestra.run.smithi008.stdout:(3/174): ceph-immutable-object-cache-19.0.0-168 1.6 MB/s | 145 kB 00:00 2024-03-16T20:43:02.890 INFO:teuthology.orchestra.run.smithi186.stdout:(36/174): ceph-test-19.0.0-1681.gaba3c1d2.el9.x 12 MB/s | 47 MB 00:04 2024-03-16T20:43:02.915 INFO:teuthology.orchestra.run.smithi186.stdout:(37/174): ceph-volume-19.0.0-1681.gaba3c1d2.el9 586 kB/s | 264 kB 00:00 2024-03-16T20:43:02.957 INFO:teuthology.orchestra.run.smithi186.stdout:(38/174): cephadm-19.0.0-1681.gaba3c1d2.el9.noa 1.5 MB/s | 748 kB 00:00 2024-03-16T20:43:02.999 INFO:teuthology.orchestra.run.smithi186.stdout:(39/174): cephfs-top-19.0.0-1681.gaba3c1d2.el9. 168 kB/s | 18 kB 00:00 2024-03-16T20:43:03.099 INFO:teuthology.orchestra.run.smithi186.stdout:(40/174): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 662 kB 00:00 2024-03-16T20:43:03.125 INFO:teuthology.orchestra.run.smithi186.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 106 kB 00:00 2024-03-16T20:43:03.158 INFO:teuthology.orchestra.run.smithi186.stdout:(42/174): bison-3.7.4-5.el9.x86_64.rpm 5.1 MB/s | 920 kB 00:00 2024-03-16T20:43:03.168 INFO:teuthology.orchestra.run.smithi170.stdout:(7/174): ceph-mds-19.0.0-1681.gaba3c1d2.el9.x86 1.2 MB/s | 2.3 MB 00:01 2024-03-16T20:43:03.183 INFO:teuthology.orchestra.run.smithi186.stdout:(43/174): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2024-03-16T20:43:03.200 INFO:teuthology.orchestra.run.smithi186.stdout:(44/174): flexiblas-3.0.4-8.el9.x86_64.rpm 425 kB/s | 32 kB 00:00 2024-03-16T20:43:03.217 INFO:teuthology.orchestra.run.smithi186.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 511 kB/s | 17 kB 00:00 2024-03-16T20:43:03.292 INFO:teuthology.orchestra.run.smithi186.stdout:(46/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 27 MB/s | 3.0 MB 00:00 2024-03-16T20:43:03.309 INFO:teuthology.orchestra.run.smithi186.stdout:(47/174): libaio-devel-0.3.111-13.el9.x86_64.rp 93 kB/s | 10 kB 00:00 2024-03-16T20:43:03.334 INFO:teuthology.orchestra.run.smithi186.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 159 kB 00:00 2024-03-16T20:43:03.351 INFO:teuthology.orchestra.run.smithi186.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-16T20:43:03.385 INFO:teuthology.orchestra.run.smithi186.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-16T20:43:03.419 INFO:teuthology.orchestra.run.smithi186.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 578 kB 00:00 2024-03-16T20:43:03.444 INFO:teuthology.orchestra.run.smithi186.stdout:(52/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 805 kB/s | 46 kB 00:00 2024-03-16T20:43:03.469 INFO:teuthology.orchestra.run.smithi186.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2024-03-16T20:43:03.477 INFO:teuthology.orchestra.run.smithi008.stdout:(4/174): ceph-mds-19.0.0-1681.gaba3c1d2.el9.x86 3.1 MB/s | 2.3 MB 00:00 2024-03-16T20:43:03.494 INFO:teuthology.orchestra.run.smithi186.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2024-03-16T20:43:03.519 INFO:teuthology.orchestra.run.smithi186.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 686 kB/s | 34 kB 00:00 2024-03-16T20:43:03.553 INFO:teuthology.orchestra.run.smithi186.stdout:(56/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.5 MB/s | 217 kB 00:00 2024-03-16T20:43:03.602 INFO:teuthology.orchestra.run.smithi008.stdout:(5/174): ceph-base-19.0.0-1681.gaba3c1d2.el9.x8 2.6 MB/s | 5.3 MB 00:02 2024-03-16T20:43:03.628 INFO:teuthology.orchestra.run.smithi186.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 35 MB/s | 4.7 MB 00:00 2024-03-16T20:43:03.671 INFO:teuthology.orchestra.run.smithi186.stdout:(58/174): postgresql-13.11-1.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2024-03-16T20:43:03.695 INFO:teuthology.orchestra.run.smithi186.stdout:(59/174): postgresql-contrib-13.11-1.el9.x86_64 5.7 MB/s | 811 kB 00:00 2024-03-16T20:43:03.719 INFO:teuthology.orchestra.run.smithi186.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.5 MB/s | 134 kB 00:00 2024-03-16T20:43:03.752 INFO:teuthology.orchestra.run.smithi186.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 18 MB/s | 1.0 MB 00:00 2024-03-16T20:43:03.861 INFO:teuthology.orchestra.run.smithi186.stdout:(62/174): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2024-03-16T20:43:03.887 INFO:teuthology.orchestra.run.smithi186.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 463 kB/s | 78 kB 00:00 2024-03-16T20:43:03.986 INFO:teuthology.orchestra.run.smithi008.stdout:(6/174): ceph-mgr-19.0.0-1681.gaba3c1d2.el9.x86 2.9 MB/s | 1.5 MB 00:00 2024-03-16T20:43:03.987 INFO:teuthology.orchestra.run.smithi186.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 5.8 MB 00:00 2024-03-16T20:43:04.013 INFO:teuthology.orchestra.run.smithi186.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 165 kB/s | 24 kB 00:00 2024-03-16T20:43:04.038 INFO:teuthology.orchestra.run.smithi186.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 122 kB/s | 18 kB 00:00 2024-03-16T20:43:04.063 INFO:teuthology.orchestra.run.smithi186.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-03-16T20:43:04.088 INFO:teuthology.orchestra.run.smithi186.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 634 kB/s | 32 kB 00:00 2024-03-16T20:43:04.172 INFO:teuthology.orchestra.run.smithi186.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2024-03-16T20:43:04.197 INFO:teuthology.orchestra.run.smithi186.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2024-03-16T20:43:04.222 INFO:teuthology.orchestra.run.smithi186.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2024-03-16T20:43:04.247 INFO:teuthology.orchestra.run.smithi186.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 920 kB/s | 69 kB 00:00 2024-03-16T20:43:04.273 INFO:teuthology.orchestra.run.smithi186.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 825 kB/s | 41 kB 00:00 2024-03-16T20:43:04.298 INFO:teuthology.orchestra.run.smithi186.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-16T20:43:04.323 INFO:teuthology.orchestra.run.smithi186.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-16T20:43:04.340 INFO:teuthology.orchestra.run.smithi186.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-16T20:43:04.365 INFO:teuthology.orchestra.run.smithi186.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-03-16T20:43:04.382 INFO:teuthology.orchestra.run.smithi186.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 729 kB/s | 43 kB 00:00 2024-03-16T20:43:04.527 INFO:teuthology.orchestra.run.smithi008.stdout:(7/174): ceph-mon-19.0.0-1681.gaba3c1d2.el9.x86 5.1 MB/s | 4.7 MB 00:00 2024-03-16T20:43:04.549 INFO:teuthology.orchestra.run.smithi186.stdout:(79/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 250 kB/s | 41 kB 00:00 2024-03-16T20:43:04.566 INFO:teuthology.orchestra.run.smithi186.stdout:(80/174): python3-toml-0.10.2-6.el9.noarch.rpm 214 kB/s | 39 kB 00:00 2024-03-16T20:43:04.717 INFO:teuthology.orchestra.run.smithi186.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-03-16T20:43:04.742 INFO:teuthology.orchestra.run.smithi186.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 300 kB 00:00 2024-03-16T20:43:04.758 INFO:teuthology.orchestra.run.smithi186.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 295 kB/s | 56 kB 00:00 2024-03-16T20:43:04.776 INFO:teuthology.orchestra.run.smithi186.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-03-16T20:43:04.793 INFO:teuthology.orchestra.run.smithi186.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2024-03-16T20:43:04.795 INFO:teuthology.orchestra.run.smithi008.stdout:(8/174): ceph-common-19.0.0-1681.gaba3c1d2.el9. 6.3 MB/s | 20 MB 00:03 2024-03-16T20:43:04.817 INFO:teuthology.orchestra.run.smithi186.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-16T20:43:04.836 INFO:teuthology.orchestra.run.smithi008.stdout:(9/174): ceph-selinux-19.0.0-1681.gaba3c1d2.el9 624 kB/s | 25 kB 00:00 2024-03-16T20:43:04.843 INFO:teuthology.orchestra.run.smithi186.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-16T20:43:04.876 INFO:teuthology.orchestra.run.smithi186.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-16T20:43:04.901 INFO:teuthology.orchestra.run.smithi170.stdout:(8/174): ceph-osd-19.0.0-1681.gaba3c1d2.el9.x86 7.2 MB/s | 17 MB 00:02 2024-03-16T20:43:04.901 INFO:teuthology.orchestra.run.smithi186.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-16T20:43:04.927 INFO:teuthology.orchestra.run.smithi186.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-16T20:43:04.952 INFO:teuthology.orchestra.run.smithi186.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2024-03-16T20:43:05.001 INFO:teuthology.orchestra.run.smithi170.stdout:(9/174): ceph-selinux-19.0.0-1681.gaba3c1d2.el9 252 kB/s | 25 kB 00:00 2024-03-16T20:43:05.086 INFO:teuthology.orchestra.run.smithi186.stdout:(92/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-03-16T20:43:05.111 INFO:teuthology.orchestra.run.smithi186.stdout:(93/174): jq-1.6-16.el9.x86_64.rpm 895 kB/s | 187 kB 00:00 2024-03-16T20:43:05.137 INFO:teuthology.orchestra.run.smithi186.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-03-16T20:43:05.162 INFO:teuthology.orchestra.run.smithi186.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.7 MB/s | 803 kB 00:00 2024-03-16T20:43:05.254 INFO:teuthology.orchestra.run.smithi186.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 151 kB/s | 21 kB 00:00 2024-03-16T20:43:05.270 INFO:teuthology.orchestra.run.smithi186.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 190 kB/s | 25 kB 00:00 2024-03-16T20:43:05.396 INFO:teuthology.orchestra.run.smithi186.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-03-16T20:43:05.421 INFO:teuthology.orchestra.run.smithi186.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-03-16T20:43:05.454 INFO:teuthology.orchestra.run.smithi186.stdout:(100/174): qatlib-23.11.0-1.el9.x86_64.rpm 3.6 MB/s | 216 kB 00:00 2024-03-16T20:43:05.471 INFO:teuthology.orchestra.run.smithi186.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 694 kB/s | 35 kB 00:00 2024-03-16T20:43:05.513 INFO:teuthology.orchestra.run.smithi186.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 760 kB/s | 44 kB 00:00 2024-03-16T20:43:05.567 INFO:teuthology.orchestra.run.smithi186.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 987 kB/s | 94 kB 00:00 2024-03-16T20:43:05.739 INFO:teuthology.orchestra.run.smithi186.stdout:(104/174): openssl-devel-3.0.7-27.el9.x86_64.rp 7.2 MB/s | 4.1 MB 00:00 2024-03-16T20:43:05.773 INFO:teuthology.orchestra.run.smithi186.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 86 kB/s | 22 kB 00:00 2024-03-16T20:43:05.915 INFO:teuthology.orchestra.run.smithi186.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-03-16T20:43:05.962 INFO:teuthology.orchestra.run.smithi008.stdout:(10/174): ceph-radosgw-19.0.0-1681.gaba3c1d2.el 6.8 MB/s | 9.8 MB 00:01 2024-03-16T20:43:06.062 INFO:teuthology.orchestra.run.smithi008.stdout:(11/174): cephfs-mirror-19.0.0-1681.gaba3c1d2.e 2.2 MB/s | 218 kB 00:00 2024-03-16T20:43:06.154 INFO:teuthology.orchestra.run.smithi008.stdout:(12/174): cephfs-shell-19.0.0-1681.gaba3c1d2.el 298 kB/s | 27 kB 00:00 2024-03-16T20:43:06.173 INFO:teuthology.orchestra.run.smithi186.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-03-16T20:43:06.206 INFO:teuthology.orchestra.run.smithi186.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-03-16T20:43:06.232 INFO:teuthology.orchestra.run.smithi186.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 673 kB/s | 309 kB 00:00 2024-03-16T20:43:06.282 INFO:teuthology.orchestra.run.smithi186.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-03-16T20:43:06.307 INFO:teuthology.orchestra.run.smithi186.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 644 kB/s | 49 kB 00:00 2024-03-16T20:43:06.350 INFO:teuthology.orchestra.run.smithi186.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-03-16T20:43:06.400 INFO:teuthology.orchestra.run.smithi186.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-03-16T20:43:06.421 INFO:teuthology.orchestra.run.smithi008.stdout:(13/174): ceph-osd-19.0.0-1681.gaba3c1d2.el9.x8 6.9 MB/s | 17 MB 00:02 2024-03-16T20:43:06.438 INFO:teuthology.orchestra.run.smithi008.stdout:(14/174): libcephfs-devel-19.0.0-1681.gaba3c1d2 111 kB/s | 31 kB 00:00 2024-03-16T20:43:06.485 INFO:teuthology.orchestra.run.smithi186.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.1 MB/s | 838 kB 00:00 2024-03-16T20:43:06.521 INFO:teuthology.orchestra.run.smithi008.stdout:(15/174): libcephsqlite-19.0.0-1681.gaba3c1d2.e 1.9 MB/s | 163 kB 00:00 2024-03-16T20:43:06.559 INFO:teuthology.orchestra.run.smithi186.stdout:(115/174): python3-asyncssh-2.13.2-4.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-03-16T20:43:06.584 INFO:teuthology.orchestra.run.smithi186.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 433 kB/s | 43 kB 00:00 2024-03-16T20:43:06.592 INFO:teuthology.orchestra.run.smithi008.stdout:(16/174): libcephfs2-19.0.0-1681.gaba3c1d2.el9. 4.3 MB/s | 744 kB 00:00 2024-03-16T20:43:06.622 INFO:teuthology.orchestra.run.smithi008.stdout:(17/174): librados-devel-19.0.0-1681.gaba3c1d2. 1.2 MB/s | 127 kB 00:00 2024-03-16T20:43:06.628 INFO:teuthology.orchestra.run.smithi186.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 469 kB/s | 32 kB 00:00 2024-03-16T20:43:06.703 INFO:teuthology.orchestra.run.smithi186.stdout:(118/174): libarrow-9.0.0-10.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-03-16T20:43:06.714 INFO:teuthology.orchestra.run.smithi008.stdout:(18/174): libradosstriper1-19.0.0-1681.gaba3c1d 4.0 MB/s | 498 kB 00:00 2024-03-16T20:43:06.720 INFO:teuthology.orchestra.run.smithi186.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 110 kB/s | 15 kB 00:00 2024-03-16T20:43:06.745 INFO:teuthology.orchestra.run.smithi186.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-03-16T20:43:06.787 INFO:teuthology.orchestra.run.smithi186.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-03-16T20:43:06.789 INFO:teuthology.orchestra.run.smithi008.stdout:(19/174): python3-ceph-argparse-19.0.0-1681.gab 610 kB/s | 45 kB 00:00 2024-03-16T20:43:06.821 INFO:teuthology.orchestra.run.smithi186.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-03-16T20:43:06.838 INFO:teuthology.orchestra.run.smithi186.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 381 kB/s | 35 kB 00:00 2024-03-16T20:43:06.863 INFO:teuthology.orchestra.run.smithi186.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-03-16T20:43:06.873 INFO:teuthology.orchestra.run.smithi008.stdout:(20/174): python3-ceph-common-19.0.0-1681.gaba3 1.6 MB/s | 131 kB 00:00 2024-03-16T20:43:06.939 INFO:teuthology.orchestra.run.smithi186.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-03-16T20:43:06.955 INFO:teuthology.orchestra.run.smithi186.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-03-16T20:43:06.956 INFO:teuthology.orchestra.run.smithi008.stdout:(21/174): python3-cephfs-19.0.0-1681.gaba3c1d2. 1.9 MB/s | 161 kB 00:00 2024-03-16T20:43:06.981 INFO:teuthology.orchestra.run.smithi186.stdout:(127/174): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-03-16T20:43:07.014 INFO:teuthology.orchestra.run.smithi186.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-03-16T20:43:07.031 INFO:teuthology.orchestra.run.smithi186.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-03-16T20:43:07.048 INFO:teuthology.orchestra.run.smithi186.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 288 kB/s | 19 kB 00:00 2024-03-16T20:43:07.065 INFO:teuthology.orchestra.run.smithi008.stdout:(22/174): python3-rados-19.0.0-1681.gaba3c1d2.e 2.9 MB/s | 321 kB 00:00 2024-03-16T20:43:07.082 INFO:teuthology.orchestra.run.smithi186.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-03-16T20:43:07.124 INFO:teuthology.orchestra.run.smithi186.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-03-16T20:43:07.149 INFO:teuthology.orchestra.run.smithi186.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 461 kB/s | 46 kB 00:00 2024-03-16T20:43:07.157 INFO:teuthology.orchestra.run.smithi008.stdout:(23/174): python3-rbd-19.0.0-1681.gaba3c1d2.el9 3.2 MB/s | 298 kB 00:00 2024-03-16T20:43:07.174 INFO:teuthology.orchestra.run.smithi186.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 854 kB/s | 79 kB 00:00 2024-03-16T20:43:07.231 INFO:teuthology.orchestra.run.smithi186.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 542 kB/s | 58 kB 00:00 2024-03-16T20:43:07.232 INFO:teuthology.orchestra.run.smithi008.stdout:(24/174): python3-rgw-19.0.0-1681.gaba3c1d2.el9 1.3 MB/s | 99 kB 00:00 2024-03-16T20:43:07.258 INFO:teuthology.orchestra.run.smithi186.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-03-16T20:43:07.284 INFO:teuthology.orchestra.run.smithi186.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-03-16T20:43:07.307 INFO:teuthology.orchestra.run.smithi008.stdout:(25/174): rbd-fuse-19.0.0-1681.gaba3c1d2.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-16T20:43:07.309 INFO:teuthology.orchestra.run.smithi186.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-03-16T20:43:07.334 INFO:teuthology.orchestra.run.smithi186.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-03-16T20:43:07.359 INFO:teuthology.orchestra.run.smithi186.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-03-16T20:43:07.385 INFO:teuthology.orchestra.run.smithi186.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-16T20:43:07.410 INFO:teuthology.orchestra.run.smithi186.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-03-16T20:43:07.416 INFO:teuthology.orchestra.run.smithi008.stdout:(26/174): librgw2-19.0.0-1681.gaba3c1d2.el9.x86 6.5 MB/s | 5.1 MB 00:00 2024-03-16T20:43:07.435 INFO:teuthology.orchestra.run.smithi186.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 472 kB/s | 36 kB 00:00 2024-03-16T20:43:07.460 INFO:teuthology.orchestra.run.smithi186.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-03-16T20:43:07.486 INFO:teuthology.orchestra.run.smithi186.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-16T20:43:07.511 INFO:teuthology.orchestra.run.smithi186.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-16T20:43:07.525 INFO:teuthology.orchestra.run.smithi008.stdout:(27/174): rbd-nbd-19.0.0-1681.gaba3c1d2.el9.x86 1.6 MB/s | 171 kB 00:00 2024-03-16T20:43:07.545 INFO:teuthology.orchestra.run.smithi186.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-03-16T20:43:07.570 INFO:teuthology.orchestra.run.smithi186.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-03-16T20:43:07.595 INFO:teuthology.orchestra.run.smithi186.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-03-16T20:43:07.625 INFO:teuthology.orchestra.run.smithi008.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1681.g 317 kB/s | 31 kB 00:00 2024-03-16T20:43:07.645 INFO:teuthology.orchestra.run.smithi186.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-03-16T20:43:07.709 INFO:teuthology.orchestra.run.smithi008.stdout:(29/174): rbd-mirror-19.0.0-1681.gaba3c1d2.el9. 7.7 MB/s | 3.1 MB 00:00 2024-03-16T20:43:07.742 INFO:teuthology.orchestra.run.smithi008.stdout:(30/174): ceph-mgr-cephadm-19.0.0-1681.gaba3c1d 1.2 MB/s | 138 kB 00:00 2024-03-16T20:43:07.812 INFO:teuthology.orchestra.run.smithi186.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 2.7 MB/s | 321 kB 00:00 2024-03-16T20:43:08.009 INFO:teuthology.orchestra.run.smithi008.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1681.gaba3c 6.0 MB/s | 1.8 MB 00:00 2024-03-16T20:43:08.063 INFO:teuthology.orchestra.run.smithi186.stdout:(152/174): NetworkManager-1.46.0-1.el9.x86_64.r 9.2 MB/s | 2.3 MB 00:00 2024-03-16T20:43:08.109 INFO:teuthology.orchestra.run.smithi008.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1681.gab 2.4 MB/s | 248 kB 00:00 2024-03-16T20:43:08.138 INFO:teuthology.orchestra.run.smithi186.stdout:(153/174): NetworkManager-libnm-1.46.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-03-16T20:43:08.188 INFO:teuthology.orchestra.run.smithi186.stdout:(154/174): NetworkManager-team-1.46.0-1.el9.x86 847 kB/s | 42 kB 00:00 2024-03-16T20:43:08.201 INFO:teuthology.orchestra.run.smithi008.stdout:(33/174): ceph-mgr-rook-19.0.0-1681.gaba3c1d2.e 544 kB/s | 49 kB 00:00 2024-03-16T20:43:08.239 INFO:teuthology.orchestra.run.smithi186.stdout:(155/174): NetworkManager-tui-1.46.0-1.el9.x86_ 4.8 MB/s | 248 kB 00:00 2024-03-16T20:43:08.281 INFO:teuthology.orchestra.run.smithi186.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-03-16T20:43:08.285 INFO:teuthology.orchestra.run.smithi008.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1681.ga 186 kB/s | 15 kB 00:00 2024-03-16T20:43:08.331 INFO:teuthology.orchestra.run.smithi186.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 729 kB/s | 36 kB 00:00 2024-03-16T20:43:08.381 INFO:teuthology.orchestra.run.smithi186.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2024-03-16T20:43:08.410 INFO:teuthology.orchestra.run.smithi008.stdout:(35/174): ceph-volume-19.0.0-1681.gaba3c1d2.el9 2.1 MB/s | 264 kB 00:00 2024-03-16T20:43:08.431 INFO:teuthology.orchestra.run.smithi186.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-03-16T20:43:08.482 INFO:teuthology.orchestra.run.smithi186.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 461 kB/s | 23 kB 00:00 2024-03-16T20:43:08.532 INFO:teuthology.orchestra.run.smithi186.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-16T20:43:08.582 INFO:teuthology.orchestra.run.smithi186.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-03-16T20:43:08.633 INFO:teuthology.orchestra.run.smithi186.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 136 kB 00:00 2024-03-16T20:43:08.675 INFO:teuthology.orchestra.run.smithi186.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-03-16T20:43:08.678 INFO:teuthology.orchestra.run.smithi008.stdout:(36/174): cephadm-19.0.0-1681.gaba3c1d2.el9.noa 2.7 MB/s | 748 kB 00:00 2024-03-16T20:43:08.716 INFO:teuthology.orchestra.run.smithi186.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 694 kB/s | 29 kB 00:00 2024-03-16T20:43:08.728 INFO:teuthology.orchestra.run.smithi008.stdout:(37/174): cephfs-top-19.0.0-1681.gaba3c1d2.el9. 373 kB/s | 18 kB 00:00 2024-03-16T20:43:08.783 INFO:teuthology.orchestra.run.smithi186.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 18 MB/s | 1.2 MB 00:00 2024-03-16T20:43:08.867 INFO:teuthology.orchestra.run.smithi186.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 26 MB/s | 2.2 MB 00:00 2024-03-16T20:43:08.868 INFO:teuthology.orchestra.run.smithi170.stdout:(10/174): ceph-common-19.0.0-1681.gaba3c1d2.el9 2.3 MB/s | 20 MB 00:08 2024-03-16T20:43:08.886 INFO:teuthology.orchestra.run.smithi008.stdout:(38/174): ceph-mgr-diskprediction-local-19.0.0- 6.5 MB/s | 7.4 MB 00:01 2024-03-16T20:43:08.951 INFO:teuthology.orchestra.run.smithi186.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 27 MB/s | 2.3 MB 00:00 2024-03-16T20:43:09.001 INFO:teuthology.orchestra.run.smithi186.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 9.1 MB/s | 465 kB 00:00 2024-03-16T20:43:09.051 INFO:teuthology.orchestra.run.smithi186.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 622 kB/s | 31 kB 00:00 2024-03-16T20:43:09.060 INFO:teuthology.orchestra.run.smithi170.stdout:(11/174): ceph-radosgw-19.0.0-1681.gaba3c1d2.el 1.7 MB/s | 9.8 MB 00:05 2024-03-16T20:43:09.085 INFO:teuthology.orchestra.run.smithi170.stdout:(12/174): cephfs-mirror-19.0.0-1681.gaba3c1d2.e 1.0 MB/s | 218 kB 00:00 2024-03-16T20:43:09.120 INFO:teuthology.orchestra.run.smithi008.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 662 kB 00:00 2024-03-16T20:43:09.126 INFO:teuthology.orchestra.run.smithi186.stdout:(171/174): librbd1-19.0.0-1681.gaba3c1d2.el9.x8 2.0 MB/s | 3.1 MB 00:01 2024-03-16T20:43:09.127 INFO:teuthology.orchestra.run.smithi170.stdout:(13/174): cephfs-shell-19.0.0-1681.gaba3c1d2.el 405 kB/s | 27 kB 00:00 2024-03-16T20:43:09.152 INFO:teuthology.orchestra.run.smithi170.stdout:(14/174): libcephfs-devel-19.0.0-1681.gaba3c1d2 468 kB/s | 31 kB 00:00 2024-03-16T20:43:09.160 INFO:teuthology.orchestra.run.smithi186.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 9.9 MB/s | 1.1 MB 00:00 2024-03-16T20:43:09.170 INFO:teuthology.orchestra.run.smithi008.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 920 kB 00:00 2024-03-16T20:43:09.196 INFO:teuthology.orchestra.run.smithi008.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2024-03-16T20:43:09.229 INFO:teuthology.orchestra.run.smithi008.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 307 kB 00:00 2024-03-16T20:43:09.252 INFO:teuthology.orchestra.run.smithi186.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 594 kB/s | 74 kB 00:00 2024-03-16T20:43:09.252 INFO:teuthology.orchestra.run.smithi170.stdout:(15/174): libcephsqlite-19.0.0-1681.gaba3c1d2.e 1.6 MB/s | 163 kB 00:00 2024-03-16T20:43:09.263 INFO:teuthology.orchestra.run.smithi008.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 499 kB/s | 32 kB 00:00 2024-03-16T20:43:09.319 INFO:teuthology.orchestra.run.smithi170.stdout:(16/174): librados-devel-19.0.0-1681.gaba3c1d2. 1.9 MB/s | 127 kB 00:00 2024-03-16T20:43:09.380 INFO:teuthology.orchestra.run.smithi008.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2024-03-16T20:43:09.405 INFO:teuthology.orchestra.run.smithi008.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 138 kB/s | 17 kB 00:00 2024-03-16T20:43:09.439 INFO:teuthology.orchestra.run.smithi008.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 314 kB/s | 10 kB 00:00 2024-03-16T20:43:09.444 INFO:teuthology.orchestra.run.smithi170.stdout:(17/174): libcephfs2-19.0.0-1681.gaba3c1d2.el9. 2.3 MB/s | 744 kB 00:00 2024-03-16T20:43:09.464 INFO:teuthology.orchestra.run.smithi008.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-16T20:43:09.489 INFO:teuthology.orchestra.run.smithi008.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 919 kB/s | 44 kB 00:00 2024-03-16T20:43:09.511 INFO:teuthology.orchestra.run.smithi170.stdout:(18/174): libradosstriper1-19.0.0-1681.gaba3c1d 2.5 MB/s | 498 kB 00:00 2024-03-16T20:43:09.531 INFO:teuthology.orchestra.run.smithi008.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2024-03-16T20:43:09.570 INFO:teuthology.orchestra.run.smithi170.stdout:(19/174): python3-ceph-argparse-19.0.0-1681.gab 774 kB/s | 45 kB 00:00 2024-03-16T20:43:09.573 INFO:teuthology.orchestra.run.smithi008.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 7.4 MB/s | 578 kB 00:00 2024-03-16T20:43:09.598 INFO:teuthology.orchestra.run.smithi008.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 769 kB/s | 46 kB 00:00 2024-03-16T20:43:09.602 INFO:teuthology.orchestra.run.smithi186.stdout:(174/174): librados2-19.0.0-1681.gaba3c1d2.el9. 1.7 MB/s | 3.4 MB 00:02 2024-03-16T20:43:09.612 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-03-16T20:43:09.613 INFO:teuthology.orchestra.run.smithi186.stdout:Total 17 MB/s | 224 MB 00:13 2024-03-16T20:43:09.632 INFO:teuthology.orchestra.run.smithi008.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-03-16T20:43:09.637 INFO:teuthology.orchestra.run.smithi170.stdout:(20/174): python3-ceph-common-19.0.0-1681.gaba3 1.9 MB/s | 131 kB 00:00 2024-03-16T20:43:09.666 INFO:teuthology.orchestra.run.smithi008.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-16T20:43:09.691 INFO:teuthology.orchestra.run.smithi008.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.8 MB/s | 217 kB 00:00 2024-03-16T20:43:09.716 INFO:teuthology.orchestra.run.smithi008.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 719 kB/s | 34 kB 00:00 2024-03-16T20:43:09.779 INFO:teuthology.orchestra.run.smithi170.stdout:(21/174): python3-cephfs-19.0.0-1681.gaba3c1d2. 1.1 MB/s | 161 kB 00:00 2024-03-16T20:43:09.867 INFO:teuthology.orchestra.run.smithi008.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-03-16T20:43:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 8.2 MB/s | 1.5 MB 00:00 2024-03-16T20:43:09.929 INFO:teuthology.orchestra.run.smithi170.stdout:(22/174): python3-rados-19.0.0-1681.gaba3c1d2.e 2.1 MB/s | 321 kB 00:00 2024-03-16T20:43:09.975 INFO:teuthology.orchestra.run.smithi008.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 7.5 MB/s | 811 kB 00:00 2024-03-16T20:43:10.001 INFO:teuthology.orchestra.run.smithi008.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2024-03-16T20:43:10.089 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-03-16T20:43:10.129 INFO:teuthology.orchestra.run.smithi170.stdout:(23/174): python3-rbd-19.0.0-1681.gaba3c1d2.el9 1.5 MB/s | 298 kB 00:00 2024-03-16T20:43:10.197 INFO:teuthology.orchestra.run.smithi170.stdout:(24/174): python3-rgw-19.0.0-1681.gaba3c1d2.el9 1.5 MB/s | 99 kB 00:00 2024-03-16T20:43:10.263 INFO:teuthology.orchestra.run.smithi170.stdout:(25/174): rbd-fuse-19.0.0-1681.gaba3c1d2.el9.x8 1.3 MB/s | 85 kB 00:00 2024-03-16T20:43:10.268 INFO:teuthology.orchestra.run.smithi008.stdout:(60/174): postgresql-server-13.11-1.el9.x86_64. 20 MB/s | 5.7 MB 00:00 2024-03-16T20:43:10.318 INFO:teuthology.orchestra.run.smithi008.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-03-16T20:43:10.344 INFO:teuthology.orchestra.run.smithi008.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 78 kB 00:00 2024-03-16T20:43:10.362 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-03-16T20:43:10.362 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-03-16T20:43:10.511 INFO:teuthology.orchestra.run.smithi008.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2024-03-16T20:43:10.527 INFO:teuthology.orchestra.run.smithi008.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 156 kB/s | 24 kB 00:00 2024-03-16T20:43:10.561 INFO:teuthology.orchestra.run.smithi008.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 564 kB/s | 18 kB 00:00 2024-03-16T20:43:10.586 INFO:teuthology.orchestra.run.smithi008.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2024-03-16T20:43:10.620 INFO:teuthology.orchestra.run.smithi008.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 981 kB/s | 32 kB 00:00 2024-03-16T20:43:10.762 INFO:teuthology.orchestra.run.smithi008.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 4.8 MB 00:00 2024-03-16T20:43:10.787 INFO:teuthology.orchestra.run.smithi008.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2024-03-16T20:43:10.829 INFO:teuthology.orchestra.run.smithi008.stdout:(70/174): python3-packaging-20.9-5.el9.noarch.r 1.7 MB/s | 69 kB 00:00 2024-03-16T20:43:10.863 INFO:teuthology.orchestra.run.smithi008.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.3 MB/s | 174 kB 00:00 2024-03-16T20:43:10.888 INFO:teuthology.orchestra.run.smithi008.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 732 kB/s | 41 kB 00:00 2024-03-16T20:43:10.921 INFO:teuthology.orchestra.run.smithi008.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.1 MB/s | 238 kB 00:00 2024-03-16T20:43:10.947 INFO:teuthology.orchestra.run.smithi008.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-03-16T20:43:10.981 INFO:teuthology.orchestra.run.smithi008.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-03-16T20:43:11.006 INFO:teuthology.orchestra.run.smithi008.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 848 kB/s | 47 kB 00:00 2024-03-16T20:43:11.031 INFO:teuthology.orchestra.run.smithi008.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 872 kB/s | 43 kB 00:00 2024-03-16T20:43:11.357 INFO:teuthology.orchestra.run.smithi008.stdout:(78/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-03-16T20:43:11.382 INFO:teuthology.orchestra.run.smithi008.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 119 kB/s | 39 kB 00:00 2024-03-16T20:43:11.405 INFO:teuthology.orchestra.run.smithi170.stdout:(26/174): ceph-test-19.0.0-1681.gaba3c1d2.el9.x 7.4 MB/s | 47 MB 00:06 2024-03-16T20:43:11.407 INFO:teuthology.orchestra.run.smithi008.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 837 kB/s | 41 kB 00:00 2024-03-16T20:43:11.441 INFO:teuthology.orchestra.run.smithi008.stdout:(81/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 300 kB 00:00 2024-03-16T20:43:11.464 INFO:teuthology.orchestra.run.smithi170.stdout:(27/174): rbd-mirror-19.0.0-1681.gaba3c1d2.el9. 2.6 MB/s | 3.1 MB 00:01 2024-03-16T20:43:11.466 INFO:teuthology.orchestra.run.smithi008.stdout:(82/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-03-16T20:43:11.489 INFO:teuthology.orchestra.run.smithi170.stdout:(28/174): rbd-nbd-19.0.0-1681.gaba3c1d2.el9.x86 2.0 MB/s | 171 kB 00:00 2024-03-16T20:43:11.491 INFO:teuthology.orchestra.run.smithi008.stdout:(83/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2024-03-16T20:43:11.516 INFO:teuthology.orchestra.run.smithi008.stdout:(84/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 901 kB/s | 44 kB 00:00 2024-03-16T20:43:11.556 INFO:teuthology.orchestra.run.smithi170.stdout:(29/174): librgw2-19.0.0-1681.gaba3c1d2.el9.x86 2.4 MB/s | 5.1 MB 00:02 2024-03-16T20:43:11.573 INFO:teuthology.orchestra.run.smithi170.stdout:(30/174): ceph-grafana-dashboards-19.0.0-1681.g 288 kB/s | 31 kB 00:00 2024-03-16T20:43:11.574 INFO:teuthology.orchestra.run.smithi008.stdout:(85/174): fuse-2.9.9-15.el9.x86_64.rpm 969 kB/s | 79 kB 00:00 2024-03-16T20:43:11.598 INFO:teuthology.orchestra.run.smithi170.stdout:(31/174): ceph-mgr-cephadm-19.0.0-1681.gaba3c1d 1.2 MB/s | 138 kB 00:00 2024-03-16T20:43:11.609 INFO:teuthology.orchestra.run.smithi008.stdout:(86/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2024-03-16T20:43:11.659 INFO:teuthology.orchestra.run.smithi008.stdout:(87/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-16T20:43:11.665 INFO:teuthology.orchestra.run.smithi170.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1681.gab 3.6 MB/s | 248 kB 00:00 2024-03-16T20:43:11.684 INFO:teuthology.orchestra.run.smithi008.stdout:(88/174): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2024-03-16T20:43:11.699 INFO:teuthology.orchestra.run.smithi170.stdout:(33/174): ceph-mgr-rook-19.0.0-1681.gaba3c1d2.e 1.4 MB/s | 49 kB 00:00 2024-03-16T20:43:11.701 INFO:teuthology.orchestra.run.smithi008.stdout:(89/174): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2024-03-16T20:43:11.732 INFO:teuthology.orchestra.run.smithi170.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1681.ga 460 kB/s | 15 kB 00:00 2024-03-16T20:43:11.735 INFO:teuthology.orchestra.run.smithi008.stdout:(90/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.8 MB/s | 187 kB 00:00 2024-03-16T20:43:11.783 INFO:teuthology.orchestra.run.smithi170.stdout:(35/174): ceph-volume-19.0.0-1681.gaba3c1d2.el9 5.1 MB/s | 264 kB 00:00 2024-03-16T20:43:11.910 INFO:teuthology.orchestra.run.smithi008.stdout:(91/174): jq-1.6-16.el9.x86_64.rpm 909 kB/s | 187 kB 00:00 2024-03-16T20:43:12.019 INFO:teuthology.orchestra.run.smithi008.stdout:(92/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-03-16T20:43:12.061 INFO:teuthology.orchestra.run.smithi008.stdout:(93/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-03-16T20:43:12.081 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-03-16T20:43:12.081 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-03-16T20:43:12.081 INFO:teuthology.orchestra.run.smithi170.stdout:(36/174): cephadm-19.0.0-1681.gaba3c1d2.el9.noa 2.5 MB/s | 748 kB 00:00 2024-03-16T20:43:12.086 INFO:teuthology.orchestra.run.smithi008.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-03-16T20:43:12.125 INFO:teuthology.orchestra.run.smithi170.stdout:(37/174): cephfs-top-19.0.0-1681.gaba3c1d2.el9. 419 kB/s | 18 kB 00:00 2024-03-16T20:43:12.145 INFO:teuthology.orchestra.run.smithi008.stdout:(95/174): elfutils-libelf-devel-0.190-2.el9.x86 261 kB/s | 21 kB 00:00 2024-03-16T20:43:12.170 INFO:teuthology.orchestra.run.smithi008.stdout:(96/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 308 kB/s | 25 kB 00:00 2024-03-16T20:43:12.234 INFO:teuthology.orchestra.run.smithi170.stdout:(38/174): ceph-mgr-dashboard-19.0.0-1681.gaba3c 2.6 MB/s | 1.8 MB 00:00 2024-03-16T20:43:12.267 INFO:teuthology.orchestra.run.smithi170.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2024-03-16T20:43:12.270 INFO:teuthology.orchestra.run.smithi008.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-03-16T20:43:12.309 INFO:teuthology.orchestra.run.smithi170.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 920 kB 00:00 2024-03-16T20:43:12.329 INFO:teuthology.orchestra.run.smithi008.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-03-16T20:43:12.334 INFO:teuthology.orchestra.run.smithi170.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-03-16T20:43:12.368 INFO:teuthology.orchestra.run.smithi170.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.1 MB/s | 307 kB 00:00 2024-03-16T20:43:12.379 INFO:teuthology.orchestra.run.smithi008.stdout:(99/174): qatlib-23.11.0-1.el9.x86_64.rpm 4.3 MB/s | 216 kB 00:00 2024-03-16T20:43:12.393 INFO:teuthology.orchestra.run.smithi170.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 547 kB/s | 32 kB 00:00 2024-03-16T20:43:12.469 INFO:teuthology.orchestra.run.smithi170.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-03-16T20:43:12.494 INFO:teuthology.orchestra.run.smithi170.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 175 kB/s | 17 kB 00:00 2024-03-16T20:43:12.519 INFO:teuthology.orchestra.run.smithi170.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-03-16T20:43:12.544 INFO:teuthology.orchestra.run.smithi170.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-16T20:43:12.570 INFO:teuthology.orchestra.run.smithi170.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 889 kB/s | 44 kB 00:00 2024-03-16T20:43:12.595 INFO:teuthology.orchestra.run.smithi170.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-16T20:43:12.629 INFO:teuthology.orchestra.run.smithi170.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 578 kB 00:00 2024-03-16T20:43:12.654 INFO:teuthology.orchestra.run.smithi170.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 807 kB/s | 46 kB 00:00 2024-03-16T20:43:12.679 INFO:teuthology.orchestra.run.smithi170.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-16T20:43:12.705 INFO:teuthology.orchestra.run.smithi170.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-16T20:43:12.735 INFO:teuthology.orchestra.run.smithi170.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.9 MB/s | 217 kB 00:00 2024-03-16T20:43:12.760 INFO:teuthology.orchestra.run.smithi170.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 628 kB/s | 34 kB 00:00 2024-03-16T20:43:12.860 INFO:teuthology.orchestra.run.smithi170.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-03-16T20:43:12.863 INFO:teuthology.orchestra.run.smithi008.stdout:(100/174): ceph-test-19.0.0-1681.gaba3c1d2.el9. 5.9 MB/s | 47 MB 00:08 2024-03-16T20:43:12.894 INFO:teuthology.orchestra.run.smithi170.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2024-03-16T20:43:12.918 INFO:teuthology.orchestra.run.smithi008.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 65 kB/s | 35 kB 00:00 2024-03-16T20:43:12.928 INFO:teuthology.orchestra.run.smithi170.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2024-03-16T20:43:12.953 INFO:teuthology.orchestra.run.smithi170.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-03-16T20:43:13.013 INFO:teuthology.orchestra.run.smithi008.stdout:(102/174): openssl-devel-3.0.7-27.el9.x86_64.rp 4.8 MB/s | 4.1 MB 00:00 2024-03-16T20:43:13.039 INFO:teuthology.orchestra.run.smithi008.stdout:(103/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 255 kB/s | 44 kB 00:00 2024-03-16T20:43:13.062 INFO:teuthology.orchestra.run.smithi170.stdout:(60/174): postgresql-server-13.11-1.el9.x86_64. 43 MB/s | 5.7 MB 00:00 2024-03-16T20:43:13.064 INFO:teuthology.orchestra.run.smithi008.stdout:(104/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 645 kB/s | 94 kB 00:00 2024-03-16T20:43:13.095 INFO:teuthology.orchestra.run.smithi170.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 7.2 MB/s | 1.0 MB 00:00 2024-03-16T20:43:13.120 INFO:teuthology.orchestra.run.smithi170.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-16T20:43:13.229 INFO:teuthology.orchestra.run.smithi170.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 43 MB/s | 5.8 MB 00:00 2024-03-16T20:43:13.255 INFO:teuthology.orchestra.run.smithi170.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 186 kB/s | 24 kB 00:00 2024-03-16T20:43:13.280 INFO:teuthology.orchestra.run.smithi170.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 362 kB/s | 18 kB 00:00 2024-03-16T20:43:13.305 INFO:teuthology.orchestra.run.smithi170.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-16T20:43:13.306 INFO:teuthology.orchestra.run.smithi008.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-03-16T20:43:13.322 INFO:teuthology.orchestra.run.smithi170.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 760 kB/s | 32 kB 00:00 2024-03-16T20:43:13.389 INFO:teuthology.orchestra.run.smithi170.stdout:(68/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.2 MB/s | 217 kB 00:00 2024-03-16T20:43:13.456 INFO:teuthology.orchestra.run.smithi170.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-03-16T20:43:13.481 INFO:teuthology.orchestra.run.smithi170.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 174 kB 00:00 2024-03-16T20:43:13.506 INFO:teuthology.orchestra.run.smithi170.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-03-16T20:43:13.523 INFO:teuthology.orchestra.run.smithi170.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 985 kB/s | 41 kB 00:00 2024-03-16T20:43:13.549 INFO:teuthology.orchestra.run.smithi170.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 5.5 MB/s | 238 kB 00:00 2024-03-16T20:43:13.574 INFO:teuthology.orchestra.run.smithi170.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-16T20:43:13.599 INFO:teuthology.orchestra.run.smithi170.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-16T20:43:13.616 INFO:teuthology.orchestra.run.smithi170.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-16T20:43:13.633 INFO:teuthology.orchestra.run.smithi170.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 43 kB 00:00 2024-03-16T20:43:13.733 INFO:teuthology.orchestra.run.smithi170.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 392 kB/s | 39 kB 00:00 2024-03-16T20:43:13.915 INFO:teuthology.orchestra.run.smithi008.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 987 kB/s | 863 kB 00:00 2024-03-16T20:43:13.942 INFO:teuthology.orchestra.run.smithi170.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2024-03-16T20:43:13.959 INFO:teuthology.orchestra.run.smithi170.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 183 kB/s | 41 kB 00:00 2024-03-16T20:43:13.985 INFO:teuthology.orchestra.run.smithi170.stdout:(81/174): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-03-16T20:43:14.010 INFO:teuthology.orchestra.run.smithi170.stdout:(82/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-16T20:43:14.027 INFO:teuthology.orchestra.run.smithi170.stdout:(83/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-03-16T20:43:14.044 INFO:teuthology.orchestra.run.smithi170.stdout:(84/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-16T20:43:14.069 INFO:teuthology.orchestra.run.smithi170.stdout:(85/174): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-03-16T20:43:14.094 INFO:teuthology.orchestra.run.smithi170.stdout:(86/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-16T20:43:14.136 INFO:teuthology.orchestra.run.smithi170.stdout:(87/174): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2024-03-16T20:43:14.153 INFO:teuthology.orchestra.run.smithi170.stdout:(88/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-16T20:43:14.178 INFO:teuthology.orchestra.run.smithi170.stdout:(89/174): python3-pycparser-2.20-6.el9.noarch.r 2.9 MB/s | 124 kB 00:00 2024-03-16T20:43:14.204 INFO:teuthology.orchestra.run.smithi170.stdout:(90/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2024-03-16T20:43:14.215 INFO:teuthology.orchestra.run.smithi008.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 65 kB/s | 19 kB 00:00 2024-03-16T20:43:14.287 INFO:teuthology.orchestra.run.smithi170.stdout:(91/174): ceph-mgr-diskprediction-local-19.0.0- 2.7 MB/s | 7.4 MB 00:02 2024-03-16T20:43:14.349 INFO:teuthology.orchestra.run.smithi008.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 297 kB/s | 309 kB 00:01 2024-03-16T20:43:14.412 INFO:teuthology.orchestra.run.smithi170.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 802 kB/s | 187 kB 00:00 2024-03-16T20:43:14.438 INFO:teuthology.orchestra.run.smithi170.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-03-16T20:43:14.480 INFO:teuthology.orchestra.run.smithi170.stdout:(94/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-03-16T20:43:14.482 INFO:teuthology.orchestra.run.smithi008.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 196 kB/s | 26 kB 00:00 2024-03-16T20:43:14.505 INFO:teuthology.orchestra.run.smithi170.stdout:(95/174): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-03-16T20:43:14.717 INFO:teuthology.orchestra.run.smithi008.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 207 kB/s | 49 kB 00:00 2024-03-16T20:43:14.757 INFO:teuthology.orchestra.run.smithi008.stdout:(111/174): abseil-cpp-20211102.0-3.el9.x86_64.r 324 kB/s | 548 kB 00:01 2024-03-16T20:43:14.933 INFO:teuthology.orchestra.run.smithi008.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 314 kB/s | 67 kB 00:00 2024-03-16T20:43:15.030 INFO:teuthology.orchestra.run.smithi170.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 36 kB/s | 21 kB 00:00 2024-03-16T20:43:15.055 INFO:teuthology.orchestra.run.smithi170.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 44 kB/s | 25 kB 00:00 2024-03-16T20:43:15.187 INFO:teuthology.orchestra.run.smithi008.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 352 kB/s | 151 kB 00:00 2024-03-16T20:43:15.931 INFO:teuthology.orchestra.run.smithi170.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 273 kB/s | 245 kB 00:00 2024-03-16T20:43:15.964 INFO:teuthology.orchestra.run.smithi170.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 273 kB/s | 248 kB 00:00 2024-03-16T20:43:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:(114/174): python3-asyncssh-2.13.2-4.el9.noarch 452 kB/s | 548 kB 00:01 2024-03-16T20:43:16.540 INFO:teuthology.orchestra.run.smithi008.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 313 kB/s | 43 kB 00:00 2024-03-16T20:43:16.548 INFO:teuthology.orchestra.run.smithi170.stdout:(100/174): qatlib-service-23.11.0-1.el9.x86_64. 60 kB/s | 35 kB 00:00 2024-03-16T20:43:16.650 INFO:teuthology.orchestra.run.smithi008.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 293 kB/s | 32 kB 00:00 2024-03-16T20:43:16.759 INFO:teuthology.orchestra.run.smithi008.stdout:(117/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 459 kB/s | 838 kB 00:01 2024-03-16T20:43:16.776 INFO:teuthology.orchestra.run.smithi008.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2024-03-16T20:43:16.823 INFO:teuthology.orchestra.run.smithi170.stdout:(101/174): qatlib-23.11.0-1.el9.x86_64.rpm 243 kB/s | 216 kB 00:00 2024-03-16T20:43:17.156 INFO:teuthology.orchestra.run.smithi170.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 73 kB/s | 44 kB 00:00 2024-03-16T20:43:17.160 INFO:teuthology.orchestra.run.smithi008.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 430 kB/s | 172 kB 00:00 2024-03-16T20:43:17.223 INFO:teuthology.orchestra.run.smithi170.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 341 kB/s | 22 kB 00:00 2024-03-16T20:43:17.357 INFO:teuthology.orchestra.run.smithi170.stdout:(104/174): protobuf-compiler-3.14.0-13.el9.x86_ 6.3 MB/s | 863 kB 00:00 2024-03-16T20:43:17.549 INFO:teuthology.orchestra.run.smithi170.stdout:(105/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 129 kB/s | 94 kB 00:00 2024-03-16T20:43:17.560 INFO:teuthology.orchestra.run.smithi008.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 458 kB/s | 358 kB 00:00 2024-03-16T20:43:17.677 INFO:teuthology.orchestra.run.smithi008.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 303 kB/s | 35 kB 00:00 2024-03-16T20:43:17.827 INFO:teuthology.orchestra.run.smithi008.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 455 kB/s | 303 kB 00:00 2024-03-16T20:43:17.883 INFO:teuthology.orchestra.run.smithi170.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-03-16T20:43:18.001 INFO:teuthology.orchestra.run.smithi170.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 166 kB/s | 19 kB 00:00 2024-03-16T20:43:18.026 INFO:teuthology.orchestra.run.smithi170.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 648 kB/s | 309 kB 00:00 2024-03-16T20:43:18.161 INFO:teuthology.orchestra.run.smithi008.stdout:(123/174): python3-google-auth-2.28.0-1.el9.noa 420 kB/s | 203 kB 00:00 2024-03-16T20:43:18.185 INFO:teuthology.orchestra.run.smithi170.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 164 kB/s | 26 kB 00:00 2024-03-16T20:43:18.318 INFO:teuthology.orchestra.run.smithi170.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 364 kB/s | 49 kB 00:00 2024-03-16T20:43:18.419 INFO:teuthology.orchestra.run.smithi170.stdout:(111/174): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-03-16T20:43:18.452 INFO:teuthology.orchestra.run.smithi170.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 504 kB/s | 67 kB 00:00 2024-03-16T20:43:18.470 INFO:teuthology.orchestra.run.smithi008.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 469 kB/s | 144 kB 00:00 2024-03-16T20:43:18.544 INFO:teuthology.orchestra.run.smithi170.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-03-16T20:43:18.603 INFO:teuthology.orchestra.run.smithi008.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 81 kB/s | 11 kB 00:00 2024-03-16T20:43:18.703 INFO:teuthology.orchestra.run.smithi170.stdout:(114/174): python3-asyncssh-2.13.2-4.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-03-16T20:43:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 164 kB/s | 18 kB 00:00 2024-03-16T20:43:18.728 INFO:teuthology.orchestra.run.smithi170.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 838 kB 00:00 2024-03-16T20:43:18.829 INFO:teuthology.orchestra.run.smithi008.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 199 kB/s | 23 kB 00:00 2024-03-16T20:43:18.836 INFO:teuthology.orchestra.run.smithi170.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-03-16T20:43:18.937 INFO:teuthology.orchestra.run.smithi170.stdout:(117/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 186 kB/s | 43 kB 00:00 2024-03-16T20:43:18.938 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-03-16T20:43:18.954 INFO:teuthology.orchestra.run.smithi008.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 156 kB/s | 19 kB 00:00 2024-03-16T20:43:18.962 INFO:teuthology.orchestra.run.smithi170.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 119 kB/s | 15 kB 00:00 2024-03-16T20:43:19.056 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-16T20:43:19.062 INFO:teuthology.orchestra.run.smithi170.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-03-16T20:43:19.087 INFO:teuthology.orchestra.run.smithi170.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-03-16T20:43:19.088 INFO:teuthology.orchestra.run.smithi008.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 148 kB/s | 20 kB 00:00 2024-03-16T20:43:19.090 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-16T20:43:19.121 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T20:43:19.131 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T20:43:19.171 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-16T20:43:19.188 INFO:teuthology.orchestra.run.smithi170.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-03-16T20:43:19.221 INFO:teuthology.orchestra.run.smithi170.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 264 kB/s | 35 kB 00:00 2024-03-16T20:43:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-16T20:43:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-16T20:43:19.292 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-16T20:43:19.313 INFO:teuthology.orchestra.run.smithi170.stdout:(123/174): python3-google-auth-2.28.0-1.el9.noa 1.6 MB/s | 203 kB 00:00 2024-03-16T20:43:19.334 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-16T20:43:19.439 INFO:teuthology.orchestra.run.smithi170.stdout:(124/174): python3-grpcio-1.46.7-10.el9.x86_64. 9.4 MB/s | 2.0 MB 00:00 2024-03-16T20:43:19.464 INFO:teuthology.orchestra.run.smithi170.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 961 kB/s | 144 kB 00:00 2024-03-16T20:43:19.548 INFO:teuthology.orchestra.run.smithi170.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-03-16T20:43:19.581 INFO:teuthology.orchestra.run.smithi170.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 151 kB/s | 18 kB 00:00 2024-03-16T20:43:19.673 INFO:teuthology.orchestra.run.smithi170.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 185 kB/s | 23 kB 00:00 2024-03-16T20:43:19.699 INFO:teuthology.orchestra.run.smithi170.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2024-03-16T20:43:19.715 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-16T20:43:19.751 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T20:43:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T20:43:19.865 INFO:teuthology.orchestra.run.smithi170.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 102 kB/s | 20 kB 00:00 2024-03-16T20:43:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T20:43:19.977 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T20:43:19.991 INFO:teuthology.orchestra.run.smithi170.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 3.5 MB/s | 1.0 MB 00:00 2024-03-16T20:43:20.008 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 12/198 2024-03-16T20:43:20.049 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-16T20:43:20.049 INFO:teuthology.orchestra.run.smithi170.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 252 kB/s | 46 kB 00:00 2024-03-16T20:43:20.099 INFO:teuthology.orchestra.run.smithi170.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 727 kB/s | 79 kB 00:00 2024-03-16T20:43:20.224 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-16T20:43:20.250 INFO:teuthology.orchestra.run.smithi170.stdout:(134/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-03-16T20:43:20.273 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-16T20:43:20.275 INFO:teuthology.orchestra.run.smithi170.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 256 kB/s | 58 kB 00:00 2024-03-16T20:43:20.301 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T20:43:20.369 INFO:teuthology.orchestra.run.smithi170.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-03-16T20:43:20.404 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T20:43:20.409 INFO:teuthology.orchestra.run.smithi170.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 673 kB/s | 90 kB 00:00 2024-03-16T20:43:20.427 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 17/198 2024-03-16T20:43:20.492 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 17/198 2024-03-16T20:43:20.493 INFO:teuthology.orchestra.run.smithi170.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 225 kB/s | 28 kB 00:00 2024-03-16T20:43:20.531 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-16T20:43:20.546 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T20:43:20.559 INFO:teuthology.orchestra.run.smithi170.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 205 kB/s | 31 kB 00:00 2024-03-16T20:43:20.561 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T20:43:20.618 INFO:teuthology.orchestra.run.smithi170.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-03-16T20:43:20.677 INFO:teuthology.orchestra.run.smithi170.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 504 kB/s | 59 kB 00:00 2024-03-16T20:43:20.721 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T20:43:20.752 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T20:43:20.761 INFO:teuthology.orchestra.run.smithi170.stdout:(142/174): openssl-devel-3.0.7-27.el9.x86_64.rp 676 kB/s | 4.1 MB 00:06 2024-03-16T20:43:20.784 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-16T20:43:20.802 INFO:teuthology.orchestra.run.smithi170.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 407 kB/s | 51 kB 00:00 2024-03-16T20:43:20.828 INFO:teuthology.orchestra.run.smithi170.stdout:(144/174): python3-tempora-5.0.0-2.el9.noarch.r 171 kB/s | 36 kB 00:00 2024-03-16T20:43:20.883 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-16T20:43:20.928 INFO:teuthology.orchestra.run.smithi170.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 717 kB/s | 90 kB 00:00 2024-03-16T20:43:20.970 INFO:teuthology.orchestra.run.smithi170.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-03-16T20:43:21.003 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T20:43:21.053 INFO:teuthology.orchestra.run.smithi170.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 159 kB/s | 20 kB 00:00 2024-03-16T20:43:21.080 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T20:43:21.120 INFO:teuthology.orchestra.run.smithi170.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-03-16T20:43:21.147 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T20:43:21.180 INFO:teuthology.orchestra.run.smithi008.stdout:(130/174): python3-kubernetes-26.1.0-2.el9.noar 500 kB/s | 1.0 MB 00:02 2024-03-16T20:43:21.221 INFO:teuthology.orchestra.run.smithi170.stdout:(149/174): python3-webob-1.8.7-6.el9.noarch.rpm 500 kB/s | 230 kB 00:00 2024-03-16T20:43:21.240 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T20:43:21.262 INFO:teuthology.orchestra.run.smithi170.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-03-16T20:43:21.321 INFO:teuthology.orchestra.run.smithi170.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2024-03-16T20:43:21.322 INFO:teuthology.orchestra.run.smithi008.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 329 kB/s | 46 kB 00:00 2024-03-16T20:43:21.460 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T20:43:21.565 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-16T20:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 306 kB/s | 79 kB 00:00 2024-03-16T20:43:21.621 INFO:teuthology.orchestra.run.smithi170.stdout:(152/174): NetworkManager-1.46.0-1.el9.x86_64.r 7.6 MB/s | 2.3 MB 00:00 2024-03-16T20:43:21.658 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-16T20:43:21.686 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-16T20:43:21.713 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-16T20:43:21.723 INFO:teuthology.orchestra.run.smithi008.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 409 kB/s | 58 kB 00:00 2024-03-16T20:43:21.749 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-16T20:43:21.772 INFO:teuthology.orchestra.run.smithi170.stdout:(153/174): NetworkManager-libnm-1.46.0-1.el9.x8 12 MB/s | 1.8 MB 00:00 2024-03-16T20:43:21.822 INFO:teuthology.orchestra.run.smithi008.stdout:(134/174): python3-grpcio-1.46.7-10.el9.x86_64. 522 kB/s | 2.0 MB 00:03 2024-03-16T20:43:21.823 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-16T20:43:21.830 INFO:teuthology.orchestra.run.smithi170.stdout:(154/174): NetworkManager-team-1.46.0-1.el9.x86 731 kB/s | 42 kB 00:00 2024-03-16T20:43:21.877 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-16T20:43:21.897 INFO:teuthology.orchestra.run.smithi170.stdout:(155/174): NetworkManager-tui-1.46.0-1.el9.x86_ 3.6 MB/s | 248 kB 00:00 2024-03-16T20:43:21.915 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-16T20:43:21.956 INFO:teuthology.orchestra.run.smithi008.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 124 kB/s | 16 kB 00:00 2024-03-16T20:43:21.964 INFO:teuthology.orchestra.run.smithi170.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-03-16T20:43:21.980 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-16T20:43:22.014 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-16T20:43:22.023 INFO:teuthology.orchestra.run.smithi170.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 624 kB/s | 36 kB 00:00 2024-03-16T20:43:22.057 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-16T20:43:22.090 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-16T20:43:22.118 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-16T20:43:22.148 INFO:teuthology.orchestra.run.smithi170.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.5 MB/s | 192 kB 00:00 2024-03-16T20:43:22.186 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-16T20:43:22.206 INFO:teuthology.orchestra.run.smithi008.stdout:(136/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 361 kB/s | 90 kB 00:00 2024-03-16T20:43:22.223 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9. 39/198 2024-03-16T20:43:22.232 INFO:teuthology.orchestra.run.smithi170.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-03-16T20:43:22.266 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el 40/198 2024-03-16T20:43:22.290 INFO:teuthology.orchestra.run.smithi170.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 394 kB/s | 23 kB 00:00 2024-03-16T20:43:22.295 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_6 41/198 2024-03-16T20:43:22.348 INFO:teuthology.orchestra.run.smithi008.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 435 kB/s | 272 kB 00:00 2024-03-16T20:43:22.349 INFO:teuthology.orchestra.run.smithi170.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 108 kB 00:00 2024-03-16T20:43:22.365 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-16T20:43:22.394 INFO:teuthology.orchestra.run.smithi008.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 151 kB/s | 28 kB 00:00 2024-03-16T20:43:22.410 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-16T20:43:22.416 INFO:teuthology.orchestra.run.smithi170.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 155 kB 00:00 2024-03-16T20:43:22.474 INFO:teuthology.orchestra.run.smithi170.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-03-16T20:43:22.482 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-16T20:43:22.532 INFO:teuthology.orchestra.run.smithi008.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 225 kB/s | 31 kB 00:00 2024-03-16T20:43:22.541 INFO:teuthology.orchestra.run.smithi170.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 960 kB/s | 64 kB 00:00 2024-03-16T20:43:22.592 INFO:teuthology.orchestra.run.smithi170.stdout:(165/174): librbd1-19.0.0-1681.gaba3c1d2.el9.x8 2.3 MB/s | 3.1 MB 00:01 2024-03-16T20:43:22.615 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-16T20:43:22.617 INFO:teuthology.orchestra.run.smithi170.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 381 kB/s | 29 kB 00:00 2024-03-16T20:43:22.661 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-16T20:43:22.682 INFO:teuthology.orchestra.run.smithi008.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 396 kB/s | 59 kB 00:00 2024-03-16T20:43:22.809 INFO:teuthology.orchestra.run.smithi170.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 11 MB/s | 2.2 MB 00:00 2024-03-16T20:43:22.816 INFO:teuthology.orchestra.run.smithi008.stdout:(141/174): python3-tempora-5.0.0-2.el9.noarch.r 269 kB/s | 36 kB 00:00 2024-03-16T20:43:22.842 INFO:teuthology.orchestra.run.smithi170.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 4.8 MB/s | 1.2 MB 00:00 2024-03-16T20:43:22.900 INFO:teuthology.orchestra.run.smithi008.stdout:(142/174): python3-routes-2.5.1-5.el9.noarch.rp 374 kB/s | 188 kB 00:00 2024-03-16T20:43:22.959 INFO:teuthology.orchestra.run.smithi170.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 15 MB/s | 2.3 MB 00:00 2024-03-16T20:43:22.966 INFO:teuthology.orchestra.run.smithi008.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 341 kB/s | 51 kB 00:00 2024-03-16T20:43:22.984 INFO:teuthology.orchestra.run.smithi170.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 3.2 MB/s | 465 kB 00:00 2024-03-16T20:43:23.044 INFO:teuthology.orchestra.run.smithi170.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 371 kB/s | 31 kB 00:00 2024-03-16T20:43:23.058 INFO:teuthology.orchestra.run.smithi008.stdout:(144/174): libarrow-9.0.0-10.el9.x86_64.rpm 512 kB/s | 4.4 MB 00:08 2024-03-16T20:43:23.160 INFO:teuthology.orchestra.run.smithi170.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.1 MB/s | 1.1 MB 00:00 2024-03-16T20:43:23.177 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-16T20:43:23.234 INFO:teuthology.orchestra.run.smithi008.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 337 kB/s | 90 kB 00:00 2024-03-16T20:43:23.257 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-16T20:43:23.329 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-16T20:43:23.359 INFO:teuthology.orchestra.run.smithi008.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 160 kB/s | 20 kB 00:00 2024-03-16T20:43:23.386 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T20:43:23.395 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T20:43:23.418 INFO:teuthology.orchestra.run.smithi008.stdout:(147/174): python3-webob-1.8.7-6.el9.noarch.rpm 444 kB/s | 230 kB 00:00 2024-03-16T20:43:23.426 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-16T20:43:23.467 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-16T20:43:23.505 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_6 53/198 2024-03-16T20:43:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-16T20:43:23.769 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-16T20:43:23.835 INFO:teuthology.orchestra.run.smithi008.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 403 kB/s | 192 kB 00:00 2024-03-16T20:43:23.868 INFO:teuthology.orchestra.run.smithi008.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 528 kB/s | 427 kB 00:00 2024-03-16T20:43:23.910 INFO:teuthology.orchestra.run.smithi170.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 86 kB/s | 74 kB 00:00 2024-03-16T20:43:23.931 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-16T20:43:23.996 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-16T20:43:24.039 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-16T20:43:24.398 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-16T20:43:24.528 INFO:teuthology.orchestra.run.smithi008.stdout:(150/174): librados2-19.0.0-1681.gaba3c1d2.el9. 4.9 MB/s | 3.4 MB 00:00 2024-03-16T20:43:24.559 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-16T20:43:24.594 INFO:teuthology.orchestra.run.smithi008.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.8 MB/s | 321 kB 00:00 2024-03-16T20:43:24.614 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-16T20:43:24.727 INFO:teuthology.orchestra.run.smithi170.stdout:(174/174): librados2-19.0.0-1681.gaba3c1d2.el9. 960 kB/s | 3.4 MB 00:03 2024-03-16T20:43:24.732 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-03-16T20:43:24.732 INFO:teuthology.orchestra.run.smithi170.stdout:Total 8.7 MB/s | 224 MB 00:25 2024-03-16T20:43:24.882 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-16T20:43:24.929 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-16T20:43:24.964 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-16T20:43:25.011 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-16T20:43:25.046 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-16T20:43:25.090 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-16T20:43:25.140 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-16T20:43:25.204 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-03-16T20:43:25.276 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-16T20:43:25.323 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-16T20:43:25.354 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-16T20:43:25.369 INFO:teuthology.orchestra.run.smithi008.stdout:(152/174): NetworkManager-1.46.0-1.el9.x86_64.r 3.0 MB/s | 2.3 MB 00:00 2024-03-16T20:43:25.395 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-16T20:43:25.479 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-03-16T20:43:25.479 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-03-16T20:43:25.488 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-16T20:43:25.529 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-16T20:43:25.569 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-16T20:43:25.595 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-16T20:43:25.619 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-16T20:43:25.653 INFO:teuthology.orchestra.run.smithi008.stdout:(153/174): librbd1-19.0.0-1681.gaba3c1d2.el9.x8 1.8 MB/s | 3.1 MB 00:01 2024-03-16T20:43:25.692 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-16T20:43:25.712 INFO:teuthology.orchestra.run.smithi008.stdout:(154/174): NetworkManager-team-1.46.0-1.el9.x86 740 kB/s | 42 kB 00:00 2024-03-16T20:43:25.813 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-16T20:43:25.829 INFO:teuthology.orchestra.run.smithi008.stdout:(155/174): NetworkManager-tui-1.46.0-1.el9.x86_ 2.1 MB/s | 248 kB 00:00 2024-03-16T20:43:25.919 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-16T20:43:25.920 INFO:teuthology.orchestra.run.smithi008.stdout:(156/174): NetworkManager-libnm-1.46.0-1.el9.x8 3.3 MB/s | 1.8 MB 00:00 2024-03-16T20:43:25.954 INFO:teuthology.orchestra.run.smithi008.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 574 kB/s | 71 kB 00:00 2024-03-16T20:43:25.961 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-16T20:43:26.004 INFO:teuthology.orchestra.run.smithi008.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 747 kB/s | 36 kB 00:00 2024-03-16T20:43:26.010 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-16T20:43:26.029 INFO:teuthology.orchestra.run.smithi008.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.5 MB/s | 192 kB 00:00 2024-03-16T20:43:26.065 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-16T20:43:26.105 INFO:teuthology.orchestra.run.smithi008.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 309 kB/s | 23 kB 00:00 2024-03-16T20:43:26.130 INFO:teuthology.orchestra.run.smithi008.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.0 MB/s | 256 kB 00:00 2024-03-16T20:43:26.180 INFO:teuthology.orchestra.run.smithi008.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 108 kB 00:00 2024-03-16T20:43:26.205 INFO:teuthology.orchestra.run.smithi008.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 155 kB 00:00 2024-03-16T20:43:26.239 INFO:teuthology.orchestra.run.smithi008.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-03-16T20:43:26.249 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-16T20:43:26.264 INFO:teuthology.orchestra.run.smithi008.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-03-16T20:43:26.290 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-16T20:43:26.298 INFO:teuthology.orchestra.run.smithi008.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 489 kB/s | 29 kB 00:00 2024-03-16T20:43:26.399 INFO:teuthology.orchestra.run.smithi008.stdout:(167/174): thrift-0.15.0-2.el9.x86_64.rpm 543 kB/s | 1.6 MB 00:02 2024-03-16T20:43:26.419 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-16T20:43:26.464 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-16T20:43:26.497 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-16T20:43:26.527 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-16T20:43:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-16T20:43:26.589 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-16T20:43:26.591 INFO:teuthology.orchestra.run.smithi008.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 7.4 MB/s | 2.2 MB 00:00 2024-03-16T20:43:26.628 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-16T20:43:26.641 INFO:teuthology.orchestra.run.smithi008.stdout:(169/174): openssl-3.0.7-27.el9.x86_64.rpm 3.2 MB/s | 1.2 MB 00:00 2024-03-16T20:43:26.660 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-16T20:43:26.690 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-16T20:43:26.699 INFO:teuthology.orchestra.run.smithi008.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 541 kB/s | 31 kB 00:00 2024-03-16T20:43:26.767 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-16T20:43:26.800 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-16T20:43:26.825 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-16T20:43:26.867 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-16T20:43:26.902 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-16T20:43:26.941 INFO:teuthology.orchestra.run.smithi008.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 1.3 MB/s | 465 kB 00:00 2024-03-16T20:43:26.984 INFO:teuthology.orchestra.run.smithi008.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 3.8 MB/s | 1.1 MB 00:00 2024-03-16T20:43:26.990 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-16T20:43:27.050 INFO:teuthology.orchestra.run.smithi008.stdout:(173/174): util-linux-2.37.4-18.el9.x86_64.rpm 3.5 MB/s | 2.3 MB 00:00 2024-03-16T20:43:27.075 INFO:teuthology.orchestra.run.smithi008.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 561 kB/s | 74 kB 00:00 2024-03-16T20:43:27.081 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-16T20:43:27.084 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2024-03-16T20:43:27.084 INFO:teuthology.orchestra.run.smithi008.stdout:Total 8.6 MB/s | 224 MB 00:26 2024-03-16T20:43:27.124 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-16T20:43:27.155 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-16T20:43:27.180 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-03-16T20:43:27.181 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-03-16T20:43:27.202 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-16T20:43:27.301 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-16T20:43:27.357 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-16T20:43:28.084 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-16T20:43:28.129 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-16T20:43:28.163 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-16T20:43:28.211 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-16T20:43:28.298 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-16T20:43:28.339 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-16T20:43:28.517 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-16T20:43:28.545 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-16T20:43:28.566 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2024-03-16T20:43:28.623 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-16T20:43:28.968 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2024-03-16T20:43:28.968 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2024-03-16T20:43:29.256 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-16T20:43:29.376 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-16T20:43:30.586 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-16T20:43:30.655 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-16T20:43:30.677 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-16T20:43:30.709 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-16T20:43:30.736 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-16T20:43:31.043 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-16T20:43:31.083 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 124/198 2024-03-16T20:43:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 124/198 2024-03-16T20:43:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 125/198 2024-03-16T20:43:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-16T20:43:31.551 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2024-03-16T20:43:31.552 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2024-03-16T20:43:31.723 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-16T20:43:31.753 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 128/198 2024-03-16T20:43:31.824 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 128/198 2024-03-16T20:43:31.846 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 129/198 2024-03-16T20:43:34.033 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T20:43:34.076 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T20:43:34.256 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-03-16T20:43:34.364 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-16T20:43:34.406 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-16T20:43:34.437 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T20:43:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T20:43:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-16T20:43:34.548 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-16T20:43:34.582 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-16T20:43:34.608 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-16T20:43:34.611 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T20:43:34.646 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 131/198 2024-03-16T20:43:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-16T20:43:34.710 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 131/198 2024-03-16T20:43:34.711 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-16T20:43:34.711 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-16T20:43:34.711 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:43:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 132/198 2024-03-16T20:43:34.969 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-16T20:43:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T20:43:35.155 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T20:43:35.177 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T20:43:35.268 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T20:43:35.297 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 12/198 2024-03-16T20:43:35.340 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-16T20:43:35.503 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-16T20:43:35.562 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-16T20:43:35.590 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T20:43:35.693 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T20:43:35.716 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 17/198 2024-03-16T20:43:35.782 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 17/198 2024-03-16T20:43:35.822 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-16T20:43:35.845 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T20:43:35.860 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T20:43:36.011 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T20:43:36.042 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T20:43:36.066 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-16T20:43:36.162 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-16T20:43:36.260 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T20:43:36.320 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T20:43:36.396 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T20:43:36.471 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T20:43:36.675 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T20:43:36.784 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-16T20:43:36.871 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-16T20:43:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-16T20:43:36.928 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-16T20:43:36.963 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-16T20:43:37.037 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-16T20:43:37.100 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-16T20:43:37.138 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-16T20:43:37.203 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-16T20:43:37.237 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-16T20:43:37.281 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-16T20:43:37.314 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-16T20:43:37.342 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-16T20:43:37.411 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-16T20:43:37.447 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9. 39/198 2024-03-16T20:43:37.490 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el 40/198 2024-03-16T20:43:37.519 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_6 41/198 2024-03-16T20:43:37.587 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-16T20:43:37.633 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-16T20:43:37.707 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-16T20:43:37.840 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-16T20:43:37.894 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-16T20:43:38.413 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-16T20:43:38.491 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-16T20:43:38.574 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-16T20:43:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T20:43:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T20:43:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-16T20:43:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-16T20:43:38.728 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_6 53/198 2024-03-16T20:43:38.767 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-16T20:43:38.981 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2024-03-16T20:43:39.002 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-16T20:43:39.091 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-16T20:43:39.140 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-16T20:43:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-16T20:43:39.186 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T20:43:39.232 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T20:43:39.236 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-16T20:43:39.280 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-16T20:43:39.354 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-16T20:43:39.409 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-16T20:43:39.450 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-16T20:43:39.466 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-16T20:43:39.505 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-16T20:43:39.531 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-16T20:43:39.569 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-16T20:43:39.665 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-16T20:43:39.705 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-16T20:43:39.909 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-16T20:43:39.940 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-16T20:43:39.987 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-16T20:43:40.023 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-16T20:43:40.066 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-16T20:43:40.108 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-16T20:43:40.121 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-16T20:43:40.183 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T20:43:40.243 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-16T20:43:40.297 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-16T20:43:40.327 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-16T20:43:40.357 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T20:43:40.369 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-16T20:43:40.384 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T20:43:40.464 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-16T20:43:40.494 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-16T20:43:40.518 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T20:43:40.534 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-16T20:43:40.552 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 12/198 2024-03-16T20:43:40.560 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-16T20:43:40.585 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-16T20:43:40.646 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-16T20:43:40.658 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-16T20:43:40.793 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-16T20:43:40.895 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-16T20:43:40.935 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-16T20:43:40.956 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-16T20:43:40.983 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-16T20:43:41.010 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-16T20:43:41.046 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-16T20:43:41.054 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T20:43:41.213 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T20:43:41.231 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-16T20:43:41.253 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 17/198 2024-03-16T20:43:41.281 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-16T20:43:41.344 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 17/198 2024-03-16T20:43:41.389 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-16T20:43:41.421 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T20:43:41.427 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-16T20:43:41.462 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-16T20:43:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T20:43:41.494 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-16T20:43:41.525 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-16T20:43:41.553 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-16T20:43:41.588 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-16T20:43:41.627 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-16T20:43:41.658 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-16T20:43:41.689 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-16T20:43:41.765 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-16T20:43:41.799 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-16T20:43:41.833 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-16T20:43:41.865 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-16T20:43:41.873 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T20:43:41.900 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-16T20:43:41.922 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T20:43:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-16T20:43:42.022 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-16T20:43:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-16T20:43:42.123 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-16T20:43:42.154 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-16T20:43:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-16T20:43:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-16T20:43:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-16T20:43:42.411 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-16T20:43:42.629 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T20:43:42.719 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T20:43:42.974 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T20:43:43.040 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T20:43:43.080 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-16T20:43:43.120 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-16T20:43:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-16T20:43:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-16T20:43:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-16T20:43:43.346 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-16T20:43:43.421 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T20:43:43.524 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-16T20:43:43.552 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-16T20:43:43.624 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-16T20:43:43.630 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-16T20:43:43.759 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-16T20:43:43.805 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-16T20:43:43.841 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-16T20:43:43.903 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-16T20:43:44.026 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-16T20:43:44.089 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-16T20:43:44.140 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-16T20:43:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-16T20:43:44.269 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-16T20:43:44.320 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-16T20:43:44.383 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-16T20:43:44.386 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-16T20:43:44.434 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-16T20:43:44.472 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-16T20:43:44.594 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-16T20:43:44.657 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9. 39/198 2024-03-16T20:43:44.717 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el 40/198 2024-03-16T20:43:44.750 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_6 41/198 2024-03-16T20:43:44.874 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-16T20:43:44.945 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-16T20:43:45.049 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-16T20:43:45.264 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-16T20:43:45.343 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-16T20:43:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-16T20:43:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-16T20:43:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-16T20:43:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-16T20:43:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-16T20:43:46.067 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-16T20:43:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-16T20:43:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 124/198 2024-03-16T20:43:46.168 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-16T20:43:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 124/198 2024-03-16T20:43:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 125/198 2024-03-16T20:43:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-16T20:43:46.367 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-16T20:43:46.412 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T20:43:46.445 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T20:43:46.510 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-16T20:43:46.544 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 132/198 2024-03-16T20:43:46.544 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /sys 2024-03-16T20:43:46.544 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /proc 2024-03-16T20:43:46.544 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /mnt 2024-03-16T20:43:46.544 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /var/tmp 2024-03-16T20:43:46.544 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /home 2024-03-16T20:43:46.544 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /root 2024-03-16T20:43:46.544 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /tmp 2024-03-16T20:43:46.544 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:43:46.589 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-16T20:43:46.651 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_6 53/198 2024-03-16T20:43:46.696 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-16T20:43:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-16T20:43:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 133/198 2024-03-16T20:43:46.720 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 133/198 2024-03-16T20:43:46.721 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:43:46.721 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-16T20:43:46.721 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:43:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 128/198 2024-03-16T20:43:46.797 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 128/198 2024-03-16T20:43:46.820 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 129/198 2024-03-16T20:43:47.101 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-16T20:43:47.372 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-16T20:43:47.503 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-16T20:43:47.577 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-16T20:43:47.804 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-16T20:43:47.872 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-16T20:43:47.957 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-16T20:43:48.058 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-16T20:43:48.097 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-16T20:43:48.137 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-16T20:43:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 134/198 2024-03-16T20:43:48.210 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-16T20:43:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 134/198 2024-03-16T20:43:48.224 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:43:48.225 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-16T20:43:48.225 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T20:43:48.225 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T20:43:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:43:48.273 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-16T20:43:48.343 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-16T20:43:48.410 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-16T20:43:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 135/198 2024-03-16T20:43:48.464 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 135/198 2024-03-16T20:43:48.464 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:43:48.464 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-16T20:43:48.464 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T20:43:48.464 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T20:43:48.464 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:43:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-16T20:43:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-16T20:43:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-16T20:43:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-16T20:43:48.909 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 136/198 2024-03-16T20:43:48.931 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 136/198 2024-03-16T20:43:48.931 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:43:48.931 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-16T20:43:48.931 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T20:43:48.931 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T20:43:48.931 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:43:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-16T20:43:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-16T20:43:49.027 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-16T20:43:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-16T20:43:49.055 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T20:43:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-16T20:43:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T20:43:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-16T20:43:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-16T20:43:49.403 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 138/198 2024-03-16T20:43:49.425 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 138/198 2024-03-16T20:43:49.457 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.e 139/198 2024-03-16T20:43:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-16T20:43:49.518 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2. 140/198 2024-03-16T20:43:49.540 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 141/198 2024-03-16T20:43:49.628 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T20:43:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-16T20:43:49.678 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 131/198 2024-03-16T20:43:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-16T20:43:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-16T20:43:49.759 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 131/198 2024-03-16T20:43:49.759 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-16T20:43:49.759 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-16T20:43:49.759 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:43:49.773 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 141/198 2024-03-16T20:43:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 132/198 2024-03-16T20:43:49.800 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 142/198 2024-03-16T20:43:49.826 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-16T20:43:50.077 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-16T20:43:50.142 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-16T20:43:50.317 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-16T20:43:50.372 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-16T20:43:50.412 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-16T20:43:50.450 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-16T20:43:50.491 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-16T20:43:50.602 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-16T20:43:50.765 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 142/198 2024-03-16T20:43:50.792 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 143/198 2024-03-16T20:43:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 143/198 2024-03-16T20:43:51.056 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el 144/198 2024-03-16T20:43:51.085 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 145/198 2024-03-16T20:43:51.101 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-16T20:43:51.109 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 145/198 2024-03-16T20:43:51.109 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:43:51.109 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-16T20:43:51.109 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T20:43:51.109 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T20:43:51.109 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:43:51.153 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 146/198 2024-03-16T20:43:51.164 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 146/198 2024-03-16T20:43:51.175 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-16T20:43:51.209 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 147/198 2024-03-16T20:43:51.224 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-16T20:43:51.370 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-16T20:43:51.418 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-16T20:43:51.452 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-16T20:43:51.553 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-16T20:43:51.599 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-16T20:43:51.755 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-16T20:43:51.872 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-16T20:43:51.936 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-16T20:43:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-16T20:43:52.060 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-16T20:43:52.077 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-16T20:43:52.113 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 149/198 2024-03-16T20:43:52.136 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 149/198 2024-03-16T20:43:52.136 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:43:52.136 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-16T20:43:52.137 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T20:43:52.137 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T20:43:52.137 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:43:52.181 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 150/198 2024-03-16T20:43:52.203 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 150/198 2024-03-16T20:43:52.203 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:43:52.203 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-16T20:43:52.203 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:43:52.213 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-16T20:43:52.248 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T20:43:52.270 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T20:43:52.270 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:43:52.271 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-16T20:43:52.271 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T20:43:52.271 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T20:43:52.271 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:43:52.279 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-16T20:43:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 152/198 2024-03-16T20:43:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 152/198 2024-03-16T20:43:52.597 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:43:52.597 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-16T20:43:52.597 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T20:43:52.597 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T20:43:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:43:53.287 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-16T20:43:53.353 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-16T20:43:53.388 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-16T20:43:53.450 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-16T20:43:53.573 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-16T20:43:53.621 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-16T20:43:53.873 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-16T20:43:53.909 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-16T20:43:54.018 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-16T20:43:54.875 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-16T20:43:55.009 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-16T20:43:56.609 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-16T20:43:56.705 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-16T20:43:56.744 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-16T20:43:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-16T20:43:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-16T20:43:57.204 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-16T20:43:57.205 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 153/198 2024-03-16T20:43:57.237 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 124/198 2024-03-16T20:43:57.247 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 154/198 2024-03-16T20:43:57.277 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 155/198 2024-03-16T20:43:57.304 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-16T20:43:57.359 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 124/198 2024-03-16T20:43:57.393 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 125/198 2024-03-16T20:43:57.449 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-16T20:43:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 157/198 2024-03-16T20:43:57.604 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-16T20:43:57.652 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 159/198 2024-03-16T20:43:57.692 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-16T20:43:57.752 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-16T20:43:57.787 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-16T20:43:57.820 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_ 163/198 2024-03-16T20:43:57.844 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-16T20:43:57.873 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-16T20:43:57.928 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-16T20:43:57.988 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-16T20:43:57.992 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-16T20:43:58.022 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-16T20:43:58.099 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 128/198 2024-03-16T20:43:58.185 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 128/198 2024-03-16T20:43:58.218 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 129/198 2024-03-16T20:43:58.596 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T20:43:58.629 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T20:43:58.649 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T20:43:59.482 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 170/198 2024-03-16T20:43:59.566 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-16T20:43:59.606 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-16T20:43:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-16T20:43:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-16T20:43:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-16T20:43:59.778 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-16T20:43:59.805 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-16T20:43:59.805 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T20:43:59.876 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T20:43:59.914 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-16T20:43:59.914 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T20:44:00.007 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T20:44:00.033 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-16T20:44:00.066 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-16T20:44:00.092 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-16T20:44:00.117 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-16T20:44:00.167 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-16T20:44:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-16T20:44:00.239 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-16T20:44:00.264 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-16T20:44:00.289 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-16T20:44:00.315 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-16T20:44:00.340 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-16T20:44:00.346 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T20:44:00.346 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T20:44:00.526 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T20:44:00.526 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T20:44:00.592 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T20:44:00.617 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-16T20:44:00.642 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-16T20:44:00.676 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-16T20:44:00.702 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-16T20:44:00.765 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T20:44:01.075 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T20:44:01.114 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T20:44:01.612 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 132/198 2024-03-16T20:44:01.612 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-03-16T20:44:01.612 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-03-16T20:44:01.612 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-03-16T20:44:01.613 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-03-16T20:44:01.613 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-03-16T20:44:01.613 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-03-16T20:44:01.613 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-03-16T20:44:01.613 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 133/198 2024-03-16T20:44:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 133/198 2024-03-16T20:44:01.791 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:01.791 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-16T20:44:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:01.807 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T20:44:01.881 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 131/198 2024-03-16T20:44:02.044 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 131/198 2024-03-16T20:44:02.044 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-16T20:44:02.044 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-16T20:44:02.044 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:02.084 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 132/198 2024-03-16T20:44:03.281 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 134/198 2024-03-16T20:44:03.306 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 134/198 2024-03-16T20:44:03.306 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:03.306 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-16T20:44:03.306 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T20:44:03.306 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T20:44:03.306 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:03.522 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 135/198 2024-03-16T20:44:03.545 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 135/198 2024-03-16T20:44:03.545 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:03.545 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-16T20:44:03.545 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T20:44:03.545 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T20:44:03.545 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:03.990 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 136/198 2024-03-16T20:44:04.012 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 136/198 2024-03-16T20:44:04.013 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:04.013 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-16T20:44:04.013 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T20:44:04.013 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T20:44:04.013 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:04.109 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-16T20:44:04.493 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 138/198 2024-03-16T20:44:04.523 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 138/198 2024-03-16T20:44:04.555 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.e 139/198 2024-03-16T20:44:04.615 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2. 140/198 2024-03-16T20:44:04.639 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 141/198 2024-03-16T20:44:04.869 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 141/198 2024-03-16T20:44:04.906 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 142/198 2024-03-16T20:44:05.354 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T20:44:05.354 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 1/198 2024-03-16T20:44:05.354 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2/198 2024-03-16T20:44:05.354 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 3/198 2024-03-16T20:44:05.354 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 4/198 2024-03-16T20:44:05.354 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 5/198 2024-03-16T20:44:05.354 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 6/198 2024-03-16T20:44:05.354 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 7/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 8/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 9/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 12/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 13/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 14/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_ 15/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 17/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_6 18/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 19/198 2024-03-16T20:44:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 20/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el 21/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9. 22/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_6 23/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 24/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 25/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 26/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 27/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 28/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 29/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2. 30/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 31/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 32/198 2024-03-16T20:44:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 33/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el 34/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 35/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.e 36/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 37/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 38/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 39/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-16T20:44:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-16T20:44:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-16T20:44:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-16T20:44:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-16T20:44:05.361 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-16T20:44:05.362 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-16T20:44:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-16T20:44:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T20:44:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 153/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-16T20:44:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-16T20:44:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-16T20:44:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-16T20:44:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-16T20:44:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-16T20:44:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-16T20:44:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-16T20:44:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-16T20:44:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-16T20:44:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-16T20:44:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-16T20:44:05.864 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 142/198 2024-03-16T20:44:05.890 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 143/198 2024-03-16T20:44:05.991 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 143/198 2024-03-16T20:44:06.145 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el 144/198 2024-03-16T20:44:06.184 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 145/198 2024-03-16T20:44:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 145/198 2024-03-16T20:44:06.207 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:06.207 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-16T20:44:06.207 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T20:44:06.207 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T20:44:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 146/198 2024-03-16T20:44:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 146/198 2024-03-16T20:44:06.315 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 147/198 2024-03-16T20:44:07.166 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-16T20:44:07.195 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 149/198 2024-03-16T20:44:07.217 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 149/198 2024-03-16T20:44:07.217 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:07.217 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-16T20:44:07.218 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T20:44:07.218 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T20:44:07.218 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:07.262 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 150/198 2024-03-16T20:44:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 150/198 2024-03-16T20:44:07.284 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:07.284 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-16T20:44:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T20:44:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T20:44:07.353 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:07.353 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-16T20:44:07.353 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T20:44:07.353 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T20:44:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 152/198 2024-03-16T20:44:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 152/198 2024-03-16T20:44:07.686 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:07.687 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-16T20:44:07.687 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T20:44:07.687 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T20:44:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:08.515 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-16T20:44:08.515 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:44:08.515 INFO:teuthology.orchestra.run.smithi186.stdout:Upgraded: 2024-03-16T20:44:08.515 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:08.515 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:08.515 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:08.515 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:08.515 INFO:teuthology.orchestra.run.smithi186.stdout: acl-2.3.1-4.el9.x86_64 2024-03-16T20:44:08.515 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-16T20:44:08.516 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: automake-1.16.2-8.el9.noarch 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: bison-3.7.4-5.el9.x86_64 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.517 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:08.518 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: flex-2.6.4-9.el9.x86_64 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-16T20:44:08.519 INFO:teuthology.orchestra.run.smithi186.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: jq-1.6-16.el9.x86_64 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-16T20:44:08.520 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: lua-5.4.4-4.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-16T20:44:08.521 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-13.11-1.el9.x86_64 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-16T20:44:08.522 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-16T20:44:08.523 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-16T20:44:08.524 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-16T20:44:08.525 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply-3.11-14.el9.noarch 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-16T20:44:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-16T20:44:08.527 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-16T20:44:08.528 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-16T20:44:08.528 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-16T20:44:08.528 INFO:teuthology.orchestra.run.smithi186.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-16T20:44:08.528 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.528 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.528 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:08.528 INFO:teuthology.orchestra.run.smithi186.stdout: re2-1:20211101-3.el9.x86_64 2024-03-16T20:44:08.528 INFO:teuthology.orchestra.run.smithi186.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-16T20:44:08.528 INFO:teuthology.orchestra.run.smithi186.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-16T20:44:08.528 INFO:teuthology.orchestra.run.smithi186.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-16T20:44:08.528 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-16T20:44:08.529 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-16T20:44:08.529 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-16T20:44:08.529 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:44:08.529 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-03-16T20:44:09.005 DEBUG:teuthology.parallel:result is None 2024-03-16T20:44:12.085 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 153/198 2024-03-16T20:44:12.126 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 154/198 2024-03-16T20:44:12.157 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 155/198 2024-03-16T20:44:12.183 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-16T20:44:12.365 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 157/198 2024-03-16T20:44:12.482 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-16T20:44:12.532 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 159/198 2024-03-16T20:44:12.570 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-16T20:44:12.623 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-16T20:44:12.666 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-16T20:44:12.701 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_ 163/198 2024-03-16T20:44:12.734 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-16T20:44:12.763 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-16T20:44:12.809 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-16T20:44:12.869 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-16T20:44:12.895 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-16T20:44:13.457 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T20:44:13.510 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T20:44:13.530 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T20:44:14.339 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 170/198 2024-03-16T20:44:14.422 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-16T20:44:14.463 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-16T20:44:14.544 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-16T20:44:14.593 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-16T20:44:14.617 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-16T20:44:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-16T20:44:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-16T20:44:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T20:44:14.741 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T20:44:14.770 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-16T20:44:14.771 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T20:44:14.847 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T20:44:14.873 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-16T20:44:14.914 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-16T20:44:14.940 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-16T20:44:14.965 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-16T20:44:14.997 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-16T20:44:15.037 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-16T20:44:15.070 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-16T20:44:15.095 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-16T20:44:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-16T20:44:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-16T20:44:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-16T20:44:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T20:44:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T20:44:15.357 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T20:44:15.357 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T20:44:15.440 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T20:44:15.465 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-16T20:44:15.490 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-16T20:44:15.515 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-16T20:44:15.541 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-16T20:44:15.609 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T20:44:15.636 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 132/198 2024-03-16T20:44:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2024-03-16T20:44:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2024-03-16T20:44:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2024-03-16T20:44:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2024-03-16T20:44:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2024-03-16T20:44:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /root 2024-03-16T20:44:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2024-03-16T20:44:15.636 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:15.869 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 133/198 2024-03-16T20:44:15.921 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 133/198 2024-03-16T20:44:15.921 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:15.921 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-16T20:44:15.922 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:17.569 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 134/198 2024-03-16T20:44:17.651 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 134/198 2024-03-16T20:44:17.651 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:17.651 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-16T20:44:17.651 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T20:44:17.652 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T20:44:17.652 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:17.936 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 135/198 2024-03-16T20:44:18.012 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 135/198 2024-03-16T20:44:18.012 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:18.012 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-16T20:44:18.012 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T20:44:18.013 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T20:44:18.013 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 136/198 2024-03-16T20:44:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 136/198 2024-03-16T20:44:18.621 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:18.621 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-16T20:44:18.621 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T20:44:18.621 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T20:44:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-16T20:44:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 138/198 2024-03-16T20:44:19.364 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 138/198 2024-03-16T20:44:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.e 139/198 2024-03-16T20:44:19.520 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2. 140/198 2024-03-16T20:44:19.551 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 141/198 2024-03-16T20:44:19.888 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 141/198 2024-03-16T20:44:19.919 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 142/198 2024-03-16T20:44:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T20:44:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 1/198 2024-03-16T20:44:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2/198 2024-03-16T20:44:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 3/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 4/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 5/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 6/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 7/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 8/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 9/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 12/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 13/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 14/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_ 15/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T20:44:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 17/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_6 18/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 19/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 20/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el 21/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9. 22/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_6 23/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 24/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 25/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 26/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 27/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 28/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 29/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2. 30/198 2024-03-16T20:44:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 31/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 32/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 33/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el 34/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 35/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.e 36/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 37/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 38/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 39/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-16T20:44:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-16T20:44:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-16T20:44:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-16T20:44:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-16T20:44:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-16T20:44:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-16T20:44:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-16T20:44:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-16T20:44:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-16T20:44:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-16T20:44:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-16T20:44:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-16T20:44:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-16T20:44:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-16T20:44:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-16T20:44:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-16T20:44:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 153/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-16T20:44:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-16T20:44:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-16T20:44:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-16T20:44:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-16T20:44:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-16T20:44:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-16T20:44:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-16T20:44:21.092 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 142/198 2024-03-16T20:44:21.119 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 143/198 2024-03-16T20:44:21.269 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 143/198 2024-03-16T20:44:21.458 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el 144/198 2024-03-16T20:44:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 145/198 2024-03-16T20:44:21.584 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 145/198 2024-03-16T20:44:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-16T20:44:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T20:44:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T20:44:21.585 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:21.647 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 146/198 2024-03-16T20:44:21.687 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 146/198 2024-03-16T20:44:21.785 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 147/198 2024-03-16T20:44:22.806 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-16T20:44:22.860 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 149/198 2024-03-16T20:44:22.933 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 149/198 2024-03-16T20:44:22.934 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:22.934 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-16T20:44:22.934 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T20:44:22.934 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T20:44:22.934 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:22.991 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 150/198 2024-03-16T20:44:23.066 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 150/198 2024-03-16T20:44:23.066 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:23.066 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-16T20:44:23.066 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:23.150 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T20:44:23.231 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T20:44:23.231 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:23.231 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-16T20:44:23.231 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T20:44:23.231 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T20:44:23.231 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: acl-2.3.1-4.el9.x86_64 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-16T20:44:23.368 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-16T20:44:23.369 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: automake-1.16.2-8.el9.noarch 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: bison-3.7.4-5.el9.x86_64 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.370 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:23.371 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: flex-2.6.4-9.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: jq-1.6-16.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-16T20:44:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-16T20:44:23.373 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: lua-5.4.4-4.el9.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-13.11-1.el9.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-16T20:44:23.374 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-16T20:44:23.375 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-16T20:44:23.376 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-16T20:44:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-16T20:44:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-16T20:44:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-16T20:44:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-16T20:44:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-16T20:44:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-16T20:44:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-16T20:44:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-16T20:44:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-16T20:44:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-16T20:44:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-16T20:44:23.379 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-3.el9.x86_64 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-16T20:44:23.380 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-16T20:44:23.381 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-16T20:44:23.381 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-03-16T20:44:23.381 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-03-16T20:44:23.634 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 152/198 2024-03-16T20:44:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 152/198 2024-03-16T20:44:23.706 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T20:44:23.706 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-16T20:44:23.706 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T20:44:23.706 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T20:44:23.706 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:23.831 DEBUG:teuthology.parallel:result is None 2024-03-16T20:44:28.774 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 153/198 2024-03-16T20:44:28.827 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 154/198 2024-03-16T20:44:28.864 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 155/198 2024-03-16T20:44:28.902 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-16T20:44:29.185 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 157/198 2024-03-16T20:44:29.314 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-16T20:44:29.375 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 159/198 2024-03-16T20:44:29.433 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-16T20:44:29.490 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-16T20:44:29.535 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-16T20:44:29.569 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_ 163/198 2024-03-16T20:44:29.643 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-16T20:44:29.694 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-16T20:44:29.774 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-16T20:44:29.889 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-16T20:44:29.926 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-16T20:44:30.875 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T20:44:30.923 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T20:44:30.998 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T20:44:32.916 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 170/198 2024-03-16T20:44:33.012 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-16T20:44:33.077 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-16T20:44:33.212 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-16T20:44:33.274 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-16T20:44:33.322 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-16T20:44:33.357 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-16T20:44:33.399 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-16T20:44:33.400 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T20:44:33.544 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T20:44:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-16T20:44:33.586 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T20:44:33.742 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T20:44:33.805 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-16T20:44:33.856 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-16T20:44:33.889 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-16T20:44:33.921 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-16T20:44:33.991 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-16T20:44:34.078 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-16T20:44:34.135 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-16T20:44:34.191 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-16T20:44:34.235 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-16T20:44:34.269 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-16T20:44:34.302 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-16T20:44:34.339 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T20:44:34.340 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T20:44:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T20:44:34.678 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T20:44:34.816 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T20:44:34.855 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-16T20:44:34.888 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-16T20:44:34.947 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-16T20:44:34.999 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-16T20:44:35.121 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T20:44:35.379 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T20:44:35.379 INFO:teuthology.orchestra.run.smithi008.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-16T20:44:35.379 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:40.399 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 1/198 2024-03-16T20:44:40.399 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2/198 2024-03-16T20:44:40.399 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 3/198 2024-03-16T20:44:40.399 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 4/198 2024-03-16T20:44:40.399 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 5/198 2024-03-16T20:44:40.399 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 6/198 2024-03-16T20:44:40.399 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 7/198 2024-03-16T20:44:40.400 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 8/198 2024-03-16T20:44:40.400 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 9/198 2024-03-16T20:44:40.400 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T20:44:40.400 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T20:44:40.400 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 12/198 2024-03-16T20:44:40.400 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 13/198 2024-03-16T20:44:40.400 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 14/198 2024-03-16T20:44:40.401 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_ 15/198 2024-03-16T20:44:40.401 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T20:44:40.401 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 17/198 2024-03-16T20:44:40.401 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_6 18/198 2024-03-16T20:44:40.401 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 19/198 2024-03-16T20:44:40.402 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 20/198 2024-03-16T20:44:40.402 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el 21/198 2024-03-16T20:44:40.402 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9. 22/198 2024-03-16T20:44:40.402 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_6 23/198 2024-03-16T20:44:40.402 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 24/198 2024-03-16T20:44:40.402 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 25/198 2024-03-16T20:44:40.403 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 26/198 2024-03-16T20:44:40.403 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 27/198 2024-03-16T20:44:40.403 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 28/198 2024-03-16T20:44:40.403 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 29/198 2024-03-16T20:44:40.403 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2. 30/198 2024-03-16T20:44:40.403 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 31/198 2024-03-16T20:44:40.403 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 32/198 2024-03-16T20:44:40.404 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 33/198 2024-03-16T20:44:40.404 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el 34/198 2024-03-16T20:44:40.404 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 35/198 2024-03-16T20:44:40.404 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.e 36/198 2024-03-16T20:44:40.404 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 37/198 2024-03-16T20:44:40.404 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 38/198 2024-03-16T20:44:40.405 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 39/198 2024-03-16T20:44:40.405 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-16T20:44:40.405 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-16T20:44:40.405 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-16T20:44:40.405 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-16T20:44:40.406 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-16T20:44:40.406 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-16T20:44:40.406 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-16T20:44:40.406 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-16T20:44:40.406 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-16T20:44:40.406 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-16T20:44:40.406 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-16T20:44:40.406 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-16T20:44:40.406 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-16T20:44:40.407 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-16T20:44:40.407 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-16T20:44:40.407 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-16T20:44:40.407 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-16T20:44:40.407 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-16T20:44:40.407 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-16T20:44:40.407 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-16T20:44:40.407 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-16T20:44:40.408 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-16T20:44:40.408 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-16T20:44:40.408 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-16T20:44:40.408 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-16T20:44:40.408 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-16T20:44:40.408 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-16T20:44:40.408 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-16T20:44:40.409 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-16T20:44:40.409 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-16T20:44:40.409 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-16T20:44:40.409 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-16T20:44:40.409 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-16T20:44:40.409 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-16T20:44:40.409 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-16T20:44:40.409 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-16T20:44:40.410 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-16T20:44:40.410 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-16T20:44:40.410 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-16T20:44:40.410 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-16T20:44:40.410 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-16T20:44:40.411 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-16T20:44:40.411 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-16T20:44:40.411 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-16T20:44:40.411 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-16T20:44:40.411 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-16T20:44:40.411 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-16T20:44:40.411 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-16T20:44:40.412 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-16T20:44:40.412 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-16T20:44:40.412 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-16T20:44:40.412 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-16T20:44:40.412 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-16T20:44:40.412 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-16T20:44:40.412 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-16T20:44:40.413 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-16T20:44:40.413 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-16T20:44:40.413 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-16T20:44:40.413 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-16T20:44:40.413 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-16T20:44:40.413 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-16T20:44:40.414 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-16T20:44:40.414 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-16T20:44:40.414 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-16T20:44:40.414 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-16T20:44:40.414 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-16T20:44:40.414 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-16T20:44:40.415 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-16T20:44:40.415 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-16T20:44:40.415 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-16T20:44:40.415 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-16T20:44:40.415 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-16T20:44:40.415 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-16T20:44:40.415 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-16T20:44:40.416 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-16T20:44:40.417 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 153/198 2024-03-16T20:44:40.418 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-16T20:44:40.419 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-16T20:44:40.420 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-16T20:44:40.421 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-16T20:44:40.422 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-16T20:44:40.422 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-16T20:44:40.422 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-16T20:44:42.944 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-16T20:44:42.944 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:42.944 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2024-03-16T20:44:42.944 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:42.944 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:42.944 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: acl-2.3.1-4.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.945 INFO:teuthology.orchestra.run.smithi008.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout: automake-1.16.2-8.el9.noarch 2024-03-16T20:44:42.946 INFO:teuthology.orchestra.run.smithi008.stdout: bison-3.7.4-5.el9.x86_64 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:42.947 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-16T20:44:42.948 INFO:teuthology.orchestra.run.smithi008.stdout: flex-2.6.4-9.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.6-16.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-16T20:44:42.949 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-16T20:44:42.950 INFO:teuthology.orchestra.run.smithi008.stdout: lua-5.4.4-4.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-13.11-1.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-16T20:44:42.951 INFO:teuthology.orchestra.run.smithi008.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-16T20:44:42.952 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-16T20:44:42.953 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ply-3.11-14.el9.noarch 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-16T20:44:42.954 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-16T20:44:42.955 INFO:teuthology.orchestra.run.smithi008.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: re2-1:20211101-3.el9.x86_64 2024-03-16T20:44:42.956 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-16T20:44:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-16T20:44:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-16T20:44:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-16T20:44:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-16T20:44:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-16T20:44:42.957 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:44:42.957 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2024-03-16T20:44:43.635 DEBUG:teuthology.parallel:result is None 2024-03-16T20:44:43.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:44:43.783 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-16T20:44:43.840 INFO:teuthology.orchestra.run.smithi008.stdout:19.0.0-1681.gaba3c1d2.el9 2024-03-16T20:44:43.840 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1681.gaba3c1d2.el9 2024-03-16T20:44:43.840 INFO:teuthology.task.install:The correct ceph version 19.0.0-1681.gaba3c1d2 is installed. 2024-03-16T20:44:43.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:44:43.978 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-16T20:44:44.003 INFO:teuthology.orchestra.run.smithi170.stdout:19.0.0-1681.gaba3c1d2.el9 2024-03-16T20:44:44.003 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1681.gaba3c1d2.el9 2024-03-16T20:44:44.003 INFO:teuthology.task.install:The correct ceph version 19.0.0-1681.gaba3c1d2 is installed. 2024-03-16T20:44:44.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:44:44.141 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-16T20:44:44.167 INFO:teuthology.orchestra.run.smithi186.stdout:19.0.0-1681.gaba3c1d2.el9 2024-03-16T20:44:44.167 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1681.gaba3c1d2.el9 2024-03-16T20:44:44.167 INFO:teuthology.task.install:The correct ceph version 19.0.0-1681.gaba3c1d2 is installed. 2024-03-16T20:44:44.169 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-16T20:44:44.169 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:44:44.169 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-16T20:44:44.252 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-03-16T20:44:44.252 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-16T20:44:44.286 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-16T20:44:44.286 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-16T20:44:44.321 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-16T20:44:44.321 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:44:44.321 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2024-03-16T20:44:44.396 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-16T20:44:44.509 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-03-16T20:44:44.510 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-03-16T20:44:44.539 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-16T20:44:44.607 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-16T20:44:44.607 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2024-03-16T20:44:44.636 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-16T20:44:44.703 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-16T20:44:44.703 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:44:44.703 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-16T20:44:44.795 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-16T20:44:44.908 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-03-16T20:44:44.909 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-16T20:44:44.937 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-16T20:44:45.003 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-16T20:44:45.003 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-16T20:44:45.031 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-16T20:44:45.098 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-16T20:44:45.098 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:44:45.098 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2024-03-16T20:44:45.200 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-16T20:44:45.275 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-03-16T20:44:45.275 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-03-16T20:44:45.301 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-16T20:44:45.367 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-16T20:44:45.368 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/stdin-killer 2024-03-16T20:44:45.394 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-16T20:44:45.461 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-16T20:44:45.549 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b', 'subvols': {'create': 2}} 2024-03-16T20:44:45.549 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:44:45.550 INFO:tasks.cephadm:Cluster fsid is 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:44:45.550 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-16T20:44:45.550 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.8', 'mon.b': '172.21.15.170', 'mon.c': '172.21.15.186'} 2024-03-16T20:44:45.550 INFO:tasks.cephadm:First mon is mon.a on smithi008 2024-03-16T20:44:45.550 INFO:tasks.cephadm:First mgr is x 2024-03-16T20:44:45.550 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-16T20:44:45.550 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname $(hostname -s) 2024-03-16T20:44:45.629 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname $(hostname -s) 2024-03-16T20:44:45.656 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname $(hostname -s) 2024-03-16T20:44:45.683 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-03-16T20:44:45.683 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:44:45.824 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77659/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1681-gaba3c1d2', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1681.gaba3c1d2'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-15 03:39:08.164055', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-lusov-qdb-squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-03-16T20:44:45.966 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-lusov-qdb-squid, sha1 aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:44:45.968 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/x86_64/flavors/default/cephadm 2024-03-16T20:44:45.968 DEBUG:teuthology.orchestra.run.smithi008:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-16T20:44:46.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-r--r--. 1 ubuntu ubuntu 766937 Mar 16 20:44 /home/ubuntu/cephtest/cephadm 2024-03-16T20:44:46.415 DEBUG:teuthology.orchestra.run.smithi170:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-16T20:44:46.987 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r--. 1 ubuntu ubuntu 766937 Mar 16 20:44 /home/ubuntu/cephtest/cephadm 2024-03-16T20:44:46.987 DEBUG:teuthology.orchestra.run.smithi186:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-16T20:44:47.508 INFO:teuthology.orchestra.run.smithi186.stdout:-rw-r--r--. 1 ubuntu ubuntu 766937 Mar 16 20:44 /home/ubuntu/cephtest/cephadm 2024-03-16T20:44:47.508 DEBUG:teuthology.orchestra.run.smithi008:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-16T20:44:47.560 DEBUG:teuthology.orchestra.run.smithi170:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-16T20:44:47.579 DEBUG:teuthology.orchestra.run.smithi186:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-16T20:44:47.613 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b on all hosts... 2024-03-16T20:44:47.613 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b pull 2024-03-16T20:44:47.620 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b pull 2024-03-16T20:44:47.623 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b pull 2024-03-16T20:44:48.465 INFO:teuthology.orchestra.run.smithi170.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b... 2024-03-16T20:44:48.495 INFO:teuthology.orchestra.run.smithi186.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b... 2024-03-16T20:44:49.224 INFO:teuthology.orchestra.run.smithi008.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b... 2024-03-16T20:45:21.312 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-03-16T20:45:21.312 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.0.0-1681-gaba3c1d2 (aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b) squid (dev)", 2024-03-16T20:45:21.312 INFO:teuthology.orchestra.run.smithi170.stdout: "image_id": "80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0", 2024-03-16T20:45:21.312 INFO:teuthology.orchestra.run.smithi170.stdout: "repo_digests": [ 2024-03-16T20:45:21.312 INFO:teuthology.orchestra.run.smithi170.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3" 2024-03-16T20:45:21.313 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-03-16T20:45:21.313 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-03-16T20:45:21.902 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-03-16T20:45:21.902 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_version": "ceph version 19.0.0-1681-gaba3c1d2 (aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b) squid (dev)", 2024-03-16T20:45:21.902 INFO:teuthology.orchestra.run.smithi186.stdout: "image_id": "80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0", 2024-03-16T20:45:21.902 INFO:teuthology.orchestra.run.smithi186.stdout: "repo_digests": [ 2024-03-16T20:45:21.902 INFO:teuthology.orchestra.run.smithi186.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3" 2024-03-16T20:45:21.902 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-03-16T20:45:21.902 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-03-16T20:45:30.332 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:45:30.333 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 19.0.0-1681-gaba3c1d2 (aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b) squid (dev)", 2024-03-16T20:45:30.333 INFO:teuthology.orchestra.run.smithi008.stdout: "image_id": "80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0", 2024-03-16T20:45:30.333 INFO:teuthology.orchestra.run.smithi008.stdout: "repo_digests": [ 2024-03-16T20:45:30.333 INFO:teuthology.orchestra.run.smithi008.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3" 2024-03-16T20:45:30.333 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T20:45:30.333 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:45:30.380 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph 2024-03-16T20:45:30.484 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph 2024-03-16T20:45:30.519 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph 2024-03-16T20:45:30.554 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /etc/ceph 2024-03-16T20:45:30.659 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /etc/ceph 2024-03-16T20:45:30.690 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /etc/ceph 2024-03-16T20:45:30.721 INFO:tasks.cephadm:Writing seed config... 2024-03-16T20:45:30.722 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-03-16T20:45:30.722 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-03-16T20:45:30.722 INFO:tasks.cephadm: override: [client] debug client = 20 2024-03-16T20:45:30.722 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-16T20:45:30.722 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-03-16T20:45:30.722 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-03-16T20:45:30.722 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-03-16T20:45:30.722 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-03-16T20:45:30.722 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-03-16T20:45:30.723 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-03-16T20:45:30.724 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-03-16T20:45:30.725 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-03-16T20:45:30.725 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-03-16T20:45:30.725 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-03-16T20:45:30.725 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-03-16T20:45:30.725 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-03-16T20:45:30.725 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-16T20:45:30.725 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-03-16T20:45:30.726 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:45:30.726 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-16T20:45:30.783 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 05d64692-e3d6-11ee-95c9-87774f69a715 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-03-16T20:45:30.784 DEBUG:teuthology.orchestra.run.smithi008:mon.a> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.a.service 2024-03-16T20:45:30.789 DEBUG:teuthology.orchestra.run.smithi008:mgr.x> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.x.service 2024-03-16T20:45:30.834 INFO:tasks.cephadm:Bootstrapping... 2024-03-16T20:45:30.835 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b -v bootstrap --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.8 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-16T20:45:31.118 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2024-03-16T20:45:31.119 INFO:teuthology.orchestra.run.smithi008.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b', '-v', 'bootstrap', '--fsid', '05d64692-e3d6-11ee-95c9-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.8', '--skip-admin-label'] 2024-03-16T20:45:31.182 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-16T20:45:31.183 INFO:teuthology.orchestra.run.smithi008.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-16T20:45:31.183 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying podman|docker is present... 2024-03-16T20:45:31.241 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-16T20:45:31.242 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying lvm2 is present... 2024-03-16T20:45:31.242 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying time synchronization is in place... 2024-03-16T20:45:31.263 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-16T20:45:31.263 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-16T20:45:31.284 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-16T20:45:31.284 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2024-03-16T20:45:31.310 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout enabled 2024-03-16T20:45:31.333 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout active 2024-03-16T20:45:31.333 INFO:teuthology.orchestra.run.smithi008.stdout:Unit chronyd.service is enabled and running 2024-03-16T20:45:31.334 INFO:teuthology.orchestra.run.smithi008.stdout:Repeating the final host check... 2024-03-16T20:45:31.394 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-16T20:45:31.394 INFO:teuthology.orchestra.run.smithi008.stdout:podman (/bin/podman) version 4.9.3 is present 2024-03-16T20:45:31.394 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl is present 2024-03-16T20:45:31.394 INFO:teuthology.orchestra.run.smithi008.stdout:lvcreate is present 2024-03-16T20:45:31.409 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-16T20:45:31.409 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-16T20:45:31.429 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-16T20:45:31.429 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2024-03-16T20:45:31.454 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout enabled 2024-03-16T20:45:31.476 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout active 2024-03-16T20:45:31.477 INFO:teuthology.orchestra.run.smithi008.stdout:Unit chronyd.service is enabled and running 2024-03-16T20:45:31.477 INFO:teuthology.orchestra.run.smithi008.stdout:Host looks OK 2024-03-16T20:45:31.477 INFO:teuthology.orchestra.run.smithi008.stdout:Cluster fsid: 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:45:31.478 INFO:teuthology.orchestra.run.smithi008.stdout:Acquiring lock 139790779781072 on /run/cephadm/05d64692-e3d6-11ee-95c9-87774f69a715.lock 2024-03-16T20:45:31.479 INFO:teuthology.orchestra.run.smithi008.stdout:Lock 139790779781072 acquired on /run/cephadm/05d64692-e3d6-11ee-95c9-87774f69a715.lock 2024-03-16T20:45:31.480 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying IP 172.21.15.8 port 3300 ... 2024-03-16T20:45:31.481 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying IP 172.21.15.8 port 6789 ... 2024-03-16T20:45:31.482 INFO:teuthology.orchestra.run.smithi008.stdout:Base mon IP(s) is [172.21.15.8:3300, 172.21.15.8:6789], mon addrv is [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2024-03-16T20:45:31.497 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.8 metric 100 2024-03-16T20:45:31.497 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.8 metric 100 2024-03-16T20:45:31.510 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-16T20:45:31.511 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-03-16T20:45:31.511 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-03-16T20:45:31.522 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-16T20:45:31.523 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-16T20:45:31.523 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-16T20:45:31.523 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-03-16T20:45:31.524 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link noprefixroute 2024-03-16T20:45:31.524 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-16T20:45:31.527 INFO:teuthology.orchestra.run.smithi008.stdout:Mon IP `172.21.15.8` is in CIDR network `172.21.0.0/20` 2024-03-16T20:45:31.527 INFO:teuthology.orchestra.run.smithi008.stdout:Mon IP `172.21.15.8` is in CIDR network `172.21.0.0/20` 2024-03-16T20:45:31.527 INFO:teuthology.orchestra.run.smithi008.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-16T20:45:31.530 INFO:teuthology.orchestra.run.smithi008.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-16T20:45:31.533 INFO:teuthology.orchestra.run.smithi008.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b... 2024-03-16T20:45:32.272 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 2024-03-16T20:45:32.273 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b... 2024-03-16T20:45:32.273 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Getting image source signatures 2024-03-16T20:45:32.273 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying blob sha256:f58b4670ef4403d11d1c912aa26a4dbcf73447df5302e9dc66f6a7fc0d9d1e47 2024-03-16T20:45:32.273 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying blob sha256:70a48e3dafcdedd8abcbc488c0076bda17d489568a5d72d4513d3d6eecb1880d 2024-03-16T20:45:32.273 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying config sha256:80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 2024-03-16T20:45:32.273 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-16T20:45:33.437 INFO:teuthology.orchestra.run.smithi008.stdout:ceph: stdout ceph version 19.0.0-1681-gaba3c1d2 (aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b) squid (dev) 2024-03-16T20:45:33.438 INFO:teuthology.orchestra.run.smithi008.stdout:Ceph version: ceph version 19.0.0-1681-gaba3c1d2 (aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b) squid (dev) 2024-03-16T20:45:33.438 INFO:teuthology.orchestra.run.smithi008.stdout:Extracting ceph user uid/gid from container image... 2024-03-16T20:45:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:stat: stdout 167 167 2024-03-16T20:45:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial keys... 2024-03-16T20:45:46.677 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQD6BPZlEhtFBhAAAQRSkkBLVtLOW0GNSntAhg== 2024-03-16T20:45:47.761 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQD7BPZlMFLZBRAAwHYucPM10QRhCNJsbLi4pA== 2024-03-16T20:45:49.027 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQD8BPZlngqAERAA9w6djRk751WUYorzSk2RHA== 2024-03-16T20:45:49.029 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial monmap... 2024-03-16T20:45:50.091 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-16T20:45:50.091 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-16T20:45:50.091 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:45:50.091 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-16T20:45:50.091 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool for a [v2:172.21.15.8:3300,v1:172.21.15.8:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-16T20:45:50.092 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = quincy 2024-03-16T20:45:50.092 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: set fsid to 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:45:50.092 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-16T20:45:50.092 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:45:50.092 INFO:teuthology.orchestra.run.smithi008.stdout:Creating mon... 2024-03-16T20:45:51.336 INFO:teuthology.orchestra.run.smithi008.stdout:create mon.a on 2024-03-16T20:45:52.083 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-16T20:45:52.341 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-16T20:45:52.652 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-05d64692-e3d6-11ee-95c9-87774f69a715.target → /etc/systemd/system/ceph-05d64692-e3d6-11ee-95c9-87774f69a715.target. 2024-03-16T20:45:52.652 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-05d64692-e3d6-11ee-95c9-87774f69a715.target → /etc/systemd/system/ceph-05d64692-e3d6-11ee-95c9-87774f69a715.target. 2024-03-16T20:45:53.062 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.a 2024-03-16T20:45:53.062 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to reset failed state of unit ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.a.service: Unit ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.a.service not loaded. 2024-03-16T20:45:53.348 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-05d64692-e3d6-11ee-95c9-87774f69a715.target.wants/ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.a.service → /etc/systemd/system/ceph-05d64692-e3d6-11ee-95c9-87774f69a715@.service. 2024-03-16T20:45:54.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:53 smithi008 podman[31039]: 2024-03-16 20:45:53.650834294 +0000 UTC m=+0.033489676 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:45:54.419 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-16T20:45:54.419 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2024-03-16T20:45:54.443 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-16T20:45:54.443 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2024-03-16T20:45:54.444 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2024-03-16T20:45:54.444 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to enable service . firewalld.service is not available 2024-03-16T20:45:54.445 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mon to start... 2024-03-16T20:45:54.446 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mon... 2024-03-16T20:45:54.599 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:54 smithi008 podman[31039]: 2024-03-16 20:45:54.24539053 +0000 UTC m=+0.628045972 container init 3b710dcef29205ac0207bec1fec920d47acd47fd79f1a6fe21b0d36a6ab70c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-16T20:45:54.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:54 smithi008 podman[31039]: 2024-03-16 20:45:54.256524982 +0000 UTC m=+0.639180407 container start 3b710dcef29205ac0207bec1fec920d47acd47fd79f1a6fe21b0d36a6ab70c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240307) 2024-03-16T20:45:54.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:54 smithi008 ceph-mon[31057]: mkfs 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:45:54.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:54 smithi008 ceph-mon[31057]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-16T20:45:54.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:54 smithi008 bash[31039]: 3b710dcef29205ac0207bec1fec920d47acd47fd79f1a6fe21b0d36a6ab70c1e 2024-03-16T20:45:54.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:54 smithi008 systemd[1]: Started Ceph mon.a for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:45:55.440 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:55 smithi008 ceph-mon[31057]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-16T20:45:55.440 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:55 smithi008 ceph-mon[31057]: monmap e1: 1 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-16T20:45:55.440 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:55 smithi008 ceph-mon[31057]: fsmap 2024-03-16T20:45:55.440 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:55 smithi008 ceph-mon[31057]: osdmap e1: 0 total, 0 up, 0 in 2024-03-16T20:45:55.440 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:55 smithi008 ceph-mon[31057]: mgrmap e1: no daemons active 2024-03-16T20:45:55.440 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:55 smithi008 ceph-mon[31057]: from='client.? 172.21.15.8:0/831773100' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-16T20:45:55.694 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout cluster: 2024-03-16T20:45:55.694 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout id: 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:45:55.695 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-16T20:45:55.695 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:45:55.695 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout services: 2024-03-16T20:45:55.695 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.777042s) 2024-03-16T20:45:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-16T20:45:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-16T20:45:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:45:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout data: 2024-03-16T20:45:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-16T20:45:55.696 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-16T20:45:55.697 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-16T20:45:55.697 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout pgs: 2024-03-16T20:45:55.697 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:45:55.697 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.017+0000 7f062e400700 1 Processor -- start 2024-03-16T20:45:55.697 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.017+0000 7f062e400700 1 -- start start 2024-03-16T20:45:55.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.018+0000 7f062e400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062810a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:45:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.018+0000 7f062e400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062807be20 con 0x7f06281084b0 2024-03-16T20:45:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.019+0000 7f0627400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062810a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:45:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.019+0000 7f0627400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062810a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56094/0 (socket says 172.21.15.8:56094) 2024-03-16T20:45:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.019+0000 7f0627400700 1 -- 172.21.15.8:0/1217423980 learned_addr learned my addr 172.21.15.8:0/1217423980 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:45:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.019+0000 7f0627400700 1 -- 172.21.15.8:0/1217423980 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062810ade0 con 0x7f06281084b0 2024-03-16T20:45:55.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.020+0000 7f0627400700 1 --2- 172.21.15.8:0/1217423980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062810a8a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f06180098a0 tx=0x7f0618009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37214c8a79cbbb62 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.020+0000 7f0626000700 1 -- 172.21.15.8:0/1217423980 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0618004160 con 0x7f06281084b0 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.020+0000 7f0626000700 1 -- 172.21.15.8:0/1217423980 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06180042c0 con 0x7f06281084b0 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.020+0000 7f0626000700 1 -- 172.21.15.8:0/1217423980 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06180045a0 con 0x7f06281084b0 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.021+0000 7f062e400700 1 -- 172.21.15.8:0/1217423980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 msgr2=0x7f062810a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.021+0000 7f062e400700 1 --2- 172.21.15.8:0/1217423980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062810a8a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f06180098a0 tx=0x7f0618009bb0 comp rx=0 tx=0).stop 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.021+0000 7f062e400700 1 -- 172.21.15.8:0/1217423980 shutdown_connections 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.021+0000 7f062e400700 1 --2- 172.21.15.8:0/1217423980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062810a8a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.021+0000 7f062e400700 1 -- 172.21.15.8:0/1217423980 >> 172.21.15.8:0/1217423980 conn(0x7f0628101ec0 msgr2=0x7f06281042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.021+0000 7f062e400700 1 -- 172.21.15.8:0/1217423980 shutdown_connections 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.021+0000 7f062e400700 1 -- 172.21.15.8:0/1217423980 wait complete. 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.022+0000 7f062e400700 1 Processor -- start 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.023+0000 7f062e400700 1 -- start start 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.023+0000 7f062e400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062819d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:45:55.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.023+0000 7f062e400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062819d670 con 0x7f06281084b0 2024-03-16T20:45:55.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.023+0000 7f0627400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062819d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:45:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.023+0000 7f0627400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062819d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56102/0 (socket says 172.21.15.8:56102) 2024-03-16T20:45:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.023+0000 7f0627400700 1 -- 172.21.15.8:0/831773100 learned_addr learned my addr 172.21.15.8:0/831773100 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:45:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.024+0000 7f0627400700 1 -- 172.21.15.8:0/831773100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618009550 con 0x7f06281084b0 2024-03-16T20:45:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.024+0000 7f0627400700 1 --2- 172.21.15.8:0/831773100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062819d130 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f062807b260 tx=0x7f0618004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:45:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.024+0000 7f061fe00700 1 -- 172.21.15.8:0/831773100 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0618011630 con 0x7f06281084b0 2024-03-16T20:45:55.704 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.024+0000 7f061fe00700 1 -- 172.21.15.8:0/831773100 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0618011790 con 0x7f06281084b0 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.024+0000 7f061fe00700 1 -- 172.21.15.8:0/831773100 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0618011a30 con 0x7f06281084b0 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.024+0000 7f062e400700 1 -- 172.21.15.8:0/831773100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062819d870 con 0x7f06281084b0 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.025+0000 7f062e400700 1 -- 172.21.15.8:0/831773100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062819dd10 con 0x7f06281084b0 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.025+0000 7f061fe00700 1 -- 172.21.15.8:0/831773100 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0618022070 con 0x7f06281084b0 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.025+0000 7f061fe00700 1 -- 172.21.15.8:0/831773100 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f061801c450 con 0x7f06281084b0 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.026+0000 7f062e400700 1 -- 172.21.15.8:0/831773100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06281970c0 con 0x7f06281084b0 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.029+0000 7f061fe00700 1 -- 172.21.15.8:0/831773100 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0618011b90 con 0x7f06281084b0 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.110+0000 7f062e400700 1 -- 172.21.15.8:0/831773100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f062810b260 con 0x7f06281084b0 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.111+0000 7f061fe00700 1 -- 172.21.15.8:0/831773100 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f0618011d30 con 0x7f06281084b0 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.112+0000 7f062e400700 1 -- 172.21.15.8:0/831773100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 msgr2=0x7f062819d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.112+0000 7f062e400700 1 --2- 172.21.15.8:0/831773100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062819d130 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f062807b260 tx=0x7f0618004750 comp rx=0 tx=0).stop 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.112+0000 7f062e400700 1 -- 172.21.15.8:0/831773100 shutdown_connections 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.112+0000 7f062e400700 1 --2- 172.21.15.8:0/831773100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06281084b0 0x7f062819d130 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:45:55.705 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.112+0000 7f062e400700 1 -- 172.21.15.8:0/831773100 >> 172.21.15.8:0/831773100 conn(0x7f0628101ec0 msgr2=0x7f0628102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:45:55.706 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.113+0000 7f062e400700 1 -- 172.21.15.8:0/831773100 shutdown_connections 2024-03-16T20:45:55.706 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:55.113+0000 7f062e400700 1 -- 172.21.15.8:0/831773100 wait complete. 2024-03-16T20:45:55.706 INFO:teuthology.orchestra.run.smithi008.stdout:mon is available 2024-03-16T20:45:55.706 INFO:teuthology.orchestra.run.smithi008.stdout:Assimilating anything we can from ceph.conf... 2024-03-16T20:45:56.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:56 smithi008 ceph-mon[31057]: from='client.? 172.21.15.8:0/2147456800' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-16T20:45:56.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:56 smithi008 ceph-mon[31057]: from='client.? 172.21.15.8:0/2147456800' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-16T20:45:57.211 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:45:57.211 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [global] 2024-03-16T20:45:57.212 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout fsid = 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:45:57.212 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2024-03-16T20:45:57.212 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-16T20:45:57.218 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-16T20:45:57.218 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-16T20:45:57.218 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-16T20:45:57.218 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [osd] 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.300+0000 7f9d1d400700 1 Processor -- start 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.301+0000 7f9d1d400700 1 -- start start 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.301+0000 7f9d1d400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1810a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.301+0000 7f9d1d400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1807be40 con 0x7f9d181084f0 2024-03-16T20:45:57.219 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.302+0000 7f9d16800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1810a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.302+0000 7f9d16800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1810a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56118/0 (socket says 172.21.15.8:56118) 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.302+0000 7f9d16800700 1 -- 172.21.15.8:0/3293181083 learned_addr learned my addr 172.21.15.8:0/3293181083 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.302+0000 7f9d16800700 1 -- 172.21.15.8:0/3293181083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1810ae20 con 0x7f9d181084f0 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.302+0000 7f9d16800700 1 --2- 172.21.15.8:0/3293181083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1810a8e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9d080098a0 tx=0x7f9d08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ae8ef923a06d78 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.303+0000 7f9d15400700 1 -- 172.21.15.8:0/3293181083 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d08004160 con 0x7f9d181084f0 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.303+0000 7f9d15400700 1 -- 172.21.15.8:0/3293181083 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d080042c0 con 0x7f9d181084f0 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.303+0000 7f9d15400700 1 -- 172.21.15.8:0/3293181083 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d080045a0 con 0x7f9d181084f0 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.303+0000 7f9d1d400700 1 -- 172.21.15.8:0/3293181083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 msgr2=0x7f9d1810a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.303+0000 7f9d1d400700 1 --2- 172.21.15.8:0/3293181083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1810a8e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9d080098a0 tx=0x7f9d08009bb0 comp rx=0 tx=0).stop 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.304+0000 7f9d1d400700 1 -- 172.21.15.8:0/3293181083 shutdown_connections 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.304+0000 7f9d1d400700 1 --2- 172.21.15.8:0/3293181083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1810a8e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.304+0000 7f9d1d400700 1 -- 172.21.15.8:0/3293181083 >> 172.21.15.8:0/3293181083 conn(0x7f9d18101f00 msgr2=0x7f9d18104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.304+0000 7f9d1d400700 1 -- 172.21.15.8:0/3293181083 shutdown_connections 2024-03-16T20:45:57.220 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.304+0000 7f9d1d400700 1 -- 172.21.15.8:0/3293181083 wait complete. 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.305+0000 7f9d1d400700 1 Processor -- start 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.305+0000 7f9d1d400700 1 -- start start 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.305+0000 7f9d1d400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1819d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.305+0000 7f9d1d400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1819d600 con 0x7f9d181084f0 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.306+0000 7f9d16800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1819d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.306+0000 7f9d16800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1819d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56120/0 (socket says 172.21.15.8:56120) 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.306+0000 7f9d16800700 1 -- 172.21.15.8:0/2147456800 learned_addr learned my addr 172.21.15.8:0/2147456800 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.306+0000 7f9d16800700 1 -- 172.21.15.8:0/2147456800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d08009550 con 0x7f9d181084f0 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.307+0000 7f9d16800700 1 --2- 172.21.15.8:0/2147456800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1819d0c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009fb0 tx=0x7f9d08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.307+0000 7f9d0f400700 1 -- 172.21.15.8:0/2147456800 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d08003dd0 con 0x7f9d181084f0 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.307+0000 7f9d0f400700 1 -- 172.21.15.8:0/2147456800 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d08011630 con 0x7f9d181084f0 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.307+0000 7f9d1d400700 1 -- 172.21.15.8:0/2147456800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1819d800 con 0x7f9d181084f0 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.307+0000 7f9d0f400700 1 -- 172.21.15.8:0/2147456800 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d08011910 con 0x7f9d181084f0 2024-03-16T20:45:57.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.307+0000 7f9d1d400700 1 -- 172.21.15.8:0/2147456800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1819dca0 con 0x7f9d181084f0 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.307+0000 7f9d0f400700 1 -- 172.21.15.8:0/2147456800 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9d0801c460 con 0x7f9d181084f0 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.308+0000 7f9d0f400700 1 -- 172.21.15.8:0/2147456800 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9d0801aba0 con 0x7f9d181084f0 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.308+0000 7f9d1d400700 1 -- 172.21.15.8:0/2147456800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1810b070 con 0x7f9d181084f0 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.311+0000 7f9d0f400700 1 -- 172.21.15.8:0/2147456800 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9d08011e50 con 0x7f9d181084f0 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.389+0000 7f9d1d400700 1 -- 172.21.15.8:0/2147456800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9d1810b250 con 0x7f9d181084f0 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.397+0000 7f9d0f400700 1 -- 172.21.15.8:0/2147456800 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f9d0801ad60 con 0x7f9d181084f0 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.399+0000 7f9d1d400700 1 -- 172.21.15.8:0/2147456800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 msgr2=0x7f9d1819d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.399+0000 7f9d1d400700 1 --2- 172.21.15.8:0/2147456800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1819d0c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009fb0 tx=0x7f9d08004750 comp rx=0 tx=0).stop 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.399+0000 7f9d1d400700 1 -- 172.21.15.8:0/2147456800 shutdown_connections 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.399+0000 7f9d1d400700 1 --2- 172.21.15.8:0/2147456800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d181084f0 0x7f9d1819d0c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.399+0000 7f9d1d400700 1 -- 172.21.15.8:0/2147456800 >> 172.21.15.8:0/2147456800 conn(0x7f9d18101f00 msgr2=0x7f9d18102d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.399+0000 7f9d1d400700 1 -- 172.21.15.8:0/2147456800 shutdown_connections 2024-03-16T20:45:57.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:56.399+0000 7f9d1d400700 1 -- 172.21.15.8:0/2147456800 wait complete. 2024-03-16T20:45:57.223 INFO:teuthology.orchestra.run.smithi008.stdout:Generating new minimal ceph.conf... 2024-03-16T20:45:58.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:57 smithi008 ceph-mon[31057]: from='client.? 172.21.15.8:0/230165908' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:45:58.585 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.799+0000 7f21a5c00700 1 Processor -- start 2024-03-16T20:45:58.585 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.799+0000 7f21a5c00700 1 -- start start 2024-03-16T20:45:58.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.800+0000 7f21a5c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a010a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:45:58.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.800+0000 7f21a5c00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a010a5e0 con 0x7f21a0109bf0 2024-03-16T20:45:58.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.800+0000 7f219ea00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a010a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:45:58.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.800+0000 7f219ea00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a010a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56128/0 (socket says 172.21.15.8:56128) 2024-03-16T20:45:58.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.800+0000 7f219ea00700 1 -- 172.21.15.8:0/2350677252 learned_addr learned my addr 172.21.15.8:0/2350677252 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:45:58.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.801+0000 7f219ea00700 1 -- 172.21.15.8:0/2350677252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a010adf0 con 0x7f21a0109bf0 2024-03-16T20:45:58.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.801+0000 7f219ea00700 1 --2- 172.21.15.8:0/2350677252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a010a010 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f21900098a0 tx=0x7f2190009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92977a67e36efbf9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:45:58.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.801+0000 7f219d600700 1 -- 172.21.15.8:0/2350677252 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2190004160 con 0x7f21a0109bf0 2024-03-16T20:45:58.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.801+0000 7f219d600700 1 -- 172.21.15.8:0/2350677252 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f21900042c0 con 0x7f21a0109bf0 2024-03-16T20:45:58.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.801+0000 7f219d600700 1 -- 172.21.15.8:0/2350677252 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2190011b70 con 0x7f21a0109bf0 2024-03-16T20:45:58.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.802+0000 7f21a5c00700 1 -- 172.21.15.8:0/2350677252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 msgr2=0x7f21a010a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.802+0000 7f21a5c00700 1 --2- 172.21.15.8:0/2350677252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a010a010 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f21900098a0 tx=0x7f2190009bb0 comp rx=0 tx=0).stop 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.802+0000 7f21a5c00700 1 -- 172.21.15.8:0/2350677252 shutdown_connections 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.802+0000 7f21a5c00700 1 --2- 172.21.15.8:0/2350677252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a010a010 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.802+0000 7f21a5c00700 1 -- 172.21.15.8:0/2350677252 >> 172.21.15.8:0/2350677252 conn(0x7f21a007d000 msgr2=0x7f21a007d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.803+0000 7f21a5c00700 1 -- 172.21.15.8:0/2350677252 shutdown_connections 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.803+0000 7f21a5c00700 1 -- 172.21.15.8:0/2350677252 wait complete. 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.804+0000 7f21a5c00700 1 Processor -- start 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.804+0000 7f21a5c00700 1 -- start start 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.804+0000 7f21a5c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a019d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.804+0000 7f21a5c00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a019df30 con 0x7f21a0109bf0 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.804+0000 7f219ea00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a019d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.804+0000 7f219ea00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a019d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56134/0 (socket says 172.21.15.8:56134) 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.804+0000 7f219ea00700 1 -- 172.21.15.8:0/230165908 learned_addr learned my addr 172.21.15.8:0/230165908 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.805+0000 7f219ea00700 1 -- 172.21.15.8:0/230165908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2190009550 con 0x7f21a0109bf0 2024-03-16T20:45:58.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.805+0000 7f219ea00700 1 --2- 172.21.15.8:0/230165908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a019d9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2190000c00 tx=0x7f2190011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.805+0000 7f2197400700 1 -- 172.21.15.8:0/230165908 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2190003aa0 con 0x7f21a0109bf0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.805+0000 7f2197400700 1 -- 172.21.15.8:0/230165908 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f2190003c00 con 0x7f21a0109bf0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.805+0000 7f2197400700 1 -- 172.21.15.8:0/230165908 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2190024930 con 0x7f21a0109bf0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.805+0000 7f21a5c00700 1 -- 172.21.15.8:0/230165908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a019e130 con 0x7f21a0109bf0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.806+0000 7f21a5c00700 1 -- 172.21.15.8:0/230165908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a019e5d0 con 0x7f21a0109bf0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.806+0000 7f2197400700 1 -- 172.21.15.8:0/230165908 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f219002d3f0 con 0x7f21a0109bf0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.806+0000 7f2197400700 1 -- 172.21.15.8:0/230165908 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f219001a430 con 0x7f21a0109bf0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.807+0000 7f21a5c00700 1 -- 172.21.15.8:0/230165908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a010e020 con 0x7f21a0109bf0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.810+0000 7f2197400700 1 -- 172.21.15.8:0/230165908 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f219001aca0 con 0x7f21a0109bf0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.887+0000 7f21a5c00700 1 -- 172.21.15.8:0/230165908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f21a01a1200 con 0x7f21a0109bf0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.888+0000 7f2197400700 1 -- 172.21.15.8:0/230165908 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f2190035090 con 0x7f21a0109bf0 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.889+0000 7f21a5c00700 1 -- 172.21.15.8:0/230165908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 msgr2=0x7f21a019d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.889+0000 7f21a5c00700 1 --2- 172.21.15.8:0/230165908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a019d9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2190000c00 tx=0x7f2190011bf0 comp rx=0 tx=0).stop 2024-03-16T20:45:58.588 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.890+0000 7f21a5c00700 1 -- 172.21.15.8:0/230165908 shutdown_connections 2024-03-16T20:45:58.589 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.890+0000 7f21a5c00700 1 --2- 172.21.15.8:0/230165908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21a0109bf0 0x7f21a019d9f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:45:58.589 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.890+0000 7f21a5c00700 1 -- 172.21.15.8:0/230165908 >> 172.21.15.8:0/230165908 conn(0x7f21a007d000 msgr2=0x7f21a01075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:45:58.589 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.890+0000 7f21a5c00700 1 -- 172.21.15.8:0/230165908 shutdown_connections 2024-03-16T20:45:58.589 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:45:57.890+0000 7f21a5c00700 1 -- 172.21.15.8:0/230165908 wait complete. 2024-03-16T20:45:58.589 INFO:teuthology.orchestra.run.smithi008.stdout:Restarting the monitor... 2024-03-16T20:45:58.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:58 smithi008 systemd[1]: Stopping Ceph mon.a for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:45:59.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:59 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a[31053]: 2024-03-16T20:45:59.090+0000 7f9e7e200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T20:45:59.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:59 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a[31053]: 2024-03-16T20:45:59.090+0000 7f9e7e200700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-16T20:45:59.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:59 smithi008 podman[31300]: 2024-03-16 20:45:59.328532752 +0000 UTC m=+0.389662671 container died 3b710dcef29205ac0207bec1fec920d47acd47fd79f1a6fe21b0d36a6ab70c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=) 2024-03-16T20:45:59.929 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:59 smithi008 podman[31300]: 2024-03-16 20:45:59.70797389 +0000 UTC m=+0.769103793 container cleanup 3b710dcef29205ac0207bec1fec920d47acd47fd79f1a6fe21b0d36a6ab70c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T20:45:59.929 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:59 smithi008 bash[31300]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a 2024-03-16T20:46:00.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:45:59 smithi008 podman[31314]: 2024-03-16 20:45:59.925612985 +0000 UTC m=+0.579994181 container remove 3b710dcef29205ac0207bec1fec920d47acd47fd79f1a6fe21b0d36a6ab70c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T20:46:00.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:00 smithi008 systemd[1]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.a.service: Deactivated successfully. 2024-03-16T20:46:00.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:00 smithi008 systemd[1]: Stopped Ceph mon.a for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:46:00.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:00 smithi008 systemd[1]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.a.service: Consumed 1.879s CPU time. 2024-03-16T20:46:00.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:00 smithi008 systemd[1]: Starting Ceph mon.a for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:46:01.018 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:00 smithi008 podman[31414]: 2024-03-16 20:46:00.665175628 +0000 UTC m=+0.041733720 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:46:01.018 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:00 smithi008 podman[31414]: 2024-03-16 20:46:00.793617373 +0000 UTC m=+0.170175487 container create a5a6050aac3f2f396d1958e5df30220474b102e80be67d394c8a5509bd3e2662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T20:46:01.018 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 podman[31414]: 2024-03-16 20:46:01.013860168 +0000 UTC m=+0.390418322 container init a5a6050aac3f2f396d1958e5df30220474b102e80be67d394c8a5509bd3e2662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T20:46:01.125 INFO:teuthology.orchestra.run.smithi008.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-16T20:46:01.277 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 podman[31414]: 2024-03-16 20:46:01.026026786 +0000 UTC m=+0.402584871 container start a5a6050aac3f2f396d1958e5df30220474b102e80be67d394c8a5509bd3e2662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a, ceph=True, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T20:46:01.277 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: set uid:gid to 167:167 (ceph:ceph) 2024-03-16T20:46:01.277 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: ceph version 19.0.0-1681-gaba3c1d2 (aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b) squid (dev), process ceph-mon, pid 2 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: pidfile_write: ignore empty --pid-file 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: load: jerasure load: lrc 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: RocksDB version: 7.9.2 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Git sha 0 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Compile date 2024-03-15 02:27:09 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: DB SUMMARY 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: DB Session ID: F6FU8H8DHHNYF3QWMG9I 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: CURRENT file: CURRENT 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: IDENTITY file: IDENTITY 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 100218 ; 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.error_if_exists: 0 2024-03-16T20:46:01.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.create_if_missing: 0 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.paranoid_checks: 1 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.env: 0x5587e5d40ae0 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.fs: PosixFileSystem 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.info_log: 0x5587e7bf5940 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_file_opening_threads: 16 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.statistics: (nil) 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.use_fsync: 0 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_log_file_size: 0 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.keep_log_file_num: 1000 2024-03-16T20:46:01.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.recycle_log_file_num: 0 2024-03-16T20:46:01.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.allow_fallocate: 1 2024-03-16T20:46:01.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.allow_mmap_reads: 0 2024-03-16T20:46:01.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.allow_mmap_writes: 0 2024-03-16T20:46:01.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.use_direct_reads: 0 2024-03-16T20:46:01.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-16T20:46:01.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.create_missing_column_families: 0 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.db_log_dir: 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.wal_dir: 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.advise_random_on_open: 1 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.db_write_buffer_size: 0 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.write_buffer_manager: 0x5587e7bc9400 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-16T20:46:01.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.rate_limiter: (nil) 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.wal_recovery_mode: 2 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.enable_thread_tracking: 0 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.enable_pipelined_write: 0 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.unordered_write: 0 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.row_cache: None 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.wal_filter: None 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-16T20:46:01.282 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.allow_ingest_behind: 0 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.two_write_queues: 0 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.manual_wal_flush: 0 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.wal_compression: 0 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.atomic_flush: 0 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.log_readahead_size: 0 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.best_efforts_recovery: 0 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.allow_data_in_errors: 0 2024-03-16T20:46:01.283 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.db_host_id: __hostname__ 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_background_jobs: 2 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_background_compactions: -1 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_subcompactions: 1 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_total_wal_size: 0 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_open_files: -1 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bytes_per_sync: 0 2024-03-16T20:46:01.284 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_readahead_size: 0 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_background_flushes: -1 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Compression algorithms supported: 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: kZSTD supported: 0 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: kXpressCompression supported: 0 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: kLZ4HCCompression supported: 1 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: kZlibCompression supported: 1 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: kSnappyCompression supported: 1 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: kLZ4Compression supported: 1 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: kBZip2Compression supported: 0 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-16T20:46:01.285 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.merge_operator: 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_filter: None 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_filter_factory: None 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.sst_partitioner_factory: None 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5587e7bf5a40) 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout: cache_index_and_filter_blocks: 1 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-16T20:46:01.286 INFO:journalctl@ceph.mon.a.smithi008.stdout: pin_top_level_index_and_filter: 1 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_type: 0 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: data_block_index_type: 0 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_shortening: 1 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: checksum: 4 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: no_block_cache: 0 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache: 0x5587e7bf9090 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_name: BinnedLRUCache 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_options: 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: capacity : 536870912 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: num_shard_bits : 4 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: strict_capacity_limit : 0 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: high_pri_pool_ratio: 0.000 2024-03-16T20:46:01.287 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_compressed: (nil) 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: persistent_cache: (nil) 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_size: 4096 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_size_deviation: 10 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_restart_interval: 16 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_block_restart_interval: 1 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: metadata_block_size: 4096 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: partition_filters: 0 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: use_delta_encoding: 1 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: filter_policy: bloomfilter 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: whole_key_filtering: 1 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: verify_compression: 0 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: read_amp_bytes_per_bit: 0 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: format_version: 5 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: enable_index_compression: 1 2024-03-16T20:46:01.288 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_align: 0 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout: max_auto_readahead_size: 262144 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout: prepopulate_block_cache: 0 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout: initial_auto_readahead_size: 8192 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout: num_file_reads_for_auto_readahead: 2 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.write_buffer_size: 33554432 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_write_buffer_number: 2 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compression: NoCompression 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bottommost_compression: Disabled 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.prefix_extractor: nullptr 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.num_levels: 7 2024-03-16T20:46:01.289 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-16T20:46:01.290 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-16T20:46:01.290 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-16T20:46:01.290 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-16T20:46:01.290 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-16T20:46:01.290 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-16T20:46:01.290 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compression_opts.level: 32767 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compression_opts.strategy: 0 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compression_opts.enabled: false 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-16T20:46:01.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.target_file_size_base: 67108864 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-16T20:46:01.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.arena_block_size: 1048576 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.disable_auto_compactions: 0 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-16T20:46:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.table_properties_collectors: 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.inplace_update_support: 0 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.bloom_locality: 0 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.max_successive_merges: 0 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.paranoid_file_checks: 0 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.force_consistency_checks: 1 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.report_bg_io_stats: 0 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.ttl: 2592000 2024-03-16T20:46:01.294 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.enable_blob_files: false 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.min_blob_size: 0 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.blob_file_size: 268435456 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.blob_file_starting_level: 0 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 69f0153b-7143-474b-9ee9-b7a122c45673 2024-03-16T20:46:01.295 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710621961080850, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710621961082626, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95343, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 318, "table_properties": {"data_size": 93329, "index_size": 296, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13898, "raw_average_key_size": 50, "raw_value_size": 85791, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 277, "num_filter_entries": 277, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1710621961, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "69f0153b-7143-474b-9ee9-b7a122c45673", "db_session_id": "F6FU8H8DHHNYF3QWMG9I", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710621961082856, "job": 1, "event": "recovery_finished"} 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5587e7cea000 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: DB pointer 0x5587e7cd4000 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** DB Stats ** 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-16T20:46:01.296 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** Compaction Stats [default] ** 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: L0 2/0 94.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 80.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: Sum 2/0 94.94 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 80.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 80.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** Compaction Stats [default] ** 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-16T20:46:01.297 INFO:journalctl@ceph.mon.a.smithi008.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 80.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative compaction: 0.00 GB write, 14.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval compaction: 0.00 GB write, 14.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: Block cache BinnedLRUCache@0x5587e7bf9090#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-03-16T20:46:01.298 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: starting mon.a rank 0 at public addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] at bind addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: mon.a@-1(???) e1 preinit fsid 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: mon.a@-1(???).mds e1 new map 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: mon.a@-1(???).mds e1 print_map 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout: e1 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout: legacy client fscid: -1 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout: No filesystems configured 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-16T20:46:01.299 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-16T20:46:01.300 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 bash[31414]: a5a6050aac3f2f396d1958e5df30220474b102e80be67d394c8a5509bd3e2662 2024-03-16T20:46:01.300 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 systemd[1]: Started Ceph mon.a for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:46:01.300 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-16T20:46:01.300 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: monmap e1: 1 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-16T20:46:01.300 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: fsmap 2024-03-16T20:46:01.300 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: osdmap e1: 0 total, 0 up, 0 in 2024-03-16T20:46:01.300 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:01 smithi008 ceph-mon[31434]: mgrmap e1: no daemons active 2024-03-16T20:46:02.841 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.171+0000 7f9f7ec00700 1 Processor -- start 2024-03-16T20:46:02.842 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.171+0000 7f9f7ec00700 1 -- start start 2024-03-16T20:46:02.842 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.172+0000 7f9f7ec00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7807c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:02.843 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.172+0000 7f9f7ec00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7807e180 con 0x7f9f7807dd60 2024-03-16T20:46:02.843 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.172+0000 7f9f7d800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7807c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:02.843 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.172+0000 7f9f7d800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7807c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41778/0 (socket says 172.21.15.8:41778) 2024-03-16T20:46:02.843 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.172+0000 7f9f7d800700 1 -- 172.21.15.8:0/122392824 learned_addr learned my addr 172.21.15.8:0/122392824 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:02.846 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.173+0000 7f9f7d800700 1 -- 172.21.15.8:0/122392824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7807c810 con 0x7f9f7807dd60 2024-03-16T20:46:02.846 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.173+0000 7f9f7d800700 1 --2- 172.21.15.8:0/122392824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7807c2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c0098a0 tx=0x7f9f6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837f7c04bf52793a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:02.846 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.174+0000 7f9f77e00700 1 -- 172.21.15.8:0/122392824 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6c004160 con 0x7f9f7807dd60 2024-03-16T20:46:02.846 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.174+0000 7f9f77e00700 1 -- 172.21.15.8:0/122392824 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f9f6c0042c0 con 0x7f9f7807dd60 2024-03-16T20:46:02.846 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.174+0000 7f9f77e00700 1 -- 172.21.15.8:0/122392824 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6c011b70 con 0x7f9f7807dd60 2024-03-16T20:46:02.846 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.174+0000 7f9f7ec00700 1 -- 172.21.15.8:0/122392824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 msgr2=0x7f9f7807c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:02.846 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.174+0000 7f9f7ec00700 1 --2- 172.21.15.8:0/122392824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7807c2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c0098a0 tx=0x7f9f6c009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:02.846 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.175+0000 7f9f7ec00700 1 -- 172.21.15.8:0/122392824 shutdown_connections 2024-03-16T20:46:02.846 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.175+0000 7f9f7ec00700 1 --2- 172.21.15.8:0/122392824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7807c2d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:02.846 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.175+0000 7f9f7ec00700 1 -- 172.21.15.8:0/122392824 >> 172.21.15.8:0/122392824 conn(0x7f9f78102ec0 msgr2=0x7f9f78105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:02.847 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.175+0000 7f9f7ec00700 1 -- 172.21.15.8:0/122392824 shutdown_connections 2024-03-16T20:46:02.849 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.175+0000 7f9f7ec00700 1 -- 172.21.15.8:0/122392824 wait complete. 2024-03-16T20:46:02.849 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.176+0000 7f9f7ec00700 1 Processor -- start 2024-03-16T20:46:02.849 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.176+0000 7f9f7ec00700 1 -- start start 2024-03-16T20:46:02.849 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.176+0000 7f9f7ec00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7819d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:02.849 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.176+0000 7f9f7ec00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7819ddb0 con 0x7f9f7807dd60 2024-03-16T20:46:02.849 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.177+0000 7f9f7d800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7819d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:02.849 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.177+0000 7f9f7d800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7819d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41786/0 (socket says 172.21.15.8:41786) 2024-03-16T20:46:02.849 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.177+0000 7f9f7d800700 1 -- 172.21.15.8:0/933840545 learned_addr learned my addr 172.21.15.8:0/933840545 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:02.850 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.177+0000 7f9f7d800700 1 -- 172.21.15.8:0/933840545 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c009550 con 0x7f9f7807dd60 2024-03-16T20:46:02.850 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.178+0000 7f9f7d800700 1 --2- 172.21.15.8:0/933840545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7819d870 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c011b40 tx=0x7f9f6c011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:02.850 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.178+0000 7f9f76000700 1 -- 172.21.15.8:0/933840545 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6c003aa0 con 0x7f9f7807dd60 2024-03-16T20:46:02.850 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.178+0000 7f9f76000700 1 -- 172.21.15.8:0/933840545 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f9f6c003c00 con 0x7f9f7807dd60 2024-03-16T20:46:02.852 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.178+0000 7f9f76000700 1 -- 172.21.15.8:0/933840545 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6c024800 con 0x7f9f7807dd60 2024-03-16T20:46:02.852 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.178+0000 7f9f7ec00700 1 -- 172.21.15.8:0/933840545 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7819dfb0 con 0x7f9f7807dd60 2024-03-16T20:46:02.852 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.178+0000 7f9f7ec00700 1 -- 172.21.15.8:0/933840545 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7819e450 con 0x7f9f7807dd60 2024-03-16T20:46:02.852 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.179+0000 7f9f76000700 1 -- 172.21.15.8:0/933840545 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9f6c024960 con 0x7f9f7807dd60 2024-03-16T20:46:02.852 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.179+0000 7f9f76000700 1 -- 172.21.15.8:0/933840545 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9f6c02de20 con 0x7f9f7807dd60 2024-03-16T20:46:02.852 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.179+0000 7f9f7ec00700 1 -- 172.21.15.8:0/933840545 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7810dbe0 con 0x7f9f7807dd60 2024-03-16T20:46:02.852 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.183+0000 7f9f76000700 1 -- 172.21.15.8:0/933840545 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9f6c01a910 con 0x7f9f7807dd60 2024-03-16T20:46:02.852 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.260+0000 7f9f7ec00700 1 -- 172.21.15.8:0/933840545 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f9f7810ddf0 con 0x7f9f7807dd60 2024-03-16T20:46:02.852 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.263+0000 7f9f76000700 1 -- 172.21.15.8:0/933840545 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9f6c024d50 con 0x7f9f7807dd60 2024-03-16T20:46:02.852 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.264+0000 7f9f7ec00700 1 -- 172.21.15.8:0/933840545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 msgr2=0x7f9f7819d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:02.853 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.264+0000 7f9f7ec00700 1 --2- 172.21.15.8:0/933840545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7819d870 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c011b40 tx=0x7f9f6c011c20 comp rx=0 tx=0).stop 2024-03-16T20:46:02.853 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.265+0000 7f9f7ec00700 1 -- 172.21.15.8:0/933840545 shutdown_connections 2024-03-16T20:46:02.853 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.265+0000 7f9f7ec00700 1 --2- 172.21.15.8:0/933840545 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f7807dd60 0x7f9f7819d870 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:02.853 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.265+0000 7f9f7ec00700 1 -- 172.21.15.8:0/933840545 >> 172.21.15.8:0/933840545 conn(0x7f9f78102ec0 msgr2=0x7f9f78103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:02.853 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.265+0000 7f9f7ec00700 1 -- 172.21.15.8:0/933840545 shutdown_connections 2024-03-16T20:46:02.853 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:02.265+0000 7f9f7ec00700 1 -- 172.21.15.8:0/933840545 wait complete. 2024-03-16T20:46:02.853 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-16T20:46:02.872 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-16T20:46:02.872 INFO:teuthology.orchestra.run.smithi008.stdout:Creating mgr... 2024-03-16T20:46:02.874 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-16T20:46:02.875 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-16T20:46:03.297 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.x 2024-03-16T20:46:03.297 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to reset failed state of unit ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.x.service: Unit ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.x.service not loaded. 2024-03-16T20:46:03.578 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-05d64692-e3d6-11ee-95c9-87774f69a715.target.wants/ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-05d64692-e3d6-11ee-95c9-87774f69a715@.service. 2024-03-16T20:46:03.608 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:03 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/933840545' entity='client.admin' 2024-03-16T20:46:03.967 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:03 smithi008 systemd[1]: Starting Ceph mgr.x for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:46:04.225 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:03 smithi008 podman[31648]: 2024-03-16 20:46:03.869836633 +0000 UTC m=+0.039502480 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:46:04.225 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:03 smithi008 podman[31648]: 2024-03-16 20:46:03.996419117 +0000 UTC m=+0.166084996 container create 679081db66a6b90aee0cadb21fab22976b400f42f8963f3f8f0113a4a794c2c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307) 2024-03-16T20:46:04.225 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:04 smithi008 podman[31648]: 2024-03-16 20:46:04.210498854 +0000 UTC m=+0.380164776 container init 679081db66a6b90aee0cadb21fab22976b400f42f8963f3f8f0113a4a794c2c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T20:46:04.225 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:04 smithi008 podman[31648]: 2024-03-16 20:46:04.220813509 +0000 UTC m=+0.390479395 container start 679081db66a6b90aee0cadb21fab22976b400f42f8963f3f8f0113a4a794c2c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-16T20:46:04.358 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-16T20:46:04.359 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2024-03-16T20:46:04.380 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-16T20:46:04.380 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2024-03-16T20:46:04.381 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2024-03-16T20:46:04.381 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to enable service . firewalld.service is not available 2024-03-16T20:46:04.405 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-16T20:46:04.405 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2024-03-16T20:46:04.424 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-16T20:46:04.424 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2024-03-16T20:46:04.424 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2024-03-16T20:46:04.425 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-16T20:46:04.425 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr to start... 2024-03-16T20:46:04.425 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr... 2024-03-16T20:46:04.493 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:04 smithi008 bash[31648]: 679081db66a6b90aee0cadb21fab22976b400f42f8963f3f8f0113a4a794c2c6 2024-03-16T20:46:04.493 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:04 smithi008 systemd[1]: Started Ceph mgr.x for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:46:05.123 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:05 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:05.022+0000 7f3f73a52200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T20:46:05.479 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:05 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/939150760' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-16T20:46:05.479 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:05 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:05.153+0000 7f3f73a52200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T20:46:05.810 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "05d64692-e3d6-11ee-95c9-87774f69a715", 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-16T20:46:05.813 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-16T20:46:05.814 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-16T20:46:05.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-16T20:46:05.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-16T20:46:05.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:05.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-16T20:46:05.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2024-03-16T20:45:54.336057+0000", 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.024+0000 7f1233800700 1 Processor -- start 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.024+0000 7f1233800700 1 -- start start 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.024+0000 7f1233800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c10a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.024+0000 7f1233800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c10a680 con 0x7f122c109c90 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.025+0000 7f1230e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c10a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.025+0000 7f1230e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c10a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41812/0 (socket says 172.21.15.8:41812) 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.025+0000 7f1230e00700 1 -- 172.21.15.8:0/2691782868 learned_addr learned my addr 172.21.15.8:0/2691782868 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.026+0000 7f1230e00700 1 -- 172.21.15.8:0/2691782868 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c10adf0 con 0x7f122c109c90 2024-03-16T20:46:05.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.026+0000 7f1230e00700 1 --2- 172.21.15.8:0/2691782868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c10a0b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f12200098a0 tx=0x7f1220009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bc83dbb5fa782d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.026+0000 7f122b400700 1 -- 172.21.15.8:0/2691782868 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1220004160 con 0x7f122c109c90 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.026+0000 7f122b400700 1 -- 172.21.15.8:0/2691782868 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f12200042c0 con 0x7f122c109c90 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.026+0000 7f122b400700 1 -- 172.21.15.8:0/2691782868 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1220011b70 con 0x7f122c109c90 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.027+0000 7f1233800700 1 -- 172.21.15.8:0/2691782868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 msgr2=0x7f122c10a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.027+0000 7f1233800700 1 --2- 172.21.15.8:0/2691782868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c10a0b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f12200098a0 tx=0x7f1220009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.027+0000 7f1233800700 1 -- 172.21.15.8:0/2691782868 shutdown_connections 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.027+0000 7f1233800700 1 --2- 172.21.15.8:0/2691782868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c10a0b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.027+0000 7f1233800700 1 -- 172.21.15.8:0/2691782868 >> 172.21.15.8:0/2691782868 conn(0x7f122c07d110 msgr2=0x7f122c07d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.027+0000 7f1233800700 1 -- 172.21.15.8:0/2691782868 shutdown_connections 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.027+0000 7f1233800700 1 -- 172.21.15.8:0/2691782868 wait complete. 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.028+0000 7f1233800700 1 Processor -- start 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.028+0000 7f1233800700 1 -- start start 2024-03-16T20:46:05.826 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.029+0000 7f1233800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c19da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.029+0000 7f1233800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c19df70 con 0x7f122c109c90 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.029+0000 7f1230e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c19da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.029+0000 7f1230e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c19da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41822/0 (socket says 172.21.15.8:41822) 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.029+0000 7f1230e00700 1 -- 172.21.15.8:0/939150760 learned_addr learned my addr 172.21.15.8:0/939150760 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.029+0000 7f1230e00700 1 -- 172.21.15.8:0/939150760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220009550 con 0x7f122c109c90 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.030+0000 7f1230e00700 1 --2- 172.21.15.8:0/939150760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c19da30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1220011850 tx=0x7f1220011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.030+0000 7f1229600700 1 -- 172.21.15.8:0/939150760 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1220003af0 con 0x7f122c109c90 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.030+0000 7f1229600700 1 -- 172.21.15.8:0/939150760 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f1220003c50 con 0x7f122c109c90 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.030+0000 7f1229600700 1 -- 172.21.15.8:0/939150760 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1220019800 con 0x7f122c109c90 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.030+0000 7f1233800700 1 -- 172.21.15.8:0/939150760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122c19e170 con 0x7f122c109c90 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.030+0000 7f1233800700 1 -- 172.21.15.8:0/939150760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122c19e610 con 0x7f122c109c90 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.031+0000 7f1229600700 1 -- 172.21.15.8:0/939150760 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1220019a80 con 0x7f122c109c90 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.031+0000 7f1229600700 1 -- 172.21.15.8:0/939150760 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f122000b720 con 0x7f122c109c90 2024-03-16T20:46:05.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.031+0000 7f1233800700 1 -- 172.21.15.8:0/939150760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122c10e020 con 0x7f122c109c90 2024-03-16T20:46:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.034+0000 7f1229600700 1 -- 172.21.15.8:0/939150760 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f122002a060 con 0x7f122c109c90 2024-03-16T20:46:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.114+0000 7f1233800700 1 -- 172.21.15.8:0/939150760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f122c1a1180 con 0x7f122c109c90 2024-03-16T20:46:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.115+0000 7f1229600700 1 -- 172.21.15.8:0/939150760 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f122001a910 con 0x7f122c109c90 2024-03-16T20:46:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.117+0000 7f1233800700 1 -- 172.21.15.8:0/939150760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 msgr2=0x7f122c19da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.117+0000 7f1233800700 1 --2- 172.21.15.8:0/939150760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c19da30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1220011850 tx=0x7f1220011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.117+0000 7f1233800700 1 -- 172.21.15.8:0/939150760 shutdown_connections 2024-03-16T20:46:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.117+0000 7f1233800700 1 --2- 172.21.15.8:0/939150760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f122c109c90 0x7f122c19da30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.117+0000 7f1233800700 1 -- 172.21.15.8:0/939150760 >> 172.21.15.8:0/939150760 conn(0x7f122c07d110 msgr2=0x7f122c107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.117+0000 7f1233800700 1 -- 172.21.15.8:0/939150760 shutdown_connections 2024-03-16T20:46:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:05.117+0000 7f1233800700 1 -- 172.21.15.8:0/939150760 wait complete. 2024-03-16T20:46:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (1/15)... 2024-03-16T20:46:06.128 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:06.000+0000 7f3f73a52200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T20:46:06.443 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:06.124+0000 7f3f73a52200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T20:46:06.444 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:06.310+0000 7f3f73a52200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T20:46:06.444 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:06.439+0000 7f3f73a52200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T20:46:06.743 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:06.553+0000 7f3f73a52200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T20:46:07.168 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:06.902+0000 7f3f73a52200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T20:46:07.169 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:07 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:07.047+0000 7f3f73a52200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T20:46:07.494 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:07 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:07.164+0000 7f3f73a52200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T20:46:07.494 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:07 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:07.292+0000 7f3f73a52200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T20:46:07.967 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:07 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:07.513+0000 7f3f73a52200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T20:46:08.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:08 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2054427453' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-16T20:46:09.072 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:08 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:08.890+0000 7f3f73a52200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T20:46:09.073 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:09 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:09.068+0000 7f3f73a52200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T20:46:09.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:46:09.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2024-03-16T20:46:09.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "05d64692-e3d6-11ee-95c9-87774f69a715", 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2024-03-16T20:46:09.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-16T20:46:09.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-16T20:46:09.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-16T20:46:09.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:09.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-16T20:46:09.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-16T20:46:09.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-16T20:46:09.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-16T20:46:09.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-16T20:46:09.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-16T20:46:09.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-16T20:46:09.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-16T20:46:09.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-16T20:46:09.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2024-03-16T20:46:09.136 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:09.136 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T20:46:09.136 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:09.136 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-16T20:46:09.136 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:09.136 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2024-03-16T20:45:54.336057+0000", 2024-03-16T20:46:09.136 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T20:46:09.136 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:09.136 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-16T20:46:09.136 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2024-03-16T20:46:09.136 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.382+0000 7f99ad600700 1 Processor -- start 2024-03-16T20:46:09.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.382+0000 7f99ad600700 1 -- start start 2024-03-16T20:46:09.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.382+0000 7f99ad600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a807c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:09.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.382+0000 7f99ad600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a807c900 con 0x7f99a807de80 2024-03-16T20:46:09.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.383+0000 7f99a6a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a807c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:09.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.383+0000 7f99a6a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a807c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44646/0 (socket says 172.21.15.8:44646) 2024-03-16T20:46:09.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.383+0000 7f99a6a00700 1 -- 172.21.15.8:0/1011456259 learned_addr learned my addr 172.21.15.8:0/1011456259 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:09.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.383+0000 7f99a6a00700 1 -- 172.21.15.8:0/1011456259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a807ca40 con 0x7f99a807de80 2024-03-16T20:46:09.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.384+0000 7f99a6a00700 1 --2- 172.21.15.8:0/1011456259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a807c330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f99980098a0 tx=0x7f9998009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5df96d2bcd2fddd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:09.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.384+0000 7f99a5600700 1 -- 172.21.15.8:0/1011456259 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9998004160 con 0x7f99a807de80 2024-03-16T20:46:09.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.384+0000 7f99a5600700 1 -- 172.21.15.8:0/1011456259 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f99980042c0 con 0x7f99a807de80 2024-03-16T20:46:09.137 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.384+0000 7f99a5600700 1 -- 172.21.15.8:0/1011456259 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9998011b70 con 0x7f99a807de80 2024-03-16T20:46:09.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.385+0000 7f99ad600700 1 -- 172.21.15.8:0/1011456259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 msgr2=0x7f99a807c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:09.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.385+0000 7f99ad600700 1 --2- 172.21.15.8:0/1011456259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a807c330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f99980098a0 tx=0x7f9998009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:09.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.385+0000 7f99ad600700 1 -- 172.21.15.8:0/1011456259 shutdown_connections 2024-03-16T20:46:09.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.385+0000 7f99ad600700 1 --2- 172.21.15.8:0/1011456259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a807c330 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:09.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.385+0000 7f99ad600700 1 -- 172.21.15.8:0/1011456259 >> 172.21.15.8:0/1011456259 conn(0x7f99a8102ff0 msgr2=0x7f99a8105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:09.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.385+0000 7f99ad600700 1 -- 172.21.15.8:0/1011456259 shutdown_connections 2024-03-16T20:46:09.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.385+0000 7f99ad600700 1 -- 172.21.15.8:0/1011456259 wait complete. 2024-03-16T20:46:09.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.386+0000 7f99ad600700 1 Processor -- start 2024-03-16T20:46:09.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.386+0000 7f99ad600700 1 -- start start 2024-03-16T20:46:09.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.386+0000 7f99ad600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a81a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:09.138 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.386+0000 7f99ad600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a81a2310 con 0x7f99a807de80 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.387+0000 7f99a6a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a81a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.387+0000 7f99a6a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a81a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44650/0 (socket says 172.21.15.8:44650) 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.387+0000 7f99a6a00700 1 -- 172.21.15.8:0/2054427453 learned_addr learned my addr 172.21.15.8:0/2054427453 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.387+0000 7f99a6a00700 1 -- 172.21.15.8:0/2054427453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998009550 con 0x7f99a807de80 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.387+0000 7f99a6a00700 1 --2- 172.21.15.8:0/2054427453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a81a1dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9998011b40 tx=0x7f9998011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.388+0000 7f999f400700 1 -- 172.21.15.8:0/2054427453 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9998003aa0 con 0x7f99a807de80 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.388+0000 7f999f400700 1 -- 172.21.15.8:0/2054427453 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f9998003c00 con 0x7f99a807de80 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.388+0000 7f999f400700 1 -- 172.21.15.8:0/2054427453 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9998024800 con 0x7f99a807de80 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.388+0000 7f99ad600700 1 -- 172.21.15.8:0/2054427453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a81a2510 con 0x7f99a807de80 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.388+0000 7f99ad600700 1 -- 172.21.15.8:0/2054427453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a81a29b0 con 0x7f99a807de80 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.388+0000 7f999f400700 1 -- 172.21.15.8:0/2054427453 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9998024cf0 con 0x7f99a807de80 2024-03-16T20:46:09.139 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.388+0000 7f999f400700 1 -- 172.21.15.8:0/2054427453 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f999801a430 con 0x7f99a807de80 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.389+0000 7f99ad600700 1 -- 172.21.15.8:0/2054427453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a819b4d0 con 0x7f99a807de80 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.392+0000 7f999f400700 1 -- 172.21.15.8:0/2054427453 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f999801abc0 con 0x7f99a807de80 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.472+0000 7f99ad600700 1 -- 172.21.15.8:0/2054427453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f99a8109ce0 con 0x7f99a807de80 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.473+0000 7f999f400700 1 -- 172.21.15.8:0/2054427453 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f999801ad60 con 0x7f99a807de80 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.474+0000 7f99ad600700 1 -- 172.21.15.8:0/2054427453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 msgr2=0x7f99a81a1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.474+0000 7f99ad600700 1 --2- 172.21.15.8:0/2054427453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a81a1dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9998011b40 tx=0x7f9998011c20 comp rx=0 tx=0).stop 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.474+0000 7f99ad600700 1 -- 172.21.15.8:0/2054427453 shutdown_connections 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.474+0000 7f99ad600700 1 --2- 172.21.15.8:0/2054427453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99a807de80 0x7f99a81a1dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.474+0000 7f99ad600700 1 -- 172.21.15.8:0/2054427453 >> 172.21.15.8:0/2054427453 conn(0x7f99a8102ff0 msgr2=0x7f99a81053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.474+0000 7f99ad600700 1 -- 172.21.15.8:0/2054427453 shutdown_connections 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:08.475+0000 7f99ad600700 1 -- 172.21.15.8:0/2054427453 wait complete. 2024-03-16T20:46:09.140 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (2/15)... 2024-03-16T20:46:09.902 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:09 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:09.515+0000 7f3f73a52200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T20:46:09.903 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:09 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:09.636+0000 7f3f73a52200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T20:46:10.243 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:09 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:09.899+0000 7f3f73a52200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:46:10.243 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:10.147+0000 7f3f73a52200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T20:46:10.743 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:10.533+0000 7f3f73a52200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:46:11.180 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:10.856+0000 7f3f73a52200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T20:46:11.468 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:11.176+0000 7f3f73a52200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T20:46:11.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:11 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1720581413' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-16T20:46:12.439 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:12.278+0000 7f3f73a52200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T20:46:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:46:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2024-03-16T20:46:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "05d64692-e3d6-11ee-95c9-87774f69a715", 2024-03-16T20:46:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2024-03-16T20:46:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-16T20:46:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-16T20:46:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-16T20:46:12.445 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:12.445 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-16T20:46:12.445 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-16T20:46:12.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:12.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-16T20:46:12.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-16T20:46:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-16T20:46:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-16T20:46:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-16T20:46:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-16T20:46:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-16T20:46:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-16T20:46:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-16T20:46:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-16T20:46:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-16T20:46:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2024-03-16T20:45:54.336057+0000", 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.714+0000 7fd09c400700 1 Processor -- start 2024-03-16T20:46:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.714+0000 7fd09c400700 1 -- start start 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.715+0000 7fd09c400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd094107ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.715+0000 7fd09c400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0941084b0 con 0x7fd094107ac0 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.715+0000 7fd099a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd094107ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.716+0000 7fd099a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd094107ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44658/0 (socket says 172.21.15.8:44658) 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.716+0000 7fd099a00700 1 -- 172.21.15.8:0/3543234381 learned_addr learned my addr 172.21.15.8:0/3543234381 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.716+0000 7fd099a00700 1 -- 172.21.15.8:0/3543234381 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094108c20 con 0x7fd094107ac0 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.716+0000 7fd099a00700 1 --2- 172.21.15.8:0/3543234381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd094107ee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd088009e80 tx=0x7fd08800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff274cf2ddc06f1a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.717+0000 7fd093e00700 1 -- 172.21.15.8:0/3543234381 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd08800e070 con 0x7fd094107ac0 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.717+0000 7fd093e00700 1 -- 172.21.15.8:0/3543234381 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fd08800b8c0 con 0x7fd094107ac0 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.717+0000 7fd093e00700 1 -- 172.21.15.8:0/3543234381 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd088004640 con 0x7fd094107ac0 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.717+0000 7fd09c400700 1 -- 172.21.15.8:0/3543234381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 msgr2=0x7fd094107ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.717+0000 7fd09c400700 1 --2- 172.21.15.8:0/3543234381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd094107ee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd088009e80 tx=0x7fd08800b330 comp rx=0 tx=0).stop 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.718+0000 7fd09c400700 1 -- 172.21.15.8:0/3543234381 shutdown_connections 2024-03-16T20:46:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.718+0000 7fd09c400700 1 --2- 172.21.15.8:0/3543234381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd094107ee0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.718+0000 7fd09c400700 1 -- 172.21.15.8:0/3543234381 >> 172.21.15.8:0/3543234381 conn(0x7fd094103080 msgr2=0x7fd0941054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.718+0000 7fd09c400700 1 -- 172.21.15.8:0/3543234381 shutdown_connections 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.718+0000 7fd09c400700 1 -- 172.21.15.8:0/3543234381 wait complete. 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.719+0000 7fd09c400700 1 Processor -- start 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.720+0000 7fd09c400700 1 -- start start 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.720+0000 7fd09c400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd09419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.720+0000 7fd09c400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09419bcf0 con 0x7fd094107ac0 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.720+0000 7fd099a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd09419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.720+0000 7fd099a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd09419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44668/0 (socket says 172.21.15.8:44668) 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.720+0000 7fd099a00700 1 -- 172.21.15.8:0/1720581413 learned_addr learned my addr 172.21.15.8:0/1720581413 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.721+0000 7fd099a00700 1 -- 172.21.15.8:0/1720581413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088009b30 con 0x7fd094107ac0 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.721+0000 7fd099a00700 1 --2- 172.21.15.8:0/1720581413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd09419b7b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd088009fd0 tx=0x7fd088009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.721+0000 7fd092000700 1 -- 172.21.15.8:0/1720581413 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd08800e040 con 0x7fd094107ac0 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.721+0000 7fd092000700 1 -- 172.21.15.8:0/1720581413 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fd08800bd70 con 0x7fd094107ac0 2024-03-16T20:46:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.721+0000 7fd09c400700 1 -- 172.21.15.8:0/1720581413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09419bef0 con 0x7fd094107ac0 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.721+0000 7fd092000700 1 -- 172.21.15.8:0/1720581413 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd088012920 con 0x7fd094107ac0 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.721+0000 7fd09c400700 1 -- 172.21.15.8:0/1720581413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09419c3f0 con 0x7fd094107ac0 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.722+0000 7fd092000700 1 -- 172.21.15.8:0/1720581413 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd088025400 con 0x7fd094107ac0 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.722+0000 7fd092000700 1 -- 172.21.15.8:0/1720581413 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd088007890 con 0x7fd094107ac0 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.723+0000 7fd09c400700 1 -- 172.21.15.8:0/1720581413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd094063610 con 0x7fd094107ac0 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.727+0000 7fd092000700 1 -- 172.21.15.8:0/1720581413 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd088020020 con 0x7fd094107ac0 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.806+0000 7fd09c400700 1 -- 172.21.15.8:0/1720581413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd09410c0c0 con 0x7fd094107ac0 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.807+0000 7fd092000700 1 -- 172.21.15.8:0/1720581413 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1240 (secure 0 0 0) 0x7fd088017070 con 0x7fd094107ac0 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.809+0000 7fd09c400700 1 -- 172.21.15.8:0/1720581413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 msgr2=0x7fd09419b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.809+0000 7fd09c400700 1 --2- 172.21.15.8:0/1720581413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd09419b7b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd088009fd0 tx=0x7fd088009390 comp rx=0 tx=0).stop 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.809+0000 7fd09c400700 1 -- 172.21.15.8:0/1720581413 shutdown_connections 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.809+0000 7fd09c400700 1 --2- 172.21.15.8:0/1720581413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd094107ac0 0x7fd09419b7b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.809+0000 7fd09c400700 1 -- 172.21.15.8:0/1720581413 >> 172.21.15.8:0/1720581413 conn(0x7fd094103080 msgr2=0x7fd094103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.809+0000 7fd09c400700 1 -- 172.21.15.8:0/1720581413 shutdown_connections 2024-03-16T20:46:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:11.809+0000 7fd09c400700 1 -- 172.21.15.8:0/1720581413 wait complete. 2024-03-16T20:46:12.462 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (3/15)... 2024-03-16T20:46:13.423 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:12.996+0000 7f3f73a52200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T20:46:13.423 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:13.129+0000 7f3f73a52200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T20:46:13.743 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:13.419+0000 7f3f73a52200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T20:46:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: Activating manager daemon x 2024-03-16T20:46:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: mgrmap e2: x(active, starting, since 0.0116911s) 2024-03-16T20:46:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: from='mgr.14100 172.21.15.8:0/1128823246' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-16T20:46:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: from='mgr.14100 172.21.15.8:0/1128823246' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-16T20:46:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: from='mgr.14100 172.21.15.8:0/1128823246' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-16T20:46:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: from='mgr.14100 172.21.15.8:0/1128823246' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:46:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: from='mgr.14100 172.21.15.8:0/1128823246' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-16T20:46:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: Manager daemon x is now available 2024-03-16T20:46:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: from='mgr.14100 172.21.15.8:0/1128823246' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-16T20:46:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: from='mgr.14100 172.21.15.8:0/1128823246' entity='mgr.x' 2024-03-16T20:46:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: from='mgr.14100 172.21.15.8:0/1128823246' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-16T20:46:13.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:13 smithi008 ceph-mon[31434]: from='mgr.14100 172.21.15.8:0/1128823246' entity='mgr.x' 2024-03-16T20:46:14.734 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:14 smithi008 ceph-mon[31434]: from='mgr.14100 172.21.15.8:0/1128823246' entity='mgr.x' 2024-03-16T20:46:14.734 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:14 smithi008 ceph-mon[31434]: mgrmap e3: x(active, since 1.02181s) 2024-03-16T20:46:15.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:15 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/493533950' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-16T20:46:16.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:46:16.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2024-03-16T20:46:16.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "05d64692-e3d6-11ee-95c9-87774f69a715", 2024-03-16T20:46:16.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2024-03-16T20:46:16.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-16T20:46:16.065 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-16T20:46:16.066 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:16.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-16T20:46:16.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-16T20:46:16.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:16.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-16T20:46:16.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:16.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-16T20:46:16.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-16T20:46:16.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-16T20:46:16.076 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-16T20:46:16.076 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-16T20:46:16.076 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-16T20:46:16.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:16.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-16T20:46:16.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-16T20:46:16.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-16T20:46:16.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-16T20:46:16.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-16T20:46:16.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-16T20:46:16.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-16T20:46:16.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-16T20:46:16.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-16T20:46:16.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-16T20:46:16.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2024-03-16T20:45:54.336057+0000", 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.042+0000 7f211e400700 1 Processor -- start 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.042+0000 7f211e400700 1 -- start start 2024-03-16T20:46:16.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.042+0000 7f211e400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211810a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.042+0000 7f211e400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211807be40 con 0x7f2118108510 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.043+0000 7f2117400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211810a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.043+0000 7f2117400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211810a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44750/0 (socket says 172.21.15.8:44750) 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.043+0000 7f2117400700 1 -- 172.21.15.8:0/1936787156 learned_addr learned my addr 172.21.15.8:0/1936787156 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.043+0000 7f2117400700 1 -- 172.21.15.8:0/1936787156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211810ae40 con 0x7f2118108510 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.044+0000 7f2117400700 1 --2- 172.21.15.8:0/1936787156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211810a900 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f21080098a0 tx=0x7f2108009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cf2a2e067a1f7b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.044+0000 7f2116000700 1 -- 172.21.15.8:0/1936787156 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2108004160 con 0x7f2118108510 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.044+0000 7f2116000700 1 -- 172.21.15.8:0/1936787156 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f21080042c0 con 0x7f2118108510 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.044+0000 7f2116000700 1 -- 172.21.15.8:0/1936787156 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2108011b70 con 0x7f2118108510 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.045+0000 7f211e400700 1 -- 172.21.15.8:0/1936787156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 msgr2=0x7f211810a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.045+0000 7f211e400700 1 --2- 172.21.15.8:0/1936787156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211810a900 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f21080098a0 tx=0x7f2108009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:16.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.045+0000 7f211e400700 1 -- 172.21.15.8:0/1936787156 shutdown_connections 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.045+0000 7f211e400700 1 --2- 172.21.15.8:0/1936787156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211810a900 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.045+0000 7f211e400700 1 -- 172.21.15.8:0/1936787156 >> 172.21.15.8:0/1936787156 conn(0x7f2118101f20 msgr2=0x7f2118104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.045+0000 7f211e400700 1 -- 172.21.15.8:0/1936787156 shutdown_connections 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.045+0000 7f211e400700 1 -- 172.21.15.8:0/1936787156 wait complete. 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.046+0000 7f211e400700 1 Processor -- start 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.046+0000 7f211e400700 1 -- start start 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.046+0000 7f211e400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211819b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.046+0000 7f211e400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211819bda0 con 0x7f2118108510 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.047+0000 7f2117400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211819b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.047+0000 7f2117400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211819b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44764/0 (socket says 172.21.15.8:44764) 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.047+0000 7f2117400700 1 -- 172.21.15.8:0/493533950 learned_addr learned my addr 172.21.15.8:0/493533950 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:16.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.047+0000 7f2117400700 1 -- 172.21.15.8:0/493533950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108009550 con 0x7f2118108510 2024-03-16T20:46:16.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.048+0000 7f2117400700 1 --2- 172.21.15.8:0/493533950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211819b860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2108011b20 tx=0x7f2108011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:16.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.048+0000 7f210fe00700 1 -- 172.21.15.8:0/493533950 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21080039c0 con 0x7f2118108510 2024-03-16T20:46:16.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.048+0000 7f210fe00700 1 -- 172.21.15.8:0/493533950 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f2108003b20 con 0x7f2118108510 2024-03-16T20:46:16.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.048+0000 7f210fe00700 1 -- 172.21.15.8:0/493533950 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2108024630 con 0x7f2118108510 2024-03-16T20:46:16.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.048+0000 7f211e400700 1 -- 172.21.15.8:0/493533950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211819bfa0 con 0x7f2118108510 2024-03-16T20:46:16.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.048+0000 7f211e400700 1 -- 172.21.15.8:0/493533950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211819c440 con 0x7f2118108510 2024-03-16T20:46:16.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.049+0000 7f210fe00700 1 -- 172.21.15.8:0/493533950 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 3) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f210801aa30 con 0x7f2118108510 2024-03-16T20:46:16.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.049+0000 7f211e400700 1 -- 172.21.15.8:0/493533950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211810bca0 con 0x7f2118108510 2024-03-16T20:46:16.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.050+0000 7f210fe00700 1 --2- 172.21.15.8:0/493533950 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f20fc038b90 0x7f20fc03b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:16.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.050+0000 7f210fe00700 1 -- 172.21.15.8:0/493533950 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f210804c980 con 0x7f2118108510 2024-03-16T20:46:16.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.050+0000 7f2116a00700 1 --2- 172.21.15.8:0/493533950 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f20fc038b90 0x7f20fc03b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.051+0000 7f2116a00700 1 --2- 172.21.15.8:0/493533950 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f20fc038b90 0x7f20fc03b050 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2104006fd0 tx=0x7f2104006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.056+0000 7f210fe00700 1 -- 172.21.15.8:0/493533950 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2108018c40 con 0x7f2118108510 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.355+0000 7f211e400700 1 -- 172.21.15.8:0/493533950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f211810beb0 con 0x7f2118108510 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.356+0000 7f210fe00700 1 -- 172.21.15.8:0/493533950 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f2108018860 con 0x7f2118108510 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.360+0000 7f211e400700 1 -- 172.21.15.8:0/493533950 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f20fc038b90 msgr2=0x7f20fc03b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.360+0000 7f211e400700 1 --2- 172.21.15.8:0/493533950 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f20fc038b90 0x7f20fc03b050 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2104006fd0 tx=0x7f2104006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.360+0000 7f211e400700 1 -- 172.21.15.8:0/493533950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 msgr2=0x7f211819b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.360+0000 7f211e400700 1 --2- 172.21.15.8:0/493533950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211819b860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2108011b20 tx=0x7f2108011c00 comp rx=0 tx=0).stop 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.360+0000 7f211e400700 1 -- 172.21.15.8:0/493533950 shutdown_connections 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.360+0000 7f211e400700 1 --2- 172.21.15.8:0/493533950 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f20fc038b90 0x7f20fc03b050 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.360+0000 7f211e400700 1 --2- 172.21.15.8:0/493533950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118108510 0x7f211819b860 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.360+0000 7f211e400700 1 -- 172.21.15.8:0/493533950 >> 172.21.15.8:0/493533950 conn(0x7f2118101f20 msgr2=0x7f2118102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:16.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.360+0000 7f211e400700 1 -- 172.21.15.8:0/493533950 shutdown_connections 2024-03-16T20:46:16.084 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:15.360+0000 7f211e400700 1 -- 172.21.15.8:0/493533950 wait complete. 2024-03-16T20:46:16.084 INFO:teuthology.orchestra.run.smithi008.stdout:mgr is available 2024-03-16T20:46:16.613 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:16 smithi008 ceph-mon[31434]: mgrmap e4: x(active, since 2s) 2024-03-16T20:46:17.617 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:17 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1857979442' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-16T20:46:17.627 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:46:17.627 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [global] 2024-03-16T20:46:17.627 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout fsid = 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:46:17.627 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-16T20:46:17.628 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-16T20:46:17.628 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-16T20:46:17.628 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-16T20:46:17.628 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:46:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-16T20:46:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-16T20:46:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2024-03-16T20:46:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [osd] 2024-03-16T20:46:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-16T20:46:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-16T20:46:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-16T20:46:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-16T20:46:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-16T20:46:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.644+0000 7fe306200700 1 Processor -- start 2024-03-16T20:46:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.644+0000 7fe306200700 1 -- start start 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.644+0000 7fe306200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe300081990 0x7fe300081db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.644+0000 7fe306200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe300082380 con 0x7fe300081990 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.645+0000 7fe2ff400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe300081990 0x7fe300081db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.645+0000 7fe2ff400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe300081990 0x7fe300081db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44770/0 (socket says 172.21.15.8:44770) 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.645+0000 7fe2ff400700 1 -- 172.21.15.8:0/2678403339 learned_addr learned my addr 172.21.15.8:0/2678403339 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.645+0000 7fe2ff400700 1 -- 172.21.15.8:0/2678403339 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3000824c0 con 0x7fe300081990 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.645+0000 7fe2ff400700 1 --2- 172.21.15.8:0/2678403339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe300081990 0x7fe300081db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe2e80098a0 tx=0x7fe2e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664dafe75379bef4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.646+0000 7fe2fea00700 1 -- 172.21.15.8:0/2678403339 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2e8004160 con 0x7fe300081990 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.646+0000 7fe2fea00700 1 -- 172.21.15.8:0/2678403339 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fe2e80042c0 con 0x7fe300081990 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.646+0000 7fe2fea00700 1 -- 172.21.15.8:0/2678403339 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2e8011b70 con 0x7fe300081990 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.646+0000 7fe306200700 1 -- 172.21.15.8:0/2678403339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe300081990 msgr2=0x7fe300081db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.646+0000 7fe306200700 1 --2- 172.21.15.8:0/2678403339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe300081990 0x7fe300081db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe2e80098a0 tx=0x7fe2e8009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.647+0000 7fe306200700 1 -- 172.21.15.8:0/2678403339 shutdown_connections 2024-03-16T20:46:17.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.647+0000 7fe306200700 1 --2- 172.21.15.8:0/2678403339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe300081990 0x7fe300081db0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.647+0000 7fe306200700 1 -- 172.21.15.8:0/2678403339 >> 172.21.15.8:0/2678403339 conn(0x7fe30007d000 msgr2=0x7fe30007f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.647+0000 7fe306200700 1 -- 172.21.15.8:0/2678403339 shutdown_connections 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.647+0000 7fe306200700 1 -- 172.21.15.8:0/2678403339 wait complete. 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.648+0000 7fe306200700 1 Processor -- start 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.648+0000 7fe306200700 1 -- start start 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.649+0000 7fe306200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3001a1fe0 0x7fe3001a2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.649+0000 7fe306200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3001a2940 con 0x7fe3001a1fe0 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.649+0000 7fe2ff400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3001a1fe0 0x7fe3001a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.649+0000 7fe2ff400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3001a1fe0 0x7fe3001a2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44784/0 (socket says 172.21.15.8:44784) 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.649+0000 7fe2ff400700 1 -- 172.21.15.8:0/1857979442 learned_addr learned my addr 172.21.15.8:0/1857979442 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.649+0000 7fe2ff400700 1 -- 172.21.15.8:0/1857979442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e8009550 con 0x7fe3001a1fe0 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.650+0000 7fe2ff400700 1 --2- 172.21.15.8:0/1857979442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3001a1fe0 0x7fe3001a2400 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe30010f060 tx=0x7fe2e8011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.650+0000 7fe2fcc00700 1 -- 172.21.15.8:0/1857979442 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2e80036a0 con 0x7fe3001a1fe0 2024-03-16T20:46:17.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.650+0000 7fe2fcc00700 1 -- 172.21.15.8:0/1857979442 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fe2e801f070 con 0x7fe3001a1fe0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.650+0000 7fe2fcc00700 1 -- 172.21.15.8:0/1857979442 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2e801adc0 con 0x7fe3001a1fe0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.650+0000 7fe306200700 1 -- 172.21.15.8:0/1857979442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3001a2b40 con 0x7fe3001a1fe0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.650+0000 7fe306200700 1 -- 172.21.15.8:0/1857979442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3001a56b0 con 0x7fe3001a1fe0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.651+0000 7fe2fcc00700 1 -- 172.21.15.8:0/1857979442 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 45758+0+0 (secure 0 0 0) 0x7fe2e8021030 con 0x7fe3001a1fe0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.651+0000 7fe306200700 1 -- 172.21.15.8:0/1857979442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe300112430 con 0x7fe3001a1fe0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.652+0000 7fe2fcc00700 1 --2- 172.21.15.8:0/1857979442 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7fe2e4038d00 0x7fe2e403b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.652+0000 7fe2fcc00700 1 -- 172.21.15.8:0/1857979442 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe2e804ca20 con 0x7fe3001a1fe0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.652+0000 7fe2f6a00700 1 --2- 172.21.15.8:0/1857979442 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7fe2e4038d00 0x7fe2e403b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.653+0000 7fe2f6a00700 1 --2- 172.21.15.8:0/1857979442 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7fe2e4038d00 0x7fe2e403b1c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0006fd0 tx=0x7fe2f0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.657+0000 7fe2fcc00700 1 -- 172.21.15.8:0/1857979442 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe2e801a5f0 con 0x7fe3001a1fe0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.879+0000 7fe306200700 1 -- 172.21.15.8:0/1857979442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe3001a5840 con 0x7fe3001a1fe0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.882+0000 7fe2fcc00700 1 -- 172.21.15.8:0/1857979442 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fe2e800b3e0 con 0x7fe3001a1fe0 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.885+0000 7fe306200700 1 -- 172.21.15.8:0/1857979442 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7fe2e4038d00 msgr2=0x7fe2e403b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.885+0000 7fe306200700 1 --2- 172.21.15.8:0/1857979442 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7fe2e4038d00 0x7fe2e403b1c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0006fd0 tx=0x7fe2f0006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:17.637 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.885+0000 7fe306200700 1 -- 172.21.15.8:0/1857979442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3001a1fe0 msgr2=0x7fe3001a2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:17.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.885+0000 7fe306200700 1 --2- 172.21.15.8:0/1857979442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3001a1fe0 0x7fe3001a2400 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe30010f060 tx=0x7fe2e8011910 comp rx=0 tx=0).stop 2024-03-16T20:46:17.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.885+0000 7fe306200700 1 -- 172.21.15.8:0/1857979442 shutdown_connections 2024-03-16T20:46:17.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.885+0000 7fe306200700 1 --2- 172.21.15.8:0/1857979442 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7fe2e4038d00 0x7fe2e403b1c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:17.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.885+0000 7fe306200700 1 --2- 172.21.15.8:0/1857979442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3001a1fe0 0x7fe3001a2400 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:17.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.885+0000 7fe306200700 1 -- 172.21.15.8:0/1857979442 >> 172.21.15.8:0/1857979442 conn(0x7fe30007d000 msgr2=0x7fe30007db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:17.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.886+0000 7fe306200700 1 -- 172.21.15.8:0/1857979442 shutdown_connections 2024-03-16T20:46:17.638 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:16.886+0000 7fe306200700 1 -- 172.21.15.8:0/1857979442 wait complete. 2024-03-16T20:46:17.638 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling cephadm module... 2024-03-16T20:46:18.817 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:18 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: ignoring --setuser ceph since I am not root 2024-03-16T20:46:18.818 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:18 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: ignoring --setgroup ceph since I am not root 2024-03-16T20:46:18.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:18 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1164440572' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-16T20:46:19.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.202+0000 7f50e3000700 1 Processor -- start 2024-03-16T20:46:19.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.203+0000 7f50e3000700 1 -- start start 2024-03-16T20:46:19.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.203+0000 7f50e3000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc107e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:19.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.203+0000 7f50e3000700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc108400 con 0x7f50dc107a10 2024-03-16T20:46:19.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.204+0000 7f50dbe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc107e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:19.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.204+0000 7f50dbe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc107e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60684/0 (socket says 172.21.15.8:60684) 2024-03-16T20:46:19.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.204+0000 7f50dbe00700 1 -- 172.21.15.8:0/2331132965 learned_addr learned my addr 172.21.15.8:0/2331132965 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:19.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.204+0000 7f50dbe00700 1 -- 172.21.15.8:0/2331132965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc108bc0 con 0x7f50dc107a10 2024-03-16T20:46:19.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.205+0000 7f50dbe00700 1 --2- 172.21.15.8:0/2331132965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc107e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0098a0 tx=0x7f50cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87127d15015c3d2a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:19.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.205+0000 7f50db400700 1 -- 172.21.15.8:0/2331132965 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50cc004160 con 0x7f50dc107a10 2024-03-16T20:46:19.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.205+0000 7f50db400700 1 -- 172.21.15.8:0/2331132965 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f50cc0042c0 con 0x7f50dc107a10 2024-03-16T20:46:19.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.205+0000 7f50db400700 1 -- 172.21.15.8:0/2331132965 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50cc011b70 con 0x7f50dc107a10 2024-03-16T20:46:19.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.206+0000 7f50e3000700 1 -- 172.21.15.8:0/2331132965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 msgr2=0x7f50dc107e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:19.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.206+0000 7f50e3000700 1 --2- 172.21.15.8:0/2331132965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc107e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0098a0 tx=0x7f50cc009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:19.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.206+0000 7f50e3000700 1 -- 172.21.15.8:0/2331132965 shutdown_connections 2024-03-16T20:46:19.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.206+0000 7f50e3000700 1 --2- 172.21.15.8:0/2331132965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc107e30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:19.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.206+0000 7f50e3000700 1 -- 172.21.15.8:0/2331132965 >> 172.21.15.8:0/2331132965 conn(0x7f50dc102fd0 msgr2=0x7f50dc1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.206+0000 7f50e3000700 1 -- 172.21.15.8:0/2331132965 shutdown_connections 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.206+0000 7f50e3000700 1 -- 172.21.15.8:0/2331132965 wait complete. 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.207+0000 7f50e3000700 1 Processor -- start 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.207+0000 7f50e3000700 1 -- start start 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.207+0000 7f50e3000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.207+0000 7f50e3000700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc19bd70 con 0x7f50dc107a10 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.208+0000 7f50dbe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.208+0000 7f50dbe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60700/0 (socket says 172.21.15.8:60700) 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.208+0000 7f50dbe00700 1 -- 172.21.15.8:0/1164440572 learned_addr learned my addr 172.21.15.8:0/1164440572 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.208+0000 7f50dbe00700 1 -- 172.21.15.8:0/1164440572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc009550 con 0x7f50dc107a10 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.208+0000 7f50dbe00700 1 --2- 172.21.15.8:0/1164440572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc19b830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f50cc000c00 tx=0x7f50cc011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.209+0000 7f50d9600700 1 -- 172.21.15.8:0/1164440572 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50cc003aa0 con 0x7f50dc107a10 2024-03-16T20:46:19.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.209+0000 7f50d9600700 1 -- 172.21.15.8:0/1164440572 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f50cc003c00 con 0x7f50dc107a10 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.209+0000 7f50d9600700 1 -- 172.21.15.8:0/1164440572 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50cc024930 con 0x7f50dc107a10 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.209+0000 7f50e3000700 1 -- 172.21.15.8:0/1164440572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc19bf70 con 0x7f50dc107a10 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.209+0000 7f50e3000700 1 -- 172.21.15.8:0/1164440572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc19c410 con 0x7f50dc107a10 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.210+0000 7f50e3000700 1 -- 172.21.15.8:0/1164440572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc10bdf0 con 0x7f50dc107a10 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.210+0000 7f50d9600700 1 -- 172.21.15.8:0/1164440572 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 45758+0+0 (secure 0 0 0) 0x7f50cc01aca0 con 0x7f50dc107a10 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.211+0000 7f50d9600700 1 --2- 172.21.15.8:0/1164440572 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f50c0038cb0 0x7f50c003b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.211+0000 7f50d9600700 1 -- 172.21.15.8:0/1164440572 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f50cc04c980 con 0x7f50dc107a10 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.212+0000 7f50d3400700 1 --2- 172.21.15.8:0/1164440572 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f50c0038cb0 0x7f50c003b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.212+0000 7f50d3400700 1 --2- 172.21.15.8:0/1164440572 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f50c0038cb0 0x7f50c003b170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006fd0 tx=0x7f50c4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.216+0000 7f50d9600700 1 -- 172.21.15.8:0/1164440572 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f50cc01a430 con 0x7f50dc107a10 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.502+0000 7f50e3000700 1 -- 172.21.15.8:0/1164440572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f50dc10c000 con 0x7f50dc107a10 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.556+0000 7f50d9600700 1 -- 172.21.15.8:0/1164440572 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f50cc018350 con 0x7f50dc107a10 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.560+0000 7f50d9600700 1 -- 172.21.15.8:0/1164440572 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mgrmap(e 5) v1 ==== 45769+0+0 (secure 0 0 0) 0x7f50cc02d770 con 0x7f50dc107a10 2024-03-16T20:46:19.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.561+0000 7f50e3000700 1 -- 172.21.15.8:0/1164440572 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f50c0038cb0 msgr2=0x7f50c003b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:19.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.561+0000 7f50e3000700 1 --2- 172.21.15.8:0/1164440572 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f50c0038cb0 0x7f50c003b170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006fd0 tx=0x7f50c4006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:19.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.561+0000 7f50e3000700 1 -- 172.21.15.8:0/1164440572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 msgr2=0x7f50dc19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:19.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.561+0000 7f50e3000700 1 --2- 172.21.15.8:0/1164440572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc19b830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f50cc000c00 tx=0x7f50cc011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:19.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.562+0000 7f50e3000700 1 -- 172.21.15.8:0/1164440572 shutdown_connections 2024-03-16T20:46:19.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.562+0000 7f50e3000700 1 --2- 172.21.15.8:0/1164440572 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f50c0038cb0 0x7f50c003b170 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:19.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.562+0000 7f50e3000700 1 --2- 172.21.15.8:0/1164440572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50dc107a10 0x7f50dc19b830 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:19.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.562+0000 7f50e3000700 1 -- 172.21.15.8:0/1164440572 >> 172.21.15.8:0/1164440572 conn(0x7f50dc102fd0 msgr2=0x7f50dc103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:19.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.563+0000 7f50e3000700 1 -- 172.21.15.8:0/1164440572 shutdown_connections 2024-03-16T20:46:19.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:18.563+0000 7f50e3000700 1 -- 172.21.15.8:0/1164440572 wait complete. 2024-03-16T20:46:19.423 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:19 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:19.418+0000 7faa6e325200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T20:46:19.684 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:19 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:19.545+0000 7faa6e325200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T20:46:19.684 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:19 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1164440572' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-16T20:46:19.684 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:19 smithi008 ceph-mon[31434]: mgrmap e5: x(active, since 5s) 2024-03-16T20:46:20.680 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:20 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/4031823946' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-16T20:46:20.681 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:20 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:20.366+0000 7faa6e325200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T20:46:20.681 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:20 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:20.493+0000 7faa6e325200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T20:46:20.681 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:20 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:20.675+0000 7faa6e325200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T20:46:20.771 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2024-03-16T20:46:20.771 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-16T20:46:20.771 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-16T20:46:20.771 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-16T20:46:20.771 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-16T20:46:20.771 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2024-03-16T20:46:20.771 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.735+0000 7f50ac200700 1 Processor -- start 2024-03-16T20:46:20.771 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.736+0000 7f50ac200700 1 -- start start 2024-03-16T20:46:20.771 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.736+0000 7f50ac200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:20.771 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.736+0000 7f50ac200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a407c830 con 0x7f50a407ddf0 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.736+0000 7f50a9800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.737+0000 7f50a9800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a407c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60722/0 (socket says 172.21.15.8:60722) 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.737+0000 7f50a9800700 1 -- 172.21.15.8:0/2756344216 learned_addr learned my addr 172.21.15.8:0/2756344216 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.737+0000 7f50a9800700 1 -- 172.21.15.8:0/2756344216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a407c970 con 0x7f50a407ddf0 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.737+0000 7f50a9800700 1 --2- 172.21.15.8:0/2756344216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a407c2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f50980098a0 tx=0x7f5098009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d474f3c542b3973 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.737+0000 7f50a3e00700 1 -- 172.21.15.8:0/2756344216 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5098004160 con 0x7f50a407ddf0 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.738+0000 7f50a3e00700 1 -- 172.21.15.8:0/2756344216 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f50980042c0 con 0x7f50a407ddf0 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.738+0000 7f50a3e00700 1 -- 172.21.15.8:0/2756344216 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5098011b70 con 0x7f50a407ddf0 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.738+0000 7f50ac200700 1 -- 172.21.15.8:0/2756344216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 msgr2=0x7f50a407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.738+0000 7f50ac200700 1 --2- 172.21.15.8:0/2756344216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a407c2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f50980098a0 tx=0x7f5098009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.738+0000 7f50ac200700 1 -- 172.21.15.8:0/2756344216 shutdown_connections 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.738+0000 7f50ac200700 1 --2- 172.21.15.8:0/2756344216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a407c2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:20.772 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.738+0000 7f50ac200700 1 -- 172.21.15.8:0/2756344216 >> 172.21.15.8:0/2756344216 conn(0x7f50a4102fc0 msgr2=0x7f50a4105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.738+0000 7f50ac200700 1 -- 172.21.15.8:0/2756344216 shutdown_connections 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.739+0000 7f50ac200700 1 -- 172.21.15.8:0/2756344216 wait complete. 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.739+0000 7f50ac200700 1 Processor -- start 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.740+0000 7f50ac200700 1 -- start start 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.740+0000 7f50ac200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a419d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.740+0000 7f50ac200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a419df00 con 0x7f50a407ddf0 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.740+0000 7f50a9800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a419d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.740+0000 7f50a9800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a419d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60734/0 (socket says 172.21.15.8:60734) 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.740+0000 7f50a9800700 1 -- 172.21.15.8:0/4031823946 learned_addr learned my addr 172.21.15.8:0/4031823946 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.741+0000 7f50a9800700 1 -- 172.21.15.8:0/4031823946 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5098009550 con 0x7f50a407ddf0 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.741+0000 7f50a9800700 1 --2- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a419d9c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5098009130 tx=0x7f5098011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:20.773 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.741+0000 7f50a2000700 1 -- 172.21.15.8:0/4031823946 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5098003aa0 con 0x7f50a407ddf0 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.741+0000 7f50a2000700 1 -- 172.21.15.8:0/4031823946 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f5098003c00 con 0x7f50a407ddf0 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.741+0000 7f50a2000700 1 -- 172.21.15.8:0/4031823946 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50980248b0 con 0x7f50a407ddf0 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.741+0000 7f50ac200700 1 -- 172.21.15.8:0/4031823946 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a419e100 con 0x7f50a407ddf0 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.741+0000 7f50ac200700 1 -- 172.21.15.8:0/4031823946 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a419e5a0 con 0x7f50a407ddf0 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.742+0000 7f50a2000700 1 -- 172.21.15.8:0/4031823946 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 45769+0+0 (secure 0 0 0) 0x7f509801ac30 con 0x7f50a407ddf0 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.743+0000 7f50ac200700 1 -- 172.21.15.8:0/4031823946 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a410de10 con 0x7f50a407ddf0 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.743+0000 7f50a2000700 1 --2- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f508c038d00 0x7f508c03b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.743+0000 7f50a2000700 1 -- 172.21.15.8:0/4031823946 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f509804c9d0 con 0x7f50a407ddf0 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.743+0000 7f50a8e00700 1 -- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f508c038d00 msgr2=0x7f508c03b1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2888433195 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.743+0000 7f50a8e00700 1 --2- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f508c038d00 0x7f508c03b1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.748+0000 7f50a2000700 1 -- 172.21.15.8:0/4031823946 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5098024a10 con 0x7f50a407ddf0 2024-03-16T20:46:20.774 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.944+0000 7f50a8e00700 1 -- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f508c038d00 msgr2=0x7f508c03b1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2888433195 2024-03-16T20:46:20.775 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:19.944+0000 7f50a8e00700 1 --2- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f508c038d00 0x7f508c03b1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T20:46:20.775 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.034+0000 7f50ac200700 1 -- 172.21.15.8:0/4031823946 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f50a41a0ee0 con 0x7f50a407ddf0 2024-03-16T20:46:20.775 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.035+0000 7f50a2000700 1 -- 172.21.15.8:0/4031823946 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f509800b3e0 con 0x7f50a407ddf0 2024-03-16T20:46:20.775 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.038+0000 7f50ac200700 1 -- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f508c038d00 msgr2=0x7f508c03b1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T20:46:20.775 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.038+0000 7f50ac200700 1 --2- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f508c038d00 0x7f508c03b1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:20.775 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.038+0000 7f50ac200700 1 -- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 msgr2=0x7f50a419d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:20.775 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.038+0000 7f50ac200700 1 --2- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a419d9c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5098009130 tx=0x7f5098011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:20.775 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.038+0000 7f50ac200700 1 -- 172.21.15.8:0/4031823946 shutdown_connections 2024-03-16T20:46:20.775 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.038+0000 7f50ac200700 1 --2- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f508c038d00 0x7f508c03b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:20.775 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.038+0000 7f50ac200700 1 --2- 172.21.15.8:0/4031823946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50a407ddf0 0x7f50a419d9c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:20.775 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.038+0000 7f50ac200700 1 -- 172.21.15.8:0/4031823946 >> 172.21.15.8:0/4031823946 conn(0x7f50a4102fc0 msgr2=0x7f50a4103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:20.776 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.038+0000 7f50ac200700 1 -- 172.21.15.8:0/4031823946 shutdown_connections 2024-03-16T20:46:20.776 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:20.038+0000 7f50ac200700 1 -- 172.21.15.8:0/4031823946 wait complete. 2024-03-16T20:46:20.776 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for the mgr to restart... 2024-03-16T20:46:20.776 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr epoch 5... 2024-03-16T20:46:20.933 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:20 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:20.813+0000 7faa6e325200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T20:46:21.208 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:20 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:20.927+0000 7faa6e325200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T20:46:21.493 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:21 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:21.274+0000 7faa6e325200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T20:46:21.493 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:21 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:21.424+0000 7faa6e325200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T20:46:21.913 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:21 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:21.543+0000 7faa6e325200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T20:46:21.913 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:21 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:21.674+0000 7faa6e325200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T20:46:21.913 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:21 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:21.908+0000 7faa6e325200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T20:46:23.493 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:23 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:23.225+0000 7faa6e325200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T20:46:23.493 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:23 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:23.403+0000 7faa6e325200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T20:46:24.223 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:23 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:23.830+0000 7faa6e325200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T20:46:24.224 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:23 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:23.953+0000 7faa6e325200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T20:46:24.224 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:24 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:24.218+0000 7faa6e325200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:46:24.743 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:24 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:24.472+0000 7faa6e325200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T20:46:25.189 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:24 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:24.860+0000 7faa6e325200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:46:25.189 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:25 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:25.184+0000 7faa6e325200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T20:46:25.993 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:25 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:25.499+0000 7faa6e325200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T20:46:26.993 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:26 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:26.565+0000 7faa6e325200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T20:46:27.584 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:27.282+0000 7faa6e325200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T20:46:27.584 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:27.418+0000 7faa6e325200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T20:46:27.993 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:27.711+0000 7faa6e325200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T20:46:27.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-mon[31434]: Active manager daemon x restarted 2024-03-16T20:46:27.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-mon[31434]: Activating manager daemon x 2024-03-16T20:46:27.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-mon[31434]: osdmap e2: 0 total, 0 up, 0 in 2024-03-16T20:46:27.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-mon[31434]: mgrmap e6: x(active, starting, since 0.00990272s) 2024-03-16T20:46:27.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:46:27.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-16T20:46:27.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-16T20:46:27.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-16T20:46:27.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-16T20:46:27.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:27 smithi008 ceph-mon[31434]: Manager daemon x is now available 2024-03-16T20:46:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:28 smithi008 ceph-mon[31434]: Found migration_current of "None". Setting to last migration. 2024-03-16T20:46:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:28 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:28 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:28 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:46:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:28 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:46:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:28 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:46:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:28 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-16T20:46:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:28 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-16T20:46:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:28 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:28 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:28.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:28 smithi008 ceph-mon[31434]: mgrmap e7: x(active, since 1.01778s) 2024-03-16T20:46:29.465 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2024-03-16T20:46:29.465 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-16T20:46:29.465 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-16T20:46:29.465 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2024-03-16T20:46:29.466 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.362+0000 7f373b800700 1 Processor -- start 2024-03-16T20:46:29.466 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.362+0000 7f373b800700 1 -- start start 2024-03-16T20:46:29.466 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.362+0000 7f373b800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f3734107e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:29.466 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.362+0000 7f373b800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734108410 con 0x7f3734107a20 2024-03-16T20:46:29.466 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.363+0000 7f3738e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f3734107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:29.466 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.363+0000 7f3738e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f3734107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60736/0 (socket says 172.21.15.8:60736) 2024-03-16T20:46:29.469 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.363+0000 7f3738e00700 1 -- 172.21.15.8:0/775873235 learned_addr learned my addr 172.21.15.8:0/775873235 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.363+0000 7f3738e00700 1 -- 172.21.15.8:0/775873235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734108bd0 con 0x7f3734107a20 2024-03-16T20:46:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.364+0000 7f3738e00700 1 --2- 172.21.15.8:0/775873235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f3734107e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f37280098a0 tx=0x7f3728009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6152731552baaf24 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.364+0000 7f3733400700 1 -- 172.21.15.8:0/775873235 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3728004160 con 0x7f3734107a20 2024-03-16T20:46:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.364+0000 7f3733400700 1 -- 172.21.15.8:0/775873235 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f37280042c0 con 0x7f3734107a20 2024-03-16T20:46:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.364+0000 7f3733400700 1 -- 172.21.15.8:0/775873235 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3728011b70 con 0x7f3734107a20 2024-03-16T20:46:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.365+0000 7f373b800700 1 -- 172.21.15.8:0/775873235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 msgr2=0x7f3734107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.365+0000 7f373b800700 1 --2- 172.21.15.8:0/775873235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f3734107e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f37280098a0 tx=0x7f3728009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.365+0000 7f373b800700 1 -- 172.21.15.8:0/775873235 shutdown_connections 2024-03-16T20:46:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.365+0000 7f373b800700 1 --2- 172.21.15.8:0/775873235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f3734107e40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.365+0000 7f373b800700 1 -- 172.21.15.8:0/775873235 >> 172.21.15.8:0/775873235 conn(0x7f3734103000 msgr2=0x7f3734105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.365+0000 7f373b800700 1 -- 172.21.15.8:0/775873235 shutdown_connections 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.365+0000 7f373b800700 1 -- 172.21.15.8:0/775873235 wait complete. 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.366+0000 7f373b800700 1 Processor -- start 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.366+0000 7f373b800700 1 -- start start 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.367+0000 7f373b800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f373419da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.367+0000 7f373b800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373419df50 con 0x7f3734107a20 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.367+0000 7f3738e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f373419da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.367+0000 7f3738e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f373419da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60744/0 (socket says 172.21.15.8:60744) 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.367+0000 7f3738e00700 1 -- 172.21.15.8:0/4062627924 learned_addr learned my addr 172.21.15.8:0/4062627924 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.367+0000 7f3738e00700 1 -- 172.21.15.8:0/4062627924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3728009550 con 0x7f3734107a20 2024-03-16T20:46:29.471 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.368+0000 7f3738e00700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f373419da10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3728000c00 tx=0x7f3728011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:29.472 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.368+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3728003aa0 con 0x7f3734107a20 2024-03-16T20:46:29.472 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.368+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f3728003c00 con 0x7f3734107a20 2024-03-16T20:46:29.472 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.368+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3728024930 con 0x7f3734107a20 2024-03-16T20:46:29.472 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.368+0000 7f373b800700 1 -- 172.21.15.8:0/4062627924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373419e150 con 0x7f3734107a20 2024-03-16T20:46:29.472 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.368+0000 7f373b800700 1 -- 172.21.15.8:0/4062627924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373419e5f0 con 0x7f3734107a20 2024-03-16T20:46:29.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.370+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 45769+0+0 (secure 0 0 0) 0x7f372801aca0 con 0x7f3734107a20 2024-03-16T20:46:29.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.370+0000 7f3731600700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 0x7f371c03b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:29.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.370+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 --> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f371c03b880 con 0x7f371c038cb0 2024-03-16T20:46:29.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.370+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f372804c9c0 con 0x7f3734107a20 2024-03-16T20:46:29.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.370+0000 7f3733e00700 1 -- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 msgr2=0x7f371c03b170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2888433195 2024-03-16T20:46:29.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.370+0000 7f3733e00700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 0x7f371c03b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T20:46:29.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.571+0000 7f3733e00700 1 -- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 msgr2=0x7f371c03b170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2888433195 2024-03-16T20:46:29.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.571+0000 7f3733e00700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 0x7f371c03b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T20:46:29.477 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.972+0000 7f3733e00700 1 -- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 msgr2=0x7f371c03b170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2888433195 2024-03-16T20:46:29.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:21.972+0000 7f3733e00700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 0x7f371c03b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-16T20:46:29.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:22.773+0000 7f3733e00700 1 -- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 msgr2=0x7f371c03b170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2888433195 2024-03-16T20:46:29.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:22.773+0000 7f3733e00700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 0x7f371c03b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-16T20:46:29.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:24.375+0000 7f3733e00700 1 -- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 msgr2=0x7f371c03b170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2888433195 2024-03-16T20:46:29.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:24.375+0000 7f3733e00700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 0x7f371c03b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-16T20:46:29.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:27.579+0000 7f3733e00700 1 -- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 msgr2=0x7f371c03b170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2888433195 2024-03-16T20:46:29.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:27.579+0000 7f3733e00700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 0x7f371c03b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-03-16T20:46:29.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:27.720+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mgrmap(e 6) v1 ==== 45536+0+0 (secure 0 0 0) 0x7f372801a990 con 0x7f3734107a20 2024-03-16T20:46:29.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:27.720+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 msgr2=0x7f371c03b170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T20:46:29.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:27.720+0000 7f3731600700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 0x7f371c03b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:29.478 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.724+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 7) v1 ==== 45663+0+0 (secure 0 0 0) 0x7f372804e170 con 0x7f3734107a20 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.724+0000 7f3731600700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f371c03c5a0 0x7f371c03e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.725+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 --> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f371c03b880 con 0x7f371c03c5a0 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.728+0000 7f3733e00700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f371c03c5a0 0x7f371c03e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.731+0000 7f3733e00700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f371c03c5a0 0x7f371c03e990 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3720003a10 tx=0x7f37200092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.733+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 <== mgr.14120 v2:172.21.15.8:6800/1972090527 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f371c03b880 con 0x7f371c03c5a0 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.741+0000 7f373b800700 1 -- 172.21.15.8:0/4062627924 --> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f373410be00 con 0x7f371c03c5a0 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.741+0000 7f3731600700 1 -- 172.21.15.8:0/4062627924 <== mgr.14120 v2:172.21.15.8:6800/1972090527 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f373410be00 con 0x7f371c03c5a0 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.742+0000 7f373b800700 1 -- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f371c03c5a0 msgr2=0x7f371c03e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.742+0000 7f373b800700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f371c03c5a0 0x7f371c03e990 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3720003a10 tx=0x7f37200092b0 comp rx=0 tx=0).stop 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.742+0000 7f373b800700 1 -- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 msgr2=0x7f373419da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.742+0000 7f373b800700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f373419da10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3728000c00 tx=0x7f3728011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.742+0000 7f373b800700 1 -- 172.21.15.8:0/4062627924 shutdown_connections 2024-03-16T20:46:29.479 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.742+0000 7f373b800700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f371c03c5a0 0x7f371c03e990 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:29.480 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.742+0000 7f373b800700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3734107a20 0x7f373419da10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:29.480 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.742+0000 7f373b800700 1 --2- 172.21.15.8:0/4062627924 >> [v2:172.21.15.8:6800/2888433195,v1:172.21.15.8:6801/2888433195] conn(0x7f371c038cb0 0x7f371c03b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:29.480 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.742+0000 7f373b800700 1 -- 172.21.15.8:0/4062627924 >> 172.21.15.8:0/4062627924 conn(0x7f3734103000 msgr2=0x7f3734103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:29.480 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.742+0000 7f373b800700 1 -- 172.21.15.8:0/4062627924 shutdown_connections 2024-03-16T20:46:29.480 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:28.742+0000 7f373b800700 1 -- 172.21.15.8:0/4062627924 wait complete. 2024-03-16T20:46:29.480 INFO:teuthology.orchestra.run.smithi008.stdout:mgr epoch 5 is available 2024-03-16T20:46:29.480 INFO:teuthology.orchestra.run.smithi008.stdout:Setting orchestrator backend to cephadm... 2024-03-16T20:46:30.094 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:29 smithi008 ceph-mon[31434]: [16/Mar/2024:20:46:28] ENGINE Bus STARTING 2024-03-16T20:46:30.094 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:29 smithi008 ceph-mon[31434]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-16T20:46:30.094 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:29 smithi008 ceph-mon[31434]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-16T20:46:30.095 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:29 smithi008 ceph-mon[31434]: [16/Mar/2024:20:46:28] ENGINE Serving on http://172.21.15.8:8765 2024-03-16T20:46:30.095 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:29 smithi008 ceph-mon[31434]: [16/Mar/2024:20:46:28] ENGINE Serving on https://172.21.15.8:7150 2024-03-16T20:46:30.095 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:29 smithi008 ceph-mon[31434]: [16/Mar/2024:20:46:28] ENGINE Bus STARTED 2024-03-16T20:46:30.095 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:29 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:46:30.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:30 smithi008 ceph-mon[31434]: mgrmap e8: x(active, since 2s) 2024-03-16T20:46:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:30 smithi008 ceph-mon[31434]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:46:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:30 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:30 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:46:31.045 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.089+0000 7f9e9e600700 1 Processor -- start 2024-03-16T20:46:31.045 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.090+0000 7f9e9e600700 1 -- start start 2024-03-16T20:46:31.045 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.090+0000 7f9e9e600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9807c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:31.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.090+0000 7f9e9e600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9807c850 con 0x7f9e9807dda0 2024-03-16T20:46:31.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.091+0000 7f9e9d200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9807c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:31.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.091+0000 7f9e9d200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9807c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59590/0 (socket says 172.21.15.8:59590) 2024-03-16T20:46:31.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.091+0000 7f9e9d200700 1 -- 172.21.15.8:0/677121878 learned_addr learned my addr 172.21.15.8:0/677121878 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:31.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.091+0000 7f9e9d200700 1 -- 172.21.15.8:0/677121878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9807c990 con 0x7f9e9807dda0 2024-03-16T20:46:31.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.092+0000 7f9e9d200700 1 --2- 172.21.15.8:0/677121878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9807c310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0098a0 tx=0x7f9e8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c5ad951cf9c1db server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:31.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.092+0000 7f9e97400700 1 -- 172.21.15.8:0/677121878 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c004160 con 0x7f9e9807dda0 2024-03-16T20:46:31.046 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.092+0000 7f9e97400700 1 -- 172.21.15.8:0/677121878 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f9e8c0042c0 con 0x7f9e9807dda0 2024-03-16T20:46:31.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.092+0000 7f9e97400700 1 -- 172.21.15.8:0/677121878 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c011b70 con 0x7f9e9807dda0 2024-03-16T20:46:31.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.093+0000 7f9e9e600700 1 -- 172.21.15.8:0/677121878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 msgr2=0x7f9e9807c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:31.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.093+0000 7f9e9e600700 1 --2- 172.21.15.8:0/677121878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9807c310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0098a0 tx=0x7f9e8c009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:31.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.093+0000 7f9e9e600700 1 -- 172.21.15.8:0/677121878 shutdown_connections 2024-03-16T20:46:31.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.093+0000 7f9e9e600700 1 --2- 172.21.15.8:0/677121878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9807c310 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:31.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.093+0000 7f9e9e600700 1 -- 172.21.15.8:0/677121878 >> 172.21.15.8:0/677121878 conn(0x7f9e98102e60 msgr2=0x7f9e981052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:31.050 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.093+0000 7f9e9e600700 1 -- 172.21.15.8:0/677121878 shutdown_connections 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.093+0000 7f9e9e600700 1 -- 172.21.15.8:0/677121878 wait complete. 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.094+0000 7f9e9e600700 1 Processor -- start 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.094+0000 7f9e9e600700 1 -- start start 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.095+0000 7f9e9e600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9819d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.095+0000 7f9e9e600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9819dd60 con 0x7f9e9807dda0 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.095+0000 7f9e9d200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9819d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.095+0000 7f9e9d200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9819d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59602/0 (socket says 172.21.15.8:59602) 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.095+0000 7f9e9d200700 1 -- 172.21.15.8:0/457460126 learned_addr learned my addr 172.21.15.8:0/457460126 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.095+0000 7f9e9d200700 1 -- 172.21.15.8:0/457460126 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c009550 con 0x7f9e9807dda0 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.096+0000 7f9e9d200700 1 --2- 172.21.15.8:0/457460126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9819d820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009130 tx=0x7f9e8c011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.096+0000 7f9e95600700 1 -- 172.21.15.8:0/457460126 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c003aa0 con 0x7f9e9807dda0 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.096+0000 7f9e95600700 1 -- 172.21.15.8:0/457460126 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f9e8c003c00 con 0x7f9e9807dda0 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.096+0000 7f9e9e600700 1 -- 172.21.15.8:0/457460126 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9819df60 con 0x7f9e9807dda0 2024-03-16T20:46:31.051 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.096+0000 7f9e95600700 1 -- 172.21.15.8:0/457460126 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c0248b0 con 0x7f9e9807dda0 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.096+0000 7f9e9e600700 1 -- 172.21.15.8:0/457460126 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9819e400 con 0x7f9e9807dda0 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.097+0000 7f9e95600700 1 -- 172.21.15.8:0/457460126 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45769+0+0 (secure 0 0 0) 0x7f9e8c01a430 con 0x7f9e9807dda0 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.098+0000 7f9e9e600700 1 -- 172.21.15.8:0/457460126 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9810db40 con 0x7f9e9807dda0 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.098+0000 7f9e95600700 1 --2- 172.21.15.8:0/457460126 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f9e80038cb0 0x7f9e8003b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.098+0000 7f9e95600700 1 -- 172.21.15.8:0/457460126 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9e8c04cda0 con 0x7f9e9807dda0 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.098+0000 7f9e97e00700 1 --2- 172.21.15.8:0/457460126 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f9e80038cb0 0x7f9e8003b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.099+0000 7f9e97e00700 1 --2- 172.21.15.8:0/457460126 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f9e80038cb0 0x7f9e8003b170 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9e84006fd0 tx=0x7f9e84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.105+0000 7f9e95600700 1 -- 172.21.15.8:0/457460126 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9e8c01a6e0 con 0x7f9e9807dda0 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.349+0000 7f9e9e600700 1 -- 172.21.15.8:0/457460126 --> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e98104150 con 0x7f9e80038cb0 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.358+0000 7f9e95600700 1 -- 172.21.15.8:0/457460126 <== mgr.14120 v2:172.21.15.8:6800/1972090527 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9e98104150 con 0x7f9e80038cb0 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.361+0000 7f9e9e600700 1 -- 172.21.15.8:0/457460126 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f9e80038cb0 msgr2=0x7f9e8003b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.361+0000 7f9e9e600700 1 --2- 172.21.15.8:0/457460126 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f9e80038cb0 0x7f9e8003b170 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9e84006fd0 tx=0x7f9e84006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.361+0000 7f9e9e600700 1 -- 172.21.15.8:0/457460126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 msgr2=0x7f9e9819d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:31.052 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.361+0000 7f9e9e600700 1 --2- 172.21.15.8:0/457460126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9819d820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009130 tx=0x7f9e8c011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:31.053 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.362+0000 7f9e9e600700 1 -- 172.21.15.8:0/457460126 shutdown_connections 2024-03-16T20:46:31.053 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.362+0000 7f9e9e600700 1 --2- 172.21.15.8:0/457460126 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f9e80038cb0 0x7f9e8003b170 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:31.053 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.362+0000 7f9e9e600700 1 --2- 172.21.15.8:0/457460126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e9807dda0 0x7f9e9819d820 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:31.053 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.362+0000 7f9e9e600700 1 -- 172.21.15.8:0/457460126 >> 172.21.15.8:0/457460126 conn(0x7f9e98102e60 msgr2=0x7f9e98103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:31.053 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.362+0000 7f9e9e600700 1 -- 172.21.15.8:0/457460126 shutdown_connections 2024-03-16T20:46:31.053 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:30.362+0000 7f9e9e600700 1 -- 172.21.15.8:0/457460126 wait complete. 2024-03-16T20:46:32.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-16T20:46:32.570 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.593+0000 7fdddf000700 1 Processor -- start 2024-03-16T20:46:32.570 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.593+0000 7fdddf000700 1 -- start start 2024-03-16T20:46:32.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.593+0000 7fdddf000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd807c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:32.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.593+0000 7fdddf000700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd807c7f0 con 0x7fddd807ddb0 2024-03-16T20:46:32.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.594+0000 7fddd7e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd807c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:32.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.594+0000 7fddd7e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd807c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59614/0 (socket says 172.21.15.8:59614) 2024-03-16T20:46:32.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.594+0000 7fddd7e00700 1 -- 172.21.15.8:0/1011504003 learned_addr learned my addr 172.21.15.8:0/1011504003 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:32.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.595+0000 7fddd7e00700 1 -- 172.21.15.8:0/1011504003 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd807c930 con 0x7fddd807ddb0 2024-03-16T20:46:32.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.595+0000 7fddd7e00700 1 --2- 172.21.15.8:0/1011504003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd807c2b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fddc80098a0 tx=0x7fddc8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba6fe2a9258fba4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:32.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.595+0000 7fddd7400700 1 -- 172.21.15.8:0/1011504003 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc8004160 con 0x7fddd807ddb0 2024-03-16T20:46:32.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.595+0000 7fddd7400700 1 -- 172.21.15.8:0/1011504003 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fddc80042c0 con 0x7fddd807ddb0 2024-03-16T20:46:32.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.595+0000 7fddd7400700 1 -- 172.21.15.8:0/1011504003 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc8011b70 con 0x7fddd807ddb0 2024-03-16T20:46:32.571 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.596+0000 7fdddf000700 1 -- 172.21.15.8:0/1011504003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 msgr2=0x7fddd807c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:32.572 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.596+0000 7fdddf000700 1 --2- 172.21.15.8:0/1011504003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd807c2b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fddc80098a0 tx=0x7fddc8009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:32.572 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.596+0000 7fdddf000700 1 -- 172.21.15.8:0/1011504003 shutdown_connections 2024-03-16T20:46:32.572 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.596+0000 7fdddf000700 1 --2- 172.21.15.8:0/1011504003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd807c2b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:32.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.596+0000 7fdddf000700 1 -- 172.21.15.8:0/1011504003 >> 172.21.15.8:0/1011504003 conn(0x7fddd8102fc0 msgr2=0x7fddd8105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:32.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.597+0000 7fdddf000700 1 -- 172.21.15.8:0/1011504003 shutdown_connections 2024-03-16T20:46:32.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.597+0000 7fdddf000700 1 -- 172.21.15.8:0/1011504003 wait complete. 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.598+0000 7fdddf000700 1 Processor -- start 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.598+0000 7fdddf000700 1 -- start start 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.598+0000 7fdddf000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd819d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.598+0000 7fdddf000700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd819df00 con 0x7fddd807ddb0 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.599+0000 7fddd7e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd819d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.599+0000 7fddd7e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd819d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59628/0 (socket says 172.21.15.8:59628) 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.599+0000 7fddd7e00700 1 -- 172.21.15.8:0/570181974 learned_addr learned my addr 172.21.15.8:0/570181974 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.599+0000 7fddd7e00700 1 -- 172.21.15.8:0/570181974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc8009550 con 0x7fddd807ddb0 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.600+0000 7fddd7e00700 1 --2- 172.21.15.8:0/570181974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd819d9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009130 tx=0x7fddc8011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.600+0000 7fddd5600700 1 -- 172.21.15.8:0/570181974 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc8003aa0 con 0x7fddd807ddb0 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.600+0000 7fddd5600700 1 -- 172.21.15.8:0/570181974 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fddc8003c00 con 0x7fddd807ddb0 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.600+0000 7fdddf000700 1 -- 172.21.15.8:0/570181974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd819e100 con 0x7fddd807ddb0 2024-03-16T20:46:32.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.600+0000 7fddd5600700 1 -- 172.21.15.8:0/570181974 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc80248b0 con 0x7fddd807ddb0 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.600+0000 7fdddf000700 1 -- 172.21.15.8:0/570181974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd819e5a0 con 0x7fddd807ddb0 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.601+0000 7fddd5600700 1 -- 172.21.15.8:0/570181974 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45769+0+0 (secure 0 0 0) 0x7fddc8024a10 con 0x7fddd807ddb0 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.601+0000 7fdddf000700 1 -- 172.21.15.8:0/570181974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd810ddf0 con 0x7fddd807ddb0 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.602+0000 7fddd5600700 1 --2- 172.21.15.8:0/570181974 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fddbc038d00 0x7fddbc03b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.602+0000 7fddd5600700 1 -- 172.21.15.8:0/570181974 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fddc804cd10 con 0x7fddd807ddb0 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.602+0000 7fddcf400700 1 --2- 172.21.15.8:0/570181974 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fddbc038d00 0x7fddbc03b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.603+0000 7fddcf400700 1 --2- 172.21.15.8:0/570181974 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fddbc038d00 0x7fddbc03b1c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fddc0006fd0 tx=0x7fddc0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.612+0000 7fddd5600700 1 -- 172.21.15.8:0/570181974 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fddc8024cc0 con 0x7fddd807ddb0 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.837+0000 7fdddf000700 1 -- 172.21.15.8:0/570181974 --> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fddd81042b0 con 0x7fddbc038d00 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.839+0000 7fddd5600700 1 -- 172.21.15.8:0/570181974 <== mgr.14120 v2:172.21.15.8:6800/1972090527 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fddd81042b0 con 0x7fddbc038d00 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.841+0000 7fdddf000700 1 -- 172.21.15.8:0/570181974 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fddbc038d00 msgr2=0x7fddbc03b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.841+0000 7fdddf000700 1 --2- 172.21.15.8:0/570181974 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fddbc038d00 0x7fddbc03b1c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fddc0006fd0 tx=0x7fddc0006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:32.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.841+0000 7fdddf000700 1 -- 172.21.15.8:0/570181974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 msgr2=0x7fddd819d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:32.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.841+0000 7fdddf000700 1 --2- 172.21.15.8:0/570181974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd819d9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009130 tx=0x7fddc8011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:32.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.842+0000 7fdddf000700 1 -- 172.21.15.8:0/570181974 shutdown_connections 2024-03-16T20:46:32.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.842+0000 7fdddf000700 1 --2- 172.21.15.8:0/570181974 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fddbc038d00 0x7fddbc03b1c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:32.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.842+0000 7fdddf000700 1 --2- 172.21.15.8:0/570181974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddd807ddb0 0x7fddd819d9c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:32.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.842+0000 7fdddf000700 1 -- 172.21.15.8:0/570181974 >> 172.21.15.8:0/570181974 conn(0x7fddd8102fc0 msgr2=0x7fddd8103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:32.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.842+0000 7fdddf000700 1 -- 172.21.15.8:0/570181974 shutdown_connections 2024-03-16T20:46:32.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:31.842+0000 7fdddf000700 1 -- 172.21.15.8:0/570181974 wait complete. 2024-03-16T20:46:32.579 INFO:teuthology.orchestra.run.smithi008.stdout:Generating ssh key... 2024-03-16T20:46:32.882 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:32 smithi008 ceph-mon[31434]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:46:33.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:33 smithi008 ceph-mon[31434]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:46:33.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:33 smithi008 ceph-mon[31434]: Generating ssh key... 2024-03-16T20:46:34.478 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: Generating public/private rsa key pair. 2024-03-16T20:46:34.478 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: Your identification has been saved in /tmp/tmp9_qlwhn4/key. 2024-03-16T20:46:34.478 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: Your public key has been saved in /tmp/tmp9_qlwhn4/key.pub. 2024-03-16T20:46:34.478 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: The key fingerprint is: 2024-03-16T20:46:34.478 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: SHA256:RmgMPeABeYZ8d4b+MiYAea9dh/NZgzPKraa05GavPwk ceph-05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:46:34.478 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: The key's randomart image is: 2024-03-16T20:46:34.478 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: +---[RSA 3072]----+ 2024-03-16T20:46:34.478 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: | o.++o . | 2024-03-16T20:46:34.478 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: |o =.++=.o | 2024-03-16T20:46:34.479 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: | o =.o+=.. | 2024-03-16T20:46:34.479 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: | . ..=.= o | 2024-03-16T20:46:34.479 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: | + o BS= . | 2024-03-16T20:46:34.479 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: | . E *.= | 2024-03-16T20:46:34.479 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: | o+ = | 2024-03-16T20:46:34.479 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: | +o.= | 2024-03-16T20:46:34.479 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: | o=*o. | 2024-03-16T20:46:34.479 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: +----[SHA256]-----+ 2024-03-16T20:46:34.854 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.179+0000 7f740fe00700 1 Processor -- start 2024-03-16T20:46:34.856 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.179+0000 7f740fe00700 1 -- start start 2024-03-16T20:46:34.856 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.179+0000 7f740fe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f7408081db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:34.856 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.179+0000 7f740fe00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408082380 con 0x7f7408081990 2024-03-16T20:46:34.856 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.180+0000 7f740d400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f7408081db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:34.856 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.180+0000 7f740d400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f7408081db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59644/0 (socket says 172.21.15.8:59644) 2024-03-16T20:46:34.856 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.180+0000 7f740d400700 1 -- 172.21.15.8:0/3670916687 learned_addr learned my addr 172.21.15.8:0/3670916687 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:34.856 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.181+0000 7f740d400700 1 -- 172.21.15.8:0/3670916687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74080824c0 con 0x7f7408081990 2024-03-16T20:46:34.857 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.181+0000 7f740d400700 1 --2- 172.21.15.8:0/3670916687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f7408081db0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0098a0 tx=0x7f73fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4078814e4d019346 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:34.857 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.181+0000 7f7407e00700 1 -- 172.21.15.8:0/3670916687 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73fc004160 con 0x7f7408081990 2024-03-16T20:46:34.857 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.182+0000 7f7407e00700 1 -- 172.21.15.8:0/3670916687 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f73fc0042c0 con 0x7f7408081990 2024-03-16T20:46:34.857 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.182+0000 7f7407e00700 1 -- 172.21.15.8:0/3670916687 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73fc011b70 con 0x7f7408081990 2024-03-16T20:46:34.857 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.182+0000 7f740fe00700 1 -- 172.21.15.8:0/3670916687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 msgr2=0x7f7408081db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:34.857 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.182+0000 7f740fe00700 1 --2- 172.21.15.8:0/3670916687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f7408081db0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0098a0 tx=0x7f73fc009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:34.857 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.182+0000 7f740fe00700 1 -- 172.21.15.8:0/3670916687 shutdown_connections 2024-03-16T20:46:34.857 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.182+0000 7f740fe00700 1 --2- 172.21.15.8:0/3670916687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f7408081db0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:34.861 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.182+0000 7f740fe00700 1 -- 172.21.15.8:0/3670916687 >> 172.21.15.8:0/3670916687 conn(0x7f740807d000 msgr2=0x7f740807f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:34.861 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.183+0000 7f740fe00700 1 -- 172.21.15.8:0/3670916687 shutdown_connections 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.183+0000 7f740fe00700 1 -- 172.21.15.8:0/3670916687 wait complete. 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.184+0000 7f740fe00700 1 Processor -- start 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.184+0000 7f740fe00700 1 -- start start 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.184+0000 7f740fe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f74081a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.184+0000 7f740fe00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74081a2330 con 0x7f7408081990 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.185+0000 7f740d400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f74081a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.185+0000 7f740d400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f74081a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59660/0 (socket says 172.21.15.8:59660) 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.185+0000 7f740d400700 1 -- 172.21.15.8:0/2387387911 learned_addr learned my addr 172.21.15.8:0/2387387911 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.185+0000 7f740d400700 1 -- 172.21.15.8:0/2387387911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc009550 con 0x7f7408081990 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.185+0000 7f740d400700 1 --2- 172.21.15.8:0/2387387911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f74081a1df0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f73fc000c00 tx=0x7f73fc011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.186+0000 7f7406000700 1 -- 172.21.15.8:0/2387387911 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73fc003aa0 con 0x7f7408081990 2024-03-16T20:46:34.862 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.186+0000 7f7406000700 1 -- 172.21.15.8:0/2387387911 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f73fc003c00 con 0x7f7408081990 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.186+0000 7f740fe00700 1 -- 172.21.15.8:0/2387387911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74081a2530 con 0x7f7408081990 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.186+0000 7f7406000700 1 -- 172.21.15.8:0/2387387911 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73fc024930 con 0x7f7408081990 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.186+0000 7f740fe00700 1 -- 172.21.15.8:0/2387387911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74081a29d0 con 0x7f7408081990 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.187+0000 7f7406000700 1 -- 172.21.15.8:0/2387387911 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45769+0+0 (secure 0 0 0) 0x7f73fc01aca0 con 0x7f7408081990 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.187+0000 7f740fe00700 1 -- 172.21.15.8:0/2387387911 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7408112430 con 0x7f7408081990 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.187+0000 7f7406000700 1 --2- 172.21.15.8:0/2387387911 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f73f0038d00 0x7f73f003b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.187+0000 7f7406000700 1 -- 172.21.15.8:0/2387387911 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f73fc04cce0 con 0x7f7408081990 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.188+0000 7f740ca00700 1 --2- 172.21.15.8:0/2387387911 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f73f0038d00 0x7f73f003b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.188+0000 7f740ca00700 1 --2- 172.21.15.8:0/2387387911 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f73f0038d00 0x7f73f003b1c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f73f4006fd0 tx=0x7f73f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.193+0000 7f7406000700 1 -- 172.21.15.8:0/2387387911 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f73fc02d3f0 con 0x7f7408081990 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:33.419+0000 7f740fe00700 1 -- 172.21.15.8:0/2387387911 --> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f74081a5310 con 0x7f73f0038d00 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:34.100+0000 7f7406000700 1 -- 172.21.15.8:0/2387387911 <== mgr.14120 v2:172.21.15.8:6800/1972090527 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f74081a5310 con 0x7f73f0038d00 2024-03-16T20:46:34.863 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:34.103+0000 7f740fe00700 1 -- 172.21.15.8:0/2387387911 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f73f0038d00 msgr2=0x7f73f003b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:34.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:34.103+0000 7f740fe00700 1 --2- 172.21.15.8:0/2387387911 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f73f0038d00 0x7f73f003b1c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f73f4006fd0 tx=0x7f73f4006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:34.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:34.103+0000 7f740fe00700 1 -- 172.21.15.8:0/2387387911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 msgr2=0x7f74081a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:34.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:34.103+0000 7f740fe00700 1 --2- 172.21.15.8:0/2387387911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f74081a1df0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f73fc000c00 tx=0x7f73fc011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:34.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:34.103+0000 7f740fe00700 1 -- 172.21.15.8:0/2387387911 shutdown_connections 2024-03-16T20:46:34.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:34.103+0000 7f740fe00700 1 --2- 172.21.15.8:0/2387387911 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f73f0038d00 0x7f73f003b1c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:34.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:34.103+0000 7f740fe00700 1 --2- 172.21.15.8:0/2387387911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7408081990 0x7f74081a1df0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:34.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:34.103+0000 7f740fe00700 1 -- 172.21.15.8:0/2387387911 >> 172.21.15.8:0/2387387911 conn(0x7f740807d000 msgr2=0x7f740807db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:34.865 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:34.104+0000 7f740fe00700 1 -- 172.21.15.8:0/2387387911 shutdown_connections 2024-03-16T20:46:34.865 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:34.104+0000 7f740fe00700 1 -- 172.21.15.8:0/2387387911 wait complete. 2024-03-16T20:46:35.384 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:35 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:35.384 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:35 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:36.338 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYRZ8cOCRUNRBoyvv/Tlx83EiUDH4C11c6u7I7rDroSUYOJ9WlFHpbCi3N8J0aYhDcWW79ClHsE1sP9Zm6Ipxdfs/vM+B7SvJbyslFRs8FTzV0dSrUN2v2/iTdrBZz0dNVrtowGy1gGRgUW1WwXVQ5HS31N798R4+bpERq+pW3YAvfFjqYy9Kdyqp9Tt62tDLqyNYN58Zn4X7toZLntkGOYDpTAdh6LYeQBSQV26T0XN2yLl1AGY/mqrSmRxqTgJzv2h04x9TzVG0zqEoMf2FXOyo4ROhXFrqCTzNeSnDmPJlQQaNN6vp/E8SEPxlzcNaLk4O91CwynOpBrd6/t58Ndq7pns7TM7JtjGzhZ2XFwEssOU8gwKvMC9Edfsvs1JgA9mVu1ZlbHtUJE1OOuledrBklqRtzivBLxKoHjhgW7vJ2NtFLHeos8SVxAnDAQh3Vxxa3MwcIY8FOj1uEf7kzN+SX6igV0R+PJDmGlodsaw722zoeTImATyzj4NYRtes= ceph-05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:46:36.338 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.462+0000 7feec8400700 1 Processor -- start 2024-03-16T20:46:36.338 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.462+0000 7feec8400700 1 -- start start 2024-03-16T20:46:36.338 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.462+0000 7feec8400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec0081db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:36.339 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.462+0000 7feec8400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec0082380 con 0x7feec0081990 2024-03-16T20:46:36.339 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.463+0000 7feec5a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec0081db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:36.339 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.463+0000 7feec5a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec0081db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59676/0 (socket says 172.21.15.8:59676) 2024-03-16T20:46:36.340 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.463+0000 7feec5a00700 1 -- 172.21.15.8:0/900663371 learned_addr learned my addr 172.21.15.8:0/900663371 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:36.340 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.463+0000 7feec5a00700 1 -- 172.21.15.8:0/900663371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00824c0 con 0x7feec0081990 2024-03-16T20:46:36.340 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.464+0000 7feec5a00700 1 --2- 172.21.15.8:0/900663371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec0081db0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feeb40098a0 tx=0x7feeb4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dcf3307a50d3f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:36.340 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.464+0000 7feebfe00700 1 -- 172.21.15.8:0/900663371 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb4004160 con 0x7feec0081990 2024-03-16T20:46:36.340 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.464+0000 7feebfe00700 1 -- 172.21.15.8:0/900663371 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7feeb40042c0 con 0x7feec0081990 2024-03-16T20:46:36.340 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.464+0000 7feebfe00700 1 -- 172.21.15.8:0/900663371 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb4011b70 con 0x7feec0081990 2024-03-16T20:46:36.340 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.465+0000 7feec8400700 1 -- 172.21.15.8:0/900663371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 msgr2=0x7feec0081db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:36.340 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.465+0000 7feec8400700 1 --2- 172.21.15.8:0/900663371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec0081db0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feeb40098a0 tx=0x7feeb4009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:36.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.465+0000 7feec8400700 1 -- 172.21.15.8:0/900663371 shutdown_connections 2024-03-16T20:46:36.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.465+0000 7feec8400700 1 --2- 172.21.15.8:0/900663371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec0081db0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:36.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.465+0000 7feec8400700 1 -- 172.21.15.8:0/900663371 >> 172.21.15.8:0/900663371 conn(0x7feec007d000 msgr2=0x7feec007f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:36.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.465+0000 7feec8400700 1 -- 172.21.15.8:0/900663371 shutdown_connections 2024-03-16T20:46:36.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.465+0000 7feec8400700 1 -- 172.21.15.8:0/900663371 wait complete. 2024-03-16T20:46:36.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.466+0000 7feec8400700 1 Processor -- start 2024-03-16T20:46:36.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.466+0000 7feec8400700 1 -- start start 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.466+0000 7feec8400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec01a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.467+0000 7feec8400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec01a2330 con 0x7feec0081990 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.467+0000 7feec5a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec01a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.467+0000 7feec5a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec01a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59682/0 (socket says 172.21.15.8:59682) 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.467+0000 7feec5a00700 1 -- 172.21.15.8:0/1789437668 learned_addr learned my addr 172.21.15.8:0/1789437668 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.467+0000 7feec5a00700 1 -- 172.21.15.8:0/1789437668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4009550 con 0x7feec0081990 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.467+0000 7feec5a00700 1 --2- 172.21.15.8:0/1789437668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec01a1df0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feeb4011670 tx=0x7feeb4011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.468+0000 7feebe000700 1 -- 172.21.15.8:0/1789437668 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb40039f0 con 0x7feec0081990 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.468+0000 7feebe000700 1 -- 172.21.15.8:0/1789437668 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7feeb4003b50 con 0x7feec0081990 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.468+0000 7feec8400700 1 -- 172.21.15.8:0/1789437668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec01a2530 con 0x7feec0081990 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.468+0000 7feebe000700 1 -- 172.21.15.8:0/1789437668 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb401a690 con 0x7feec0081990 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.468+0000 7feec8400700 1 -- 172.21.15.8:0/1789437668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec01a29d0 con 0x7feec0081990 2024-03-16T20:46:36.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.469+0000 7feebe000700 1 -- 172.21.15.8:0/1789437668 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45769+0+0 (secure 0 0 0) 0x7feeb4024430 con 0x7feec0081990 2024-03-16T20:46:36.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.469+0000 7feec8400700 1 -- 172.21.15.8:0/1789437668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec0112430 con 0x7feec0081990 2024-03-16T20:46:36.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.470+0000 7feebe000700 1 --2- 172.21.15.8:0/1789437668 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7feea8038cb0 0x7feea803b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:36.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.470+0000 7feebe000700 1 -- 172.21.15.8:0/1789437668 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7feeb404ce30 con 0x7feec0081990 2024-03-16T20:46:36.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.470+0000 7feec5000700 1 --2- 172.21.15.8:0/1789437668 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7feea8038cb0 0x7feea803b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:36.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.471+0000 7feec5000700 1 --2- 172.21.15.8:0/1789437668 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7feea8038cb0 0x7feea803b170 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feeac006fd0 tx=0x7feeac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:36.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.475+0000 7feebe000700 1 -- 172.21.15.8:0/1789437668 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7feeb4051070 con 0x7feec0081990 2024-03-16T20:46:36.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.703+0000 7feec8400700 1 -- 172.21.15.8:0/1789437668 --> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7feec007e220 con 0x7feea8038cb0 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.704+0000 7feebe000700 1 -- 172.21.15.8:0/1789437668 <== mgr.14120 v2:172.21.15.8:6800/1972090527 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7feec007e220 con 0x7feea8038cb0 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.707+0000 7feec8400700 1 -- 172.21.15.8:0/1789437668 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7feea8038cb0 msgr2=0x7feea803b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.707+0000 7feec8400700 1 --2- 172.21.15.8:0/1789437668 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7feea8038cb0 0x7feea803b170 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feeac006fd0 tx=0x7feeac006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.707+0000 7feec8400700 1 -- 172.21.15.8:0/1789437668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 msgr2=0x7feec01a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.707+0000 7feec8400700 1 --2- 172.21.15.8:0/1789437668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec01a1df0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feeb4011670 tx=0x7feeb4011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.707+0000 7feec8400700 1 -- 172.21.15.8:0/1789437668 shutdown_connections 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.708+0000 7feec8400700 1 --2- 172.21.15.8:0/1789437668 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7feea8038cb0 0x7feea803b170 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.708+0000 7feec8400700 1 --2- 172.21.15.8:0/1789437668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec0081990 0x7feec01a1df0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.708+0000 7feec8400700 1 -- 172.21.15.8:0/1789437668 >> 172.21.15.8:0/1789437668 conn(0x7feec007d000 msgr2=0x7feec007db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.708+0000 7feec8400700 1 -- 172.21.15.8:0/1789437668 shutdown_connections 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:35.708+0000 7feec8400700 1 -- 172.21.15.8:0/1789437668 wait complete. 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-16T20:46:36.347 INFO:teuthology.orchestra.run.smithi008.stdout:Adding key to root@localhost authorized_keys... 2024-03-16T20:46:36.348 INFO:teuthology.orchestra.run.smithi008.stdout:Adding host smithi008... 2024-03-16T20:46:36.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:36 smithi008 ceph-mon[31434]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:46:37.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:37 smithi008 ceph-mon[31434]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi008", "addr": "172.21.15.8", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:46:39.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:39 smithi008 ceph-mon[31434]: Deploying cephadm binary to smithi008 2024-03-16T20:46:44.504 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Added host 'smithi008' with addr '172.21.15.8' 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.001+0000 7f86f5800700 1 Processor -- start 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.001+0000 7f86f5800700 1 -- start start 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.002+0000 7f86f5800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f0107ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.002+0000 7f86f5800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f01082b0 con 0x7f86f01078c0 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.002+0000 7f86efe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f0107ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.002+0000 7f86efe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f0107ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59692/0 (socket says 172.21.15.8:59692) 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.002+0000 7f86efe00700 1 -- 172.21.15.8:0/3288312536 learned_addr learned my addr 172.21.15.8:0/3288312536 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.003+0000 7f86efe00700 1 -- 172.21.15.8:0/3288312536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f0108a20 con 0x7f86f01078c0 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.003+0000 7f86efe00700 1 --2- 172.21.15.8:0/3288312536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f0107ce0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f86e00098a0 tx=0x7f86e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5620a6251a7654a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.003+0000 7f86eea00700 1 -- 172.21.15.8:0/3288312536 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86e0004160 con 0x7f86f01078c0 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.003+0000 7f86eea00700 1 -- 172.21.15.8:0/3288312536 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f86e00042c0 con 0x7f86f01078c0 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.003+0000 7f86eea00700 1 -- 172.21.15.8:0/3288312536 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86e0011b70 con 0x7f86f01078c0 2024-03-16T20:46:44.505 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.004+0000 7f86f5800700 1 -- 172.21.15.8:0/3288312536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 msgr2=0x7f86f0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.004+0000 7f86f5800700 1 --2- 172.21.15.8:0/3288312536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f0107ce0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f86e00098a0 tx=0x7f86e0009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.004+0000 7f86f5800700 1 -- 172.21.15.8:0/3288312536 shutdown_connections 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.004+0000 7f86f5800700 1 --2- 172.21.15.8:0/3288312536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f0107ce0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.004+0000 7f86f5800700 1 -- 172.21.15.8:0/3288312536 >> 172.21.15.8:0/3288312536 conn(0x7f86f0102ea0 msgr2=0x7f86f01052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.004+0000 7f86f5800700 1 -- 172.21.15.8:0/3288312536 shutdown_connections 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.004+0000 7f86f5800700 1 -- 172.21.15.8:0/3288312536 wait complete. 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.005+0000 7f86f5800700 1 Processor -- start 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.005+0000 7f86f5800700 1 -- start start 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.006+0000 7f86f5800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f019d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.006+0000 7f86f5800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f019dd80 con 0x7f86f01078c0 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.006+0000 7f86efe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f019d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:44.506 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.006+0000 7f86efe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f019d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59694/0 (socket says 172.21.15.8:59694) 2024-03-16T20:46:44.509 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.006+0000 7f86efe00700 1 -- 172.21.15.8:0/3669222488 learned_addr learned my addr 172.21.15.8:0/3669222488 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.006+0000 7f86efe00700 1 -- 172.21.15.8:0/3669222488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0009550 con 0x7f86f01078c0 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.007+0000 7f86efe00700 1 --2- 172.21.15.8:0/3669222488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f019d840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86e0000c00 tx=0x7f86e0011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.007+0000 7f86ecc00700 1 -- 172.21.15.8:0/3669222488 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86e0003aa0 con 0x7f86f01078c0 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.007+0000 7f86ecc00700 1 -- 172.21.15.8:0/3669222488 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f86e0003c00 con 0x7f86f01078c0 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.007+0000 7f86f5800700 1 -- 172.21.15.8:0/3669222488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f019df80 con 0x7f86f01078c0 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.007+0000 7f86ecc00700 1 -- 172.21.15.8:0/3669222488 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86e0024930 con 0x7f86f01078c0 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.007+0000 7f86f5800700 1 -- 172.21.15.8:0/3669222488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f019e420 con 0x7f86f01078c0 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.008+0000 7f86ecc00700 1 -- 172.21.15.8:0/3669222488 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45769+0+0 (secure 0 0 0) 0x7f86e001a430 con 0x7f86f01078c0 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.008+0000 7f86f5800700 1 -- 172.21.15.8:0/3669222488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f010bc50 con 0x7f86f01078c0 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.009+0000 7f86ecc00700 1 --2- 172.21.15.8:0/3669222488 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f86d4038d00 0x7f86d403b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.009+0000 7f86ecc00700 1 -- 172.21.15.8:0/3669222488 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f86e004ce70 con 0x7f86f01078c0 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.009+0000 7f86ef400700 1 --2- 172.21.15.8:0/3669222488 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f86d4038d00 0x7f86d403b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:44.510 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.010+0000 7f86ef400700 1 --2- 172.21.15.8:0/3669222488 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f86d4038d00 0x7f86d403b1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86dc006fd0 tx=0x7f86dc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.015+0000 7f86ecc00700 1 -- 172.21.15.8:0/3669222488 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f86e0010380 con 0x7f86f01078c0 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:37.244+0000 7f86f5800700 1 -- 172.21.15.8:0/3669222488 --> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi008", "addr": "172.21.15.8", "target": ["mon-mgr", ""]}) v1 -- 0x7f86f0104060 con 0x7f86d4038d00 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:43.819+0000 7f86ecc00700 1 -- 172.21.15.8:0/3669222488 <== mgr.14120 v2:172.21.15.8:6800/1972090527 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f86f0104060 con 0x7f86d4038d00 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:43.823+0000 7f86f5800700 1 -- 172.21.15.8:0/3669222488 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f86d4038d00 msgr2=0x7f86d403b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:43.823+0000 7f86f5800700 1 --2- 172.21.15.8:0/3669222488 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f86d4038d00 0x7f86d403b1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86dc006fd0 tx=0x7f86dc006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:43.823+0000 7f86f5800700 1 -- 172.21.15.8:0/3669222488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 msgr2=0x7f86f019d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:43.823+0000 7f86f5800700 1 --2- 172.21.15.8:0/3669222488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f019d840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86e0000c00 tx=0x7f86e0011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:43.823+0000 7f86f5800700 1 -- 172.21.15.8:0/3669222488 shutdown_connections 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:43.823+0000 7f86f5800700 1 --2- 172.21.15.8:0/3669222488 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f86d4038d00 0x7f86d403b1c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:43.823+0000 7f86f5800700 1 --2- 172.21.15.8:0/3669222488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86f01078c0 0x7f86f019d840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:43.823+0000 7f86f5800700 1 -- 172.21.15.8:0/3669222488 >> 172.21.15.8:0/3669222488 conn(0x7f86f0102ea0 msgr2=0x7f86f0103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:43.824+0000 7f86f5800700 1 -- 172.21.15.8:0/3669222488 shutdown_connections 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:43.824+0000 7f86f5800700 1 -- 172.21.15.8:0/3669222488 wait complete. 2024-03-16T20:46:44.511 INFO:teuthology.orchestra.run.smithi008.stdout:Deploying unmanaged mon service... 2024-03-16T20:46:45.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:44 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:45.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:44 smithi008 ceph-mon[31434]: Added host smithi008 2024-03-16T20:46:45.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:44 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:46:46.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:46 smithi008 ceph-mon[31434]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:46:46.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:46 smithi008 ceph-mon[31434]: Saving service mon spec with placement count:5 2024-03-16T20:46:46.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:46 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:46.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-16T20:46:46.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.170+0000 7f2e35e00700 1 Processor -- start 2024-03-16T20:46:46.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.170+0000 7f2e35e00700 1 -- start start 2024-03-16T20:46:46.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.170+0000 7f2e35e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3010a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:46.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.170+0000 7f2e35e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3007bdb0 con 0x7f2e30108390 2024-03-16T20:46:46.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.171+0000 7f2e34a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3010a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.171+0000 7f2e34a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3010a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53676/0 (socket says 172.21.15.8:53676) 2024-03-16T20:46:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.171+0000 7f2e34a00700 1 -- 172.21.15.8:0/2548924652 learned_addr learned my addr 172.21.15.8:0/2548924652 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.171+0000 7f2e34a00700 1 -- 172.21.15.8:0/2548924652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3007bef0 con 0x7f2e30108390 2024-03-16T20:46:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.172+0000 7f2e34a00700 1 --2- 172.21.15.8:0/2548924652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3010a780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2e240098a0 tx=0x7f2e24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2ddf9748b2153 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.172+0000 7f2e2f400700 1 -- 172.21.15.8:0/2548924652 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e24004160 con 0x7f2e30108390 2024-03-16T20:46:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.172+0000 7f2e2f400700 1 -- 172.21.15.8:0/2548924652 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f2e240042c0 con 0x7f2e30108390 2024-03-16T20:46:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.172+0000 7f2e2f400700 1 -- 172.21.15.8:0/2548924652 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e24011b70 con 0x7f2e30108390 2024-03-16T20:46:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.173+0000 7f2e35e00700 1 -- 172.21.15.8:0/2548924652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 msgr2=0x7f2e3010a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.173+0000 7f2e35e00700 1 --2- 172.21.15.8:0/2548924652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3010a780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2e240098a0 tx=0x7f2e24009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.173+0000 7f2e35e00700 1 -- 172.21.15.8:0/2548924652 shutdown_connections 2024-03-16T20:46:46.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.173+0000 7f2e35e00700 1 --2- 172.21.15.8:0/2548924652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3010a780 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.173+0000 7f2e35e00700 1 -- 172.21.15.8:0/2548924652 >> 172.21.15.8:0/2548924652 conn(0x7f2e30101d60 msgr2=0x7f2e30104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.173+0000 7f2e35e00700 1 -- 172.21.15.8:0/2548924652 shutdown_connections 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.173+0000 7f2e35e00700 1 -- 172.21.15.8:0/2548924652 wait complete. 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.174+0000 7f2e35e00700 1 Processor -- start 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.174+0000 7f2e35e00700 1 -- start start 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.175+0000 7f2e35e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3019b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.175+0000 7f2e35e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3019bb50 con 0x7f2e30108390 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.175+0000 7f2e34a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3019b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.175+0000 7f2e34a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3019b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53682/0 (socket says 172.21.15.8:53682) 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.175+0000 7f2e34a00700 1 -- 172.21.15.8:0/3036783051 learned_addr learned my addr 172.21.15.8:0/3036783051 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.175+0000 7f2e34a00700 1 -- 172.21.15.8:0/3036783051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009550 con 0x7f2e30108390 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.176+0000 7f2e34a00700 1 --2- 172.21.15.8:0/3036783051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3019b610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009130 tx=0x7f2e24011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:46.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.176+0000 7f2e2d600700 1 -- 172.21.15.8:0/3036783051 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e24003aa0 con 0x7f2e30108390 2024-03-16T20:46:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.176+0000 7f2e2d600700 1 -- 172.21.15.8:0/3036783051 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f2e24003c00 con 0x7f2e30108390 2024-03-16T20:46:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.176+0000 7f2e35e00700 1 -- 172.21.15.8:0/3036783051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3019bd50 con 0x7f2e30108390 2024-03-16T20:46:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.176+0000 7f2e2d600700 1 -- 172.21.15.8:0/3036783051 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e240248b0 con 0x7f2e30108390 2024-03-16T20:46:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.176+0000 7f2e35e00700 1 -- 172.21.15.8:0/3036783051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3019c1f0 con 0x7f2e30108390 2024-03-16T20:46:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.177+0000 7f2e2d600700 1 -- 172.21.15.8:0/3036783051 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45769+0+0 (secure 0 0 0) 0x7f2e2401ac30 con 0x7f2e30108390 2024-03-16T20:46:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.177+0000 7f2e35e00700 1 -- 172.21.15.8:0/3036783051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3010ba60 con 0x7f2e30108390 2024-03-16T20:46:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.178+0000 7f2e2d600700 1 --2- 172.21.15.8:0/3036783051 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f2e18038d00 0x7f2e1803b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.178+0000 7f2e2d600700 1 -- 172.21.15.8:0/3036783051 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2e2404cde0 con 0x7f2e30108390 2024-03-16T20:46:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.178+0000 7f2e2fe00700 1 --2- 172.21.15.8:0/3036783051 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f2e18038d00 0x7f2e1803b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.179+0000 7f2e2fe00700 1 --2- 172.21.15.8:0/3036783051 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f2e18038d00 0x7f2e1803b1c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c006fd0 tx=0x7f2e1c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:46.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.184+0000 7f2e2d600700 1 -- 172.21.15.8:0/3036783051 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2e24024a10 con 0x7f2e30108390 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.436+0000 7f2e35e00700 1 -- 172.21.15.8:0/3036783051 --> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f2e30102f40 con 0x7f2e18038d00 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.447+0000 7f2e2d600700 1 -- 172.21.15.8:0/3036783051 <== mgr.14120 v2:172.21.15.8:6800/1972090527 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f2e30102f40 con 0x7f2e18038d00 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.449+0000 7f2e35e00700 1 -- 172.21.15.8:0/3036783051 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f2e18038d00 msgr2=0x7f2e1803b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.449+0000 7f2e35e00700 1 --2- 172.21.15.8:0/3036783051 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f2e18038d00 0x7f2e1803b1c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c006fd0 tx=0x7f2e1c006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.449+0000 7f2e35e00700 1 -- 172.21.15.8:0/3036783051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 msgr2=0x7f2e3019b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.449+0000 7f2e35e00700 1 --2- 172.21.15.8:0/3036783051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3019b610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009130 tx=0x7f2e24011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.450+0000 7f2e35e00700 1 -- 172.21.15.8:0/3036783051 shutdown_connections 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.450+0000 7f2e35e00700 1 --2- 172.21.15.8:0/3036783051 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f2e18038d00 0x7f2e1803b1c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.450+0000 7f2e35e00700 1 --2- 172.21.15.8:0/3036783051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30108390 0x7f2e3019b610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.450+0000 7f2e35e00700 1 -- 172.21.15.8:0/3036783051 >> 172.21.15.8:0/3036783051 conn(0x7f2e30101d60 msgr2=0x7f2e30102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.450+0000 7f2e35e00700 1 -- 172.21.15.8:0/3036783051 shutdown_connections 2024-03-16T20:46:46.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:45.450+0000 7f2e35e00700 1 -- 172.21.15.8:0/3036783051 wait complete. 2024-03-16T20:46:46.723 INFO:teuthology.orchestra.run.smithi008.stdout:Deploying unmanaged mgr service... 2024-03-16T20:46:48.693 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:48 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:48.693 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:48 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:48.693 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:48 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:48.707 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-16T20:46:48.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.774+0000 7fc27ae00700 1 Processor -- start 2024-03-16T20:46:48.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.775+0000 7fc27ae00700 1 -- start start 2024-03-16T20:46:48.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.775+0000 7fc27ae00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27407c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:48.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.775+0000 7fc27ae00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27407e190 con 0x7fc27407dd70 2024-03-16T20:46:48.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.776+0000 7fc273e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27407c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:48.717 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.776+0000 7fc273e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27407c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53692/0 (socket says 172.21.15.8:53692) 2024-03-16T20:46:48.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.776+0000 7fc273e00700 1 -- 172.21.15.8:0/3749406575 learned_addr learned my addr 172.21.15.8:0/3749406575 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:48.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.777+0000 7fc273e00700 1 -- 172.21.15.8:0/3749406575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27407c870 con 0x7fc27407dd70 2024-03-16T20:46:48.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.777+0000 7fc273e00700 1 --2- 172.21.15.8:0/3749406575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27407c330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2640098a0 tx=0x7fc264009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671a82255e443fb2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:48.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.777+0000 7fc272a00700 1 -- 172.21.15.8:0/3749406575 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc264004160 con 0x7fc27407dd70 2024-03-16T20:46:48.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.777+0000 7fc272a00700 1 -- 172.21.15.8:0/3749406575 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc2640042c0 con 0x7fc27407dd70 2024-03-16T20:46:48.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.777+0000 7fc272a00700 1 -- 172.21.15.8:0/3749406575 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc264011b90 con 0x7fc27407dd70 2024-03-16T20:46:48.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.778+0000 7fc27ae00700 1 -- 172.21.15.8:0/3749406575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 msgr2=0x7fc27407c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:48.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.778+0000 7fc27ae00700 1 --2- 172.21.15.8:0/3749406575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27407c330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2640098a0 tx=0x7fc264009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:48.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.778+0000 7fc27ae00700 1 -- 172.21.15.8:0/3749406575 shutdown_connections 2024-03-16T20:46:48.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.778+0000 7fc27ae00700 1 --2- 172.21.15.8:0/3749406575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27407c330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:48.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.778+0000 7fc27ae00700 1 -- 172.21.15.8:0/3749406575 >> 172.21.15.8:0/3749406575 conn(0x7fc274103140 msgr2=0x7fc274105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:48.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.778+0000 7fc27ae00700 1 -- 172.21.15.8:0/3749406575 shutdown_connections 2024-03-16T20:46:48.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.778+0000 7fc27ae00700 1 -- 172.21.15.8:0/3749406575 wait complete. 2024-03-16T20:46:48.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.779+0000 7fc27ae00700 1 Processor -- start 2024-03-16T20:46:48.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.780+0000 7fc27ae00700 1 -- start start 2024-03-16T20:46:48.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.780+0000 7fc27ae00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27419da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:48.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.780+0000 7fc27ae00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27419df70 con 0x7fc27407dd70 2024-03-16T20:46:48.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.780+0000 7fc273e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27419da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:48.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.780+0000 7fc273e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27419da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53694/0 (socket says 172.21.15.8:53694) 2024-03-16T20:46:48.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.780+0000 7fc273e00700 1 -- 172.21.15.8:0/361641828 learned_addr learned my addr 172.21.15.8:0/361641828 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:48.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.781+0000 7fc273e00700 1 -- 172.21.15.8:0/361641828 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc264009550 con 0x7fc27407dd70 2024-03-16T20:46:48.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.781+0000 7fc273e00700 1 --2- 172.21.15.8:0/361641828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27419da30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc264011b40 tx=0x7fc264011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:48.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.781+0000 7fc270c00700 1 -- 172.21.15.8:0/361641828 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc264003aa0 con 0x7fc27407dd70 2024-03-16T20:46:48.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.781+0000 7fc270c00700 1 -- 172.21.15.8:0/361641828 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc264003c00 con 0x7fc27407dd70 2024-03-16T20:46:48.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.781+0000 7fc270c00700 1 -- 172.21.15.8:0/361641828 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc264024840 con 0x7fc27407dd70 2024-03-16T20:46:48.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.781+0000 7fc27ae00700 1 -- 172.21.15.8:0/361641828 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27419e170 con 0x7fc27407dd70 2024-03-16T20:46:48.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.781+0000 7fc27ae00700 1 -- 172.21.15.8:0/361641828 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27419e610 con 0x7fc27407dd70 2024-03-16T20:46:48.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.783+0000 7fc27ae00700 1 -- 172.21.15.8:0/361641828 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27410de10 con 0x7fc27407dd70 2024-03-16T20:46:48.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.783+0000 7fc270c00700 1 -- 172.21.15.8:0/361641828 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45769+0+0 (secure 0 0 0) 0x7fc26401abc0 con 0x7fc27407dd70 2024-03-16T20:46:48.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.783+0000 7fc270c00700 1 --2- 172.21.15.8:0/361641828 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fc258038cb0 0x7fc25803b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:48.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.783+0000 7fc270c00700 1 -- 172.21.15.8:0/361641828 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc26404ce30 con 0x7fc27407dd70 2024-03-16T20:46:48.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.784+0000 7fc273400700 1 --2- 172.21.15.8:0/361641828 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fc258038cb0 0x7fc25803b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:48.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.785+0000 7fc273400700 1 --2- 172.21.15.8:0/361641828 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fc258038cb0 0x7fc25803b170 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc260006fd0 tx=0x7fc260006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:48.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:47.789+0000 7fc270c00700 1 -- 172.21.15.8:0/361641828 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc264024ab0 con 0x7fc27407dd70 2024-03-16T20:46:48.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.031+0000 7fc27ae00700 1 -- 172.21.15.8:0/361641828 --> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc2741a0f50 con 0x7fc258038cb0 2024-03-16T20:46:48.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.037+0000 7fc270c00700 1 -- 172.21.15.8:0/361641828 <== mgr.14120 v2:172.21.15.8:6800/1972090527 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc2741a0f50 con 0x7fc258038cb0 2024-03-16T20:46:48.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.040+0000 7fc27ae00700 1 -- 172.21.15.8:0/361641828 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fc258038cb0 msgr2=0x7fc25803b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:48.725 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.040+0000 7fc27ae00700 1 --2- 172.21.15.8:0/361641828 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fc258038cb0 0x7fc25803b170 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc260006fd0 tx=0x7fc260006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:48.725 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.040+0000 7fc27ae00700 1 -- 172.21.15.8:0/361641828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 msgr2=0x7fc27419da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:48.725 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.040+0000 7fc27ae00700 1 --2- 172.21.15.8:0/361641828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27419da30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc264011b40 tx=0x7fc264011c20 comp rx=0 tx=0).stop 2024-03-16T20:46:48.725 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.040+0000 7fc27ae00700 1 -- 172.21.15.8:0/361641828 shutdown_connections 2024-03-16T20:46:48.725 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.040+0000 7fc27ae00700 1 --2- 172.21.15.8:0/361641828 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7fc258038cb0 0x7fc25803b170 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:48.725 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.040+0000 7fc27ae00700 1 --2- 172.21.15.8:0/361641828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc27407dd70 0x7fc27419da30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:48.726 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.040+0000 7fc27ae00700 1 -- 172.21.15.8:0/361641828 >> 172.21.15.8:0/361641828 conn(0x7fc274103140 msgr2=0x7fc274103cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:48.726 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.041+0000 7fc27ae00700 1 -- 172.21.15.8:0/361641828 shutdown_connections 2024-03-16T20:46:48.726 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:48.041+0000 7fc27ae00700 1 -- 172.21.15.8:0/361641828 wait complete. 2024-03-16T20:46:49.575 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:49 smithi008 ceph-mon[31434]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:46:49.575 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:49 smithi008 ceph-mon[31434]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:46:49.575 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:49 smithi008 ceph-mon[31434]: Saving service mgr spec with placement count:2 2024-03-16T20:46:50.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:50 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/28379753' entity='client.admin' 2024-03-16T20:46:50.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:50 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:50.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.289+0000 7f5572a00700 1 Processor -- start 2024-03-16T20:46:50.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.290+0000 7f5572a00700 1 -- start start 2024-03-16T20:46:50.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.290+0000 7f5572a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c107e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:50.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.290+0000 7f5572a00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c108430 con 0x7f556c107a40 2024-03-16T20:46:50.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.290+0000 7f556be00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c107e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:50.864 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.291+0000 7f556be00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c107e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53830/0 (socket says 172.21.15.8:53830) 2024-03-16T20:46:50.865 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.291+0000 7f556be00700 1 -- 172.21.15.8:0/3433885171 learned_addr learned my addr 172.21.15.8:0/3433885171 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:50.865 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.291+0000 7f556be00700 1 -- 172.21.15.8:0/3433885171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c108ba0 con 0x7f556c107a40 2024-03-16T20:46:50.865 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.291+0000 7f556be00700 1 --2- 172.21.15.8:0/3433885171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c107e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f555c0098a0 tx=0x7f555c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471a525585bedcbf server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:50.865 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.292+0000 7f556aa00700 1 -- 172.21.15.8:0/3433885171 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f555c004160 con 0x7f556c107a40 2024-03-16T20:46:50.865 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.292+0000 7f556aa00700 1 -- 172.21.15.8:0/3433885171 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f555c0042c0 con 0x7f556c107a40 2024-03-16T20:46:50.865 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.292+0000 7f556aa00700 1 -- 172.21.15.8:0/3433885171 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f555c011b90 con 0x7f556c107a40 2024-03-16T20:46:50.865 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.292+0000 7f5572a00700 1 -- 172.21.15.8:0/3433885171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 msgr2=0x7f556c107e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:50.866 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.292+0000 7f5572a00700 1 --2- 172.21.15.8:0/3433885171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c107e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f555c0098a0 tx=0x7f555c009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:50.866 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.292+0000 7f5572a00700 1 -- 172.21.15.8:0/3433885171 shutdown_connections 2024-03-16T20:46:50.866 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.292+0000 7f5572a00700 1 --2- 172.21.15.8:0/3433885171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c107e60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:50.866 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.292+0000 7f5572a00700 1 -- 172.21.15.8:0/3433885171 >> 172.21.15.8:0/3433885171 conn(0x7f556c102fc0 msgr2=0x7f556c105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:50.866 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.293+0000 7f5572a00700 1 -- 172.21.15.8:0/3433885171 shutdown_connections 2024-03-16T20:46:50.866 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.293+0000 7f5572a00700 1 -- 172.21.15.8:0/3433885171 wait complete. 2024-03-16T20:46:50.867 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.294+0000 7f5572a00700 1 Processor -- start 2024-03-16T20:46:50.867 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.294+0000 7f5572a00700 1 -- start start 2024-03-16T20:46:50.867 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.294+0000 7f5572a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:50.867 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.294+0000 7f5572a00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c19bd60 con 0x7f556c107a40 2024-03-16T20:46:50.869 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.295+0000 7f556be00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:50.869 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.295+0000 7f556be00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53834/0 (socket says 172.21.15.8:53834) 2024-03-16T20:46:50.869 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.295+0000 7f556be00700 1 -- 172.21.15.8:0/28379753 learned_addr learned my addr 172.21.15.8:0/28379753 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:50.870 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.295+0000 7f556be00700 1 -- 172.21.15.8:0/28379753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c009550 con 0x7f556c107a40 2024-03-16T20:46:50.870 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.295+0000 7f556be00700 1 --2- 172.21.15.8:0/28379753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c19b820 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f555c000c00 tx=0x7f555c011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:50.870 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.295+0000 7f5568c00700 1 -- 172.21.15.8:0/28379753 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f555c003aa0 con 0x7f556c107a40 2024-03-16T20:46:50.870 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.296+0000 7f5568c00700 1 -- 172.21.15.8:0/28379753 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f555c003c00 con 0x7f556c107a40 2024-03-16T20:46:50.870 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.296+0000 7f5568c00700 1 -- 172.21.15.8:0/28379753 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f555c024890 con 0x7f556c107a40 2024-03-16T20:46:50.870 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.296+0000 7f5572a00700 1 -- 172.21.15.8:0/28379753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556c19bf60 con 0x7f556c107a40 2024-03-16T20:46:50.870 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.296+0000 7f5572a00700 1 -- 172.21.15.8:0/28379753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c19c400 con 0x7f556c107a40 2024-03-16T20:46:50.871 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.297+0000 7f5568c00700 1 -- 172.21.15.8:0/28379753 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45769+0+0 (secure 0 0 0) 0x7f555c01ac30 con 0x7f556c107a40 2024-03-16T20:46:50.871 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.297+0000 7f5562000700 1 -- 172.21.15.8:0/28379753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5544005330 con 0x7f556c107a40 2024-03-16T20:46:50.871 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.297+0000 7f5568c00700 1 --2- 172.21.15.8:0/28379753 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f5550038d60 0x7f555003b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:50.871 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.298+0000 7f5568c00700 1 -- 172.21.15.8:0/28379753 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f555c04ce10 con 0x7f556c107a40 2024-03-16T20:46:50.871 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.298+0000 7f556b400700 1 --2- 172.21.15.8:0/28379753 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f5550038d60 0x7f555003b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:50.871 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.298+0000 7f556b400700 1 --2- 172.21.15.8:0/28379753 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f5550038d60 0x7f555003b220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5558006fd0 tx=0x7f5558006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:50.872 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.303+0000 7f5568c00700 1 -- 172.21.15.8:0/28379753 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f555c0249f0 con 0x7f556c107a40 2024-03-16T20:46:50.872 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.570+0000 7f5562000700 1 -- 172.21.15.8:0/28379753 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f55440055e0 con 0x7f556c107a40 2024-03-16T20:46:50.872 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.575+0000 7f5568c00700 1 -- 172.21.15.8:0/28379753 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f555c02c350 con 0x7f556c107a40 2024-03-16T20:46:50.872 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.578+0000 7f5562000700 1 -- 172.21.15.8:0/28379753 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f5550038d60 msgr2=0x7f555003b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:50.872 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.578+0000 7f5562000700 1 --2- 172.21.15.8:0/28379753 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f5550038d60 0x7f555003b220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5558006fd0 tx=0x7f5558006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:50.872 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.578+0000 7f5562000700 1 -- 172.21.15.8:0/28379753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 msgr2=0x7f556c19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:50.873 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.578+0000 7f5562000700 1 --2- 172.21.15.8:0/28379753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c19b820 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f555c000c00 tx=0x7f555c011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:50.873 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.578+0000 7f5562000700 1 -- 172.21.15.8:0/28379753 shutdown_connections 2024-03-16T20:46:50.873 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.578+0000 7f5562000700 1 --2- 172.21.15.8:0/28379753 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f5550038d60 0x7f555003b220 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:50.873 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.578+0000 7f5562000700 1 --2- 172.21.15.8:0/28379753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f556c107a40 0x7f556c19b820 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:50.873 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.578+0000 7f5562000700 1 -- 172.21.15.8:0/28379753 >> 172.21.15.8:0/28379753 conn(0x7f556c102fc0 msgr2=0x7f556c103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:50.874 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.579+0000 7f5562000700 1 -- 172.21.15.8:0/28379753 shutdown_connections 2024-03-16T20:46:50.874 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:49.579+0000 7f5562000700 1 -- 172.21.15.8:0/28379753 wait complete. 2024-03-16T20:46:51.693 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:51 smithi008 ceph-mon[31434]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:46:52.360 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.435+0000 7ff229e00700 1 Processor -- start 2024-03-16T20:46:52.360 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.435+0000 7ff229e00700 1 -- start start 2024-03-16T20:46:52.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.436+0000 7ff229e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22410a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:52.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.436+0000 7ff229e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22407bde0 con 0x7ff224108560 2024-03-16T20:46:52.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.436+0000 7ff222a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22410a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:52.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.436+0000 7ff222a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22410a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53838/0 (socket says 172.21.15.8:53838) 2024-03-16T20:46:52.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.436+0000 7ff222a00700 1 -- 172.21.15.8:0/1967300430 learned_addr learned my addr 172.21.15.8:0/1967300430 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:52.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.437+0000 7ff222a00700 1 -- 172.21.15.8:0/1967300430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22407bf20 con 0x7ff224108560 2024-03-16T20:46:52.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.437+0000 7ff222a00700 1 --2- 172.21.15.8:0/1967300430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22410a950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2140098a0 tx=0x7ff214009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d1b1c35c952784 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:52.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.438+0000 7ff221600700 1 -- 172.21.15.8:0/1967300430 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff214004160 con 0x7ff224108560 2024-03-16T20:46:52.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.438+0000 7ff221600700 1 -- 172.21.15.8:0/1967300430 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff2140042c0 con 0x7ff224108560 2024-03-16T20:46:52.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.438+0000 7ff221600700 1 -- 172.21.15.8:0/1967300430 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff214011b90 con 0x7ff224108560 2024-03-16T20:46:52.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.439+0000 7ff229e00700 1 -- 172.21.15.8:0/1967300430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 msgr2=0x7ff22410a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:52.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.439+0000 7ff229e00700 1 --2- 172.21.15.8:0/1967300430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22410a950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2140098a0 tx=0x7ff214009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:52.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.439+0000 7ff229e00700 1 -- 172.21.15.8:0/1967300430 shutdown_connections 2024-03-16T20:46:52.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.439+0000 7ff229e00700 1 --2- 172.21.15.8:0/1967300430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22410a950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.439+0000 7ff229e00700 1 -- 172.21.15.8:0/1967300430 >> 172.21.15.8:0/1967300430 conn(0x7ff224101f10 msgr2=0x7ff224104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.439+0000 7ff229e00700 1 -- 172.21.15.8:0/1967300430 shutdown_connections 2024-03-16T20:46:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.439+0000 7ff229e00700 1 -- 172.21.15.8:0/1967300430 wait complete. 2024-03-16T20:46:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.440+0000 7ff229e00700 1 Processor -- start 2024-03-16T20:46:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.441+0000 7ff229e00700 1 -- start start 2024-03-16T20:46:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.441+0000 7ff229e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22419da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.441+0000 7ff229e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22419df70 con 0x7ff224108560 2024-03-16T20:46:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.441+0000 7ff222a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22419da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.441+0000 7ff222a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22419da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53852/0 (socket says 172.21.15.8:53852) 2024-03-16T20:46:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.441+0000 7ff222a00700 1 -- 172.21.15.8:0/996710551 learned_addr learned my addr 172.21.15.8:0/996710551 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.442+0000 7ff222a00700 1 -- 172.21.15.8:0/996710551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff214009550 con 0x7ff224108560 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.442+0000 7ff222a00700 1 --2- 172.21.15.8:0/996710551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22419da30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff214011b40 tx=0x7ff214011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.442+0000 7ff228a00700 1 -- 172.21.15.8:0/996710551 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff214003aa0 con 0x7ff224108560 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.442+0000 7ff229e00700 1 -- 172.21.15.8:0/996710551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22419e170 con 0x7ff224108560 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.442+0000 7ff228a00700 1 -- 172.21.15.8:0/996710551 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff214003c00 con 0x7ff224108560 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.442+0000 7ff228a00700 1 -- 172.21.15.8:0/996710551 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff214024840 con 0x7ff224108560 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.443+0000 7ff229e00700 1 -- 172.21.15.8:0/996710551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22419e610 con 0x7ff224108560 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.444+0000 7ff228a00700 1 -- 172.21.15.8:0/996710551 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45769+0+0 (secure 0 0 0) 0x7ff21401abc0 con 0x7ff224108560 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.444+0000 7ff229e00700 1 -- 172.21.15.8:0/996710551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22410bcc0 con 0x7ff224108560 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.444+0000 7ff228a00700 1 --2- 172.21.15.8:0/996710551 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff208038cb0 0x7ff20803b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.444+0000 7ff228a00700 1 -- 172.21.15.8:0/996710551 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff21404ce30 con 0x7ff224108560 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.445+0000 7ff222000700 1 --2- 172.21.15.8:0/996710551 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff208038cb0 0x7ff20803b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.445+0000 7ff222000700 1 --2- 172.21.15.8:0/996710551 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff208038cb0 0x7ff20803b170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff210006fd0 tx=0x7ff210006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.450+0000 7ff228a00700 1 -- 172.21.15.8:0/996710551 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff214024ab0 con 0x7ff224108560 2024-03-16T20:46:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.680+0000 7ff229e00700 1 -- 172.21.15.8:0/996710551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7ff2241a0f50 con 0x7ff224108560 2024-03-16T20:46:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.685+0000 7ff228a00700 1 -- 172.21.15.8:0/996710551 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7ff214018350 con 0x7ff224108560 2024-03-16T20:46:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.687+0000 7ff229e00700 1 -- 172.21.15.8:0/996710551 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff208038cb0 msgr2=0x7ff20803b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.687+0000 7ff229e00700 1 --2- 172.21.15.8:0/996710551 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff208038cb0 0x7ff20803b170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff210006fd0 tx=0x7ff210006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.687+0000 7ff229e00700 1 -- 172.21.15.8:0/996710551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 msgr2=0x7ff22419da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.687+0000 7ff229e00700 1 --2- 172.21.15.8:0/996710551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22419da30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff214011b40 tx=0x7ff214011c20 comp rx=0 tx=0).stop 2024-03-16T20:46:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.688+0000 7ff229e00700 1 -- 172.21.15.8:0/996710551 shutdown_connections 2024-03-16T20:46:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.688+0000 7ff229e00700 1 --2- 172.21.15.8:0/996710551 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff208038cb0 0x7ff20803b170 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.688+0000 7ff229e00700 1 --2- 172.21.15.8:0/996710551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff224108560 0x7ff22419da30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:52.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.688+0000 7ff229e00700 1 -- 172.21.15.8:0/996710551 >> 172.21.15.8:0/996710551 conn(0x7ff224101f10 msgr2=0x7ff224102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:52.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.688+0000 7ff229e00700 1 -- 172.21.15.8:0/996710551 shutdown_connections 2024-03-16T20:46:52.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:51.689+0000 7ff229e00700 1 -- 172.21.15.8:0/996710551 wait complete. 2024-03-16T20:46:52.370 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling the dashboard module... 2024-03-16T20:46:52.978 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:52 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/996710551' entity='client.admin' 2024-03-16T20:46:52.978 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:52 smithi008 ceph-mon[31434]: from='mgr.14120 172.21.15.8:0/2879762992' entity='mgr.x' 2024-03-16T20:46:53.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:53 smithi008 ceph-mon[31434]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:46:53.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:53 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2208787214' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-16T20:46:53.994 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:53 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: ignoring --setuser ceph since I am not root 2024-03-16T20:46:53.994 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:53 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: ignoring --setgroup ceph since I am not root 2024-03-16T20:46:54.652 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:54 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:54.538+0000 7f2b08dae200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T20:46:54.669 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.973+0000 7f8e7b800700 1 Processor -- start 2024-03-16T20:46:54.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.973+0000 7f8e7b800700 1 -- start start 2024-03-16T20:46:54.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.974+0000 7f8e7b800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7407bce0 0x7f8e7410a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:54.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.974+0000 7f8e7b800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7410ab60 con 0x7f8e7407bce0 2024-03-16T20:46:54.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.974+0000 7f8e78e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7407bce0 0x7f8e7410a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:54.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.974+0000 7f8e78e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7407bce0 0x7f8e7410a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53862/0 (socket says 172.21.15.8:53862) 2024-03-16T20:46:54.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.974+0000 7f8e78e00700 1 -- 172.21.15.8:0/1284219194 learned_addr learned my addr 172.21.15.8:0/1284219194 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:54.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.975+0000 7f8e78e00700 1 -- 172.21.15.8:0/1284219194 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7410aca0 con 0x7f8e7407bce0 2024-03-16T20:46:54.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.975+0000 7f8e78e00700 1 --2- 172.21.15.8:0/1284219194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7407bce0 0x7f8e7410a590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e680098a0 tx=0x7f8e68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7480ab4b04daa46d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:54.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.975+0000 7f8e73400700 1 -- 172.21.15.8:0/1284219194 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e68004160 con 0x7f8e7407bce0 2024-03-16T20:46:54.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.975+0000 7f8e73400700 1 -- 172.21.15.8:0/1284219194 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8e680042c0 con 0x7f8e7407bce0 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.975+0000 7f8e73400700 1 -- 172.21.15.8:0/1284219194 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e68011b90 con 0x7f8e7407bce0 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.976+0000 7f8e7b800700 1 -- 172.21.15.8:0/1284219194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7407bce0 msgr2=0x7f8e7410a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.976+0000 7f8e7b800700 1 --2- 172.21.15.8:0/1284219194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7407bce0 0x7f8e7410a590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e680098a0 tx=0x7f8e68009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.976+0000 7f8e7b800700 1 -- 172.21.15.8:0/1284219194 shutdown_connections 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.976+0000 7f8e7b800700 1 --2- 172.21.15.8:0/1284219194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7407bce0 0x7f8e7410a590 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.976+0000 7f8e7b800700 1 -- 172.21.15.8:0/1284219194 >> 172.21.15.8:0/1284219194 conn(0x7f8e74101ef0 msgr2=0x7f8e74104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.976+0000 7f8e7b800700 1 -- 172.21.15.8:0/1284219194 shutdown_connections 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.977+0000 7f8e7b800700 1 -- 172.21.15.8:0/1284219194 wait complete. 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.978+0000 7f8e7b800700 1 Processor -- start 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.978+0000 7f8e7b800700 1 -- start start 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.978+0000 7f8e7b800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7419dcc0 0x7f8e7419e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:54.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.978+0000 7f8e7b800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7419e620 con 0x7f8e7419dcc0 2024-03-16T20:46:54.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.978+0000 7f8e78e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7419dcc0 0x7f8e7419e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:54.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.979+0000 7f8e78e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7419dcc0 0x7f8e7419e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53876/0 (socket says 172.21.15.8:53876) 2024-03-16T20:46:54.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.979+0000 7f8e78e00700 1 -- 172.21.15.8:0/2208787214 learned_addr learned my addr 172.21.15.8:0/2208787214 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:54.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.979+0000 7f8e78e00700 1 -- 172.21.15.8:0/2208787214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e68009550 con 0x7f8e7419dcc0 2024-03-16T20:46:54.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.979+0000 7f8e78e00700 1 --2- 172.21.15.8:0/2208787214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7419dcc0 0x7f8e7419e0e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e68000c00 tx=0x7f8e68013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:54.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.980+0000 7f8e71600700 1 -- 172.21.15.8:0/2208787214 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e680037d0 con 0x7f8e7419dcc0 2024-03-16T20:46:54.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.980+0000 7f8e71600700 1 -- 172.21.15.8:0/2208787214 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8e6801f070 con 0x7f8e7419dcc0 2024-03-16T20:46:54.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.980+0000 7f8e71600700 1 -- 172.21.15.8:0/2208787214 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e6801ae60 con 0x7f8e7419dcc0 2024-03-16T20:46:54.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.980+0000 7f8e7b800700 1 -- 172.21.15.8:0/2208787214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7419e820 con 0x7f8e7419dcc0 2024-03-16T20:46:54.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.980+0000 7f8e7b800700 1 -- 172.21.15.8:0/2208787214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e741a1380 con 0x7f8e7419dcc0 2024-03-16T20:46:54.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.981+0000 7f8e7b800700 1 -- 172.21.15.8:0/2208787214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e54005360 con 0x7f8e7419dcc0 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.981+0000 7f8e71600700 1 -- 172.21.15.8:0/2208787214 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45769+0+0 (secure 0 0 0) 0x7f8e68003930 con 0x7f8e7419dcc0 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.982+0000 7f8e71600700 1 --2- 172.21.15.8:0/2208787214 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f8e5c038cb0 0x7f8e5c03b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.982+0000 7f8e71600700 1 -- 172.21.15.8:0/2208787214 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8e68021070 con 0x7f8e7419dcc0 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.982+0000 7f8e73e00700 1 --2- 172.21.15.8:0/2208787214 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f8e5c038cb0 0x7f8e5c03b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.983+0000 7f8e73e00700 1 --2- 172.21.15.8:0/2208787214 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f8e5c038cb0 0x7f8e5c03b170 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e60006fd0 tx=0x7f8e60006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:52.987+0000 7f8e71600700 1 -- 172.21.15.8:0/2208787214 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8e6800bc30 con 0x7f8e7419dcc0 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.295+0000 7f8e7b800700 1 -- 172.21.15.8:0/2208787214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f8e54005610 con 0x7f8e7419dcc0 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.689+0000 7f8e71600700 1 -- 172.21.15.8:0/2208787214 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f8e6800bc30 con 0x7f8e7419dcc0 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.691+0000 7f8e71600700 1 -- 172.21.15.8:0/2208787214 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mgrmap(e 9) v1 ==== 45782+0+0 (secure 0 0 0) 0x7f8e6801b9a0 con 0x7f8e7419dcc0 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.694+0000 7f8e7b800700 1 -- 172.21.15.8:0/2208787214 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f8e5c038cb0 msgr2=0x7f8e5c03b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.694+0000 7f8e7b800700 1 --2- 172.21.15.8:0/2208787214 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f8e5c038cb0 0x7f8e5c03b170 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e60006fd0 tx=0x7f8e60006e40 comp rx=0 tx=0).stop 2024-03-16T20:46:54.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.694+0000 7f8e7b800700 1 -- 172.21.15.8:0/2208787214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7419dcc0 msgr2=0x7f8e7419e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:54.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.694+0000 7f8e7b800700 1 --2- 172.21.15.8:0/2208787214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7419dcc0 0x7f8e7419e0e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e68000c00 tx=0x7f8e68013000 comp rx=0 tx=0).stop 2024-03-16T20:46:54.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.694+0000 7f8e7b800700 1 -- 172.21.15.8:0/2208787214 shutdown_connections 2024-03-16T20:46:54.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.694+0000 7f8e7b800700 1 --2- 172.21.15.8:0/2208787214 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f8e5c038cb0 0x7f8e5c03b170 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:54.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.694+0000 7f8e7b800700 1 --2- 172.21.15.8:0/2208787214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e7419dcc0 0x7f8e7419e0e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:54.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.694+0000 7f8e7b800700 1 -- 172.21.15.8:0/2208787214 >> 172.21.15.8:0/2208787214 conn(0x7f8e74101ef0 msgr2=0x7f8e74102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:54.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.694+0000 7f8e7b800700 1 -- 172.21.15.8:0/2208787214 shutdown_connections 2024-03-16T20:46:54.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:53.694+0000 7f8e7b800700 1 -- 172.21.15.8:0/2208787214 wait complete. 2024-03-16T20:46:54.924 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:54 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:54.665+0000 7f2b08dae200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T20:46:54.925 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:54 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2208787214' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-16T20:46:54.925 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:54 smithi008 ceph-mon[31434]: mgrmap e9: x(active, since 25s) 2024-03-16T20:46:55.542 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:55 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:55.492+0000 7f2b08dae200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T20:46:55.811 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:55 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:55.621+0000 7f2b08dae200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T20:46:56.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:46:56 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2783371987' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-16T20:46:56.243 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:55 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:55.806+0000 7f2b08dae200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T20:46:56.243 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:55 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:55.936+0000 7f2b08dae200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T20:46:56.243 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:56 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:56.056+0000 7f2b08dae200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T20:46:56.628 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:56 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:56.403+0000 7f2b08dae200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T20:46:56.628 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:56 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:56.551+0000 7f2b08dae200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T20:46:56.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2024-03-16T20:46:56.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-16T20:46:56.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-16T20:46:56.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-16T20:46:56.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-16T20:46:56.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2024-03-16T20:46:56.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.685+0000 7ff6d0e00700 1 Processor -- start 2024-03-16T20:46:56.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.685+0000 7ff6d0e00700 1 -- start start 2024-03-16T20:46:56.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.686+0000 7ff6d0e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc10a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.686+0000 7ff6d0e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc07bea0 con 0x7ff6cc108490 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.686+0000 7ff6c9e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc10a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.687+0000 7ff6c9e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc10a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53886/0 (socket says 172.21.15.8:53886) 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.687+0000 7ff6c9e00700 1 -- 172.21.15.8:0/794073364 learned_addr learned my addr 172.21.15.8:0/794073364 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.687+0000 7ff6c9e00700 1 -- 172.21.15.8:0/794073364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc10adc0 con 0x7ff6cc108490 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.687+0000 7ff6c9e00700 1 --2- 172.21.15.8:0/794073364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc10a880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0098a0 tx=0x7ff6bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabba3065ead364b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.688+0000 7ff6c8a00700 1 -- 172.21.15.8:0/794073364 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc004160 con 0x7ff6cc108490 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.688+0000 7ff6c8a00700 1 -- 172.21.15.8:0/794073364 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff6bc0042c0 con 0x7ff6cc108490 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.688+0000 7ff6c8a00700 1 -- 172.21.15.8:0/794073364 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc011b90 con 0x7ff6cc108490 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.688+0000 7ff6d0e00700 1 -- 172.21.15.8:0/794073364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 msgr2=0x7ff6cc10a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.688+0000 7ff6d0e00700 1 --2- 172.21.15.8:0/794073364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc10a880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0098a0 tx=0x7ff6bc009bb0 comp rx=0 tx=0).stop 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.688+0000 7ff6d0e00700 1 -- 172.21.15.8:0/794073364 shutdown_connections 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.688+0000 7ff6d0e00700 1 --2- 172.21.15.8:0/794073364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc10a880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:56.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.688+0000 7ff6d0e00700 1 -- 172.21.15.8:0/794073364 >> 172.21.15.8:0/794073364 conn(0x7ff6cc101f00 msgr2=0x7ff6cc104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.689+0000 7ff6d0e00700 1 -- 172.21.15.8:0/794073364 shutdown_connections 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.689+0000 7ff6d0e00700 1 -- 172.21.15.8:0/794073364 wait complete. 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.690+0000 7ff6d0e00700 1 Processor -- start 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.690+0000 7ff6d0e00700 1 -- start start 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.690+0000 7ff6d0e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc107d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.690+0000 7ff6d0e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc108250 con 0x7ff6cc108490 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.690+0000 7ff6c9e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc107d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.690+0000 7ff6c9e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc107d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53888/0 (socket says 172.21.15.8:53888) 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.690+0000 7ff6c9e00700 1 -- 172.21.15.8:0/2783371987 learned_addr learned my addr 172.21.15.8:0/2783371987 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.691+0000 7ff6c9e00700 1 -- 172.21.15.8:0/2783371987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc009550 con 0x7ff6cc108490 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.691+0000 7ff6c9e00700 1 --2- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc107d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc011670 tx=0x7ff6bc011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.691+0000 7ff6c2a00700 1 -- 172.21.15.8:0/2783371987 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc0039c0 con 0x7ff6cc108490 2024-03-16T20:46:56.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.691+0000 7ff6c2a00700 1 -- 172.21.15.8:0/2783371987 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff6bc003b20 con 0x7ff6cc108490 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.691+0000 7ff6d0e00700 1 -- 172.21.15.8:0/2783371987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc106440 con 0x7ff6cc108490 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.691+0000 7ff6c2a00700 1 -- 172.21.15.8:0/2783371987 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc01a690 con 0x7ff6cc108490 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.691+0000 7ff6d0e00700 1 -- 172.21.15.8:0/2783371987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc1068e0 con 0x7ff6cc108490 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.693+0000 7ff6c2a00700 1 -- 172.21.15.8:0/2783371987 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 9) v1 ==== 45782+0+0 (secure 0 0 0) 0x7ff6bc024430 con 0x7ff6cc108490 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.693+0000 7ff6d0e00700 1 -- 172.21.15.8:0/2783371987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc10bcc0 con 0x7ff6cc108490 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.693+0000 7ff6c2a00700 1 --2- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff6b0038cb0 0x7ff6b003b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.693+0000 7ff6c2a00700 1 -- 172.21.15.8:0/2783371987 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff6bc04ced0 con 0x7ff6cc108490 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.693+0000 7ff6c9400700 1 -- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff6b0038cb0 msgr2=0x7ff6b003b170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1972090527 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.693+0000 7ff6c9400700 1 --2- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff6b0038cb0 0x7ff6b003b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.699+0000 7ff6c2a00700 1 -- 172.21.15.8:0/2783371987 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff6bc018a40 con 0x7ff6cc108490 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.894+0000 7ff6c9400700 1 -- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff6b0038cb0 msgr2=0x7ff6b003b170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1972090527 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.894+0000 7ff6c9400700 1 --2- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff6b0038cb0 0x7ff6b003b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T20:46:56.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.983+0000 7ff6d0e00700 1 -- 172.21.15.8:0/2783371987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff6cc106ee0 con 0x7ff6cc108490 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.984+0000 7ff6c2a00700 1 -- 172.21.15.8:0/2783371987 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7ff6bc018350 con 0x7ff6cc108490 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.987+0000 7ff6d0e00700 1 -- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff6b0038cb0 msgr2=0x7ff6b003b170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.987+0000 7ff6d0e00700 1 --2- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff6b0038cb0 0x7ff6b003b170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.987+0000 7ff6d0e00700 1 -- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 msgr2=0x7ff6cc107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.987+0000 7ff6d0e00700 1 --2- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc107d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc011670 tx=0x7ff6bc011bf0 comp rx=0 tx=0).stop 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.987+0000 7ff6d0e00700 1 -- 172.21.15.8:0/2783371987 shutdown_connections 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.987+0000 7ff6d0e00700 1 --2- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7ff6b0038cb0 0x7ff6b003b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.987+0000 7ff6d0e00700 1 --2- 172.21.15.8:0/2783371987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6cc108490 0x7ff6cc107d10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.987+0000 7ff6d0e00700 1 -- 172.21.15.8:0/2783371987 >> 172.21.15.8:0/2783371987 conn(0x7ff6cc101f00 msgr2=0x7ff6cc1029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.988+0000 7ff6d0e00700 1 -- 172.21.15.8:0/2783371987 shutdown_connections 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:55.988+0000 7ff6d0e00700 1 -- 172.21.15.8:0/2783371987 wait complete. 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for the mgr to restart... 2024-03-16T20:46:56.646 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr epoch 9... 2024-03-16T20:46:56.928 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:56 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:56.671+0000 7f2b08dae200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T20:46:56.928 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:56 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:56.802+0000 7f2b08dae200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T20:46:57.180 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:57 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:57.033+0000 7f2b08dae200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T20:46:58.552 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:58 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:58.365+0000 7f2b08dae200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T20:46:58.552 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:58 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:58.547+0000 7f2b08dae200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T20:46:59.243 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:58 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:58.989+0000 7f2b08dae200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T20:46:59.243 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:59 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:59.114+0000 7f2b08dae200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T20:46:59.649 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:59 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:59.388+0000 7f2b08dae200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:46:59.993 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:46:59 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:46:59.644+0000 7f2b08dae200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T20:47:00.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:47:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:47:00.038+0000 7f2b08dae200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:47:00.714 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:47:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:47:00.391+0000 7f2b08dae200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T20:47:00.714 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:47:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:47:00.709+0000 7f2b08dae200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T20:47:02.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:47:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:47:01.780+0000 7f2b08dae200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T20:47:02.936 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:47:02.500+0000 7f2b08dae200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T20:47:02.936 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:47:02.634+0000 7f2b08dae200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T20:47:03.243 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:47:02.931+0000 7f2b08dae200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T20:47:03.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-mon[31434]: Active manager daemon x restarted 2024-03-16T20:47:03.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-mon[31434]: Activating manager daemon x 2024-03-16T20:47:03.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-mon[31434]: osdmap e3: 0 total, 0 up, 0 in 2024-03-16T20:47:03.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-mon[31434]: mgrmap e10: x(active, starting, since 0.00495022s) 2024-03-16T20:47:03.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:47:03.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-16T20:47:03.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-16T20:47:03.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-16T20:47:03.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-16T20:47:03.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:02 smithi008 ceph-mon[31434]: Manager daemon x is now available 2024-03-16T20:47:04.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:47:04.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:47:04.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-16T20:47:04.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-16T20:47:04.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:03 smithi008 ceph-mon[31434]: mgrmap e11: x(active, since 1.00956s) 2024-03-16T20:47:04.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2024-03-16T20:47:04.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-16T20:47:04.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-16T20:47:04.781 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2024-03-16T20:47:04.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.246+0000 7f211e000700 1 Processor -- start 2024-03-16T20:47:04.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.246+0000 7f211e000700 1 -- start start 2024-03-16T20:47:04.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.246+0000 7f211e000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f2118107e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:04.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.246+0000 7f211e000700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2118108430 con 0x7f2118107a40 2024-03-16T20:47:04.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.247+0000 7f2117400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f2118107e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:04.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.247+0000 7f2117400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f2118107e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53902/0 (socket says 172.21.15.8:53902) 2024-03-16T20:47:04.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.247+0000 7f2117400700 1 -- 172.21.15.8:0/1597648038 learned_addr learned my addr 172.21.15.8:0/1597648038 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:04.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.247+0000 7f2117400700 1 -- 172.21.15.8:0/1597648038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118108ba0 con 0x7f2118107a40 2024-03-16T20:47:04.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.247+0000 7f2117400700 1 --2- 172.21.15.8:0/1597648038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f2118107e60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21080098a0 tx=0x7f2108009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6572081aad461bf server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:04.788 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.248+0000 7f2116000700 1 -- 172.21.15.8:0/1597648038 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2108004160 con 0x7f2118107a40 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.248+0000 7f2116000700 1 -- 172.21.15.8:0/1597648038 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f21080042c0 con 0x7f2118107a40 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.248+0000 7f2116000700 1 -- 172.21.15.8:0/1597648038 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2108011b90 con 0x7f2118107a40 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.248+0000 7f211e000700 1 -- 172.21.15.8:0/1597648038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 msgr2=0x7f2118107e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.248+0000 7f211e000700 1 --2- 172.21.15.8:0/1597648038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f2118107e60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21080098a0 tx=0x7f2108009bb0 comp rx=0 tx=0).stop 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.248+0000 7f211e000700 1 -- 172.21.15.8:0/1597648038 shutdown_connections 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.248+0000 7f211e000700 1 --2- 172.21.15.8:0/1597648038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f2118107e60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.248+0000 7f211e000700 1 -- 172.21.15.8:0/1597648038 >> 172.21.15.8:0/1597648038 conn(0x7f2118102fc0 msgr2=0x7f2118105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.249+0000 7f211e000700 1 -- 172.21.15.8:0/1597648038 shutdown_connections 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.249+0000 7f211e000700 1 -- 172.21.15.8:0/1597648038 wait complete. 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.250+0000 7f211e000700 1 Processor -- start 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.250+0000 7f211e000700 1 -- start start 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.250+0000 7f211e000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f211819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.250+0000 7f211e000700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211819df60 con 0x7f2118107a40 2024-03-16T20:47:04.789 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.250+0000 7f2117400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f211819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.250+0000 7f2117400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f211819da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53916/0 (socket says 172.21.15.8:53916) 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.250+0000 7f2117400700 1 -- 172.21.15.8:0/1994535956 learned_addr learned my addr 172.21.15.8:0/1994535956 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.251+0000 7f2117400700 1 -- 172.21.15.8:0/1994535956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108009550 con 0x7f2118107a40 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.251+0000 7f2117400700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f211819da20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2108000c00 tx=0x7f2108011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.251+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2108003aa0 con 0x7f2118107a40 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.251+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2108003c00 con 0x7f2118107a40 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.251+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2108024890 con 0x7f2118107a40 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.251+0000 7f211e000700 1 -- 172.21.15.8:0/1994535956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211819e160 con 0x7f2118107a40 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.252+0000 7f211e000700 1 -- 172.21.15.8:0/1994535956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211819e600 con 0x7f2118107a40 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.253+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 9) v1 ==== 45782+0+0 (secure 0 0 0) 0x7f210801ac30 con 0x7f2118107a40 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.253+0000 7f210fe00700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 0x7f20fc03b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.253+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 --> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20fc03b930 con 0x7f20fc038d60 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.253+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f210804cdb0 con 0x7f2118107a40 2024-03-16T20:47:04.790 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.253+0000 7f2116a00700 1 -- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 msgr2=0x7f20fc03b220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1972090527 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.253+0000 7f2116a00700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 0x7f20fc03b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.454+0000 7f2116a00700 1 -- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 msgr2=0x7f20fc03b220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1972090527 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.454+0000 7f2116a00700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 0x7f20fc03b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.855+0000 7f2116a00700 1 -- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 msgr2=0x7f20fc03b220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1972090527 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:57.855+0000 7f2116a00700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 0x7f20fc03b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:58.656+0000 7f2116a00700 1 -- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 msgr2=0x7f20fc03b220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1972090527 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:46:58.656+0000 7f2116a00700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 0x7f20fc03b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:00.258+0000 7f2116a00700 1 -- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 msgr2=0x7f20fc03b220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1972090527 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:00.258+0000 7f2116a00700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 0x7f20fc03b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:02.939+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mgrmap(e 10) v1 ==== 45549+0+0 (secure 0 0 0) 0x7f210801a950 con 0x7f2118107a40 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:02.939+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 msgr2=0x7f20fc03b220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:02.939+0000 7f210fe00700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 0x7f20fc03b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.942+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 11) v1 ==== 45676+0+0 (secure 0 0 0) 0x7f210804e820 con 0x7f2118107a40 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.942+0000 7f210fe00700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f20fc03c810 0x7f20fc03ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:04.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.942+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20fc03b930 con 0x7f20fc03c810 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.943+0000 7f2116a00700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f20fc03c810 0x7f20fc03ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.944+0000 7f2116a00700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f20fc03c810 0x7f20fc03ec00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2104003a10 tx=0x7f2104009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.945+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f20fc03b930 con 0x7f20fc03c810 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.954+0000 7f211e000700 1 -- 172.21.15.8:0/1994535956 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f211810bda0 con 0x7f20fc03c810 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.954+0000 7f210fe00700 1 -- 172.21.15.8:0/1994535956 <== mgr.14152 v2:172.21.15.8:6800/1064583862 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f211810bda0 con 0x7f20fc03c810 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.955+0000 7f211e000700 1 -- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f20fc03c810 msgr2=0x7f20fc03ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.955+0000 7f211e000700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f20fc03c810 0x7f20fc03ec00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2104003a10 tx=0x7f2104009270 comp rx=0 tx=0).stop 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.955+0000 7f211e000700 1 -- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 msgr2=0x7f211819da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.955+0000 7f211e000700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f211819da20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2108000c00 tx=0x7f2108011bf0 comp rx=0 tx=0).stop 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.955+0000 7f211e000700 1 -- 172.21.15.8:0/1994535956 shutdown_connections 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.955+0000 7f211e000700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f20fc03c810 0x7f20fc03ec00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.955+0000 7f211e000700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2118107a40 0x7f211819da20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.955+0000 7f211e000700 1 --2- 172.21.15.8:0/1994535956 >> [v2:172.21.15.8:6800/1972090527,v1:172.21.15.8:6801/1972090527] conn(0x7f20fc038d60 0x7f20fc03b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.955+0000 7f211e000700 1 -- 172.21.15.8:0/1994535956 >> 172.21.15.8:0/1994535956 conn(0x7f2118102fc0 msgr2=0x7f2118103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.955+0000 7f211e000700 1 -- 172.21.15.8:0/1994535956 shutdown_connections 2024-03-16T20:47:04.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:03.955+0000 7f211e000700 1 -- 172.21.15.8:0/1994535956 wait complete. 2024-03-16T20:47:04.793 INFO:teuthology.orchestra.run.smithi008.stdout:mgr epoch 9 is available 2024-03-16T20:47:04.793 INFO:teuthology.orchestra.run.smithi008.stdout:Generating a dashboard self-signed certificate... 2024-03-16T20:47:05.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:04 smithi008 ceph-mon[31434]: [16/Mar/2024:20:47:03] ENGINE Bus STARTING 2024-03-16T20:47:05.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:04 smithi008 ceph-mon[31434]: [16/Mar/2024:20:47:04] ENGINE Serving on http://172.21.15.8:8765 2024-03-16T20:47:05.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:04 smithi008 ceph-mon[31434]: [16/Mar/2024:20:47:04] ENGINE Serving on https://172.21.15.8:7150 2024-03-16T20:47:05.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:04 smithi008 ceph-mon[31434]: [16/Mar/2024:20:47:04] ENGINE Bus STARTED 2024-03-16T20:47:06.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:05 smithi008 ceph-mon[31434]: mgrmap e12: x(active, since 2s) 2024-03-16T20:47:06.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:05 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:07.067 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-16T20:47:07.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.011+0000 7f6ad9600700 1 Processor -- start 2024-03-16T20:47:07.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.011+0000 7f6ad9600700 1 -- start start 2024-03-16T20:47:07.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.012+0000 7f6ad9600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad4108650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:07.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.012+0000 7f6ad9600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad407bea0 con 0x7f6ad4106220 2024-03-16T20:47:07.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.012+0000 7f6ad2a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad4108650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:07.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.012+0000 7f6ad2a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad4108650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36242/0 (socket says 172.21.15.8:36242) 2024-03-16T20:47:07.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.012+0000 7f6ad2a00700 1 -- 172.21.15.8:0/3667978569 learned_addr learned my addr 172.21.15.8:0/3667978569 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:07.069 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.013+0000 7f6ad2a00700 1 -- 172.21.15.8:0/3667978569 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad4108b90 con 0x7f6ad4106220 2024-03-16T20:47:07.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.013+0000 7f6ad2a00700 1 --2- 172.21.15.8:0/3667978569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad4108650 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40098a0 tx=0x7f6ac4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7eaa4443c1b6f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:07.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.013+0000 7f6ad1600700 1 -- 172.21.15.8:0/3667978569 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4004160 con 0x7f6ad4106220 2024-03-16T20:47:07.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.014+0000 7f6ad1600700 1 -- 172.21.15.8:0/3667978569 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6ac40042c0 con 0x7f6ad4106220 2024-03-16T20:47:07.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.014+0000 7f6ad1600700 1 -- 172.21.15.8:0/3667978569 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4011b90 con 0x7f6ad4106220 2024-03-16T20:47:07.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.014+0000 7f6ad9600700 1 -- 172.21.15.8:0/3667978569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 msgr2=0x7f6ad4108650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:07.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.014+0000 7f6ad9600700 1 --2- 172.21.15.8:0/3667978569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad4108650 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40098a0 tx=0x7f6ac4009bb0 comp rx=0 tx=0).stop 2024-03-16T20:47:07.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.014+0000 7f6ad9600700 1 -- 172.21.15.8:0/3667978569 shutdown_connections 2024-03-16T20:47:07.071 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.014+0000 7f6ad9600700 1 --2- 172.21.15.8:0/3667978569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad4108650 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:07.076 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.014+0000 7f6ad9600700 1 -- 172.21.15.8:0/3667978569 >> 172.21.15.8:0/3667978569 conn(0x7f6ad4101ec0 msgr2=0x7f6ad41042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.014+0000 7f6ad9600700 1 -- 172.21.15.8:0/3667978569 shutdown_connections 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.015+0000 7f6ad9600700 1 -- 172.21.15.8:0/3667978569 wait complete. 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.016+0000 7f6ad9600700 1 Processor -- start 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.016+0000 7f6ad9600700 1 -- start start 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.016+0000 7f6ad9600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad41a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.016+0000 7f6ad9600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad41a2350 con 0x7f6ad4106220 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.016+0000 7f6ad2a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad41a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.017+0000 7f6ad2a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad41a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36244/0 (socket says 172.21.15.8:36244) 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.017+0000 7f6ad2a00700 1 -- 172.21.15.8:0/262129096 learned_addr learned my addr 172.21.15.8:0/262129096 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.017+0000 7f6ad2a00700 1 -- 172.21.15.8:0/262129096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4009550 con 0x7f6ad4106220 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.017+0000 7f6ad2a00700 1 --2- 172.21.15.8:0/262129096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad41a1e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4011b40 tx=0x7f6ac4011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.017+0000 7f6acb400700 1 -- 172.21.15.8:0/262129096 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4003aa0 con 0x7f6ad4106220 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.018+0000 7f6acb400700 1 -- 172.21.15.8:0/262129096 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6ac4003c00 con 0x7f6ad4106220 2024-03-16T20:47:07.077 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.018+0000 7f6ad9600700 1 -- 172.21.15.8:0/262129096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad41a2550 con 0x7f6ad4106220 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.018+0000 7f6acb400700 1 -- 172.21.15.8:0/262129096 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4024840 con 0x7f6ad4106220 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.018+0000 7f6ad9600700 1 -- 172.21.15.8:0/262129096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad41a29f0 con 0x7f6ad4106220 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.019+0000 7f6acb400700 1 -- 172.21.15.8:0/262129096 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45782+0+0 (secure 0 0 0) 0x7f6ac40249a0 con 0x7f6ad4106220 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.019+0000 7f6ad9600700 1 -- 172.21.15.8:0/262129096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad419b500 con 0x7f6ad4106220 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.019+0000 7f6acb400700 1 --2- 172.21.15.8:0/262129096 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ab8038d60 0x7f6ab803b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.019+0000 7f6acb400700 1 -- 172.21.15.8:0/262129096 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6ac404cff0 con 0x7f6ad4106220 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.020+0000 7f6ad2000700 1 --2- 172.21.15.8:0/262129096 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ab8038d60 0x7f6ab803b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.020+0000 7f6ad2000700 1 --2- 172.21.15.8:0/262129096 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ab8038d60 0x7f6ab803b220 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0006fd0 tx=0x7f6ac0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.025+0000 7f6acb400700 1 -- 172.21.15.8:0/262129096 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6ac4018a40 con 0x7f6ad4106220 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.262+0000 7f6ad9600700 1 -- 172.21.15.8:0/262129096 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ad402db10 con 0x7f6ab8038d60 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.338+0000 7f6acb400700 1 -- 172.21.15.8:0/262129096 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f6ad402db10 con 0x7f6ab8038d60 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.342+0000 7f6ad9600700 1 -- 172.21.15.8:0/262129096 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ab8038d60 msgr2=0x7f6ab803b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.342+0000 7f6ad9600700 1 --2- 172.21.15.8:0/262129096 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ab8038d60 0x7f6ab803b220 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0006fd0 tx=0x7f6ac0006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:07.078 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.343+0000 7f6ad9600700 1 -- 172.21.15.8:0/262129096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 msgr2=0x7f6ad41a1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:07.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.343+0000 7f6ad9600700 1 --2- 172.21.15.8:0/262129096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad41a1e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4011b40 tx=0x7f6ac4011c20 comp rx=0 tx=0).stop 2024-03-16T20:47:07.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.343+0000 7f6ad9600700 1 -- 172.21.15.8:0/262129096 shutdown_connections 2024-03-16T20:47:07.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.343+0000 7f6ad9600700 1 --2- 172.21.15.8:0/262129096 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ab8038d60 0x7f6ab803b220 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:07.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.343+0000 7f6ad9600700 1 --2- 172.21.15.8:0/262129096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad4106220 0x7f6ad41a1e10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:07.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.343+0000 7f6ad9600700 1 -- 172.21.15.8:0/262129096 >> 172.21.15.8:0/262129096 conn(0x7f6ad4101ec0 msgr2=0x7f6ad41042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:07.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.343+0000 7f6ad9600700 1 -- 172.21.15.8:0/262129096 shutdown_connections 2024-03-16T20:47:07.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:06.343+0000 7f6ad9600700 1 -- 172.21.15.8:0/262129096 wait complete. 2024-03-16T20:47:07.079 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial admin user... 2024-03-16T20:47:07.607 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:07 smithi008 ceph-mon[31434]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:47:07.607 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:07.608 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:08.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:08 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:08.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:08 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:08.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$r6g81b7uYF1tEDLtdxG3Z.TkpyQ52XdxIEaLenmcOpxmngz8IZxtC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1710622028, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-16T20:47:08.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.685+0000 7f17bfe00700 1 Processor -- start 2024-03-16T20:47:08.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.685+0000 7f17bfe00700 1 -- start start 2024-03-16T20:47:08.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.685+0000 7f17bfe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b8107e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:08.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.685+0000 7f17bfe00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8108420 con 0x7f17b8107a30 2024-03-16T20:47:08.920 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.686+0000 7f17bd400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b8107e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:08.921 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.686+0000 7f17bd400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b8107e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36258/0 (socket says 172.21.15.8:36258) 2024-03-16T20:47:08.921 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.686+0000 7f17bd400700 1 -- 172.21.15.8:0/55028351 learned_addr learned my addr 172.21.15.8:0/55028351 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:08.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.686+0000 7f17bd400700 1 -- 172.21.15.8:0/55028351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8108be0 con 0x7f17b8107a30 2024-03-16T20:47:08.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.687+0000 7f17bd400700 1 --2- 172.21.15.8:0/55028351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b8107e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0098a0 tx=0x7f17ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80033854a6eff05 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:08.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.687+0000 7f17b7e00700 1 -- 172.21.15.8:0/55028351 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17ac004160 con 0x7f17b8107a30 2024-03-16T20:47:08.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.687+0000 7f17b7e00700 1 -- 172.21.15.8:0/55028351 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f17ac0042c0 con 0x7f17b8107a30 2024-03-16T20:47:08.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.687+0000 7f17b7e00700 1 -- 172.21.15.8:0/55028351 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17ac011b90 con 0x7f17b8107a30 2024-03-16T20:47:08.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.688+0000 7f17bfe00700 1 -- 172.21.15.8:0/55028351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 msgr2=0x7f17b8107e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:08.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.688+0000 7f17bfe00700 1 --2- 172.21.15.8:0/55028351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b8107e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0098a0 tx=0x7f17ac009bb0 comp rx=0 tx=0).stop 2024-03-16T20:47:08.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.688+0000 7f17bfe00700 1 -- 172.21.15.8:0/55028351 shutdown_connections 2024-03-16T20:47:08.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.688+0000 7f17bfe00700 1 --2- 172.21.15.8:0/55028351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b8107e50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:08.926 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.688+0000 7f17bfe00700 1 -- 172.21.15.8:0/55028351 >> 172.21.15.8:0/55028351 conn(0x7f17b8102ff0 msgr2=0x7f17b8105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.688+0000 7f17bfe00700 1 -- 172.21.15.8:0/55028351 shutdown_connections 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.688+0000 7f17bfe00700 1 -- 172.21.15.8:0/55028351 wait complete. 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.689+0000 7f17bfe00700 1 Processor -- start 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.689+0000 7f17bfe00700 1 -- start start 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.690+0000 7f17bfe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b807db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.690+0000 7f17bfe00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b807e050 con 0x7f17b8107a30 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.690+0000 7f17bd400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b807db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.690+0000 7f17bd400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b807db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36274/0 (socket says 172.21.15.8:36274) 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.690+0000 7f17bd400700 1 -- 172.21.15.8:0/2954949824 learned_addr learned my addr 172.21.15.8:0/2954949824 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.690+0000 7f17bd400700 1 -- 172.21.15.8:0/2954949824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac009550 con 0x7f17b8107a30 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.691+0000 7f17bd400700 1 --2- 172.21.15.8:0/2954949824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b807db10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17ac000c00 tx=0x7f17ac011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.691+0000 7f17b6000700 1 -- 172.21.15.8:0/2954949824 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17ac003aa0 con 0x7f17b8107a30 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.691+0000 7f17bfe00700 1 -- 172.21.15.8:0/2954949824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b807c290 con 0x7f17b8107a30 2024-03-16T20:47:08.927 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.691+0000 7f17b6000700 1 -- 172.21.15.8:0/2954949824 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f17ac003c00 con 0x7f17b8107a30 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.691+0000 7f17b6000700 1 -- 172.21.15.8:0/2954949824 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17ac024890 con 0x7f17b8107a30 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.691+0000 7f17bfe00700 1 -- 172.21.15.8:0/2954949824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b807c730 con 0x7f17b8107a30 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.692+0000 7f17b6000700 1 -- 172.21.15.8:0/2954949824 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45782+0+0 (secure 0 0 0) 0x7f17ac01a430 con 0x7f17b8107a30 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.692+0000 7f17bfe00700 1 -- 172.21.15.8:0/2954949824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b810be10 con 0x7f17b8107a30 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.693+0000 7f17b6000700 1 --2- 172.21.15.8:0/2954949824 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f17a0038d00 0x7f17a003b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.693+0000 7f17b6000700 1 -- 172.21.15.8:0/2954949824 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f17ac04cea0 con 0x7f17b8107a30 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.693+0000 7f17bca00700 1 --2- 172.21.15.8:0/2954949824 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f17a0038d00 0x7f17a003b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.694+0000 7f17bca00700 1 --2- 172.21.15.8:0/2954949824 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f17a0038d00 0x7f17a003b1c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17a4006fd0 tx=0x7f17a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.699+0000 7f17b6000700 1 -- 172.21.15.8:0/2954949824 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f17ac018530 con 0x7f17b8107a30 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:07.942+0000 7f17bfe00700 1 -- 172.21.15.8:0/2954949824 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f17b8063430 con 0x7f17a0038d00 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:08.217+0000 7f17b6000700 1 -- 172.21.15.8:0/2954949824 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f17b8063430 con 0x7f17a0038d00 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:08.220+0000 7f17bfe00700 1 -- 172.21.15.8:0/2954949824 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f17a0038d00 msgr2=0x7f17a003b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:08.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:08.220+0000 7f17bfe00700 1 --2- 172.21.15.8:0/2954949824 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f17a0038d00 0x7f17a003b1c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17a4006fd0 tx=0x7f17a4006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:08.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:08.220+0000 7f17bfe00700 1 -- 172.21.15.8:0/2954949824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 msgr2=0x7f17b807db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:08.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:08.220+0000 7f17bfe00700 1 --2- 172.21.15.8:0/2954949824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b807db10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17ac000c00 tx=0x7f17ac011bf0 comp rx=0 tx=0).stop 2024-03-16T20:47:08.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:08.221+0000 7f17bfe00700 1 -- 172.21.15.8:0/2954949824 shutdown_connections 2024-03-16T20:47:08.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:08.221+0000 7f17bfe00700 1 --2- 172.21.15.8:0/2954949824 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f17a0038d00 0x7f17a003b1c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:08.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:08.221+0000 7f17bfe00700 1 --2- 172.21.15.8:0/2954949824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17b8107a30 0x7f17b807db10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:08.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:08.221+0000 7f17bfe00700 1 -- 172.21.15.8:0/2954949824 >> 172.21.15.8:0/2954949824 conn(0x7f17b8102ff0 msgr2=0x7f17b8103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:08.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:08.221+0000 7f17bfe00700 1 -- 172.21.15.8:0/2954949824 shutdown_connections 2024-03-16T20:47:08.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:08.221+0000 7f17bfe00700 1 -- 172.21.15.8:0/2954949824 wait complete. 2024-03-16T20:47:08.929 INFO:teuthology.orchestra.run.smithi008.stdout:Fetching dashboard port number... 2024-03-16T20:47:09.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:09 smithi008 ceph-mon[31434]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:47:10.757 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 8443 2024-03-16T20:47:10.757 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.695+0000 7fd296e00700 1 Processor -- start 2024-03-16T20:47:10.757 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.695+0000 7fd296e00700 1 -- start start 2024-03-16T20:47:10.757 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.696+0000 7fd296e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29007c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:10.757 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.696+0000 7fd296e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29007c8e0 con 0x7fd29007de60 2024-03-16T20:47:10.758 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.696+0000 7fd28fe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29007c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:10.758 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.696+0000 7fd28fe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29007c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49852/0 (socket says 172.21.15.8:49852) 2024-03-16T20:47:10.758 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.696+0000 7fd28fe00700 1 -- 172.21.15.8:0/144007694 learned_addr learned my addr 172.21.15.8:0/144007694 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:10.758 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.696+0000 7fd28fe00700 1 -- 172.21.15.8:0/144007694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29007ca20 con 0x7fd29007de60 2024-03-16T20:47:10.759 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.697+0000 7fd28fe00700 1 --2- 172.21.15.8:0/144007694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29007c310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2800098a0 tx=0x7fd280009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d66b9053086f89 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:10.759 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.697+0000 7fd28ea00700 1 -- 172.21.15.8:0/144007694 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd280004160 con 0x7fd29007de60 2024-03-16T20:47:10.759 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.697+0000 7fd28ea00700 1 -- 172.21.15.8:0/144007694 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd2800042c0 con 0x7fd29007de60 2024-03-16T20:47:10.759 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.697+0000 7fd28ea00700 1 -- 172.21.15.8:0/144007694 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd280011b90 con 0x7fd29007de60 2024-03-16T20:47:10.759 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.698+0000 7fd296e00700 1 -- 172.21.15.8:0/144007694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 msgr2=0x7fd29007c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:10.759 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.698+0000 7fd296e00700 1 --2- 172.21.15.8:0/144007694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29007c310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2800098a0 tx=0x7fd280009bb0 comp rx=0 tx=0).stop 2024-03-16T20:47:10.763 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.698+0000 7fd296e00700 1 -- 172.21.15.8:0/144007694 shutdown_connections 2024-03-16T20:47:10.763 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.698+0000 7fd296e00700 1 --2- 172.21.15.8:0/144007694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29007c310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:10.763 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.698+0000 7fd296e00700 1 -- 172.21.15.8:0/144007694 >> 172.21.15.8:0/144007694 conn(0x7fd290102fd0 msgr2=0x7fd290105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:10.763 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.698+0000 7fd296e00700 1 -- 172.21.15.8:0/144007694 shutdown_connections 2024-03-16T20:47:10.763 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.698+0000 7fd296e00700 1 -- 172.21.15.8:0/144007694 wait complete. 2024-03-16T20:47:10.763 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.699+0000 7fd296e00700 1 Processor -- start 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.699+0000 7fd296e00700 1 -- start start 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.699+0000 7fd296e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29019da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.699+0000 7fd296e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29019df70 con 0x7fd29007de60 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.699+0000 7fd28fe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29019da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.700+0000 7fd28fe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29019da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49864/0 (socket says 172.21.15.8:49864) 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.700+0000 7fd28fe00700 1 -- 172.21.15.8:0/1099990757 learned_addr learned my addr 172.21.15.8:0/1099990757 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.700+0000 7fd28fe00700 1 -- 172.21.15.8:0/1099990757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd280009550 con 0x7fd29007de60 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.700+0000 7fd28fe00700 1 --2- 172.21.15.8:0/1099990757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29019da30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd280011b40 tx=0x7fd280011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.700+0000 7fd28cc00700 1 -- 172.21.15.8:0/1099990757 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd280003aa0 con 0x7fd29007de60 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.700+0000 7fd28cc00700 1 -- 172.21.15.8:0/1099990757 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd280003c00 con 0x7fd29007de60 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.700+0000 7fd296e00700 1 -- 172.21.15.8:0/1099990757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29019e170 con 0x7fd29007de60 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.700+0000 7fd28cc00700 1 -- 172.21.15.8:0/1099990757 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd280024840 con 0x7fd29007de60 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.701+0000 7fd296e00700 1 -- 172.21.15.8:0/1099990757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29019e610 con 0x7fd29007de60 2024-03-16T20:47:10.764 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.702+0000 7fd28cc00700 1 -- 172.21.15.8:0/1099990757 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45782+0+0 (secure 0 0 0) 0x7fd28001abc0 con 0x7fd29007de60 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.702+0000 7fd296e00700 1 -- 172.21.15.8:0/1099990757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29010de90 con 0x7fd29007de60 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.702+0000 7fd28cc00700 1 --2- 172.21.15.8:0/1099990757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd274038d00 0x7fd27403b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.702+0000 7fd28cc00700 1 -- 172.21.15.8:0/1099990757 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd28004ceb0 con 0x7fd29007de60 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.702+0000 7fd28f400700 1 --2- 172.21.15.8:0/1099990757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd274038d00 0x7fd27403b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.703+0000 7fd28f400700 1 --2- 172.21.15.8:0/1099990757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd274038d00 0x7fd27403b1c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd27c006fd0 tx=0x7fd27c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.708+0000 7fd28cc00700 1 -- 172.21.15.8:0/1099990757 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd280018760 con 0x7fd29007de60 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.825+0000 7fd28cc00700 1 -- 172.21.15.8:0/1099990757 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7fd2800249a0 con 0x7fd29007de60 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.938+0000 7fd296e00700 1 -- 172.21.15.8:0/1099990757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fd2901a0ef0 con 0x7fd29007de60 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.939+0000 7fd28cc00700 1 -- 172.21.15.8:0/1099990757 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fd280018760 con 0x7fd29007de60 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.942+0000 7fd296e00700 1 -- 172.21.15.8:0/1099990757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd274038d00 msgr2=0x7fd27403b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.942+0000 7fd296e00700 1 --2- 172.21.15.8:0/1099990757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd274038d00 0x7fd27403b1c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd27c006fd0 tx=0x7fd27c006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.942+0000 7fd296e00700 1 -- 172.21.15.8:0/1099990757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 msgr2=0x7fd29019da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.942+0000 7fd296e00700 1 --2- 172.21.15.8:0/1099990757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29019da30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd280011b40 tx=0x7fd280011c20 comp rx=0 tx=0).stop 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.942+0000 7fd296e00700 1 -- 172.21.15.8:0/1099990757 shutdown_connections 2024-03-16T20:47:10.765 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.942+0000 7fd296e00700 1 --2- 172.21.15.8:0/1099990757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd274038d00 0x7fd27403b1c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:10.766 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.942+0000 7fd296e00700 1 --2- 172.21.15.8:0/1099990757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd29007de60 0x7fd29019da30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:10.766 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.942+0000 7fd296e00700 1 -- 172.21.15.8:0/1099990757 >> 172.21.15.8:0/1099990757 conn(0x7fd290102fd0 msgr2=0x7fd290103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:10.766 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.942+0000 7fd296e00700 1 -- 172.21.15.8:0/1099990757 shutdown_connections 2024-03-16T20:47:10.766 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:09.942+0000 7fd296e00700 1 -- 172.21.15.8:0/1099990757 wait complete. 2024-03-16T20:47:10.796 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-16T20:47:10.796 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2024-03-16T20:47:10.819 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-16T20:47:10.819 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2024-03-16T20:47:10.819 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2024-03-16T20:47:10.819 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-16T20:47:10.823 INFO:teuthology.orchestra.run.smithi008.stdout:Ceph Dashboard is now available at: 2024-03-16T20:47:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: URL: https://smithi008.front.sepia.ceph.com:8443/ 2024-03-16T20:47:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: User: admin 2024-03-16T20:47:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: Password: vg99myhpdd 2024-03-16T20:47:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:10.824 INFO:teuthology.orchestra.run.smithi008.stdout:Saving cluster configuration to /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config directory 2024-03-16T20:47:10.825 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling autotune for osd_memory_target 2024-03-16T20:47:11.031 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:10 smithi008 ceph-mon[31434]: mgrmap e13: x(active, since 6s) 2024-03-16T20:47:11.031 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:10 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1099990757' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-16T20:47:12.817 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.875+0000 7f0262200700 1 Processor -- start 2024-03-16T20:47:12.818 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.875+0000 7f0262200700 1 -- start start 2024-03-16T20:47:12.818 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.876+0000 7f0262200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c081ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:12.819 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.876+0000 7f0262200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0824b0 con 0x7f025c081ac0 2024-03-16T20:47:12.819 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.876+0000 7f025b400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c081ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:12.819 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.876+0000 7f025b400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c081ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49868/0 (socket says 172.21.15.8:49868) 2024-03-16T20:47:12.819 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.876+0000 7f025b400700 1 -- 172.21.15.8:0/2548358566 learned_addr learned my addr 172.21.15.8:0/2548358566 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:12.819 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.877+0000 7f025b400700 1 -- 172.21.15.8:0/2548358566 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c10f1f0 con 0x7f025c081ac0 2024-03-16T20:47:12.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.877+0000 7f025b400700 1 --2- 172.21.15.8:0/2548358566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c081ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f024c0098a0 tx=0x7f024c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706beeae3a57c3db server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:12.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.878+0000 7f025a000700 1 -- 172.21.15.8:0/2548358566 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f024c004160 con 0x7f025c081ac0 2024-03-16T20:47:12.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.878+0000 7f025a000700 1 -- 172.21.15.8:0/2548358566 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f024c0042c0 con 0x7f025c081ac0 2024-03-16T20:47:12.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.878+0000 7f025a000700 1 -- 172.21.15.8:0/2548358566 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f024c011b90 con 0x7f025c081ac0 2024-03-16T20:47:12.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.878+0000 7f0262200700 1 -- 172.21.15.8:0/2548358566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 msgr2=0x7f025c081ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.878+0000 7f0262200700 1 --2- 172.21.15.8:0/2548358566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c081ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f024c0098a0 tx=0x7f024c009bb0 comp rx=0 tx=0).stop 2024-03-16T20:47:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.878+0000 7f0262200700 1 -- 172.21.15.8:0/2548358566 shutdown_connections 2024-03-16T20:47:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.878+0000 7f0262200700 1 --2- 172.21.15.8:0/2548358566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c081ee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.879+0000 7f0262200700 1 -- 172.21.15.8:0/2548358566 >> 172.21.15.8:0/2548358566 conn(0x7f025c07d0a0 msgr2=0x7f025c07f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.879+0000 7f0262200700 1 -- 172.21.15.8:0/2548358566 shutdown_connections 2024-03-16T20:47:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.879+0000 7f0262200700 1 -- 172.21.15.8:0/2548358566 wait complete. 2024-03-16T20:47:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.880+0000 7f0262200700 1 Processor -- start 2024-03-16T20:47:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.880+0000 7f0262200700 1 -- start start 2024-03-16T20:47:12.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.880+0000 7f0262200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c1a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:12.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.880+0000 7f0262200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c1a2360 con 0x7f025c081ac0 2024-03-16T20:47:12.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.880+0000 7f025b400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c1a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:12.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.880+0000 7f025b400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c1a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49872/0 (socket says 172.21.15.8:49872) 2024-03-16T20:47:12.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.881+0000 7f025b400700 1 -- 172.21.15.8:0/2188810484 learned_addr learned my addr 172.21.15.8:0/2188810484 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:12.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.881+0000 7f025b400700 1 -- 172.21.15.8:0/2188810484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c009550 con 0x7f025c081ac0 2024-03-16T20:47:12.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.881+0000 7f025b400700 1 --2- 172.21.15.8:0/2188810484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c1a1e20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f024c011670 tx=0x7f024c011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:12.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.881+0000 7f0253e00700 1 -- 172.21.15.8:0/2188810484 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f024c0039c0 con 0x7f025c081ac0 2024-03-16T20:47:12.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.881+0000 7f0253e00700 1 -- 172.21.15.8:0/2188810484 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f024c003b20 con 0x7f025c081ac0 2024-03-16T20:47:12.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.882+0000 7f0253e00700 1 -- 172.21.15.8:0/2188810484 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f024c01a690 con 0x7f025c081ac0 2024-03-16T20:47:12.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.882+0000 7f0262200700 1 -- 172.21.15.8:0/2188810484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c1a2560 con 0x7f025c081ac0 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.882+0000 7f0262200700 1 -- 172.21.15.8:0/2188810484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c1a2a00 con 0x7f025c081ac0 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.883+0000 7f0253e00700 1 -- 172.21.15.8:0/2188810484 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7f024c0249c0 con 0x7f025c081ac0 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.883+0000 7f0262200700 1 -- 172.21.15.8:0/2188810484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c112420 con 0x7f025c081ac0 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.883+0000 7f0253e00700 1 --2- 172.21.15.8:0/2188810484 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0240038d50 0x7f024003b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.883+0000 7f0253e00700 1 -- 172.21.15.8:0/2188810484 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f024c04d040 con 0x7f025c081ac0 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.884+0000 7f025aa00700 1 --2- 172.21.15.8:0/2188810484 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0240038d50 0x7f024003b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.884+0000 7f025aa00700 1 --2- 172.21.15.8:0/2188810484 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0240038d50 0x7f024003b210 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0248006fd0 tx=0x7f0248006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:11.889+0000 7f0253e00700 1 -- 172.21.15.8:0/2188810484 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f024c081280 con 0x7f025c081ac0 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.117+0000 7f0262200700 1 -- 172.21.15.8:0/2188810484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f025c1a52e0 con 0x7f025c081ac0 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.118+0000 7f0253e00700 1 -- 172.21.15.8:0/2188810484 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f024c003c90 con 0x7f025c081ac0 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.120+0000 7f0262200700 1 -- 172.21.15.8:0/2188810484 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0240038d50 msgr2=0x7f024003b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:12.827 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.120+0000 7f0262200700 1 --2- 172.21.15.8:0/2188810484 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0240038d50 0x7f024003b210 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0248006fd0 tx=0x7f0248006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:12.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.120+0000 7f0262200700 1 -- 172.21.15.8:0/2188810484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 msgr2=0x7f025c1a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:12.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.120+0000 7f0262200700 1 --2- 172.21.15.8:0/2188810484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c1a1e20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f024c011670 tx=0x7f024c011bf0 comp rx=0 tx=0).stop 2024-03-16T20:47:12.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.120+0000 7f0262200700 1 -- 172.21.15.8:0/2188810484 shutdown_connections 2024-03-16T20:47:12.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.120+0000 7f0262200700 1 --2- 172.21.15.8:0/2188810484 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0240038d50 0x7f024003b210 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:12.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.120+0000 7f0262200700 1 --2- 172.21.15.8:0/2188810484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f025c081ac0 0x7f025c1a1e20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:12.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.120+0000 7f0262200700 1 -- 172.21.15.8:0/2188810484 >> 172.21.15.8:0/2188810484 conn(0x7f025c07d0a0 msgr2=0x7f025c07dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:12.829 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.121+0000 7f0262200700 1 -- 172.21.15.8:0/2188810484 shutdown_connections 2024-03-16T20:47:12.829 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:12.121+0000 7f0262200700 1 -- 172.21.15.8:0/2188810484 wait complete. 2024-03-16T20:47:14.436 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.427+0000 7f34d7600700 1 Processor -- start 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.427+0000 7f34d7600700 1 -- start start 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.427+0000 7f34d7600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d010a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.427+0000 7f34d7600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d007bde0 con 0x7f34d0108560 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.428+0000 7f34d4c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d010a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.428+0000 7f34d4c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d010a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49882/0 (socket says 172.21.15.8:49882) 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.428+0000 7f34d4c00700 1 -- 172.21.15.8:0/2207680341 learned_addr learned my addr 172.21.15.8:0/2207680341 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.428+0000 7f34d4c00700 1 -- 172.21.15.8:0/2207680341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d007bf20 con 0x7f34d0108560 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.429+0000 7f34d4c00700 1 --2- 172.21.15.8:0/2207680341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d010a950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f34c40098a0 tx=0x7f34c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36740c1f1ff676a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.429+0000 7f34cf400700 1 -- 172.21.15.8:0/2207680341 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34c4004160 con 0x7f34d0108560 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.429+0000 7f34cf400700 1 -- 172.21.15.8:0/2207680341 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f34c40042c0 con 0x7f34d0108560 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.429+0000 7f34cf400700 1 -- 172.21.15.8:0/2207680341 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34c4011b90 con 0x7f34d0108560 2024-03-16T20:47:14.437 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.430+0000 7f34d7600700 1 -- 172.21.15.8:0/2207680341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 msgr2=0x7f34d010a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.430+0000 7f34d7600700 1 --2- 172.21.15.8:0/2207680341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d010a950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f34c40098a0 tx=0x7f34c4009bb0 comp rx=0 tx=0).stop 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.430+0000 7f34d7600700 1 -- 172.21.15.8:0/2207680341 shutdown_connections 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.430+0000 7f34d7600700 1 --2- 172.21.15.8:0/2207680341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d010a950 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.430+0000 7f34d7600700 1 -- 172.21.15.8:0/2207680341 >> 172.21.15.8:0/2207680341 conn(0x7f34d0101f10 msgr2=0x7f34d0104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.430+0000 7f34d7600700 1 -- 172.21.15.8:0/2207680341 shutdown_connections 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.430+0000 7f34d7600700 1 -- 172.21.15.8:0/2207680341 wait complete. 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.432+0000 7f34d7600700 1 Processor -- start 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.432+0000 7f34d7600700 1 -- start start 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.432+0000 7f34d7600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d019da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.432+0000 7f34d7600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d019df70 con 0x7f34d0108560 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.432+0000 7f34d4c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d019da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.432+0000 7f34d4c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d019da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49888/0 (socket says 172.21.15.8:49888) 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.432+0000 7f34d4c00700 1 -- 172.21.15.8:0/2213767864 learned_addr learned my addr 172.21.15.8:0/2213767864 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:14.438 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.433+0000 7f34d4c00700 1 -- 172.21.15.8:0/2213767864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c4009550 con 0x7f34d0108560 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.433+0000 7f34d4c00700 1 --2- 172.21.15.8:0/2213767864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d019da30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f34c4011670 tx=0x7f34c4011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.433+0000 7f34cd600700 1 -- 172.21.15.8:0/2213767864 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34c40039c0 con 0x7f34d0108560 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.434+0000 7f34d7600700 1 -- 172.21.15.8:0/2213767864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d019e170 con 0x7f34d0108560 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.434+0000 7f34cd600700 1 -- 172.21.15.8:0/2213767864 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f34c4003b20 con 0x7f34d0108560 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.434+0000 7f34cd600700 1 -- 172.21.15.8:0/2213767864 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34c401a690 con 0x7f34d0108560 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.434+0000 7f34d7600700 1 -- 172.21.15.8:0/2213767864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d019e610 con 0x7f34d0108560 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.435+0000 7f34d7600700 1 -- 172.21.15.8:0/2213767864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d010bcc0 con 0x7f34d0108560 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.435+0000 7f34cd600700 1 -- 172.21.15.8:0/2213767864 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7f34c40249c0 con 0x7f34d0108560 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.435+0000 7f34cd600700 1 --2- 172.21.15.8:0/2213767864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f34b8038db0 0x7f34b803b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.435+0000 7f34cd600700 1 -- 172.21.15.8:0/2213767864 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f34c404d070 con 0x7f34d0108560 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.436+0000 7f34cfe00700 1 --2- 172.21.15.8:0/2213767864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f34b8038db0 0x7f34b803b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.436+0000 7f34cfe00700 1 --2- 172.21.15.8:0/2213767864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f34b8038db0 0x7f34b803b270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34bc006fd0 tx=0x7f34bc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:14.439 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.441+0000 7f34cd600700 1 -- 172.21.15.8:0/2213767864 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f34c4018530 con 0x7f34d0108560 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.779+0000 7f34d7600700 1 -- 172.21.15.8:0/2213767864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f34d01a0ef0 con 0x7f34d0108560 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.784+0000 7f34cd600700 1 -- 172.21.15.8:0/2213767864 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f34c4018350 con 0x7f34d0108560 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.787+0000 7f34d7600700 1 -- 172.21.15.8:0/2213767864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f34b8038db0 msgr2=0x7f34b803b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.787+0000 7f34d7600700 1 --2- 172.21.15.8:0/2213767864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f34b8038db0 0x7f34b803b270 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34bc006fd0 tx=0x7f34bc006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.787+0000 7f34d7600700 1 -- 172.21.15.8:0/2213767864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 msgr2=0x7f34d019da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.787+0000 7f34d7600700 1 --2- 172.21.15.8:0/2213767864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d019da30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f34c4011670 tx=0x7f34c4011bf0 comp rx=0 tx=0).stop 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.787+0000 7f34d7600700 1 -- 172.21.15.8:0/2213767864 shutdown_connections 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.787+0000 7f34d7600700 1 --2- 172.21.15.8:0/2213767864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f34b8038db0 0x7f34b803b270 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.787+0000 7f34d7600700 1 --2- 172.21.15.8:0/2213767864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34d0108560 0x7f34d019da30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.787+0000 7f34d7600700 1 -- 172.21.15.8:0/2213767864 >> 172.21.15.8:0/2213767864 conn(0x7f34d0101f10 msgr2=0x7f34d0102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.787+0000 7f34d7600700 1 -- 172.21.15.8:0/2213767864 shutdown_connections 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2024-03-16T20:47:13.788+0000 7f34d7600700 1 -- 172.21.15.8:0/2213767864 wait complete. 2024-03-16T20:47:14.440 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-16T20:47:14.441 INFO:teuthology.orchestra.run.smithi008.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-16T20:47:14.441 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:14.441 INFO:teuthology.orchestra.run.smithi008.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-16T20:47:14.441 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout:Or, if you are only running a single cluster on this host: 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout: ceph telemetry on 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout:For more information see: 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:14.442 INFO:teuthology.orchestra.run.smithi008.stdout:Bootstrap complete. 2024-03-16T20:47:14.553 INFO:tasks.cephadm:Fetching config... 2024-03-16T20:47:14.554 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:47:14.554 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-16T20:47:14.609 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-16T20:47:14.609 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:47:14.609 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-16T20:47:14.651 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-16T20:47:14.651 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:47:14.651 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/keyring of=/dev/stdout 2024-03-16T20:47:14.784 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-16T20:47:14.784 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:47:14.784 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-16T20:47:14.832 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-16T20:47:14.832 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYRZ8cOCRUNRBoyvv/Tlx83EiUDH4C11c6u7I7rDroSUYOJ9WlFHpbCi3N8J0aYhDcWW79ClHsE1sP9Zm6Ipxdfs/vM+B7SvJbyslFRs8FTzV0dSrUN2v2/iTdrBZz0dNVrtowGy1gGRgUW1WwXVQ5HS31N798R4+bpERq+pW3YAvfFjqYy9Kdyqp9Tt62tDLqyNYN58Zn4X7toZLntkGOYDpTAdh6LYeQBSQV26T0XN2yLl1AGY/mqrSmRxqTgJzv2h04x9TzVG0zqEoMf2FXOyo4ROhXFrqCTzNeSnDmPJlQQaNN6vp/E8SEPxlzcNaLk4O91CwynOpBrd6/t58Ndq7pns7TM7JtjGzhZ2XFwEssOU8gwKvMC9Edfsvs1JgA9mVu1ZlbHtUJE1OOuledrBklqRtzivBLxKoHjhgW7vJ2NtFLHeos8SVxAnDAQh3Vxxa3MwcIY8FOj1uEf7kzN+SX6igV0R+PJDmGlodsaw722zoeTImATyzj4NYRtes= ceph-05d64692-e3d6-11ee-95c9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-16T20:47:14.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:14 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2213767864' entity='client.admin' 2024-03-16T20:47:15.004 INFO:teuthology.orchestra.run.smithi008.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYRZ8cOCRUNRBoyvv/Tlx83EiUDH4C11c6u7I7rDroSUYOJ9WlFHpbCi3N8J0aYhDcWW79ClHsE1sP9Zm6Ipxdfs/vM+B7SvJbyslFRs8FTzV0dSrUN2v2/iTdrBZz0dNVrtowGy1gGRgUW1WwXVQ5HS31N798R4+bpERq+pW3YAvfFjqYy9Kdyqp9Tt62tDLqyNYN58Zn4X7toZLntkGOYDpTAdh6LYeQBSQV26T0XN2yLl1AGY/mqrSmRxqTgJzv2h04x9TzVG0zqEoMf2FXOyo4ROhXFrqCTzNeSnDmPJlQQaNN6vp/E8SEPxlzcNaLk4O91CwynOpBrd6/t58Ndq7pns7TM7JtjGzhZ2XFwEssOU8gwKvMC9Edfsvs1JgA9mVu1ZlbHtUJE1OOuledrBklqRtzivBLxKoHjhgW7vJ2NtFLHeos8SVxAnDAQh3Vxxa3MwcIY8FOj1uEf7kzN+SX6igV0R+PJDmGlodsaw722zoeTImATyzj4NYRtes= ceph-05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:47:15.073 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYRZ8cOCRUNRBoyvv/Tlx83EiUDH4C11c6u7I7rDroSUYOJ9WlFHpbCi3N8J0aYhDcWW79ClHsE1sP9Zm6Ipxdfs/vM+B7SvJbyslFRs8FTzV0dSrUN2v2/iTdrBZz0dNVrtowGy1gGRgUW1WwXVQ5HS31N798R4+bpERq+pW3YAvfFjqYy9Kdyqp9Tt62tDLqyNYN58Zn4X7toZLntkGOYDpTAdh6LYeQBSQV26T0XN2yLl1AGY/mqrSmRxqTgJzv2h04x9TzVG0zqEoMf2FXOyo4ROhXFrqCTzNeSnDmPJlQQaNN6vp/E8SEPxlzcNaLk4O91CwynOpBrd6/t58Ndq7pns7TM7JtjGzhZ2XFwEssOU8gwKvMC9Edfsvs1JgA9mVu1ZlbHtUJE1OOuledrBklqRtzivBLxKoHjhgW7vJ2NtFLHeos8SVxAnDAQh3Vxxa3MwcIY8FOj1uEf7kzN+SX6igV0R+PJDmGlodsaw722zoeTImATyzj4NYRtes= ceph-05d64692-e3d6-11ee-95c9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-16T20:47:15.120 INFO:teuthology.orchestra.run.smithi170.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYRZ8cOCRUNRBoyvv/Tlx83EiUDH4C11c6u7I7rDroSUYOJ9WlFHpbCi3N8J0aYhDcWW79ClHsE1sP9Zm6Ipxdfs/vM+B7SvJbyslFRs8FTzV0dSrUN2v2/iTdrBZz0dNVrtowGy1gGRgUW1WwXVQ5HS31N798R4+bpERq+pW3YAvfFjqYy9Kdyqp9Tt62tDLqyNYN58Zn4X7toZLntkGOYDpTAdh6LYeQBSQV26T0XN2yLl1AGY/mqrSmRxqTgJzv2h04x9TzVG0zqEoMf2FXOyo4ROhXFrqCTzNeSnDmPJlQQaNN6vp/E8SEPxlzcNaLk4O91CwynOpBrd6/t58Ndq7pns7TM7JtjGzhZ2XFwEssOU8gwKvMC9Edfsvs1JgA9mVu1ZlbHtUJE1OOuledrBklqRtzivBLxKoHjhgW7vJ2NtFLHeos8SVxAnDAQh3Vxxa3MwcIY8FOj1uEf7kzN+SX6igV0R+PJDmGlodsaw722zoeTImATyzj4NYRtes= ceph-05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:47:15.134 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYRZ8cOCRUNRBoyvv/Tlx83EiUDH4C11c6u7I7rDroSUYOJ9WlFHpbCi3N8J0aYhDcWW79ClHsE1sP9Zm6Ipxdfs/vM+B7SvJbyslFRs8FTzV0dSrUN2v2/iTdrBZz0dNVrtowGy1gGRgUW1WwXVQ5HS31N798R4+bpERq+pW3YAvfFjqYy9Kdyqp9Tt62tDLqyNYN58Zn4X7toZLntkGOYDpTAdh6LYeQBSQV26T0XN2yLl1AGY/mqrSmRxqTgJzv2h04x9TzVG0zqEoMf2FXOyo4ROhXFrqCTzNeSnDmPJlQQaNN6vp/E8SEPxlzcNaLk4O91CwynOpBrd6/t58Ndq7pns7TM7JtjGzhZ2XFwEssOU8gwKvMC9Edfsvs1JgA9mVu1ZlbHtUJE1OOuledrBklqRtzivBLxKoHjhgW7vJ2NtFLHeos8SVxAnDAQh3Vxxa3MwcIY8FOj1uEf7kzN+SX6igV0R+PJDmGlodsaw722zoeTImATyzj4NYRtes= ceph-05d64692-e3d6-11ee-95c9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-16T20:47:15.181 INFO:teuthology.orchestra.run.smithi186.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYRZ8cOCRUNRBoyvv/Tlx83EiUDH4C11c6u7I7rDroSUYOJ9WlFHpbCi3N8J0aYhDcWW79ClHsE1sP9Zm6Ipxdfs/vM+B7SvJbyslFRs8FTzV0dSrUN2v2/iTdrBZz0dNVrtowGy1gGRgUW1WwXVQ5HS31N798R4+bpERq+pW3YAvfFjqYy9Kdyqp9Tt62tDLqyNYN58Zn4X7toZLntkGOYDpTAdh6LYeQBSQV26T0XN2yLl1AGY/mqrSmRxqTgJzv2h04x9TzVG0zqEoMf2FXOyo4ROhXFrqCTzNeSnDmPJlQQaNN6vp/E8SEPxlzcNaLk4O91CwynOpBrd6/t58Ndq7pns7TM7JtjGzhZ2XFwEssOU8gwKvMC9Edfsvs1JgA9mVu1ZlbHtUJE1OOuledrBklqRtzivBLxKoHjhgW7vJ2NtFLHeos8SVxAnDAQh3Vxxa3MwcIY8FOj1uEf7kzN+SX6igV0R+PJDmGlodsaw722zoeTImATyzj4NYRtes= ceph-05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:47:15.196 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-16T20:47:15.636 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:47:18.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.382+0000 7fbf4ca00700 1 -- 172.21.15.8:0/711502372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf48102540 msgr2=0x7fbf48104930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:18.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.382+0000 7fbf4ca00700 1 --2- 172.21.15.8:0/711502372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf48102540 0x7fbf48104930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009910 tx=0x7fbf38009c20 comp rx=0 tx=0).stop 2024-03-16T20:47:18.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.382+0000 7fbf4ca00700 1 -- 172.21.15.8:0/711502372 shutdown_connections 2024-03-16T20:47:18.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.382+0000 7fbf4ca00700 1 --2- 172.21.15.8:0/711502372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf48102540 0x7fbf48104930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:18.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.382+0000 7fbf4ca00700 1 -- 172.21.15.8:0/711502372 >> 172.21.15.8:0/711502372 conn(0x7fbf480fbeb0 msgr2=0x7fbf480fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:18.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.382+0000 7fbf4ca00700 1 -- 172.21.15.8:0/711502372 shutdown_connections 2024-03-16T20:47:18.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.383+0000 7fbf4ca00700 1 -- 172.21.15.8:0/711502372 wait complete. 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.384+0000 7fbf4ca00700 1 Processor -- start 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.384+0000 7fbf4ca00700 1 -- start start 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.385+0000 7fbf4ca00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf48102540 0x7fbf48199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.385+0000 7fbf4ca00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48199660 con 0x7fbf48102540 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.385+0000 7fbf45e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf48102540 0x7fbf48199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.385+0000 7fbf45e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf48102540 0x7fbf48199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39576/0 (socket says 172.21.15.8:39576) 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.385+0000 7fbf45e00700 1 -- 172.21.15.8:0/3277875553 learned_addr learned my addr 172.21.15.8:0/3277875553 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.385+0000 7fbf45e00700 1 -- 172.21.15.8:0/3277875553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf380095f0 con 0x7fbf48102540 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.386+0000 7fbf45e00700 1 --2- 172.21.15.8:0/3277875553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf48102540 0x7fbf48199120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800b5c0 tx=0x7fbf38005010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.386+0000 7fbf3ea00700 1 -- 172.21.15.8:0/3277875553 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf3801d070 con 0x7fbf48102540 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.386+0000 7fbf3ea00700 1 -- 172.21.15.8:0/3277875553 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbf38022470 con 0x7fbf48102540 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.386+0000 7fbf3ea00700 1 -- 172.21.15.8:0/3277875553 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf3800f5f0 con 0x7fbf48102540 2024-03-16T20:47:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.386+0000 7fbf4ca00700 1 -- 172.21.15.8:0/3277875553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf48199860 con 0x7fbf48102540 2024-03-16T20:47:18.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.386+0000 7fbf4ca00700 1 -- 172.21.15.8:0/3277875553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf48199d00 con 0x7fbf48102540 2024-03-16T20:47:18.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.387+0000 7fbf3ea00700 1 -- 172.21.15.8:0/3277875553 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7fbf38022a00 con 0x7fbf48102540 2024-03-16T20:47:18.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.387+0000 7fbf4ca00700 1 -- 172.21.15.8:0/3277875553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf48192db0 con 0x7fbf48102540 2024-03-16T20:47:18.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.388+0000 7fbf3ea00700 1 --2- 172.21.15.8:0/3277875553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbf2c038db0 0x7fbf2c03b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:18.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.388+0000 7fbf3ea00700 1 -- 172.21.15.8:0/3277875553 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbf3804cf70 con 0x7fbf48102540 2024-03-16T20:47:18.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.388+0000 7fbf3fe00700 1 --2- 172.21.15.8:0/3277875553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbf2c038db0 0x7fbf2c03b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:18.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.389+0000 7fbf3fe00700 1 --2- 172.21.15.8:0/3277875553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbf2c038db0 0x7fbf2c03b270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbf30006fd0 tx=0x7fbf30006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:18.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.394+0000 7fbf3ea00700 1 -- 172.21.15.8:0/3277875553 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fbf38020370 con 0x7fbf48102540 2024-03-16T20:47:18.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.625+0000 7fbf4ca00700 1 -- 172.21.15.8:0/3277875553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fbf48063610 con 0x7fbf48102540 2024-03-16T20:47:18.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.631+0000 7fbf3ea00700 1 -- 172.21.15.8:0/3277875553 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fbf38027030 con 0x7fbf48102540 2024-03-16T20:47:18.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.634+0000 7fbf4ca00700 1 -- 172.21.15.8:0/3277875553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbf2c038db0 msgr2=0x7fbf2c03b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:18.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.634+0000 7fbf4ca00700 1 --2- 172.21.15.8:0/3277875553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbf2c038db0 0x7fbf2c03b270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbf30006fd0 tx=0x7fbf30006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.634+0000 7fbf4ca00700 1 -- 172.21.15.8:0/3277875553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf48102540 msgr2=0x7fbf48199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.634+0000 7fbf4ca00700 1 --2- 172.21.15.8:0/3277875553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf48102540 0x7fbf48199120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800b5c0 tx=0x7fbf38005010 comp rx=0 tx=0).stop 2024-03-16T20:47:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.634+0000 7fbf4ca00700 1 -- 172.21.15.8:0/3277875553 shutdown_connections 2024-03-16T20:47:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.634+0000 7fbf4ca00700 1 --2- 172.21.15.8:0/3277875553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbf2c038db0 0x7fbf2c03b270 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.634+0000 7fbf4ca00700 1 --2- 172.21.15.8:0/3277875553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf48102540 0x7fbf48199120 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.634+0000 7fbf4ca00700 1 -- 172.21.15.8:0/3277875553 >> 172.21.15.8:0/3277875553 conn(0x7fbf480fbeb0 msgr2=0x7fbf480fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.634+0000 7fbf4ca00700 1 -- 172.21.15.8:0/3277875553 shutdown_connections 2024-03-16T20:47:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:18.634+0000 7fbf4ca00700 1 -- 172.21.15.8:0/3277875553 wait complete. 2024-03-16T20:47:19.445 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-16T20:47:19.445 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-16T20:47:19.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:19 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3277875553' entity='client.admin' 2024-03-16T20:47:19.861 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:47:22.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:22.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:22.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi008", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:47:22.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:22.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:47:22.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.491+0000 7f77dc600700 1 -- 172.21.15.8:0/4250632655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4076010 msgr2=0x7f77d4074470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.491+0000 7f77dc600700 1 --2- 172.21.15.8:0/4250632655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4076010 0x7f77d4074470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77c800b0a0 tx=0x7f77c800b3b0 comp rx=0 tx=0).stop 2024-03-16T20:47:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.491+0000 7f77dc600700 1 -- 172.21.15.8:0/4250632655 shutdown_connections 2024-03-16T20:47:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.491+0000 7f77dc600700 1 --2- 172.21.15.8:0/4250632655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4076010 0x7f77d4074470 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.491+0000 7f77dc600700 1 -- 172.21.15.8:0/4250632655 >> 172.21.15.8:0/4250632655 conn(0x7f77d40fcfb0 msgr2=0x7f77d40ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.491+0000 7f77dc600700 1 -- 172.21.15.8:0/4250632655 shutdown_connections 2024-03-16T20:47:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.491+0000 7f77dc600700 1 -- 172.21.15.8:0/4250632655 wait complete. 2024-03-16T20:47:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.492+0000 7f77dc600700 1 Processor -- start 2024-03-16T20:47:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.492+0000 7f77dc600700 1 -- start start 2024-03-16T20:47:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.493+0000 7f77dc600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4076010 0x7f77d419d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.493+0000 7f77dc600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d419dad0 con 0x7f77d4076010 2024-03-16T20:47:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.493+0000 7f77d9c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4076010 0x7f77d419d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.493+0000 7f77d9c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4076010 0x7f77d419d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39598/0 (socket says 172.21.15.8:39598) 2024-03-16T20:47:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.493+0000 7f77d9c00700 1 -- 172.21.15.8:0/4008913074 learned_addr learned my addr 172.21.15.8:0/4008913074 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.493+0000 7f77d9c00700 1 -- 172.21.15.8:0/4008913074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c8009d00 con 0x7f77d4076010 2024-03-16T20:47:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.494+0000 7f77d9c00700 1 --2- 172.21.15.8:0/4008913074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4076010 0x7f77d419d590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77c8007760 tx=0x7f77c800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.494+0000 7f77d2000700 1 -- 172.21.15.8:0/4008913074 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77c800e040 con 0x7f77d4076010 2024-03-16T20:47:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.494+0000 7f77d2000700 1 -- 172.21.15.8:0/4008913074 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f77c8003d40 con 0x7f77d4076010 2024-03-16T20:47:22.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.494+0000 7f77d2000700 1 -- 172.21.15.8:0/4008913074 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77c801d810 con 0x7f77d4076010 2024-03-16T20:47:22.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.494+0000 7f77dc600700 1 -- 172.21.15.8:0/4008913074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d419dcd0 con 0x7f77d4076010 2024-03-16T20:47:22.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.494+0000 7f77dc600700 1 -- 172.21.15.8:0/4008913074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d419e170 con 0x7f77d4076010 2024-03-16T20:47:22.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.495+0000 7f77d2000700 1 -- 172.21.15.8:0/4008913074 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7f77c8019070 con 0x7f77d4076010 2024-03-16T20:47:22.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.495+0000 7f77dc600700 1 -- 172.21.15.8:0/4008913074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d4197010 con 0x7f77d4076010 2024-03-16T20:47:22.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.496+0000 7f77d2000700 1 --2- 172.21.15.8:0/4008913074 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f77bc038db0 0x7f77bc03b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:22.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.496+0000 7f77d2000700 1 -- 172.21.15.8:0/4008913074 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f77c804cf50 con 0x7f77d4076010 2024-03-16T20:47:22.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.496+0000 7f77d9200700 1 --2- 172.21.15.8:0/4008913074 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f77bc038db0 0x7f77bc03b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.497+0000 7f77d9200700 1 --2- 172.21.15.8:0/4008913074 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f77bc038db0 0x7f77bc03b270 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f77c0006fd0 tx=0x7f77c0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.502+0000 7f77d2000700 1 -- 172.21.15.8:0/4008913074 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f77c801c5b0 con 0x7f77d4076010 2024-03-16T20:47:22.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.729+0000 7f77dc600700 1 -- 172.21.15.8:0/4008913074 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f77d402d990 con 0x7f77bc038db0 2024-03-16T20:47:22.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.737+0000 7f77d2000700 1 -- 172.21.15.8:0/4008913074 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f77d402d990 con 0x7f77bc038db0 2024-03-16T20:47:22.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.740+0000 7f77dc600700 1 -- 172.21.15.8:0/4008913074 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f77bc038db0 msgr2=0x7f77bc03b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.740+0000 7f77dc600700 1 --2- 172.21.15.8:0/4008913074 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f77bc038db0 0x7f77bc03b270 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f77c0006fd0 tx=0x7f77c0006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.740+0000 7f77dc600700 1 -- 172.21.15.8:0/4008913074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4076010 msgr2=0x7f77d419d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.740+0000 7f77dc600700 1 --2- 172.21.15.8:0/4008913074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4076010 0x7f77d419d590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77c8007760 tx=0x7f77c800bd40 comp rx=0 tx=0).stop 2024-03-16T20:47:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.740+0000 7f77dc600700 1 -- 172.21.15.8:0/4008913074 shutdown_connections 2024-03-16T20:47:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.740+0000 7f77dc600700 1 --2- 172.21.15.8:0/4008913074 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f77bc038db0 0x7f77bc03b270 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.740+0000 7f77dc600700 1 --2- 172.21.15.8:0/4008913074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4076010 0x7f77d419d590 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.740+0000 7f77dc600700 1 -- 172.21.15.8:0/4008913074 >> 172.21.15.8:0/4008913074 conn(0x7f77d40fcfb0 msgr2=0x7f77d40fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.740+0000 7f77dc600700 1 -- 172.21.15.8:0/4008913074 shutdown_connections 2024-03-16T20:47:22.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:22.740+0000 7f77dc600700 1 -- 172.21.15.8:0/4008913074 wait complete. 2024-03-16T20:47:23.561 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi170 2024-03-16T20:47:23.561 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-03-16T20:47:23.561 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/etc/ceph/ceph.conf 2024-03-16T20:47:23.579 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-03-16T20:47:23.579 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:47:23.636 INFO:tasks.cephadm:Adding host smithi170 to orchestrator... 2024-03-16T20:47:23.636 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch host add smithi170 2024-03-16T20:47:23.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:23 smithi008 ceph-mon[31434]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:47:23.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:23.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:47:23.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:47:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:47:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:23 smithi008 ceph-mon[31434]: Updating smithi008:/etc/ceph/ceph.conf 2024-03-16T20:47:24.051 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:47:24.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:24 smithi008 ceph-mon[31434]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:24.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:24 smithi008 ceph-mon[31434]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:47:25.910 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:25 smithi008 ceph-mon[31434]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:47:25.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:25 smithi008 ceph-mon[31434]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:47:25.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:25 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:25.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:25 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:25.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:25 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:26.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.085+0000 7f0277600700 1 -- 172.21.15.8:0/2933242738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0270074410 msgr2=0x7f02700747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.085+0000 7f0277600700 1 --2- 172.21.15.8:0/2933242738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0270074410 0x7f02700747f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0264009910 tx=0x7f0264009c20 comp rx=0 tx=0).stop 2024-03-16T20:47:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.085+0000 7f0277600700 1 -- 172.21.15.8:0/2933242738 shutdown_connections 2024-03-16T20:47:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.085+0000 7f0277600700 1 --2- 172.21.15.8:0/2933242738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0270074410 0x7f02700747f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.085+0000 7f0277600700 1 -- 172.21.15.8:0/2933242738 >> 172.21.15.8:0/2933242738 conn(0x7f02700fd4f0 msgr2=0x7f02700ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.085+0000 7f0277600700 1 -- 172.21.15.8:0/2933242738 shutdown_connections 2024-03-16T20:47:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.085+0000 7f0277600700 1 -- 172.21.15.8:0/2933242738 wait complete. 2024-03-16T20:47:26.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.086+0000 7f0277600700 1 Processor -- start 2024-03-16T20:47:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.087+0000 7f0277600700 1 -- start start 2024-03-16T20:47:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.087+0000 7f0277600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0270074410 0x7f02701995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.087+0000 7f0277600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0270199b20 con 0x7f0270074410 2024-03-16T20:47:26.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.087+0000 7f0274c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0270074410 0x7f02701995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:26.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.087+0000 7f0274c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0270074410 0x7f02701995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39622/0 (socket says 172.21.15.8:39622) 2024-03-16T20:47:26.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.087+0000 7f0274c00700 1 -- 172.21.15.8:0/2559926606 learned_addr learned my addr 172.21.15.8:0/2559926606 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:26.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.088+0000 7f0274c00700 1 -- 172.21.15.8:0/2559926606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02640095f0 con 0x7f0270074410 2024-03-16T20:47:26.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.088+0000 7f0274c00700 1 --2- 172.21.15.8:0/2559926606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0270074410 0x7f02701995e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0264005850 tx=0x7f0264004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.088+0000 7f026d600700 1 -- 172.21.15.8:0/2559926606 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f026401d070 con 0x7f0270074410 2024-03-16T20:47:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.088+0000 7f026d600700 1 -- 172.21.15.8:0/2559926606 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f026400be60 con 0x7f0270074410 2024-03-16T20:47:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.088+0000 7f026d600700 1 -- 172.21.15.8:0/2559926606 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f026400f460 con 0x7f0270074410 2024-03-16T20:47:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.088+0000 7f0277600700 1 -- 172.21.15.8:0/2559926606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0270199d20 con 0x7f0270074410 2024-03-16T20:47:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.089+0000 7f0277600700 1 -- 172.21.15.8:0/2559926606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027019a140 con 0x7f0270074410 2024-03-16T20:47:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.090+0000 7f026d600700 1 -- 172.21.15.8:0/2559926606 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7f026400b960 con 0x7f0270074410 2024-03-16T20:47:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.090+0000 7f0277600700 1 -- 172.21.15.8:0/2559926606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0270063610 con 0x7f0270074410 2024-03-16T20:47:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.090+0000 7f026d600700 1 --2- 172.21.15.8:0/2559926606 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0258038db0 0x7f025803b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.090+0000 7f026d600700 1 -- 172.21.15.8:0/2559926606 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f026404d210 con 0x7f0270074410 2024-03-16T20:47:26.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.090+0000 7f026fe00700 1 --2- 172.21.15.8:0/2559926606 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0258038db0 0x7f025803b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:26.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.091+0000 7f026fe00700 1 --2- 172.21.15.8:0/2559926606 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0258038db0 0x7f025803b270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f025c006fd0 tx=0x7f025c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.095+0000 7f026d600700 1 -- 172.21.15.8:0/2559926606 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f026402be20 con 0x7f0270074410 2024-03-16T20:47:26.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:26.327+0000 7f0277600700 1 -- 172.21.15.8:0/2559926606 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi170", "target": ["mon-mgr", ""]}) v1 -- 0x7f027010e240 con 0x7f0258038db0 2024-03-16T20:47:27.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:26 smithi008 ceph-mon[31434]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:28.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:27 smithi008 ceph-mon[31434]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi170", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:47:28.844 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:28 smithi008 ceph-mon[31434]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:28.844 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:28 smithi008 ceph-mon[31434]: Deploying cephadm binary to smithi170 2024-03-16T20:47:31.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:30 smithi008 ceph-mon[31434]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:31.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:31.253+0000 7f026d600700 1 -- 172.21.15.8:0/2559926606 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f027010e240 con 0x7f0258038db0 2024-03-16T20:47:31.259 INFO:teuthology.orchestra.run.smithi008.stdout:Added host 'smithi170' with addr '172.21.15.170' 2024-03-16T20:47:31.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:31.257+0000 7f0277600700 1 -- 172.21.15.8:0/2559926606 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0258038db0 msgr2=0x7f025803b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:31.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:31.257+0000 7f0277600700 1 --2- 172.21.15.8:0/2559926606 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0258038db0 0x7f025803b270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f025c006fd0 tx=0x7f025c006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:31.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:31.257+0000 7f0277600700 1 -- 172.21.15.8:0/2559926606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0270074410 msgr2=0x7f02701995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:31.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:31.257+0000 7f0277600700 1 --2- 172.21.15.8:0/2559926606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0270074410 0x7f02701995e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0264005850 tx=0x7f0264004ff0 comp rx=0 tx=0).stop 2024-03-16T20:47:31.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:31.258+0000 7f0277600700 1 -- 172.21.15.8:0/2559926606 shutdown_connections 2024-03-16T20:47:31.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:31.258+0000 7f0277600700 1 --2- 172.21.15.8:0/2559926606 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0258038db0 0x7f025803b270 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:31.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:31.258+0000 7f0277600700 1 --2- 172.21.15.8:0/2559926606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0270074410 0x7f02701995e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:31.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:31.258+0000 7f0277600700 1 -- 172.21.15.8:0/2559926606 >> 172.21.15.8:0/2559926606 conn(0x7f02700fd4f0 msgr2=0x7f0270105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:31.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:31.258+0000 7f0277600700 1 -- 172.21.15.8:0/2559926606 shutdown_connections 2024-03-16T20:47:31.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:31.258+0000 7f0277600700 1 -- 172.21.15.8:0/2559926606 wait complete. 2024-03-16T20:47:32.038 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch host ls --format=json 2024-03-16T20:47:32.502 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:47:32.631 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:32 smithi008 ceph-mon[31434]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:32.631 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:32 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:32.632 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:32 smithi008 ceph-mon[31434]: Added host smithi170 2024-03-16T20:47:32.632 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:32 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:47:32.632 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:32 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:33.611 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:34.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.386+0000 7f61e4400700 1 -- 172.21.15.8:0/1080404136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc108240 msgr2=0x7f61dc108620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:34.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.386+0000 7f61e4400700 1 --2- 172.21.15.8:0/1080404136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc108240 0x7f61dc108620 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009910 tx=0x7f61d0009c20 comp rx=0 tx=0).stop 2024-03-16T20:47:34.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.386+0000 7f61e4400700 1 -- 172.21.15.8:0/1080404136 shutdown_connections 2024-03-16T20:47:34.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.386+0000 7f61e4400700 1 --2- 172.21.15.8:0/1080404136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc108240 0x7f61dc108620 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:34.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.386+0000 7f61e4400700 1 -- 172.21.15.8:0/1080404136 >> 172.21.15.8:0/1080404136 conn(0x7f61dc077780 msgr2=0x7f61dc079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:34.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.386+0000 7f61e4400700 1 -- 172.21.15.8:0/1080404136 shutdown_connections 2024-03-16T20:47:34.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.387+0000 7f61e4400700 1 -- 172.21.15.8:0/1080404136 wait complete. 2024-03-16T20:47:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.388+0000 7f61e4400700 1 Processor -- start 2024-03-16T20:47:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.388+0000 7f61e4400700 1 -- start start 2024-03-16T20:47:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.388+0000 7f61e4400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc108240 0x7f61dc1a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.388+0000 7f61e4400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc1a3b60 con 0x7f61dc108240 2024-03-16T20:47:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.388+0000 7f61e1a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc108240 0x7f61dc1a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.389+0000 7f61e1a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc108240 0x7f61dc1a3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37528/0 (socket says 172.21.15.8:37528) 2024-03-16T20:47:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.389+0000 7f61e1a00700 1 -- 172.21.15.8:0/988395050 learned_addr learned my addr 172.21.15.8:0/988395050 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.389+0000 7f61e1a00700 1 -- 172.21.15.8:0/988395050 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00095f0 con 0x7f61dc108240 2024-03-16T20:47:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.389+0000 7f61e1a00700 1 --2- 172.21.15.8:0/988395050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc108240 0x7f61dc1a3620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f61d0004f40 tx=0x7f61d0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.389+0000 7f61da000700 1 -- 172.21.15.8:0/988395050 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d001d070 con 0x7f61dc108240 2024-03-16T20:47:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.390+0000 7f61da000700 1 -- 172.21.15.8:0/988395050 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f61d000be60 con 0x7f61dc108240 2024-03-16T20:47:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.390+0000 7f61e4400700 1 -- 172.21.15.8:0/988395050 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc1a3d60 con 0x7f61dc108240 2024-03-16T20:47:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.390+0000 7f61da000700 1 -- 172.21.15.8:0/988395050 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d000f460 con 0x7f61dc108240 2024-03-16T20:47:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.390+0000 7f61e4400700 1 -- 172.21.15.8:0/988395050 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc1a4180 con 0x7f61dc108240 2024-03-16T20:47:34.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.391+0000 7f61da000700 1 -- 172.21.15.8:0/988395050 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7f61d000b960 con 0x7f61dc108240 2024-03-16T20:47:34.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.391+0000 7f61e4400700 1 -- 172.21.15.8:0/988395050 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61dc109720 con 0x7f61dc108240 2024-03-16T20:47:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.391+0000 7f61da000700 1 --2- 172.21.15.8:0/988395050 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61c4038d50 0x7f61c403b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.391+0000 7f61da000700 1 -- 172.21.15.8:0/988395050 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f61d004cfe0 con 0x7f61dc108240 2024-03-16T20:47:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.392+0000 7f61e1000700 1 --2- 172.21.15.8:0/988395050 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61c4038d50 0x7f61c403b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.392+0000 7f61e1000700 1 --2- 172.21.15.8:0/988395050 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61c4038d50 0x7f61c403b210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f61c8006fd0 tx=0x7f61c8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:34.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.397+0000 7f61da000700 1 -- 172.21.15.8:0/988395050 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f61d0081280 con 0x7f61dc108240 2024-03-16T20:47:34.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:34 smithi008 ceph-mon[31434]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:34.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:34 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.630+0000 7f61e4400700 1 -- 172.21.15.8:0/988395050 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61dc112660 con 0x7f61c4038d50 2024-03-16T20:47:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.632+0000 7f61da000700 1 -- 172.21.15.8:0/988395050 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f61dc112660 con 0x7f61c4038d50 2024-03-16T20:47:34.636 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:34.636 INFO:teuthology.orchestra.run.smithi008.stdout:[{"addr": "172.21.15.8", "hostname": "smithi008", "labels": [], "status": ""}, {"addr": "172.21.15.170", "hostname": "smithi170", "labels": [], "status": ""}] 2024-03-16T20:47:34.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.635+0000 7f61e4400700 1 -- 172.21.15.8:0/988395050 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61c4038d50 msgr2=0x7f61c403b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:34.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.635+0000 7f61e4400700 1 --2- 172.21.15.8:0/988395050 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61c4038d50 0x7f61c403b210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f61c8006fd0 tx=0x7f61c8006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:34.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.635+0000 7f61e4400700 1 -- 172.21.15.8:0/988395050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc108240 msgr2=0x7f61dc1a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:34.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.635+0000 7f61e4400700 1 --2- 172.21.15.8:0/988395050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc108240 0x7f61dc1a3620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f61d0004f40 tx=0x7f61d0005020 comp rx=0 tx=0).stop 2024-03-16T20:47:34.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.635+0000 7f61e4400700 1 -- 172.21.15.8:0/988395050 shutdown_connections 2024-03-16T20:47:34.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.636+0000 7f61e4400700 1 --2- 172.21.15.8:0/988395050 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61c4038d50 0x7f61c403b210 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:34.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.636+0000 7f61e4400700 1 --2- 172.21.15.8:0/988395050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61dc108240 0x7f61dc1a3620 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:34.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.636+0000 7f61e4400700 1 -- 172.21.15.8:0/988395050 >> 172.21.15.8:0/988395050 conn(0x7f61dc077780 msgr2=0x7f61dc10fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:34.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.636+0000 7f61e4400700 1 -- 172.21.15.8:0/988395050 shutdown_connections 2024-03-16T20:47:34.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:34.636+0000 7f61e4400700 1 -- 172.21.15.8:0/988395050 wait complete. 2024-03-16T20:47:35.381 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi186 2024-03-16T20:47:35.381 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-16T20:47:35.381 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.conf 2024-03-16T20:47:35.399 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-16T20:47:35.399 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:47:35.456 INFO:tasks.cephadm:Adding host smithi186 to orchestrator... 2024-03-16T20:47:35.456 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch host add smithi186 2024-03-16T20:47:35.550 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:35 smithi008 ceph-mon[31434]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:47:35.924 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:47:36.389 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:36 smithi008 ceph-mon[31434]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:38.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.020+0000 7f9881a00700 1 -- 172.21.15.8:0/1429796350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f987c103e40 msgr2=0x7f987c104220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:38.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.020+0000 7f9881a00700 1 --2- 172.21.15.8:0/1429796350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f987c103e40 0x7f987c104220 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f986c009910 tx=0x7f986c009c20 comp rx=0 tx=0).stop 2024-03-16T20:47:38.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.020+0000 7f9881a00700 1 -- 172.21.15.8:0/1429796350 shutdown_connections 2024-03-16T20:47:38.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.020+0000 7f9881a00700 1 --2- 172.21.15.8:0/1429796350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f987c103e40 0x7f987c104220 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:38.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.020+0000 7f9881a00700 1 -- 172.21.15.8:0/1429796350 >> 172.21.15.8:0/1429796350 conn(0x7f987c0ff6f0 msgr2=0x7f987c101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:38.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.020+0000 7f9881a00700 1 -- 172.21.15.8:0/1429796350 shutdown_connections 2024-03-16T20:47:38.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.020+0000 7f9881a00700 1 -- 172.21.15.8:0/1429796350 wait complete. 2024-03-16T20:47:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.021+0000 7f9881a00700 1 Processor -- start 2024-03-16T20:47:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.022+0000 7f9881a00700 1 -- start start 2024-03-16T20:47:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.022+0000 7f9881a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f987c103e40 0x7f987c1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.022+0000 7f9881a00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c199ae0 con 0x7f987c103e40 2024-03-16T20:47:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.022+0000 7f987aa00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f987c103e40 0x7f987c1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.022+0000 7f987aa00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f987c103e40 0x7f987c1995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34594/0 (socket says 172.21.15.8:34594) 2024-03-16T20:47:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.022+0000 7f987aa00700 1 -- 172.21.15.8:0/2723772458 learned_addr learned my addr 172.21.15.8:0/2723772458 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.023+0000 7f987aa00700 1 -- 172.21.15.8:0/2723772458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0095f0 con 0x7f987c103e40 2024-03-16T20:47:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.023+0000 7f987aa00700 1 --2- 172.21.15.8:0/2723772458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f987c103e40 0x7f987c1995a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f986c004f40 tx=0x7f986c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:38.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.023+0000 7f9873400700 1 -- 172.21.15.8:0/2723772458 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f986c01d070 con 0x7f987c103e40 2024-03-16T20:47:38.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.023+0000 7f9873400700 1 -- 172.21.15.8:0/2723772458 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f986c00be60 con 0x7f987c103e40 2024-03-16T20:47:38.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.023+0000 7f9873400700 1 -- 172.21.15.8:0/2723772458 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f986c00f460 con 0x7f987c103e40 2024-03-16T20:47:38.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.023+0000 7f9881a00700 1 -- 172.21.15.8:0/2723772458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c199ce0 con 0x7f987c103e40 2024-03-16T20:47:38.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.024+0000 7f9881a00700 1 -- 172.21.15.8:0/2723772458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c19a100 con 0x7f987c103e40 2024-03-16T20:47:38.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.025+0000 7f9881a00700 1 -- 172.21.15.8:0/2723772458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c063610 con 0x7f987c103e40 2024-03-16T20:47:38.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.025+0000 7f9873400700 1 -- 172.21.15.8:0/2723772458 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7f986c022690 con 0x7f987c103e40 2024-03-16T20:47:38.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.026+0000 7f9873400700 1 --2- 172.21.15.8:0/2723772458 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9860038db0 0x7f986003b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:38.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.026+0000 7f9873400700 1 -- 172.21.15.8:0/2723772458 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f986c04cfd0 con 0x7f987c103e40 2024-03-16T20:47:38.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.026+0000 7f987a000700 1 --2- 172.21.15.8:0/2723772458 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9860038db0 0x7f986003b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:38.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.027+0000 7f987a000700 1 --2- 172.21.15.8:0/2723772458 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9860038db0 0x7f986003b270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9868006fd0 tx=0x7f9868006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:38.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.031+0000 7f9873400700 1 -- 172.21.15.8:0/2723772458 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f986c02baa0 con 0x7f987c103e40 2024-03-16T20:47:38.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:38.262+0000 7f9881a00700 1 -- 172.21.15.8:0/2723772458 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}) v1 -- 0x7f987c10e230 con 0x7f9860038db0 2024-03-16T20:47:38.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:38 smithi008 ceph-mon[31434]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:38.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:38.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:38.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:38.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:38.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:47:38.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:47:38.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:47:38.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:38 smithi008 ceph-mon[31434]: Updating smithi170:/etc/ceph/ceph.conf 2024-03-16T20:47:38.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:38 smithi008 ceph-mon[31434]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:47:38.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:38 smithi008 ceph-mon[31434]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:47:39.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:39 smithi008 ceph-mon[31434]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:47:39.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:39 smithi008 ceph-mon[31434]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:47:39.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:39.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:39.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:40.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:40 smithi008 ceph-mon[31434]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:40.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:40 smithi008 ceph-mon[31434]: Deploying cephadm binary to smithi186 2024-03-16T20:47:42.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:42 smithi008 ceph-mon[31434]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:43.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:43.245+0000 7f9873400700 1 -- 172.21.15.8:0/2723772458 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f987c10e230 con 0x7f9860038db0 2024-03-16T20:47:43.249 INFO:teuthology.orchestra.run.smithi008.stdout:Added host 'smithi186' with addr '172.21.15.186' 2024-03-16T20:47:43.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:43.250+0000 7f9881a00700 1 -- 172.21.15.8:0/2723772458 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9860038db0 msgr2=0x7f986003b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:43.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:43.250+0000 7f9881a00700 1 --2- 172.21.15.8:0/2723772458 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9860038db0 0x7f986003b270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9868006fd0 tx=0x7f9868006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:43.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:43.250+0000 7f9881a00700 1 -- 172.21.15.8:0/2723772458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f987c103e40 msgr2=0x7f987c1995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:43.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:43.250+0000 7f9881a00700 1 --2- 172.21.15.8:0/2723772458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f987c103e40 0x7f987c1995a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f986c004f40 tx=0x7f986c005020 comp rx=0 tx=0).stop 2024-03-16T20:47:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:43.250+0000 7f9881a00700 1 -- 172.21.15.8:0/2723772458 shutdown_connections 2024-03-16T20:47:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:43.250+0000 7f9881a00700 1 --2- 172.21.15.8:0/2723772458 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9860038db0 0x7f986003b270 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:43.250+0000 7f9881a00700 1 --2- 172.21.15.8:0/2723772458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f987c103e40 0x7f987c1995a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:43.250+0000 7f9881a00700 1 -- 172.21.15.8:0/2723772458 >> 172.21.15.8:0/2723772458 conn(0x7f987c0ff6f0 msgr2=0x7f987c105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:43.251+0000 7f9881a00700 1 -- 172.21.15.8:0/2723772458 shutdown_connections 2024-03-16T20:47:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:43.251+0000 7f9881a00700 1 -- 172.21.15.8:0/2723772458 wait complete. 2024-03-16T20:47:44.039 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch host ls --format=json 2024-03-16T20:47:44.495 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:47:44.650 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:44 smithi008 ceph-mon[31434]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:44.650 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:44.650 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:44 smithi008 ceph-mon[31434]: Added host smithi186 2024-03-16T20:47:44.650 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:47:44.650 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:45.637 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:45 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:46.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.376+0000 7fb495200700 1 -- 172.21.15.8:0/3009054873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4901028e0 msgr2=0x7fb4900ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.376+0000 7fb495200700 1 --2- 172.21.15.8:0/3009054873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4901028e0 0x7fb4900ffed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb480009910 tx=0x7fb480009c20 comp rx=0 tx=0).stop 2024-03-16T20:47:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.376+0000 7fb495200700 1 -- 172.21.15.8:0/3009054873 shutdown_connections 2024-03-16T20:47:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.376+0000 7fb495200700 1 --2- 172.21.15.8:0/3009054873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4901028e0 0x7fb4900ffed0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.376+0000 7fb495200700 1 -- 172.21.15.8:0/3009054873 >> 172.21.15.8:0/3009054873 conn(0x7fb4900fbb30 msgr2=0x7fb4900fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.376+0000 7fb495200700 1 -- 172.21.15.8:0/3009054873 shutdown_connections 2024-03-16T20:47:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.376+0000 7fb495200700 1 -- 172.21.15.8:0/3009054873 wait complete. 2024-03-16T20:47:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.378+0000 7fb495200700 1 Processor -- start 2024-03-16T20:47:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.378+0000 7fb495200700 1 -- start start 2024-03-16T20:47:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.378+0000 7fb495200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4901028e0 0x7fb490199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.378+0000 7fb495200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb490199ad0 con 0x7fb4901028e0 2024-03-16T20:47:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.379+0000 7fb48de00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4901028e0 0x7fb490199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.379+0000 7fb48de00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4901028e0 0x7fb490199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34618/0 (socket says 172.21.15.8:34618) 2024-03-16T20:47:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.379+0000 7fb48de00700 1 -- 172.21.15.8:0/2157356533 learned_addr learned my addr 172.21.15.8:0/2157356533 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.379+0000 7fb48de00700 1 -- 172.21.15.8:0/2157356533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800095f0 con 0x7fb4901028e0 2024-03-16T20:47:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.380+0000 7fb48de00700 1 --2- 172.21.15.8:0/2157356533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4901028e0 0x7fb490199590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb480005850 tx=0x7fb480004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.380+0000 7fb486a00700 1 -- 172.21.15.8:0/2157356533 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb48001d070 con 0x7fb4901028e0 2024-03-16T20:47:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.380+0000 7fb486a00700 1 -- 172.21.15.8:0/2157356533 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb48000be60 con 0x7fb4901028e0 2024-03-16T20:47:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.380+0000 7fb486a00700 1 -- 172.21.15.8:0/2157356533 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb48000f460 con 0x7fb4901028e0 2024-03-16T20:47:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.380+0000 7fb495200700 1 -- 172.21.15.8:0/2157356533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb490199cd0 con 0x7fb4901028e0 2024-03-16T20:47:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.380+0000 7fb495200700 1 -- 172.21.15.8:0/2157356533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49019a0f0 con 0x7fb4901028e0 2024-03-16T20:47:46.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.382+0000 7fb495200700 1 -- 172.21.15.8:0/2157356533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb490063610 con 0x7fb4901028e0 2024-03-16T20:47:46.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.382+0000 7fb486a00700 1 -- 172.21.15.8:0/2157356533 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7fb480022690 con 0x7fb4901028e0 2024-03-16T20:47:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.383+0000 7fb486a00700 1 --2- 172.21.15.8:0/2157356533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb474038db0 0x7fb47403b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.383+0000 7fb486a00700 1 -- 172.21.15.8:0/2157356533 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb48004cf40 con 0x7fb4901028e0 2024-03-16T20:47:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.383+0000 7fb48d400700 1 --2- 172.21.15.8:0/2157356533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb474038db0 0x7fb47403b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.384+0000 7fb48d400700 1 --2- 172.21.15.8:0/2157356533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb474038db0 0x7fb47403b270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb47c006fd0 tx=0x7fb47c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:46.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.388+0000 7fb486a00700 1 -- 172.21.15.8:0/2157356533 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb48002a360 con 0x7fb4901028e0 2024-03-16T20:47:46.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:46 smithi008 ceph-mon[31434]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:46.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:46.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.627+0000 7fb495200700 1 -- 172.21.15.8:0/2157356533 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb49010e290 con 0x7fb474038db0 2024-03-16T20:47:46.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.630+0000 7fb486a00700 1 -- 172.21.15.8:0/2157356533 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7fb49010e290 con 0x7fb474038db0 2024-03-16T20:47:46.633 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:47:46.633 INFO:teuthology.orchestra.run.smithi008.stdout:[{"addr": "172.21.15.8", "hostname": "smithi008", "labels": [], "status": ""}, {"addr": "172.21.15.170", "hostname": "smithi170", "labels": [], "status": ""}, {"addr": "172.21.15.186", "hostname": "smithi186", "labels": [], "status": ""}] 2024-03-16T20:47:46.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.632+0000 7fb495200700 1 -- 172.21.15.8:0/2157356533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb474038db0 msgr2=0x7fb47403b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:46.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.632+0000 7fb495200700 1 --2- 172.21.15.8:0/2157356533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb474038db0 0x7fb47403b270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb47c006fd0 tx=0x7fb47c006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:46.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.632+0000 7fb495200700 1 -- 172.21.15.8:0/2157356533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4901028e0 msgr2=0x7fb490199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:46.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.632+0000 7fb495200700 1 --2- 172.21.15.8:0/2157356533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4901028e0 0x7fb490199590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb480005850 tx=0x7fb480004ff0 comp rx=0 tx=0).stop 2024-03-16T20:47:46.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.633+0000 7fb495200700 1 -- 172.21.15.8:0/2157356533 shutdown_connections 2024-03-16T20:47:46.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.633+0000 7fb495200700 1 --2- 172.21.15.8:0/2157356533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb474038db0 0x7fb47403b270 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:46.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.633+0000 7fb495200700 1 --2- 172.21.15.8:0/2157356533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4901028e0 0x7fb490199590 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:46.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.633+0000 7fb495200700 1 -- 172.21.15.8:0/2157356533 >> 172.21.15.8:0/2157356533 conn(0x7fb4900fbb30 msgr2=0x7fb4900fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:46.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.633+0000 7fb495200700 1 -- 172.21.15.8:0/2157356533 shutdown_connections 2024-03-16T20:47:46.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:46.633+0000 7fb495200700 1 -- 172.21.15.8:0/2157356533 wait complete. 2024-03-16T20:47:47.332 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-16T20:47:47.333 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd crush tunables default 2024-03-16T20:47:47.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:47 smithi008 ceph-mon[31434]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:47:47.787 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:47:48.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:48 smithi008 ceph-mon[31434]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:49.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.713+0000 7fc7a4200700 1 -- 172.21.15.8:0/844905296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c103e40 msgr2=0x7fc79c104220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:49.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.713+0000 7fc7a4200700 1 --2- 172.21.15.8:0/844905296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c103e40 0x7fc79c104220 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc790009910 tx=0x7fc790009c20 comp rx=0 tx=0).stop 2024-03-16T20:47:49.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.713+0000 7fc7a4200700 1 -- 172.21.15.8:0/844905296 shutdown_connections 2024-03-16T20:47:49.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.713+0000 7fc7a4200700 1 --2- 172.21.15.8:0/844905296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c103e40 0x7fc79c104220 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:49.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.713+0000 7fc7a4200700 1 -- 172.21.15.8:0/844905296 >> 172.21.15.8:0/844905296 conn(0x7fc79c0ff6f0 msgr2=0x7fc79c101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:49.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.713+0000 7fc7a4200700 1 -- 172.21.15.8:0/844905296 shutdown_connections 2024-03-16T20:47:49.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.713+0000 7fc7a4200700 1 -- 172.21.15.8:0/844905296 wait complete. 2024-03-16T20:47:49.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.714+0000 7fc7a4200700 1 Processor -- start 2024-03-16T20:47:49.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.715+0000 7fc7a4200700 1 -- start start 2024-03-16T20:47:49.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.715+0000 7fc7a4200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c103e40 0x7fc79c1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:49.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.715+0000 7fc7a4200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c199b20 con 0x7fc79c103e40 2024-03-16T20:47:49.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.715+0000 7fc7a1800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c103e40 0x7fc79c1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:49.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.715+0000 7fc7a1800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c103e40 0x7fc79c1995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57908/0 (socket says 172.21.15.8:57908) 2024-03-16T20:47:49.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.715+0000 7fc7a1800700 1 -- 172.21.15.8:0/4074118533 learned_addr learned my addr 172.21.15.8:0/4074118533 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:47:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.716+0000 7fc7a1800700 1 -- 172.21.15.8:0/4074118533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7900095f0 con 0x7fc79c103e40 2024-03-16T20:47:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.716+0000 7fc7a1800700 1 --2- 172.21.15.8:0/4074118533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c103e40 0x7fc79c1995e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc790004f40 tx=0x7fc790005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.716+0000 7fc79a000700 1 -- 172.21.15.8:0/4074118533 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc79001d070 con 0x7fc79c103e40 2024-03-16T20:47:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.717+0000 7fc79a000700 1 -- 172.21.15.8:0/4074118533 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc79000be60 con 0x7fc79c103e40 2024-03-16T20:47:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.717+0000 7fc79a000700 1 -- 172.21.15.8:0/4074118533 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc79000f460 con 0x7fc79c103e40 2024-03-16T20:47:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.717+0000 7fc7a4200700 1 -- 172.21.15.8:0/4074118533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c199d20 con 0x7fc79c103e40 2024-03-16T20:47:49.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.717+0000 7fc7a4200700 1 -- 172.21.15.8:0/4074118533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c19a140 con 0x7fc79c103e40 2024-03-16T20:47:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.718+0000 7fc7a4200700 1 -- 172.21.15.8:0/4074118533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c063610 con 0x7fc79c103e40 2024-03-16T20:47:49.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.718+0000 7fc79a000700 1 -- 172.21.15.8:0/4074118533 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7fc79000b960 con 0x7fc79c103e40 2024-03-16T20:47:49.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.719+0000 7fc79a000700 1 --2- 172.21.15.8:0/4074118533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc784038db0 0x7fc78403b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:49.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.719+0000 7fc79a000700 1 -- 172.21.15.8:0/4074118533 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc79004cf90 con 0x7fc79c103e40 2024-03-16T20:47:49.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.719+0000 7fc7a0e00700 1 --2- 172.21.15.8:0/4074118533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc784038db0 0x7fc78403b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:49.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.720+0000 7fc7a0e00700 1 --2- 172.21.15.8:0/4074118533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc784038db0 0x7fc78403b270 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc788006fd0 tx=0x7fc788006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:49.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.724+0000 7fc79a000700 1 -- 172.21.15.8:0/4074118533 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc79002bda0 con 0x7fc79c103e40 2024-03-16T20:47:49.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:49.959+0000 7fc7a4200700 1 -- 172.21.15.8:0/4074118533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc79c10e1c0 con 0x7fc79c103e40 2024-03-16T20:47:50.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:50.355+0000 7fc79a000700 1 -- 172.21.15.8:0/4074118533 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc790027070 con 0x7fc79c103e40 2024-03-16T20:47:50.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:50.359+0000 7fc7a4200700 1 -- 172.21.15.8:0/4074118533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc784038db0 msgr2=0x7fc78403b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:50.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:50.359+0000 7fc7a4200700 1 --2- 172.21.15.8:0/4074118533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc784038db0 0x7fc78403b270 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc788006fd0 tx=0x7fc788006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:50.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:50.359+0000 7fc7a4200700 1 -- 172.21.15.8:0/4074118533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c103e40 msgr2=0x7fc79c1995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:50.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:50.359+0000 7fc7a4200700 1 --2- 172.21.15.8:0/4074118533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c103e40 0x7fc79c1995e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc790004f40 tx=0x7fc790005020 comp rx=0 tx=0).stop 2024-03-16T20:47:50.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:50.359+0000 7fc7a4200700 1 -- 172.21.15.8:0/4074118533 shutdown_connections 2024-03-16T20:47:50.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:50.359+0000 7fc7a4200700 1 --2- 172.21.15.8:0/4074118533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc784038db0 0x7fc78403b270 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:50.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:50.359+0000 7fc7a4200700 1 --2- 172.21.15.8:0/4074118533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc79c103e40 0x7fc79c1995e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:50.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:50.359+0000 7fc7a4200700 1 -- 172.21.15.8:0/4074118533 >> 172.21.15.8:0/4074118533 conn(0x7fc79c0ff6f0 msgr2=0x7fc79c105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:50.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:50.359+0000 7fc7a4200700 1 -- 172.21.15.8:0/4074118533 shutdown_connections 2024-03-16T20:47:50.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:47:50.359+0000 7fc7a4200700 1 -- 172.21.15.8:0/4074118533 wait complete. 2024-03-16T20:47:50.365 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2024-03-16T20:47:50.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:50 smithi008 ceph-mon[31434]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:47:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:47:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:47:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:50 smithi008 ceph-mon[31434]: Updating smithi186:/etc/ceph/ceph.conf 2024-03-16T20:47:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:50 smithi008 ceph-mon[31434]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:47:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:50 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/4074118533' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-16T20:47:51.153 INFO:tasks.cephadm:Adding mon.a on smithi008 2024-03-16T20:47:51.153 INFO:tasks.cephadm:Adding mon.b on smithi170 2024-03-16T20:47:51.153 INFO:tasks.cephadm:Adding mon.c on smithi186 2024-03-16T20:47:51.154 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch apply mon '3;smithi008:172.21.15.8=a;smithi170:172.21.15.170=b;smithi186:172.21.15.186=c' 2024-03-16T20:47:51.380 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:47:51.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:51 smithi008 ceph-mon[31434]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:47:51.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:51 smithi008 ceph-mon[31434]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:47:51.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:51 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/4074118533' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-16T20:47:51.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:51 smithi008 ceph-mon[31434]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T20:47:51.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:51.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:51.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:52.723 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.719+0000 7f0c3168a700 1 -- 172.21.15.186:0/1748833728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c1068b0 msgr2=0x7f0c2c106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:52.723 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.719+0000 7f0c3168a700 1 --2- 172.21.15.186:0/1748833728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c1068b0 0x7f0c2c106c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009910 tx=0x7f0c1c009c20 comp rx=0 tx=0).stop 2024-03-16T20:47:52.723 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.719+0000 7f0c3168a700 1 -- 172.21.15.186:0/1748833728 shutdown_connections 2024-03-16T20:47:52.723 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.719+0000 7f0c3168a700 1 --2- 172.21.15.186:0/1748833728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c1068b0 0x7f0c2c106c90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:52.723 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.719+0000 7f0c3168a700 1 -- 172.21.15.186:0/1748833728 >> 172.21.15.186:0/1748833728 conn(0x7f0c2c0fc3a0 msgr2=0x7f0c2c0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:52.724 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.719+0000 7f0c3168a700 1 -- 172.21.15.186:0/1748833728 shutdown_connections 2024-03-16T20:47:52.724 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.719+0000 7f0c3168a700 1 -- 172.21.15.186:0/1748833728 wait complete. 2024-03-16T20:47:52.724 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.720+0000 7f0c3168a700 1 Processor -- start 2024-03-16T20:47:52.725 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.720+0000 7f0c3168a700 1 -- start start 2024-03-16T20:47:52.725 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.721+0000 7f0c3168a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c1068b0 0x7f0c2c196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:52.725 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.721+0000 7f0c3168a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c196750 con 0x7f0c2c1068b0 2024-03-16T20:47:52.725 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.721+0000 7f0c2affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c1068b0 0x7f0c2c196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:52.725 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.721+0000 7f0c2affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c1068b0 0x7f0c2c196210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.186:50948/0 (socket says 172.21.15.186:50948) 2024-03-16T20:47:52.725 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.721+0000 7f0c2affd700 1 -- 172.21.15.186:0/524340636 learned_addr learned my addr 172.21.15.186:0/524340636 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-16T20:47:52.725 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.722+0000 7f0c2affd700 1 -- 172.21.15.186:0/524340636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c0095f0 con 0x7f0c2c1068b0 2024-03-16T20:47:52.725 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.722+0000 7f0c2affd700 1 --2- 172.21.15.186:0/524340636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c1068b0 0x7f0c2c196210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c004f40 tx=0x7f0c1c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:52.726 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.722+0000 7f0c13fff700 1 -- 172.21.15.186:0/524340636 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c1c01d070 con 0x7f0c2c1068b0 2024-03-16T20:47:52.726 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.722+0000 7f0c3168a700 1 -- 172.21.15.186:0/524340636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2c1969b0 con 0x7f0c2c1068b0 2024-03-16T20:47:52.726 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.723+0000 7f0c3168a700 1 -- 172.21.15.186:0/524340636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2c196e30 con 0x7f0c2c1068b0 2024-03-16T20:47:52.726 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.723+0000 7f0c13fff700 1 -- 172.21.15.186:0/524340636 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0c1c00be60 con 0x7f0c2c1068b0 2024-03-16T20:47:52.726 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.723+0000 7f0c13fff700 1 -- 172.21.15.186:0/524340636 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c1c00f460 con 0x7f0c2c1068b0 2024-03-16T20:47:52.727 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.723+0000 7f0c3168a700 1 -- 172.21.15.186:0/524340636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2c063610 con 0x7f0c2c1068b0 2024-03-16T20:47:52.727 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.724+0000 7f0c13fff700 1 -- 172.21.15.186:0/524340636 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7f0c1c022720 con 0x7f0c2c1068b0 2024-03-16T20:47:52.728 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.724+0000 7f0c13fff700 1 --2- 172.21.15.186:0/524340636 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0c14038d50 0x7f0c1403b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:52.728 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.724+0000 7f0c13fff700 1 -- 172.21.15.186:0/524340636 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0c1c04cdc0 con 0x7f0c2c1068b0 2024-03-16T20:47:52.728 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.725+0000 7f0c2a7fc700 1 --2- 172.21.15.186:0/524340636 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0c14038d50 0x7f0c1403b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:52.729 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.726+0000 7f0c2a7fc700 1 --2- 172.21.15.186:0/524340636 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0c14038d50 0x7f0c1403b210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c20006fd0 tx=0x7f0c20006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:52.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:52 smithi008 ceph-mon[31434]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:52.743 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.740+0000 7f0c13fff700 1 -- 172.21.15.186:0/524340636 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0c1c00b960 con 0x7f0c2c1068b0 2024-03-16T20:47:52.952 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.949+0000 7f0c3168a700 1 -- 172.21.15.186:0/524340636 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi170:172.21.15.170=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c2c10afe0 con 0x7f0c14038d50 2024-03-16T20:47:52.968 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.965+0000 7f0c13fff700 1 -- 172.21.15.186:0/524340636 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f0c2c10afe0 con 0x7f0c14038d50 2024-03-16T20:47:52.969 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mon update... 2024-03-16T20:47:52.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.967+0000 7f0c3168a700 1 -- 172.21.15.186:0/524340636 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0c14038d50 msgr2=0x7f0c1403b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:52.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.967+0000 7f0c3168a700 1 --2- 172.21.15.186:0/524340636 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0c14038d50 0x7f0c1403b210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c20006fd0 tx=0x7f0c20006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:52.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.967+0000 7f0c3168a700 1 -- 172.21.15.186:0/524340636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c1068b0 msgr2=0x7f0c2c196210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:52.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.967+0000 7f0c3168a700 1 --2- 172.21.15.186:0/524340636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c1068b0 0x7f0c2c196210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c004f40 tx=0x7f0c1c005020 comp rx=0 tx=0).stop 2024-03-16T20:47:52.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.967+0000 7f0c3168a700 1 -- 172.21.15.186:0/524340636 shutdown_connections 2024-03-16T20:47:52.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.967+0000 7f0c3168a700 1 --2- 172.21.15.186:0/524340636 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0c14038d50 0x7f0c1403b210 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:52.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.967+0000 7f0c3168a700 1 --2- 172.21.15.186:0/524340636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c1068b0 0x7f0c2c196210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:52.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.967+0000 7f0c3168a700 1 -- 172.21.15.186:0/524340636 >> 172.21.15.186:0/524340636 conn(0x7f0c2c0fc3a0 msgr2=0x7f0c2c108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:52.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.967+0000 7f0c3168a700 1 -- 172.21.15.186:0/524340636 shutdown_connections 2024-03-16T20:47:52.971 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:52.967+0000 7f0c3168a700 1 -- 172.21.15.186:0/524340636 wait complete. 2024-03-16T20:47:53.510 DEBUG:teuthology.orchestra.run.smithi170:mon.b> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.b.service 2024-03-16T20:47:53.513 DEBUG:teuthology.orchestra.run.smithi186:mon.c> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.c.service 2024-03-16T20:47:53.515 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-16T20:47:53.515 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-16T20:47:54.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:53 smithi008 ceph-mon[31434]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi170:172.21.15.170=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:47:54.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:53 smithi008 ceph-mon[31434]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi170:172.21.15.170=b;smithi186:172.21.15.186=c;count:3 2024-03-16T20:47:54.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:53 smithi008 ceph-mon[31434]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:54.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:53 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:54.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:53 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:47:54.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:53 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:47:54.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:53 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:47:54.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:53 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:54.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:53 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:47:54.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:53 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:47:54.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:53 smithi008 ceph-mon[31434]: Deploying daemon mon.c on smithi186 2024-03-16T20:47:55.044 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:47:56.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:55 smithi008 ceph-mon[31434]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:56.384 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.380+0000 7feb29ce7700 1 -- 172.21.15.186:0/2111915742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb24102bb0 msgr2=0x7feb24102f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:56.384 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.380+0000 7feb29ce7700 1 --2- 172.21.15.186:0/2111915742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb24102bb0 0x7feb24102f90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feb1400b0a0 tx=0x7feb1400b3b0 comp rx=0 tx=0).stop 2024-03-16T20:47:56.384 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.380+0000 7feb29ce7700 1 -- 172.21.15.186:0/2111915742 shutdown_connections 2024-03-16T20:47:56.384 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.380+0000 7feb29ce7700 1 --2- 172.21.15.186:0/2111915742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb24102bb0 0x7feb24102f90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:56.384 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.380+0000 7feb29ce7700 1 -- 172.21.15.186:0/2111915742 >> 172.21.15.186:0/2111915742 conn(0x7feb240fc420 msgr2=0x7feb240fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:56.384 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.380+0000 7feb29ce7700 1 -- 172.21.15.186:0/2111915742 shutdown_connections 2024-03-16T20:47:56.384 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.380+0000 7feb29ce7700 1 -- 172.21.15.186:0/2111915742 wait complete. 2024-03-16T20:47:56.385 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.381+0000 7feb29ce7700 1 Processor -- start 2024-03-16T20:47:56.385 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.381+0000 7feb29ce7700 1 -- start start 2024-03-16T20:47:56.385 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.381+0000 7feb29ce7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb24102bb0 0x7feb24100810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:56.386 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.381+0000 7feb29ce7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb241026b0 con 0x7feb24102bb0 2024-03-16T20:47:56.386 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.382+0000 7feb237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb24102bb0 0x7feb24100810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:56.386 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.382+0000 7feb237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb24102bb0 0x7feb24100810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.186:50962/0 (socket says 172.21.15.186:50962) 2024-03-16T20:47:56.386 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.382+0000 7feb237fe700 1 -- 172.21.15.186:0/320062543 learned_addr learned my addr 172.21.15.186:0/320062543 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-16T20:47:56.386 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.382+0000 7feb237fe700 1 -- 172.21.15.186:0/320062543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14009d00 con 0x7feb24102bb0 2024-03-16T20:47:56.387 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.382+0000 7feb237fe700 1 --2- 172.21.15.186:0/320062543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb24102bb0 0x7feb24100810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb14015040 tx=0x7feb14003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:56.387 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.383+0000 7feb20ff9700 1 -- 172.21.15.186:0/320062543 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb1400e040 con 0x7feb24102bb0 2024-03-16T20:47:56.387 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.383+0000 7feb29ce7700 1 -- 172.21.15.186:0/320062543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb24100d50 con 0x7feb24102bb0 2024-03-16T20:47:56.387 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.383+0000 7feb29ce7700 1 -- 172.21.15.186:0/320062543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb24101170 con 0x7feb24102bb0 2024-03-16T20:47:56.387 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.383+0000 7feb20ff9700 1 -- 172.21.15.186:0/320062543 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7feb14007b70 con 0x7feb24102bb0 2024-03-16T20:47:56.387 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.383+0000 7feb20ff9700 1 -- 172.21.15.186:0/320062543 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb1401d480 con 0x7feb24102bb0 2024-03-16T20:47:56.388 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.384+0000 7feb29ce7700 1 -- 172.21.15.186:0/320062543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb24063610 con 0x7feb24102bb0 2024-03-16T20:47:56.388 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.384+0000 7feb20ff9700 1 -- 172.21.15.186:0/320062543 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7feb14004040 con 0x7feb24102bb0 2024-03-16T20:47:56.388 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.384+0000 7feb20ff9700 1 --2- 172.21.15.186:0/320062543 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb0c038da0 0x7feb0c03b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:47:56.388 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.385+0000 7feb20ff9700 1 -- 172.21.15.186:0/320062543 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7feb1404d9b0 con 0x7feb24102bb0 2024-03-16T20:47:56.388 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.385+0000 7feb22ffd700 1 --2- 172.21.15.186:0/320062543 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb0c038da0 0x7feb0c03b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:47:56.389 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.386+0000 7feb22ffd700 1 --2- 172.21.15.186:0/320062543 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb0c038da0 0x7feb0c03b260 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb18006fd0 tx=0x7feb18006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:47:56.403 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.400+0000 7feb20ff9700 1 -- 172.21.15.186:0/320062543 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7feb1401aaa0 con 0x7feb24102bb0 2024-03-16T20:47:56.680 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.676+0000 7feb29ce7700 1 -- 172.21.15.186:0/320062543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feb2410c060 con 0x7feb24102bb0 2024-03-16T20:47:56.681 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.677+0000 7feb20ff9700 1 -- 172.21.15.186:0/320062543 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+741 (secure 0 0 0) 0x7feb14017020 con 0x7feb24102bb0 2024-03-16T20:47:56.681 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:47:56.681 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":1,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","modified":"2024-03-16T20:45:49.514457Z","created":"2024-03-16T20:45:49.514457Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-16T20:47:56.683 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.679+0000 7feb29ce7700 1 -- 172.21.15.186:0/320062543 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb0c038da0 msgr2=0x7feb0c03b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:56.683 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.679+0000 7feb29ce7700 1 --2- 172.21.15.186:0/320062543 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb0c038da0 0x7feb0c03b260 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb18006fd0 tx=0x7feb18006e40 comp rx=0 tx=0).stop 2024-03-16T20:47:56.683 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.679+0000 7feb29ce7700 1 -- 172.21.15.186:0/320062543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb24102bb0 msgr2=0x7feb24100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:47:56.683 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.679+0000 7feb29ce7700 1 --2- 172.21.15.186:0/320062543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb24102bb0 0x7feb24100810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb14015040 tx=0x7feb14003ce0 comp rx=0 tx=0).stop 2024-03-16T20:47:56.683 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.679+0000 7feb29ce7700 1 -- 172.21.15.186:0/320062543 shutdown_connections 2024-03-16T20:47:56.683 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.679+0000 7feb29ce7700 1 --2- 172.21.15.186:0/320062543 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb0c038da0 0x7feb0c03b260 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:56.683 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.679+0000 7feb29ce7700 1 --2- 172.21.15.186:0/320062543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb24102bb0 0x7feb24100810 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:47:56.683 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.679+0000 7feb29ce7700 1 -- 172.21.15.186:0/320062543 >> 172.21.15.186:0/320062543 conn(0x7feb240fc420 msgr2=0x7feb24103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:47:56.684 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.680+0000 7feb29ce7700 1 -- 172.21.15.186:0/320062543 shutdown_connections 2024-03-16T20:47:56.684 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:47:56.680+0000 7feb29ce7700 1 -- 172.21.15.186:0/320062543 wait complete. 2024-03-16T20:47:56.684 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 1 2024-03-16T20:47:57.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:56 smithi008 ceph-mon[31434]: from='client.? 172.21.15.186:0/320062543' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-16T20:47:58.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:47:57 smithi008 ceph-mon[31434]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.335 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(???) e0 preinit fsid 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:47:58.409 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-16T20:47:58.410 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-16T20:47:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 bash[36372]: b5ace1e8043133bd506862b36b67385c1aa439c8fe4ee26e4084d932a1a4d6a6 2024-03-16T20:47:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).mds e1 new map 2024-03-16T20:47:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).mds e1 print_map 2024-03-16T20:47:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout: e1 2024-03-16T20:47:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-16T20:47:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-16T20:47:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout: legacy client fscid: -1 2024-03-16T20:47:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout: 2024-03-16T20:47:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout: No filesystems configured 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:47:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi170", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Deploying cephadm binary to smithi170 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Added host smithi170 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:47:58.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.646 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.646 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.646 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Updating smithi170:/etc/ceph/ceph.conf 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:47:58.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 systemd[1]: Started Ceph mon.c for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Deploying cephadm binary to smithi186 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Added host smithi186 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.649 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Updating smithi186:/etc/ceph/ceph.conf 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/4074118533' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/4074118533' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi170:172.21.15.170=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi170:172.21.15.170=b;smithi186:172.21.15.186=c;count:3 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: Deploying daemon mon.c on smithi186 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: from='client.? 172.21.15.186:0/320062543' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-16T20:47:58.652 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:47:58.652 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:47:58 smithi186 ceph-mon[36391]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-16T20:47:58.652 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:48:03.700 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.695+0000 7f7361107700 1 -- 172.21.15.186:0/3829152167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73440035c0 msgr2=0x7f7344005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:03.700 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.695+0000 7f7361107700 1 --2- 172.21.15.186:0/3829152167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73440035c0 0x7f7344005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f735c100910 tx=0x7f7354009e80 comp rx=0 tx=0).stop 2024-03-16T20:48:03.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.695+0000 7f7361107700 1 -- 172.21.15.186:0/3829152167 shutdown_connections 2024-03-16T20:48:03.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.695+0000 7f7361107700 1 --2- 172.21.15.186:0/3829152167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73440035c0 0x7f7344005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:03.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.695+0000 7f7361107700 1 -- 172.21.15.186:0/3829152167 >> 172.21.15.186:0/3829152167 conn(0x7f735c0fc4f0 msgr2=0x7f735c0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:03.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.695+0000 7f7361107700 1 -- 172.21.15.186:0/3829152167 shutdown_connections 2024-03-16T20:48:03.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.695+0000 7f7361107700 1 -- 172.21.15.186:0/3829152167 wait complete. 2024-03-16T20:48:03.701 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:48:03.701 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.701 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: mon.a calling monitor election 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: mon.c calling monitor election 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: fsmap 2024-03-16T20:48:03.702 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T20:48:03.703 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: mgrmap e13: x(active, since 60s) 2024-03-16T20:48:03.703 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: overall HEALTH_OK 2024-03-16T20:48:03.703 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:03.703 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:03.703 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:03.703 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:48:03.703 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:03.704 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.696+0000 7f7361107700 1 Processor -- start 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.697+0000 7f7361107700 1 -- start start 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.697+0000 7f7361107700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73440035c0 0x7f735c1025b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.697+0000 7f7361107700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f735c102af0 0x7f735c102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.697+0000 7f7361107700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1044a0 con 0x7f73440035c0 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.697+0000 7f7361107700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1a3690 con 0x7f735c102af0 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.698+0000 7f735a59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f735c102af0 0x7f735c102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.698+0000 7f735a59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f735c102af0 0x7f735c102f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:47036/0 (socket says 172.21.15.186:47036) 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.698+0000 7f735a59c700 1 -- 172.21.15.186:0/1681418778 learned_addr learned my addr 172.21.15.186:0/1681418778 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.698+0000 7f735a59c700 1 -- 172.21.15.186:0/1681418778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f735c102af0 msgr2=0x7f735c102f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.698+0000 7f735a59c700 1 -- 172.21.15.186:0/1681418778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f735c102af0 msgr2=0x7f735c102f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.698+0000 7f735a59c700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f735c102af0 0x7f735c102f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T20:48:03.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.698+0000 7f735ad9d700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73440035c0 0x7f735c1025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:03.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.698+0000 7f735a59c700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f735c102af0 0x7f735c102f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T20:48:03.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.698+0000 7f735ad9d700 1 -- 172.21.15.186:0/1681418778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f735c102af0 msgr2=0x7f735c102f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T20:48:03.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.698+0000 7f735ad9d700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f735c102af0 0x7f735c102f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:03.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.699+0000 7f735ad9d700 1 -- 172.21.15.186:0/1681418778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540098d0 con 0x7f73440035c0 2024-03-16T20:48:03.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.699+0000 7f735ad9d700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73440035c0 0x7f735c1025b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f735401f000 tx=0x7f7354019cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:03.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.699+0000 7f7343fff700 1 -- 172.21.15.186:0/1681418778 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f7354004e00 con 0x7f73440035c0 2024-03-16T20:48:03.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.699+0000 7f7361107700 1 -- 172.21.15.186:0/1681418778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735c1a37d0 con 0x7f73440035c0 2024-03-16T20:48:03.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.700+0000 7f7361107700 1 -- 172.21.15.186:0/1681418778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c1a3c90 con 0x7f73440035c0 2024-03-16T20:48:03.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.700+0000 7f7343fff700 1 -- 172.21.15.186:0/1681418778 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7354021a80 con 0x7f73440035c0 2024-03-16T20:48:03.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.700+0000 7f7343fff700 1 -- 172.21.15.186:0/1681418778 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f73540054c0 con 0x7f73440035c0 2024-03-16T20:48:03.707 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.701+0000 7f7361107700 1 -- 172.21.15.186:0/1681418778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7344002140 con 0x7f73440035c0 2024-03-16T20:48:03.707 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.701+0000 7f7343fff700 1 -- 172.21.15.186:0/1681418778 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7f7354021bf0 con 0x7f73440035c0 2024-03-16T20:48:03.707 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.701+0000 7f7343fff700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f7348038b60 0x7f734803b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:03.707 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.701+0000 7f7343fff700 1 -- 172.21.15.186:0/1681418778 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f735404e590 con 0x7f73440035c0 2024-03-16T20:48:03.708 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.702+0000 7f735a59c700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f7348038b60 0x7f734803b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:03.708 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.703+0000 7f735a59c700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f7348038b60 0x7f734803b020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7350009180 tx=0x7f7350008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:03.721 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:03.716+0000 7f7343fff700 1 -- 172.21.15.186:0/1681418778 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7354005620 con 0x7f73440035c0 2024-03-16T20:48:03.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:48:03.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: mon.a calling monitor election 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: mon.c calling monitor election 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: fsmap 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: mgrmap e13: x(active, since 60s) 2024-03-16T20:48:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: overall HEALTH_OK 2024-03-16T20:48:03.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:03.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:03.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:03.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:48:03.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:04.011 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.006+0000 7f7361107700 1 -- 172.21.15.186:0/1681418778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7344003400 con 0x7f73440035c0 2024-03-16T20:48:04.012 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.007+0000 7f7343fff700 1 -- 172.21.15.186:0/1681418778 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1011 (secure 0 0 0) 0x7f7354031360 con 0x7f73440035c0 2024-03-16T20:48:04.012 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:48:04.013 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":2,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","modified":"2024-03-16T20:47:58.342212Z","created":"2024-03-16T20:45:49.514457Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-16T20:48:04.014 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.009+0000 7f7361107700 1 -- 172.21.15.186:0/1681418778 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f7348038b60 msgr2=0x7f734803b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:04.014 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.009+0000 7f7361107700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f7348038b60 0x7f734803b020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7350009180 tx=0x7f7350008040 comp rx=0 tx=0).stop 2024-03-16T20:48:04.014 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.009+0000 7f7361107700 1 -- 172.21.15.186:0/1681418778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73440035c0 msgr2=0x7f735c1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:04.014 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.009+0000 7f7361107700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73440035c0 0x7f735c1025b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f735401f000 tx=0x7f7354019cb0 comp rx=0 tx=0).stop 2024-03-16T20:48:04.014 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.009+0000 7f7361107700 1 -- 172.21.15.186:0/1681418778 shutdown_connections 2024-03-16T20:48:04.014 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.009+0000 7f7361107700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f7348038b60 0x7f734803b020 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:04.014 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.009+0000 7f7361107700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73440035c0 0x7f735c1025b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:04.015 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.009+0000 7f7361107700 1 --2- 172.21.15.186:0/1681418778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f735c102af0 0x7f735c102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:04.015 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.009+0000 7f7361107700 1 -- 172.21.15.186:0/1681418778 >> 172.21.15.186:0/1681418778 conn(0x7f735c0fc4f0 msgr2=0x7f735c06a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:04.015 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.010+0000 7f7361107700 1 -- 172.21.15.186:0/1681418778 shutdown_connections 2024-03-16T20:48:04.015 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:04.010+0000 7f7361107700 1 -- 172.21.15.186:0/1681418778 wait complete. 2024-03-16T20:48:04.015 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 2 2024-03-16T20:48:04.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:04 smithi186 ceph-mon[36391]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:04.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:04 smithi186 ceph-mon[36391]: Deploying daemon mon.b on smithi170 2024-03-16T20:48:04.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:04 smithi186 ceph-mon[36391]: from='client.? 172.21.15.186:0/1681418778' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-16T20:48:04.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:04.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:04 smithi008 ceph-mon[31434]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:04.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:04 smithi008 ceph-mon[31434]: Deploying daemon mon.b on smithi170 2024-03-16T20:48:04.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:04 smithi008 ceph-mon[31434]: from='client.? 172.21.15.186:0/1681418778' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-16T20:48:04.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:05.507 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-16T20:48:05.507 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-16T20:48:05.755 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:48:06.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:06 smithi008 ceph-mon[31434]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:06.861 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:06 smithi186 ceph-mon[36391]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:07.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.201+0000 7fb07affd700 1 -- 172.21.15.186:0/2089136 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fb06c0056a0 con 0x7fb07c107ac0 2024-03-16T20:48:07.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.202+0000 7fb082692700 1 -- 172.21.15.186:0/2089136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c107ac0 msgr2=0x7fb07c107ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:07.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.202+0000 7fb082692700 1 --2- 172.21.15.186:0/2089136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c107ac0 0x7fb07c107ea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009910 tx=0x7fb06c009c20 comp rx=0 tx=0).stop 2024-03-16T20:48:07.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.202+0000 7fb082692700 1 -- 172.21.15.186:0/2089136 shutdown_connections 2024-03-16T20:48:07.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.202+0000 7fb082692700 1 --2- 172.21.15.186:0/2089136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c107ac0 0x7fb07c107ea0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:07.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.202+0000 7fb082692700 1 -- 172.21.15.186:0/2089136 >> 172.21.15.186:0/2089136 conn(0x7fb07c0fd5b0 msgr2=0x7fb07c0ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:07.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.202+0000 7fb082692700 1 -- 172.21.15.186:0/2089136 shutdown_connections 2024-03-16T20:48:07.208 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.202+0000 7fb082692700 1 -- 172.21.15.186:0/2089136 wait complete. 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.202+0000 7fb082692700 1 Processor -- start 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.202+0000 7fb082692700 1 -- start start 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb082692700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb07c107ac0 0x7fb07c197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb082692700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c197ac0 0x7fb07c19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb082692700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c198050 con 0x7fb07c197ac0 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb082692700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1981c0 con 0x7fb07c107ac0 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb07bfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb07c107ac0 0x7fb07c197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb07bfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb07c107ac0 0x7fb07c197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:47044/0 (socket says 172.21.15.186:47044) 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb07bfff700 1 -- 172.21.15.186:0/3226299195 learned_addr learned my addr 172.21.15.186:0/3226299195 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb07bfff700 1 -- 172.21.15.186:0/3226299195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb07c107ac0 msgr2=0x7fb07c197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb07bfff700 1 -- 172.21.15.186:0/3226299195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb07c107ac0 msgr2=0x7fb07c197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb07bfff700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb07c107ac0 0x7fb07c197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb07bfff700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb07c107ac0 0x7fb07c197580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T20:48:07.209 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.203+0000 7fb07b7fe700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c197ac0 0x7fb07c19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:07.211 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.204+0000 7fb07b7fe700 1 -- 172.21.15.186:0/3226299195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb07c107ac0 msgr2=0x7fb07c197580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T20:48:07.211 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.204+0000 7fb07b7fe700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb07c107ac0 0x7fb07c197580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:07.211 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.204+0000 7fb07b7fe700 1 -- 172.21.15.186:0/3226299195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0095f0 con 0x7fb07c197ac0 2024-03-16T20:48:07.211 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.205+0000 7fb07b7fe700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c197ac0 0x7fb07c19be50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb07000b4d0 tx=0x7fb07000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:07.211 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.205+0000 7fb0797fa700 1 -- 172.21.15.186:0/3226299195 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fb070011630 con 0x7fb07c197ac0 2024-03-16T20:48:07.211 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.205+0000 7fb082692700 1 -- 172.21.15.186:0/3226299195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c19c3f0 con 0x7fb07c197ac0 2024-03-16T20:48:07.211 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.205+0000 7fb082692700 1 -- 172.21.15.186:0/3226299195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c19c940 con 0x7fb07c197ac0 2024-03-16T20:48:07.211 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.205+0000 7fb0797fa700 1 -- 172.21.15.186:0/3226299195 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb070011c90 con 0x7fb07c197ac0 2024-03-16T20:48:07.211 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.205+0000 7fb0797fa700 1 -- 172.21.15.186:0/3226299195 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fb0700193b0 con 0x7fb07c197ac0 2024-03-16T20:48:07.211 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.206+0000 7fb082692700 1 -- 172.21.15.186:0/3226299195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb068005360 con 0x7fb07c197ac0 2024-03-16T20:48:07.212 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.207+0000 7fb0797fa700 1 -- 172.21.15.186:0/3226299195 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7fb070011790 con 0x7fb07c197ac0 2024-03-16T20:48:07.212 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.207+0000 7fb0797fa700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb064038af0 0x7fb06403afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:07.212 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.207+0000 7fb0797fa700 1 -- 172.21.15.186:0/3226299195 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb07004b6d0 con 0x7fb07c197ac0 2024-03-16T20:48:07.212 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.207+0000 7fb07bfff700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb064038af0 0x7fb06403afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:07.213 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.208+0000 7fb07bfff700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb064038af0 0x7fb06403afb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb06c005d10 tx=0x7fb06c005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:07.227 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.223+0000 7fb0797fa700 1 -- 172.21.15.186:0/3226299195 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb070022740 con 0x7fb07c197ac0 2024-03-16T20:48:07.505 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.500+0000 7fb082692700 1 -- 172.21.15.186:0/3226299195 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb0680058e0 con 0x7fb07c197ac0 2024-03-16T20:48:07.506 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.501+0000 7fb0797fa700 1 -- 172.21.15.186:0/3226299195 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1011 (secure 0 0 0) 0x7fb070022350 con 0x7fb07c197ac0 2024-03-16T20:48:07.506 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:48:07.506 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":2,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","modified":"2024-03-16T20:47:58.342212Z","created":"2024-03-16T20:45:49.514457Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-16T20:48:07.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.504+0000 7fb082692700 1 -- 172.21.15.186:0/3226299195 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb064038af0 msgr2=0x7fb06403afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:07.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.504+0000 7fb082692700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb064038af0 0x7fb06403afb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb06c005d10 tx=0x7fb06c005c80 comp rx=0 tx=0).stop 2024-03-16T20:48:07.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.504+0000 7fb082692700 1 -- 172.21.15.186:0/3226299195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c197ac0 msgr2=0x7fb07c19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:07.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.504+0000 7fb082692700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c197ac0 0x7fb07c19be50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb07000b4d0 tx=0x7fb07000b890 comp rx=0 tx=0).stop 2024-03-16T20:48:07.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.504+0000 7fb082692700 1 -- 172.21.15.186:0/3226299195 shutdown_connections 2024-03-16T20:48:07.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.504+0000 7fb082692700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb064038af0 0x7fb06403afb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:07.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.504+0000 7fb082692700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb07c107ac0 0x7fb07c197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:07.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.504+0000 7fb082692700 1 --2- 172.21.15.186:0/3226299195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c197ac0 0x7fb07c19be50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:07.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.504+0000 7fb082692700 1 -- 172.21.15.186:0/3226299195 >> 172.21.15.186:0/3226299195 conn(0x7fb07c0fd5b0 msgr2=0x7fb07c1035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:07.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.504+0000 7fb082692700 1 -- 172.21.15.186:0/3226299195 shutdown_connections 2024-03-16T20:48:07.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:07.504+0000 7fb082692700 1 -- 172.21.15.186:0/3226299195 wait complete. 2024-03-16T20:48:07.510 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 2 2024-03-16T20:48:07.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:07 smithi170 ceph-mon[35947]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-16T20:48:07.528 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:07 smithi170 bash[35929]: 233ed24b031b62ee9e2a81a1338b3355120c0b073bca6aa7fe4f3d3cefa12fc5 2024-03-16T20:48:07.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:07 smithi170 systemd[1]: Started Ceph mon.b for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:48:09.186 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-16T20:48:09.187 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-16T20:48:09.439 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:48:12.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: mon.c calling monitor election 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: mon.a calling monitor election 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-16T20:48:12.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-16T20:48:12.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: fsmap 2024-03-16T20:48:12.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T20:48:12.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: mgrmap e13: x(active, since 69s) 2024-03-16T20:48:12.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-16T20:48:12.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-16T20:48:12.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-16T20:48:12.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: mon.b (rank 2) addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] is down (out of quorum) 2024-03-16T20:48:12.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:12.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:12.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:12.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:12.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: mon.c calling monitor election 2024-03-16T20:48:12.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:48:12.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: mon.a calling monitor election 2024-03-16T20:48:12.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:12.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:12.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-16T20:48:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-16T20:48:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: fsmap 2024-03-16T20:48:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T20:48:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: mgrmap e13: x(active, since 69s) 2024-03-16T20:48:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-16T20:48:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-16T20:48:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-16T20:48:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: mon.b (rank 2) addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] is down (out of quorum) 2024-03-16T20:48:12.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:12.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:12.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:13.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:13 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:13.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:13 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:13.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:13 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:13.867 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:13 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:13.887 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.882+0000 7feba3476700 1 -- 172.21.15.186:0/3279792799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb8c0035c0 msgr2=0x7feb8c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:13.887 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.882+0000 7feba3476700 1 --2- 172.21.15.186:0/3279792799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb8c0035c0 0x7feb8c005a50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feb9c1019e0 tx=0x7feb90009e80 comp rx=0 tx=0).stop 2024-03-16T20:48:13.887 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.882+0000 7feba3476700 1 -- 172.21.15.186:0/3279792799 shutdown_connections 2024-03-16T20:48:13.887 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.882+0000 7feba3476700 1 --2- 172.21.15.186:0/3279792799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb8c0035c0 0x7feb8c005a50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:13.887 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.882+0000 7feba3476700 1 -- 172.21.15.186:0/3279792799 >> 172.21.15.186:0/3279792799 conn(0x7feb9c0fd5e0 msgr2=0x7feb9c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:13.888 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.883+0000 7feba3476700 1 -- 172.21.15.186:0/3279792799 shutdown_connections 2024-03-16T20:48:13.888 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.883+0000 7feba3476700 1 -- 172.21.15.186:0/3279792799 wait complete. 2024-03-16T20:48:13.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.883+0000 7feba3476700 1 Processor -- start 2024-03-16T20:48:13.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.883+0000 7feba3476700 1 -- start start 2024-03-16T20:48:13.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.883+0000 7feba3476700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb8c0035c0 0x7feb9c0742e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:13.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.883+0000 7feba3476700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9c074820 0x7feb9c074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.883+0000 7feba3476700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb9c1a37c0 0x7feb9c1a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.883+0000 7feba3476700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c1a61b0 con 0x7feb8c0035c0 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.883+0000 7feba3476700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c1a6320 con 0x7feb9c1a37c0 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.883+0000 7feba3476700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c1a64e0 con 0x7feb9c074820 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba0a11700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9c074820 0x7feb9c074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba0a11700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9c074820 0x7feb9c074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50914/0 (socket says 172.21.15.186:50914) 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba0a11700 1 -- 172.21.15.186:0/140212721 learned_addr learned my addr 172.21.15.186:0/140212721 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba1212700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb8c0035c0 0x7feb9c0742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba0a11700 1 -- 172.21.15.186:0/140212721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb9c1a37c0 msgr2=0x7feb9c1a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba0a11700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb9c1a37c0 0x7feb9c1a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba0a11700 1 -- 172.21.15.186:0/140212721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb8c0035c0 msgr2=0x7feb9c0742e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba0a11700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb8c0035c0 0x7feb9c0742e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:13.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba0a11700 1 -- 172.21.15.186:0/140212721 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900098d0 con 0x7feb9c074820 2024-03-16T20:48:13.892 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba1212700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb8c0035c0 0x7feb9c0742e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:48:13.892 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba0a11700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9c074820 0x7feb9c074ca0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7feb8800b780 tx=0x7feb8800bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:13.892 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feb9a7fc700 1 -- 172.21.15.186:0/140212721 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88004230 con 0x7feb9c074820 2024-03-16T20:48:13.892 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feb9a7fc700 1 -- 172.21.15.186:0/140212721 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7feb88004390 con 0x7feb9c074820 2024-03-16T20:48:13.892 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba3476700 1 -- 172.21.15.186:0/140212721 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c1a67c0 con 0x7feb9c074820 2024-03-16T20:48:13.892 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feb9a7fc700 1 -- 172.21.15.186:0/140212721 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88011c80 con 0x7feb9c074820 2024-03-16T20:48:13.892 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.884+0000 7feba3476700 1 -- 172.21.15.186:0/140212721 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c1a6cc0 con 0x7feb9c074820 2024-03-16T20:48:13.892 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.885+0000 7feb9a7fc700 1 -- 172.21.15.186:0/140212721 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7feb8801a400 con 0x7feb9c074820 2024-03-16T20:48:13.892 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.885+0000 7feb9a7fc700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb800391e0 0x7feb8003b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:13.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.885+0000 7feb9a7fc700 1 -- 172.21.15.186:0/140212721 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7feb8804b410 con 0x7feb9c074820 2024-03-16T20:48:13.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.885+0000 7feba3476700 1 -- 172.21.15.186:0/140212721 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c1912a0 con 0x7feb9c074820 2024-03-16T20:48:13.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.886+0000 7feba1212700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb800391e0 0x7feb8003b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:13.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.886+0000 7feba1212700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb800391e0 0x7feb8003b6a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feb900062a0 tx=0x7feb90006230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:13.895 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:13.891+0000 7feb9a7fc700 1 -- 172.21.15.186:0/140212721 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7feb8800f8d0 con 0x7feb9c074820 2024-03-16T20:48:13.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:13 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:13.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:13 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:13.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:13 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:13.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:13 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:14.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.172+0000 7feba3476700 1 -- 172.21.15.186:0/140212721 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feb9c109a50 con 0x7feb9c074820 2024-03-16T20:48:14.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.172+0000 7feb9a7fc700 1 -- 172.21.15.186:0/140212721 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1279 (secure 0 0 0) 0x7feb880151c0 con 0x7feb9c074820 2024-03-16T20:48:14.177 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-16T20:48:14.177 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":3,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","modified":"2024-03-16T20:48:07.504674Z","created":"2024-03-16T20:45:49.514457Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-16T20:48:14.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.174+0000 7feba3476700 1 -- 172.21.15.186:0/140212721 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb800391e0 msgr2=0x7feb8003b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:14.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.174+0000 7feba3476700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb800391e0 0x7feb8003b6a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feb900062a0 tx=0x7feb90006230 comp rx=0 tx=0).stop 2024-03-16T20:48:14.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.174+0000 7feba3476700 1 -- 172.21.15.186:0/140212721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9c074820 msgr2=0x7feb9c074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:14.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.174+0000 7feba3476700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9c074820 0x7feb9c074ca0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7feb8800b780 tx=0x7feb8800bb40 comp rx=0 tx=0).stop 2024-03-16T20:48:14.180 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.174+0000 7feba3476700 1 -- 172.21.15.186:0/140212721 shutdown_connections 2024-03-16T20:48:14.180 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.174+0000 7feba3476700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb800391e0 0x7feb8003b6a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:14.180 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.174+0000 7feba3476700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb8c0035c0 0x7feb9c0742e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:14.180 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.174+0000 7feba3476700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb9c1a37c0 0x7feb9c1a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:14.180 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.174+0000 7feba3476700 1 --2- 172.21.15.186:0/140212721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb9c074820 0x7feb9c074ca0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:14.180 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.174+0000 7feba3476700 1 -- 172.21.15.186:0/140212721 >> 172.21.15.186:0/140212721 conn(0x7feb9c0fd5e0 msgr2=0x7feb9c1065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:14.180 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.175+0000 7feba3476700 1 -- 172.21.15.186:0/140212721 shutdown_connections 2024-03-16T20:48:14.180 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:14.175+0000 7feba3476700 1 -- 172.21.15.186:0/140212721 wait complete. 2024-03-16T20:48:14.180 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 3 2024-03-16T20:48:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: mon.c calling monitor election 2024-03-16T20:48:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:48:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: mon.a calling monitor election 2024-03-16T20:48:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:48:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-16T20:48:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-16T20:48:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: fsmap 2024-03-16T20:48:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T20:48:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: mgrmap e13: x(active, since 69s) 2024-03-16T20:48:14.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-16T20:48:14.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-16T20:48:14.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-16T20:48:14.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: mon.b (rank 2) addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] is down (out of quorum) 2024-03-16T20:48:14.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:14.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:14.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:14.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:14.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:14.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:14.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:14.955 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-16T20:48:14.955 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph config generate-minimal-conf 2024-03-16T20:48:15.385 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:48:15.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: mon.b calling monitor election 2024-03-16T20:48:15.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: Updating smithi008:/etc/ceph/ceph.conf 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: Updating smithi170:/etc/ceph/ceph.conf 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: Updating smithi186:/etc/ceph/ceph.conf 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: mon.b calling monitor election 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: mon.c calling monitor election 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: mon.a calling monitor election 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: fsmap 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: mgrmap e13: x(active, since 71s) 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-16T20:48:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: Cluster is now healthy 2024-03-16T20:48:15.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: overall HEALTH_OK 2024-03-16T20:48:15.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:15.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:15.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:15.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:15.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: mon.b calling monitor election 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: Updating smithi008:/etc/ceph/ceph.conf 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: Updating smithi170:/etc/ceph/ceph.conf 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: Updating smithi186:/etc/ceph/ceph.conf 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: mon.b calling monitor election 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: mon.c calling monitor election 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: mon.a calling monitor election 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: fsmap 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T20:48:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: mgrmap e13: x(active, since 71s) 2024-03-16T20:48:15.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-16T20:48:15.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: Cluster is now healthy 2024-03-16T20:48:15.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: overall HEALTH_OK 2024-03-16T20:48:15.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:15.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:15.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:15.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:15.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: mon.b calling monitor election 2024-03-16T20:48:15.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: Updating smithi008:/etc/ceph/ceph.conf 2024-03-16T20:48:15.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: Updating smithi170:/etc/ceph/ceph.conf 2024-03-16T20:48:15.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: Updating smithi186:/etc/ceph/ceph.conf 2024-03-16T20:48:15.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: mon.b calling monitor election 2024-03-16T20:48:15.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: mon.c calling monitor election 2024-03-16T20:48:15.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: mon.a calling monitor election 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: fsmap 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: mgrmap e13: x(active, since 71s) 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: Cluster is now healthy 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: overall HEALTH_OK 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:16.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:48:16.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:16.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:48:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T20:48:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:16.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:16.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:48:16.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:16.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:48:16.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T20:48:16.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:16.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:16.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:48:16.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:48:16.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:16.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:48:16.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T20:48:16.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:17.361 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:17 smithi008 ceph-mon[31434]: Reconfiguring mon.a (unknown last config time)... 2024-03-16T20:48:17.361 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:17 smithi008 ceph-mon[31434]: Reconfiguring daemon mon.a on smithi008 2024-03-16T20:48:17.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:17 smithi170 ceph-mon[35947]: Reconfiguring mon.a (unknown last config time)... 2024-03-16T20:48:17.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:17 smithi170 ceph-mon[35947]: Reconfiguring daemon mon.a on smithi008 2024-03-16T20:48:17.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:17 smithi186 ceph-mon[36391]: Reconfiguring mon.a (unknown last config time)... 2024-03-16T20:48:17.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:17 smithi186 ceph-mon[36391]: Reconfiguring daemon mon.a on smithi008 2024-03-16T20:48:18.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:18 smithi008 ceph-mon[31434]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.162+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3366812180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2b8106a10 msgr2=0x7fc2b8106df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.162+0000 7fc2bcc00700 1 --2- 172.21.15.8:0/3366812180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2b8106a10 0x7fc2b8106df0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009910 tx=0x7fc2a8009c20 comp rx=0 tx=0).stop 2024-03-16T20:48:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.162+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3366812180 shutdown_connections 2024-03-16T20:48:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.162+0000 7fc2bcc00700 1 --2- 172.21.15.8:0/3366812180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2b8106a10 0x7fc2b8106df0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.162+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3366812180 >> 172.21.15.8:0/3366812180 conn(0x7fc2b80fbb30 msgr2=0x7fc2b80fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.162+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3366812180 shutdown_connections 2024-03-16T20:48:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.162+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3366812180 wait complete. 2024-03-16T20:48:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.163+0000 7fc2bcc00700 1 Processor -- start 2024-03-16T20:48:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.163+0000 7fc2bcc00700 1 -- start start 2024-03-16T20:48:18.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.163+0000 7fc2bcc00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2b8106a10 0x7fc2b819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.163+0000 7fc2bcc00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2b819fad0 0x7fc2b8199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.163+0000 7fc2bcc00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b8199ba0 0x7fc2b819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.163+0000 7fc2bcc00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81a00b0 con 0x7fc2b819fad0 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.163+0000 7fc2bcc00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81a6340 con 0x7fc2b8199ba0 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.163+0000 7fc2bcc00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81a64d0 con 0x7fc2b8106a10 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.164+0000 7fc2b5400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2b819fad0 0x7fc2b8199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.164+0000 7fc2b5400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2b819fad0 0x7fc2b8199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33596/0 (socket says 172.21.15.8:33596) 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.164+0000 7fc2b5400700 1 -- 172.21.15.8:0/3709571120 learned_addr learned my addr 172.21.15.8:0/3709571120 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.164+0000 7fc2b5e00700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2b8106a10 0x7fc2b819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.164+0000 7fc2b6800700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b8199ba0 0x7fc2b819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.164+0000 7fc2b5400700 1 -- 172.21.15.8:0/3709571120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2b8106a10 msgr2=0x7fc2b819f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:18.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.164+0000 7fc2b5400700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2b8106a10 0x7fc2b819f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.164+0000 7fc2b5400700 1 -- 172.21.15.8:0/3709571120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b8199ba0 msgr2=0x7fc2b819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.164+0000 7fc2b5400700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b8199ba0 0x7fc2b819a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.164+0000 7fc2b5400700 1 -- 172.21.15.8:0/3709571120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a80095f0 con 0x7fc2b819fad0 2024-03-16T20:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.164+0000 7fc2b6800700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b8199ba0 0x7fc2b819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.165+0000 7fc2b5400700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2b819fad0 0x7fc2b8199660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400b7b0 tx=0x7fc2a400bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.165+0000 7fc2aea00700 1 -- 172.21.15.8:0/3709571120 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4004230 con 0x7fc2b819fad0 2024-03-16T20:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.165+0000 7fc2aea00700 1 -- 172.21.15.8:0/3709571120 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc2a4004390 con 0x7fc2b819fad0 2024-03-16T20:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.165+0000 7fc2aea00700 1 -- 172.21.15.8:0/3709571120 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4011c90 con 0x7fc2b819fad0 2024-03-16T20:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.165+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3709571120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b81a67b0 con 0x7fc2b819fad0 2024-03-16T20:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.165+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3709571120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b81a6c60 con 0x7fc2b819fad0 2024-03-16T20:48:18.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.166+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3709571120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b8103150 con 0x7fc2b819fad0 2024-03-16T20:48:18.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.167+0000 7fc2aea00700 1 -- 172.21.15.8:0/3709571120 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7fc2a4003ca0 con 0x7fc2b819fad0 2024-03-16T20:48:18.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.167+0000 7fc2aea00700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc29c0391e0 0x7fc29c03b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:18.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.167+0000 7fc2aea00700 1 -- 172.21.15.8:0/3709571120 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc2a404b340 con 0x7fc2b819fad0 2024-03-16T20:48:18.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.168+0000 7fc2b5e00700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc29c0391e0 0x7fc29c03b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:18.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.168+0000 7fc2b5e00700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc29c0391e0 0x7fc29c03b6a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8006010 tx=0x7fc2a8005130 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:18.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.174+0000 7fc2aea00700 1 -- 172.21.15.8:0/3709571120 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc2a4004500 con 0x7fc2b819fad0 2024-03-16T20:48:18.579 INFO:teuthology.orchestra.run.smithi008.stdout:# minimal ceph.conf for 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:48:18.579 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2024-03-16T20:48:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:48:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: mon_host = [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] 2024-03-16T20:48:18.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.407+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3709571120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fc2b810c0a0 con 0x7fc2b819fad0 2024-03-16T20:48:18.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.408+0000 7fc2aea00700 1 -- 172.21.15.8:0/3709571120 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7fc2a40093b0 con 0x7fc2b819fad0 2024-03-16T20:48:18.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.410+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3709571120 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc29c0391e0 msgr2=0x7fc29c03b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:18.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.410+0000 7fc2bcc00700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc29c0391e0 0x7fc29c03b6a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8006010 tx=0x7fc2a8005130 comp rx=0 tx=0).stop 2024-03-16T20:48:18.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.410+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3709571120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2b819fad0 msgr2=0x7fc2b8199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:18.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.410+0000 7fc2bcc00700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2b819fad0 0x7fc2b8199660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400b7b0 tx=0x7fc2a400bac0 comp rx=0 tx=0).stop 2024-03-16T20:48:18.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.410+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3709571120 shutdown_connections 2024-03-16T20:48:18.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.410+0000 7fc2bcc00700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fc29c0391e0 0x7fc29c03b6a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:18.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.410+0000 7fc2bcc00700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b8199ba0 0x7fc2b819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:18.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.410+0000 7fc2bcc00700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2b8106a10 0x7fc2b819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:18.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.410+0000 7fc2bcc00700 1 --2- 172.21.15.8:0/3709571120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2b819fad0 0x7fc2b8199660 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:18.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.410+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3709571120 >> 172.21.15.8:0/3709571120 conn(0x7fc2b80fbb30 msgr2=0x7fc2b8100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:18.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.411+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3709571120 shutdown_connections 2024-03-16T20:48:18.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:18.411+0000 7fc2bcc00700 1 -- 172.21.15.8:0/3709571120 wait complete. 2024-03-16T20:48:18.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:18 smithi170 ceph-mon[35947]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:18.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:18 smithi186 ceph-mon[36391]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:19.272 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:19 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3709571120' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:19.273 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:19.273 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:19.273 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:19 smithi008 ceph-mon[31434]: Reconfiguring mon.b (monmap changed)... 2024-03-16T20:48:19.273 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:48:19.273 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T20:48:19.273 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:19.273 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:19 smithi008 ceph-mon[31434]: Reconfiguring daemon mon.b on smithi170 2024-03-16T20:48:19.338 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-16T20:48:19.338 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:48:19.338 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.conf 2024-03-16T20:48:19.342 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:19 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3709571120' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:19.342 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:19.342 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:19.342 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:19 smithi170 ceph-mon[35947]: Reconfiguring mon.b (monmap changed)... 2024-03-16T20:48:19.342 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:48:19.342 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T20:48:19.342 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:19.342 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:19 smithi170 ceph-mon[35947]: Reconfiguring daemon mon.b on smithi170 2024-03-16T20:48:19.443 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:48:19.443 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:48:19.589 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-03-16T20:48:19.589 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.conf 2024-03-16T20:48:19.620 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-03-16T20:48:19.620 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:48:19.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:19 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3709571120' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:19.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:19.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:19.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:19 smithi186 ceph-mon[36391]: Reconfiguring mon.b (monmap changed)... 2024-03-16T20:48:19.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:48:19.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T20:48:19.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:19.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:19 smithi186 ceph-mon[36391]: Reconfiguring daemon mon.b on smithi170 2024-03-16T20:48:19.687 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-16T20:48:19.687 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.conf 2024-03-16T20:48:19.721 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-16T20:48:19.721 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:48:19.793 INFO:tasks.cephadm:Adding mgr.x on smithi008 2024-03-16T20:48:19.793 INFO:tasks.cephadm:Adding mgr.y on smithi170 2024-03-16T20:48:19.793 INFO:tasks.cephadm:Adding mgr.z on smithi186 2024-03-16T20:48:19.794 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch apply mgr '3;smithi008=x;smithi170=y;smithi186=z' 2024-03-16T20:48:20.087 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:48:20.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:20 smithi008 ceph-mon[31434]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:48:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T20:48:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:20.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:20 smithi170 ceph-mon[35947]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:48:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T20:48:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:20.880 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:20 smithi186 ceph-mon[36391]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:20.880 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:20.880 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:20.881 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T20:48:20.881 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T20:48:20.881 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:21.502 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:21 smithi186 ceph-mon[36391]: Reconfiguring mon.c (monmap changed)... 2024-03-16T20:48:21.502 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:21 smithi186 ceph-mon[36391]: Reconfiguring daemon mon.c on smithi186 2024-03-16T20:48:21.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:21 smithi008 ceph-mon[31434]: Reconfiguring mon.c (monmap changed)... 2024-03-16T20:48:21.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:21 smithi008 ceph-mon[31434]: Reconfiguring daemon mon.c on smithi186 2024-03-16T20:48:21.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:21 smithi170 ceph-mon[35947]: Reconfiguring mon.c (monmap changed)... 2024-03-16T20:48:21.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:21 smithi170 ceph-mon[35947]: Reconfiguring daemon mon.c on smithi186 2024-03-16T20:48:22.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 -- 172.21.15.186:0/3510884381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b70102b20 msgr2=0x7f5b701093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:22.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 --2- 172.21.15.186:0/3510884381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b70102b20 0x7f5b701093d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800b0a0 tx=0x7f5b6800b3b0 comp rx=0 tx=0).stop 2024-03-16T20:48:22.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 -- 172.21.15.186:0/3510884381 shutdown_connections 2024-03-16T20:48:22.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 --2- 172.21.15.186:0/3510884381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b70100f80 0x7f5b701013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:22.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 --2- 172.21.15.186:0/3510884381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b70102b20 0x7f5b701093d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:22.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 --2- 172.21.15.186:0/3510884381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b70102180 0x7f5b701025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:22.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 -- 172.21.15.186:0/3510884381 >> 172.21.15.186:0/3510884381 conn(0x7f5b700fc540 msgr2=0x7f5b700fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:22.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 -- 172.21.15.186:0/3510884381 shutdown_connections 2024-03-16T20:48:22.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 -- 172.21.15.186:0/3510884381 wait complete. 2024-03-16T20:48:22.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 Processor -- start 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 -- start start 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b70100f80 0x7f5b7010b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b70102180 0x7f5b70109ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b70102b20 0x7f5b7010a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7010aba0 con 0x7f5b70102180 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7010ad10 con 0x7f5b70102b20 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.573+0000 7f5b753ae700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b701a2250 con 0x7f5b70100f80 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6effd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b70100f80 0x7f5b7010b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6effd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b70100f80 0x7f5b7010b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:45298/0 (socket says 172.21.15.186:45298) 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6effd700 1 -- 172.21.15.186:0/3925065242 learned_addr learned my addr 172.21.15.186:0/3925065242 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6f7fe700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b70102b20 0x7f5b7010a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6effd700 1 -- 172.21.15.186:0/3925065242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b70102b20 msgr2=0x7f5b7010a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6effd700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b70102b20 0x7f5b7010a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6effd700 1 -- 172.21.15.186:0/3925065242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b70102180 msgr2=0x7f5b70109ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:22.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6effd700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b70102180 0x7f5b70109ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:22.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6effd700 1 -- 172.21.15.186:0/3925065242 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b68009d00 con 0x7f5b70100f80 2024-03-16T20:48:22.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6effd700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b70100f80 0x7f5b7010b890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000b500 tx=0x7f5b6000b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:22.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6cff9700 1 -- 172.21.15.186:0/3925065242 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60011830 con 0x7f5b70100f80 2024-03-16T20:48:22.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6cff9700 1 -- 172.21.15.186:0/3925065242 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f5b60011e90 con 0x7f5b70100f80 2024-03-16T20:48:22.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b753ae700 1 -- 172.21.15.186:0/3925065242 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b701a2530 con 0x7f5b70100f80 2024-03-16T20:48:22.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b6cff9700 1 -- 172.21.15.186:0/3925065242 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000f2e0 con 0x7f5b70100f80 2024-03-16T20:48:22.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.574+0000 7f5b753ae700 1 -- 172.21.15.186:0/3925065242 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b701a2ab0 con 0x7f5b70100f80 2024-03-16T20:48:22.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.575+0000 7f5b6cff9700 1 -- 172.21.15.186:0/3925065242 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7f5b600106a0 con 0x7f5b70100f80 2024-03-16T20:48:22.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.575+0000 7f5b753ae700 1 -- 172.21.15.186:0/3925065242 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b701082e0 con 0x7f5b70100f80 2024-03-16T20:48:22.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.575+0000 7f5b6cff9700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5b5c038f90 0x7f5b5c03b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:22.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.575+0000 7f5b6cff9700 1 -- 172.21.15.186:0/3925065242 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5b6004b340 con 0x7f5b70100f80 2024-03-16T20:48:22.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.576+0000 7f5b67fff700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5b5c038f90 0x7f5b5c03b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:22.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.577+0000 7f5b67fff700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5b5c038f90 0x7f5b5c03b450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800a990 tx=0x7f5b58005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:22.584 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.580+0000 7f5b6cff9700 1 -- 172.21.15.186:0/3925065242 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5b600214e0 con 0x7f5b70100f80 2024-03-16T20:48:22.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:22 smithi186 ceph-mon[36391]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:22.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:22.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:22.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:22.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:22.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:22.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:22.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:22 smithi008 ceph-mon[31434]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:22.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:22.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:22.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:22.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:22.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:22.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:22.791 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.787+0000 7f5b753ae700 1 -- 172.21.15.186:0/3925065242 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi170=y;smithi186=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b7002da30 con 0x7f5b5c038f90 2024-03-16T20:48:22.803 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.800+0000 7f5b6cff9700 1 -- 172.21.15.186:0/3925065242 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5b7002da30 con 0x7f5b5c038f90 2024-03-16T20:48:22.804 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mgr update... 2024-03-16T20:48:22.806 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 -- 172.21.15.186:0/3925065242 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5b5c038f90 msgr2=0x7f5b5c03b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:22.806 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5b5c038f90 0x7f5b5c03b450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800a990 tx=0x7f5b58005c80 comp rx=0 tx=0).stop 2024-03-16T20:48:22.806 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 -- 172.21.15.186:0/3925065242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b70100f80 msgr2=0x7f5b7010b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:22.806 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b70100f80 0x7f5b7010b890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000b500 tx=0x7f5b6000b810 comp rx=0 tx=0).stop 2024-03-16T20:48:22.806 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 -- 172.21.15.186:0/3925065242 shutdown_connections 2024-03-16T20:48:22.806 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5b5c038f90 0x7f5b5c03b450 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:22.806 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b70102b20 0x7f5b7010a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:22.807 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b70100f80 0x7f5b7010b890 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:22.807 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 --2- 172.21.15.186:0/3925065242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b70102180 0x7f5b70109ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:22.807 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 -- 172.21.15.186:0/3925065242 >> 172.21.15.186:0/3925065242 conn(0x7f5b700fc540 msgr2=0x7f5b70105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:22.807 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 -- 172.21.15.186:0/3925065242 shutdown_connections 2024-03-16T20:48:22.807 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:48:22.802+0000 7f5b753ae700 1 -- 172.21.15.186:0/3925065242 wait complete. 2024-03-16T20:48:22.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:22 smithi170 ceph-mon[35947]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:22.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:22.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:22.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:22.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:22.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:22.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:23.380 DEBUG:teuthology.orchestra.run.smithi170:mgr.y> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.y.service 2024-03-16T20:48:23.382 DEBUG:teuthology.orchestra.run.smithi186:mgr.z> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.z.service 2024-03-16T20:48:23.384 INFO:tasks.cephadm:Deploying OSDs... 2024-03-16T20:48:23.384 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:48:23.384 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2024-03-16T20:48:23.445 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-16T20:48:23.445 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2024-03-16T20:48:23.499 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-16T20:48:23.499 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:23.500 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 634 Links: 1 2024-03-16T20:48:23.500 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:23.500 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:23.500 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-03-16 20:47:19.418315906 +0000 2024-03-16T20:48:23.500 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-03-16 20:42:01.223943218 +0000 2024-03-16T20:48:23.500 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-03-16 20:42:01.223943218 +0000 2024-03-16T20:48:23.500 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-03-16 20:42:01.223943218 +0000 2024-03-16T20:48:23.500 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-16T20:48:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-03-16T20:48:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-03-16T20:48:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000265038 s, 1.9 MB/s 2024-03-16T20:48:23.600 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-16T20:48:23.659 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2024-03-16T20:48:23.712 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-16T20:48:23.712 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:23.712 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 650 Links: 1 2024-03-16T20:48:23.712 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:23.712 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:23.713 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-03-16 20:47:19.498315063 +0000 2024-03-16T20:48:23.713 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-03-16 20:42:01.790936161 +0000 2024-03-16T20:48:23.713 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-03-16 20:42:01.790936161 +0000 2024-03-16T20:48:23.713 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-03-16 20:42:01.790936161 +0000 2024-03-16T20:48:23.713 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-16T20:48:23.807 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-03-16T20:48:23.807 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-03-16T20:48:23.807 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000236829 s, 2.2 MB/s 2024-03-16T20:48:23.812 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-16T20:48:23.867 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2024-03-16T20:48:23.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi170=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:48:23.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: Saving service mgr spec with placement smithi008=x;smithi170=y;smithi186=z;count:3 2024-03-16T20:48:23.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:23.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:23.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:23.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:23.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:23.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T20:48:23.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T20:48:23.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T20:48:23.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:23.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:23 smithi186 ceph-mon[36391]: Deploying daemon mgr.z on smithi186 2024-03-16T20:48:23.916 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-16T20:48:23.916 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:23.917 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-16T20:48:23.917 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:23.917 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:23.917 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-03-16 20:47:19.566314347 +0000 2024-03-16T20:48:23.917 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-03-16 20:42:02.440928071 +0000 2024-03-16T20:48:23.917 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-03-16 20:42:02.440928071 +0000 2024-03-16T20:48:23.917 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-03-16 20:42:02.440928071 +0000 2024-03-16T20:48:23.917 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi170=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: Saving service mgr spec with placement smithi008=x;smithi170=y;smithi186=z;count:3 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:23 smithi008 ceph-mon[31434]: Deploying daemon mgr.z on smithi186 2024-03-16T20:48:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-03-16T20:48:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-03-16T20:48:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000233609 s, 2.2 MB/s 2024-03-16T20:48:24.011 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-16T20:48:24.066 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2024-03-16T20:48:24.117 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-16T20:48:24.117 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:24.117 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-03-16T20:48:24.117 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:24.117 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:24.117 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-03-16 20:47:19.638313589 +0000 2024-03-16T20:48:24.117 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-03-16 20:42:03.029920740 +0000 2024-03-16T20:48:24.117 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-03-16 20:42:03.029920740 +0000 2024-03-16T20:48:24.117 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-03-16 20:42:03.029920740 +0000 2024-03-16T20:48:24.118 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-16T20:48:24.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi170=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:48:24.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: Saving service mgr spec with placement smithi008=x;smithi170=y;smithi186=z;count:3 2024-03-16T20:48:24.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:24.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:24.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:24.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:24.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:24.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T20:48:24.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T20:48:24.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T20:48:24.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:24.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:23 smithi170 ceph-mon[35947]: Deploying daemon mgr.z on smithi186 2024-03-16T20:48:24.210 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-03-16T20:48:24.210 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-03-16T20:48:24.210 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000275163 s, 1.9 MB/s 2024-03-16T20:48:24.215 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-16T20:48:24.275 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-03-16T20:48:24.275 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-03-16T20:48:24.294 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-16T20:48:24.294 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-03-16T20:48:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-16T20:48:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:24.351 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-03-16T20:48:24.351 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:24.351 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:24.351 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-03-16 20:48:06.965449541 +0000 2024-03-16T20:48:24.351 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-03-16 20:40:48.417294057 +0000 2024-03-16T20:48:24.351 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-03-16 20:40:48.417294057 +0000 2024-03-16T20:48:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-03-16 20:40:48.417294057 +0000 2024-03-16T20:48:24.351 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-16T20:48:24.420 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-03-16T20:48:24.420 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-03-16T20:48:24.420 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000133623 s, 3.8 MB/s 2024-03-16T20:48:24.422 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-16T20:48:24.481 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-03-16T20:48:24.539 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-16T20:48:24.539 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:24.539 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-03-16T20:48:24.539 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:24.539 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:24.539 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-03-16 20:48:06.966449516 +0000 2024-03-16T20:48:24.539 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-03-16 20:40:48.758285464 +0000 2024-03-16T20:48:24.539 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-03-16 20:40:48.758285464 +0000 2024-03-16T20:48:24.539 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-03-16 20:40:48.758285464 +0000 2024-03-16T20:48:24.539 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-16T20:48:24.608 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-03-16T20:48:24.608 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-03-16T20:48:24.609 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000108453 s, 4.7 MB/s 2024-03-16T20:48:24.610 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-16T20:48:24.668 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-03-16T20:48:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-16T20:48:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:24.726 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-03-16T20:48:24.726 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:24.726 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:24.726 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-03-16 20:48:06.966449516 +0000 2024-03-16T20:48:24.726 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-03-16 20:40:49.092277047 +0000 2024-03-16T20:48:24.726 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-03-16 20:40:49.092277047 +0000 2024-03-16T20:48:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-03-16 20:40:49.092277047 +0000 2024-03-16T20:48:24.727 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-16T20:48:24.795 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-03-16T20:48:24.795 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-03-16T20:48:24.795 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000117563 s, 4.4 MB/s 2024-03-16T20:48:24.796 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-16T20:48:24.853 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-03-16T20:48:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-16T20:48:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:24.911 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 719 Links: 1 2024-03-16T20:48:24.911 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:24.911 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:24.911 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-03-16 20:48:06.966449516 +0000 2024-03-16T20:48:24.911 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-03-16 20:40:49.411269008 +0000 2024-03-16T20:48:24.912 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-03-16 20:40:49.411269008 +0000 2024-03-16T20:48:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-03-16 20:40:49.411269008 +0000 2024-03-16T20:48:24.912 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-16T20:48:24.979 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-03-16T20:48:24.979 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-03-16T20:48:24.979 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000118007 s, 4.3 MB/s 2024-03-16T20:48:24.981 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-16T20:48:25.038 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-16T20:48:25.038 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2024-03-16T20:48:25.055 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-16T20:48:25.055 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2024-03-16T20:48:25.062 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:24 smithi186 ceph-mon[36391]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:25.063 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:24 smithi186 systemd[1]: Starting Ceph mgr.z for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:48:25.076 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-16T20:48:25.076 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:25.077 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 661 Links: 1 2024-03-16T20:48:25.077 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:25.077 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:25.077 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-03-16 20:48:24.788519147 +0000 2024-03-16T20:48:25.077 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-03-16 20:40:57.028157603 +0000 2024-03-16T20:48:25.077 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-03-16 20:40:57.028157603 +0000 2024-03-16T20:48:25.077 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-03-16 20:40:57.028157603 +0000 2024-03-16T20:48:25.077 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-16T20:48:25.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:24 smithi170 ceph-mon[35947]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:25.144 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-03-16T20:48:25.144 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-03-16T20:48:25.144 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000264436 s, 1.9 MB/s 2024-03-16T20:48:25.145 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-16T20:48:25.201 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2024-03-16T20:48:25.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:24 smithi008 ceph-mon[31434]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:25.255 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-16T20:48:25.256 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:25.256 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-03-16T20:48:25.256 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:25.256 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:25.256 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-03-16 20:48:24.789519128 +0000 2024-03-16T20:48:25.256 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-03-16 20:40:57.363150614 +0000 2024-03-16T20:48:25.256 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-03-16 20:40:57.363150614 +0000 2024-03-16T20:48:25.256 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-03-16 20:40:57.363150614 +0000 2024-03-16T20:48:25.267 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-16T20:48:25.330 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:25 smithi186 podman[38198]: 2024-03-16 20:48:25.058678601 +0000 UTC m=+0.106099152 container create de40adc41fd049ff5435599c39726b6251772ea639226e9f2dd7757a6ccb33de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-16T20:48:25.331 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:25 smithi186 podman[38198]: 2024-03-16 20:48:24.970689916 +0000 UTC m=+0.018110458 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:48:25.333 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-03-16T20:48:25.333 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-03-16T20:48:25.334 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000206558 s, 2.5 MB/s 2024-03-16T20:48:25.335 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-16T20:48:25.390 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2024-03-16T20:48:25.445 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-16T20:48:25.445 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:25.446 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-03-16T20:48:25.446 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:25.446 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:25.446 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-03-16 20:48:24.789519128 +0000 2024-03-16T20:48:25.446 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-03-16 20:40:57.710143375 +0000 2024-03-16T20:48:25.446 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-03-16 20:40:57.710143375 +0000 2024-03-16T20:48:25.446 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-03-16 20:40:57.710143375 +0000 2024-03-16T20:48:25.446 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-16T20:48:25.514 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-03-16T20:48:25.514 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-03-16T20:48:25.514 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000181192 s, 2.8 MB/s 2024-03-16T20:48:25.515 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-16T20:48:25.571 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2024-03-16T20:48:25.626 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-16T20:48:25.626 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T20:48:25.626 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 717 Links: 1 2024-03-16T20:48:25.626 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:48:25.626 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T20:48:25.626 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-03-16 20:48:24.789519128 +0000 2024-03-16T20:48:25.627 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-03-16 20:40:58.060136072 +0000 2024-03-16T20:48:25.627 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-03-16 20:40:58.060136072 +0000 2024-03-16T20:48:25.627 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-03-16 20:40:58.060136072 +0000 2024-03-16T20:48:25.627 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-16T20:48:25.642 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:25 smithi186 podman[38198]: 2024-03-16 20:48:25.327899108 +0000 UTC m=+0.375319640 container init de40adc41fd049ff5435599c39726b6251772ea639226e9f2dd7757a6ccb33de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=) 2024-03-16T20:48:25.642 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:25 smithi186 podman[38198]: 2024-03-16 20:48:25.330604537 +0000 UTC m=+0.378025070 container start de40adc41fd049ff5435599c39726b6251772ea639226e9f2dd7757a6ccb33de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-16T20:48:25.642 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:25 smithi186 ceph-mgr[38320]: -- 172.21.15.186:0/2962484654 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e1e014e1a0 con 0x55e1e0124c00 2024-03-16T20:48:25.642 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:25 smithi186 bash[38198]: de40adc41fd049ff5435599c39726b6251772ea639226e9f2dd7757a6ccb33de 2024-03-16T20:48:25.642 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:25 smithi186 systemd[1]: Started Ceph mgr.z for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:48:25.667 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-03-16T20:48:25.667 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-03-16T20:48:25.667 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000204061 s, 2.5 MB/s 2024-03-16T20:48:25.669 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-16T20:48:25.725 INFO:tasks.cephadm:Deploying osd.0 on smithi008 with /dev/vg_nvme/lv_4... 2024-03-16T20:48:25.725 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-16T20:48:25.989 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:25.892+0000 7f0beb80f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T20:48:25.989 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:25.985+0000 7f0beb80f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T20:48:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:48:26.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:26 smithi008 ceph-mon[31434]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:26.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:26.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:26.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:26.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T20:48:26.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T20:48:26.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T20:48:26.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:26.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:26 smithi008 ceph-mon[31434]: Deploying daemon mgr.y on smithi170 2024-03-16T20:48:26.863 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:26.626+0000 7f0beb80f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T20:48:26.863 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:26.718+0000 7f0beb80f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T20:48:26.863 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:26.859+0000 7f0beb80f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T20:48:26.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-mon[36391]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:26.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:26.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:26.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:26.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T20:48:26.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T20:48:26.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T20:48:26.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:26.864 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-mon[36391]: Deploying daemon mgr.y on smithi170 2024-03-16T20:48:26.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:26 smithi170 ceph-mon[35947]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:26.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:26.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:26.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:26.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T20:48:26.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T20:48:26.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T20:48:26.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:26.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:26 smithi170 ceph-mon[35947]: Deploying daemon mgr.y on smithi170 2024-03-16T20:48:27.142 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:26.954+0000 7f0beb80f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T20:48:27.142 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:27.038+0000 7f0beb80f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T20:48:27.600 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:27.308+0000 7f0beb80f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T20:48:27.601 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:27.416+0000 7f0beb80f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T20:48:27.601 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:27.502+0000 7f0beb80f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T20:48:27.601 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:27.597+0000 7f0beb80f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T20:48:27.799 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:27 smithi170 systemd[1]: Starting Ceph mgr.y for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:48:27.892 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:27.775+0000 7f0beb80f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T20:48:28.056 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:27 smithi170 podman[37340]: 2024-03-16 20:48:27.698544523 +0000 UTC m=+0.018139862 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:48:28.056 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:27 smithi170 podman[37340]: 2024-03-16 20:48:27.808561725 +0000 UTC m=+0.128157046 container create f659b6a51d81542d23664dc061710611322eaca3c2c04a023ae89985e07c0ca0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-03-16T20:48:28.056 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:27 smithi170 podman[37340]: 2024-03-16 20:48:27.99410003 +0000 UTC m=+0.313695351 container init f659b6a51d81542d23664dc061710611322eaca3c2c04a023ae89985e07c0ca0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T20:48:28.056 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:27 smithi170 podman[37340]: 2024-03-16 20:48:27.996614924 +0000 UTC m=+0.316210246 container start f659b6a51d81542d23664dc061710611322eaca3c2c04a023ae89985e07c0ca0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-16T20:48:28.056 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:28 smithi170 ceph-mgr[37359]: -- 172.21.15.170:0/4104579724 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e630d2a1a0 con 0x55e630d00800 2024-03-16T20:48:28.056 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:28 smithi170 bash[37340]: f659b6a51d81542d23664dc061710611322eaca3c2c04a023ae89985e07c0ca0 2024-03-16T20:48:28.366 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:28 smithi170 systemd[1]: Started Ceph mgr.y for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:48:28.770 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:28 smithi186 ceph-mon[36391]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:28.770 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.770 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.770 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.770 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.770 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:28.866 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:28 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:28.563+0000 7f973aec1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T20:48:28.866 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:28 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:28.660+0000 7f973aec1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T20:48:28.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:28 smithi170 ceph-mon[35947]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:28.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-16T20:48:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-16T20:48:28.882 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2024-03-16T20:48:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2024-03-16T20:48:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0370693 s, 283 MB/s 2024-03-16T20:48:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2024-03-16T20:48:28.883 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:28 smithi008 ceph-mon[31434]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:28.883 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.883 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.883 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.883 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:28.883 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:29.142 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:28.766+0000 7f0beb80f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T20:48:29.142 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:28.903+0000 7f0beb80f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T20:48:29.558 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:29.261+0000 7f0beb80f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T20:48:29.558 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:29.355+0000 7f0beb80f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T20:48:29.558 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:29.554+0000 7f0beb80f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:48:29.579 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:29 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:29.342+0000 7f973aec1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T20:48:29.579 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:29 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:29.434+0000 7f973aec1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T20:48:29.725 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi008:vg_nvme/lv_4 2024-03-16T20:48:29.866 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:29 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:29.575+0000 7f973aec1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T20:48:29.866 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:29 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:29.676+0000 7f973aec1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T20:48:29.866 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:29 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:29.763+0000 7f973aec1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T20:48:29.892 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:29.758+0000 7f0beb80f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T20:48:30.178 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:48:30.306 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:30.039+0000 7f0beb80f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:48:30.306 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:30.303+0000 7f0beb80f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T20:48:30.323 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:30.031+0000 7f973aec1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T20:48:30.323 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:30.141+0000 7f973aec1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T20:48:30.323 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:30.226+0000 7f973aec1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T20:48:30.324 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:30.319+0000 7f973aec1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T20:48:30.616 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:30.494+0000 7f973aec1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T20:48:30.642 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:30.536+0000 7f0beb80f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T20:48:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:30 smithi008 ceph-mon[31434]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:30 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:30 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:30 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:30 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:30 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:30 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:30 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:30 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T20:48:30.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:30 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T20:48:30.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:30 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:31.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-mon[35947]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T20:48:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T20:48:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:30 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:31.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-mon[36391]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:31.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:31.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:31.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:31.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:31.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T20:48:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T20:48:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:30 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:31.642 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:31 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:31.332+0000 7f0beb80f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T20:48:31.747 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:31 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:31.452+0000 7f973aec1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T20:48:31.747 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:31 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:31.579+0000 7f973aec1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T20:48:32.002 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:31 smithi186 ceph-mon[36391]: Reconfiguring mgr.x (unknown last config time)... 2024-03-16T20:48:32.002 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:31 smithi186 ceph-mon[36391]: Reconfiguring daemon mgr.x on smithi008 2024-03-16T20:48:32.003 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:31 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:31.901+0000 7f0beb80f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T20:48:32.003 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:31 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:31.999+0000 7f0beb80f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T20:48:32.003 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:31 smithi170 ceph-mon[35947]: Reconfiguring mgr.x (unknown last config time)... 2024-03-16T20:48:32.003 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:31 smithi170 ceph-mon[35947]: Reconfiguring daemon mgr.x on smithi008 2024-03-16T20:48:32.003 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:31 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:31.911+0000 7f973aec1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T20:48:32.003 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:32 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:31.998+0000 7f973aec1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T20:48:32.038 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:31 smithi008 ceph-mon[31434]: Reconfiguring mgr.x (unknown last config time)... 2024-03-16T20:48:32.038 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:31 smithi008 ceph-mon[31434]: Reconfiguring daemon mgr.x on smithi008 2024-03-16T20:48:32.366 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:32 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:32.194+0000 7f973aec1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:48:32.392 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:48:32 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:48:32.211+0000 7f0beb80f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T20:48:32.660 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:32 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:32.376+0000 7f973aec1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T20:48:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.667+0000 7f828e400700 1 -- 172.21.15.8:0/2649639546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8288109860 msgr2=0x7f8288109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.667+0000 7f828e400700 1 --2- 172.21.15.8:0/2649639546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8288109860 0x7f8288109cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f82700099c0 tx=0x7f8270009cd0 comp rx=0 tx=0).stop 2024-03-16T20:48:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.668+0000 7f828e400700 1 -- 172.21.15.8:0/2649639546 shutdown_connections 2024-03-16T20:48:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.668+0000 7f828e400700 1 --2- 172.21.15.8:0/2649639546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f828810a200 0x7f8288110ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.668+0000 7f828e400700 1 --2- 172.21.15.8:0/2649639546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8288108660 0x7f8288108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.668+0000 7f828e400700 1 --2- 172.21.15.8:0/2649639546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8288109860 0x7f8288109cc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:32.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.668+0000 7f828e400700 1 -- 172.21.15.8:0/2649639546 >> 172.21.15.8:0/2649639546 conn(0x7f8288077630 msgr2=0x7f8288079a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:32.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.668+0000 7f828e400700 1 -- 172.21.15.8:0/2649639546 shutdown_connections 2024-03-16T20:48:32.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.668+0000 7f828e400700 1 -- 172.21.15.8:0/2649639546 wait complete. 2024-03-16T20:48:32.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.669+0000 7f828e400700 1 Processor -- start 2024-03-16T20:48:32.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.669+0000 7f828e400700 1 -- start start 2024-03-16T20:48:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f828e400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8288108660 0x7f828819e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f828e400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8288109860 0x7f828819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f828e400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f828810a200 0x7f82881a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f828e400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82881a61f0 con 0x7f828810a200 2024-03-16T20:48:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f828e400700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82881a6330 con 0x7f8288108660 2024-03-16T20:48:32.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f828e400700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82881a64c0 con 0x7f8288109860 2024-03-16T20:48:32.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f8287400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8288108660 0x7f828819e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:32.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f827ea00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8288109860 0x7f828819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:32.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f8287400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8288108660 0x7f828819e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44676/0 (socket says 172.21.15.8:44676) 2024-03-16T20:48:32.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f827ea00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8288109860 0x7f828819eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44590/0 (socket says 172.21.15.8:44590) 2024-03-16T20:48:32.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f8287400700 1 -- 172.21.15.8:0/1265330865 learned_addr learned my addr 172.21.15.8:0/1265330865 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:48:32.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f8287e00700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f828810a200 0x7f82881a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:32.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f827ea00700 1 -- 172.21.15.8:0/1265330865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8288108660 msgr2=0x7f828819e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:32.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f827ea00700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8288108660 0x7f828819e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:32.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f827ea00700 1 -- 172.21.15.8:0/1265330865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f828810a200 msgr2=0x7f82881a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:32.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.670+0000 7f827ea00700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f828810a200 0x7f82881a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.671+0000 7f827ea00700 1 -- 172.21.15.8:0/1265330865 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280009c40 con 0x7f8288109860 2024-03-16T20:48:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.671+0000 7f8287400700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8288108660 0x7f828819e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:48:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.671+0000 7f827ea00700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8288109860 0x7f828819eba0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82700099c0 tx=0x7f827000bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.671+0000 7f8284c00700 1 -- 172.21.15.8:0/1265330865 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827001d070 con 0x7f8288109860 2024-03-16T20:48:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.671+0000 7f8284c00700 1 -- 172.21.15.8:0/1265330865 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8270005550 con 0x7f8288109860 2024-03-16T20:48:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.671+0000 7f8284c00700 1 -- 172.21.15.8:0/1265330865 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270004990 con 0x7f8288109860 2024-03-16T20:48:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.671+0000 7f828e400700 1 -- 172.21.15.8:0/1265330865 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82700095f0 con 0x7f8288109860 2024-03-16T20:48:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.671+0000 7f828e400700 1 -- 172.21.15.8:0/1265330865 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82881a6aa0 con 0x7f8288109860 2024-03-16T20:48:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.672+0000 7f8284c00700 1 -- 172.21.15.8:0/1265330865 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 13) v1 ==== 45824+0+0 (secure 0 0 0) 0x7f8270005050 con 0x7f8288109860 2024-03-16T20:48:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.672+0000 7f828e400700 1 -- 172.21.15.8:0/1265330865 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828810f9c0 con 0x7f8288109860 2024-03-16T20:48:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.673+0000 7f8284c00700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f826c038f90 0x7f826c03b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:48:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.673+0000 7f8284c00700 1 -- 172.21.15.8:0/1265330865 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f827004c580 con 0x7f8288109860 2024-03-16T20:48:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.673+0000 7f8287400700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f826c038f90 0x7f826c03b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:48:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.674+0000 7f8287400700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f826c038f90 0x7f826c03b450 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8278005950 tx=0x7f8278009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:48:32.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.678+0000 7f8284c00700 1 -- 172.21.15.8:0/1265330865 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8270004af0 con 0x7f8288109860 2024-03-16T20:48:32.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.761+0000 7f8284c00700 1 -- 172.21.15.8:0/1265330865 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mgrmap(e 14) v1 ==== 91023+0+0 (secure 0 0 0) 0x7f8270029360 con 0x7f8288109860 2024-03-16T20:48:32.922 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:32 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:32.656+0000 7f973aec1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:48:32.922 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:32 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:32.918+0000 7f973aec1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T20:48:32.923 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:32 smithi170 ceph-mon[35947]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:32.923 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:32 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-16T20:48:32.923 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:32 smithi170 ceph-mon[35947]: Standby manager daemon z started 2024-03-16T20:48:32.923 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:32 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:48:32.923 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:32 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-16T20:48:32.923 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:32 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:48:32.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:32.922+0000 7f828e400700 1 -- 172.21.15.8:0/1265330865 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f828802da30 con 0x7f826c038f90 2024-03-16T20:48:33.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:32 smithi186 ceph-mon[36391]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:33.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:32 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-16T20:48:33.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:32 smithi186 ceph-mon[36391]: Standby manager daemon z started 2024-03-16T20:48:33.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:32 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:48:33.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:32 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-16T20:48:33.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:32 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:48:33.202 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:32 smithi008 ceph-mon[31434]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:33.202 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:32 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-16T20:48:33.202 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:32 smithi008 ceph-mon[31434]: Standby manager daemon z started 2024-03-16T20:48:33.202 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:32 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:48:33.202 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:32 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-16T20:48:33.202 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:32 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.186:0/2468385780' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:48:33.366 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:33.152+0000 7f973aec1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T20:48:34.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: mgrmap e14: x(active, since 89s), standbys: z 2024-03-16T20:48:34.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-16T20:48:34.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:48:34.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:48:34.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:34.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:34.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:34.036 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:34.036 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.086 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: mgrmap e14: x(active, since 89s), standbys: z 2024-03-16T20:48:34.086 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-16T20:48:34.087 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:48:34.087 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:48:34.087 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:34.087 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.087 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.087 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.087 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:34.087 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:34.087 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:34.087 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.116 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:33.947+0000 7f973aec1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T20:48:34.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: mgrmap e14: x(active, since 89s), standbys: z 2024-03-16T20:48:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-16T20:48:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:48:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:48:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:34.772 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:34 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:34.515+0000 7f973aec1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T20:48:34.772 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:34 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:34.612+0000 7f973aec1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T20:48:34.983 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:34 smithi008 ceph-mon[31434]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:48:34.983 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:34 smithi008 ceph-mon[31434]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:35.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:34 smithi170 ceph-mon[35947]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:48:35.144 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:34 smithi170 ceph-mon[35947]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:35.144 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:48:34 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:48:34.826+0000 7f973aec1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T20:48:35.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:34 smithi186 ceph-mon[36391]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:48:35.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:34 smithi186 ceph-mon[36391]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:35.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:35.790+0000 7f8284c00700 1 -- 172.21.15.8:0/1265330865 <== mon.1 v2:172.21.15.186:3300/0 8 ==== mgrmap(e 15) v1 ==== 136222+0+0 (secure 0 0 0) 0x7f827000cb50 con 0x7f8288109860 2024-03-16T20:48:35.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:35 smithi008 ceph-mon[31434]: Standby manager daemon y started 2024-03-16T20:48:35.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:35 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-16T20:48:35.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:35 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:48:35.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:35 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-16T20:48:35.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:35 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:48:36.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:35 smithi170 ceph-mon[35947]: Standby manager daemon y started 2024-03-16T20:48:36.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:35 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-16T20:48:36.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:35 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:48:36.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:35 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-16T20:48:36.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:35 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:48:36.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:35 smithi186 ceph-mon[36391]: Standby manager daemon y started 2024-03-16T20:48:36.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:35 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-16T20:48:36.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:35 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:48:36.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:35 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-16T20:48:36.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:35 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.170:0/3304941490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:48:37.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:36 smithi170 ceph-mon[35947]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:37.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:36 smithi170 ceph-mon[35947]: mgrmap e15: x(active, since 92s), standbys: y, z 2024-03-16T20:48:37.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-16T20:48:37.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:36 smithi186 ceph-mon[36391]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:37.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:36 smithi186 ceph-mon[36391]: mgrmap e15: x(active, since 92s), standbys: y, z 2024-03-16T20:48:37.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-16T20:48:37.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:36 smithi008 ceph-mon[31434]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:37.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:36 smithi008 ceph-mon[31434]: mgrmap e15: x(active, since 92s), standbys: y, z 2024-03-16T20:48:37.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-16T20:48:38.043 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:37 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3835094199' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14eef491-9b9d-4dc1-8779-a2f28a5dbdc2"}]: dispatch 2024-03-16T20:48:38.043 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:37 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3835094199' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14eef491-9b9d-4dc1-8779-a2f28a5dbdc2"}]': finished 2024-03-16T20:48:38.043 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:37 smithi186 ceph-mon[36391]: osdmap e5: 1 total, 0 up, 1 in 2024-03-16T20:48:38.043 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:48:38.043 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:37 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/390595669' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:48:38.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:37 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3835094199' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14eef491-9b9d-4dc1-8779-a2f28a5dbdc2"}]: dispatch 2024-03-16T20:48:38.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:37 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3835094199' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14eef491-9b9d-4dc1-8779-a2f28a5dbdc2"}]': finished 2024-03-16T20:48:38.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:37 smithi170 ceph-mon[35947]: osdmap e5: 1 total, 0 up, 1 in 2024-03-16T20:48:38.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:48:38.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:37 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/390595669' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:48:38.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:37 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3835094199' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14eef491-9b9d-4dc1-8779-a2f28a5dbdc2"}]: dispatch 2024-03-16T20:48:38.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:37 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3835094199' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14eef491-9b9d-4dc1-8779-a2f28a5dbdc2"}]': finished 2024-03-16T20:48:38.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:37 smithi008 ceph-mon[31434]: osdmap e5: 1 total, 0 up, 1 in 2024-03-16T20:48:38.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:48:38.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:37 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/390595669' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:48:38.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:38 smithi008 ceph-mon[31434]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:39.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:38 smithi170 ceph-mon[35947]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:39.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:38 smithi186 ceph-mon[36391]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:41.079 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:40 smithi008 ceph-mon[31434]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:41.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:40 smithi170 ceph-mon[35947]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:41.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:40 smithi186 ceph-mon[36391]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:43.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:42 smithi170 ceph-mon[35947]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:43.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:42 smithi186 ceph-mon[36391]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:43.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:42 smithi008 ceph-mon[31434]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:45.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:44 smithi170 ceph-mon[35947]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:45.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:44 smithi186 ceph-mon[36391]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:45.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:44 smithi008 ceph-mon[31434]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:46.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:45 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-16T20:48:46.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:45 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:46.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:45 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-16T20:48:46.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:45 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:46.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:45 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-16T20:48:46.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:45 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:46.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:46 smithi008 ceph-mon[31434]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:46.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:46 smithi008 ceph-mon[31434]: Deploying daemon osd.0 on smithi008 2024-03-16T20:48:47.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:46 smithi170 ceph-mon[35947]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:47.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:46 smithi170 ceph-mon[35947]: Deploying daemon osd.0 on smithi008 2024-03-16T20:48:47.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:46 smithi186 ceph-mon[36391]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:47.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:46 smithi186 ceph-mon[36391]: Deploying daemon osd.0 on smithi008 2024-03-16T20:48:49.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:48 smithi170 ceph-mon[35947]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:49.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:48 smithi186 ceph-mon[36391]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:49.237 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:48 smithi008 ceph-mon[31434]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:50.944 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:50 smithi008 ceph-mon[31434]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:51.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:50 smithi170 ceph-mon[35947]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:51.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:50 smithi186 ceph-mon[36391]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:53.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:52 smithi170 ceph-mon[35947]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:53.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:52 smithi186 ceph-mon[36391]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:53.152 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:52 smithi008 ceph-mon[31434]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:54.862 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:54 smithi008 ceph-mon[31434]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:54.862 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:54 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:54.862 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:54 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:54.862 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:54 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:54.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:54 smithi170 ceph-mon[35947]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:54.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:54 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:54.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:54 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:54.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:54 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:54.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:54 smithi186 ceph-mon[36391]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:54.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:54 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:54.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:54 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:54.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:54 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:56.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:56 smithi008 ceph-mon[31434]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:56.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:56.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:56.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:56.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:56.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:56.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:56 smithi170 ceph-mon[35947]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:56.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:56.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:56.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:56.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:56.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:56.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:56 smithi186 ceph-mon[36391]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:56.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:56.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:56.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:48:56.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:48:56.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:57.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:57 smithi170 ceph-mon[35947]: from='osd.0 [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-16T20:48:57.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:57 smithi170 ceph-mon[35947]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-16T20:48:57.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:57 smithi186 ceph-mon[36391]: from='osd.0 [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-16T20:48:57.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:57 smithi186 ceph-mon[36391]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-16T20:48:57.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:57 smithi008 ceph-mon[31434]: from='osd.0 [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-16T20:48:57.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:57 smithi008 ceph-mon[31434]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-16T20:48:58.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.572+0000 7f8284c00700 1 -- 172.21.15.8:0/1265330865 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f828802da30 con 0x7f826c038f90 2024-03-16T20:48:58.575 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 0 on host 'smithi008' 2024-03-16T20:48:58.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.575+0000 7f828e400700 1 -- 172.21.15.8:0/1265330865 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f826c038f90 msgr2=0x7f826c03b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:58.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.576+0000 7f828e400700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f826c038f90 0x7f826c03b450 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8278005950 tx=0x7f8278009260 comp rx=0 tx=0).stop 2024-03-16T20:48:58.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.576+0000 7f828e400700 1 -- 172.21.15.8:0/1265330865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8288109860 msgr2=0x7f828819eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:48:58.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.576+0000 7f828e400700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8288109860 0x7f828819eba0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82700099c0 tx=0x7f827000bfd0 comp rx=0 tx=0).stop 2024-03-16T20:48:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.576+0000 7f828e400700 1 -- 172.21.15.8:0/1265330865 shutdown_connections 2024-03-16T20:48:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.576+0000 7f828e400700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f826c038f90 0x7f826c03b450 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.576+0000 7f828e400700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f828810a200 0x7f82881a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.576+0000 7f828e400700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8288108660 0x7f828819e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.576+0000 7f828e400700 1 --2- 172.21.15.8:0/1265330865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8288109860 0x7f828819eba0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:48:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.576+0000 7f828e400700 1 -- 172.21.15.8:0/1265330865 >> 172.21.15.8:0/1265330865 conn(0x7f8288077630 msgr2=0x7f828810cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:48:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.577+0000 7f828e400700 1 -- 172.21.15.8:0/1265330865 shutdown_connections 2024-03-16T20:48:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:48:58.577+0000 7f828e400700 1 -- 172.21.15.8:0/1265330865 wait complete. 2024-03-16T20:48:58.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:58 smithi008 ceph-mon[31434]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:58.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:58 smithi008 ceph-mon[31434]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-16T20:48:58.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:58 smithi008 ceph-mon[31434]: osdmap e6: 1 total, 0 up, 1 in 2024-03-16T20:48:58.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:48:58.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:58 smithi008 ceph-mon[31434]: from='osd.0 [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:48:58.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:58 smithi008 ceph-mon[31434]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:48:58.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:58.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:58.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:58.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:58 smithi186 ceph-mon[36391]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:58.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:58 smithi186 ceph-mon[36391]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-16T20:48:58.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:58 smithi186 ceph-mon[36391]: osdmap e6: 1 total, 0 up, 1 in 2024-03-16T20:48:58.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:48:58.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:58 smithi186 ceph-mon[36391]: from='osd.0 [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:48:58.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:58 smithi186 ceph-mon[36391]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:48:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:59.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:58 smithi170 ceph-mon[35947]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:48:59.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:58 smithi170 ceph-mon[35947]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-16T20:48:59.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:58 smithi170 ceph-mon[35947]: osdmap e6: 1 total, 0 up, 1 in 2024-03-16T20:48:59.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:48:59.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:58 smithi170 ceph-mon[35947]: from='osd.0 [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:48:59.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:58 smithi170 ceph-mon[35947]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:48:59.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:59.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:48:59.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:48:59.409 DEBUG:teuthology.orchestra.run.smithi008:osd.0> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.0.service 2024-03-16T20:48:59.414 INFO:tasks.cephadm:Deploying osd.1 on smithi170 with /dev/vg_nvme/lv_4... 2024-03-16T20:48:59.414 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-16T20:48:59.656 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T20:48:59.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:59 smithi170 ceph-mon[35947]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:48:59.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:59 smithi170 ceph-mon[35947]: osdmap e7: 1 total, 0 up, 1 in 2024-03-16T20:48:59.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:59 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:48:59.777 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:48:59 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:48:59.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:59 smithi186 ceph-mon[36391]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:48:59.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:59 smithi186 ceph-mon[36391]: osdmap e7: 1 total, 0 up, 1 in 2024-03-16T20:48:59.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:59 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:48:59.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:48:59 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:48:59.948 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:59 smithi008 ceph-mon[31434]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:48:59.948 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:59 smithi008 ceph-mon[31434]: osdmap e7: 1 total, 0 up, 1 in 2024-03-16T20:48:59.948 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:59 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:48:59.948 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:48:59 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:49:00.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:00 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:49:00.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:00 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:49:00.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:00 smithi186 ceph-mon[36391]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:49:00.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:00 smithi186 ceph-mon[36391]: osd.0 [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859] boot 2024-03-16T20:49:00.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:00 smithi186 ceph-mon[36391]: osdmap e8: 1 total, 1 up, 1 in 2024-03-16T20:49:00.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:00 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:49:00.949 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:00 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:49:00.949 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:00 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:49:00.949 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:00 smithi170 ceph-mon[35947]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:49:00.949 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:00 smithi170 ceph-mon[35947]: osd.0 [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859] boot 2024-03-16T20:49:00.949 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:00 smithi170 ceph-mon[35947]: osdmap e8: 1 total, 1 up, 1 in 2024-03-16T20:49:00.949 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:00 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:49:00.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:00 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:49:00.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:00 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:49:00.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:00 smithi008 ceph-mon[31434]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T20:49:00.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:00 smithi008 ceph-mon[31434]: osd.0 [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859] boot 2024-03-16T20:49:00.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:00 smithi008 ceph-mon[31434]: osdmap e8: 1 total, 1 up, 1 in 2024-03-16T20:49:00.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:00 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:49:01.515 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-16T20:49:01.515 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-16T20:49:01.515 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-03-16T20:49:01.515 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-03-16T20:49:01.516 INFO:teuthology.orchestra.run.smithi170.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00899409 s, 1.2 GB/s 2024-03-16T20:49:01.516 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 2024-03-16T20:49:01.516 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-03-16T20:49:02.128 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi170:vg_nvme/lv_4 2024-03-16T20:49:02.365 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T20:49:02.763 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:02 smithi170 ceph-mon[35947]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:02.763 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:02 smithi170 ceph-mon[35947]: osdmap e9: 1 total, 1 up, 1 in 2024-03-16T20:49:02.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:02 smithi008 ceph-mon[31434]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:02.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:02 smithi008 ceph-mon[31434]: osdmap e9: 1 total, 1 up, 1 in 2024-03-16T20:49:03.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:02 smithi186 ceph-mon[36391]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:03.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:02 smithi186 ceph-mon[36391]: osdmap e9: 1 total, 1 up, 1 in 2024-03-16T20:49:03.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.846+0000 7febea914700 1 -- 172.21.15.170:0/3980569049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe4107d00 msgr2=0x7febe410a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.846+0000 7febea914700 1 --2- 172.21.15.170:0/3980569049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe4107d00 0x7febe410a170 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7febdc00b0a0 tx=0x7febdc00b3b0 comp rx=0 tx=0).stop 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.846+0000 7febea914700 1 -- 172.21.15.170:0/3980569049 shutdown_connections 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.846+0000 7febea914700 1 --2- 172.21.15.170:0/3980569049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febe4102aa0 0x7febe4104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.846+0000 7febea914700 1 --2- 172.21.15.170:0/3980569049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe4107d00 0x7febe410a170 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.846+0000 7febea914700 1 --2- 172.21.15.170:0/3980569049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe41053d0 0x7febe41077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.846+0000 7febea914700 1 -- 172.21.15.170:0/3980569049 >> 172.21.15.170:0/3980569049 conn(0x7febe40fc4d0 msgr2=0x7febe40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.846+0000 7febea914700 1 -- 172.21.15.170:0/3980569049 shutdown_connections 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.846+0000 7febea914700 1 -- 172.21.15.170:0/3980569049 wait complete. 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.846+0000 7febea914700 1 Processor -- start 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.846+0000 7febea914700 1 -- start start 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febea914700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febe4102aa0 0x7febe4198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febea914700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe41053d0 0x7febe41986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febea914700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe4107d00 0x7febe419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:03.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febea914700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe419fd10 con 0x7febe4102aa0 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febea914700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe419fe50 con 0x7febe4107d00 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febea914700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe419ffe0 con 0x7febe41053d0 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe8eb1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe4107d00 0x7febe419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe8eb1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe4107d00 0x7febe419f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33946/0 (socket says 172.21.15.170:33946) 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe8eb1700 1 -- 172.21.15.170:0/1025559735 learned_addr learned my addr 172.21.15.170:0/1025559735 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe37fe700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe41053d0 0x7febe41986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe8eb1700 1 -- 172.21.15.170:0/1025559735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe41053d0 msgr2=0x7febe41986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe3fff700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febe4102aa0 0x7febe4198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe8eb1700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe41053d0 0x7febe41986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe8eb1700 1 -- 172.21.15.170:0/1025559735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febe4102aa0 msgr2=0x7febe4198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe8eb1700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febe4102aa0 0x7febe4198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe8eb1700 1 -- 172.21.15.170:0/1025559735 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc009d00 con 0x7febe4107d00 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe8eb1700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe4107d00 0x7febe419f740 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7febdc008f50 tx=0x7febdc008f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.847+0000 7febe17fa700 1 -- 172.21.15.170:0/1025559735 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc00e040 con 0x7febe4107d00 2024-03-16T20:49:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.848+0000 7febea914700 1 -- 172.21.15.170:0/1025559735 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe41a0260 con 0x7febe4107d00 2024-03-16T20:49:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.848+0000 7febe17fa700 1 -- 172.21.15.170:0/1025559735 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7febdc01d970 con 0x7febe4107d00 2024-03-16T20:49:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.848+0000 7febea914700 1 -- 172.21.15.170:0/1025559735 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe41a07a0 con 0x7febe4107d00 2024-03-16T20:49:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.848+0000 7febe17fa700 1 -- 172.21.15.170:0/1025559735 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc0057d0 con 0x7febe4107d00 2024-03-16T20:49:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.849+0000 7febea914700 1 -- 172.21.15.170:0/1025559735 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe40fe050 con 0x7febe4107d00 2024-03-16T20:49:03.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.850+0000 7febe17fa700 1 -- 172.21.15.170:0/1025559735 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 15) v1 ==== 136222+0+0 (secure 0 0 0) 0x7febdc005930 con 0x7febe4107d00 2024-03-16T20:49:03.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.850+0000 7febe17fa700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7febcc0a1a30 0x7febcc0a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:03.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.851+0000 7febe17fa700 1 -- 172.21.15.170:0/1025559735 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7febdc0cd980 con 0x7febe4107d00 2024-03-16T20:49:03.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.851+0000 7febe3fff700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7febcc0a1a30 0x7febcc0a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:49:03.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.852+0000 7febe3fff700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7febcc0a1a30 0x7febcc0a3ef0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7febd4006fd0 tx=0x7febd4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:49:03.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:03.854+0000 7febe17fa700 1 -- 172.21.15.170:0/1025559735 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7febdc098670 con 0x7febe4107d00 2024-03-16T20:49:04.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:04.055+0000 7febea914700 1 -- 172.21.15.170:0/1025559735 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7febe402d990 con 0x7febcc0a1a30 2024-03-16T20:49:04.981 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:04 smithi170 ceph-mon[35947]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:04.981 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:04.981 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:04.981 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:49:04.981 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:04.981 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:04.981 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:04.981 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:04.981 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:49:04.981 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:49:04.982 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:04.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:04 smithi008 ceph-mon[31434]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:04.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:04.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:04.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:49:04.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:04.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:04.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:49:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:49:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:05.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:04 smithi186 ceph-mon[36391]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:05.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:49:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:49:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:49:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:05.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:05 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi008 2024-03-16T20:49:05.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:05 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi008 to 17095M 2024-03-16T20:49:05.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:05 smithi170 ceph-mon[35947]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:49:05.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:05 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi008 2024-03-16T20:49:05.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:05 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi008 to 17095M 2024-03-16T20:49:05.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:05 smithi008 ceph-mon[31434]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:49:06.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:05 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi008 2024-03-16T20:49:06.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:05 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi008 to 17095M 2024-03-16T20:49:06.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:05 smithi186 ceph-mon[36391]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:49:06.927 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:06 smithi170 ceph-mon[35947]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:06.928 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:06 smithi170 ceph-mon[35947]: from='client.? 172.21.15.170:0/750003132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5827deaa-3a3a-46d6-93c8-f03d6d586e16"}]: dispatch 2024-03-16T20:49:06.928 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:06 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5827deaa-3a3a-46d6-93c8-f03d6d586e16"}]: dispatch 2024-03-16T20:49:06.928 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:06 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5827deaa-3a3a-46d6-93c8-f03d6d586e16"}]': finished 2024-03-16T20:49:06.928 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:06 smithi170 ceph-mon[35947]: osdmap e10: 2 total, 1 up, 2 in 2024-03-16T20:49:06.928 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:06 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:06.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:06 smithi008 ceph-mon[31434]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:06.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:06 smithi008 ceph-mon[31434]: from='client.? 172.21.15.170:0/750003132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5827deaa-3a3a-46d6-93c8-f03d6d586e16"}]: dispatch 2024-03-16T20:49:06.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:06 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5827deaa-3a3a-46d6-93c8-f03d6d586e16"}]: dispatch 2024-03-16T20:49:06.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:06 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5827deaa-3a3a-46d6-93c8-f03d6d586e16"}]': finished 2024-03-16T20:49:06.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:06 smithi008 ceph-mon[31434]: osdmap e10: 2 total, 1 up, 2 in 2024-03-16T20:49:06.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:06 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:07.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:06 smithi186 ceph-mon[36391]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:07.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:06 smithi186 ceph-mon[36391]: from='client.? 172.21.15.170:0/750003132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5827deaa-3a3a-46d6-93c8-f03d6d586e16"}]: dispatch 2024-03-16T20:49:07.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:06 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5827deaa-3a3a-46d6-93c8-f03d6d586e16"}]: dispatch 2024-03-16T20:49:07.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:06 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5827deaa-3a3a-46d6-93c8-f03d6d586e16"}]': finished 2024-03-16T20:49:07.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:06 smithi186 ceph-mon[36391]: osdmap e10: 2 total, 1 up, 2 in 2024-03-16T20:49:07.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:06 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:07.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:07 smithi008 ceph-mon[31434]: from='client.? 172.21.15.170:0/1693472868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:49:08.043 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:07 smithi186 ceph-mon[36391]: from='client.? 172.21.15.170:0/1693472868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:49:08.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:07 smithi170 ceph-mon[35947]: from='client.? 172.21.15.170:0/1693472868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:49:08.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:08 smithi008 ceph-mon[31434]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:09.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:08 smithi170 ceph-mon[35947]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:09.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:08 smithi186 ceph-mon[36391]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:10.775 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:10 smithi170 ceph-mon[35947]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:10.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:10 smithi008 ceph-mon[31434]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:11.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:10 smithi186 ceph-mon[36391]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:12.938 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:12 smithi170 ceph-mon[35947]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:12.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:12 smithi008 ceph-mon[31434]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:13.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:12 smithi186 ceph-mon[36391]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:13.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:13 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-16T20:49:13.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:13 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:14.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:13 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-16T20:49:14.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:13 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:14.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:13 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-16T20:49:14.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:13 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:14.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:14 smithi170 ceph-mon[35947]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:14.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:14 smithi170 ceph-mon[35947]: Deploying daemon osd.1 on smithi170 2024-03-16T20:49:14.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:14 smithi008 ceph-mon[31434]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:14.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:14 smithi008 ceph-mon[31434]: Deploying daemon osd.1 on smithi170 2024-03-16T20:49:15.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:14 smithi186 ceph-mon[36391]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:15.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:14 smithi186 ceph-mon[36391]: Deploying daemon osd.1 on smithi170 2024-03-16T20:49:16.963 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:16 smithi170 ceph-mon[35947]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:16.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:16 smithi008 ceph-mon[31434]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:17.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:16 smithi186 ceph-mon[36391]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:18.959 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:18 smithi170 ceph-mon[35947]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:18.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:18 smithi008 ceph-mon[31434]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:19.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:18 smithi186 ceph-mon[36391]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:20.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:20 smithi170 ceph-mon[35947]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:20.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:20.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:20.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:20.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:20 smithi186 ceph-mon[36391]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:20.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:20.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:20.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:20.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:20 smithi008 ceph-mon[31434]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:20.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:20.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:20.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:22.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:22 smithi170 ceph-mon[35947]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:22.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:22.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:22.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:22.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:22.561 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:22.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.635+0000 7febe17fa700 1 -- 172.21.15.170:0/1025559735 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7febe402d990 con 0x7febcc0a1a30 2024-03-16T20:49:22.639 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 1 on host 'smithi170' 2024-03-16T20:49:22.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.637+0000 7febea914700 1 -- 172.21.15.170:0/1025559735 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7febcc0a1a30 msgr2=0x7febcc0a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:22.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.637+0000 7febea914700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7febcc0a1a30 0x7febcc0a3ef0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7febd4006fd0 tx=0x7febd4008040 comp rx=0 tx=0).stop 2024-03-16T20:49:22.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.637+0000 7febea914700 1 -- 172.21.15.170:0/1025559735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe4107d00 msgr2=0x7febe419f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:22.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.637+0000 7febea914700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe4107d00 0x7febe419f740 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7febdc008f50 tx=0x7febdc008f80 comp rx=0 tx=0).stop 2024-03-16T20:49:22.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.637+0000 7febea914700 1 -- 172.21.15.170:0/1025559735 shutdown_connections 2024-03-16T20:49:22.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.637+0000 7febea914700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7febcc0a1a30 0x7febcc0a3ef0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:22.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.637+0000 7febea914700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febe4102aa0 0x7febe4198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:22.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.637+0000 7febea914700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febe4107d00 0x7febe419f740 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:22.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.637+0000 7febea914700 1 --2- 172.21.15.170:0/1025559735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe41053d0 0x7febe41986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:22.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.637+0000 7febea914700 1 -- 172.21.15.170:0/1025559735 >> 172.21.15.170:0/1025559735 conn(0x7febe40fc4d0 msgr2=0x7febe41033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:49:22.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.637+0000 7febea914700 1 -- 172.21.15.170:0/1025559735 shutdown_connections 2024-03-16T20:49:22.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:49:22.638+0000 7febea914700 1 -- 172.21.15.170:0/1025559735 wait complete. 2024-03-16T20:49:22.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:22 smithi186 ceph-mon[36391]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:22.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:22.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:22.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:22.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:22.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:22.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:22 smithi008 ceph-mon[31434]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:22.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:22.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:22.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:22.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:22.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:23.305 DEBUG:teuthology.orchestra.run.smithi170:osd.1> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.1.service 2024-03-16T20:49:23.308 INFO:tasks.cephadm:Deploying osd.2 on smithi186 with /dev/vg_nvme/lv_4... 2024-03-16T20:49:23.308 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-16T20:49:23.553 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:49:23.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:23.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:23.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:23.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:23 smithi170 ceph-mon[35947]: from='osd.1 [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T20:49:23.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:23 smithi170 ceph-mon[35947]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T20:49:23.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:23.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:23.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:23.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:23 smithi186 ceph-mon[36391]: from='osd.1 [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T20:49:23.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:23 smithi186 ceph-mon[36391]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T20:49:23.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:23.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:23 smithi008 ceph-mon[31434]: from='osd.1 [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T20:49:23.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:23 smithi008 ceph-mon[31434]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T20:49:24.778 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:24 smithi186 ceph-mon[36391]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:24.778 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:24 smithi186 ceph-mon[36391]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-16T20:49:24.778 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:24 smithi186 ceph-mon[36391]: from='osd.1 [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:49:24.778 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:24 smithi186 ceph-mon[36391]: osdmap e11: 2 total, 1 up, 2 in 2024-03-16T20:49:24.778 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:24 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:24.778 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:24 smithi186 ceph-mon[36391]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:49:24.899 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:24 smithi170 ceph-mon[35947]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:24.899 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:24 smithi170 ceph-mon[35947]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-16T20:49:24.899 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:24 smithi170 ceph-mon[35947]: from='osd.1 [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:49:24.899 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:24 smithi170 ceph-mon[35947]: osdmap e11: 2 total, 1 up, 2 in 2024-03-16T20:49:24.899 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:24 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:24.899 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:24 smithi170 ceph-mon[35947]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:49:24.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:24 smithi008 ceph-mon[31434]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:24.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:24 smithi008 ceph-mon[31434]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-16T20:49:24.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:24 smithi008 ceph-mon[31434]: from='osd.1 [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:49:24.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:24 smithi008 ceph-mon[31434]: osdmap e11: 2 total, 1 up, 2 in 2024-03-16T20:49:24.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:24 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:24.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:24 smithi008 ceph-mon[31434]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:49:25.317 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-16T20:49:25.317 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-16T20:49:25.317 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-03-16T20:49:25.317 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-03-16T20:49:25.317 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114041 s, 919 MB/s 2024-03-16T20:49:25.317 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-03-16T20:49:25.366 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 20:49:25 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1[40578]: 2024-03-16T20:49:25.068+0000 7f2d4ffdb700 -1 osd.1 0 waiting for initial osdmap 2024-03-16T20:49:25.367 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 20:49:25 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1[40578]: 2024-03-16T20:49:25.072+0000 7f2d47dc6700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T20:49:25.809 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:25 smithi170 ceph-mon[35947]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:49:25.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:25 smithi170 ceph-mon[35947]: osdmap e12: 2 total, 1 up, 2 in 2024-03-16T20:49:25.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:25 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:25.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:25 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:25.810 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:25 smithi170 ceph-mon[35947]: from='osd.1 ' entity='osd.1' 2024-03-16T20:49:25.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:25 smithi186 ceph-mon[36391]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:49:25.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:25 smithi186 ceph-mon[36391]: osdmap e12: 2 total, 1 up, 2 in 2024-03-16T20:49:25.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:25 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:25.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:25 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:25.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:25 smithi186 ceph-mon[36391]: from='osd.1 ' entity='osd.1' 2024-03-16T20:49:25.981 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_4 2024-03-16T20:49:25.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:25 smithi008 ceph-mon[31434]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:49:25.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:25 smithi008 ceph-mon[31434]: osdmap e12: 2 total, 1 up, 2 in 2024-03-16T20:49:25.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:25 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:25.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:25 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:25.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:25 smithi008 ceph-mon[31434]: from='osd.1 ' entity='osd.1' 2024-03-16T20:49:26.222 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:49:26.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:49:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:49:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: osd.1 [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520] boot 2024-03-16T20:49:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: osdmap e13: 2 total, 2 up, 2 in 2024-03-16T20:49:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:49:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:26.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:26.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:26.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:49:26.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:49:26.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:26.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:26.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: osd.1 [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520] boot 2024-03-16T20:49:26.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: osdmap e13: 2 total, 2 up, 2 in 2024-03-16T20:49:26.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:26.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:26.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:26.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:49:26.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:26.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:26.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:26.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:27.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: osd.1 [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520] boot 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: osdmap e13: 2 total, 2 up, 2 in 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:27.745 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:27 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi170 2024-03-16T20:49:27.745 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:27 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi170 to 17080M 2024-03-16T20:49:27.747 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.744+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/1931877187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1abc100f00 msgr2=0x7f1abc101320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:27.748 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.744+0000 7f1ac2a8e700 1 --2- 172.21.15.186:0/1931877187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1abc100f00 0x7f1abc101320 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009990 tx=0x7f1ab0009ca0 comp rx=0 tx=0).stop 2024-03-16T20:49:27.748 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.744+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/1931877187 shutdown_connections 2024-03-16T20:49:27.748 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.744+0000 7f1ac2a8e700 1 --2- 172.21.15.186:0/1931877187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1abc102a20 0x7f1abc109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:27.748 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.744+0000 7f1ac2a8e700 1 --2- 172.21.15.186:0/1931877187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1abc100f00 0x7f1abc101320 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:27.748 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.744+0000 7f1ac2a8e700 1 --2- 172.21.15.186:0/1931877187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1abc102060 0x7f1abc1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:27.748 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.744+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/1931877187 >> 172.21.15.186:0/1931877187 conn(0x7f1abc0fc4a0 msgr2=0x7f1abc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:49:27.748 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.744+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/1931877187 shutdown_connections 2024-03-16T20:49:27.748 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.744+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/1931877187 wait complete. 2024-03-16T20:49:27.750 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1ac2a8e700 1 Processor -- start 2024-03-16T20:49:27.750 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1ac2a8e700 1 -- start start 2024-03-16T20:49:27.750 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1ac2a8e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1abc100f00 0x7f1abc06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1ac2a8e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1abc102060 0x7f1abc19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1ac2a8e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1abc102a20 0x7f1abc19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1ac2a8e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc19fcb0 con 0x7f1abc100f00 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1ac2a8e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc19fe20 con 0x7f1abc102a20 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1ac2a8e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc19ffe0 con 0x7f1abc102060 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1abc102060 0x7f1abc19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1abc102060 0x7f1abc19cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:58824/0 (socket says 172.21.15.186:58824) 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1abbfff700 1 -- 172.21.15.186:0/2313147041 learned_addr learned my addr 172.21.15.186:0/2313147041 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1ac102b700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1abc102a20 0x7f1abc19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1abbfff700 1 -- 172.21.15.186:0/2313147041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1abc102a20 msgr2=0x7f1abc19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1abbfff700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1abc102a20 0x7f1abc19f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1abbfff700 1 -- 172.21.15.186:0/2313147041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1abc100f00 msgr2=0x7f1abc06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:27.751 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1abbfff700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1abc100f00 0x7f1abc06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:27.752 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.745+0000 7f1abbfff700 1 -- 172.21.15.186:0/2313147041 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab00095f0 con 0x7f1abc102060 2024-03-16T20:49:27.752 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.746+0000 7f1abbfff700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1abc102060 0x7f1abc19cec0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800b530 tx=0x7f1aa800b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:49:27.752 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.746+0000 7f1ab9ffb700 1 -- 172.21.15.186:0/2313147041 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8011830 con 0x7f1abc102060 2024-03-16T20:49:27.752 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.746+0000 7f1ab9ffb700 1 -- 172.21.15.186:0/2313147041 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1aa8011e90 con 0x7f1abc102060 2024-03-16T20:49:27.752 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.746+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/2313147041 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc1a02c0 con 0x7f1abc102060 2024-03-16T20:49:27.752 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.746+0000 7f1ab9ffb700 1 -- 172.21.15.186:0/2313147041 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa800f2e0 con 0x7f1abc102060 2024-03-16T20:49:27.752 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.746+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/2313147041 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc1a0890 con 0x7f1abc102060 2024-03-16T20:49:27.752 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.747+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/2313147041 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1abc1082b0 con 0x7f1abc102060 2024-03-16T20:49:27.753 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.748+0000 7f1ab9ffb700 1 -- 172.21.15.186:0/2313147041 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 15) v1 ==== 136222+0+0 (secure 0 0 0) 0x7f1aa80106a0 con 0x7f1abc102060 2024-03-16T20:49:27.753 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.748+0000 7f1ab9ffb700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1aac0a1ab0 0x7f1aac0a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:27.753 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.749+0000 7f1ab9ffb700 1 -- 172.21.15.186:0/2313147041 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f1aa80cb650 con 0x7f1abc102060 2024-03-16T20:49:27.753 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.749+0000 7f1ac082a700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1aac0a1ab0 0x7f1aac0a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:49:27.753 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.750+0000 7f1ac082a700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1aac0a1ab0 0x7f1aac0a3f70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00095c0 tx=0x7f1ab0009530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:49:27.757 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.753+0000 7f1ab9ffb700 1 -- 172.21.15.186:0/2313147041 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1aa80960b0 con 0x7f1abc102060 2024-03-16T20:49:27.957 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:27.954+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/2313147041 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1abc02da30 con 0x7f1aac0a1ab0 2024-03-16T20:49:27.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:27 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi170 2024-03-16T20:49:27.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:27 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi170 to 17080M 2024-03-16T20:49:28.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:27 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi170 2024-03-16T20:49:28.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:27 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi170 to 17080M 2024-03-16T20:49:28.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:28 smithi186 ceph-mon[36391]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:28.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:28 smithi186 ceph-mon[36391]: osdmap e14: 2 total, 2 up, 2 in 2024-03-16T20:49:28.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:49:28.865 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:49:28.866 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:28.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:28 smithi008 ceph-mon[31434]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:28 smithi008 ceph-mon[31434]: osdmap e14: 2 total, 2 up, 2 in 2024-03-16T20:49:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:49:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:49:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:29.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:28 smithi170 ceph-mon[35947]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:29.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:28 smithi170 ceph-mon[35947]: osdmap e14: 2 total, 2 up, 2 in 2024-03-16T20:49:29.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:49:29.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:49:29.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:29.780 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:29 smithi186 ceph-mon[36391]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:49:29.926 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:29 smithi008 ceph-mon[31434]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:49:30.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:29 smithi170 ceph-mon[35947]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:49:30.952 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:30 smithi186 ceph-mon[36391]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:30.953 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:30 smithi186 ceph-mon[36391]: from='client.? 172.21.15.186:0/3931261885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b803123f-d2da-4341-97ed-4b13fb96b49c"}]: dispatch 2024-03-16T20:49:30.953 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:30 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b803123f-d2da-4341-97ed-4b13fb96b49c"}]: dispatch 2024-03-16T20:49:30.953 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:30 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b803123f-d2da-4341-97ed-4b13fb96b49c"}]': finished 2024-03-16T20:49:30.953 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:30 smithi186 ceph-mon[36391]: osdmap e15: 3 total, 2 up, 3 in 2024-03-16T20:49:30.953 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:30 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:30.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:30 smithi008 ceph-mon[31434]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:30 smithi008 ceph-mon[31434]: from='client.? 172.21.15.186:0/3931261885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b803123f-d2da-4341-97ed-4b13fb96b49c"}]: dispatch 2024-03-16T20:49:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:30 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b803123f-d2da-4341-97ed-4b13fb96b49c"}]: dispatch 2024-03-16T20:49:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:30 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b803123f-d2da-4341-97ed-4b13fb96b49c"}]': finished 2024-03-16T20:49:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:30 smithi008 ceph-mon[31434]: osdmap e15: 3 total, 2 up, 3 in 2024-03-16T20:49:30.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:30 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:31.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:30 smithi170 ceph-mon[35947]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:31.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:30 smithi170 ceph-mon[35947]: from='client.? 172.21.15.186:0/3931261885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b803123f-d2da-4341-97ed-4b13fb96b49c"}]: dispatch 2024-03-16T20:49:31.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:30 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b803123f-d2da-4341-97ed-4b13fb96b49c"}]: dispatch 2024-03-16T20:49:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:30 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b803123f-d2da-4341-97ed-4b13fb96b49c"}]': finished 2024-03-16T20:49:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:30 smithi170 ceph-mon[35947]: osdmap e15: 3 total, 2 up, 3 in 2024-03-16T20:49:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:30 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:31.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:31 smithi008 ceph-mon[31434]: from='client.? 172.21.15.186:0/2393320108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:49:32.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:31 smithi170 ceph-mon[35947]: from='client.? 172.21.15.186:0/2393320108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:49:32.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:31 smithi186 ceph-mon[36391]: from='client.? 172.21.15.186:0/2393320108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:49:32.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:32 smithi008 ceph-mon[31434]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:33.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:32 smithi170 ceph-mon[35947]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:33.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:32 smithi186 ceph-mon[36391]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:34.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:34 smithi186 ceph-mon[36391]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:34.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:34 smithi008 ceph-mon[31434]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:35.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:34 smithi170 ceph-mon[35947]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:36.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:36 smithi008 ceph-mon[31434]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:37.084 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:36 smithi186 ceph-mon[36391]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:37.104 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:36 smithi170 ceph-mon[35947]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:37.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-16T20:49:37.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:37.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-16T20:49:37.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:38.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-16T20:49:38.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:38.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:38 smithi186 ceph-mon[36391]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:38.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:38 smithi186 ceph-mon[36391]: Deploying daemon osd.2 on smithi186 2024-03-16T20:49:38.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:38 smithi008 ceph-mon[31434]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:38.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:38 smithi008 ceph-mon[31434]: Deploying daemon osd.2 on smithi186 2024-03-16T20:49:39.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:38 smithi170 ceph-mon[35947]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:39.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:38 smithi170 ceph-mon[35947]: Deploying daemon osd.2 on smithi186 2024-03-16T20:49:40.815 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:40 smithi186 ceph-mon[36391]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:40.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:40 smithi008 ceph-mon[31434]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:41.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:40 smithi170 ceph-mon[35947]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:42.762 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:42 smithi186 ceph-mon[36391]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:42.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:42 smithi008 ceph-mon[31434]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:43.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:42 smithi170 ceph-mon[35947]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:44.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:43 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:44.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:43 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:44.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:43 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:44.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:43 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:44.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:43 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:44.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:43 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:44.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:43 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:44.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:43 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:44.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:43 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:45.082 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:44 smithi186 ceph-mon[36391]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:45.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:44 smithi170 ceph-mon[35947]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:45.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:44 smithi008 ceph-mon[31434]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:46.140 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 2 on host 'smithi186' 2024-03-16T20:49:46.140 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.134+0000 7f1ab9ffb700 1 -- 172.21.15.186:0/2313147041 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1abc02da30 con 0x7f1aac0a1ab0 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/2313147041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1aac0a1ab0 msgr2=0x7f1aac0a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1aac0a1ab0 0x7f1aac0a3f70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00095c0 tx=0x7f1ab0009530 comp rx=0 tx=0).stop 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/2313147041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1abc102060 msgr2=0x7f1abc19cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1abc102060 0x7f1abc19cec0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800b530 tx=0x7f1aa800b8f0 comp rx=0 tx=0).stop 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/2313147041 shutdown_connections 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1aac0a1ab0 0x7f1aac0a3f70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1abc100f00 0x7f1abc06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1abc102a20 0x7f1abc19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 --2- 172.21.15.186:0/2313147041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1abc102060 0x7f1abc19cec0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/2313147041 >> 172.21.15.186:0/2313147041 conn(0x7f1abc0fc4a0 msgr2=0x7f1abc1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/2313147041 shutdown_connections 2024-03-16T20:49:46.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:49:46.137+0000 7f1ac2a8e700 1 -- 172.21.15.186:0/2313147041 wait complete. 2024-03-16T20:49:46.723 DEBUG:teuthology.orchestra.run.smithi186:osd.2> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.2.service 2024-03-16T20:49:46.726 INFO:tasks.cephadm:Deploying osd.3 on smithi008 with /dev/vg_nvme/lv_3... 2024-03-16T20:49:46.726 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-16T20:49:46.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:46 smithi170 ceph-mon[35947]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:46.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:46.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:46 smithi170 ceph-mon[35947]: from='osd.2 [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T20:49:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:46 smithi170 ceph-mon[35947]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T20:49:47.002 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:46 smithi186 ceph-mon[36391]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:47.002 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:47.002 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:47.002 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:47.003 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:47.003 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:47.003 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:47.003 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:47.003 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:47.003 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:46 smithi186 ceph-mon[36391]: from='osd.2 [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T20:49:47.003 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:46 smithi186 ceph-mon[36391]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T20:49:47.177 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:49:47.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:46 smithi008 ceph-mon[31434]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:49:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:46 smithi008 ceph-mon[31434]: from='osd.2 [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T20:49:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:46 smithi008 ceph-mon[31434]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T20:49:48.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:48 smithi186 ceph-mon[36391]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:48.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:48 smithi186 ceph-mon[36391]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-16T20:49:48.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:48 smithi186 ceph-mon[36391]: from='osd.2 [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:49:48.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:48 smithi186 ceph-mon[36391]: osdmap e16: 3 total, 2 up, 3 in 2024-03-16T20:49:48.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:48 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:48.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:48 smithi186 ceph-mon[36391]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:49:48.457 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:48 smithi008 ceph-mon[31434]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:48.457 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:48 smithi008 ceph-mon[31434]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-16T20:49:48.457 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:48 smithi008 ceph-mon[31434]: from='osd.2 [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:49:48.457 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:48 smithi008 ceph-mon[31434]: osdmap e16: 3 total, 2 up, 3 in 2024-03-16T20:49:48.457 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:48 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:48.457 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:48 smithi008 ceph-mon[31434]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:49:48.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:48 smithi170 ceph-mon[35947]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:48.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:48 smithi170 ceph-mon[35947]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-16T20:49:48.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:48 smithi170 ceph-mon[35947]: from='osd.2 [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:49:48.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:48 smithi170 ceph-mon[35947]: osdmap e16: 3 total, 2 up, 3 in 2024-03-16T20:49:48.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:48 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:48.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:48 smithi170 ceph-mon[35947]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:49:48.892 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 20:49:48 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2[41745]: 2024-03-16T20:49:48.559+0000 7f654fbfd700 -1 osd.2 0 waiting for initial osdmap 2024-03-16T20:49:48.893 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 20:49:48 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2[41745]: 2024-03-16T20:49:48.563+0000 7f65479e8700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T20:49:49.349 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:49 smithi186 ceph-mon[36391]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:49:49.349 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:49 smithi186 ceph-mon[36391]: osdmap e17: 3 total, 2 up, 3 in 2024-03-16T20:49:49.349 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:49.349 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:49.349 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:49 smithi186 ceph-mon[36391]: from='osd.2 ' entity='osd.2' 2024-03-16T20:49:49.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:49 smithi008 ceph-mon[31434]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:49:49.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:49 smithi008 ceph-mon[31434]: osdmap e17: 3 total, 2 up, 3 in 2024-03-16T20:49:49.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:49 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:49.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:49 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:49.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:49 smithi008 ceph-mon[31434]: from='osd.2 ' entity='osd.2' 2024-03-16T20:49:49.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:49 smithi170 ceph-mon[35947]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:49:49.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:49 smithi170 ceph-mon[35947]: osdmap e17: 3 total, 2 up, 3 in 2024-03-16T20:49:49.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:49.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:49.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:49 smithi170 ceph-mon[35947]: from='osd.2 ' entity='osd.2' 2024-03-16T20:49:49.992 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-16T20:49:49.992 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-16T20:49:49.993 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2024-03-16T20:49:49.993 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2024-03-16T20:49:49.993 INFO:teuthology.orchestra.run.smithi008.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0327362 s, 320 MB/s 2024-03-16T20:49:49.993 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2024-03-16T20:49:50.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:49:50.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:49:50.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: osd.2 [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805] boot 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: osdmap e18: 3 total, 3 up, 3 in 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi186 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi186 to 17080M 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:50.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:50 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.394 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:49:50.394 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:49:50.394 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:50.394 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:50.394 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: osd.2 [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805] boot 2024-03-16T20:49:50.394 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: osdmap e18: 3 total, 3 up, 3 in 2024-03-16T20:49:50.394 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:50.394 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi186 2024-03-16T20:49:50.394 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.394 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.394 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:49:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi186 to 17080M 2024-03-16T20:49:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: osd.2 [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805] boot 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: osdmap e18: 3 total, 3 up, 3 in 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi186 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi186 to 17080M 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:49:50.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:50 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:50.823 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi008:vg_nvme/lv_3 2024-03-16T20:49:51.264 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:49:51.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:51 smithi008 ceph-mon[31434]: osdmap e19: 3 total, 3 up, 3 in 2024-03-16T20:49:52.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:51 smithi170 ceph-mon[35947]: osdmap e19: 3 total, 3 up, 3 in 2024-03-16T20:49:52.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:51 smithi186 ceph-mon[36391]: osdmap e19: 3 total, 3 up, 3 in 2024-03-16T20:49:52.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:52 smithi008 ceph-mon[31434]: pgmap v93: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:52.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-16T20:49:52.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-16T20:49:52.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:52 smithi008 ceph-mon[31434]: osdmap e20: 3 total, 3 up, 3 in 2024-03-16T20:49:52.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T20:49:53.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:52 smithi170 ceph-mon[35947]: pgmap v93: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:53.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-16T20:49:53.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-16T20:49:53.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:52 smithi170 ceph-mon[35947]: osdmap e20: 3 total, 3 up, 3 in 2024-03-16T20:49:53.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T20:49:53.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:52 smithi186 ceph-mon[36391]: pgmap v93: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:53.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-16T20:49:53.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-16T20:49:53.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:52 smithi186 ceph-mon[36391]: osdmap e20: 3 total, 3 up, 3 in 2024-03-16T20:49:53.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T20:49:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.268+0000 7f6a5b800700 1 -- 172.21.15.8:0/2394111566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a54105e00 msgr2=0x7f6a5410c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.268+0000 7f6a5b800700 1 --2- 172.21.15.8:0/2394111566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a54105e00 0x7f6a5410c6b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009fc0 tx=0x7f6a4c00b330 comp rx=0 tx=0).stop 2024-03-16T20:49:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.268+0000 7f6a5b800700 1 -- 172.21.15.8:0/2394111566 shutdown_connections 2024-03-16T20:49:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.268+0000 7f6a5b800700 1 --2- 172.21.15.8:0/2394111566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a54104260 0x7f6a54104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.268+0000 7f6a5b800700 1 --2- 172.21.15.8:0/2394111566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a54105e00 0x7f6a5410c6b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.268+0000 7f6a5b800700 1 --2- 172.21.15.8:0/2394111566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54105460 0x7f6a541058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.268+0000 7f6a5b800700 1 -- 172.21.15.8:0/2394111566 >> 172.21.15.8:0/2394111566 conn(0x7f6a540ff800 msgr2=0x7f6a54101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:49:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.268+0000 7f6a5b800700 1 -- 172.21.15.8:0/2394111566 shutdown_connections 2024-03-16T20:49:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.268+0000 7f6a5b800700 1 -- 172.21.15.8:0/2394111566 wait complete. 2024-03-16T20:49:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.269+0000 7f6a5b800700 1 Processor -- start 2024-03-16T20:49:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a5b800700 1 -- start start 2024-03-16T20:49:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a5b800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a54104260 0x7f6a5419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a5b800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a54105460 0x7f6a5419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a5b800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54105e00 0x7f6a541a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a5b800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a541a1f30 con 0x7f6a54105460 2024-03-16T20:49:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a5b800700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a541a2070 con 0x7f6a54104260 2024-03-16T20:49:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a5b800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a541a2200 con 0x7f6a54105e00 2024-03-16T20:49:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a53e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a54105460 0x7f6a5419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:49:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a53e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a54105460 0x7f6a5419a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35508/0 (socket says 172.21.15.8:35508) 2024-03-16T20:49:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a53e00700 1 -- 172.21.15.8:0/4099650017 learned_addr learned my addr 172.21.15.8:0/4099650017 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:49:53.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a58e00700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a54104260 0x7f6a5419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:49:53.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.270+0000 7f6a59800700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54105e00 0x7f6a541a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:49:53.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.271+0000 7f6a59800700 1 -- 172.21.15.8:0/4099650017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a54104260 msgr2=0x7f6a5419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.271+0000 7f6a59800700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a54104260 0x7f6a5419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.271+0000 7f6a59800700 1 -- 172.21.15.8:0/4099650017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a54105460 msgr2=0x7f6a5419a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.271+0000 7f6a59800700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a54105460 0x7f6a5419a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.271+0000 7f6a59800700 1 -- 172.21.15.8:0/4099650017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480095f0 con 0x7f6a54105e00 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.271+0000 7f6a58e00700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a54104260 0x7f6a5419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.271+0000 7f6a53e00700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a54105460 0x7f6a5419a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.271+0000 7f6a59800700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54105e00 0x7f6a541a1960 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c007890 tx=0x7f6a4c0078c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.272+0000 7f6a51600700 1 -- 172.21.15.8:0/4099650017 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c00e040 con 0x7f6a54105e00 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.272+0000 7f6a51600700 1 -- 172.21.15.8:0/4099650017 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6a4c01d470 con 0x7f6a54105e00 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.272+0000 7f6a5b800700 1 -- 172.21.15.8:0/4099650017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c009c40 con 0x7f6a54105e00 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.272+0000 7f6a51600700 1 -- 172.21.15.8:0/4099650017 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0052a0 con 0x7f6a54105e00 2024-03-16T20:49:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.272+0000 7f6a5b800700 1 -- 172.21.15.8:0/4099650017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a541a2760 con 0x7f6a54105e00 2024-03-16T20:49:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.273+0000 7f6a5b800700 1 -- 172.21.15.8:0/4099650017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5410b550 con 0x7f6a54105e00 2024-03-16T20:49:53.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.275+0000 7f6a51600700 1 -- 172.21.15.8:0/4099650017 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 15) v1 ==== 136222+0+0 (secure 0 0 0) 0x7f6a4c01da00 con 0x7f6a54105e00 2024-03-16T20:49:53.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.276+0000 7f6a51600700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a3c0a1b30 0x7f6a3c0a3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:49:53.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.277+0000 7f6a51600700 1 -- 172.21.15.8:0/4099650017 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3237+0+0 (secure 0 0 0) 0x7f6a4c0cd5c0 con 0x7f6a54105e00 2024-03-16T20:49:53.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.277+0000 7f6a58e00700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a3c0a1b30 0x7f6a3c0a3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:49:53.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.277+0000 7f6a58e00700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a3c0a1b30 0x7f6a3c0a3ff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a541052c0 tx=0x7f6a48009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:49:53.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.279+0000 7f6a51600700 1 -- 172.21.15.8:0/4099650017 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6a4c097c70 con 0x7f6a54105e00 2024-03-16T20:49:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:53.548+0000 7f6a5b800700 1 -- 172.21.15.8:0/4099650017 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a5402d990 con 0x7f6a3c0a1b30 2024-03-16T20:49:53.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:53 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-16T20:49:53.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:53 smithi008 ceph-mon[31434]: osdmap e21: 3 total, 3 up, 3 in 2024-03-16T20:49:53.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:53 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:49:53.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:53 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:49:53.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:53 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:54.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:53 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-16T20:49:54.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:53 smithi170 ceph-mon[35947]: osdmap e21: 3 total, 3 up, 3 in 2024-03-16T20:49:54.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:53 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:49:54.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:53 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:49:54.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:53 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:54.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:53 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-16T20:49:54.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:53 smithi186 ceph-mon[36391]: osdmap e21: 3 total, 3 up, 3 in 2024-03-16T20:49:54.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:53 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:49:54.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:53 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:49:54.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:53 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:49:54.470 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 20:49:53 smithi008 sudo[50759]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T20:49:54.471 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 20:49:54 smithi008 sudo[50759]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:54.471 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 20:49:54 smithi008 sudo[50759]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:54.471 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 20:49:54 smithi008 sudo[50759]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:54.723 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 20:49:54 smithi008 sudo[50815]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T20:49:54.725 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 20:49:54 smithi008 sudo[50815]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:54.725 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 20:49:54 smithi008 sudo[50815]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:54.725 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 20:49:54 smithi008 sudo[50815]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:54 smithi008 ceph-mon[31434]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:54 smithi008 ceph-mon[31434]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:49:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:54 smithi008 ceph-mon[31434]: osdmap e22: 3 total, 3 up, 3 in 2024-03-16T20:49:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:54 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:55.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:54 smithi170 ceph-mon[35947]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:55.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:54 smithi170 ceph-mon[35947]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:49:55.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:54 smithi170 ceph-mon[35947]: osdmap e22: 3 total, 3 up, 3 in 2024-03-16T20:49:55.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:54 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:55.117 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 20:49:54 smithi170 sudo[44296]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T20:49:55.117 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 20:49:54 smithi170 sudo[44296]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:55.117 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 20:49:54 smithi170 sudo[44296]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:55.117 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 20:49:54 smithi170 sudo[44296]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:55.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:54 smithi186 ceph-mon[36391]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:55.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:54 smithi186 ceph-mon[36391]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:49:55.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:54 smithi186 ceph-mon[36391]: osdmap e22: 3 total, 3 up, 3 in 2024-03-16T20:49:55.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:54 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:55.616 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 20:49:55 smithi170 sudo[44299]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T20:49:55.617 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 20:49:55 smithi170 sudo[44299]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:55.617 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 20:49:55 smithi170 sudo[44299]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:55.617 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 20:49:55 smithi170 sudo[44299]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:55.681 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 20:49:55 smithi186 sudo[45387]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T20:49:55.681 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 20:49:55 smithi186 sudo[45387]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:55.681 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 20:49:55 smithi186 sudo[45387]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:55.681 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 20:49:55 smithi186 sudo[45387]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:56.142 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 20:49:55 smithi186 sudo[45390]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T20:49:56.142 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 20:49:55 smithi186 sudo[45390]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:56.142 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 20:49:55 smithi186 sudo[45390]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:56.142 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 20:49:55 smithi186 sudo[45390]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:56.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:56 smithi008 sudo[50867]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T20:49:56.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:56 smithi008 sudo[50867]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:56.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:56 smithi008 sudo[50867]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:56.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:56 smithi008 sudo[50867]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:56.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:49:56.904+0000 7f6a51600700 1 -- 172.21.15.8:0/4099650017 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f6a4c098040 con 0x7f6a54105e00 2024-03-16T20:49:57.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:56 smithi008 sudo[50889]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T20:49:57.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:56 smithi008 sudo[50889]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:57.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:56 smithi008 sudo[50889]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:57.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:56 smithi008 sudo[50889]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:57.399 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:57 smithi186 sudo[45393]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T20:49:57.399 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:57 smithi186 sudo[45393]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:57.399 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:57 smithi186 sudo[45393]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:57.399 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:57 smithi186 sudo[45393]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:57.661 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:57 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:57.661 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:57 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:57.661 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:57 smithi170 sudo[44302]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T20:49:57.661 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:57 smithi170 sudo[44302]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:57.662 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:57 smithi170 sudo[44302]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:57.662 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:57 smithi170 sudo[44302]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:57.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:57 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:57.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:57 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:57.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:57 smithi186 sudo[45396]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T20:49:57.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:57 smithi186 sudo[45396]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:57.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:57 smithi186 sudo[45396]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:57.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:57 smithi186 sudo[45396]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:57.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:57 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:57.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:57 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:49:58.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:57 smithi170 sudo[44305]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T20:49:58.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:57 smithi170 sudo[44305]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T20:49:58.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:57 smithi170 sudo[44305]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T20:49:58.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:57 smithi170 sudo[44305]: pam_unix(sudo:session): session closed for user root 2024-03-16T20:49:58.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:58.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T20:49:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T20:49:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:49:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:49:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:49:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T20:49:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-03-16T20:49:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:49:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:49:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:49:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T20:49:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T20:49:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:49:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:49:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:49:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2700001623' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a9ec3bc-a405-4fae-a263-63f34412c469"}]: dispatch 2024-03-16T20:49:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a9ec3bc-a405-4fae-a263-63f34412c469"}]: dispatch 2024-03-16T20:49:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T20:49:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a9ec3bc-a405-4fae-a263-63f34412c469"}]': finished 2024-03-16T20:49:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: osdmap e23: 4 total, 3 up, 4 in 2024-03-16T20:49:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:49:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T20:49:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T20:49:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:49:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:49:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:49:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T20:49:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-03-16T20:49:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:49:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:49:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2700001623' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a9ec3bc-a405-4fae-a263-63f34412c469"}]: dispatch 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a9ec3bc-a405-4fae-a263-63f34412c469"}]: dispatch 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a9ec3bc-a405-4fae-a263-63f34412c469"}]': finished 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: osdmap e23: 4 total, 3 up, 4 in 2024-03-16T20:49:58.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:49:58.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:49:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T20:49:58.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T20:49:58.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:49:58.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:49:58.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:49:58.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2700001623' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a9ec3bc-a405-4fae-a263-63f34412c469"}]: dispatch 2024-03-16T20:49:58.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a9ec3bc-a405-4fae-a263-63f34412c469"}]: dispatch 2024-03-16T20:49:58.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T20:49:58.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a9ec3bc-a405-4fae-a263-63f34412c469"}]': finished 2024-03-16T20:49:58.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: osdmap e23: 4 total, 3 up, 4 in 2024-03-16T20:49:58.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:49:59.697 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:49:59 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2315731538' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:49:59.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:49:59 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2315731538' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:49:59.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:49:59 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2315731538' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:50:00.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:00 smithi008 ceph-mon[31434]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:00.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:00 smithi008 ceph-mon[31434]: overall HEALTH_OK 2024-03-16T20:50:00.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:00 smithi170 ceph-mon[35947]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:00 smithi170 ceph-mon[35947]: overall HEALTH_OK 2024-03-16T20:50:00.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:00 smithi186 ceph-mon[36391]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:00.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:00 smithi186 ceph-mon[36391]: overall HEALTH_OK 2024-03-16T20:50:02.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:02 smithi008 ceph-mon[31434]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:02.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:02 smithi170 ceph-mon[35947]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:02.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:02 smithi186 ceph-mon[36391]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:04.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:04 smithi008 ceph-mon[31434]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-03-16T20:50:04.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:04 smithi170 ceph-mon[35947]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-03-16T20:50:04.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:04 smithi186 ceph-mon[36391]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-03-16T20:50:06.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:06 smithi008 ceph-mon[31434]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-03-16T20:50:06.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:06 smithi170 ceph-mon[35947]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-03-16T20:50:06.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:06 smithi186 ceph-mon[36391]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-03-16T20:50:07.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-16T20:50:07.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:07.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-16T20:50:07.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:07.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-16T20:50:07.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:08.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:08 smithi008 ceph-mon[31434]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-03-16T20:50:08.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:08 smithi008 ceph-mon[31434]: Deploying daemon osd.3 on smithi008 2024-03-16T20:50:08.793 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:08 smithi186 ceph-mon[36391]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-03-16T20:50:08.793 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:08 smithi186 ceph-mon[36391]: Deploying daemon osd.3 on smithi008 2024-03-16T20:50:08.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:08 smithi170 ceph-mon[35947]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-03-16T20:50:08.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:08 smithi170 ceph-mon[35947]: Deploying daemon osd.3 on smithi008 2024-03-16T20:50:10.721 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:10 smithi008 ceph-mon[31434]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 923 B/s rd, 24 KiB/s wr, 2 op/s 2024-03-16T20:50:10.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:10 smithi170 ceph-mon[35947]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 923 B/s rd, 24 KiB/s wr, 2 op/s 2024-03-16T20:50:10.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:10 smithi186 ceph-mon[36391]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 923 B/s rd, 24 KiB/s wr, 2 op/s 2024-03-16T20:50:12.608 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:12 smithi008 ceph-mon[31434]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-03-16T20:50:12.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:12 smithi170 ceph-mon[35947]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-03-16T20:50:12.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:12 smithi186 ceph-mon[36391]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-03-16T20:50:14.602 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:14 smithi008 ceph-mon[31434]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-03-16T20:50:14.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:14 smithi170 ceph-mon[35947]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-03-16T20:50:14.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:14 smithi186 ceph-mon[36391]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-03-16T20:50:16.701 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:16 smithi008 ceph-mon[31434]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:16.701 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:16.701 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:16.701 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:16.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:16 smithi170 ceph-mon[35947]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:16.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:16.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:16.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:16.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:16 smithi186 ceph-mon[36391]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:16.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:16.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:16.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:18.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:18 smithi008 ceph-mon[31434]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:18.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:18 smithi170 ceph-mon[35947]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:18.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:18 smithi186 ceph-mon[36391]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:19.917 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:19.917 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:19.917 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:19.917 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:19.917 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:19.917 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:19 smithi008 ceph-mon[31434]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-16T20:50:20.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:20.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:20.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:20.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:20.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:20.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:19 smithi170 ceph-mon[35947]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-16T20:50:20.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:20.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:20.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:20.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:20.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:20.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:19 smithi186 ceph-mon[36391]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-16T20:50:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.555+0000 7f6a51600700 1 -- 172.21.15.8:0/4099650017 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6a5402d990 con 0x7f6a3c0a1b30 2024-03-16T20:50:20.559 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 3 on host 'smithi008' 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 -- 172.21.15.8:0/4099650017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a3c0a1b30 msgr2=0x7f6a3c0a3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a3c0a1b30 0x7f6a3c0a3ff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a541052c0 tx=0x7f6a48009310 comp rx=0 tx=0).stop 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 -- 172.21.15.8:0/4099650017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54105e00 msgr2=0x7f6a541a1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54105e00 0x7f6a541a1960 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c007890 tx=0x7f6a4c0078c0 comp rx=0 tx=0).stop 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 -- 172.21.15.8:0/4099650017 shutdown_connections 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a3c0a1b30 0x7f6a3c0a3ff0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54105e00 0x7f6a541a1960 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a54104260 0x7f6a5419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 --2- 172.21.15.8:0/4099650017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a54105460 0x7f6a5419a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 -- 172.21.15.8:0/4099650017 >> 172.21.15.8:0/4099650017 conn(0x7f6a540ff800 msgr2=0x7f6a54108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 -- 172.21.15.8:0/4099650017 shutdown_connections 2024-03-16T20:50:20.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:50:20.559+0000 7f6a5b800700 1 -- 172.21.15.8:0/4099650017 wait complete. 2024-03-16T20:50:21.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:20 smithi170 ceph-mon[35947]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:21.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:20 smithi170 ceph-mon[35947]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-16T20:50:21.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:20 smithi170 ceph-mon[35947]: osdmap e24: 4 total, 3 up, 4 in 2024-03-16T20:50:21.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:20 smithi170 ceph-mon[35947]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:50:21.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:21.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:21.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:21.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:21.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:20 smithi186 ceph-mon[36391]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:21.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:20 smithi186 ceph-mon[36391]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-16T20:50:21.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:20 smithi186 ceph-mon[36391]: osdmap e24: 4 total, 3 up, 4 in 2024-03-16T20:50:21.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:20 smithi186 ceph-mon[36391]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:50:21.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:21.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:21.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:21.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:21.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:20 smithi008 ceph-mon[31434]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:21.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:20 smithi008 ceph-mon[31434]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-16T20:50:21.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:20 smithi008 ceph-mon[31434]: osdmap e24: 4 total, 3 up, 4 in 2024-03-16T20:50:21.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:20 smithi008 ceph-mon[31434]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:50:21.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:21.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:21.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:21.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:21.355 DEBUG:teuthology.orchestra.run.smithi008:osd.3> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.3.service 2024-03-16T20:50:21.359 INFO:tasks.cephadm:Deploying osd.4 on smithi170 with /dev/vg_nvme/lv_3... 2024-03-16T20:50:21.360 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-16T20:50:21.617 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T20:50:22.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:21 smithi170 ceph-mon[35947]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:50:22.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:21 smithi170 ceph-mon[35947]: osdmap e25: 4 total, 3 up, 4 in 2024-03-16T20:50:22.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:21 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:22.043 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:21 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:22.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:21 smithi186 ceph-mon[36391]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:50:22.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:21 smithi186 ceph-mon[36391]: osdmap e25: 4 total, 3 up, 4 in 2024-03-16T20:50:22.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:21 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:22.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:21 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:22.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:21 smithi008 ceph-mon[31434]: from='osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:50:22.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:21 smithi008 ceph-mon[31434]: osdmap e25: 4 total, 3 up, 4 in 2024-03-16T20:50:22.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:21 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:22.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:21 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:22.969 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:22 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:50:22.969 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:22 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:50:22.969 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:22 smithi008 ceph-mon[31434]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:22.969 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:22.969 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:22 smithi008 ceph-mon[31434]: osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487] boot 2024-03-16T20:50:22.969 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:22 smithi008 ceph-mon[31434]: osdmap e26: 4 total, 4 up, 4 in 2024-03-16T20:50:22.969 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:22.969 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:22 smithi008 ceph-mon[31434]: osdmap e27: 4 total, 4 up, 4 in 2024-03-16T20:50:23.055 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:22 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:50:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:22 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:50:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:22 smithi170 ceph-mon[35947]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:22 smithi170 ceph-mon[35947]: osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487] boot 2024-03-16T20:50:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:22 smithi170 ceph-mon[35947]: osdmap e26: 4 total, 4 up, 4 in 2024-03-16T20:50:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:23.056 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:22 smithi170 ceph-mon[35947]: osdmap e27: 4 total, 4 up, 4 in 2024-03-16T20:50:23.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:22 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:50:23.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:22 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:50:23.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:22 smithi186 ceph-mon[36391]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T20:50:23.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:23.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:22 smithi186 ceph-mon[36391]: osd.3 [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487] boot 2024-03-16T20:50:23.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:22 smithi186 ceph-mon[36391]: osdmap e26: 4 total, 4 up, 4 in 2024-03-16T20:50:23.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:50:23.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:22 smithi186 ceph-mon[36391]: osdmap e27: 4 total, 4 up, 4 in 2024-03-16T20:50:23.616 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-16T20:50:23.616 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-16T20:50:23.617 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-03-16T20:50:23.617 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-03-16T20:50:23.617 INFO:teuthology.orchestra.run.smithi170.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012654 s, 829 MB/s 2024-03-16T20:50:23.617 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-03-16T20:50:24.228 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:23 smithi170 ceph-mon[35947]: osdmap e28: 4 total, 4 up, 4 in 2024-03-16T20:50:24.228 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:23 smithi170 ceph-mon[35947]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:24.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:23 smithi008 ceph-mon[31434]: osdmap e28: 4 total, 4 up, 4 in 2024-03-16T20:50:24.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:23 smithi008 ceph-mon[31434]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:24.258 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi170:vg_nvme/lv_3 2024-03-16T20:50:24.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:23 smithi186 ceph-mon[36391]: osdmap e28: 4 total, 4 up, 4 in 2024-03-16T20:50:24.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:23 smithi186 ceph-mon[36391]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:24.492 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T20:50:25.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:24 smithi008 ceph-mon[31434]: osdmap e29: 4 total, 4 up, 4 in 2024-03-16T20:50:25.335 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:24 smithi170 ceph-mon[35947]: osdmap e29: 4 total, 4 up, 4 in 2024-03-16T20:50:25.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:24 smithi186 ceph-mon[36391]: osdmap e29: 4 total, 4 up, 4 in 2024-03-16T20:50:26.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.152+0000 7f2d50520700 1 -- 172.21.15.170:0/2529135977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d48107d00 msgr2=0x7f2d4810a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:50:26.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.152+0000 7f2d50520700 1 --2- 172.21.15.170:0/2529135977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d48107d00 0x7f2d4810a170 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000b0a0 tx=0x7f2d4000b3b0 comp rx=0 tx=0).stop 2024-03-16T20:50:26.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.152+0000 7f2d50520700 1 -- 172.21.15.170:0/2529135977 shutdown_connections 2024-03-16T20:50:26.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.152+0000 7f2d50520700 1 --2- 172.21.15.170:0/2529135977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d48107d00 0x7f2d4810a170 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:26.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.152+0000 7f2d50520700 1 --2- 172.21.15.170:0/2529135977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d48102aa0 0x7f2d48104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:26.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.152+0000 7f2d50520700 1 --2- 172.21.15.170:0/2529135977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d481053d0 0x7f2d481077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:26.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.152+0000 7f2d50520700 1 -- 172.21.15.170:0/2529135977 >> 172.21.15.170:0/2529135977 conn(0x7f2d480fc4d0 msgr2=0x7f2d480fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:50:26.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.152+0000 7f2d50520700 1 -- 172.21.15.170:0/2529135977 shutdown_connections 2024-03-16T20:50:26.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.152+0000 7f2d50520700 1 -- 172.21.15.170:0/2529135977 wait complete. 2024-03-16T20:50:26.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.152+0000 7f2d50520700 1 Processor -- start 2024-03-16T20:50:26.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.152+0000 7f2d50520700 1 -- start start 2024-03-16T20:50:26.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d50520700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d48102aa0 0x7f2d481981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:50:26.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d50520700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d481053d0 0x7f2d48198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:50:26.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d50520700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d48107d00 0x7f2d4819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:50:26.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d50520700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4819fd70 con 0x7f2d48102aa0 2024-03-16T20:50:26.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d50520700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4819feb0 con 0x7f2d481053d0 2024-03-16T20:50:26.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d50520700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d481a0040 con 0x7f2d48107d00 2024-03-16T20:50:26.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d4dabb700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d481053d0 0x7f2d48198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d4dabb700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d481053d0 0x7f2d48198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48084/0 (socket says 172.21.15.170:48084) 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d4dabb700 1 -- 172.21.15.170:0/1618588183 learned_addr learned my addr 172.21.15.170:0/1618588183 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d4eabd700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d48107d00 0x7f2d4819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d4dabb700 1 -- 172.21.15.170:0/1618588183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d48107d00 msgr2=0x7f2d4819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d4dabb700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d48107d00 0x7f2d4819f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d4e2bc700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d48102aa0 0x7f2d481981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d4dabb700 1 -- 172.21.15.170:0/1618588183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d48102aa0 msgr2=0x7f2d481981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d4dabb700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d48102aa0 0x7f2d481981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d4dabb700 1 -- 172.21.15.170:0/1618588183 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40009d00 con 0x7f2d481053d0 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d4dabb700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d481053d0 0x7f2d48198720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800b530 tx=0x7f2d3800b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d3f7fe700 1 -- 172.21.15.170:0/1618588183 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38011830 con 0x7f2d481053d0 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d3f7fe700 1 -- 172.21.15.170:0/1618588183 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2d38011e90 con 0x7f2d481053d0 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d50520700 1 -- 172.21.15.170:0/1618588183 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d481a0320 con 0x7f2d481053d0 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.153+0000 7f2d3f7fe700 1 -- 172.21.15.170:0/1618588183 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3800f540 con 0x7f2d481053d0 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.154+0000 7f2d50520700 1 -- 172.21.15.170:0/1618588183 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d481a08a0 con 0x7f2d481053d0 2024-03-16T20:50:26.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.154+0000 7f2d50520700 1 -- 172.21.15.170:0/1618588183 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d480fe050 con 0x7f2d481053d0 2024-03-16T20:50:26.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.155+0000 7f2d3f7fe700 1 -- 172.21.15.170:0/1618588183 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f2d38010780 con 0x7f2d481053d0 2024-03-16T20:50:26.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.156+0000 7f2d3f7fe700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2d340a1ac0 0x7f2d340a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:50:26.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.156+0000 7f2d3f7fe700 1 -- 172.21.15.170:0/1618588183 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3669+0+0 (secure 0 0 0) 0x7f2d380cbd10 con 0x7f2d481053d0 2024-03-16T20:50:26.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.156+0000 7f2d4e2bc700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2d340a1ac0 0x7f2d340a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:50:26.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.157+0000 7f2d4e2bc700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2d340a1ac0 0x7f2d340a3f80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2d44005950 tx=0x7f2d44005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:50:26.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.161+0000 7f2d3f7fe700 1 -- 172.21.15.170:0/1618588183 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2d38096140 con 0x7f2d481053d0 2024-03-16T20:50:26.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:25 smithi008 ceph-mon[31434]: osdmap e30: 4 total, 4 up, 4 in 2024-03-16T20:50:26.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:25 smithi008 ceph-mon[31434]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:26.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:25 smithi170 ceph-mon[35947]: osdmap e30: 4 total, 4 up, 4 in 2024-03-16T20:50:26.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:25 smithi170 ceph-mon[35947]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:26.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:26.365+0000 7f2d50520700 1 -- 172.21.15.170:0/1618588183 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d4802da30 con 0x7f2d340a1ac0 2024-03-16T20:50:26.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:25 smithi186 ceph-mon[36391]: osdmap e30: 4 total, 4 up, 4 in 2024-03-16T20:50:26.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:25 smithi186 ceph-mon[36391]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:27.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:26 smithi008 ceph-mon[31434]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:50:27.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:50:27.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:50:27.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:26 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:27.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:26 smithi170 ceph-mon[35947]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:50:27.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:50:27.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:50:27.283 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:26 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:27.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:26 smithi186 ceph-mon[36391]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:50:27.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:50:27.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:50:27.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:26 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:28.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:28 smithi170 ceph-mon[35947]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-16T20:50:28.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:28 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi008 2024-03-16T20:50:28.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:28.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:28.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:28.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:28.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:28 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi008 to 8547M 2024-03-16T20:50:28.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:28.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:28.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:28.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:28.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:28 smithi186 ceph-mon[36391]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-16T20:50:28.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:28 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi008 2024-03-16T20:50:28.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:28.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:28.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:28.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:28.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:28 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi008 to 8547M 2024-03-16T20:50:28.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:28.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:28.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:28.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:28.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:28 smithi008 ceph-mon[31434]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-16T20:50:28.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:28 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi008 2024-03-16T20:50:28.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:28.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:28.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:28.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:28.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:28 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi008 to 8547M 2024-03-16T20:50:28.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:28.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:28.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:28.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:29.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:29 smithi170 ceph-mon[35947]: from='client.? 172.21.15.170:0/2004765950' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a59cbe06-70e2-4289-99c5-6ac77a7e5998"}]: dispatch 2024-03-16T20:50:29.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:29 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a59cbe06-70e2-4289-99c5-6ac77a7e5998"}]: dispatch 2024-03-16T20:50:29.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:29 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a59cbe06-70e2-4289-99c5-6ac77a7e5998"}]': finished 2024-03-16T20:50:29.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:29 smithi170 ceph-mon[35947]: osdmap e31: 5 total, 4 up, 5 in 2024-03-16T20:50:29.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:29 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:29.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:29 smithi186 ceph-mon[36391]: from='client.? 172.21.15.170:0/2004765950' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a59cbe06-70e2-4289-99c5-6ac77a7e5998"}]: dispatch 2024-03-16T20:50:29.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:29 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a59cbe06-70e2-4289-99c5-6ac77a7e5998"}]: dispatch 2024-03-16T20:50:29.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:29 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a59cbe06-70e2-4289-99c5-6ac77a7e5998"}]': finished 2024-03-16T20:50:29.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:29 smithi186 ceph-mon[36391]: osdmap e31: 5 total, 4 up, 5 in 2024-03-16T20:50:29.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:29 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:29.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:29 smithi008 ceph-mon[31434]: from='client.? 172.21.15.170:0/2004765950' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a59cbe06-70e2-4289-99c5-6ac77a7e5998"}]: dispatch 2024-03-16T20:50:29.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:29 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a59cbe06-70e2-4289-99c5-6ac77a7e5998"}]: dispatch 2024-03-16T20:50:29.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:29 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a59cbe06-70e2-4289-99c5-6ac77a7e5998"}]': finished 2024-03-16T20:50:29.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:29 smithi008 ceph-mon[31434]: osdmap e31: 5 total, 4 up, 5 in 2024-03-16T20:50:29.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:29 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:30.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:30 smithi170 ceph-mon[35947]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T20:50:30.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:30 smithi170 ceph-mon[35947]: from='client.? 172.21.15.170:0/2646328383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:50:30.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:30 smithi186 ceph-mon[36391]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T20:50:30.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:30 smithi186 ceph-mon[36391]: from='client.? 172.21.15.170:0/2646328383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:50:30.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:30 smithi008 ceph-mon[31434]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T20:50:30.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:30 smithi008 ceph-mon[31434]: from='client.? 172.21.15.170:0/2646328383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:50:32.639 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:32 smithi170 ceph-mon[35947]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-03-16T20:50:32.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:32 smithi186 ceph-mon[36391]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-03-16T20:50:32.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:32 smithi008 ceph-mon[31434]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-03-16T20:50:34.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:34 smithi170 ceph-mon[35947]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-03-16T20:50:34.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:34 smithi186 ceph-mon[36391]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-03-16T20:50:34.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:34 smithi008 ceph-mon[31434]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-03-16T20:50:36.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:36 smithi186 ceph-mon[36391]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T20:50:36.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-16T20:50:36.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:36.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:36 smithi008 ceph-mon[31434]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T20:50:36.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-16T20:50:36.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:36.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:36 smithi170 ceph-mon[35947]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T20:50:36.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-16T20:50:36.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:37.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:37 smithi186 ceph-mon[36391]: Deploying daemon osd.4 on smithi170 2024-03-16T20:50:37.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:37 smithi008 ceph-mon[31434]: Deploying daemon osd.4 on smithi170 2024-03-16T20:50:37.772 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:37 smithi170 ceph-mon[35947]: Deploying daemon osd.4 on smithi170 2024-03-16T20:50:38.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:38 smithi186 ceph-mon[36391]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:38.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:38 smithi008 ceph-mon[31434]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:38.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:38 smithi170 ceph-mon[35947]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:40.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:40 smithi008 ceph-mon[31434]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:40.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:40 smithi170 ceph-mon[35947]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:40.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:40 smithi186 ceph-mon[36391]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:43.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:42 smithi170 ceph-mon[35947]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:43.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:42 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:43.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:42 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:43.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:42 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:43.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:42 smithi186 ceph-mon[36391]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:43.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:42 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:43.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:42 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:43.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:42 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:43.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:42 smithi008 ceph-mon[31434]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:43.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:42 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:43.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:42 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:43.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:42 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:44.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.993+0000 7f2d3f7fe700 1 -- 172.21.15.170:0/1618588183 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2d4802da30 con 0x7f2d340a1ac0 2024-03-16T20:50:44.998 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 4 on host 'smithi170' 2024-03-16T20:50:45.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 -- 172.21.15.170:0/1618588183 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2d340a1ac0 msgr2=0x7f2d340a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:50:45.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2d340a1ac0 0x7f2d340a3f80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2d44005950 tx=0x7f2d44005cf0 comp rx=0 tx=0).stop 2024-03-16T20:50:45.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 -- 172.21.15.170:0/1618588183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d481053d0 msgr2=0x7f2d48198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:50:45.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d481053d0 0x7f2d48198720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800b530 tx=0x7f2d3800b840 comp rx=0 tx=0).stop 2024-03-16T20:50:45.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 -- 172.21.15.170:0/1618588183 shutdown_connections 2024-03-16T20:50:45.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2d340a1ac0 0x7f2d340a3f80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:45.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d48102aa0 0x7f2d481981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:45.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d48107d00 0x7f2d4819f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:45.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 --2- 172.21.15.170:0/1618588183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d481053d0 0x7f2d48198720 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:45.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 -- 172.21.15.170:0/1618588183 >> 172.21.15.170:0/1618588183 conn(0x7f2d480fc4d0 msgr2=0x7f2d481033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:50:45.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 -- 172.21.15.170:0/1618588183 shutdown_connections 2024-03-16T20:50:45.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:50:44.996+0000 7f2d50520700 1 -- 172.21.15.170:0/1618588183 wait complete. 2024-03-16T20:50:45.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:44 smithi170 ceph-mon[35947]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:45.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:44 smithi186 ceph-mon[36391]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:45.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:44 smithi008 ceph-mon[31434]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:45.765 DEBUG:teuthology.orchestra.run.smithi170:osd.4> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.4.service 2024-03-16T20:50:45.768 INFO:tasks.cephadm:Deploying osd.5 on smithi186 with /dev/vg_nvme/lv_3... 2024-03-16T20:50:45.768 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-16T20:50:46.019 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:50:46.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:45 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:46.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:45 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:46.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:45 smithi170 ceph-mon[35947]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:46.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:45 smithi170 ceph-mon[35947]: from='osd.4 [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T20:50:46.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:45 smithi170 ceph-mon[35947]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T20:50:46.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:45 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:46.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:45 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:46.129 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:45 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:46.129 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:45 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:46.129 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:45 smithi186 ceph-mon[36391]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:46.129 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:45 smithi186 ceph-mon[36391]: from='osd.4 [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T20:50:46.129 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:45 smithi186 ceph-mon[36391]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T20:50:46.129 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:45 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:46.129 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:45 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:46.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:45 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:46.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:45 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:46.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:45 smithi008 ceph-mon[31434]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:46.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:45 smithi008 ceph-mon[31434]: from='osd.4 [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T20:50:46.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:45 smithi008 ceph-mon[31434]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T20:50:46.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:45 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:46.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:45 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:47.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:46 smithi170 ceph-mon[35947]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-16T20:50:47.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:46 smithi170 ceph-mon[35947]: from='osd.4 [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:50:47.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:46 smithi170 ceph-mon[35947]: osdmap e32: 5 total, 4 up, 5 in 2024-03-16T20:50:47.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:47.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:46 smithi170 ceph-mon[35947]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:50:47.117 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 20:50:46 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4[47132]: 2024-03-16T20:50:46.962+0000 7f1265fec700 -1 osd.4 0 waiting for initial osdmap 2024-03-16T20:50:47.117 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 20:50:46 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4[47132]: 2024-03-16T20:50:46.967+0000 7f1261ddf700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T20:50:47.126 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:46 smithi186 ceph-mon[36391]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-16T20:50:47.126 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:46 smithi186 ceph-mon[36391]: from='osd.4 [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:50:47.126 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:46 smithi186 ceph-mon[36391]: osdmap e32: 5 total, 4 up, 5 in 2024-03-16T20:50:47.126 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:47.126 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:46 smithi186 ceph-mon[36391]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:50:47.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:46 smithi008 ceph-mon[31434]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-16T20:50:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:46 smithi008 ceph-mon[31434]: from='osd.4 [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:50:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:46 smithi008 ceph-mon[31434]: osdmap e32: 5 total, 4 up, 5 in 2024-03-16T20:50:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:46 smithi008 ceph-mon[31434]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:50:47.994 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-16T20:50:47.994 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-16T20:50:47.994 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-03-16T20:50:47.994 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-03-16T20:50:47.995 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0117843 s, 890 MB/s 2024-03-16T20:50:47.995 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-03-16T20:50:48.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:47 smithi170 ceph-mon[35947]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:50:48.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:47 smithi170 ceph-mon[35947]: osdmap e33: 5 total, 4 up, 5 in 2024-03-16T20:50:48.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:47 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:48.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:47 smithi170 ceph-mon[35947]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:48.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:47 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:48.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:47 smithi008 ceph-mon[31434]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:50:48.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:47 smithi008 ceph-mon[31434]: osdmap e33: 5 total, 4 up, 5 in 2024-03-16T20:50:48.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:47 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:48.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:47 smithi008 ceph-mon[31434]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:48.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:47 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:48.316 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:47 smithi186 ceph-mon[36391]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:50:48.316 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:47 smithi186 ceph-mon[36391]: osdmap e33: 5 total, 4 up, 5 in 2024-03-16T20:50:48.316 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:47 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:48.316 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:47 smithi186 ceph-mon[36391]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-03-16T20:50:48.316 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:47 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:48.635 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_3 2024-03-16T20:50:48.869 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:50:49.154 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:48 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:50:49.155 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:48 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:50:49.155 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:48 smithi170 ceph-mon[35947]: osd.4 [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677] boot 2024-03-16T20:50:49.155 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:48 smithi170 ceph-mon[35947]: osdmap e34: 5 total, 5 up, 5 in 2024-03-16T20:50:49.155 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:48 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:49.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:48 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:50:49.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:48 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:50:49.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:48 smithi008 ceph-mon[31434]: osd.4 [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677] boot 2024-03-16T20:50:49.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:48 smithi008 ceph-mon[31434]: osdmap e34: 5 total, 5 up, 5 in 2024-03-16T20:50:49.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:48 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:49.294 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:48 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:50:49.294 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:48 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:50:49.294 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:48 smithi186 ceph-mon[36391]: osd.4 [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677] boot 2024-03-16T20:50:49.295 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:48 smithi186 ceph-mon[36391]: osdmap e34: 5 total, 5 up, 5 in 2024-03-16T20:50:49.295 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:48 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: osdmap e35: 5 total, 5 up, 5 in 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi170 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi170 to 8540M 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:50.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.219 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:50.219 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:50.219 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:50.219 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:49 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: osdmap e35: 5 total, 5 up, 5 in 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi170 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi170 to 8540M 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:50.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:49 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.445 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.441+0000 7f1570c7b700 1 -- 172.21.15.186:0/2609824882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c103be0 msgr2=0x7f156c10a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:50:50.446 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.441+0000 7f1570c7b700 1 --2- 172.21.15.186:0/2609824882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c103be0 0x7f156c10a490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f156400b0a0 tx=0x7f156400b3b0 comp rx=0 tx=0).stop 2024-03-16T20:50:50.446 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.441+0000 7f1570c7b700 1 -- 172.21.15.186:0/2609824882 shutdown_connections 2024-03-16T20:50:50.446 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.441+0000 7f1570c7b700 1 --2- 172.21.15.186:0/2609824882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c102040 0x7f156c102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:50.446 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.441+0000 7f1570c7b700 1 --2- 172.21.15.186:0/2609824882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c103be0 0x7f156c10a490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:50.446 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.441+0000 7f1570c7b700 1 --2- 172.21.15.186:0/2609824882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f156c103240 0x7f156c1036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:50.446 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.441+0000 7f1570c7b700 1 -- 172.21.15.186:0/2609824882 >> 172.21.15.186:0/2609824882 conn(0x7f156c0fd5e0 msgr2=0x7f156c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:50:50.446 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.441+0000 7f1570c7b700 1 -- 172.21.15.186:0/2609824882 shutdown_connections 2024-03-16T20:50:50.446 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.441+0000 7f1570c7b700 1 -- 172.21.15.186:0/2609824882 wait complete. 2024-03-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.442+0000 7f1570c7b700 1 Processor -- start 2024-03-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.442+0000 7f1570c7b700 1 -- start start 2024-03-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f1570c7b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c102040 0x7f156c198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f1570c7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c103240 0x7f156c1986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f1570c7b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f156c103be0 0x7f156c19f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f1570c7b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c19fd10 con 0x7f156c103240 2024-03-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f1570c7b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c19fe50 con 0x7f156c103be0 2024-03-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f1570c7b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c19ffe0 con 0x7f156c102040 2024-03-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f156a59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c102040 0x7f156c198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f156a59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c102040 0x7f156c198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:39310/0 (socket says 172.21.15.186:39310) 2024-03-16T20:50:50.448 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f156a59c700 1 -- 172.21.15.186:0/1126496975 learned_addr learned my addr 172.21.15.186:0/1126496975 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f156ad9d700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f156c103be0 0x7f156c19f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f156a59c700 1 -- 172.21.15.186:0/1126496975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f156c103be0 msgr2=0x7f156c19f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f156a59c700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f156c103be0 0x7f156c19f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f156a59c700 1 -- 172.21.15.186:0/1126496975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c103240 msgr2=0x7f156c1986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f156a59c700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c103240 0x7f156c1986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f156a59c700 1 -- 172.21.15.186:0/1126496975 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564009d00 con 0x7f156c102040 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f156a59c700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c102040 0x7f156c198180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f155c00b530 tx=0x7f155c00b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f155b7fe700 1 -- 172.21.15.186:0/1126496975 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c011830 con 0x7f156c102040 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f1570c7b700 1 -- 172.21.15.186:0/1126496975 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c1a02c0 con 0x7f156c102040 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f155b7fe700 1 -- 172.21.15.186:0/1126496975 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f155c011e90 con 0x7f156c102040 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f155b7fe700 1 -- 172.21.15.186:0/1126496975 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c00f2e0 con 0x7f156c102040 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.443+0000 7f1570c7b700 1 -- 172.21.15.186:0/1126496975 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c1a0840 con 0x7f156c102040 2024-03-16T20:50:50.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.444+0000 7f1570c7b700 1 -- 172.21.15.186:0/1126496975 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c109330 con 0x7f156c102040 2024-03-16T20:50:50.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.445+0000 7f155b7fe700 1 -- 172.21.15.186:0/1126496975 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f155c0106a0 con 0x7f156c102040 2024-03-16T20:50:50.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.446+0000 7f155b7fe700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f15540a1ac0 0x7f15540a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:50:50.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.446+0000 7f155b7fe700 1 -- 172.21.15.186:0/1126496975 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f155c0cbef0 con 0x7f156c102040 2024-03-16T20:50:50.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.446+0000 7f1569d9b700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f15540a1ac0 0x7f15540a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:50:50.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.447+0000 7f1569d9b700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f15540a1ac0 0x7f15540a3f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1560005950 tx=0x7f15600058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:50:50.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.450+0000 7f155b7fe700 1 -- 172.21.15.186:0/1126496975 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f155c096170 con 0x7f156c102040 2024-03-16T20:50:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:49 smithi008 ceph-mon[31434]: osdmap e35: 5 total, 5 up, 5 in 2024-03-16T20:50:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:49 smithi008 ceph-mon[31434]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:49 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi170 2024-03-16T20:50:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:49 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:49 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:50:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:50 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi170 to 8540M 2024-03-16T20:50:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:50.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:50.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:50:50.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:50.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:50:50.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:50 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:50:50.656 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:50:50.653+0000 7f1570c7b700 1 -- 172.21.15.186:0/1126496975 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f156c02da90 con 0x7f15540a1ac0 2024-03-16T20:50:51.290 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:51 smithi186 ceph-mon[36391]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:50:51.290 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:51 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:50:51.290 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:51 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:50:51.290 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:51 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:51.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:51 smithi170 ceph-mon[35947]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:50:51.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:51 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:50:51.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:51 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:50:51.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:51 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:51.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:51 smithi008 ceph-mon[31434]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:50:51.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:50:51.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:50:51.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:50:52.258 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:52 smithi186 ceph-mon[36391]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:52.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:52 smithi170 ceph-mon[35947]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:52.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:52 smithi008 ceph-mon[31434]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:54.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:54 smithi170 ceph-mon[35947]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:54.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:54 smithi170 ceph-mon[35947]: from='client.? 172.21.15.186:0/3892347845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94656aa4-e7a0-41c4-b17d-b05fbd63e4e1"}]: dispatch 2024-03-16T20:50:54.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:54 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94656aa4-e7a0-41c4-b17d-b05fbd63e4e1"}]: dispatch 2024-03-16T20:50:54.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:54 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94656aa4-e7a0-41c4-b17d-b05fbd63e4e1"}]': finished 2024-03-16T20:50:54.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:54 smithi170 ceph-mon[35947]: osdmap e36: 6 total, 5 up, 6 in 2024-03-16T20:50:54.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:54 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:50:54.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:54 smithi186 ceph-mon[36391]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:54.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:54 smithi186 ceph-mon[36391]: from='client.? 172.21.15.186:0/3892347845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94656aa4-e7a0-41c4-b17d-b05fbd63e4e1"}]: dispatch 2024-03-16T20:50:54.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:54 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94656aa4-e7a0-41c4-b17d-b05fbd63e4e1"}]: dispatch 2024-03-16T20:50:54.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:54 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94656aa4-e7a0-41c4-b17d-b05fbd63e4e1"}]': finished 2024-03-16T20:50:54.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:54 smithi186 ceph-mon[36391]: osdmap e36: 6 total, 5 up, 6 in 2024-03-16T20:50:54.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:54 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:50:54.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:54 smithi008 ceph-mon[31434]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:54.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:54 smithi008 ceph-mon[31434]: from='client.? 172.21.15.186:0/3892347845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94656aa4-e7a0-41c4-b17d-b05fbd63e4e1"}]: dispatch 2024-03-16T20:50:54.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:54 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94656aa4-e7a0-41c4-b17d-b05fbd63e4e1"}]: dispatch 2024-03-16T20:50:54.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:54 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94656aa4-e7a0-41c4-b17d-b05fbd63e4e1"}]': finished 2024-03-16T20:50:54.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:54 smithi008 ceph-mon[31434]: osdmap e36: 6 total, 5 up, 6 in 2024-03-16T20:50:54.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:54 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:50:55.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:55 smithi170 ceph-mon[35947]: from='client.? 172.21.15.186:0/3740755817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:50:55.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:55 smithi186 ceph-mon[36391]: from='client.? 172.21.15.186:0/3740755817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:50:55.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:55 smithi008 ceph-mon[31434]: from='client.? 172.21.15.186:0/3740755817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:50:56.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:56 smithi170 ceph-mon[35947]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:56.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:56 smithi186 ceph-mon[36391]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:56.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:56 smithi008 ceph-mon[31434]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:58.296 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:50:58 smithi008 ceph-mon[31434]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:58.325 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:50:58 smithi186 ceph-mon[36391]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:50:58.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:50:58 smithi170 ceph-mon[35947]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:00.369 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:00 smithi170 ceph-mon[35947]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:00 smithi186 ceph-mon[36391]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:00.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:00 smithi008 ceph-mon[31434]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:01.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:01 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-16T20:51:01.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:01 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:01.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:01 smithi170 ceph-mon[35947]: Deploying daemon osd.5 on smithi186 2024-03-16T20:51:01.378 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:01 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-16T20:51:01.378 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:01 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:01.378 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:01 smithi186 ceph-mon[36391]: Deploying daemon osd.5 on smithi186 2024-03-16T20:51:01.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:01 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-16T20:51:01.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:01 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:01.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:01 smithi008 ceph-mon[31434]: Deploying daemon osd.5 on smithi186 2024-03-16T20:51:02.338 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:02 smithi186 ceph-mon[36391]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:02.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:02 smithi170 ceph-mon[35947]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:02.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:02 smithi008 ceph-mon[31434]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:04.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:04 smithi170 ceph-mon[35947]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:04.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:04 smithi186 ceph-mon[36391]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:04.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:04 smithi008 ceph-mon[31434]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:06.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:06 smithi186 ceph-mon[36391]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:06.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:06 smithi170 ceph-mon[35947]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:06.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:06 smithi008 ceph-mon[31434]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:07.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:07.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:07.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:07.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:07.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:07.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:07.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:07.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:08.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:08 smithi008 ceph-mon[31434]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:08.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:08 smithi170 ceph-mon[35947]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:08.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:08 smithi186 ceph-mon[36391]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:10.292 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.287+0000 7f155b7fe700 1 -- 172.21.15.186:0/1126496975 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f156c02da90 con 0x7f15540a1ac0 2024-03-16T20:51:10.292 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 5 on host 'smithi186' 2024-03-16T20:51:10.294 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 -- 172.21.15.186:0/1126496975 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f15540a1ac0 msgr2=0x7f15540a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:51:10.294 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f15540a1ac0 0x7f15540a3f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1560005950 tx=0x7f15600058e0 comp rx=0 tx=0).stop 2024-03-16T20:51:10.294 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 -- 172.21.15.186:0/1126496975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c102040 msgr2=0x7f156c198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:51:10.294 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c102040 0x7f156c198180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f155c00b530 tx=0x7f155c00b8f0 comp rx=0 tx=0).stop 2024-03-16T20:51:10.295 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 -- 172.21.15.186:0/1126496975 shutdown_connections 2024-03-16T20:51:10.295 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f15540a1ac0 0x7f15540a3f80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:10.295 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f156c103be0 0x7f156c19f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:10.295 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f156c102040 0x7f156c198180 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:10.295 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 --2- 172.21.15.186:0/1126496975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f156c103240 0x7f156c1986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:10.295 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 -- 172.21.15.186:0/1126496975 >> 172.21.15.186:0/1126496975 conn(0x7f156c0fd5e0 msgr2=0x7f156c106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:51:10.295 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 -- 172.21.15.186:0/1126496975 shutdown_connections 2024-03-16T20:51:10.295 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:51:10.290+0000 7f1570c7b700 1 -- 172.21.15.186:0/1126496975 wait complete. 2024-03-16T20:51:10.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:10 smithi186 ceph-mon[36391]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:10 smithi186 ceph-mon[36391]: from='osd.5 [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T20:51:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:10 smithi186 ceph-mon[36391]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T20:51:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:10 smithi008 ceph-mon[31434]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:10 smithi008 ceph-mon[31434]: from='osd.5 [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T20:51:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:10 smithi008 ceph-mon[31434]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T20:51:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:10 smithi170 ceph-mon[35947]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:10 smithi170 ceph-mon[35947]: from='osd.5 [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T20:51:10.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:10 smithi170 ceph-mon[35947]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T20:51:10.949 DEBUG:teuthology.orchestra.run.smithi186:osd.5> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.5.service 2024-03-16T20:51:10.951 INFO:tasks.cephadm:Deploying osd.6 on smithi008 with /dev/vg_nvme/lv_2... 2024-03-16T20:51:10.951 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-16T20:51:11.429 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:51:12.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:12 smithi186 ceph-mon[36391]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:12.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:12 smithi186 ceph-mon[36391]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-16T20:51:12.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:12 smithi186 ceph-mon[36391]: from='osd.5 [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:51:12.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:12 smithi186 ceph-mon[36391]: osdmap e37: 6 total, 5 up, 6 in 2024-03-16T20:51:12.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:51:12.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:12 smithi186 ceph-mon[36391]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:51:12.393 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 20:51:12 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T20:51:12.259+0000 7ff9e2d22700 -1 osd.5 0 waiting for initial osdmap 2024-03-16T20:51:12.393 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 20:51:12 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T20:51:12.268+0000 7ff9deb15700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T20:51:12.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:12 smithi170 ceph-mon[35947]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:12 smithi170 ceph-mon[35947]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-16T20:51:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:12 smithi170 ceph-mon[35947]: from='osd.5 [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:51:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:12 smithi170 ceph-mon[35947]: osdmap e37: 6 total, 5 up, 6 in 2024-03-16T20:51:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:12 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:51:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:12 smithi170 ceph-mon[35947]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:51:12.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:12 smithi008 ceph-mon[31434]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:12.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:12 smithi008 ceph-mon[31434]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-16T20:51:12.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:12 smithi008 ceph-mon[31434]: from='osd.5 [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:51:12.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:12 smithi008 ceph-mon[31434]: osdmap e37: 6 total, 5 up, 6 in 2024-03-16T20:51:12.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:51:12.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:12 smithi008 ceph-mon[31434]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:51:13.598 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:13 smithi008 ceph-mon[31434]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:51:13.598 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:13 smithi008 ceph-mon[31434]: osdmap e38: 6 total, 5 up, 6 in 2024-03-16T20:51:13.599 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:13 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:51:13.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:13 smithi170 ceph-mon[35947]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:51:13.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:13 smithi170 ceph-mon[35947]: osdmap e38: 6 total, 5 up, 6 in 2024-03-16T20:51:13.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:13 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:51:13.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:13 smithi186 ceph-mon[36391]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:51:13.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:13 smithi186 ceph-mon[36391]: osdmap e38: 6 total, 5 up, 6 in 2024-03-16T20:51:13.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:13 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:51:14.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: osd.5 [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577] boot 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: osdmap e39: 6 total, 6 up, 6 in 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:14.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:14 smithi008 ceph-mon[31434]: osdmap e40: 6 total, 6 up, 6 in 2024-03-16T20:51:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-16T20:51:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-16T20:51:14.512 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2024-03-16T20:51:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2024-03-16T20:51:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.037967 s, 276 MB/s 2024-03-16T20:51:14.512 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 2024-03-16T20:51:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: osd.5 [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577] boot 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: osdmap e39: 6 total, 6 up, 6 in 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:14.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:14 smithi170 ceph-mon[35947]: osdmap e40: 6 total, 6 up, 6 in 2024-03-16T20:51:14.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:51:14.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: osd.5 [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577] boot 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: osdmap e39: 6 total, 6 up, 6 in 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:14 smithi186 ceph-mon[36391]: osdmap e40: 6 total, 6 up, 6 in 2024-03-16T20:51:15.362 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi008:vg_nvme/lv_2 2024-03-16T20:51:15.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:15 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi186 2024-03-16T20:51:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:15 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi186 to 8540M 2024-03-16T20:51:15.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:15 smithi170 ceph-mon[35947]: osdmap e41: 6 total, 6 up, 6 in 2024-03-16T20:51:15.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:15 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi186 2024-03-16T20:51:15.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:15 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi186 to 8540M 2024-03-16T20:51:15.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:15 smithi186 ceph-mon[36391]: osdmap e41: 6 total, 6 up, 6 in 2024-03-16T20:51:15.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:15 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi186 2024-03-16T20:51:15.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:15 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi186 to 8540M 2024-03-16T20:51:15.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:15 smithi008 ceph-mon[31434]: osdmap e41: 6 total, 6 up, 6 in 2024-03-16T20:51:15.789 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:51:16.431 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:16 smithi008 ceph-mon[31434]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:16.431 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:16 smithi008 ceph-mon[31434]: osdmap e42: 6 total, 6 up, 6 in 2024-03-16T20:51:16.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:16 smithi170 ceph-mon[35947]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:16.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:16 smithi170 ceph-mon[35947]: osdmap e42: 6 total, 6 up, 6 in 2024-03-16T20:51:16.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:16 smithi186 ceph-mon[36391]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:16.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:16 smithi186 ceph-mon[36391]: osdmap e42: 6 total, 6 up, 6 in 2024-03-16T20:51:18.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.121+0000 7feaf6800700 1 -- 172.21.15.8:0/1809691456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf0105e00 msgr2=0x7feaf010c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:51:18.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.121+0000 7feaf6800700 1 --2- 172.21.15.8:0/1809691456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf0105e00 0x7feaf010c6b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7feae8009f90 tx=0x7feae800b330 comp rx=0 tx=0).stop 2024-03-16T20:51:18.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.121+0000 7feaf6800700 1 -- 172.21.15.8:0/1809691456 shutdown_connections 2024-03-16T20:51:18.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.121+0000 7feaf6800700 1 --2- 172.21.15.8:0/1809691456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaf0104260 0x7feaf0104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:18.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.121+0000 7feaf6800700 1 --2- 172.21.15.8:0/1809691456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf0105e00 0x7feaf010c6b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:18.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.121+0000 7feaf6800700 1 --2- 172.21.15.8:0/1809691456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaf0105460 0x7feaf01058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:18.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.121+0000 7feaf6800700 1 -- 172.21.15.8:0/1809691456 >> 172.21.15.8:0/1809691456 conn(0x7feaf00ff800 msgr2=0x7feaf0101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:51:18.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.122+0000 7feaf6800700 1 -- 172.21.15.8:0/1809691456 shutdown_connections 2024-03-16T20:51:18.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.122+0000 7feaf6800700 1 -- 172.21.15.8:0/1809691456 wait complete. 2024-03-16T20:51:18.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.123+0000 7feaf6800700 1 Processor -- start 2024-03-16T20:51:18.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.123+0000 7feaf6800700 1 -- start start 2024-03-16T20:51:18.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.123+0000 7feaf6800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf0104260 0x7feaf019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:51:18.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.123+0000 7feaf6800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaf0105460 0x7feaf019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:51:18.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaf6800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaf0105e00 0x7feaf01a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:51:18.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaf6800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf01a1f50 con 0x7feaf0105e00 2024-03-16T20:51:18.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaf6800700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf01a2090 con 0x7feaf0105460 2024-03-16T20:51:18.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaf6800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf01a2220 con 0x7feaf0104260 2024-03-16T20:51:18.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaefe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaf0105e00 0x7feaf01a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaef400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf0104260 0x7feaf019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaefe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaf0105e00 0x7feaf01a1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33348/0 (socket says 172.21.15.8:33348) 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaefe00700 1 -- 172.21.15.8:0/2996258400 learned_addr learned my addr 172.21.15.8:0/2996258400 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feae7e00700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaf0105460 0x7feaf019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaefe00700 1 -- 172.21.15.8:0/2996258400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf0104260 msgr2=0x7feaf019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaefe00700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf0104260 0x7feaf019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaefe00700 1 -- 172.21.15.8:0/2996258400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaf0105460 msgr2=0x7feaf019a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaefe00700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaf0105460 0x7feaf019a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feaefe00700 1 -- 172.21.15.8:0/2996258400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8009c40 con 0x7feaf0105e00 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.124+0000 7feae7e00700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaf0105460 0x7feaf019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.125+0000 7feaefe00700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaf0105e00 0x7feaf01a1980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feae8007bd0 tx=0x7feae8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.125+0000 7feaecc00700 1 -- 172.21.15.8:0/2996258400 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800e040 con 0x7feaf0105e00 2024-03-16T20:51:18.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.125+0000 7feaf6800700 1 -- 172.21.15.8:0/2996258400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf01a24a0 con 0x7feaf0105e00 2024-03-16T20:51:18.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.125+0000 7feaf6800700 1 -- 172.21.15.8:0/2996258400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf01a2960 con 0x7feaf0105e00 2024-03-16T20:51:18.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.125+0000 7feaecc00700 1 -- 172.21.15.8:0/2996258400 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7feae8007870 con 0x7feaf0105e00 2024-03-16T20:51:18.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.125+0000 7feaecc00700 1 -- 172.21.15.8:0/2996258400 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80052a0 con 0x7feaf0105e00 2024-03-16T20:51:18.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.126+0000 7feaf6800700 1 -- 172.21.15.8:0/2996258400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feacc005360 con 0x7feaf0105e00 2024-03-16T20:51:18.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.129+0000 7feaecc00700 1 -- 172.21.15.8:0/2996258400 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7feae8005400 con 0x7feaf0105e00 2024-03-16T20:51:18.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.130+0000 7feaecc00700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fead40a1ac0 0x7fead40a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:51:18.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.130+0000 7feaecc00700 1 -- 172.21.15.8:0/2996258400 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4533+0+0 (secure 0 0 0) 0x7feae80cdc20 con 0x7feaf0105e00 2024-03-16T20:51:18.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.130+0000 7feaef400700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fead40a1ac0 0x7fead40a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:51:18.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.131+0000 7feaef400700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fead40a1ac0 0x7fead40a3f80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feaf01052c0 tx=0x7feae0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:51:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.133+0000 7feaecc00700 1 -- 172.21.15.8:0/2996258400 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7feae8097ce0 con 0x7feaf0105e00 2024-03-16T20:51:18.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:18.369+0000 7feaf6800700 1 -- 172.21.15.8:0/2996258400 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7feacc000bf0 con 0x7fead40a1ac0 2024-03-16T20:51:18.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:18 smithi008 ceph-mon[31434]: pgmap v159: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-16T20:51:18.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:18 smithi008 ceph-mon[31434]: osdmap e43: 6 total, 6 up, 6 in 2024-03-16T20:51:18.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:18 smithi170 ceph-mon[35947]: pgmap v159: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-16T20:51:18.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:18 smithi170 ceph-mon[35947]: osdmap e43: 6 total, 6 up, 6 in 2024-03-16T20:51:18.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:18 smithi186 ceph-mon[36391]: pgmap v159: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-16T20:51:18.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:18 smithi186 ceph-mon[36391]: osdmap e43: 6 total, 6 up, 6 in 2024-03-16T20:51:19.538 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:19 smithi008 ceph-mon[31434]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:51:19.539 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:51:19.539 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:51:19.539 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:19.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:19 smithi170 ceph-mon[35947]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:51:19.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:51:19.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:51:19.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:19.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:19 smithi186 ceph-mon[36391]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:51:19.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:51:19.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:51:19.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:20.376 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:20 smithi008 ceph-mon[31434]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-03-16T20:51:20.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:20 smithi170 ceph-mon[35947]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-03-16T20:51:20.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:20 smithi186 ceph-mon[36391]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-03-16T20:51:22.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:22 smithi170 ceph-mon[35947]: pgmap v162: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T20:51:22.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:22 smithi186 ceph-mon[36391]: pgmap v162: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T20:51:22.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:22 smithi008 ceph-mon[31434]: pgmap v162: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T20:51:23.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:23 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/4048336796' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da2851d1-b95b-4035-9555-f159a9fcc4e4"}]: dispatch 2024-03-16T20:51:23.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:23 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/4048336796' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da2851d1-b95b-4035-9555-f159a9fcc4e4"}]': finished 2024-03-16T20:51:23.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:23 smithi008 ceph-mon[31434]: osdmap e44: 7 total, 6 up, 7 in 2024-03-16T20:51:23.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:23 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:23.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:23 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/4048336796' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da2851d1-b95b-4035-9555-f159a9fcc4e4"}]: dispatch 2024-03-16T20:51:23.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:23 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/4048336796' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da2851d1-b95b-4035-9555-f159a9fcc4e4"}]': finished 2024-03-16T20:51:23.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:23 smithi170 ceph-mon[35947]: osdmap e44: 7 total, 6 up, 7 in 2024-03-16T20:51:23.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:23 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:23.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:23 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/4048336796' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da2851d1-b95b-4035-9555-f159a9fcc4e4"}]: dispatch 2024-03-16T20:51:23.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:23 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/4048336796' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da2851d1-b95b-4035-9555-f159a9fcc4e4"}]': finished 2024-03-16T20:51:23.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:23 smithi186 ceph-mon[36391]: osdmap e44: 7 total, 6 up, 7 in 2024-03-16T20:51:23.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:23 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:24.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:24 smithi170 ceph-mon[35947]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-03-16T20:51:24.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:24 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3789842268' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:51:24.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:24 smithi186 ceph-mon[36391]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-03-16T20:51:24.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:24 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3789842268' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:51:24.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:24 smithi008 ceph-mon[31434]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-03-16T20:51:24.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:24 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3789842268' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:51:26.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:26 smithi170 ceph-mon[35947]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:26.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:26 smithi186 ceph-mon[36391]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:26.675 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:26 smithi008 ceph-mon[31434]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:28.579 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:28 smithi008 ceph-mon[31434]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:28.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:28 smithi170 ceph-mon[35947]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:28.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:28 smithi186 ceph-mon[36391]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:30.446 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:30 smithi008 ceph-mon[31434]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:30.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:30 smithi170 ceph-mon[35947]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:30.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:30 smithi186 ceph-mon[36391]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:32.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:32 smithi170 ceph-mon[35947]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:32.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:32 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-16T20:51:32.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:32 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:32.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:32 smithi186 ceph-mon[36391]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:32.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:32 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-16T20:51:32.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:32 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:32.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:32 smithi008 ceph-mon[31434]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:32.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:32 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-16T20:51:32.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:32 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:33.437 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:33 smithi008 ceph-mon[31434]: Deploying daemon osd.6 on smithi008 2024-03-16T20:51:33.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:33 smithi170 ceph-mon[35947]: Deploying daemon osd.6 on smithi008 2024-03-16T20:51:33.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:33 smithi186 ceph-mon[36391]: Deploying daemon osd.6 on smithi008 2024-03-16T20:51:34.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:34 smithi170 ceph-mon[35947]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:34.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:34 smithi186 ceph-mon[36391]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:34.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:34 smithi008 ceph-mon[31434]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:36.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:36 smithi170 ceph-mon[35947]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:36.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:36 smithi186 ceph-mon[36391]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:36.732 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:36 smithi008 ceph-mon[31434]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:38.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:38 smithi170 ceph-mon[35947]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:38.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:38 smithi186 ceph-mon[36391]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:38.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:38 smithi008 ceph-mon[31434]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:40.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:40 smithi170 ceph-mon[35947]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:40.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:40 smithi186 ceph-mon[36391]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:40.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:40 smithi008 ceph-mon[31434]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:41.834 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:41.834 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:41.834 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:41.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:41.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:41.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:41.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:41.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:41.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:42.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:42 smithi170 ceph-mon[35947]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:42.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:42 smithi186 ceph-mon[36391]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:42.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:42 smithi008 ceph-mon[31434]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:44.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:44 smithi170 ceph-mon[35947]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:44.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:44.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:44.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:44 smithi170 ceph-mon[35947]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-16T20:51:44.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:44 smithi186 ceph-mon[36391]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:44.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:44.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:44.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:44 smithi186 ceph-mon[36391]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-16T20:51:44.905 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:44 smithi008 ceph-mon[31434]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:44.905 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:44.905 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:44.905 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:44 smithi008 ceph-mon[31434]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-16T20:51:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.887+0000 7feaecc00700 1 -- 172.21.15.8:0/2996258400 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7feacc000bf0 con 0x7fead40a1ac0 2024-03-16T20:51:45.892 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 6 on host 'smithi008' 2024-03-16T20:51:45.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.890+0000 7feaf6800700 1 -- 172.21.15.8:0/2996258400 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fead40a1ac0 msgr2=0x7fead40a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:51:45.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.890+0000 7feaf6800700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fead40a1ac0 0x7fead40a3f80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feaf01052c0 tx=0x7feae0009260 comp rx=0 tx=0).stop 2024-03-16T20:51:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.891+0000 7feaf6800700 1 -- 172.21.15.8:0/2996258400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaf0105e00 msgr2=0x7feaf01a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:51:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.891+0000 7feaf6800700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaf0105e00 0x7feaf01a1980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feae8007bd0 tx=0x7feae8004c80 comp rx=0 tx=0).stop 2024-03-16T20:51:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.891+0000 7feaf6800700 1 -- 172.21.15.8:0/2996258400 shutdown_connections 2024-03-16T20:51:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.891+0000 7feaf6800700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fead40a1ac0 0x7fead40a3f80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.891+0000 7feaf6800700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaf0105e00 0x7feaf01a1980 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.891+0000 7feaf6800700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf0104260 0x7feaf019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.891+0000 7feaf6800700 1 --2- 172.21.15.8:0/2996258400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaf0105460 0x7feaf019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.891+0000 7feaf6800700 1 -- 172.21.15.8:0/2996258400 >> 172.21.15.8:0/2996258400 conn(0x7feaf00ff800 msgr2=0x7feaf0108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:51:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.891+0000 7feaf6800700 1 -- 172.21.15.8:0/2996258400 shutdown_connections 2024-03-16T20:51:45.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:51:45.891+0000 7feaf6800700 1 -- 172.21.15.8:0/2996258400 wait complete. 2024-03-16T20:51:46.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:46 smithi170 ceph-mon[35947]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:46.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:46 smithi170 ceph-mon[35947]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-16T20:51:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:46 smithi170 ceph-mon[35947]: osdmap e45: 7 total, 6 up, 7 in 2024-03-16T20:51:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:46 smithi170 ceph-mon[35947]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:51:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:46.725 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:46 smithi008 ceph-mon[31434]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:46.725 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:46 smithi008 ceph-mon[31434]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-16T20:51:46.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:46 smithi008 ceph-mon[31434]: osdmap e45: 7 total, 6 up, 7 in 2024-03-16T20:51:46.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:46 smithi008 ceph-mon[31434]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:51:46.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:46.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:46.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:46.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:46.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:46.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:46.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:46.774 DEBUG:teuthology.orchestra.run.smithi008:osd.6> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.6.service 2024-03-16T20:51:46.778 INFO:tasks.cephadm:Deploying osd.7 on smithi170 with /dev/vg_nvme/lv_2... 2024-03-16T20:51:46.778 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-16T20:51:46.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:46 smithi186 ceph-mon[36391]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:46 smithi186 ceph-mon[36391]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-16T20:51:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:46 smithi186 ceph-mon[36391]: osdmap e45: 7 total, 6 up, 7 in 2024-03-16T20:51:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:46 smithi186 ceph-mon[36391]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:51:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:51:47.016 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T20:51:47.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:47 smithi008 ceph-mon[31434]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:51:47.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:47 smithi008 ceph-mon[31434]: osdmap e46: 7 total, 6 up, 7 in 2024-03-16T20:51:47.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:47 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:47.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:47 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:47.824 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:47 smithi170 ceph-mon[35947]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:51:47.824 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:47 smithi170 ceph-mon[35947]: osdmap e46: 7 total, 6 up, 7 in 2024-03-16T20:51:47.824 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:47 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:47.824 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:47 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:47.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:47 smithi186 ceph-mon[36391]: from='osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:51:47.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:47 smithi186 ceph-mon[36391]: osdmap e46: 7 total, 6 up, 7 in 2024-03-16T20:51:47.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:47 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:47.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:47 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:48 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:51:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:48 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:51:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:48 smithi008 ceph-mon[31434]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:48 smithi008 ceph-mon[31434]: osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181] boot 2024-03-16T20:51:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:48 smithi008 ceph-mon[31434]: osdmap e47: 7 total, 7 up, 7 in 2024-03-16T20:51:48.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:48 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:48.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:48 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:51:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:48 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:51:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:48 smithi170 ceph-mon[35947]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:48 smithi170 ceph-mon[35947]: osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181] boot 2024-03-16T20:51:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:48 smithi170 ceph-mon[35947]: osdmap e47: 7 total, 7 up, 7 in 2024-03-16T20:51:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:48 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:48 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:51:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:48 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:51:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:48 smithi186 ceph-mon[36391]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-16T20:51:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:48 smithi186 ceph-mon[36391]: osd.6 [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181] boot 2024-03-16T20:51:48.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:48 smithi186 ceph-mon[36391]: osdmap e47: 7 total, 7 up, 7 in 2024-03-16T20:51:48.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:48 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:51:48.939 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-16T20:51:48.939 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-16T20:51:48.939 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-03-16T20:51:48.939 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-03-16T20:51:48.939 INFO:teuthology.orchestra.run.smithi170.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00874161 s, 1.2 GB/s 2024-03-16T20:51:48.939 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 2024-03-16T20:51:48.939 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-03-16T20:51:49.599 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:49 smithi170 ceph-mon[35947]: osdmap e48: 7 total, 7 up, 7 in 2024-03-16T20:51:49.626 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi170:vg_nvme/lv_2 2024-03-16T20:51:49.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:49 smithi008 ceph-mon[31434]: osdmap e48: 7 total, 7 up, 7 in 2024-03-16T20:51:49.866 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T20:51:49.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:49 smithi186 ceph-mon[36391]: osdmap e48: 7 total, 7 up, 7 in 2024-03-16T20:51:50.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:50 smithi008 ceph-mon[31434]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:50.836 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:50 smithi170 ceph-mon[35947]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:50.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:50 smithi186 ceph-mon[36391]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:51.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.485+0000 7f93dd6a8700 1 -- 172.21.15.170:0/1997611543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93d8103230 msgr2=0x7f93d8103690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:51:51.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.485+0000 7f93dd6a8700 1 --2- 172.21.15.170:0/1997611543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93d8103230 0x7f93d8103690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f93c80099c0 tx=0x7f93c8009cd0 comp rx=0 tx=0).stop 2024-03-16T20:51:51.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.485+0000 7f93dd6a8700 1 -- 172.21.15.170:0/1997611543 shutdown_connections 2024-03-16T20:51:51.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.485+0000 7f93dd6a8700 1 --2- 172.21.15.170:0/1997611543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d8102030 0x7f93d8102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:51.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.485+0000 7f93dd6a8700 1 --2- 172.21.15.170:0/1997611543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93d8103bd0 0x7f93d810a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:51.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.485+0000 7f93dd6a8700 1 --2- 172.21.15.170:0/1997611543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93d8103230 0x7f93d8103690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.485+0000 7f93dd6a8700 1 -- 172.21.15.170:0/1997611543 >> 172.21.15.170:0/1997611543 conn(0x7f93d80fd5f0 msgr2=0x7f93d80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.485+0000 7f93dd6a8700 1 -- 172.21.15.170:0/1997611543 shutdown_connections 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.485+0000 7f93dd6a8700 1 -- 172.21.15.170:0/1997611543 wait complete. 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.486+0000 7f93dd6a8700 1 Processor -- start 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.486+0000 7f93dd6a8700 1 -- start start 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.486+0000 7f93dd6a8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93d8102030 0x7f93d8075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.486+0000 7f93dd6a8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d8103230 0x7f93d80743d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.486+0000 7f93dd6a8700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93d8103bd0 0x7f93d8074910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.486+0000 7f93dd6a8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8075090 con 0x7f93d8103230 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.486+0000 7f93dd6a8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8075200 con 0x7f93d8102030 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.486+0000 7f93dd6a8700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d81a21b0 con 0x7f93d8103bd0 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93d6ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93d8102030 0x7f93d8075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93d6ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93d8102030 0x7f93d8075d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53586/0 (socket says 172.21.15.170:53586) 2024-03-16T20:51:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93d6ffd700 1 -- 172.21.15.170:0/2796488653 learned_addr learned my addr 172.21.15.170:0/2796488653 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93d77fe700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93d8103bd0 0x7f93d8074910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93d6ffd700 1 -- 172.21.15.170:0/2796488653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93d8103bd0 msgr2=0x7f93d8074910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93d6ffd700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93d8103bd0 0x7f93d8074910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93d6ffd700 1 -- 172.21.15.170:0/2796488653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d8103230 msgr2=0x7f93d80743d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93d6ffd700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d8103230 0x7f93d80743d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93d6ffd700 1 -- 172.21.15.170:0/2796488653 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c80095f0 con 0x7f93d8102030 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93d6ffd700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93d8102030 0x7f93d8075d80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00b500 tx=0x7f93cc00b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93bffff700 1 -- 172.21.15.170:0/2796488653 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc011830 con 0x7f93d8102030 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93bffff700 1 -- 172.21.15.170:0/2796488653 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f93cc011e90 con 0x7f93d8102030 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93dd6a8700 1 -- 172.21.15.170:0/2796488653 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d81a2490 con 0x7f93d8102030 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93bffff700 1 -- 172.21.15.170:0/2796488653 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00f2e0 con 0x7f93d8102030 2024-03-16T20:51:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.487+0000 7f93dd6a8700 1 -- 172.21.15.170:0/2796488653 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d81a29e0 con 0x7f93d8102030 2024-03-16T20:51:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.488+0000 7f93dd6a8700 1 -- 172.21.15.170:0/2796488653 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d8109390 con 0x7f93d8102030 2024-03-16T20:51:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.489+0000 7f93bffff700 1 -- 172.21.15.170:0/2796488653 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f93cc0106a0 con 0x7f93d8102030 2024-03-16T20:51:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.490+0000 7f93bffff700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f93c00a1b40 0x7f93c00a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:51:51.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.490+0000 7f93bffff700 1 -- 172.21.15.170:0/2796488653 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f93cc0cc640 con 0x7f93d8102030 2024-03-16T20:51:51.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.490+0000 7f93d67fc700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f93c00a1b40 0x7f93c00a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:51:51.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.491+0000 7f93d67fc700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f93c00a1b40 0x7f93c00a4000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93c80098e0 tx=0x7f93c8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:51:51.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.494+0000 7f93bffff700 1 -- 172.21.15.170:0/2796488653 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f93cc096560 con 0x7f93d8102030 2024-03-16T20:51:51.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:51:51.697+0000 7f93dd6a8700 1 -- 172.21.15.170:0/2796488653 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f93d802d990 con 0x7f93c00a1b40 2024-03-16T20:51:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi008 2024-03-16T20:51:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi008 to 5698M 2024-03-16T20:51:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:52.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:51:52.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:51:52.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:51:52.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:52 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:52.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:52.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi008 2024-03-16T20:51:52.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi008 to 5698M 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:51:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:52 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:52.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:52.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi008 2024-03-16T20:51:52.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:52.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:52.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:51:52.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi008 to 5698M 2024-03-16T20:51:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:51:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:51:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:51:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:51:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:51:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:52 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:51:54.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:54 smithi170 ceph-mon[35947]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:54.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:54 smithi170 ceph-mon[35947]: from='client.? 172.21.15.170:0/631465297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9718fcd-5f0e-47da-8821-547c22b2de7d"}]: dispatch 2024-03-16T20:51:54.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:54 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9718fcd-5f0e-47da-8821-547c22b2de7d"}]: dispatch 2024-03-16T20:51:54.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:54 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9718fcd-5f0e-47da-8821-547c22b2de7d"}]': finished 2024-03-16T20:51:54.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:54 smithi170 ceph-mon[35947]: osdmap e49: 8 total, 7 up, 8 in 2024-03-16T20:51:54.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:54 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:51:54.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:54 smithi186 ceph-mon[36391]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:54.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:54 smithi186 ceph-mon[36391]: from='client.? 172.21.15.170:0/631465297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9718fcd-5f0e-47da-8821-547c22b2de7d"}]: dispatch 2024-03-16T20:51:54.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:54 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9718fcd-5f0e-47da-8821-547c22b2de7d"}]: dispatch 2024-03-16T20:51:54.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:54 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9718fcd-5f0e-47da-8821-547c22b2de7d"}]': finished 2024-03-16T20:51:54.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:54 smithi186 ceph-mon[36391]: osdmap e49: 8 total, 7 up, 8 in 2024-03-16T20:51:54.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:54 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:51:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:54 smithi008 ceph-mon[31434]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:54 smithi008 ceph-mon[31434]: from='client.? 172.21.15.170:0/631465297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9718fcd-5f0e-47da-8821-547c22b2de7d"}]: dispatch 2024-03-16T20:51:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:54 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9718fcd-5f0e-47da-8821-547c22b2de7d"}]: dispatch 2024-03-16T20:51:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:54 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9718fcd-5f0e-47da-8821-547c22b2de7d"}]': finished 2024-03-16T20:51:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:54 smithi008 ceph-mon[31434]: osdmap e49: 8 total, 7 up, 8 in 2024-03-16T20:51:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:54 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:51:55.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:55 smithi008 ceph-mon[31434]: from='client.? 172.21.15.170:0/919509665' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:51:55.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:55 smithi170 ceph-mon[35947]: from='client.? 172.21.15.170:0/919509665' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:51:55.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:55 smithi186 ceph-mon[36391]: from='client.? 172.21.15.170:0/919509665' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:51:56.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:56 smithi170 ceph-mon[35947]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:56.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:56 smithi186 ceph-mon[36391]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:56.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:56 smithi008 ceph-mon[31434]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:58.693 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:51:58 smithi170 ceph-mon[35947]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:58.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:51:58 smithi186 ceph-mon[36391]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:51:58.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:51:58 smithi008 ceph-mon[31434]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:00.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:00 smithi008 ceph-mon[31434]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:00.847 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:00 smithi170 ceph-mon[35947]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:00.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:00 smithi186 ceph-mon[36391]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:01.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:01 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-16T20:52:01.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:01 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:01.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:01 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-16T20:52:01.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:01 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:01.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:01 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-16T20:52:01.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:01 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:02.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:02 smithi170 ceph-mon[35947]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:02.797 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:02 smithi170 ceph-mon[35947]: Deploying daemon osd.7 on smithi170 2024-03-16T20:52:02.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:02 smithi186 ceph-mon[36391]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:02.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:02 smithi186 ceph-mon[36391]: Deploying daemon osd.7 on smithi170 2024-03-16T20:52:02.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:02 smithi008 ceph-mon[31434]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:02.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:02 smithi008 ceph-mon[31434]: Deploying daemon osd.7 on smithi170 2024-03-16T20:52:04.780 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:04 smithi170 ceph-mon[35947]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:04.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:04 smithi186 ceph-mon[36391]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:04.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:04 smithi008 ceph-mon[31434]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:06.724 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:06 smithi170 ceph-mon[35947]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:06.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:06 smithi186 ceph-mon[36391]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:06.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:06 smithi008 ceph-mon[31434]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:08.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:08 smithi170 ceph-mon[35947]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:08.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:08 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:08.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:08 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:08.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:08 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:08.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:08 smithi186 ceph-mon[36391]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:08.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:08 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:08.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:08 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:08.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:08 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:08.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:08 smithi008 ceph-mon[31434]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:08.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:08 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:08.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:08 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:08.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:08 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:10.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:10 smithi008 ceph-mon[31434]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:10.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:10.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:10.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:10.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:10.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:10.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:10 smithi170 ceph-mon[35947]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:10.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:10.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:10.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:10.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:10.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:10.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:10 smithi186 ceph-mon[36391]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:10.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:10.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:10.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:10.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:10.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:10.834 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 7 on host 'smithi170' 2024-03-16T20:52:10.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.830+0000 7f93bffff700 1 -- 172.21.15.170:0/2796488653 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f93d802d990 con 0x7f93c00a1b40 2024-03-16T20:52:10.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 -- 172.21.15.170:0/2796488653 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f93c00a1b40 msgr2=0x7f93c00a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:52:10.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f93c00a1b40 0x7f93c00a4000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93c80098e0 tx=0x7f93c8000bc0 comp rx=0 tx=0).stop 2024-03-16T20:52:10.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 -- 172.21.15.170:0/2796488653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93d8102030 msgr2=0x7f93d8075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:52:10.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93d8102030 0x7f93d8075d80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00b500 tx=0x7f93cc00b810 comp rx=0 tx=0).stop 2024-03-16T20:52:10.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 -- 172.21.15.170:0/2796488653 shutdown_connections 2024-03-16T20:52:10.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f93c00a1b40 0x7f93c00a4000 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:10.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93d8103bd0 0x7f93d8074910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:10.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93d8102030 0x7f93d8075d80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:10.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 --2- 172.21.15.170:0/2796488653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93d8103230 0x7f93d80743d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:10.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 -- 172.21.15.170:0/2796488653 >> 172.21.15.170:0/2796488653 conn(0x7f93d80fd5f0 msgr2=0x7f93d81064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:52:10.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 -- 172.21.15.170:0/2796488653 shutdown_connections 2024-03-16T20:52:10.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:52:10.833+0000 7f93dd6a8700 1 -- 172.21.15.170:0/2796488653 wait complete. 2024-03-16T20:52:11.518 DEBUG:teuthology.orchestra.run.smithi170:osd.7> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.7.service 2024-03-16T20:52:11.520 INFO:tasks.cephadm:Deploying osd.8 on smithi186 with /dev/vg_nvme/lv_2... 2024-03-16T20:52:11.520 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-16T20:52:11.770 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:52:11.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:11 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:11.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:11 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:11.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:11 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:11.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:11 smithi186 ceph-mon[36391]: from='osd.7 [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T20:52:11.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:11 smithi186 ceph-mon[36391]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T20:52:12.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:11 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:12.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:11 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:12.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:11 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:12.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:11 smithi170 ceph-mon[35947]: from='osd.7 [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T20:52:12.054 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:11 smithi170 ceph-mon[35947]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T20:52:12.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:11 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:12.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:11 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:12.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:11 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:12.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:11 smithi008 ceph-mon[31434]: from='osd.7 [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T20:52:12.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:11 smithi008 ceph-mon[31434]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T20:52:13.116 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:12 smithi170 ceph-mon[35947]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:13.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:12 smithi170 ceph-mon[35947]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-16T20:52:13.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:12 smithi170 ceph-mon[35947]: from='osd.7 [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:52:13.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:12 smithi170 ceph-mon[35947]: osdmap e50: 8 total, 7 up, 8 in 2024-03-16T20:52:13.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:12 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:52:13.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:12 smithi170 ceph-mon[35947]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:52:13.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:12 smithi186 ceph-mon[36391]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:13.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:12 smithi186 ceph-mon[36391]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-16T20:52:13.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:12 smithi186 ceph-mon[36391]: from='osd.7 [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:52:13.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:12 smithi186 ceph-mon[36391]: osdmap e50: 8 total, 7 up, 8 in 2024-03-16T20:52:13.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:52:13.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:12 smithi186 ceph-mon[36391]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:52:13.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:12 smithi008 ceph-mon[31434]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:13.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:12 smithi008 ceph-mon[31434]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-16T20:52:13.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:12 smithi008 ceph-mon[31434]: from='osd.7 [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:52:13.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:12 smithi008 ceph-mon[31434]: osdmap e50: 8 total, 7 up, 8 in 2024-03-16T20:52:13.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:52:13.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:12 smithi008 ceph-mon[31434]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:52:13.617 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 20:52:13 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T20:52:13.262+0000 7f6909810700 -1 osd.7 0 waiting for initial osdmap 2024-03-16T20:52:13.617 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 20:52:13 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T20:52:13.275+0000 7f69015fb700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T20:52:13.894 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-16T20:52:13.894 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-16T20:52:13.894 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-03-16T20:52:13.895 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-03-16T20:52:13.895 INFO:teuthology.orchestra.run.smithi186.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115041 s, 911 MB/s 2024-03-16T20:52:13.895 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-03-16T20:52:14.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:13 smithi170 ceph-mon[35947]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:52:14.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:13 smithi170 ceph-mon[35947]: osdmap e51: 8 total, 7 up, 8 in 2024-03-16T20:52:14.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:13 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:52:14.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:13 smithi170 ceph-mon[35947]: from='osd.7 ' entity='osd.7' 2024-03-16T20:52:14.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:13 smithi170 ceph-mon[35947]: osd.7 [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716] boot 2024-03-16T20:52:14.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:13 smithi186 ceph-mon[36391]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:52:14.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:13 smithi186 ceph-mon[36391]: osdmap e51: 8 total, 7 up, 8 in 2024-03-16T20:52:14.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:13 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:52:14.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:13 smithi186 ceph-mon[36391]: from='osd.7 ' entity='osd.7' 2024-03-16T20:52:14.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:13 smithi186 ceph-mon[36391]: osd.7 [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716] boot 2024-03-16T20:52:14.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:13 smithi008 ceph-mon[31434]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:52:14.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:13 smithi008 ceph-mon[31434]: osdmap e51: 8 total, 7 up, 8 in 2024-03-16T20:52:14.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:13 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:52:14.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:13 smithi008 ceph-mon[31434]: from='osd.7 ' entity='osd.7' 2024-03-16T20:52:14.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:13 smithi008 ceph-mon[31434]: osd.7 [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716] boot 2024-03-16T20:52:14.551 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_2 2024-03-16T20:52:14.787 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:52:15.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:14 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:52:15.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:14 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:52:15.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:14 smithi170 ceph-mon[35947]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:15.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:14 smithi170 ceph-mon[35947]: osdmap e52: 8 total, 8 up, 8 in 2024-03-16T20:52:15.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:52:15.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:14 smithi170 ceph-mon[35947]: osdmap e53: 8 total, 8 up, 8 in 2024-03-16T20:52:15.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:14 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:52:15.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:14 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:52:15.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:14 smithi186 ceph-mon[36391]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:15.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:14 smithi186 ceph-mon[36391]: osdmap e52: 8 total, 8 up, 8 in 2024-03-16T20:52:15.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:52:15.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:14 smithi186 ceph-mon[36391]: osdmap e53: 8 total, 8 up, 8 in 2024-03-16T20:52:15.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:14 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:52:15.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:14 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:52:15.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:14 smithi008 ceph-mon[31434]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-16T20:52:15.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:14 smithi008 ceph-mon[31434]: osdmap e52: 8 total, 8 up, 8 in 2024-03-16T20:52:15.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:52:15.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:14 smithi008 ceph-mon[31434]: osdmap e53: 8 total, 8 up, 8 in 2024-03-16T20:52:15.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi170 2024-03-16T20:52:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi170 to 5693M 2024-03-16T20:52:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:15 smithi186 ceph-mon[36391]: osdmap e54: 8 total, 8 up, 8 in 2024-03-16T20:52:16.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi170 2024-03-16T20:52:16.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:16.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:16.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:16.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:16.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:16.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi170 to 5693M 2024-03-16T20:52:16.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:16.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:16.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:16.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:16.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:15 smithi170 ceph-mon[35947]: osdmap e54: 8 total, 8 up, 8 in 2024-03-16T20:52:16.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi170 2024-03-16T20:52:16.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:16.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:16.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:16.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:16.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:16.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi170 to 5693M 2024-03-16T20:52:16.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:16.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:16.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:16.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:16.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:15 smithi008 ceph-mon[31434]: osdmap e54: 8 total, 8 up, 8 in 2024-03-16T20:52:16.396 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.390+0000 7f692ae6f700 1 -- 172.21.15.186:0/3222486368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6924102b10 msgr2=0x7f69241093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:52:16.396 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.390+0000 7f692ae6f700 1 --2- 172.21.15.186:0/3222486368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6924102b10 0x7f69241093c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f691c00b0a0 tx=0x7f691c00b3b0 comp rx=0 tx=0).stop 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.390+0000 7f692ae6f700 1 -- 172.21.15.186:0/3222486368 shutdown_connections 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.390+0000 7f692ae6f700 1 --2- 172.21.15.186:0/3222486368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6924100f70 0x7f6924101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.390+0000 7f692ae6f700 1 --2- 172.21.15.186:0/3222486368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6924102b10 0x7f69241093c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.390+0000 7f692ae6f700 1 --2- 172.21.15.186:0/3222486368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6924102170 0x7f69241025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.390+0000 7f692ae6f700 1 -- 172.21.15.186:0/3222486368 >> 172.21.15.186:0/3222486368 conn(0x7f69240fc530 msgr2=0x7f69240fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.390+0000 7f692ae6f700 1 -- 172.21.15.186:0/3222486368 shutdown_connections 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.390+0000 7f692ae6f700 1 -- 172.21.15.186:0/3222486368 wait complete. 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.390+0000 7f692ae6f700 1 Processor -- start 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.390+0000 7f692ae6f700 1 -- start start 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f692ae6f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6924100f70 0x7f692406b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f692ae6f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6924102170 0x7f692419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f692ae6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6924102b10 0x7f692419f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f692ae6f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692419fd30 con 0x7f6924102b10 2024-03-16T20:52:16.397 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f692ae6f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692419fea0 con 0x7f6924100f70 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f692ae6f700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241a0060 con 0x7f6924102170 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6923fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6924102170 0x7f692419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6923fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6924102170 0x7f692419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:49776/0 (socket says 172.21.15.186:49776) 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6923fff700 1 -- 172.21.15.186:0/538577820 learned_addr learned my addr 172.21.15.186:0/538577820 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6928c0b700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6924100f70 0x7f692406b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6923fff700 1 -- 172.21.15.186:0/538577820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6924100f70 msgr2=0x7f692406b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6923fff700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6924100f70 0x7f692406b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6923fff700 1 -- 172.21.15.186:0/538577820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6924102b10 msgr2=0x7f692419f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6923fff700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6924102b10 0x7f692419f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6923fff700 1 -- 172.21.15.186:0/538577820 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c009d00 con 0x7f6924102170 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6923fff700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6924102170 0x7f692419cf40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f691000d950 tx=0x7f691000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6921ffb700 1 -- 172.21.15.186:0/538577820 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910009940 con 0x7f6924102170 2024-03-16T20:52:16.398 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6921ffb700 1 -- 172.21.15.186:0/538577820 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6910010460 con 0x7f6924102170 2024-03-16T20:52:16.399 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f692ae6f700 1 -- 172.21.15.186:0/538577820 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69241a0340 con 0x7f6924102170 2024-03-16T20:52:16.399 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.391+0000 7f6921ffb700 1 -- 172.21.15.186:0/538577820 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000f6b0 con 0x7f6924102170 2024-03-16T20:52:16.399 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.392+0000 7f692ae6f700 1 -- 172.21.15.186:0/538577820 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69241a0910 con 0x7f6924102170 2024-03-16T20:52:16.399 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.392+0000 7f692ae6f700 1 -- 172.21.15.186:0/538577820 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6924108260 con 0x7f6924102170 2024-03-16T20:52:16.399 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.393+0000 7f6921ffb700 1 -- 172.21.15.186:0/538577820 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f69100105d0 con 0x7f6924102170 2024-03-16T20:52:16.400 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.394+0000 7f6921ffb700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f69140a1b40 0x7f69140a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:52:16.400 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.394+0000 7f6921ffb700 1 -- 172.21.15.186:0/538577820 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f69100cc710 con 0x7f6924102170 2024-03-16T20:52:16.400 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.394+0000 7f6928c0b700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f69140a1b40 0x7f69140a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:52:16.400 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.395+0000 7f6928c0b700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f69140a1b40 0x7f69140a4000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6924101fd0 tx=0x7f6918009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:52:16.403 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.398+0000 7f6921ffb700 1 -- 172.21.15.186:0/538577820 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6910096460 con 0x7f6924102170 2024-03-16T20:52:16.605 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:16.600+0000 7f692ae6f700 1 -- 172.21.15.186:0/538577820 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f692402daa0 con 0x7f69140a1b40 2024-03-16T20:52:16.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:16 smithi186 ceph-mon[36391]: pgmap v199: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:16.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:16 smithi186 ceph-mon[36391]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-03-16T20:52:16.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:52:16.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:52:16.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:16 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:17.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:16 smithi170 ceph-mon[35947]: pgmap v199: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:17.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:16 smithi170 ceph-mon[35947]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-03-16T20:52:17.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:52:17.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:52:17.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:16 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:17.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:16 smithi008 ceph-mon[31434]: pgmap v199: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:17.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:16 smithi008 ceph-mon[31434]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-03-16T20:52:17.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:52:17.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:52:17.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:16 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:18.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:17 smithi008 ceph-mon[31434]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:52:18.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:17 smithi008 ceph-mon[31434]: osdmap e55: 8 total, 8 up, 8 in 2024-03-16T20:52:18.256 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:17 smithi186 ceph-mon[36391]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:52:18.256 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:17 smithi186 ceph-mon[36391]: osdmap e55: 8 total, 8 up, 8 in 2024-03-16T20:52:18.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:17 smithi170 ceph-mon[35947]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:52:18.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:17 smithi170 ceph-mon[35947]: osdmap e55: 8 total, 8 up, 8 in 2024-03-16T20:52:19.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:18 smithi008 ceph-mon[31434]: pgmap v202: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:19.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:18 smithi008 ceph-mon[31434]: osdmap e56: 8 total, 8 up, 8 in 2024-03-16T20:52:19.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:18 smithi170 ceph-mon[35947]: pgmap v202: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:19.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:18 smithi170 ceph-mon[35947]: osdmap e56: 8 total, 8 up, 8 in 2024-03-16T20:52:19.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:18 smithi186 ceph-mon[36391]: pgmap v202: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:19.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:18 smithi186 ceph-mon[36391]: osdmap e56: 8 total, 8 up, 8 in 2024-03-16T20:52:20.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:19 smithi008 ceph-mon[31434]: from='client.? 172.21.15.186:0/2128749988' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f98927f9-bb43-4c80-af77-f319bc786d89"}]: dispatch 2024-03-16T20:52:20.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:19 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f98927f9-bb43-4c80-af77-f319bc786d89"}]: dispatch 2024-03-16T20:52:20.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:19 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f98927f9-bb43-4c80-af77-f319bc786d89"}]': finished 2024-03-16T20:52:20.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:19 smithi008 ceph-mon[31434]: osdmap e57: 9 total, 8 up, 9 in 2024-03-16T20:52:20.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:20.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:19 smithi170 ceph-mon[35947]: from='client.? 172.21.15.186:0/2128749988' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f98927f9-bb43-4c80-af77-f319bc786d89"}]: dispatch 2024-03-16T20:52:20.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:19 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f98927f9-bb43-4c80-af77-f319bc786d89"}]: dispatch 2024-03-16T20:52:20.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:19 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f98927f9-bb43-4c80-af77-f319bc786d89"}]': finished 2024-03-16T20:52:20.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:19 smithi170 ceph-mon[35947]: osdmap e57: 9 total, 8 up, 9 in 2024-03-16T20:52:20.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:20.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:19 smithi186 ceph-mon[36391]: from='client.? 172.21.15.186:0/2128749988' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f98927f9-bb43-4c80-af77-f319bc786d89"}]: dispatch 2024-03-16T20:52:20.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:19 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f98927f9-bb43-4c80-af77-f319bc786d89"}]: dispatch 2024-03-16T20:52:20.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:19 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f98927f9-bb43-4c80-af77-f319bc786d89"}]': finished 2024-03-16T20:52:20.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:19 smithi186 ceph-mon[36391]: osdmap e57: 9 total, 8 up, 9 in 2024-03-16T20:52:20.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:21.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:20 smithi008 ceph-mon[31434]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:21.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:20 smithi008 ceph-mon[31434]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-03-16T20:52:21.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:20 smithi008 ceph-mon[31434]: Cluster is now healthy 2024-03-16T20:52:21.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:20 smithi008 ceph-mon[31434]: from='client.? 172.21.15.186:0/1964638818' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:52:21.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:20 smithi170 ceph-mon[35947]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:21.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:20 smithi170 ceph-mon[35947]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-03-16T20:52:21.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:20 smithi170 ceph-mon[35947]: Cluster is now healthy 2024-03-16T20:52:21.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:20 smithi170 ceph-mon[35947]: from='client.? 172.21.15.186:0/1964638818' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:52:21.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:20 smithi186 ceph-mon[36391]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:21.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:20 smithi186 ceph-mon[36391]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-03-16T20:52:21.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:20 smithi186 ceph-mon[36391]: Cluster is now healthy 2024-03-16T20:52:21.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:20 smithi186 ceph-mon[36391]: from='client.? 172.21.15.186:0/1964638818' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:52:22.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:21 smithi008 ceph-mon[31434]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:22.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:21 smithi170 ceph-mon[35947]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:22.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:21 smithi186 ceph-mon[36391]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:24.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:24 smithi170 ceph-mon[35947]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:24.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:24 smithi186 ceph-mon[36391]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:24.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:24 smithi008 ceph-mon[31434]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:26.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:26 smithi170 ceph-mon[35947]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:26.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:26 smithi186 ceph-mon[36391]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:26.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:26 smithi008 ceph-mon[31434]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:27.355 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:27 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-16T20:52:27.355 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:27 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:27.356 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:27 smithi186 ceph-mon[36391]: Deploying daemon osd.8 on smithi186 2024-03-16T20:52:27.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:27 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-16T20:52:27.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:27 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:27.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:27 smithi170 ceph-mon[35947]: Deploying daemon osd.8 on smithi186 2024-03-16T20:52:27.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:27 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-16T20:52:27.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:27 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:27.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:27 smithi008 ceph-mon[31434]: Deploying daemon osd.8 on smithi186 2024-03-16T20:52:28.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:28 smithi170 ceph-mon[35947]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:28.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:28 smithi186 ceph-mon[36391]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:28.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:28 smithi008 ceph-mon[31434]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:30.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:30 smithi170 ceph-mon[35947]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:30.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:30 smithi186 ceph-mon[36391]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:30.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:30 smithi008 ceph-mon[31434]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:32.366 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:32 smithi170 ceph-mon[35947]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:32.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:32 smithi186 ceph-mon[36391]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:32.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:32 smithi008 ceph-mon[31434]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:33.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:33.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:33.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:33.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:33.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:33.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:33.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:34.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:34 smithi008 ceph-mon[31434]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:34.517 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:34 smithi170 ceph-mon[35947]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:34.640 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:34 smithi186 ceph-mon[36391]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:36.248 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 8 on host 'smithi186' 2024-03-16T20:52:36.248 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.244+0000 7f6921ffb700 1 -- 172.21.15.186:0/538577820 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f692402daa0 con 0x7f69140a1b40 2024-03-16T20:52:36.250 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.246+0000 7f692ae6f700 1 -- 172.21.15.186:0/538577820 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f69140a1b40 msgr2=0x7f69140a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:52:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.246+0000 7f692ae6f700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f69140a1b40 0x7f69140a4000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6924101fd0 tx=0x7f6918009190 comp rx=0 tx=0).stop 2024-03-16T20:52:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.246+0000 7f692ae6f700 1 -- 172.21.15.186:0/538577820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6924102170 msgr2=0x7f692419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:52:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.246+0000 7f692ae6f700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6924102170 0x7f692419cf40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f691000d950 tx=0x7f691000dc60 comp rx=0 tx=0).stop 2024-03-16T20:52:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.246+0000 7f692ae6f700 1 -- 172.21.15.186:0/538577820 shutdown_connections 2024-03-16T20:52:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.246+0000 7f692ae6f700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f69140a1b40 0x7f69140a4000 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.247+0000 7f692ae6f700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6924102b10 0x7f692419f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.247+0000 7f692ae6f700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6924100f70 0x7f692406b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.247+0000 7f692ae6f700 1 --2- 172.21.15.186:0/538577820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6924102170 0x7f692419cf40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.247+0000 7f692ae6f700 1 -- 172.21.15.186:0/538577820 >> 172.21.15.186:0/538577820 conn(0x7f69240fc530 msgr2=0x7f69241053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:52:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.247+0000 7f692ae6f700 1 -- 172.21.15.186:0/538577820 shutdown_connections 2024-03-16T20:52:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:52:36.247+0000 7f692ae6f700 1 -- 172.21.15.186:0/538577820 wait complete. 2024-03-16T20:52:36.560 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:36 smithi186 ceph-mon[36391]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:36.560 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.560 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.561 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:36.561 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:36.561 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.561 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:36 smithi186 ceph-mon[36391]: from='osd.8 [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T20:52:36.561 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:36 smithi186 ceph-mon[36391]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T20:52:36.561 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.561 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.561 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:36 smithi170 ceph-mon[35947]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:36 smithi170 ceph-mon[35947]: from='osd.8 [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T20:52:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:36 smithi170 ceph-mon[35947]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T20:52:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:36.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:36 smithi008 ceph-mon[31434]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:36.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:36.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:36.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:36 smithi008 ceph-mon[31434]: from='osd.8 [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T20:52:36.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:36 smithi008 ceph-mon[31434]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T20:52:36.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:36.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:52:36.913 DEBUG:teuthology.orchestra.run.smithi186:osd.8> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.8.service 2024-03-16T20:52:36.914 INFO:tasks.cephadm:Deploying osd.9 on smithi008 with /dev/vg_nvme/lv_1... 2024-03-16T20:52:36.915 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-16T20:52:37.386 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:52:37.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:37 smithi186 ceph-mon[36391]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-16T20:52:37.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:37 smithi186 ceph-mon[36391]: from='osd.8 [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:52:37.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:37 smithi186 ceph-mon[36391]: osdmap e58: 9 total, 8 up, 9 in 2024-03-16T20:52:37.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:37.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:37 smithi186 ceph-mon[36391]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:52:37.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:37 smithi008 ceph-mon[31434]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-16T20:52:37.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:37 smithi008 ceph-mon[31434]: from='osd.8 [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:52:37.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:37 smithi008 ceph-mon[31434]: osdmap e58: 9 total, 8 up, 9 in 2024-03-16T20:52:37.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:37.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:37 smithi008 ceph-mon[31434]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:52:37.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:37 smithi170 ceph-mon[35947]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-16T20:52:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:37 smithi170 ceph-mon[35947]: from='osd.8 [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:52:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:37 smithi170 ceph-mon[35947]: osdmap e58: 9 total, 8 up, 9 in 2024-03-16T20:52:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:37 smithi170 ceph-mon[35947]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:52:38.143 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 20:52:37 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T20:52:37.865+0000 7f61f1e23700 -1 osd.8 0 waiting for initial osdmap 2024-03-16T20:52:38.143 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 20:52:37 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T20:52:37.878+0000 7f61e9c0e700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T20:52:38.494 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:38 smithi186 ceph-mon[36391]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:38.494 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:38 smithi186 ceph-mon[36391]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:52:38.494 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:38 smithi186 ceph-mon[36391]: osdmap e59: 9 total, 8 up, 9 in 2024-03-16T20:52:38.494 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:38 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:38.494 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:38 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:38.494 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:38 smithi186 ceph-mon[36391]: from='osd.8 ' entity='osd.8' 2024-03-16T20:52:38.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:38 smithi008 ceph-mon[31434]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:38.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:38 smithi008 ceph-mon[31434]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:52:38.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:38 smithi008 ceph-mon[31434]: osdmap e59: 9 total, 8 up, 9 in 2024-03-16T20:52:38.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:38.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:38.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:38 smithi008 ceph-mon[31434]: from='osd.8 ' entity='osd.8' 2024-03-16T20:52:38.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:38 smithi170 ceph-mon[35947]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-03-16T20:52:38.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:38 smithi170 ceph-mon[35947]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:52:38.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:38 smithi170 ceph-mon[35947]: osdmap e59: 9 total, 8 up, 9 in 2024-03-16T20:52:38.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:38 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:38.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:38 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:38.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:38 smithi170 ceph-mon[35947]: from='osd.8 ' entity='osd.8' 2024-03-16T20:52:39.483 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:39 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:52:39.483 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:39 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:52:39.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:39 smithi008 ceph-mon[31434]: osd.8 [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318] boot 2024-03-16T20:52:39.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:39 smithi008 ceph-mon[31434]: osdmap e60: 9 total, 9 up, 9 in 2024-03-16T20:52:39.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:39.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:39 smithi008 ceph-mon[31434]: osdmap e61: 9 total, 9 up, 9 in 2024-03-16T20:52:39.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:39 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:52:39.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:39 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:52:39.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:39 smithi186 ceph-mon[36391]: osd.8 [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318] boot 2024-03-16T20:52:39.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:39 smithi186 ceph-mon[36391]: osdmap e60: 9 total, 9 up, 9 in 2024-03-16T20:52:39.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:39 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:39.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:39 smithi186 ceph-mon[36391]: osdmap e61: 9 total, 9 up, 9 in 2024-03-16T20:52:39.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:39 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:52:39.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:39 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:52:39.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:39 smithi170 ceph-mon[35947]: osd.8 [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318] boot 2024-03-16T20:52:39.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:39 smithi170 ceph-mon[35947]: osdmap e60: 9 total, 9 up, 9 in 2024-03-16T20:52:39.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:39 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:52:39.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:39 smithi170 ceph-mon[35947]: osdmap e61: 9 total, 9 up, 9 in 2024-03-16T20:52:40.466 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-16T20:52:40.466 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-16T20:52:40.466 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2024-03-16T20:52:40.466 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2024-03-16T20:52:40.466 INFO:teuthology.orchestra.run.smithi008.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0376071 s, 279 MB/s 2024-03-16T20:52:40.466 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2024-03-16T20:52:40.467 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:40 smithi008 ceph-mon[31434]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:40.467 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:40 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.467 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:40 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.467 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:40 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:40.467 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:40 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:40.467 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:40 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:40.467 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:40 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.467 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:40 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:40.467 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:40 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:40.467 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:40 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.467 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:40 smithi008 ceph-mon[31434]: osdmap e62: 9 total, 9 up, 9 in 2024-03-16T20:52:40.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:40 smithi170 ceph-mon[35947]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:40.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:40 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:40 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:40 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:40.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:40 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:40.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:40 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:40.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:40 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:40 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:40.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:40 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:40.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:40 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.870 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:40 smithi170 ceph-mon[35947]: osdmap e62: 9 total, 9 up, 9 in 2024-03-16T20:52:40.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:40 smithi186 ceph-mon[36391]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:40.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:40 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:40 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:40 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:40.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:40 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:40.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:40 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:52:40.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:40 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:40 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:40.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:40 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:52:40.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:40 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:52:40.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:40 smithi186 ceph-mon[36391]: osdmap e62: 9 total, 9 up, 9 in 2024-03-16T20:52:41.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi008:vg_nvme/lv_1 2024-03-16T20:52:41.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:41 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi186 2024-03-16T20:52:41.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:41 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi186 to 5693M 2024-03-16T20:52:41.766 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:52:41.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:41 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi186 2024-03-16T20:52:41.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:41 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi186 to 5693M 2024-03-16T20:52:41.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:41 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi186 2024-03-16T20:52:41.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:41 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi186 to 5693M 2024-03-16T20:52:42.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:42 smithi008 ceph-mon[31434]: pgmap v221: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:42 smithi008 ceph-mon[31434]: osdmap e63: 9 total, 9 up, 9 in 2024-03-16T20:52:42.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:42 smithi170 ceph-mon[35947]: pgmap v221: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:42.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:42 smithi170 ceph-mon[35947]: osdmap e63: 9 total, 9 up, 9 in 2024-03-16T20:52:42.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:42 smithi186 ceph-mon[36391]: pgmap v221: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:42.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:42 smithi186 ceph-mon[36391]: osdmap e63: 9 total, 9 up, 9 in 2024-03-16T20:52:43.700 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:43 smithi008 ceph-mon[31434]: osdmap e64: 9 total, 9 up, 9 in 2024-03-16T20:52:43.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:43 smithi170 ceph-mon[35947]: osdmap e64: 9 total, 9 up, 9 in 2024-03-16T20:52:43.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:43 smithi186 ceph-mon[36391]: osdmap e64: 9 total, 9 up, 9 in 2024-03-16T20:52:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.985+0000 7fa878c00700 1 -- 172.21.15.8:0/1459092979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa874104260 msgr2=0x7fa874104680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:52:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.985+0000 7fa878c00700 1 --2- 172.21.15.8:0/1459092979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa874104260 0x7fa874104680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8640099c0 tx=0x7fa864009cd0 comp rx=0 tx=0).stop 2024-03-16T20:52:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.985+0000 7fa878c00700 1 -- 172.21.15.8:0/1459092979 shutdown_connections 2024-03-16T20:52:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.985+0000 7fa878c00700 1 --2- 172.21.15.8:0/1459092979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa874104260 0x7fa874104680 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.985+0000 7fa878c00700 1 --2- 172.21.15.8:0/1459092979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa874105e00 0x7fa87410c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.985+0000 7fa878c00700 1 --2- 172.21.15.8:0/1459092979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa874105460 0x7fa8741058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.985+0000 7fa878c00700 1 -- 172.21.15.8:0/1459092979 >> 172.21.15.8:0/1459092979 conn(0x7fa8740ff800 msgr2=0x7fa874101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:52:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.985+0000 7fa878c00700 1 -- 172.21.15.8:0/1459092979 shutdown_connections 2024-03-16T20:52:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.985+0000 7fa878c00700 1 -- 172.21.15.8:0/1459092979 wait complete. 2024-03-16T20:52:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.986+0000 7fa878c00700 1 Processor -- start 2024-03-16T20:52:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.987+0000 7fa878c00700 1 -- start start 2024-03-16T20:52:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.987+0000 7fa878c00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa874104260 0x7fa87419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:52:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.987+0000 7fa878c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa874105460 0x7fa87419a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:52:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.987+0000 7fa878c00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa874105e00 0x7fa8741a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:52:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.987+0000 7fa878c00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8741a1ed0 con 0x7fa874105460 2024-03-16T20:52:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.987+0000 7fa878c00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8741a2010 con 0x7fa874104260 2024-03-16T20:52:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.987+0000 7fa878c00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8741a21a0 con 0x7fa874105e00 2024-03-16T20:52:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.987+0000 7fa869400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa874105460 0x7fa87419a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:52:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.988+0000 7fa869400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa874105460 0x7fa87419a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54568/0 (socket says 172.21.15.8:54568) 2024-03-16T20:52:43.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.988+0000 7fa871e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa874104260 0x7fa87419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:52:43.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.988+0000 7fa869400700 1 -- 172.21.15.8:0/475989462 learned_addr learned my addr 172.21.15.8:0/475989462 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:52:43.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.988+0000 7fa872800700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa874105e00 0x7fa8741a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:52:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.988+0000 7fa869400700 1 -- 172.21.15.8:0/475989462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa874105e00 msgr2=0x7fa8741a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:52:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.988+0000 7fa869400700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa874105e00 0x7fa8741a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.988+0000 7fa869400700 1 -- 172.21.15.8:0/475989462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa874104260 msgr2=0x7fa87419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:52:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.988+0000 7fa869400700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa874104260 0x7fa87419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:52:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.988+0000 7fa869400700 1 -- 172.21.15.8:0/475989462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8640095f0 con 0x7fa874105460 2024-03-16T20:52:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.988+0000 7fa871e00700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa874104260 0x7fa87419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:52:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.988+0000 7fa869400700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa874105460 0x7fa87419a880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00e9d0 tx=0x7fa85c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:52:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.989+0000 7fa86b400700 1 -- 172.21.15.8:0/475989462 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c009790 con 0x7fa874105460 2024-03-16T20:52:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.989+0000 7fa86b400700 1 -- 172.21.15.8:0/475989462 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa85c00ee70 con 0x7fa874105460 2024-03-16T20:52:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.989+0000 7fa878c00700 1 -- 172.21.15.8:0/475989462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8741a2480 con 0x7fa874105460 2024-03-16T20:52:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.989+0000 7fa86b400700 1 -- 172.21.15.8:0/475989462 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c018680 con 0x7fa874105460 2024-03-16T20:52:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.989+0000 7fa878c00700 1 -- 172.21.15.8:0/475989462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8741a2980 con 0x7fa874105460 2024-03-16T20:52:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.990+0000 7fa878c00700 1 -- 172.21.15.8:0/475989462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87410b550 con 0x7fa874105460 2024-03-16T20:52:43.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.994+0000 7fa86b400700 1 -- 172.21.15.8:0/475989462 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fa85c00cbd0 con 0x7fa874105460 2024-03-16T20:52:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.995+0000 7fa86b400700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa8580a1ac0 0x7fa8580a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:52:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.995+0000 7fa86b400700 1 -- 172.21.15.8:0/475989462 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5829+0+0 (secure 0 0 0) 0x7fa85c014070 con 0x7fa874105460 2024-03-16T20:52:44.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.995+0000 7fa871e00700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa8580a1ac0 0x7fa8580a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:52:44.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.996+0000 7fa871e00700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa8580a1ac0 0x7fa8580a3f80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa864009fd0 tx=0x7fa864005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:52:44.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:43.998+0000 7fa86b400700 1 -- 172.21.15.8:0/475989462 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa85c096c60 con 0x7fa874105460 2024-03-16T20:52:44.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:52:44.233+0000 7fa878c00700 1 -- 172.21.15.8:0/475989462 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa87402da30 con 0x7fa8580a1ac0 2024-03-16T20:52:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:44 smithi008 ceph-mon[31434]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:52:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:52:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:44.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:44 smithi170 ceph-mon[35947]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:44.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:52:44.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:52:44.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:44.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:44 smithi186 ceph-mon[36391]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:44.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:52:44.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:52:44.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:45.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:45 smithi008 ceph-mon[31434]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:52:45.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:45 smithi170 ceph-mon[35947]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:52:45.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:45 smithi186 ceph-mon[36391]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:52:46.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:46 smithi008 ceph-mon[31434]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-03-16T20:52:46.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:46 smithi170 ceph-mon[35947]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-03-16T20:52:46.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:46 smithi186 ceph-mon[36391]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-03-16T20:52:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:48 smithi008 ceph-mon[31434]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-03-16T20:52:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:48 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3399744160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35ed0aeb-5dd5-4354-bf28-f5043871c2ec"}]: dispatch 2024-03-16T20:52:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:48 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35ed0aeb-5dd5-4354-bf28-f5043871c2ec"}]: dispatch 2024-03-16T20:52:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:48 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35ed0aeb-5dd5-4354-bf28-f5043871c2ec"}]': finished 2024-03-16T20:52:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:48 smithi008 ceph-mon[31434]: osdmap e65: 10 total, 9 up, 10 in 2024-03-16T20:52:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:48 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:52:48.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:48 smithi170 ceph-mon[35947]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-03-16T20:52:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:48 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3399744160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35ed0aeb-5dd5-4354-bf28-f5043871c2ec"}]: dispatch 2024-03-16T20:52:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:48 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35ed0aeb-5dd5-4354-bf28-f5043871c2ec"}]: dispatch 2024-03-16T20:52:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:48 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35ed0aeb-5dd5-4354-bf28-f5043871c2ec"}]': finished 2024-03-16T20:52:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:48 smithi170 ceph-mon[35947]: osdmap e65: 10 total, 9 up, 10 in 2024-03-16T20:52:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:48 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:52:48.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:48 smithi186 ceph-mon[36391]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-03-16T20:52:48.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:48 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3399744160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35ed0aeb-5dd5-4354-bf28-f5043871c2ec"}]: dispatch 2024-03-16T20:52:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:48 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35ed0aeb-5dd5-4354-bf28-f5043871c2ec"}]: dispatch 2024-03-16T20:52:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:48 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35ed0aeb-5dd5-4354-bf28-f5043871c2ec"}]': finished 2024-03-16T20:52:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:48 smithi186 ceph-mon[36391]: osdmap e65: 10 total, 9 up, 10 in 2024-03-16T20:52:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:48 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:52:49.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:49 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/30400133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:52:49.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:49 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/30400133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:52:49.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:49 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/30400133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:52:50.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:50 smithi008 ceph-mon[31434]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-03-16T20:52:50.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:50 smithi170 ceph-mon[35947]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-03-16T20:52:50.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:50 smithi186 ceph-mon[36391]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-03-16T20:52:52.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:52 smithi008 ceph-mon[31434]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-03-16T20:52:52.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:52 smithi170 ceph-mon[35947]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-03-16T20:52:52.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:52 smithi186 ceph-mon[36391]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-03-16T20:52:54.715 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:54 smithi008 ceph-mon[31434]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T20:52:54.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:54 smithi170 ceph-mon[35947]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T20:52:54.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:54 smithi186 ceph-mon[36391]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T20:52:56.596 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:56 smithi008 ceph-mon[31434]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:56.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:56 smithi170 ceph-mon[35947]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:56.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:56 smithi186 ceph-mon[36391]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:58.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:58 smithi008 ceph-mon[31434]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:58.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-16T20:52:58.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:58.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:58 smithi170 ceph-mon[35947]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-16T20:52:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:58.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:58 smithi186 ceph-mon[36391]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:52:58.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-16T20:52:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:52:59.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:52:59 smithi008 ceph-mon[31434]: Deploying daemon osd.9 on smithi008 2024-03-16T20:52:59.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:52:59 smithi170 ceph-mon[35947]: Deploying daemon osd.9 on smithi008 2024-03-16T20:52:59.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:52:59 smithi186 ceph-mon[36391]: Deploying daemon osd.9 on smithi008 2024-03-16T20:53:00.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:00 smithi008 ceph-mon[31434]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:00 smithi170 ceph-mon[35947]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:00.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:00 smithi186 ceph-mon[36391]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:02.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:02 smithi008 ceph-mon[31434]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:02.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:02 smithi170 ceph-mon[35947]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:02.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:02 smithi186 ceph-mon[36391]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:04.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:04 smithi008 ceph-mon[31434]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:04.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:04 smithi170 ceph-mon[35947]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:04.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:04 smithi186 ceph-mon[36391]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:06.783 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:06 smithi008 ceph-mon[31434]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:06.783 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:06 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:06.784 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:06 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:06.784 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:06 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:06.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:06 smithi170 ceph-mon[35947]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:06 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:06 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:06 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:06.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:06 smithi186 ceph-mon[36391]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:06.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:06 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:06.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:06 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:06.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:06 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:08.620 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:08 smithi008 ceph-mon[31434]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:08.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:08 smithi170 ceph-mon[35947]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:08.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:08 smithi186 ceph-mon[36391]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:10.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:10 smithi008 ceph-mon[31434]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:10.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:10.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:10 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:10.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:10 smithi008 ceph-mon[31434]: from='osd.9 [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-16T20:53:10.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:10 smithi008 ceph-mon[31434]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-16T20:53:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:10 smithi170 ceph-mon[35947]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:10 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:10 smithi170 ceph-mon[35947]: from='osd.9 [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-16T20:53:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:10 smithi170 ceph-mon[35947]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-16T20:53:10.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:10 smithi186 ceph-mon[36391]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:10.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:10.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:10 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:10.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:10 smithi186 ceph-mon[36391]: from='osd.9 [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-16T20:53:10.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:10 smithi186 ceph-mon[36391]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-16T20:53:11.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.424+0000 7fa86b400700 1 -- 172.21.15.8:0/475989462 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa87402da30 con 0x7fa8580a1ac0 2024-03-16T20:53:11.429 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 9 on host 'smithi008' 2024-03-16T20:53:11.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.427+0000 7fa878c00700 1 -- 172.21.15.8:0/475989462 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa8580a1ac0 msgr2=0x7fa8580a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:53:11.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.427+0000 7fa878c00700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa8580a1ac0 0x7fa8580a3f80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa864009fd0 tx=0x7fa864005fb0 comp rx=0 tx=0).stop 2024-03-16T20:53:11.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.427+0000 7fa878c00700 1 -- 172.21.15.8:0/475989462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa874105460 msgr2=0x7fa87419a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:53:11.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.428+0000 7fa878c00700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa874105460 0x7fa87419a880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00e9d0 tx=0x7fa85c00ece0 comp rx=0 tx=0).stop 2024-03-16T20:53:11.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.428+0000 7fa878c00700 1 -- 172.21.15.8:0/475989462 shutdown_connections 2024-03-16T20:53:11.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.428+0000 7fa878c00700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa8580a1ac0 0x7fa8580a3f80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:11.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.428+0000 7fa878c00700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa874105e00 0x7fa8741a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:11.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.428+0000 7fa878c00700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa874104260 0x7fa87419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:11.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.428+0000 7fa878c00700 1 --2- 172.21.15.8:0/475989462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa874105460 0x7fa87419a880 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:11.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.428+0000 7fa878c00700 1 -- 172.21.15.8:0/475989462 >> 172.21.15.8:0/475989462 conn(0x7fa8740ff800 msgr2=0x7fa874108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:53:11.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.428+0000 7fa878c00700 1 -- 172.21.15.8:0/475989462 shutdown_connections 2024-03-16T20:53:11.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:53:11.428+0000 7fa878c00700 1 -- 172.21.15.8:0/475989462 wait complete. 2024-03-16T20:53:12.301 DEBUG:teuthology.orchestra.run.smithi008:osd.9> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.9.service 2024-03-16T20:53:12.305 INFO:tasks.cephadm:Deploying osd.10 on smithi170 with /dev/vg_nvme/lv_1... 2024-03-16T20:53:12.305 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-16T20:53:12.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:12 smithi008 ceph-mon[31434]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:12.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:12 smithi008 ceph-mon[31434]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-16T20:53:12.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:12 smithi008 ceph-mon[31434]: from='osd.9 [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:53:12.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:12 smithi008 ceph-mon[31434]: osdmap e66: 10 total, 9 up, 10 in 2024-03-16T20:53:12.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:12.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:12 smithi008 ceph-mon[31434]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:53:12.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:12.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:12 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:12.552 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T20:53:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:12 smithi170 ceph-mon[35947]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:12 smithi170 ceph-mon[35947]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-16T20:53:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:12 smithi170 ceph-mon[35947]: from='osd.9 [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:53:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:12 smithi170 ceph-mon[35947]: osdmap e66: 10 total, 9 up, 10 in 2024-03-16T20:53:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:12 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:12 smithi170 ceph-mon[35947]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:53:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:12 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:12.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:12 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:12.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:12 smithi186 ceph-mon[36391]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:12.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:12 smithi186 ceph-mon[36391]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-16T20:53:12.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:12 smithi186 ceph-mon[36391]: from='osd.9 [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:53:12.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:12 smithi186 ceph-mon[36391]: osdmap e66: 10 total, 9 up, 10 in 2024-03-16T20:53:12.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:12.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:12 smithi186 ceph-mon[36391]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2024-03-16T20:53:12.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:12.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:12 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:13.244 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 20:53:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T20:53:12.935+0000 7fe248600700 -1 osd.9 0 waiting for initial osdmap 2024-03-16T20:53:13.244 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 20:53:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T20:53:12.964+0000 7fe23e400700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T20:53:13.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:13 smithi170 ceph-mon[35947]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:53:13.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:13 smithi170 ceph-mon[35947]: osdmap e67: 10 total, 9 up, 10 in 2024-03-16T20:53:13.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:13 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:13.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:13 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:13.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:13 smithi170 ceph-mon[35947]: from='osd.9 ' entity='osd.9' 2024-03-16T20:53:13.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:13 smithi186 ceph-mon[36391]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:53:13.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:13 smithi186 ceph-mon[36391]: osdmap e67: 10 total, 9 up, 10 in 2024-03-16T20:53:13.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:13 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:13.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:13 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:13.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:13 smithi186 ceph-mon[36391]: from='osd.9 ' entity='osd.9' 2024-03-16T20:53:13.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:13 smithi008 ceph-mon[31434]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2024-03-16T20:53:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:13 smithi008 ceph-mon[31434]: osdmap e67: 10 total, 9 up, 10 in 2024-03-16T20:53:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:13 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:13 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:13.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:13 smithi008 ceph-mon[31434]: from='osd.9 ' entity='osd.9' 2024-03-16T20:53:14.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:14 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:53:14.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:14 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:53:14.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:14 smithi170 ceph-mon[35947]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:14.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:14.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:14 smithi170 ceph-mon[35947]: osd.9 [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660] boot 2024-03-16T20:53:14.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:14 smithi170 ceph-mon[35947]: osdmap e68: 10 total, 10 up, 10 in 2024-03-16T20:53:14.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:14 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:14.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:14 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:53:14.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:14 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:53:14.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:14 smithi008 ceph-mon[31434]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:14.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:14.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:14 smithi008 ceph-mon[31434]: osd.9 [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660] boot 2024-03-16T20:53:14.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:14 smithi008 ceph-mon[31434]: osdmap e68: 10 total, 10 up, 10 in 2024-03-16T20:53:14.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:14 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:14.635 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-16T20:53:14.635 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-16T20:53:14.635 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-03-16T20:53:14.635 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-03-16T20:53:14.635 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0091307 s, 1.1 GB/s 2024-03-16T20:53:14.635 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-03-16T20:53:14.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:14 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:53:14.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:14 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:53:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:14 smithi186 ceph-mon[36391]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-03-16T20:53:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:14 smithi186 ceph-mon[36391]: osd.9 [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660] boot 2024-03-16T20:53:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:14 smithi186 ceph-mon[36391]: osdmap e68: 10 total, 10 up, 10 in 2024-03-16T20:53:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:14 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:53:15.339 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi170:vg_nvme/lv_1 2024-03-16T20:53:15.583 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T20:53:16.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:15 smithi008 ceph-mon[31434]: osdmap e69: 10 total, 10 up, 10 in 2024-03-16T20:53:16.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:15 smithi008 ceph-mon[31434]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:16.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:15 smithi170 ceph-mon[35947]: osdmap e69: 10 total, 10 up, 10 in 2024-03-16T20:53:16.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:15 smithi170 ceph-mon[35947]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:16.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:15 smithi186 ceph-mon[36391]: osdmap e69: 10 total, 10 up, 10 in 2024-03-16T20:53:16.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:15 smithi186 ceph-mon[36391]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:17.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.213+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3036794666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c34103bb0 msgr2=0x7f9c3410a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:53:17.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.213+0000 7f9c3ba6a700 1 --2- 172.21.15.170:0/3036794666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c34103bb0 0x7f9c3410a460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00b0d0 tx=0x7f9c2c00b3e0 comp rx=0 tx=0).stop 2024-03-16T20:53:17.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.213+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3036794666 shutdown_connections 2024-03-16T20:53:17.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.214+0000 7f9c3ba6a700 1 --2- 172.21.15.170:0/3036794666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c34102010 0x7f9c34102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:17.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.214+0000 7f9c3ba6a700 1 --2- 172.21.15.170:0/3036794666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c34103bb0 0x7f9c3410a460 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:17.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.214+0000 7f9c3ba6a700 1 --2- 172.21.15.170:0/3036794666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c34103210 0x7f9c34103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:17.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.214+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3036794666 >> 172.21.15.170:0/3036794666 conn(0x7f9c340fd5f0 msgr2=0x7f9c340ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:53:17.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.214+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3036794666 shutdown_connections 2024-03-16T20:53:17.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.214+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3036794666 wait complete. 2024-03-16T20:53:17.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.214+0000 7f9c3ba6a700 1 Processor -- start 2024-03-16T20:53:17.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.214+0000 7f9c3ba6a700 1 -- start start 2024-03-16T20:53:17.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c3ba6a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c34102010 0x7f9c341981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:53:17.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c3ba6a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c34103210 0x7f9c34198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:53:17.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c3ba6a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c34103bb0 0x7f9c3419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:53:17.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c3ba6a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3419fd60 con 0x7f9c34102010 2024-03-16T20:53:17.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c3ba6a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3419fea0 con 0x7f9c34103210 2024-03-16T20:53:17.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c3ba6a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c341a0030 con 0x7f9c34103bb0 2024-03-16T20:53:17.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c39005700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c34103210 0x7f9c34198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:53:17.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c39005700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c34103210 0x7f9c34198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:34084/0 (socket says 172.21.15.170:34084) 2024-03-16T20:53:17.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c39005700 1 -- 172.21.15.170:0/3814515838 learned_addr learned my addr 172.21.15.170:0/3814515838 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-03-16T20:53:17.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c3a007700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c34103bb0 0x7f9c3419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c39005700 1 -- 172.21.15.170:0/3814515838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c34103bb0 msgr2=0x7f9c3419f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c39005700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c34103bb0 0x7f9c3419f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c39005700 1 -- 172.21.15.170:0/3814515838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c34102010 msgr2=0x7f9c341981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c39005700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c34102010 0x7f9c341981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c39005700 1 -- 172.21.15.170:0/3814515838 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c009d00 con 0x7f9c34103210 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c39005700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c34103210 0x7f9c34198710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000d950 tx=0x7f9c3000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c2affd700 1 -- 172.21.15.170:0/3814515838 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30009940 con 0x7f9c34103210 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c2affd700 1 -- 172.21.15.170:0/3814515838 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9c30010460 con 0x7f9c34103210 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3814515838 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c341a0310 con 0x7f9c34103210 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c2affd700 1 -- 172.21.15.170:0/3814515838 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3000f690 con 0x7f9c34103210 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.215+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3814515838 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c341a0890 con 0x7f9c34103210 2024-03-16T20:53:17.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.216+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3814515838 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c34109370 con 0x7f9c34103210 2024-03-16T20:53:17.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.217+0000 7f9c2affd700 1 -- 172.21.15.170:0/3814515838 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f9c300109f0 con 0x7f9c34103210 2024-03-16T20:53:17.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.218+0000 7f9c2affd700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9c200a1ac0 0x7f9c200a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:53:17.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.218+0000 7f9c2affd700 1 -- 172.21.15.170:0/3814515838 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f9c300cca50 con 0x7f9c34103210 2024-03-16T20:53:17.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.218+0000 7f9c39806700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9c200a1ac0 0x7f9c200a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:53:17.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.220+0000 7f9c39806700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9c200a1ac0 0x7f9c200a3f80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c34103070 tx=0x7f9c24006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:53:17.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.222+0000 7f9c2affd700 1 -- 172.21.15.170:0/3814515838 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9c30096460 con 0x7f9c34103210 2024-03-16T20:53:17.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:17.426+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3814515838 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c3402da90 con 0x7f9c200a1ac0 2024-03-16T20:53:18.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:18.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi008 2024-03-16T20:53:18.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:53:18.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:53:18.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:53:18.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:18.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi008 to 4273M 2024-03-16T20:53:18.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:18.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:18.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:18.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:18.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:18.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi008 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi008 to 4273M 2024-03-16T20:53:18.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:18.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:18.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:18.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:18.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:18.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi008 2024-03-16T20:53:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:53:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:53:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:53:18.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:18.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:18.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi008 to 4273M 2024-03-16T20:53:18.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:18.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:18.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:18.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:18.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:18.895 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:18.895 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:20 smithi008 ceph-mon[31434]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:20 smithi008 ceph-mon[31434]: from='client.? 172.21.15.170:0/3355471908' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b004246-9f25-40a6-b58b-7dec13df8703"}]: dispatch 2024-03-16T20:53:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:20 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b004246-9f25-40a6-b58b-7dec13df8703"}]: dispatch 2024-03-16T20:53:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:20 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b004246-9f25-40a6-b58b-7dec13df8703"}]': finished 2024-03-16T20:53:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:20 smithi008 ceph-mon[31434]: osdmap e70: 11 total, 10 up, 11 in 2024-03-16T20:53:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:20 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:20.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:20 smithi170 ceph-mon[35947]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:20 smithi170 ceph-mon[35947]: from='client.? 172.21.15.170:0/3355471908' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b004246-9f25-40a6-b58b-7dec13df8703"}]: dispatch 2024-03-16T20:53:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:20 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b004246-9f25-40a6-b58b-7dec13df8703"}]: dispatch 2024-03-16T20:53:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:20 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b004246-9f25-40a6-b58b-7dec13df8703"}]': finished 2024-03-16T20:53:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:20 smithi170 ceph-mon[35947]: osdmap e70: 11 total, 10 up, 11 in 2024-03-16T20:53:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:20 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:20.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:20 smithi186 ceph-mon[36391]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:20.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:20 smithi186 ceph-mon[36391]: from='client.? 172.21.15.170:0/3355471908' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b004246-9f25-40a6-b58b-7dec13df8703"}]: dispatch 2024-03-16T20:53:20.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:20 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b004246-9f25-40a6-b58b-7dec13df8703"}]: dispatch 2024-03-16T20:53:20.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:20 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b004246-9f25-40a6-b58b-7dec13df8703"}]': finished 2024-03-16T20:53:20.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:20 smithi186 ceph-mon[36391]: osdmap e70: 11 total, 10 up, 11 in 2024-03-16T20:53:20.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:20 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:21.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:21 smithi008 ceph-mon[31434]: from='client.? 172.21.15.170:0/4082027545' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:53:21.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:21 smithi170 ceph-mon[35947]: from='client.? 172.21.15.170:0/4082027545' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:53:21.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:21 smithi186 ceph-mon[36391]: from='client.? 172.21.15.170:0/4082027545' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:53:22.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:22 smithi008 ceph-mon[31434]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:22.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:22 smithi170 ceph-mon[35947]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:22.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:22 smithi186 ceph-mon[36391]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:24.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:24 smithi008 ceph-mon[31434]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:24.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:24 smithi170 ceph-mon[35947]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:24.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:24 smithi186 ceph-mon[36391]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:26.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:26 smithi008 ceph-mon[31434]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:26.752 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:26 smithi170 ceph-mon[35947]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:26 smithi186 ceph-mon[36391]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:28.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:28 smithi008 ceph-mon[31434]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:28.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-16T20:53:28.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:28.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:28 smithi008 ceph-mon[31434]: Deploying daemon osd.10 on smithi170 2024-03-16T20:53:28.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:28 smithi170 ceph-mon[35947]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:28.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-16T20:53:28.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:28.779 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:28 smithi170 ceph-mon[35947]: Deploying daemon osd.10 on smithi170 2024-03-16T20:53:28.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:28 smithi186 ceph-mon[36391]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:28.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-16T20:53:28.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:28.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:28 smithi186 ceph-mon[36391]: Deploying daemon osd.10 on smithi170 2024-03-16T20:53:30.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:30 smithi008 ceph-mon[31434]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:30.790 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:30 smithi170 ceph-mon[35947]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:30.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:30 smithi186 ceph-mon[36391]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:32.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:32 smithi170 ceph-mon[35947]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:32.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:32 smithi008 ceph-mon[31434]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:32.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:32 smithi186 ceph-mon[36391]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:34.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:34 smithi170 ceph-mon[35947]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:34.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:34 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:34.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:34 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:34.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:34 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:34.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:34 smithi186 ceph-mon[36391]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:34.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:34 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:34.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:34 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:34.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:34 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:34.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:34 smithi008 ceph-mon[31434]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:34.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:34 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:34.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:34 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:34.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:34 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:36.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:36 smithi170 ceph-mon[35947]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:36.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:36 smithi186 ceph-mon[36391]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:36.993 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:36 smithi008 ceph-mon[31434]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:37.273 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 10 on host 'smithi170' 2024-03-16T20:53:37.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.269+0000 7f9c2affd700 1 -- 172.21.15.170:0/3814515838 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f9c3402da90 con 0x7f9c200a1ac0 2024-03-16T20:53:37.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.271+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3814515838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9c200a1ac0 msgr2=0x7f9c200a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:53:37.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.271+0000 7f9c3ba6a700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9c200a1ac0 0x7f9c200a3f80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c34103070 tx=0x7f9c24006d20 comp rx=0 tx=0).stop 2024-03-16T20:53:37.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.271+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3814515838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c34103210 msgr2=0x7f9c34198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:53:37.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.271+0000 7f9c3ba6a700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c34103210 0x7f9c34198710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000d950 tx=0x7f9c3000dc60 comp rx=0 tx=0).stop 2024-03-16T20:53:37.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.271+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3814515838 shutdown_connections 2024-03-16T20:53:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.271+0000 7f9c3ba6a700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9c200a1ac0 0x7f9c200a3f80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.271+0000 7f9c3ba6a700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c34102010 0x7f9c341981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.271+0000 7f9c3ba6a700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c34103bb0 0x7f9c3419f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.271+0000 7f9c3ba6a700 1 --2- 172.21.15.170:0/3814515838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c34103210 0x7f9c34198710 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.271+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3814515838 >> 172.21.15.170:0/3814515838 conn(0x7f9c340fd5f0 msgr2=0x7f9c341064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:53:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.272+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3814515838 shutdown_connections 2024-03-16T20:53:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-03-16T20:53:37.272+0000 7f9c3ba6a700 1 -- 172.21.15.170:0/3814515838 wait complete. 2024-03-16T20:53:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:37 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:37 smithi170 ceph-mon[35947]: from='osd.10 [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T20:53:37.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:37 smithi170 ceph-mon[35947]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T20:53:37.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:37.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:37.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:37.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:37 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:37 smithi186 ceph-mon[36391]: from='osd.10 [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T20:53:37.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:37 smithi186 ceph-mon[36391]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T20:53:37.973 DEBUG:teuthology.orchestra.run.smithi170:osd.10> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.10.service 2024-03-16T20:53:37.975 INFO:tasks.cephadm:Deploying osd.11 on smithi186 with /dev/vg_nvme/lv_1... 2024-03-16T20:53:37.975 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-16T20:53:37.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:37.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:37.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:53:37.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:37 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:37.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:37 smithi008 ceph-mon[31434]: from='osd.10 [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T20:53:37.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:37 smithi008 ceph-mon[31434]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T20:53:38.227 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:53:38.838 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:38 smithi170 ceph-mon[35947]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:38.838 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:38 smithi170 ceph-mon[35947]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-16T20:53:38.838 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:38 smithi170 ceph-mon[35947]: from='osd.10 [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:53:38.838 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:38 smithi170 ceph-mon[35947]: osdmap e71: 11 total, 10 up, 11 in 2024-03-16T20:53:38.838 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:38 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:38.838 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:38 smithi170 ceph-mon[35947]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:53:38.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:38 smithi186 ceph-mon[36391]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:38.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:38 smithi186 ceph-mon[36391]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-16T20:53:38.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:38 smithi186 ceph-mon[36391]: from='osd.10 [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:53:38.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:38 smithi186 ceph-mon[36391]: osdmap e71: 11 total, 10 up, 11 in 2024-03-16T20:53:38.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:38 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:38.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:38 smithi186 ceph-mon[36391]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:53:38.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:38 smithi008 ceph-mon[31434]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:38.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:38 smithi008 ceph-mon[31434]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-16T20:53:38.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:38 smithi008 ceph-mon[31434]: from='osd.10 [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:53:38.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:38 smithi008 ceph-mon[31434]: osdmap e71: 11 total, 10 up, 11 in 2024-03-16T20:53:38.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:38.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:38 smithi008 ceph-mon[31434]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-03-16T20:53:39.367 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 20:53:39 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T20:53:39.241+0000 7f45a6897700 -1 osd.10 0 waiting for initial osdmap 2024-03-16T20:53:39.367 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 20:53:39 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T20:53:39.252+0000 7f45a268a700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T20:53:40.347 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-16T20:53:40.347 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-16T20:53:40.347 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-03-16T20:53:40.347 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-03-16T20:53:40.347 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115019 s, 912 MB/s 2024-03-16T20:53:40.347 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-03-16T20:53:40.479 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:40 smithi170 ceph-mon[35947]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:40.479 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:40 smithi170 ceph-mon[35947]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:53:40.479 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:40 smithi170 ceph-mon[35947]: osdmap e72: 11 total, 10 up, 11 in 2024-03-16T20:53:40.479 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:40 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:40.480 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:40 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:40.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:40 smithi186 ceph-mon[36391]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:40.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:40 smithi186 ceph-mon[36391]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:53:40.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:40 smithi186 ceph-mon[36391]: osdmap e72: 11 total, 10 up, 11 in 2024-03-16T20:53:40.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:40 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:40.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:40 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:40.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:40 smithi008 ceph-mon[31434]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T20:53:40.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:40 smithi008 ceph-mon[31434]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-03-16T20:53:40.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:40 smithi008 ceph-mon[31434]: osdmap e72: 11 total, 10 up, 11 in 2024-03-16T20:53:40.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:40 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:40.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:40 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:41.092 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_1 2024-03-16T20:53:41.343 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:53:41.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:53:41.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: osd.10 [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152] boot 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: osdmap e73: 11 total, 11 up, 11 in 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi170 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:41.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:41 smithi186 ceph-mon[36391]: osdmap e74: 11 total, 11 up, 11 in 2024-03-16T20:53:41.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:53:41.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:53:41.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: osd.10 [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152] boot 2024-03-16T20:53:41.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: osdmap e73: 11 total, 11 up, 11 in 2024-03-16T20:53:41.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:41.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi170 2024-03-16T20:53:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:41 smithi170 ceph-mon[35947]: osdmap e74: 11 total, 11 up, 11 in 2024-03-16T20:53:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:53:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:53:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: osd.10 [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152] boot 2024-03-16T20:53:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: osdmap e73: 11 total, 11 up, 11 in 2024-03-16T20:53:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:53:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi170 2024-03-16T20:53:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:53:41.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:41.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:53:41.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:53:41.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:41 smithi008 ceph-mon[31434]: osdmap e74: 11 total, 11 up, 11 in 2024-03-16T20:53:42.540 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:42 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi170 to 4270M 2024-03-16T20:53:42.541 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:42 smithi186 ceph-mon[36391]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:42.541 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:42 smithi186 ceph-mon[36391]: osdmap e75: 11 total, 11 up, 11 in 2024-03-16T20:53:42.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:42 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi170 to 4270M 2024-03-16T20:53:42.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:42 smithi170 ceph-mon[35947]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:42.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:42 smithi170 ceph-mon[35947]: osdmap e75: 11 total, 11 up, 11 in 2024-03-16T20:53:42.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:42 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi170 to 4270M 2024-03-16T20:53:42.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:42 smithi008 ceph-mon[31434]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:42.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:42 smithi008 ceph-mon[31434]: osdmap e75: 11 total, 11 up, 11 in 2024-03-16T20:53:43.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.060+0000 7f702d492700 1 -- 172.21.15.186:0/3645801485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7028102b20 msgr2=0x7f70281093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:53:43.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.060+0000 7f702d492700 1 --2- 172.21.15.186:0/3645801485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7028102b20 0x7f70281093d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f702000b0a0 tx=0x7f702000b3b0 comp rx=0 tx=0).stop 2024-03-16T20:53:43.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.060+0000 7f702d492700 1 -- 172.21.15.186:0/3645801485 shutdown_connections 2024-03-16T20:53:43.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.060+0000 7f702d492700 1 --2- 172.21.15.186:0/3645801485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7028100f80 0x7f70281013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:43.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.060+0000 7f702d492700 1 --2- 172.21.15.186:0/3645801485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7028102b20 0x7f70281093d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:43.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.060+0000 7f702d492700 1 --2- 172.21.15.186:0/3645801485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7028102180 0x7f70281025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:43.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.060+0000 7f702d492700 1 -- 172.21.15.186:0/3645801485 >> 172.21.15.186:0/3645801485 conn(0x7f70280fc540 msgr2=0x7f70280fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:53:43.066 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.060+0000 7f702d492700 1 -- 172.21.15.186:0/3645801485 shutdown_connections 2024-03-16T20:53:43.066 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.060+0000 7f702d492700 1 -- 172.21.15.186:0/3645801485 wait complete. 2024-03-16T20:53:43.067 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.061+0000 7f702d492700 1 Processor -- start 2024-03-16T20:53:43.067 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.061+0000 7f702d492700 1 -- start start 2024-03-16T20:53:43.067 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.061+0000 7f702d492700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7028100f80 0x7f702806b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:53:43.067 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.061+0000 7f702d492700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7028102180 0x7f702819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.061+0000 7f702d492700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7028102b20 0x7f702819f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.061+0000 7f702d492700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702819fd20 con 0x7f7028102b20 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.061+0000 7f702d492700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702819fe90 con 0x7f7028100f80 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.061+0000 7f702d492700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70281a0050 con 0x7f7028102180 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.061+0000 7f70267fc700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7028102180 0x7f702819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f7026ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7028100f80 0x7f702806b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f70267fc700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7028102180 0x7f702819cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:48704/0 (socket says 172.21.15.186:48704) 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f70267fc700 1 -- 172.21.15.186:0/1383266498 learned_addr learned my addr 172.21.15.186:0/1383266498 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f70267fc700 1 -- 172.21.15.186:0/1383266498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7028100f80 msgr2=0x7f702806b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f70267fc700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7028100f80 0x7f702806b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f70267fc700 1 -- 172.21.15.186:0/1383266498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7028102b20 msgr2=0x7f702819f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f70267fc700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7028102b20 0x7f702819f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f70267fc700 1 -- 172.21.15.186:0/1383266498 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7020009d00 con 0x7f7028102180 2024-03-16T20:53:43.068 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f70267fc700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7028102180 0x7f702819cf40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f701c00c920 tx=0x7f701c00cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:53:43.069 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f700ffff700 1 -- 172.21.15.186:0/1383266498 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c007b00 con 0x7f7028102180 2024-03-16T20:53:43.069 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f702d492700 1 -- 172.21.15.186:0/1383266498 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70281a0330 con 0x7f7028102180 2024-03-16T20:53:43.069 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f700ffff700 1 -- 172.21.15.186:0/1383266498 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f701c00ce70 con 0x7f7028102180 2024-03-16T20:53:43.069 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f700ffff700 1 -- 172.21.15.186:0/1383266498 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c005610 con 0x7f7028102180 2024-03-16T20:53:43.069 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.062+0000 7f702d492700 1 -- 172.21.15.186:0/1383266498 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70281a08b0 con 0x7f7028102180 2024-03-16T20:53:43.069 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.063+0000 7f702d492700 1 -- 172.21.15.186:0/1383266498 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70281082e0 con 0x7f7028102180 2024-03-16T20:53:43.070 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.064+0000 7f700ffff700 1 -- 172.21.15.186:0/1383266498 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f701c004750 con 0x7f7028102180 2024-03-16T20:53:43.070 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.065+0000 7f700ffff700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f70100a1ac0 0x7f70100a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:53:43.070 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.065+0000 7f700ffff700 1 -- 172.21.15.186:0/1383266498 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f701c0ccd40 con 0x7f7028102180 2024-03-16T20:53:43.070 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.065+0000 7f7026ffd700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f70100a1ac0 0x7f70100a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:53:43.070 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.067+0000 7f7026ffd700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f70100a1ac0 0x7f70100a3f80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7028101fe0 tx=0x7f7018009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:53:43.072 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.069+0000 7f700ffff700 1 -- 172.21.15.186:0/1383266498 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f701c096580 con 0x7f7028102180 2024-03-16T20:53:43.278 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:53:43.274+0000 7f702d492700 1 -- 172.21.15.186:0/1383266498 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f702802daa0 con 0x7f70100a1ac0 2024-03-16T20:53:44.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:44 smithi170 ceph-mon[35947]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:44.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:44 smithi170 ceph-mon[35947]: osdmap e76: 11 total, 11 up, 11 in 2024-03-16T20:53:44.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:44 smithi170 ceph-mon[35947]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:53:44.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:53:44.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:53:44.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:44.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:44 smithi186 ceph-mon[36391]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:44.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:44 smithi186 ceph-mon[36391]: osdmap e76: 11 total, 11 up, 11 in 2024-03-16T20:53:44.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:44 smithi186 ceph-mon[36391]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:53:44.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:53:44.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:53:44.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:44 smithi008 ceph-mon[31434]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:44 smithi008 ceph-mon[31434]: osdmap e76: 11 total, 11 up, 11 in 2024-03-16T20:53:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:44 smithi008 ceph-mon[31434]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:53:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T20:53:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T20:53:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:45.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:45 smithi170 ceph-mon[35947]: osdmap e77: 11 total, 11 up, 11 in 2024-03-16T20:53:45.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:45 smithi186 ceph-mon[36391]: osdmap e77: 11 total, 11 up, 11 in 2024-03-16T20:53:45.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:45 smithi008 ceph-mon[31434]: osdmap e77: 11 total, 11 up, 11 in 2024-03-16T20:53:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:46 smithi170 ceph-mon[35947]: pgmap v268: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-16T20:53:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:46 smithi170 ceph-mon[35947]: from='client.? 172.21.15.186:0/2096369902' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d7c8c33-46e9-4e59-baef-f28b12a298b5"}]: dispatch 2024-03-16T20:53:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:46 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d7c8c33-46e9-4e59-baef-f28b12a298b5"}]: dispatch 2024-03-16T20:53:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:46 smithi170 ceph-mon[35947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d7c8c33-46e9-4e59-baef-f28b12a298b5"}]': finished 2024-03-16T20:53:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:46 smithi170 ceph-mon[35947]: osdmap e78: 12 total, 11 up, 12 in 2024-03-16T20:53:46.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:46 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:53:46.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:46 smithi186 ceph-mon[36391]: pgmap v268: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-16T20:53:46.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:46 smithi186 ceph-mon[36391]: from='client.? 172.21.15.186:0/2096369902' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d7c8c33-46e9-4e59-baef-f28b12a298b5"}]: dispatch 2024-03-16T20:53:46.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:46 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d7c8c33-46e9-4e59-baef-f28b12a298b5"}]: dispatch 2024-03-16T20:53:46.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:46 smithi186 ceph-mon[36391]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d7c8c33-46e9-4e59-baef-f28b12a298b5"}]': finished 2024-03-16T20:53:46.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:46 smithi186 ceph-mon[36391]: osdmap e78: 12 total, 11 up, 12 in 2024-03-16T20:53:46.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:46 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:53:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:46 smithi008 ceph-mon[31434]: pgmap v268: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-16T20:53:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:46 smithi008 ceph-mon[31434]: from='client.? 172.21.15.186:0/2096369902' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d7c8c33-46e9-4e59-baef-f28b12a298b5"}]: dispatch 2024-03-16T20:53:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:46 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d7c8c33-46e9-4e59-baef-f28b12a298b5"}]: dispatch 2024-03-16T20:53:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:46 smithi008 ceph-mon[31434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d7c8c33-46e9-4e59-baef-f28b12a298b5"}]': finished 2024-03-16T20:53:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:46 smithi008 ceph-mon[31434]: osdmap e78: 12 total, 11 up, 12 in 2024-03-16T20:53:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:46 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:53:47.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:47 smithi170 ceph-mon[35947]: from='client.? 172.21.15.186:0/3523038604' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:53:47.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:47 smithi186 ceph-mon[36391]: from='client.? 172.21.15.186:0/3523038604' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:53:47.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:47 smithi008 ceph-mon[31434]: from='client.? 172.21.15.186:0/3523038604' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T20:53:48.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:48 smithi170 ceph-mon[35947]: pgmap v270: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-03-16T20:53:48.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:48 smithi186 ceph-mon[36391]: pgmap v270: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-03-16T20:53:48.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:48 smithi008 ceph-mon[31434]: pgmap v270: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-03-16T20:53:50.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:50 smithi186 ceph-mon[36391]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T20:53:50.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:50 smithi170 ceph-mon[35947]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T20:53:50.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:50 smithi008 ceph-mon[31434]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T20:53:52.605 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:52 smithi186 ceph-mon[36391]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-03-16T20:53:52.616 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:52 smithi170 ceph-mon[35947]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-03-16T20:53:52.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:52 smithi008 ceph-mon[31434]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-03-16T20:53:54.591 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:54 smithi186 ceph-mon[36391]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:54.591 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:54 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-16T20:53:54.591 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:54 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:54.591 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:54 smithi186 ceph-mon[36391]: Deploying daemon osd.11 on smithi186 2024-03-16T20:53:54.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:54 smithi170 ceph-mon[35947]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:54.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:54 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-16T20:53:54.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:54 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:54.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:54 smithi170 ceph-mon[35947]: Deploying daemon osd.11 on smithi186 2024-03-16T20:53:54.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:54 smithi008 ceph-mon[31434]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:54.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:54 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-16T20:53:54.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:54 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:53:54.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:54 smithi008 ceph-mon[31434]: Deploying daemon osd.11 on smithi186 2024-03-16T20:53:56.587 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:56 smithi186 ceph-mon[36391]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:56.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:56 smithi170 ceph-mon[35947]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:56.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:56 smithi008 ceph-mon[31434]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:58.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:53:57 smithi186 ceph-mon[36391]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:58.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:53:57 smithi170 ceph-mon[35947]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:53:58.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:53:57 smithi008 ceph-mon[31434]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:00 smithi170 ceph-mon[35947]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:00 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:00 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:00 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:54:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:00 smithi186 ceph-mon[36391]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:00 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:00 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:00 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:54:00.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:00 smithi008 ceph-mon[31434]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:00.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:00 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:00.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:00 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:00.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:00 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:54:02.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:02 smithi170 ceph-mon[35947]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:02.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:02 smithi186 ceph-mon[36391]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:02.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:02 smithi008 ceph-mon[31434]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:03.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.411+0000 7f700ffff700 1 -- 172.21.15.186:0/1383266498 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f702802daa0 con 0x7f70100a1ac0 2024-03-16T20:54:03.417 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 11 on host 'smithi186' 2024-03-16T20:54:03.420 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 -- 172.21.15.186:0/1383266498 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f70100a1ac0 msgr2=0x7f70100a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:03.420 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f70100a1ac0 0x7f70100a3f80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7028101fe0 tx=0x7f7018009190 comp rx=0 tx=0).stop 2024-03-16T20:54:03.420 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 -- 172.21.15.186:0/1383266498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7028102180 msgr2=0x7f702819cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:03.420 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7028102180 0x7f702819cf40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f701c00c920 tx=0x7f701c00cc30 comp rx=0 tx=0).stop 2024-03-16T20:54:03.420 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 -- 172.21.15.186:0/1383266498 shutdown_connections 2024-03-16T20:54:03.420 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f70100a1ac0 0x7f70100a3f80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:03.420 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7028102b20 0x7f702819f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:03.420 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7028100f80 0x7f702806b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:03.421 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 --2- 172.21.15.186:0/1383266498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7028102180 0x7f702819cf40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:03.421 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 -- 172.21.15.186:0/1383266498 >> 172.21.15.186:0/1383266498 conn(0x7f70280fc540 msgr2=0x7f7028105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:03.421 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 -- 172.21.15.186:0/1383266498 shutdown_connections 2024-03-16T20:54:03.421 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:03.415+0000 7f702d492700 1 -- 172.21.15.186:0/1383266498 wait complete. 2024-03-16T20:54:03.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:03.646 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:54:03.646 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.646 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:54:03.646 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.646 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.646 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:03 smithi186 ceph-mon[36391]: from='osd.11 [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-16T20:54:03.646 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:03 smithi186 ceph-mon[36391]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-16T20:54:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:54:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:54:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:03 smithi170 ceph-mon[35947]: from='osd.11 [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-16T20:54:03.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:03 smithi170 ceph-mon[35947]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-16T20:54:03.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:03.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:54:03.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:54:03.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:03 smithi008 ceph-mon[31434]: from='osd.11 [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-16T20:54:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:03 smithi008 ceph-mon[31434]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-16T20:54:04.049 DEBUG:teuthology.orchestra.run.smithi186:osd.11> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.11.service 2024-03-16T20:54:04.051 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-03-16T20:54:04.052 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd stat -f json 2024-03-16T20:54:04.538 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:54:04.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:04 smithi186 ceph-mon[36391]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:04.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:04 smithi186 ceph-mon[36391]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-16T20:54:04.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:04 smithi186 ceph-mon[36391]: osdmap e79: 12 total, 11 up, 12 in 2024-03-16T20:54:04.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:04.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:04 smithi186 ceph-mon[36391]: from='osd.11 [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:54:04.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:04 smithi186 ceph-mon[36391]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:54:04.870 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:04 smithi170 ceph-mon[35947]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:04.870 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:04 smithi170 ceph-mon[35947]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-16T20:54:04.870 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:04 smithi170 ceph-mon[35947]: osdmap e79: 12 total, 11 up, 12 in 2024-03-16T20:54:04.870 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:04.870 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:04 smithi170 ceph-mon[35947]: from='osd.11 [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:54:04.870 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:04 smithi170 ceph-mon[35947]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:54:04.880 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:04 smithi008 ceph-mon[31434]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:04.881 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:04 smithi008 ceph-mon[31434]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-16T20:54:04.881 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:04 smithi008 ceph-mon[31434]: osdmap e79: 12 total, 11 up, 12 in 2024-03-16T20:54:04.881 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:04.881 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:04 smithi008 ceph-mon[31434]: from='osd.11 [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:54:04.881 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:04 smithi008 ceph-mon[31434]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-03-16T20:54:05.531 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 20:54:05 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T20:54:05.399+0000 7fc8fc134700 -1 osd.11 0 waiting for initial osdmap 2024-03-16T20:54:05.531 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 20:54:05 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T20:54:05.412+0000 7fc8f7f27700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T20:54:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:06 smithi186 ceph-mon[36391]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:06 smithi186 ceph-mon[36391]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:54:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:06 smithi186 ceph-mon[36391]: osdmap e80: 12 total, 11 up, 12 in 2024-03-16T20:54:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:06 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:06 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:06.662 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:06 smithi008 ceph-mon[31434]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:06.662 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:06 smithi008 ceph-mon[31434]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:54:06.662 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:06 smithi008 ceph-mon[31434]: osdmap e80: 12 total, 11 up, 12 in 2024-03-16T20:54:06.662 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:06 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:06.662 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:06 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.829+0000 7fe40d000700 1 -- 172.21.15.8:0/944075558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4080749e0 msgr2=0x7fe408074e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.829+0000 7fe40d000700 1 --2- 172.21.15.8:0/944075558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4080749e0 0x7fe408074e60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009990 tx=0x7fe3f0009ca0 comp rx=0 tx=0).stop 2024-03-16T20:54:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.829+0000 7fe40d000700 1 -- 172.21.15.8:0/944075558 shutdown_connections 2024-03-16T20:54:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.829+0000 7fe40d000700 1 --2- 172.21.15.8:0/944075558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe408075fb0 0x7fe408074410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.829+0000 7fe40d000700 1 --2- 172.21.15.8:0/944075558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe408109f40 0x7fe40810c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.829+0000 7fe40d000700 1 --2- 172.21.15.8:0/944075558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4080749e0 0x7fe408074e60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.829+0000 7fe40d000700 1 -- 172.21.15.8:0/944075558 >> 172.21.15.8:0/944075558 conn(0x7fe4080fd600 msgr2=0x7fe4080ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.830+0000 7fe40d000700 1 -- 172.21.15.8:0/944075558 shutdown_connections 2024-03-16T20:54:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.830+0000 7fe40d000700 1 -- 172.21.15.8:0/944075558 wait complete. 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.831+0000 7fe40d000700 1 Processor -- start 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.831+0000 7fe40d000700 1 -- start start 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.831+0000 7fe40d000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4080749e0 0x7fe40819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.831+0000 7fe40d000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe408075fb0 0x7fe40819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.831+0000 7fe40d000700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe408109f40 0x7fe4081a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.831+0000 7fe40d000700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4081a1e40 con 0x7fe4080749e0 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.831+0000 7fe40d000700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4081a1f80 con 0x7fe408109f40 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.831+0000 7fe40d000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4081a2110 con 0x7fe408075fb0 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe3ffe00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe408075fb0 0x7fe40819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe3ffe00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe408075fb0 0x7fe40819a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33286/0 (socket says 172.21.15.8:33286) 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe3ffe00700 1 -- 172.21.15.8:0/1042111128 learned_addr learned my addr 172.21.15.8:0/1042111128 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:06.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe405e00700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4080749e0 0x7fe40819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe406800700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe408109f40 0x7fe4081a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe3ffe00700 1 -- 172.21.15.8:0/1042111128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe408109f40 msgr2=0x7fe4081a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe3ffe00700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe408109f40 0x7fe4081a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe3ffe00700 1 -- 172.21.15.8:0/1042111128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4080749e0 msgr2=0x7fe40819a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe3ffe00700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4080749e0 0x7fe40819a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe3ffe00700 1 -- 172.21.15.8:0/1042111128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400009c40 con 0x7fe408075fb0 2024-03-16T20:54:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe405e00700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4080749e0 0x7fe40819a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:54:06.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.832+0000 7fe3ffe00700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe408075fb0 0x7fe40819a7f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0000c00 tx=0x7fe3f000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:06.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.833+0000 7fe3fea00700 1 -- 172.21.15.8:0/1042111128 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f001d070 con 0x7fe408075fb0 2024-03-16T20:54:06.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.833+0000 7fe3fea00700 1 -- 172.21.15.8:0/1042111128 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe3f000b610 con 0x7fe408075fb0 2024-03-16T20:54:06.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.833+0000 7fe3fea00700 1 -- 172.21.15.8:0/1042111128 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0017650 con 0x7fe408075fb0 2024-03-16T20:54:06.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.833+0000 7fe40d000700 1 -- 172.21.15.8:0/1042111128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f00095f0 con 0x7fe408075fb0 2024-03-16T20:54:06.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.833+0000 7fe40d000700 1 -- 172.21.15.8:0/1042111128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4081a25c0 con 0x7fe408075fb0 2024-03-16T20:54:06.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.834+0000 7fe40d000700 1 -- 172.21.15.8:0/1042111128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe408068ce0 con 0x7fe408075fb0 2024-03-16T20:54:06.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.836+0000 7fe3fea00700 1 -- 172.21.15.8:0/1042111128 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fe3f0022470 con 0x7fe408075fb0 2024-03-16T20:54:06.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.837+0000 7fe3fea00700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe3ec0a1b40 0x7fe3ec0a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:06.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.837+0000 7fe3fea00700 1 -- 172.21.15.8:0/1042111128 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe3f00ce6d0 con 0x7fe408075fb0 2024-03-16T20:54:06.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.838+0000 7fe405e00700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe3ec0a1b40 0x7fe3ec0a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:06.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.838+0000 7fe405e00700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe3ec0a1b40 0x7fe3ec0a4000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009cb0 tx=0x7fe3f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:06.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:06.840+0000 7fe3fea00700 1 -- 172.21.15.8:0/1042111128 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe3f0097d70 con 0x7fe408075fb0 2024-03-16T20:54:06.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:06 smithi170 ceph-mon[35947]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-03-16T20:54:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:06 smithi170 ceph-mon[35947]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-03-16T20:54:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:06 smithi170 ceph-mon[35947]: osdmap e80: 12 total, 11 up, 12 in 2024-03-16T20:54:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:06 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:06 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:07.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.071+0000 7fe40d000700 1 -- 172.21.15.8:0/1042111128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fe40810ff80 con 0x7fe408075fb0 2024-03-16T20:54:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.072+0000 7fe3fea00700 1 -- 172.21.15.8:0/1042111128 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) v1 ==== 74+0+133 (secure 0 0 0) 0x7fe3f009b430 con 0x7fe408075fb0 2024-03-16T20:54:07.077 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:07.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.075+0000 7fe40d000700 1 -- 172.21.15.8:0/1042111128 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe3ec0a1b40 msgr2=0x7fe3ec0a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:07.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.075+0000 7fe40d000700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe3ec0a1b40 0x7fe3ec0a4000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009cb0 tx=0x7fe3f8009260 comp rx=0 tx=0).stop 2024-03-16T20:54:07.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.075+0000 7fe40d000700 1 -- 172.21.15.8:0/1042111128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe408075fb0 msgr2=0x7fe40819a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:07.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.075+0000 7fe40d000700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe408075fb0 0x7fe40819a7f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0000c00 tx=0x7fe3f000f740 comp rx=0 tx=0).stop 2024-03-16T20:54:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.076+0000 7fe40d000700 1 -- 172.21.15.8:0/1042111128 shutdown_connections 2024-03-16T20:54:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.076+0000 7fe40d000700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe3ec0a1b40 0x7fe3ec0a4000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.076+0000 7fe40d000700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4080749e0 0x7fe40819a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.076+0000 7fe40d000700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe408109f40 0x7fe4081a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.076+0000 7fe40d000700 1 --2- 172.21.15.8:0/1042111128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe408075fb0 0x7fe40819a7f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.076+0000 7fe40d000700 1 -- 172.21.15.8:0/1042111128 >> 172.21.15.8:0/1042111128 conn(0x7fe4080fd600 msgr2=0x7fe408105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.076+0000 7fe40d000700 1 -- 172.21.15.8:0/1042111128 shutdown_connections 2024-03-16T20:54:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:07.076+0000 7fe40d000700 1 -- 172.21.15.8:0/1042111128 wait complete. 2024-03-16T20:54:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: purged_snaps scrub starts 2024-03-16T20:54:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: purged_snaps scrub ok 2024-03-16T20:54:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: osd.11 [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423] boot 2024-03-16T20:54:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: osdmap e81: 12 total, 12 up, 12 in 2024-03-16T20:54:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1042111128' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-16T20:54:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:07.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:07.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:07.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:54:07.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:07 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:07.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: purged_snaps scrub starts 2024-03-16T20:54:07.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: purged_snaps scrub ok 2024-03-16T20:54:07.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: osd.11 [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423] boot 2024-03-16T20:54:07.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: osdmap e81: 12 total, 12 up, 12 in 2024-03-16T20:54:07.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:07.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:07.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1042111128' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-16T20:54:07.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:07.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:07.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:07.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:54:07.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:07 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:07.886 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1710622446,"num_in_osds":12,"osd_in_since":1710622426,"num_remapped_pgs":0} 2024-03-16T20:54:07.886 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd dump --format=json 2024-03-16T20:54:07.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: purged_snaps scrub starts 2024-03-16T20:54:07.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: purged_snaps scrub ok 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: osd.11 [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423] boot 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: osdmap e81: 12 total, 12 up, 12 in 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1042111128' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:54:07.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:07 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:08.351 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:54:08.685 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:08 smithi008 ceph-mon[31434]: Detected new or changed devices on smithi186 2024-03-16T20:54:08.685 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:08 smithi008 ceph-mon[31434]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:08.685 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:08 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi186 to 4270M 2024-03-16T20:54:08.685 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:08 smithi008 ceph-mon[31434]: osdmap e82: 12 total, 12 up, 12 in 2024-03-16T20:54:08.795 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:08 smithi186 ceph-mon[36391]: Detected new or changed devices on smithi186 2024-03-16T20:54:08.795 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:08 smithi186 ceph-mon[36391]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:08.795 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:08 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi186 to 4270M 2024-03-16T20:54:08.795 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:08 smithi186 ceph-mon[36391]: osdmap e82: 12 total, 12 up, 12 in 2024-03-16T20:54:08.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:08 smithi170 ceph-mon[35947]: Detected new or changed devices on smithi186 2024-03-16T20:54:08.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:08 smithi170 ceph-mon[35947]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:08.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:08 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi186 to 4270M 2024-03-16T20:54:08.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:08 smithi170 ceph-mon[35947]: osdmap e82: 12 total, 12 up, 12 in 2024-03-16T20:54:10.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.456+0000 7f8411200700 1 -- 172.21.15.8:0/362057416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840c074b30 msgr2=0x7f840c112c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:10.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.456+0000 7f8411200700 1 --2- 172.21.15.8:0/362057416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840c074b30 0x7f840c112c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f83f40098f0 tx=0x7f83f4009c00 comp rx=0 tx=0).stop 2024-03-16T20:54:10.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.456+0000 7f8411200700 1 -- 172.21.15.8:0/362057416 shutdown_connections 2024-03-16T20:54:10.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.456+0000 7f8411200700 1 --2- 172.21.15.8:0/362057416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f840c1131b0 0x7f840c1155a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:10.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.456+0000 7f8411200700 1 --2- 172.21.15.8:0/362057416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f840c074210 0x7f840c0745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:10.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.456+0000 7f8411200700 1 --2- 172.21.15.8:0/362057416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840c074b30 0x7f840c112c70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:10.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.456+0000 7f8411200700 1 -- 172.21.15.8:0/362057416 >> 172.21.15.8:0/362057416 conn(0x7f840c079140 msgr2=0x7f840c079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:10.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.456+0000 7f8411200700 1 -- 172.21.15.8:0/362057416 shutdown_connections 2024-03-16T20:54:10.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.456+0000 7f8411200700 1 -- 172.21.15.8:0/362057416 wait complete. 2024-03-16T20:54:10.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.457+0000 7f8411200700 1 Processor -- start 2024-03-16T20:54:10.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.457+0000 7f8411200700 1 -- start start 2024-03-16T20:54:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.457+0000 7f8411200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f840c074210 0x7f840c1a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.457+0000 7f8411200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f840c074b30 0x7f840c1a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.457+0000 7f8411200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840c1131b0 0x7f840c19eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f8411200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c19f120 con 0x7f840c074210 2024-03-16T20:54:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f8411200700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c19f260 con 0x7f840c074b30 2024-03-16T20:54:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f8411200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c19f420 con 0x7f840c1131b0 2024-03-16T20:54:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f8409e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f840c074210 0x7f840c1a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f8409e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f840c074210 0x7f840c1a4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50962/0 (socket says 172.21.15.8:50962) 2024-03-16T20:54:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f840a800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840c1131b0 0x7f840c19eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f8409e00700 1 -- 172.21.15.8:0/1485531627 learned_addr learned my addr 172.21.15.8:0/1485531627 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:10.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f8403e00700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f840c074b30 0x7f840c1a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f840a800700 1 -- 172.21.15.8:0/1485531627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f840c074b30 msgr2=0x7f840c1a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f840a800700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f840c074b30 0x7f840c1a4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f840a800700 1 -- 172.21.15.8:0/1485531627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f840c074210 msgr2=0x7f840c1a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f840a800700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f840c074210 0x7f840c1a4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f840a800700 1 -- 172.21.15.8:0/1485531627 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8404009d00 con 0x7f840c1131b0 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.458+0000 7f8403e00700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f840c074b30 0x7f840c1a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.459+0000 7f840a800700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840c1131b0 0x7f840c19eac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f840400efd0 tx=0x7f840400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.459+0000 7f8402a00700 1 -- 172.21.15.8:0/1485531627 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840400e020 con 0x7f840c1131b0 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.459+0000 7f8402a00700 1 -- 172.21.15.8:0/1485531627 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f840400f040 con 0x7f840c1131b0 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.459+0000 7f8411200700 1 -- 172.21.15.8:0/1485531627 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f4009520 con 0x7f840c1131b0 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.459+0000 7f8402a00700 1 -- 172.21.15.8:0/1485531627 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040045d0 con 0x7f840c1131b0 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.459+0000 7f8411200700 1 -- 172.21.15.8:0/1485531627 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c1ab7d0 con 0x7f840c1131b0 2024-03-16T20:54:10.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.460+0000 7f8411200700 1 -- 172.21.15.8:0/1485531627 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c068ca0 con 0x7f840c1131b0 2024-03-16T20:54:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.462+0000 7f8402a00700 1 -- 172.21.15.8:0/1485531627 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f8404004730 con 0x7f840c1131b0 2024-03-16T20:54:10.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.463+0000 7f8402a00700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83f00a1b40 0x7f83f00a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.463+0000 7f8402a00700 1 -- 172.21.15.8:0/1485531627 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f84040ccc50 con 0x7f840c1131b0 2024-03-16T20:54:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.463+0000 7f8409e00700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83f00a1b40 0x7f83f00a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:10.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.464+0000 7f8409e00700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83f00a1b40 0x7f83f00a4000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f840c19fc00 tx=0x7f83fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:10.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.467+0000 7f8402a00700 1 -- 172.21.15.8:0/1485531627 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f84040962f0 con 0x7f840c1131b0 2024-03-16T20:54:10.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.694+0000 7f8411200700 1 -- 172.21.15.8:0/1485531627 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f840c1188a0 con 0x7f840c1131b0 2024-03-16T20:54:10.699 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:10 smithi008 ceph-mon[31434]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:10.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.695+0000 7f8402a00700 1 -- 172.21.15.8:0/1485531627 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18385 (secure 0 0 0) 0x7f84040999b0 con 0x7f840c1131b0 2024-03-16T20:54:10.700 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:10.701 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":82,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:54:07.407682+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:54:10.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.698+0000 7f8411200700 1 -- 172.21.15.8:0/1485531627 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83f00a1b40 msgr2=0x7f83f00a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:10.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.698+0000 7f8411200700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83f00a1b40 0x7f83f00a4000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f840c19fc00 tx=0x7f83fc009260 comp rx=0 tx=0).stop 2024-03-16T20:54:10.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.698+0000 7f8411200700 1 -- 172.21.15.8:0/1485531627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840c1131b0 msgr2=0x7f840c19eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:10.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.698+0000 7f8411200700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840c1131b0 0x7f840c19eac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f840400efd0 tx=0x7f840400c3a0 comp rx=0 tx=0).stop 2024-03-16T20:54:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.699+0000 7f8411200700 1 -- 172.21.15.8:0/1485531627 shutdown_connections 2024-03-16T20:54:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.699+0000 7f8411200700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83f00a1b40 0x7f83f00a4000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.699+0000 7f8411200700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f840c074210 0x7f840c1a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.699+0000 7f8411200700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840c1131b0 0x7f840c19eac0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.699+0000 7f8411200700 1 --2- 172.21.15.8:0/1485531627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f840c074b30 0x7f840c1a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.699+0000 7f8411200700 1 -- 172.21.15.8:0/1485531627 >> 172.21.15.8:0/1485531627 conn(0x7f840c079140 msgr2=0x7f840c111f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.699+0000 7f8411200700 1 -- 172.21.15.8:0/1485531627 shutdown_connections 2024-03-16T20:54:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:10.699+0000 7f8411200700 1 -- 172.21.15.8:0/1485531627 wait complete. 2024-03-16T20:54:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:10 smithi170 ceph-mon[35947]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:10.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:10 smithi186 ceph-mon[36391]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:11.503 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T20:54:11.503 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-16T20:54:11.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:11 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1485531627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:54:11.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:11 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1485531627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:54:11.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:11 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1485531627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:54:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:54:12.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:12 smithi008 ceph-mon[31434]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:12.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:12 smithi170 ceph-mon[35947]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:12.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:12 smithi186 ceph-mon[36391]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.077+0000 7f4327200700 1 -- 172.21.15.8:0/1981120867 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4320104de0 msgr2=0x7f4320108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.077+0000 7f4327200700 1 --2- 172.21.15.8:0/1981120867 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4320104de0 0x7f4320108e30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f430c009990 tx=0x7f430c009ca0 comp rx=0 tx=0).stop 2024-03-16T20:54:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.078+0000 7f4327200700 1 -- 172.21.15.8:0/1981120867 shutdown_connections 2024-03-16T20:54:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.078+0000 7f4327200700 1 --2- 172.21.15.8:0/1981120867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320109510 0x7f43201110e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.078+0000 7f4327200700 1 --2- 172.21.15.8:0/1981120867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4320104430 0x7f4320104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.078+0000 7f4327200700 1 --2- 172.21.15.8:0/1981120867 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4320104de0 0x7f4320108e30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.078+0000 7f4327200700 1 -- 172.21.15.8:0/1981120867 >> 172.21.15.8:0/1981120867 conn(0x7f43200ffcc0 msgr2=0x7f43201020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.078+0000 7f4327200700 1 -- 172.21.15.8:0/1981120867 shutdown_connections 2024-03-16T20:54:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.078+0000 7f4327200700 1 -- 172.21.15.8:0/1981120867 wait complete. 2024-03-16T20:54:14.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.079+0000 7f4327200700 1 Processor -- start 2024-03-16T20:54:14.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f4327200700 1 -- start start 2024-03-16T20:54:14.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f4327200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4320104430 0x7f43201a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:14.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f4327200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4320104de0 0x7f43201a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f4327200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320109510 0x7f432019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f4327200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432019ade0 con 0x7f4320109510 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f4327200700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432019af50 con 0x7f4320104430 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f4327200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432019b110 con 0x7f4320104de0 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f4325200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320109510 0x7f432019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f431f400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4320104de0 0x7f43201a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f4325200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320109510 0x7f432019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50968/0 (socket says 172.21.15.8:50968) 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f4325200700 1 -- 172.21.15.8:0/1145065553 learned_addr learned my addr 172.21.15.8:0/1145065553 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.080+0000 7f431fe00700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4320104430 0x7f43201a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.081+0000 7f4325200700 1 -- 172.21.15.8:0/1145065553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4320104de0 msgr2=0x7f43201a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.081+0000 7f4325200700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4320104de0 0x7f43201a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.081+0000 7f4325200700 1 -- 172.21.15.8:0/1145065553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4320104430 msgr2=0x7f43201a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.081+0000 7f4325200700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4320104430 0x7f43201a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.081+0000 7f4325200700 1 -- 172.21.15.8:0/1145065553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0095f0 con 0x7f4320109510 2024-03-16T20:54:14.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.081+0000 7f431fe00700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4320104430 0x7f43201a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:54:14.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.081+0000 7f4325200700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320109510 0x7f432019a630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f431800ef30 tx=0x7f431800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:14.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.081+0000 7f431cc00700 1 -- 172.21.15.8:0/1145065553 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4318018070 con 0x7f4320109510 2024-03-16T20:54:14.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.082+0000 7f4327200700 1 -- 172.21.15.8:0/1145065553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432019b390 con 0x7f4320109510 2024-03-16T20:54:14.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.082+0000 7f431cc00700 1 -- 172.21.15.8:0/1145065553 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f431800f040 con 0x7f4320109510 2024-03-16T20:54:14.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.082+0000 7f431cc00700 1 -- 172.21.15.8:0/1145065553 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800ce40 con 0x7f4320109510 2024-03-16T20:54:14.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.082+0000 7f4327200700 1 -- 172.21.15.8:0/1145065553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43201a74e0 con 0x7f4320109510 2024-03-16T20:54:14.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.083+0000 7f4327200700 1 -- 172.21.15.8:0/1145065553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4320105910 con 0x7f4320109510 2024-03-16T20:54:14.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.085+0000 7f431cc00700 1 -- 172.21.15.8:0/1145065553 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f4318003a00 con 0x7f4320109510 2024-03-16T20:54:14.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.086+0000 7f431cc00700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43040a1ac0 0x7f43040a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:14.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.087+0000 7f431cc00700 1 -- 172.21.15.8:0/1145065553 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f43180cd000 con 0x7f4320109510 2024-03-16T20:54:14.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.087+0000 7f431fe00700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43040a1ac0 0x7f43040a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:14.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.087+0000 7f431fe00700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43040a1ac0 0x7f43040a3f80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4310011490 tx=0x7f4310009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:14.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.090+0000 7f431cc00700 1 -- 172.21.15.8:0/1145065553 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f43180966a0 con 0x7f4320109510 2024-03-16T20:54:14.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.314+0000 7f4327200700 1 -- 172.21.15.8:0/1145065553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4320068ca0 con 0x7f4320109510 2024-03-16T20:54:14.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.315+0000 7f431cc00700 1 -- 172.21.15.8:0/1145065553 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4318003cb0 con 0x7f4320109510 2024-03-16T20:54:14.320 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T20:54:14.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.318+0000 7f4327200700 1 -- 172.21.15.8:0/1145065553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43040a1ac0 msgr2=0x7f43040a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:14.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.318+0000 7f4327200700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43040a1ac0 0x7f43040a3f80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4310011490 tx=0x7f4310009260 comp rx=0 tx=0).stop 2024-03-16T20:54:14.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.318+0000 7f4327200700 1 -- 172.21.15.8:0/1145065553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320109510 msgr2=0x7f432019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:14.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.318+0000 7f4327200700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320109510 0x7f432019a630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f431800ef30 tx=0x7f431800c3a0 comp rx=0 tx=0).stop 2024-03-16T20:54:14.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.318+0000 7f4327200700 1 -- 172.21.15.8:0/1145065553 shutdown_connections 2024-03-16T20:54:14.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.318+0000 7f4327200700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43040a1ac0 0x7f43040a3f80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:14.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.318+0000 7f4327200700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320109510 0x7f432019a630 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:14.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.318+0000 7f4327200700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4320104430 0x7f43201a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:14.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.318+0000 7f4327200700 1 --2- 172.21.15.8:0/1145065553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4320104de0 0x7f43201a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:14.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.318+0000 7f4327200700 1 -- 172.21.15.8:0/1145065553 >> 172.21.15.8:0/1145065553 conn(0x7f43200ffcc0 msgr2=0x7f43201006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:14.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.319+0000 7f4327200700 1 -- 172.21.15.8:0/1145065553 shutdown_connections 2024-03-16T20:54:14.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:14.319+0000 7f4327200700 1 -- 172.21.15.8:0/1145065553 wait complete. 2024-03-16T20:54:14.709 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:14 smithi008 ceph-mon[31434]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:14.709 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:14 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1145065553' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:54:14.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:14 smithi170 ceph-mon[35947]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:14 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1145065553' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:54:14.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:14 smithi186 ceph-mon[36391]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:14.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:14 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1145065553' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:54:15.110 INFO:tasks.cephadm:Adding mds.a on smithi008 2024-03-16T20:54:15.110 INFO:tasks.cephadm:Adding mds.d on smithi008 2024-03-16T20:54:15.110 INFO:tasks.cephadm:Adding mds.g on smithi008 2024-03-16T20:54:15.110 INFO:tasks.cephadm:Adding mds.j on smithi008 2024-03-16T20:54:15.110 INFO:tasks.cephadm:Adding mds.b on smithi170 2024-03-16T20:54:15.110 INFO:tasks.cephadm:Adding mds.e on smithi170 2024-03-16T20:54:15.110 INFO:tasks.cephadm:Adding mds.h on smithi170 2024-03-16T20:54:15.110 INFO:tasks.cephadm:Adding mds.k on smithi170 2024-03-16T20:54:15.110 INFO:tasks.cephadm:Adding mds.c on smithi186 2024-03-16T20:54:15.111 INFO:tasks.cephadm:Adding mds.f on smithi186 2024-03-16T20:54:15.111 INFO:tasks.cephadm:Adding mds.i on smithi186 2024-03-16T20:54:15.111 INFO:tasks.cephadm:Adding mds.l on smithi186 2024-03-16T20:54:15.111 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph orch apply mds all '12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l' 2024-03-16T20:54:15.364 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T20:54:16.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:16 smithi008 ceph-mon[31434]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:16.815 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:16 smithi186 ceph-mon[36391]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:16.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:16 smithi170 ceph-mon[35947]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:17.072 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.046+0000 7f2bd654c700 1 -- 172.21.15.186:0/3054697684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd0102070 msgr2=0x7f2bd01024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:17.072 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.046+0000 7f2bd654c700 1 --2- 172.21.15.186:0/3054697684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd0102070 0x7f2bd01024f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009990 tx=0x7f2bc4009ca0 comp rx=0 tx=0).stop 2024-03-16T20:54:17.072 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.046+0000 7f2bd654c700 1 -- 172.21.15.186:0/3054697684 shutdown_connections 2024-03-16T20:54:17.072 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.046+0000 7f2bd654c700 1 --2- 172.21.15.186:0/3054697684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd0102a30 0x7f2bd0109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:17.072 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.046+0000 7f2bd654c700 1 --2- 172.21.15.186:0/3054697684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd0100f10 0x7f2bd0101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.046+0000 7f2bd654c700 1 --2- 172.21.15.186:0/3054697684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd0102070 0x7f2bd01024f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.046+0000 7f2bd654c700 1 -- 172.21.15.186:0/3054697684 >> 172.21.15.186:0/3054697684 conn(0x7f2bd00fc4d0 msgr2=0x7f2bd00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.046+0000 7f2bd654c700 1 -- 172.21.15.186:0/3054697684 shutdown_connections 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.046+0000 7f2bd654c700 1 -- 172.21.15.186:0/3054697684 wait complete. 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.047+0000 7f2bd654c700 1 Processor -- start 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.047+0000 7f2bd654c700 1 -- start start 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.047+0000 7f2bd654c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd0100f10 0x7f2bd0198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.047+0000 7f2bd654c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd0102070 0x7f2bd0198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.047+0000 7f2bd654c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd0102a30 0x7f2bd019f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.047+0000 7f2bd654c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd019fcd0 con 0x7f2bd0102070 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.047+0000 7f2bd654c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd019fe10 con 0x7f2bd0100f10 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.047+0000 7f2bd654c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd019ffa0 con 0x7f2bd0102a30 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.047+0000 7f2bd4ae9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd0102a30 0x7f2bd019f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:17.073 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.047+0000 7f2bd4ae9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd0102a30 0x7f2bd019f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:49280/0 (socket says 172.21.15.186:49280) 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.047+0000 7f2bd4ae9700 1 -- 172.21.15.186:0/3516626110 learned_addr learned my addr 172.21.15.186:0/3516626110 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bcffff700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd0100f10 0x7f2bd0198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bd4ae9700 1 -- 172.21.15.186:0/3516626110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd0100f10 msgr2=0x7f2bd0198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bd4ae9700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd0100f10 0x7f2bd0198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bd4ae9700 1 -- 172.21.15.186:0/3516626110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd0102070 msgr2=0x7f2bd0198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bd4ae9700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd0102070 0x7f2bd0198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bd4ae9700 1 -- 172.21.15.186:0/3516626110 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc40095f0 con 0x7f2bd0102a30 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bd4ae9700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd0102a30 0x7f2bd019f700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800b9a0 tx=0x7f2bc800bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bcd7fa700 1 -- 172.21.15.186:0/3516626110 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc800c9b0 con 0x7f2bd0102a30 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bd654c700 1 -- 172.21.15.186:0/3516626110 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd01a0280 con 0x7f2bd0102a30 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bcd7fa700 1 -- 172.21.15.186:0/3516626110 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2bc800cb10 con 0x7f2bd0102a30 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bcd7fa700 1 -- 172.21.15.186:0/3516626110 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80075d0 con 0x7f2bd0102a30 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.048+0000 7f2bd654c700 1 -- 172.21.15.186:0/3516626110 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd01a0800 con 0x7f2bd0102a30 2024-03-16T20:54:17.074 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.049+0000 7f2bd654c700 1 -- 172.21.15.186:0/3516626110 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd01082c0 con 0x7f2bd0102a30 2024-03-16T20:54:17.075 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.050+0000 7f2bcd7fa700 1 -- 172.21.15.186:0/3516626110 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f2bc800cc80 con 0x7f2bd0102a30 2024-03-16T20:54:17.075 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.051+0000 7f2bcd7fa700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2bb80a1ac0 0x7f2bb80a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:17.075 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.051+0000 7f2bcd7fa700 1 -- 172.21.15.186:0/3516626110 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2bc8006e40 con 0x7f2bd0102a30 2024-03-16T20:54:17.075 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.051+0000 7f2bcffff700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2bb80a1ac0 0x7f2bb80a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:17.075 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.052+0000 7f2bcffff700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2bb80a1ac0 0x7f2bb80a3f80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0006fd0 tx=0x7f2bc0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:17.075 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.054+0000 7f2bcd7fa700 1 -- 172.21.15.186:0/3516626110 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2bc8096290 con 0x7f2bd0102a30 2024-03-16T20:54:17.266 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.262+0000 7f2bd654c700 1 -- 172.21.15.186:0/3516626110 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bd002db30 con 0x7f2bb80a1ac0 2024-03-16T20:54:17.283 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.279+0000 7f2bcd7fa700 1 -- 172.21.15.186:0/3516626110 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f2bd002db30 con 0x7f2bb80a1ac0 2024-03-16T20:54:17.283 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mds.all update... 2024-03-16T20:54:17.286 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.281+0000 7f2bd654c700 1 -- 172.21.15.186:0/3516626110 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2bb80a1ac0 msgr2=0x7f2bb80a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:17.286 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.281+0000 7f2bd654c700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2bb80a1ac0 0x7f2bb80a3f80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0006fd0 tx=0x7f2bc0008040 comp rx=0 tx=0).stop 2024-03-16T20:54:17.286 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.281+0000 7f2bd654c700 1 -- 172.21.15.186:0/3516626110 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd0102a30 msgr2=0x7f2bd019f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:17.286 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.281+0000 7f2bd654c700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd0102a30 0x7f2bd019f700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800b9a0 tx=0x7f2bc800bd60 comp rx=0 tx=0).stop 2024-03-16T20:54:17.286 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.281+0000 7f2bd654c700 1 -- 172.21.15.186:0/3516626110 shutdown_connections 2024-03-16T20:54:17.286 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.281+0000 7f2bd654c700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2bb80a1ac0 0x7f2bb80a3f80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:17.286 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.281+0000 7f2bd654c700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bd0102a30 0x7f2bd019f700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:17.286 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.281+0000 7f2bd654c700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd0100f10 0x7f2bd0198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:17.286 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.281+0000 7f2bd654c700 1 --2- 172.21.15.186:0/3516626110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd0102070 0x7f2bd0198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:17.286 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.281+0000 7f2bd654c700 1 -- 172.21.15.186:0/3516626110 >> 172.21.15.186:0/3516626110 conn(0x7f2bd00fc4d0 msgr2=0x7f2bd0105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:17.287 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.282+0000 7f2bd654c700 1 -- 172.21.15.186:0/3516626110 shutdown_connections 2024-03-16T20:54:17.287 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-16T20:54:17.282+0000 7f2bd654c700 1 -- 172.21.15.186:0/3516626110 wait complete. 2024-03-16T20:54:18.069 DEBUG:teuthology.orchestra.run.smithi008:mds.a> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.a.service 2024-03-16T20:54:18.076 DEBUG:teuthology.orchestra.run.smithi008:mds.d> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.d.service 2024-03-16T20:54:18.121 DEBUG:teuthology.orchestra.run.smithi008:mds.g> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.g.service 2024-03-16T20:54:18.167 DEBUG:teuthology.orchestra.run.smithi008:mds.j> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.j.service 2024-03-16T20:54:18.212 DEBUG:teuthology.orchestra.run.smithi170:mds.b> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.b.service 2024-03-16T20:54:18.215 DEBUG:teuthology.orchestra.run.smithi170:mds.e> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.e.service 2024-03-16T20:54:18.258 DEBUG:teuthology.orchestra.run.smithi170:mds.h> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.h.service 2024-03-16T20:54:18.300 DEBUG:teuthology.orchestra.run.smithi170:mds.k> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.k.service 2024-03-16T20:54:18.343 DEBUG:teuthology.orchestra.run.smithi186:mds.c> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.c.service 2024-03-16T20:54:18.346 DEBUG:teuthology.orchestra.run.smithi186:mds.f> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.f.service 2024-03-16T20:54:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:18 smithi186 ceph-mon[36391]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:18 smithi186 ceph-mon[36391]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:54:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:18 smithi186 ceph-mon[36391]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2024-03-16T20:54:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:18 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:54:18.370 DEBUG:teuthology.orchestra.run.smithi186:mds.i> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.i.service 2024-03-16T20:54:18.413 DEBUG:teuthology.orchestra.run.smithi186:mds.l> sudo journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.l.service 2024-03-16T20:54:18.456 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-03-16T20:54:18.456 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:54:18.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:18 smithi008 ceph-mon[31434]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:18.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:18 smithi008 ceph-mon[31434]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:54:18.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:18 smithi008 ceph-mon[31434]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2024-03-16T20:54:18.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:18.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:18 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:54:18.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:18 smithi170 ceph-mon[35947]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:18.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:18 smithi170 ceph-mon[35947]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:54:18.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:18 smithi170 ceph-mon[35947]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2024-03-16T20:54:18.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:18.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:18 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:54:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.675+0000 7fcf31c00640 1 -- 172.21.15.8:0/729302446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf2c0754d0 msgr2=0x7fcf2c073920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.675+0000 7fcf31c00640 1 --2- 172.21.15.8:0/729302446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf2c0754d0 0x7fcf2c073920 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009900 tx=0x7fcf1c02bcd0 comp rx=0 tx=0).stop 2024-03-16T20:54:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.675+0000 7fcf31c00640 1 -- 172.21.15.8:0/729302446 shutdown_connections 2024-03-16T20:54:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.675+0000 7fcf31c00640 1 --2- 172.21.15.8:0/729302446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf2c109390 0x7fcf2c10b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.675+0000 7fcf31c00640 1 --2- 172.21.15.8:0/729302446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf2c073ef0 0x7fcf2c074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.675+0000 7fcf31c00640 1 --2- 172.21.15.8:0/729302446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf2c0754d0 0x7fcf2c073920 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.675+0000 7fcf31c00640 1 -- 172.21.15.8:0/729302446 >> 172.21.15.8:0/729302446 conn(0x7fcf2c0fcad0 msgr2=0x7fcf2c0feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.675+0000 7fcf31c00640 1 -- 172.21.15.8:0/729302446 shutdown_connections 2024-03-16T20:54:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.675+0000 7fcf31c00640 1 -- 172.21.15.8:0/729302446 wait complete. 2024-03-16T20:54:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.676+0000 7fcf31c00640 1 Processor -- start 2024-03-16T20:54:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.676+0000 7fcf31c00640 1 -- start start 2024-03-16T20:54:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.676+0000 7fcf31c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf2c073ef0 0x7fcf2c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.676+0000 7fcf31c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf2c0754d0 0x7fcf2c199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.676+0000 7fcf31c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf2c109390 0x7fcf2c1a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf31c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c1a1370 con 0x7fcf2c073ef0 2024-03-16T20:54:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf31c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c1a14e0 con 0x7fcf2c109390 2024-03-16T20:54:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf31c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c1a16a0 con 0x7fcf2c0754d0 2024-03-16T20:54:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf2c073ef0 0x7fcf2c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf2c073ef0 0x7fcf2c199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57480/0 (socket says 172.21.15.8:57480) 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2aa00640 1 -- 172.21.15.8:0/1856685658 learned_addr learned my addr 172.21.15.8:0/1856685658 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2a000640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf2c0754d0 0x7fcf2c199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2b400640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf2c109390 0x7fcf2c1a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2aa00640 1 -- 172.21.15.8:0/1856685658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf2c0754d0 msgr2=0x7fcf2c199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2aa00640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf2c0754d0 0x7fcf2c199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2aa00640 1 -- 172.21.15.8:0/1856685658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf2c109390 msgr2=0x7fcf2c1a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2aa00640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf2c109390 0x7fcf2c1a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2aa00640 1 -- 172.21.15.8:0/1856685658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18009490 con 0x7fcf2c073ef0 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2b400640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf2c109390 0x7fcf2c1a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.677+0000 7fcf2aa00640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf2c073ef0 0x7fcf2c199880 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009430 tx=0x7fcf1c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.678+0000 7fcf23400640 1 -- 172.21.15.8:0/1856685658 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c004390 con 0x7fcf2c073ef0 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.678+0000 7fcf23400640 1 -- 172.21.15.8:0/1856685658 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcf1c0044f0 con 0x7fcf2c073ef0 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.678+0000 7fcf23400640 1 -- 172.21.15.8:0/1856685658 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c003cb0 con 0x7fcf2c073ef0 2024-03-16T20:54:18.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.678+0000 7fcf31c00640 1 -- 172.21.15.8:0/1856685658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf24009840 con 0x7fcf2c073ef0 2024-03-16T20:54:18.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.678+0000 7fcf31c00640 1 -- 172.21.15.8:0/1856685658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c009560 con 0x7fcf2c073ef0 2024-03-16T20:54:18.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.679+0000 7fcf31c00640 1 -- 172.21.15.8:0/1856685658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c068730 con 0x7fcf2c073ef0 2024-03-16T20:54:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.681+0000 7fcf23400640 1 -- 172.21.15.8:0/1856685658 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fcf1c004e10 con 0x7fcf2c073ef0 2024-03-16T20:54:18.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.684+0000 7fcf23400640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcf100a1ab0 0x7fcf100a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:18.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.684+0000 7fcf23400640 1 -- 172.21.15.8:0/1856685658 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcf1c0efa80 con 0x7fcf2c073ef0 2024-03-16T20:54:18.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.684+0000 7fcf2a000640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcf100a1ab0 0x7fcf100a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:18.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.685+0000 7fcf2a000640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcf100a1ab0 0x7fcf100a3f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c19ad90 tx=0x7fcf18005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:18.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.687+0000 7fcf23400640 1 -- 172.21.15.8:0/1856685658 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fcf1c0b9090 con 0x7fcf2c073ef0 2024-03-16T20:54:18.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.893+0000 7fcf31c00640 1 -- 172.21.15.8:0/1856685658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf2c108150 con 0x7fcf2c073ef0 2024-03-16T20:54:18.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.895+0000 7fcf23400640 1 -- 172.21.15.8:0/1856685658 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18385 (secure 0 0 0) 0x7fcf1c0bc750 con 0x7fcf2c073ef0 2024-03-16T20:54:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:18.900 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":82,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:54:07.407682+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:54:18.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.897+0000 7fcf31c00640 1 -- 172.21.15.8:0/1856685658 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcf100a1ab0 msgr2=0x7fcf100a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:18.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.897+0000 7fcf31c00640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcf100a1ab0 0x7fcf100a3f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c19ad90 tx=0x7fcf18005f90 comp rx=0 tx=0).stop 2024-03-16T20:54:18.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.897+0000 7fcf31c00640 1 -- 172.21.15.8:0/1856685658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf2c073ef0 msgr2=0x7fcf2c199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.897+0000 7fcf31c00640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf2c073ef0 0x7fcf2c199880 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009430 tx=0x7fcf1c005d50 comp rx=0 tx=0).stop 2024-03-16T20:54:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.898+0000 7fcf31c00640 1 -- 172.21.15.8:0/1856685658 shutdown_connections 2024-03-16T20:54:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.898+0000 7fcf31c00640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcf100a1ab0 0x7fcf100a3f70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.898+0000 7fcf31c00640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf2c109390 0x7fcf2c1a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.898+0000 7fcf31c00640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf2c0754d0 0x7fcf2c199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.898+0000 7fcf31c00640 1 --2- 172.21.15.8:0/1856685658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf2c073ef0 0x7fcf2c199880 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.898+0000 7fcf31c00640 1 -- 172.21.15.8:0/1856685658 >> 172.21.15.8:0/1856685658 conn(0x7fcf2c0fcad0 msgr2=0x7fcf2c105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.898+0000 7fcf31c00640 1 -- 172.21.15.8:0/1856685658 shutdown_connections 2024-03-16T20:54:18.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:18.898+0000 7fcf31c00640 1 -- 172.21.15.8:0/1856685658 wait complete. 2024-03-16T20:54:18.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T20:54:18.922 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T20:54:19.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.194+0000 7f1b47e00640 1 -- 172.21.15.8:0/2897368959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b480ff6b0 msgr2=0x7f1b480ffad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:19.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.194+0000 7f1b47e00640 1 --2- 172.21.15.8:0/2897368959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b480ff6b0 0x7f1b480ffad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1b38009900 tx=0x7f1b3802bc30 comp rx=0 tx=0).stop 2024-03-16T20:54:19.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.194+0000 7f1b47e00640 1 -- 172.21.15.8:0/2897368959 shutdown_connections 2024-03-16T20:54:19.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.194+0000 7f1b47e00640 1 --2- 172.21.15.8:0/2897368959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b48103040 0x7f1b481098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.194+0000 7f1b47e00640 1 --2- 172.21.15.8:0/2897368959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b48102680 0x7f1b48102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.194+0000 7f1b47e00640 1 --2- 172.21.15.8:0/2897368959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b480ff6b0 0x7f1b480ffad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.194+0000 7f1b47e00640 1 -- 172.21.15.8:0/2897368959 >> 172.21.15.8:0/2897368959 conn(0x7f1b480fafe0 msgr2=0x7f1b480fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:19.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.194+0000 7f1b47e00640 1 -- 172.21.15.8:0/2897368959 shutdown_connections 2024-03-16T20:54:19.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.194+0000 7f1b47e00640 1 -- 172.21.15.8:0/2897368959 wait complete. 2024-03-16T20:54:19.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.196+0000 7f1b47e00640 1 Processor -- start 2024-03-16T20:54:19.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.196+0000 7f1b47e00640 1 -- start start 2024-03-16T20:54:19.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.196+0000 7f1b47e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b480ff6b0 0x7f1b48101ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:19.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.196+0000 7f1b47e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b48102680 0x7f1b48100630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:19.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b47e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b48103040 0x7f1b48100b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:19.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b47e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b481012d0 con 0x7f1b480ff6b0 2024-03-16T20:54:19.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b47e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b48101440 con 0x7f1b48102680 2024-03-16T20:54:19.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b47e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b481a1600 con 0x7f1b48103040 2024-03-16T20:54:19.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b46a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b480ff6b0 0x7f1b48101ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:19.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b47400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b48103040 0x7f1b48100b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:19.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b46a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b480ff6b0 0x7f1b48101ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57506/0 (socket says 172.21.15.8:57506) 2024-03-16T20:54:19.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b46a00640 1 -- 172.21.15.8:0/2731325123 learned_addr learned my addr 172.21.15.8:0/2731325123 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:19.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b3e000640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b48102680 0x7f1b48100630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:19.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b47400640 1 -- 172.21.15.8:0/2731325123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b48102680 msgr2=0x7f1b48100630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:19.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b47400640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b48102680 0x7f1b48100630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b47400640 1 -- 172.21.15.8:0/2731325123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b480ff6b0 msgr2=0x7f1b48101ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:19.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b47400640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b480ff6b0 0x7f1b48101ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.197+0000 7f1b47400640 1 -- 172.21.15.8:0/2731325123 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38009560 con 0x7f1b48103040 2024-03-16T20:54:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.198+0000 7f1b47400640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b48103040 0x7f1b48100b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009fd0 tx=0x7f1b4000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.198+0000 7f1b3fe00640 1 -- 172.21.15.8:0/2731325123 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000ce20 con 0x7f1b48103040 2024-03-16T20:54:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.198+0000 7f1b47e00640 1 -- 172.21.15.8:0/2731325123 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b481a18b0 con 0x7f1b48103040 2024-03-16T20:54:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.198+0000 7f1b3fe00640 1 -- 172.21.15.8:0/2731325123 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1b40004b20 con 0x7f1b48103040 2024-03-16T20:54:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.198+0000 7f1b3fe00640 1 -- 172.21.15.8:0/2731325123 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b400106f0 con 0x7f1b48103040 2024-03-16T20:54:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.198+0000 7f1b47e00640 1 -- 172.21.15.8:0/2731325123 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b481a1dc0 con 0x7f1b48103040 2024-03-16T20:54:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.199+0000 7f1b47e00640 1 -- 172.21.15.8:0/2731325123 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b481087b0 con 0x7f1b48103040 2024-03-16T20:54:19.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.201+0000 7f1b3fe00640 1 -- 172.21.15.8:0/2731325123 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f1b40004c90 con 0x7f1b48103040 2024-03-16T20:54:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.202+0000 7f1b3fe00640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b2c0a1a30 0x7f1b2c0a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.202+0000 7f1b3fe00640 1 -- 172.21.15.8:0/2731325123 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1b40014070 con 0x7f1b48103040 2024-03-16T20:54:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.203+0000 7f1b46a00640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b2c0a1a30 0x7f1b2c0a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.203+0000 7f1b46a00640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b2c0a1a30 0x7f1b2c0a3ef0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b38006010 tx=0x7f1b3802df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:19.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.206+0000 7f1b3fe00640 1 -- 172.21.15.8:0/2731325123 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1b40096d30 con 0x7f1b48103040 2024-03-16T20:54:19.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.411+0000 7f1b47e00640 1 -- 172.21.15.8:0/2731325123 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b48108220 con 0x7f1b48103040 2024-03-16T20:54:19.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.412+0000 7f1b3fe00640 1 -- 172.21.15.8:0/2731325123 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b4009a3f0 con 0x7f1b48103040 2024-03-16T20:54:19.418 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T20:54:19.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.414+0000 7f1b47e00640 1 -- 172.21.15.8:0/2731325123 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b2c0a1a30 msgr2=0x7f1b2c0a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:19.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.414+0000 7f1b47e00640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b2c0a1a30 0x7f1b2c0a3ef0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b38006010 tx=0x7f1b3802df90 comp rx=0 tx=0).stop 2024-03-16T20:54:19.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.414+0000 7f1b47e00640 1 -- 172.21.15.8:0/2731325123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b48103040 msgr2=0x7f1b48100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:19.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.414+0000 7f1b47e00640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b48103040 0x7f1b48100b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009fd0 tx=0x7f1b4000ef10 comp rx=0 tx=0).stop 2024-03-16T20:54:19.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.414+0000 7f1b47e00640 1 -- 172.21.15.8:0/2731325123 shutdown_connections 2024-03-16T20:54:19.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.414+0000 7f1b47e00640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b2c0a1a30 0x7f1b2c0a3ef0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.414+0000 7f1b47e00640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b48103040 0x7f1b48100b70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.414+0000 7f1b47e00640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b48102680 0x7f1b48100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.414+0000 7f1b47e00640 1 --2- 172.21.15.8:0/2731325123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b480ff6b0 0x7f1b48101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.414+0000 7f1b47e00640 1 -- 172.21.15.8:0/2731325123 >> 172.21.15.8:0/2731325123 conn(0x7f1b480fafe0 msgr2=0x7f1b48105980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:19.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.415+0000 7f1b47e00640 1 -- 172.21.15.8:0/2731325123 shutdown_connections 2024-03-16T20:54:19.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.415+0000 7f1b47e00640 1 -- 172.21.15.8:0/2731325123 wait complete. 2024-03-16T20:54:19.430 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:19.430 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:54:19.431 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:19.431 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:19.431 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:19.431 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:19 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:19.431 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:19 smithi186 ceph-mon[36391]: Deploying daemon mds.l on smithi186 2024-03-16T20:54:19.431 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:19 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1856685658' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:54:19.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:19.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:19.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:54:19.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:19.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:19.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:19.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:19 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:19.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:19 smithi008 ceph-mon[31434]: Deploying daemon mds.l on smithi186 2024-03-16T20:54:19.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:19 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1856685658' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:54:19.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:19.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:54:19.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:19.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:19.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:19.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:19 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:19.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:19 smithi170 ceph-mon[35947]: Deploying daemon mds.l on smithi186 2024-03-16T20:54:19.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:19 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1856685658' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:54:19.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.664+0000 7efe4f200640 1 -- 172.21.15.8:0/1916356608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe501046f0 msgr2=0x7efe50106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:19.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.664+0000 7efe4f200640 1 --2- 172.21.15.8:0/1916356608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe501046f0 0x7efe50106ae0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efe38009900 tx=0x7efe3802bc50 comp rx=0 tx=0).stop 2024-03-16T20:54:19.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.665+0000 7efe4f200640 1 -- 172.21.15.8:0/1916356608 shutdown_connections 2024-03-16T20:54:19.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.665+0000 7efe4f200640 1 --2- 172.21.15.8:0/1916356608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe50107020 0x7efe50109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.665+0000 7efe4f200640 1 --2- 172.21.15.8:0/1916356608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe501046f0 0x7efe50106ae0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.665+0000 7efe4f200640 1 --2- 172.21.15.8:0/1916356608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe50101dc0 0x7efe501041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.665+0000 7efe4f200640 1 -- 172.21.15.8:0/1916356608 >> 172.21.15.8:0/1916356608 conn(0x7efe500fb7d0 msgr2=0x7efe500fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:19.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.665+0000 7efe4f200640 1 -- 172.21.15.8:0/1916356608 shutdown_connections 2024-03-16T20:54:19.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.665+0000 7efe4f200640 1 -- 172.21.15.8:0/1916356608 wait complete. 2024-03-16T20:54:19.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.666+0000 7efe4f200640 1 Processor -- start 2024-03-16T20:54:19.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.666+0000 7efe4f200640 1 -- start start 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.666+0000 7efe4f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe50101dc0 0x7efe501974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.666+0000 7efe4f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe501046f0 0x7efe50197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.666+0000 7efe4f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50107020 0x7efe5019ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.666+0000 7efe4f200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5019efd0 con 0x7efe50107020 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.666+0000 7efe4f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5019f140 con 0x7efe50101dc0 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.666+0000 7efe4f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5019f300 con 0x7efe501046f0 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe45400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe501046f0 0x7efe50197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe4de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe50101dc0 0x7efe501974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe4e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50107020 0x7efe5019ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe4de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe50101dc0 0x7efe501974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:38262/0 (socket says 172.21.15.8:38262) 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe4de00640 1 -- 172.21.15.8:0/3591382441 learned_addr learned my addr 172.21.15.8:0/3591382441 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe45400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe501046f0 0x7efe50197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39136/0 (socket says 172.21.15.8:39136) 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe45400640 1 -- 172.21.15.8:0/3591382441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe50101dc0 msgr2=0x7efe501974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:19.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe45400640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe50101dc0 0x7efe501974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe45400640 1 -- 172.21.15.8:0/3591382441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50107020 msgr2=0x7efe5019ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe45400640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50107020 0x7efe5019ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe45400640 1 -- 172.21.15.8:0/3591382441 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe40009490 con 0x7efe501046f0 2024-03-16T20:54:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe4de00640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe50101dc0 0x7efe501974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:54:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe4e800640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50107020 0x7efe5019ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:54:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.667+0000 7efe45400640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe501046f0 0x7efe50197a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe38009230 tx=0x7efe38004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.668+0000 7efe47400640 1 -- 172.21.15.8:0/3591382441 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38005010 con 0x7efe501046f0 2024-03-16T20:54:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.668+0000 7efe47400640 1 -- 172.21.15.8:0/3591382441 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7efe38004500 con 0x7efe501046f0 2024-03-16T20:54:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.668+0000 7efe47400640 1 -- 172.21.15.8:0/3591382441 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38034440 con 0x7efe501046f0 2024-03-16T20:54:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.668+0000 7efe4f200640 1 -- 172.21.15.8:0/3591382441 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe38009560 con 0x7efe501046f0 2024-03-16T20:54:19.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.668+0000 7efe4f200640 1 -- 172.21.15.8:0/3591382441 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5019f870 con 0x7efe501046f0 2024-03-16T20:54:19.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.669+0000 7efe4f200640 1 -- 172.21.15.8:0/3591382441 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe500fd2c0 con 0x7efe501046f0 2024-03-16T20:54:19.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.671+0000 7efe47400640 1 -- 172.21.15.8:0/3591382441 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7efe38003780 con 0x7efe501046f0 2024-03-16T20:54:19.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.672+0000 7efe47400640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efe340a1a30 0x7efe340a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:19.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.672+0000 7efe47400640 1 -- 172.21.15.8:0/3591382441 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7efe380ef0d0 con 0x7efe501046f0 2024-03-16T20:54:19.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.672+0000 7efe4de00640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efe340a1a30 0x7efe340a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:19.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.673+0000 7efe4de00640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efe340a1a30 0x7efe340a3ef0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe40011690 tx=0x7efe40005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:19.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.676+0000 7efe47400640 1 -- 172.21.15.8:0/3591382441 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7efe380b8790 con 0x7efe501046f0 2024-03-16T20:54:19.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.919+0000 7efe4f200640 1 -- 172.21.15.8:0/3591382441 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe5002cf90 con 0x7efe501046f0 2024-03-16T20:54:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.920+0000 7efe47400640 1 -- 172.21.15.8:0/3591382441 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7efe380bbe50 con 0x7efe501046f0 2024-03-16T20:54:19.924 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:19.924 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-16T20:54:19.925 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 1 2024-03-16T20:54:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.922+0000 7efe4f200640 1 -- 172.21.15.8:0/3591382441 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efe340a1a30 msgr2=0x7efe340a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.922+0000 7efe4f200640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efe340a1a30 0x7efe340a3ef0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe40011690 tx=0x7efe40005f90 comp rx=0 tx=0).stop 2024-03-16T20:54:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.922+0000 7efe4f200640 1 -- 172.21.15.8:0/3591382441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe501046f0 msgr2=0x7efe50197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.922+0000 7efe4f200640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe501046f0 0x7efe50197a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe38009230 tx=0x7efe38004040 comp rx=0 tx=0).stop 2024-03-16T20:54:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.922+0000 7efe4f200640 1 -- 172.21.15.8:0/3591382441 shutdown_connections 2024-03-16T20:54:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.922+0000 7efe4f200640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efe340a1a30 0x7efe340a3ef0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.922+0000 7efe4f200640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe50107020 0x7efe5019ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.922+0000 7efe4f200640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe501046f0 0x7efe50197a20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.922+0000 7efe4f200640 1 --2- 172.21.15.8:0/3591382441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe50101dc0 0x7efe501974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.922+0000 7efe4f200640 1 -- 172.21.15.8:0/3591382441 >> 172.21.15.8:0/3591382441 conn(0x7efe500fb7d0 msgr2=0x7efe501027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.923+0000 7efe4f200640 1 -- 172.21.15.8:0/3591382441 shutdown_connections 2024-03-16T20:54:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:19.923+0000 7efe4f200640 1 -- 172.21.15.8:0/3591382441 wait complete. 2024-03-16T20:54:20.501 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:20 smithi186 ceph-mon[36391]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:20.501 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:20 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2731325123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:54:20.501 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:20 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3591382441' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:20.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:20 smithi170 ceph-mon[35947]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:20.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:20 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2731325123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:54:20.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:20 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3591382441' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:20 smithi008 ceph-mon[31434]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:20 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2731325123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:54:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:20 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3591382441' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:20.893 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 20:54:20 smithi186 systemd[1]: Starting Ceph mds.l for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:21.150 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 20:54:20 smithi186 podman[66927]: 2024-03-16 20:54:20.795748884 +0000 UTC m=+0.017992337 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:21.150 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 20:54:20 smithi186 podman[66927]: 2024-03-16 20:54:20.900834979 +0000 UTC m=+0.123078468 container create a8ffc766bf6f53513e1052ac9b358dd843dd75acadbca8b39a0803ce5163efdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-l, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-16T20:54:21.150 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 20:54:21 smithi186 podman[66927]: 2024-03-16 20:54:21.145033324 +0000 UTC m=+0.367276771 container init a8ffc766bf6f53513e1052ac9b358dd843dd75acadbca8b39a0803ce5163efdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-l, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux ) 2024-03-16T20:54:21.643 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 20:54:21 smithi186 podman[66927]: 2024-03-16 20:54:21.147837384 +0000 UTC m=+0.370080837 container start a8ffc766bf6f53513e1052ac9b358dd843dd75acadbca8b39a0803ce5163efdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-l, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T20:54:21.643 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 20:54:21 smithi186 ceph-mds[66946]: -- 172.21.15.186:0/1536571919 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55609e4781a0 con 0x55609e44ec00 2024-03-16T20:54:21.643 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 20:54:21 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-l[66942]: starting mds.l at 2024-03-16T20:54:21.643 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 20:54:21 smithi186 bash[66927]: a8ffc766bf6f53513e1052ac9b358dd843dd75acadbca8b39a0803ce5163efdd 2024-03-16T20:54:21.643 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 20:54:21 smithi186 systemd[1]: Started Ceph mds.l for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:21.948 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:22.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.174+0000 7f9babe00640 1 -- 172.21.15.8:0/2426265305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac103540 msgr2=0x7f9bac103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:22.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.174+0000 7f9babe00640 1 --2- 172.21.15.8:0/2426265305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac103540 0x7f9bac103960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009860 tx=0x7f9b9c02bb70 comp rx=0 tx=0).stop 2024-03-16T20:54:22.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.174+0000 7f9babe00640 1 -- 172.21.15.8:0/2426265305 shutdown_connections 2024-03-16T20:54:22.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.174+0000 7f9babe00640 1 --2- 172.21.15.8:0/2426265305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bac1050f0 0x7f9bac10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:22.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.174+0000 7f9babe00640 1 --2- 172.21.15.8:0/2426265305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bac104730 0x7f9bac104bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:22.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.174+0000 7f9babe00640 1 --2- 172.21.15.8:0/2426265305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac103540 0x7f9bac103960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:22.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.174+0000 7f9babe00640 1 -- 172.21.15.8:0/2426265305 >> 172.21.15.8:0/2426265305 conn(0x7f9bac0fead0 msgr2=0x7f9bac100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:22.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.174+0000 7f9babe00640 1 -- 172.21.15.8:0/2426265305 shutdown_connections 2024-03-16T20:54:22.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.174+0000 7f9babe00640 1 -- 172.21.15.8:0/2426265305 wait complete. 2024-03-16T20:54:22.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.175+0000 7f9babe00640 1 Processor -- start 2024-03-16T20:54:22.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.175+0000 7f9babe00640 1 -- start start 2024-03-16T20:54:22.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9babe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bac103540 0x7f9bac1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:22.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9babe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac104730 0x7f9bac199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9babe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bac1050f0 0x7f9bac1a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9babe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac1a11d0 con 0x7f9bac103540 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9babe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac1a1340 con 0x7f9bac104730 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9babe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac1a1500 con 0x7f9bac1050f0 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9baaa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bac103540 0x7f9bac1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9baaa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bac103540 0x7f9bac1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57532/0 (socket says 172.21.15.8:57532) 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9baaa00640 1 -- 172.21.15.8:0/2059656598 learned_addr learned my addr 172.21.15.8:0/2059656598 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9bab400640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bac1050f0 0x7f9bac1a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9ba3e00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac104730 0x7f9bac199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9baaa00640 1 -- 172.21.15.8:0/2059656598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bac1050f0 msgr2=0x7f9bac1a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9baaa00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bac1050f0 0x7f9bac1a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9baaa00640 1 -- 172.21.15.8:0/2059656598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac104730 msgr2=0x7f9bac199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:22.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9baaa00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac104730 0x7f9bac199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:22.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.176+0000 7f9baaa00640 1 -- 172.21.15.8:0/2059656598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b94009490 con 0x7f9bac103540 2024-03-16T20:54:22.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.177+0000 7f9baaa00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bac103540 0x7f9bac1996e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c02c0b0 tx=0x7f9b9c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:22.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.177+0000 7f9ba3400640 1 -- 172.21.15.8:0/2059656598 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c02c510 con 0x7f9bac103540 2024-03-16T20:54:22.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.177+0000 7f9babe00640 1 -- 172.21.15.8:0/2059656598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba4009900 con 0x7f9bac103540 2024-03-16T20:54:22.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.177+0000 7f9ba3400640 1 -- 172.21.15.8:0/2059656598 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9b9c02cb70 con 0x7f9bac103540 2024-03-16T20:54:22.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.177+0000 7f9ba3400640 1 -- 172.21.15.8:0/2059656598 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0035f0 con 0x7f9bac103540 2024-03-16T20:54:22.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.177+0000 7f9babe00640 1 -- 172.21.15.8:0/2059656598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c009490 con 0x7f9bac103540 2024-03-16T20:54:22.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.178+0000 7f9babe00640 1 -- 172.21.15.8:0/2059656598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac10a860 con 0x7f9bac103540 2024-03-16T20:54:22.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.180+0000 7f9ba3400640 1 -- 172.21.15.8:0/2059656598 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f9b9c03b040 con 0x7f9bac103540 2024-03-16T20:54:22.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.182+0000 7f9ba3400640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9b900a1a30 0x7f9b900a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:22.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.182+0000 7f9ba3400640 1 -- 172.21.15.8:0/2059656598 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9b9c0eea20 con 0x7f9bac103540 2024-03-16T20:54:22.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.182+0000 7f9ba3e00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9b900a1a30 0x7f9b900a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:22.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.183+0000 7f9ba3e00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9b900a1a30 0x7f9b900a3ef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9bac19abf0 tx=0x7f9b94005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:22.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.187+0000 7f9ba3400640 1 -- 172.21.15.8:0/2059656598 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9b9c0b80e0 con 0x7f9bac103540 2024-03-16T20:54:22.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:22 smithi170 ceph-mon[35947]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:22.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:22 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.186:6832/1283670519,v1:172.21.15.186:6833/1283670519] up:boot 2024-03-16T20:54:22.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:22 smithi170 ceph-mon[35947]: fsmap 1 up:standby 2024-03-16T20:54:22.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T20:54:22.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:22.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:22.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:22.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:22.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:22.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:22 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:22.333 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:22 smithi170 ceph-mon[35947]: Deploying daemon mds.k on smithi170 2024-03-16T20:54:22.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.432+0000 7f9babe00640 1 -- 172.21.15.8:0/2059656598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bac10f060 con 0x7f9bac103540 2024-03-16T20:54:22.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.434+0000 7f9ba3400640 1 -- 172.21.15.8:0/2059656598 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7f9b9c0bb7a0 con 0x7f9bac103540 2024-03-16T20:54:22.438 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:22.438 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-16T20:54:22.439 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 2 2024-03-16T20:54:22.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.436+0000 7f9babe00640 1 -- 172.21.15.8:0/2059656598 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9b900a1a30 msgr2=0x7f9b900a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:22.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.436+0000 7f9babe00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9b900a1a30 0x7f9b900a3ef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9bac19abf0 tx=0x7f9b94005f90 comp rx=0 tx=0).stop 2024-03-16T20:54:22.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.436+0000 7f9babe00640 1 -- 172.21.15.8:0/2059656598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bac103540 msgr2=0x7f9bac1996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:22.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.436+0000 7f9babe00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bac103540 0x7f9bac1996e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c02c0b0 tx=0x7f9b9c005d50 comp rx=0 tx=0).stop 2024-03-16T20:54:22.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.436+0000 7f9babe00640 1 -- 172.21.15.8:0/2059656598 shutdown_connections 2024-03-16T20:54:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.436+0000 7f9babe00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9b900a1a30 0x7f9b900a3ef0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.436+0000 7f9babe00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bac1050f0 0x7f9bac1a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.436+0000 7f9babe00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac104730 0x7f9bac199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.437+0000 7f9babe00640 1 --2- 172.21.15.8:0/2059656598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bac103540 0x7f9bac1996e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.437+0000 7f9babe00640 1 -- 172.21.15.8:0/2059656598 >> 172.21.15.8:0/2059656598 conn(0x7f9bac0fead0 msgr2=0x7f9bac107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.437+0000 7f9babe00640 1 -- 172.21.15.8:0/2059656598 shutdown_connections 2024-03-16T20:54:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:22.437+0000 7f9babe00640 1 -- 172.21.15.8:0/2059656598 wait complete. 2024-03-16T20:54:22.458 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:22 smithi008 ceph-mon[31434]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:22.458 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:22 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.186:6832/1283670519,v1:172.21.15.186:6833/1283670519] up:boot 2024-03-16T20:54:22.458 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:22 smithi008 ceph-mon[31434]: fsmap 1 up:standby 2024-03-16T20:54:22.458 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T20:54:22.458 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:22.458 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:22.458 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:22.459 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:22.459 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:22.459 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:22 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:22.459 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:22 smithi008 ceph-mon[31434]: Deploying daemon mds.k on smithi170 2024-03-16T20:54:22.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:22 smithi186 ceph-mon[36391]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:22.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:22 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.186:6832/1283670519,v1:172.21.15.186:6833/1283670519] up:boot 2024-03-16T20:54:22.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:22 smithi186 ceph-mon[36391]: fsmap 1 up:standby 2024-03-16T20:54:22.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T20:54:22.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:22.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:22.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:22.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:22.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:22.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:22 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:22.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:22 smithi186 ceph-mon[36391]: Deploying daemon mds.k on smithi170 2024-03-16T20:54:23.342 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:23 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2059656598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:23.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:23 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2059656598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:23.617 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 20:54:23 smithi170 systemd[1]: Starting Ceph mds.k for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:23.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:23 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2059656598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:23.992 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 20:54:23 smithi170 podman[65285]: 2024-03-16 20:54:23.637206666 +0000 UTC m=+0.017670507 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:23.992 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 20:54:23 smithi170 podman[65285]: 2024-03-16 20:54:23.761120872 +0000 UTC m=+0.141584706 container create 07752b1516c46d4fdc70d4ccf6dd7f18d5cca64ba2d9c386c8fd70a8748d31d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-k, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-03-16T20:54:23.993 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 20:54:23 smithi170 podman[65285]: 2024-03-16 20:54:23.989085796 +0000 UTC m=+0.369549655 container init 07752b1516c46d4fdc70d4ccf6dd7f18d5cca64ba2d9c386c8fd70a8748d31d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-k, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=) 2024-03-16T20:54:24.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:24 smithi170 ceph-mon[35947]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:24.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:24 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:24.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:24 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:24.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:24 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:24.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:24 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:24.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:24 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:24.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:24 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:24.368 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 20:54:23 smithi170 podman[65285]: 2024-03-16 20:54:23.991861024 +0000 UTC m=+0.372324878 container start 07752b1516c46d4fdc70d4ccf6dd7f18d5cca64ba2d9c386c8fd70a8748d31d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-k, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-03-16T20:54:24.368 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 20:54:24 smithi170 ceph-mds[65304]: -- 172.21.15.170:0/565295850 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b2aa7d61a0 con 0x55b2aa7ad000 2024-03-16T20:54:24.368 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 20:54:24 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-k[65300]: starting mds.k at 2024-03-16T20:54:24.368 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 20:54:24 smithi170 bash[65285]: 07752b1516c46d4fdc70d4ccf6dd7f18d5cca64ba2d9c386c8fd70a8748d31d0 2024-03-16T20:54:24.368 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 20:54:24 smithi170 systemd[1]: Started Ceph mds.k for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:24.463 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:24.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:24 smithi008 ceph-mon[31434]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:24.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:24 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:24.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:24 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:24.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:24 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:24.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:24 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:24.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:24 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:24.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:24 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:24.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:24 smithi186 ceph-mon[36391]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:24.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:24 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:24.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:24 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:24.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:24 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:24.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:24 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:24.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:24 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:24.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:24 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:24.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.684+0000 7fe9b7e00640 1 -- 172.21.15.8:0/1938154834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9b8104ed0 msgr2=0x7fe9b8105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:24.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.684+0000 7fe9b7e00640 1 --2- 172.21.15.8:0/1938154834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9b8104ed0 0x7fe9b8105350 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009900 tx=0x7fe9b002bc50 comp rx=0 tx=0).stop 2024-03-16T20:54:24.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.685+0000 7fe9b7e00640 1 -- 172.21.15.8:0/1938154834 shutdown_connections 2024-03-16T20:54:24.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.685+0000 7fe9b7e00640 1 --2- 172.21.15.8:0/1938154834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9b8104ed0 0x7fe9b8105350 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:24.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.685+0000 7fe9b7e00640 1 --2- 172.21.15.8:0/1938154834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9b8102520 0x7fe9b8104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:24.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.685+0000 7fe9b7e00640 1 --2- 172.21.15.8:0/1938154834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9b80ffbb0 0x7fe9b8101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:24.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.685+0000 7fe9b7e00640 1 -- 172.21.15.8:0/1938154834 >> 172.21.15.8:0/1938154834 conn(0x7fe9b80fb7d0 msgr2=0x7fe9b80fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:24.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.685+0000 7fe9b7e00640 1 -- 172.21.15.8:0/1938154834 shutdown_connections 2024-03-16T20:54:24.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.685+0000 7fe9b7e00640 1 -- 172.21.15.8:0/1938154834 wait complete. 2024-03-16T20:54:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.686+0000 7fe9b7e00640 1 Processor -- start 2024-03-16T20:54:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.686+0000 7fe9b7e00640 1 -- start start 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.686+0000 7fe9b7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9b80ffbb0 0x7fe9b819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.686+0000 7fe9b7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9b8102520 0x7fe9b819df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.686+0000 7fe9b7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9b8104ed0 0x7fe9b81a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.686+0000 7fe9b7e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b81a5510 con 0x7fe9b80ffbb0 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.686+0000 7fe9b7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b81a5680 con 0x7fe9b8102520 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.686+0000 7fe9b7e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b81a5840 con 0x7fe9b8104ed0 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9b80ffbb0 0x7fe9b819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9b8102520 0x7fe9b819df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9b8102520 0x7fe9b819df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:38296/0 (socket says 172.21.15.8:38296) 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b6000640 1 -- 172.21.15.8:0/3708235723 learned_addr learned my addr 172.21.15.8:0/3708235723 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9b80ffbb0 0x7fe9b819da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57552/0 (socket says 172.21.15.8:57552) 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b7400640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9b8104ed0 0x7fe9b81a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b6000640 1 -- 172.21.15.8:0/3708235723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9b8104ed0 msgr2=0x7fe9b81a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b6000640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9b8104ed0 0x7fe9b81a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b6000640 1 -- 172.21.15.8:0/3708235723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9b80ffbb0 msgr2=0x7fe9b819da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b6000640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9b80ffbb0 0x7fe9b819da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b6000640 1 -- 172.21.15.8:0/3708235723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b0009560 con 0x7fe9b8102520 2024-03-16T20:54:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.687+0000 7fe9b6000640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9b8102520 0x7fe9b819df60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400e9f0 tx=0x7fe9a400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.688+0000 7fe9af400640 1 -- 172.21.15.8:0/3708235723 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4009700 con 0x7fe9b8102520 2024-03-16T20:54:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.688+0000 7fe9af400640 1 -- 172.21.15.8:0/3708235723 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe9a400cd80 con 0x7fe9b8102520 2024-03-16T20:54:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.688+0000 7fe9af400640 1 -- 172.21.15.8:0/3708235723 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a40189c0 con 0x7fe9b8102520 2024-03-16T20:54:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.688+0000 7fe9b7e00640 1 -- 172.21.15.8:0/3708235723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b81a5b20 con 0x7fe9b8102520 2024-03-16T20:54:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.688+0000 7fe9b7e00640 1 -- 172.21.15.8:0/3708235723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b81a5fe0 con 0x7fe9b8102520 2024-03-16T20:54:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.689+0000 7fe9b7e00640 1 -- 172.21.15.8:0/3708235723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b80fd2c0 con 0x7fe9b8102520 2024-03-16T20:54:24.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.692+0000 7fe9af400640 1 -- 172.21.15.8:0/3708235723 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fe9a4018b20 con 0x7fe9b8102520 2024-03-16T20:54:24.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.693+0000 7fe9af400640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe99c0a1a30 0x7fe99c0a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:24.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.693+0000 7fe9af400640 1 -- 172.21.15.8:0/3708235723 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe9a4014070 con 0x7fe9b8102520 2024-03-16T20:54:24.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.693+0000 7fe9b6a00640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe99c0a1a30 0x7fe99c0a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:24.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.694+0000 7fe9b6a00640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe99c0a1a30 0x7fe99c0a3ef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8005fd0 tx=0x7fe9a8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:24.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.697+0000 7fe9af400640 1 -- 172.21.15.8:0/3708235723 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe9a4053280 con 0x7fe9b8102520 2024-03-16T20:54:24.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.945+0000 7fe9b7e00640 1 -- 172.21.15.8:0/3708235723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9b802cf60 con 0x7fe9b8102520 2024-03-16T20:54:24.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.946+0000 7fe9af400640 1 -- 172.21.15.8:0/3708235723 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7fe9a40969c0 con 0x7fe9b8102520 2024-03-16T20:54:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:24.951 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-16T20:54:24.951 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2024-03-16T20:54:24.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 -- 172.21.15.8:0/3708235723 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe99c0a1a30 msgr2=0x7fe99c0a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:24.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe99c0a1a30 0x7fe99c0a3ef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8005fd0 tx=0x7fe9a8009500 comp rx=0 tx=0).stop 2024-03-16T20:54:24.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 -- 172.21.15.8:0/3708235723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9b8102520 msgr2=0x7fe9b819df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:24.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9b8102520 0x7fe9b819df60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400e9f0 tx=0x7fe9a400eeb0 comp rx=0 tx=0).stop 2024-03-16T20:54:24.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 -- 172.21.15.8:0/3708235723 shutdown_connections 2024-03-16T20:54:24.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe99c0a1a30 0x7fe99c0a3ef0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:24.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9b8104ed0 0x7fe9b81a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:24.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9b8102520 0x7fe9b819df60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:24.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 --2- 172.21.15.8:0/3708235723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9b80ffbb0 0x7fe9b819da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:24.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 -- 172.21.15.8:0/3708235723 >> 172.21.15.8:0/3708235723 conn(0x7fe9b80fb7d0 msgr2=0x7fe9b81031f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:24.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 -- 172.21.15.8:0/3708235723 shutdown_connections 2024-03-16T20:54:24.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:24.949+0000 7fe9b7e00640 1 -- 172.21.15.8:0/3708235723 wait complete. 2024-03-16T20:54:25.411 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:25 smithi170 ceph-mon[35947]: Deploying daemon mds.j on smithi008 2024-03-16T20:54:25.412 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:25 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.170:6832/636279364,v1:172.21.15.170:6833/636279364] up:boot 2024-03-16T20:54:25.412 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:25 smithi170 ceph-mon[35947]: fsmap 2 up:standby 2024-03-16T20:54:25.412 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:25 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T20:54:25.412 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:25 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3708235723' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:25.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:25 smithi008 ceph-mon[31434]: Deploying daemon mds.j on smithi008 2024-03-16T20:54:25.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:25 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.170:6832/636279364,v1:172.21.15.170:6833/636279364] up:boot 2024-03-16T20:54:25.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:25 smithi008 ceph-mon[31434]: fsmap 2 up:standby 2024-03-16T20:54:25.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:25 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T20:54:25.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:25 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3708235723' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:25.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:25 smithi186 ceph-mon[36391]: Deploying daemon mds.j on smithi008 2024-03-16T20:54:25.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:25 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.170:6832/636279364,v1:172.21.15.170:6833/636279364] up:boot 2024-03-16T20:54:25.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:25 smithi186 ceph-mon[36391]: fsmap 2 up:standby 2024-03-16T20:54:25.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:25 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T20:54:25.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:25 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3708235723' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:26.451 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:26 smithi008 ceph-mon[31434]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:26.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:26 smithi170 ceph-mon[35947]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:26.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:26 smithi186 ceph-mon[36391]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:26.975 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:27.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.401+0000 7ffac8e00640 1 -- 172.21.15.8:0/1871432655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffac4107020 msgr2=0x7ffac4109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:27.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.401+0000 7ffac8e00640 1 --2- 172.21.15.8:0/1871432655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffac4107020 0x7ffac4109470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009ca0 tx=0x7ffabc02c100 comp rx=0 tx=0).stop 2024-03-16T20:54:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.401+0000 7ffac8e00640 1 -- 172.21.15.8:0/1871432655 shutdown_connections 2024-03-16T20:54:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.401+0000 7ffac8e00640 1 --2- 172.21.15.8:0/1871432655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffac4107020 0x7ffac4109470 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.401+0000 7ffac8e00640 1 --2- 172.21.15.8:0/1871432655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffac41046f0 0x7ffac4106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.401+0000 7ffac8e00640 1 --2- 172.21.15.8:0/1871432655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffac4101dc0 0x7ffac41041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.401+0000 7ffac8e00640 1 -- 172.21.15.8:0/1871432655 >> 172.21.15.8:0/1871432655 conn(0x7ffac40fb7d0 msgr2=0x7ffac40fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.401+0000 7ffac8e00640 1 -- 172.21.15.8:0/1871432655 shutdown_connections 2024-03-16T20:54:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.401+0000 7ffac8e00640 1 -- 172.21.15.8:0/1871432655 wait complete. 2024-03-16T20:54:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.402+0000 7ffac8e00640 1 Processor -- start 2024-03-16T20:54:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.402+0000 7ffac8e00640 1 -- start start 2024-03-16T20:54:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.403+0000 7ffac8e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffac4101dc0 0x7ffac4199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.403+0000 7ffac8e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffac41046f0 0x7ffac4199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.403+0000 7ffac8e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffac4107020 0x7ffac41a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.403+0000 7ffac8e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac41a1180 con 0x7ffac4101dc0 2024-03-16T20:54:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.403+0000 7ffac8e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac41a12f0 con 0x7ffac41046f0 2024-03-16T20:54:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.403+0000 7ffac8e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac41a14b0 con 0x7ffac4107020 2024-03-16T20:54:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.403+0000 7ffac3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffac4101dc0 0x7ffac4199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.403+0000 7ffac3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffac4101dc0 0x7ffac4199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57566/0 (socket says 172.21.15.8:57566) 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.403+0000 7ffac3400640 1 -- 172.21.15.8:0/4205512158 learned_addr learned my addr 172.21.15.8:0/4205512158 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.403+0000 7ffabbe00640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffac41046f0 0x7ffac4199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.403+0000 7ffac3e00640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffac4107020 0x7ffac41a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.404+0000 7ffac3400640 1 -- 172.21.15.8:0/4205512158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffac4107020 msgr2=0x7ffac41a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.404+0000 7ffac3400640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffac4107020 0x7ffac41a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.404+0000 7ffac3400640 1 -- 172.21.15.8:0/4205512158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffac41046f0 msgr2=0x7ffac4199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.404+0000 7ffac3400640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffac41046f0 0x7ffac4199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.404+0000 7ffac3400640 1 -- 172.21.15.8:0/4205512158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab4009490 con 0x7ffac4101dc0 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.404+0000 7ffac3400640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffac4101dc0 0x7ffac4199690 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffab400ea60 tx=0x7ffab400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.404+0000 7ffac0c00640 1 -- 172.21.15.8:0/4205512158 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab400cde0 con 0x7ffac4101dc0 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.404+0000 7ffac0c00640 1 -- 172.21.15.8:0/4205512158 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ffab40035f0 con 0x7ffac4101dc0 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.404+0000 7ffac0c00640 1 -- 172.21.15.8:0/4205512158 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4010690 con 0x7ffac4101dc0 2024-03-16T20:54:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.404+0000 7ffac8e00640 1 -- 172.21.15.8:0/4205512158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac009490 con 0x7ffac4101dc0 2024-03-16T20:54:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.404+0000 7ffac8e00640 1 -- 172.21.15.8:0/4205512158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc009900 con 0x7ffac4101dc0 2024-03-16T20:54:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.406+0000 7ffac8e00640 1 -- 172.21.15.8:0/4205512158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac4108b10 con 0x7ffac4101dc0 2024-03-16T20:54:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.408+0000 7ffac0c00640 1 -- 172.21.15.8:0/4205512158 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7ffab4003b80 con 0x7ffac4101dc0 2024-03-16T20:54:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.410+0000 7ffac0c00640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffaa80a1ab0 0x7ffaa80a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.410+0000 7ffac0c00640 1 -- 172.21.15.8:0/4205512158 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ffab4014070 con 0x7ffac4101dc0 2024-03-16T20:54:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.410+0000 7ffabbe00640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffaa80a1ab0 0x7ffaa80a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.411+0000 7ffabbe00640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffaa80a1ab0 0x7ffaa80a3f70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffac419aba0 tx=0x7ffaac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:27.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.416+0000 7ffac0c00640 1 -- 172.21.15.8:0/4205512158 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ffab4096ab0 con 0x7ffac4101dc0 2024-03-16T20:54:27.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.686+0000 7ffac8e00640 1 -- 172.21.15.8:0/4205512158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffac410ce70 con 0x7ffac4101dc0 2024-03-16T20:54:27.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.688+0000 7ffac0c00640 1 -- 172.21.15.8:0/4205512158 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7ffab409a170 con 0x7ffac4101dc0 2024-03-16T20:54:27.692 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-16T20:54:27.693 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2024-03-16T20:54:27.693 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 20:54:27 smithi008 systemd[1]: Starting Ceph mds.j for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:27.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.690+0000 7ffac8e00640 1 -- 172.21.15.8:0/4205512158 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffaa80a1ab0 msgr2=0x7ffaa80a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:27.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.690+0000 7ffac8e00640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffaa80a1ab0 0x7ffaa80a3f70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffac419aba0 tx=0x7ffaac005f90 comp rx=0 tx=0).stop 2024-03-16T20:54:27.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.690+0000 7ffac8e00640 1 -- 172.21.15.8:0/4205512158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffac4101dc0 msgr2=0x7ffac4199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:27.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.690+0000 7ffac8e00640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffac4101dc0 0x7ffac4199690 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffab400ea60 tx=0x7ffab400ef20 comp rx=0 tx=0).stop 2024-03-16T20:54:27.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.690+0000 7ffac8e00640 1 -- 172.21.15.8:0/4205512158 shutdown_connections 2024-03-16T20:54:27.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.690+0000 7ffac8e00640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffaa80a1ab0 0x7ffaa80a3f70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:27.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.691+0000 7ffac8e00640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffac4107020 0x7ffac41a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:27.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.691+0000 7ffac8e00640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffac41046f0 0x7ffac4199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:27.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.691+0000 7ffac8e00640 1 --2- 172.21.15.8:0/4205512158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffac4101dc0 0x7ffac4199690 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:27.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.691+0000 7ffac8e00640 1 -- 172.21.15.8:0/4205512158 >> 172.21.15.8:0/4205512158 conn(0x7ffac40fb7d0 msgr2=0x7ffac4101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:27.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.691+0000 7ffac8e00640 1 -- 172.21.15.8:0/4205512158 shutdown_connections 2024-03-16T20:54:27.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:27.691+0000 7ffac8e00640 1 -- 172.21.15.8:0/4205512158 wait complete. 2024-03-16T20:54:27.971 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 20:54:27 smithi008 podman[71726]: 2024-03-16 20:54:27.593851474 +0000 UTC m=+0.044282716 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:27.971 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 20:54:27 smithi008 podman[71726]: 2024-03-16 20:54:27.693440148 +0000 UTC m=+0.143871402 container create b241a9c722e56464ccde2b94c0c1584da9616e77d1acdae0b4975519837a9b2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-j, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-03-16T20:54:27.971 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 20:54:27 smithi008 podman[71726]: 2024-03-16 20:54:27.964594491 +0000 UTC m=+0.415025772 container init b241a9c722e56464ccde2b94c0c1584da9616e77d1acdae0b4975519837a9b2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T20:54:28.243 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 20:54:27 smithi008 podman[71726]: 2024-03-16 20:54:27.978964033 +0000 UTC m=+0.429395313 container start b241a9c722e56464ccde2b94c0c1584da9616e77d1acdae0b4975519837a9b2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-j, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-16T20:54:28.243 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 20:54:28 smithi008 ceph-mds[71747]: -- 172.21.15.8:0/685414339 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5615b8cb61a0 con 0x5615b8c8d000 2024-03-16T20:54:28.243 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 20:54:28 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-j[71743]: starting mds.j at 2024-03-16T20:54:28.243 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 20:54:28 smithi008 bash[71726]: b241a9c722e56464ccde2b94c0c1584da9616e77d1acdae0b4975519837a9b2f 2024-03-16T20:54:28.243 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 20:54:28 smithi008 systemd[1]: Started Ceph mds.j for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:28.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:28 smithi008 ceph-mon[31434]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:28.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:28 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/4205512158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:28.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:28 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:28.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:28 smithi170 ceph-mon[35947]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:28.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:28 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/4205512158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:28.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:28 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:28.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:28 smithi186 ceph-mon[36391]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:28.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:28 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/4205512158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:28.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:28 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:29.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:29 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:29.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:29 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.8:6834/1887028715,v1:172.21.15.8:6835/1887028715] up:boot 2024-03-16T20:54:29.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:29 smithi008 ceph-mon[31434]: fsmap 3 up:standby 2024-03-16T20:54:29.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:29 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-16T20:54:29.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:29 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:29.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:29 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:29.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:29 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:29.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:29 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:29.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:29 smithi008 ceph-mon[31434]: Deploying daemon mds.d on smithi008 2024-03-16T20:54:29.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:29 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:29.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:29 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.8:6834/1887028715,v1:172.21.15.8:6835/1887028715] up:boot 2024-03-16T20:54:29.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:29 smithi170 ceph-mon[35947]: fsmap 3 up:standby 2024-03-16T20:54:29.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:29 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-16T20:54:29.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:29 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:29.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:29 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:29.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:29 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:29.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:29 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:29.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:29 smithi170 ceph-mon[35947]: Deploying daemon mds.d on smithi008 2024-03-16T20:54:29.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:29 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:29.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:29 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.8:6834/1887028715,v1:172.21.15.8:6835/1887028715] up:boot 2024-03-16T20:54:29.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:29 smithi186 ceph-mon[36391]: fsmap 3 up:standby 2024-03-16T20:54:29.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:29 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-16T20:54:29.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:29 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:29.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:29 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:29.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:29 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:29.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:29 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:29.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:29 smithi186 ceph-mon[36391]: Deploying daemon mds.d on smithi008 2024-03-16T20:54:29.716 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:29.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.922+0000 7f8e90c00640 1 -- 172.21.15.8:0/1021574528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e8c073f50 msgr2=0x7f8e8c0743d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:29.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.922+0000 7f8e90c00640 1 --2- 172.21.15.8:0/1021574528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e8c073f50 0x7f8e8c0743d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009860 tx=0x7f8e7402bb70 comp rx=0 tx=0).stop 2024-03-16T20:54:29.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.923+0000 7f8e90c00640 1 -- 172.21.15.8:0/1021574528 shutdown_connections 2024-03-16T20:54:29.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.923+0000 7f8e90c00640 1 --2- 172.21.15.8:0/1021574528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e8c109220 0x7f8e8c10b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:29.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.923+0000 7f8e90c00640 1 --2- 172.21.15.8:0/1021574528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e8c073f50 0x7f8e8c0743d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:29.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.923+0000 7f8e90c00640 1 --2- 172.21.15.8:0/1021574528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e8c075530 0x7f8e8c073980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:29.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.923+0000 7f8e90c00640 1 -- 172.21.15.8:0/1021574528 >> 172.21.15.8:0/1021574528 conn(0x7f8e8c0fc8d0 msgr2=0x7f8e8c0fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:29.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.923+0000 7f8e90c00640 1 -- 172.21.15.8:0/1021574528 shutdown_connections 2024-03-16T20:54:29.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.923+0000 7f8e90c00640 1 -- 172.21.15.8:0/1021574528 wait complete. 2024-03-16T20:54:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.924+0000 7f8e90c00640 1 Processor -- start 2024-03-16T20:54:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.924+0000 7f8e90c00640 1 -- start start 2024-03-16T20:54:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.924+0000 7f8e90c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e8c073f50 0x7f8e8c1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.924+0000 7f8e90c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e8c075530 0x7f8e8c199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e90c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e8c109220 0x7f8e8c1a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e90c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c1a11c0 con 0x7f8e8c109220 2024-03-16T20:54:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e90c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c1a1330 con 0x7f8e8c073f50 2024-03-16T20:54:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e90c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c1a14f0 con 0x7f8e8c075530 2024-03-16T20:54:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e8be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e8c109220 0x7f8e8c1a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e8b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e8c073f50 0x7f8e8c1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e8b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e8c073f50 0x7f8e8c1996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35518/0 (socket says 172.21.15.8:35518) 2024-03-16T20:54:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e8b400640 1 -- 172.21.15.8:0/3382783019 learned_addr learned my addr 172.21.15.8:0/3382783019 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e82a00640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e8c075530 0x7f8e8c199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e8b400640 1 -- 172.21.15.8:0/3382783019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e8c075530 msgr2=0x7f8e8c199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e8b400640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e8c075530 0x7f8e8c199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e8b400640 1 -- 172.21.15.8:0/3382783019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e8c109220 msgr2=0x7f8e8c1a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e8b400640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e8c109220 0x7f8e8c1a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e8b400640 1 -- 172.21.15.8:0/3382783019 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e74009490 con 0x7f8e8c073f50 2024-03-16T20:54:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.925+0000 7f8e8be00640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e8c109220 0x7f8e8c1a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:54:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.926+0000 7f8e8b400640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e8c073f50 0x7f8e8c1996d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00e9f0 tx=0x7f8e7c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.926+0000 7f8e88c00640 1 -- 172.21.15.8:0/3382783019 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c009720 con 0x7f8e8c073f50 2024-03-16T20:54:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.926+0000 7f8e90c00640 1 -- 172.21.15.8:0/3382783019 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c1a17d0 con 0x7f8e8c073f50 2024-03-16T20:54:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.926+0000 7f8e88c00640 1 -- 172.21.15.8:0/3382783019 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8e7c00cd80 con 0x7f8e8c073f50 2024-03-16T20:54:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.926+0000 7f8e88c00640 1 -- 172.21.15.8:0/3382783019 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c010690 con 0x7f8e8c073f50 2024-03-16T20:54:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.926+0000 7f8e90c00640 1 -- 172.21.15.8:0/3382783019 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c1a1cb0 con 0x7f8e8c073f50 2024-03-16T20:54:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.927+0000 7f8e90c00640 1 -- 172.21.15.8:0/3382783019 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c107f50 con 0x7f8e8c073f50 2024-03-16T20:54:29.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.929+0000 7f8e88c00640 1 -- 172.21.15.8:0/3382783019 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f8e7c0046c0 con 0x7f8e8c073f50 2024-03-16T20:54:29.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.931+0000 7f8e88c00640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8e700a1a30 0x7f8e700a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:29.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.931+0000 7f8e88c00640 1 -- 172.21.15.8:0/3382783019 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8e7c014070 con 0x7f8e8c073f50 2024-03-16T20:54:29.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.931+0000 7f8e82a00640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8e700a1a30 0x7f8e700a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.932+0000 7f8e82a00640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8e700a1a30 0x7f8e700a3ef0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8e7402c180 tx=0x7f8e74034c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:29.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:29.935+0000 7f8e88c00640 1 -- 172.21.15.8:0/3382783019 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8e7c096980 con 0x7f8e8c073f50 2024-03-16T20:54:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.188+0000 7f8e90c00640 1 -- 172.21.15.8:0/3382783019 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e8c10f080 con 0x7f8e8c073f50 2024-03-16T20:54:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.189+0000 7f8e88c00640 1 -- 172.21.15.8:0/3382783019 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2907 (secure 0 0 0) 0x7f8e7c09a040 con 0x7f8e8c073f50 2024-03-16T20:54:30.194 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:30.194 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2024-03-16T20:54:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 4 2024-03-16T20:54:30.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.192+0000 7f8e90c00640 1 -- 172.21.15.8:0/3382783019 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8e700a1a30 msgr2=0x7f8e700a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:30.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.192+0000 7f8e90c00640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8e700a1a30 0x7f8e700a3ef0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8e7402c180 tx=0x7f8e74034c40 comp rx=0 tx=0).stop 2024-03-16T20:54:30.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.192+0000 7f8e90c00640 1 -- 172.21.15.8:0/3382783019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e8c073f50 msgr2=0x7f8e8c1996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:30.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.192+0000 7f8e90c00640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e8c073f50 0x7f8e8c1996d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00e9f0 tx=0x7f8e7c00edf0 comp rx=0 tx=0).stop 2024-03-16T20:54:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.193+0000 7f8e90c00640 1 -- 172.21.15.8:0/3382783019 shutdown_connections 2024-03-16T20:54:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.193+0000 7f8e90c00640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8e700a1a30 0x7f8e700a3ef0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.193+0000 7f8e90c00640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e8c109220 0x7f8e8c1a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.193+0000 7f8e90c00640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e8c075530 0x7f8e8c199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.193+0000 7f8e90c00640 1 --2- 172.21.15.8:0/3382783019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e8c073f50 0x7f8e8c1996d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.193+0000 7f8e90c00640 1 -- 172.21.15.8:0/3382783019 >> 172.21.15.8:0/3382783019 conn(0x7f8e8c0fc8d0 msgr2=0x7f8e8c105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.193+0000 7f8e90c00640 1 -- 172.21.15.8:0/3382783019 shutdown_connections 2024-03-16T20:54:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:30.193+0000 7f8e90c00640 1 -- 172.21.15.8:0/3382783019 wait complete. 2024-03-16T20:54:30.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:30 smithi008 ceph-mon[31434]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:30.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:30 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3382783019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:30.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:30 smithi170 ceph-mon[35947]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:30.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:30 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3382783019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:30.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:30 smithi186 ceph-mon[36391]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:30.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:30 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3382783019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:31.745 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 20:54:31 smithi008 systemd[1]: Starting Ceph mds.d for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:32.075 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 20:54:31 smithi008 podman[72086]: 2024-03-16 20:54:31.663922942 +0000 UTC m=+0.037354787 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:32.075 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 20:54:31 smithi008 podman[72086]: 2024-03-16 20:54:31.775087004 +0000 UTC m=+0.148518887 container create e439fb0ee71462744f2e7858889b9ef63e5278eedb89f2cc24d446776fc65189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-d, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-16T20:54:32.075 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 20:54:32 smithi008 podman[72086]: 2024-03-16 20:54:32.070577024 +0000 UTC m=+0.444008914 container init e439fb0ee71462744f2e7858889b9ef63e5278eedb89f2cc24d446776fc65189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-d, org.label-schema.build-date=20240307, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-16T20:54:32.218 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:32.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.433+0000 7f2831200640 1 -- 172.21.15.8:0/3939000385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f282c0ffba0 msgr2=0x7f282c101fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:32.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.433+0000 7f2831200640 1 --2- 172.21.15.8:0/3939000385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f282c0ffba0 0x7f282c101fd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f281c009be0 tx=0x7f281c02bef0 comp rx=0 tx=0).stop 2024-03-16T20:54:32.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.433+0000 7f2831200640 1 -- 172.21.15.8:0/3939000385 shutdown_connections 2024-03-16T20:54:32.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.433+0000 7f2831200640 1 --2- 172.21.15.8:0/3939000385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f282c104ec0 0x7f282c105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:32.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.433+0000 7f2831200640 1 --2- 172.21.15.8:0/3939000385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f282c102510 0x7f282c104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:32.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.433+0000 7f2831200640 1 --2- 172.21.15.8:0/3939000385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f282c0ffba0 0x7f282c101fd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:32.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.433+0000 7f2831200640 1 -- 172.21.15.8:0/3939000385 >> 172.21.15.8:0/3939000385 conn(0x7f282c0fb7a0 msgr2=0x7f282c0fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:32.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.433+0000 7f2831200640 1 -- 172.21.15.8:0/3939000385 shutdown_connections 2024-03-16T20:54:32.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.433+0000 7f2831200640 1 -- 172.21.15.8:0/3939000385 wait complete. 2024-03-16T20:54:32.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.434+0000 7f2831200640 1 Processor -- start 2024-03-16T20:54:32.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.434+0000 7f2831200640 1 -- start start 2024-03-16T20:54:32.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f2831200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f282c0ffba0 0x7f282c19da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:32.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f2831200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f282c102510 0x7f282c19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:32.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f2831200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f282c104ec0 0x7f282c1a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:32.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f2831200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c1a5540 con 0x7f282c102510 2024-03-16T20:54:32.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f2831200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c1a56b0 con 0x7f282c104ec0 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f2831200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c1a5870 con 0x7f282c0ffba0 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f282aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f282c102510 0x7f282c19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f282aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f282c102510 0x7f282c19df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55134/0 (socket says 172.21.15.8:55134) 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f282aa00640 1 -- 172.21.15.8:0/10052731 learned_addr learned my addr 172.21.15.8:0/10052731 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f282b400640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f282c0ffba0 0x7f282c19da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f282be00640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f282c104ec0 0x7f282c1a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f282b400640 1 -- 172.21.15.8:0/10052731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f282c104ec0 msgr2=0x7f282c1a5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f282b400640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f282c104ec0 0x7f282c1a5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f282b400640 1 -- 172.21.15.8:0/10052731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f282c102510 msgr2=0x7f282c19df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f282b400640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f282c102510 0x7f282c19df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f282b400640 1 -- 172.21.15.8:0/10052731 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814009560 con 0x7f282c0ffba0 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.435+0000 7f282aa00640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f282c102510 0x7f282c19df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:54:32.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.436+0000 7f282b400640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f282c0ffba0 0x7f282c19da50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f281c02c500 tx=0x7f281c033820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:32.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.436+0000 7f2823e00640 1 -- 172.21.15.8:0/10052731 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c003b80 con 0x7f282c0ffba0 2024-03-16T20:54:32.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.436+0000 7f2823e00640 1 -- 172.21.15.8:0/10052731 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f281c003ce0 con 0x7f282c0ffba0 2024-03-16T20:54:32.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.436+0000 7f2831200640 1 -- 172.21.15.8:0/10052731 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c009840 con 0x7f282c0ffba0 2024-03-16T20:54:32.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.436+0000 7f2823e00640 1 -- 172.21.15.8:0/10052731 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c0349f0 con 0x7f282c0ffba0 2024-03-16T20:54:32.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.436+0000 7f2831200640 1 -- 172.21.15.8:0/10052731 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c1a5e90 con 0x7f282c0ffba0 2024-03-16T20:54:32.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.438+0000 7f2831200640 1 -- 172.21.15.8:0/10052731 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282c0fd290 con 0x7f282c0ffba0 2024-03-16T20:54:32.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.439+0000 7f2823e00640 1 -- 172.21.15.8:0/10052731 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f281c0046b0 con 0x7f282c0ffba0 2024-03-16T20:54:32.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.440+0000 7f2823e00640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f28100a1ab0 0x7f28100a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:32.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.441+0000 7f2823e00640 1 -- 172.21.15.8:0/10052731 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f281c0efe00 con 0x7f282c0ffba0 2024-03-16T20:54:32.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.441+0000 7f282aa00640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f28100a1ab0 0x7f28100a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:32.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.441+0000 7f282aa00640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f28100a1ab0 0x7f28100a3f70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f282c19ef60 tx=0x7f2814009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.445+0000 7f2823e00640 1 -- 172.21.15.8:0/10052731 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f281c0b9410 con 0x7f282c0ffba0 2024-03-16T20:54:32.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:32 smithi008 ceph-mon[31434]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:32.494 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 20:54:32 smithi008 podman[72086]: 2024-03-16 20:54:32.080914403 +0000 UTC m=+0.454346309 container start e439fb0ee71462744f2e7858889b9ef63e5278eedb89f2cc24d446776fc65189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-d, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T20:54:32.494 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 20:54:32 smithi008 ceph-mds[72105]: -- 172.21.15.8:0/3213461954 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5604bf1941a0 con 0x5604bf16b000 2024-03-16T20:54:32.494 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 20:54:32 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-d[72101]: starting mds.d at 2024-03-16T20:54:32.494 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 20:54:32 smithi008 bash[72086]: e439fb0ee71462744f2e7858889b9ef63e5278eedb89f2cc24d446776fc65189 2024-03-16T20:54:32.494 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 20:54:32 smithi008 systemd[1]: Started Ceph mds.d for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:32.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:32 smithi170 ceph-mon[35947]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:32.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:32 smithi186 ceph-mon[36391]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:32.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.688+0000 7f2831200640 1 -- 172.21.15.8:0/10052731 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f282c0fcd00 con 0x7f282c0ffba0 2024-03-16T20:54:32.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.690+0000 7f2823e00640 1 -- 172.21.15.8:0/10052731 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3695 (secure 0 0 0) 0x7f281c0bcad0 con 0x7f282c0ffba0 2024-03-16T20:54:32.695 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:32.695 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2024-03-16T20:54:32.695 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 5 2024-03-16T20:54:32.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.692+0000 7f2831200640 1 -- 172.21.15.8:0/10052731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f28100a1ab0 msgr2=0x7f28100a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:32.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.692+0000 7f2831200640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f28100a1ab0 0x7f28100a3f70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f282c19ef60 tx=0x7f2814009260 comp rx=0 tx=0).stop 2024-03-16T20:54:32.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.692+0000 7f2831200640 1 -- 172.21.15.8:0/10052731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f282c0ffba0 msgr2=0x7f282c19da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:32.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.692+0000 7f2831200640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f282c0ffba0 0x7f282c19da50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f281c02c500 tx=0x7f281c033820 comp rx=0 tx=0).stop 2024-03-16T20:54:32.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.693+0000 7f2831200640 1 -- 172.21.15.8:0/10052731 shutdown_connections 2024-03-16T20:54:32.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.693+0000 7f2831200640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f28100a1ab0 0x7f28100a3f70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:32.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.693+0000 7f2831200640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f282c104ec0 0x7f282c1a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:32.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.693+0000 7f2831200640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f282c102510 0x7f282c19df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:32.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.693+0000 7f2831200640 1 --2- 172.21.15.8:0/10052731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f282c0ffba0 0x7f282c19da50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:32.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.693+0000 7f2831200640 1 -- 172.21.15.8:0/10052731 >> 172.21.15.8:0/10052731 conn(0x7f282c0fb7a0 msgr2=0x7f282c102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:32.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.693+0000 7f2831200640 1 -- 172.21.15.8:0/10052731 shutdown_connections 2024-03-16T20:54:32.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:32.693+0000 7f2831200640 1 -- 172.21.15.8:0/10052731 wait complete. 2024-03-16T20:54:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:33 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.8:6836/3869749427,v1:172.21.15.8:6837/3869749427] up:boot 2024-03-16T20:54:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:33 smithi170 ceph-mon[35947]: fsmap 4 up:standby 2024-03-16T20:54:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-16T20:54:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:33 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:33 smithi170 ceph-mon[35947]: Deploying daemon mds.e on smithi170 2024-03-16T20:54:33.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:33 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/10052731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:33.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:33.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:33 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.8:6836/3869749427,v1:172.21.15.8:6837/3869749427] up:boot 2024-03-16T20:54:33.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:33 smithi186 ceph-mon[36391]: fsmap 4 up:standby 2024-03-16T20:54:33.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-16T20:54:33.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:33.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:33.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:33.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:33.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:33 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:33.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:33 smithi186 ceph-mon[36391]: Deploying daemon mds.e on smithi170 2024-03-16T20:54:33.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:33 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/10052731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:33.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:33.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:33 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.8:6836/3869749427,v1:172.21.15.8:6837/3869749427] up:boot 2024-03-16T20:54:33.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:33 smithi008 ceph-mon[31434]: fsmap 4 up:standby 2024-03-16T20:54:33.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-16T20:54:33.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:33.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:33.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:33.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:33.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:33 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:33.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:33 smithi008 ceph-mon[31434]: Deploying daemon mds.e on smithi170 2024-03-16T20:54:33.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:33 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/10052731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:34.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:34 smithi170 ceph-mon[35947]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:34.617 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 20:54:34 smithi170 systemd[1]: Starting Ceph mds.e for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:34.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:34 smithi186 ceph-mon[36391]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:34.717 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:34.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:34 smithi008 ceph-mon[31434]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.944+0000 7fef67c00640 1 -- 172.21.15.8:0/182605448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef60107b30 msgr2=0x7fef60107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.944+0000 7fef67c00640 1 --2- 172.21.15.8:0/182605448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef60107b30 0x7fef60107f50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fef54009900 tx=0x7fef5402bc40 comp rx=0 tx=0).stop 2024-03-16T20:54:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.945+0000 7fef67c00640 1 -- 172.21.15.8:0/182605448 shutdown_connections 2024-03-16T20:54:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.945+0000 7fef67c00640 1 --2- 172.21.15.8:0/182605448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef601096e0 0x7fef6010ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.945+0000 7fef67c00640 1 --2- 172.21.15.8:0/182605448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef60108d20 0x7fef601091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.945+0000 7fef67c00640 1 --2- 172.21.15.8:0/182605448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef60107b30 0x7fef60107f50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.945+0000 7fef67c00640 1 -- 172.21.15.8:0/182605448 >> 172.21.15.8:0/182605448 conn(0x7fef60076b00 msgr2=0x7fef60078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.945+0000 7fef67c00640 1 -- 172.21.15.8:0/182605448 shutdown_connections 2024-03-16T20:54:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.945+0000 7fef67c00640 1 -- 172.21.15.8:0/182605448 wait complete. 2024-03-16T20:54:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.946+0000 7fef67c00640 1 Processor -- start 2024-03-16T20:54:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.946+0000 7fef67c00640 1 -- start start 2024-03-16T20:54:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.947+0000 7fef67c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef60107b30 0x7fef6019dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.947+0000 7fef67c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef60108d20 0x7fef6019e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.947+0000 7fef67c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef601096e0 0x7fef601a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.947+0000 7fef67c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef601a5790 con 0x7fef60108d20 2024-03-16T20:54:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.947+0000 7fef67c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef601a5900 con 0x7fef601096e0 2024-03-16T20:54:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.947+0000 7fef67c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef601a5ac0 con 0x7fef60107b30 2024-03-16T20:54:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.947+0000 7fef65200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef60107b30 0x7fef6019dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.947+0000 7fef5fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef60108d20 0x7fef6019e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.947+0000 7fef65c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef601096e0 0x7fef601a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.947+0000 7fef65200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef60107b30 0x7fef6019dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:54550/0 (socket says 172.21.15.8:54550) 2024-03-16T20:54:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.947+0000 7fef65200640 1 -- 172.21.15.8:0/3371893974 learned_addr learned my addr 172.21.15.8:0/3371893974 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.948+0000 7fef65200640 1 -- 172.21.15.8:0/3371893974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef601096e0 msgr2=0x7fef601a5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.948+0000 7fef65200640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef601096e0 0x7fef601a5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.948+0000 7fef65200640 1 -- 172.21.15.8:0/3371893974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef60108d20 msgr2=0x7fef6019e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.948+0000 7fef65200640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef60108d20 0x7fef6019e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.948+0000 7fef65200640 1 -- 172.21.15.8:0/3371893974 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c009490 con 0x7fef60107b30 2024-03-16T20:54:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.948+0000 7fef65200640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef60107b30 0x7fef6019dc80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef54000c00 tx=0x7fef54005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.948+0000 7fef5d600640 1 -- 172.21.15.8:0/3371893974 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54004350 con 0x7fef60107b30 2024-03-16T20:54:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.948+0000 7fef5d600640 1 -- 172.21.15.8:0/3371893974 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fef540044b0 con 0x7fef60107b30 2024-03-16T20:54:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.948+0000 7fef5d600640 1 -- 172.21.15.8:0/3371893974 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54003de0 con 0x7fef60107b30 2024-03-16T20:54:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.948+0000 7fef67c00640 1 -- 172.21.15.8:0/3371893974 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef54009560 con 0x7fef60107b30 2024-03-16T20:54:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.949+0000 7fef67c00640 1 -- 172.21.15.8:0/3371893974 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef601a6070 con 0x7fef60107b30 2024-03-16T20:54:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.950+0000 7fef67c00640 1 -- 172.21.15.8:0/3371893974 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6010ed80 con 0x7fef60107b30 2024-03-16T20:54:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.952+0000 7fef5d600640 1 -- 172.21.15.8:0/3371893974 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fef54004e10 con 0x7fef60107b30 2024-03-16T20:54:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.953+0000 7fef5d600640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fef480a1a30 0x7fef480a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.953+0000 7fef5d600640 1 -- 172.21.15.8:0/3371893974 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fef540ef5f0 con 0x7fef60107b30 2024-03-16T20:54:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.953+0000 7fef5fe00640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fef480a1a30 0x7fef480a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.954+0000 7fef5fe00640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fef480a1a30 0x7fef480a3ef0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fef6019f180 tx=0x7fef4c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:34.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:34.957+0000 7fef5d600640 1 -- 172.21.15.8:0/3371893974 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fef540b8c00 con 0x7fef60107b30 2024-03-16T20:54:35.040 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 20:54:34 smithi170 podman[65604]: 2024-03-16 20:54:34.675976935 +0000 UTC m=+0.017903243 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:35.040 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 20:54:34 smithi170 podman[65604]: 2024-03-16 20:54:34.791735371 +0000 UTC m=+0.133661670 container create 5df377e9316f5d730b9493fbae1ee8d90bd3d7c0545a3f0d97ec43648fadad08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-16T20:54:35.040 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 20:54:35 smithi170 podman[65604]: 2024-03-16 20:54:35.036592996 +0000 UTC m=+0.378519304 container init 5df377e9316f5d730b9493fbae1ee8d90bd3d7c0545a3f0d97ec43648fadad08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T20:54:35.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.203+0000 7fef67c00640 1 -- 172.21.15.8:0/3371893974 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef6002d060 con 0x7fef60107b30 2024-03-16T20:54:35.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.204+0000 7fef5d600640 1 -- 172.21.15.8:0/3371893974 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3695 (secure 0 0 0) 0x7fef540bc2c0 con 0x7fef60107b30 2024-03-16T20:54:35.209 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:35.209 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2024-03-16T20:54:35.209 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 5 2024-03-16T20:54:35.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 -- 172.21.15.8:0/3371893974 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fef480a1a30 msgr2=0x7fef480a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:35.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fef480a1a30 0x7fef480a3ef0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fef6019f180 tx=0x7fef4c005f90 comp rx=0 tx=0).stop 2024-03-16T20:54:35.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 -- 172.21.15.8:0/3371893974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef60107b30 msgr2=0x7fef6019dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:35.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef60107b30 0x7fef6019dc80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef54000c00 tx=0x7fef54005dd0 comp rx=0 tx=0).stop 2024-03-16T20:54:35.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 -- 172.21.15.8:0/3371893974 shutdown_connections 2024-03-16T20:54:35.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fef480a1a30 0x7fef480a3ef0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:35.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef601096e0 0x7fef601a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:35.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef60108d20 0x7fef6019e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:35.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 --2- 172.21.15.8:0/3371893974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef60107b30 0x7fef6019dc80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:35.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 -- 172.21.15.8:0/3371893974 >> 172.21.15.8:0/3371893974 conn(0x7fef60076b00 msgr2=0x7fef6010bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:35.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 -- 172.21.15.8:0/3371893974 shutdown_connections 2024-03-16T20:54:35.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:35.207+0000 7fef67c00640 1 -- 172.21.15.8:0/3371893974 wait complete. 2024-03-16T20:54:35.367 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 20:54:35 smithi170 podman[65604]: 2024-03-16 20:54:35.039755457 +0000 UTC m=+0.381681772 container start 5df377e9316f5d730b9493fbae1ee8d90bd3d7c0545a3f0d97ec43648fadad08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-16T20:54:35.367 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 20:54:35 smithi170 ceph-mds[65623]: -- 172.21.15.170:0/1263712893 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5624003941a0 con 0x56240036a800 2024-03-16T20:54:35.367 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 20:54:35 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e[65619]: starting mds.e at 2024-03-16T20:54:35.367 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 20:54:35 smithi170 bash[65604]: 5df377e9316f5d730b9493fbae1ee8d90bd3d7c0545a3f0d97ec43648fadad08 2024-03-16T20:54:35.367 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 20:54:35 smithi170 systemd[1]: Started Ceph mds.e for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:36.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3371893974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: Deploying daemon mds.f on smithi186 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.170:6834/335822502,v1:172.21.15.170:6835/335822502] up:boot 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: fsmap 5 up:standby 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T20:54:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T20:54:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3371893974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: Deploying daemon mds.f on smithi186 2024-03-16T20:54:36.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.170:6834/335822502,v1:172.21.15.170:6835/335822502] up:boot 2024-03-16T20:54:36.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: fsmap 5 up:standby 2024-03-16T20:54:36.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T20:54:36.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T20:54:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3371893974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: Deploying daemon mds.f on smithi186 2024-03-16T20:54:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.170:6834/335822502,v1:172.21.15.170:6835/335822502] up:boot 2024-03-16T20:54:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: fsmap 5 up:standby 2024-03-16T20:54:36.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T20:54:36.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T20:54:37.234 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.465+0000 7fb240000640 1 -- 172.21.15.8:0/2268868844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb238101120 msgr2=0x7fb2381015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.465+0000 7fb240000640 1 --2- 172.21.15.8:0/2268868844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb238101120 0x7fb2381015a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb230009be0 tx=0x7fb23002bf80 comp rx=0 tx=0).stop 2024-03-16T20:54:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.465+0000 7fb240000640 1 -- 172.21.15.8:0/2268868844 shutdown_connections 2024-03-16T20:54:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.465+0000 7fb240000640 1 --2- 172.21.15.8:0/2268868844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb238101120 0x7fb2381015a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.465+0000 7fb240000640 1 --2- 172.21.15.8:0/2268868844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb238100780 0x7fb238100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.465+0000 7fb240000640 1 --2- 172.21.15.8:0/2268868844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2380ffe20 0x7fb238100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.465+0000 7fb240000640 1 -- 172.21.15.8:0/2268868844 >> 172.21.15.8:0/2268868844 conn(0x7fb2380fb9a0 msgr2=0x7fb2380fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.465+0000 7fb240000640 1 -- 172.21.15.8:0/2268868844 shutdown_connections 2024-03-16T20:54:37.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.465+0000 7fb240000640 1 -- 172.21.15.8:0/2268868844 wait complete. 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.466+0000 7fb240000640 1 Processor -- start 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.466+0000 7fb240000640 1 -- start start 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb240000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2380ffe20 0x7fb238199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb240000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb238100780 0x7fb238199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb240000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb238101120 0x7fb2381a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb240000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2381a1350 con 0x7fb238100780 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb240000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2381a14c0 con 0x7fb238101120 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb240000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2381a1680 con 0x7fb2380ffe20 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23d600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2380ffe20 0x7fb238199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb238100780 0x7fb238199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb238101120 0x7fb2381a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:37.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23d600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2380ffe20 0x7fb238199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:54568/0 (socket says 172.21.15.8:54568) 2024-03-16T20:54:37.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb238101120 0x7fb2381a0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35580/0 (socket says 172.21.15.8:35580) 2024-03-16T20:54:37.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23d600640 1 -- 172.21.15.8:0/3483383015 learned_addr learned my addr 172.21.15.8:0/3483383015 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:37.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb238100780 0x7fb238199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55174/0 (socket says 172.21.15.8:55174) 2024-03-16T20:54:37.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23e000640 1 -- 172.21.15.8:0/3483383015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2380ffe20 msgr2=0x7fb238199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:37.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23e000640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2380ffe20 0x7fb238199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:37.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23e000640 1 -- 172.21.15.8:0/3483383015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb238100780 msgr2=0x7fb238199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:37.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23e000640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb238100780 0x7fb238199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:37.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23e000640 1 -- 172.21.15.8:0/3483383015 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb230009840 con 0x7fb238101120 2024-03-16T20:54:37.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23d600640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2380ffe20 0x7fb238199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:54:37.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.467+0000 7fb23cc00640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb238100780 0x7fb238199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:54:37.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.468+0000 7fb23e000640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb238101120 0x7fb2381a0e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb23002c4c0 tx=0x7fb2300042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:37.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.468+0000 7fb236000640 1 -- 172.21.15.8:0/3483383015 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230004720 con 0x7fb238101120 2024-03-16T20:54:37.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.468+0000 7fb236000640 1 -- 172.21.15.8:0/3483383015 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb230004880 con 0x7fb238101120 2024-03-16T20:54:37.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.468+0000 7fb240000640 1 -- 172.21.15.8:0/3483383015 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2381a1900 con 0x7fb238101120 2024-03-16T20:54:37.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.468+0000 7fb236000640 1 -- 172.21.15.8:0/3483383015 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23003e920 con 0x7fb238101120 2024-03-16T20:54:37.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.468+0000 7fb240000640 1 -- 172.21.15.8:0/3483383015 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2381a1de0 con 0x7fb238101120 2024-03-16T20:54:37.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.469+0000 7fb240000640 1 -- 172.21.15.8:0/3483383015 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23810ac80 con 0x7fb238101120 2024-03-16T20:54:37.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.471+0000 7fb236000640 1 -- 172.21.15.8:0/3483383015 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fb23003ea80 con 0x7fb238101120 2024-03-16T20:54:37.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.472+0000 7fb236000640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb2200a1a30 0x7fb2200a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:37.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.473+0000 7fb236000640 1 -- 172.21.15.8:0/3483383015 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb2300efcf0 con 0x7fb238101120 2024-03-16T20:54:37.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.473+0000 7fb23d600640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb2200a1a30 0x7fb2200a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:37.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.474+0000 7fb23d600640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb2200a1a30 0x7fb2200a3ef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0058c0 tx=0x7fb22c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:37.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.477+0000 7fb236000640 1 -- 172.21.15.8:0/3483383015 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb2300b9300 con 0x7fb238101120 2024-03-16T20:54:37.643 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 20:54:37 smithi186 systemd[1]: Starting Ceph mds.f for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:37.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.714+0000 7fb240000640 1 -- 172.21.15.8:0/3483383015 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb23802d000 con 0x7fb238101120 2024-03-16T20:54:37.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.716+0000 7fb236000640 1 -- 172.21.15.8:0/3483383015 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7fb2300bc9c0 con 0x7fb238101120 2024-03-16T20:54:37.720 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:37.720 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2024-03-16T20:54:37.720 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 6 2024-03-16T20:54:37.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.717+0000 7fb240000640 1 -- 172.21.15.8:0/3483383015 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb2200a1a30 msgr2=0x7fb2200a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.717+0000 7fb240000640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb2200a1a30 0x7fb2200a3ef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0058c0 tx=0x7fb22c009260 comp rx=0 tx=0).stop 2024-03-16T20:54:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.717+0000 7fb240000640 1 -- 172.21.15.8:0/3483383015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb238101120 msgr2=0x7fb2381a0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.718+0000 7fb240000640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb238101120 0x7fb2381a0e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb23002c4c0 tx=0x7fb2300042e0 comp rx=0 tx=0).stop 2024-03-16T20:54:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.718+0000 7fb240000640 1 -- 172.21.15.8:0/3483383015 shutdown_connections 2024-03-16T20:54:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.718+0000 7fb240000640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb2200a1a30 0x7fb2200a3ef0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.718+0000 7fb240000640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb238101120 0x7fb2381a0e10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.718+0000 7fb240000640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb238100780 0x7fb238199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.718+0000 7fb240000640 1 --2- 172.21.15.8:0/3483383015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2380ffe20 0x7fb238199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.718+0000 7fb240000640 1 -- 172.21.15.8:0/3483383015 >> 172.21.15.8:0/3483383015 conn(0x7fb2380fb9a0 msgr2=0x7fb2380fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.718+0000 7fb240000640 1 -- 172.21.15.8:0/3483383015 shutdown_connections 2024-03-16T20:54:37.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:37.718+0000 7fb240000640 1 -- 172.21.15.8:0/3483383015 wait complete. 2024-03-16T20:54:38.053 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 20:54:37 smithi186 podman[67238]: 2024-03-16 20:54:37.677122615 +0000 UTC m=+0.018079495 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:38.053 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 20:54:37 smithi186 podman[67238]: 2024-03-16 20:54:37.805089378 +0000 UTC m=+0.146046245 container create e33f94b835df830442a67e177e99c5be458dd346ecacd4529a31d750c74e4df0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-16T20:54:38.053 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 20:54:38 smithi186 podman[67238]: 2024-03-16 20:54:38.04963781 +0000 UTC m=+0.390594691 container init e33f94b835df830442a67e177e99c5be458dd346ecacd4529a31d750c74e4df0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T20:54:38.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:38 smithi186 ceph-mon[36391]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:38.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:38 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3483383015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:38.393 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 20:54:38 smithi186 podman[67238]: 2024-03-16 20:54:38.05244864 +0000 UTC m=+0.393405511 container start e33f94b835df830442a67e177e99c5be458dd346ecacd4529a31d750c74e4df0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T20:54:38.393 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 20:54:38 smithi186 ceph-mds[67257]: -- 172.21.15.186:0/1883383251 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e0483281a0 con 0x55e0482ff000 2024-03-16T20:54:38.393 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 20:54:38 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f[67253]: starting mds.f at 2024-03-16T20:54:38.393 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 20:54:38 smithi186 bash[67238]: e33f94b835df830442a67e177e99c5be458dd346ecacd4529a31d750c74e4df0 2024-03-16T20:54:38.393 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 20:54:38 smithi186 systemd[1]: Started Ceph mds.f for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:38.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:38 smithi008 ceph-mon[31434]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:38.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:38 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3483383015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:38.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:38 smithi170 ceph-mon[35947]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:38.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:38 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3483383015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:39.486 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:39 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:39.486 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:39 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.186:6834/3505833451,v1:172.21.15.186:6835/3505833451] up:boot 2024-03-16T20:54:39.486 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:39 smithi186 ceph-mon[36391]: fsmap 6 up:standby 2024-03-16T20:54:39.487 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:39 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T20:54:39.487 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:39 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:39.487 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:39 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:39.487 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:39 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:39.487 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:39 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:39.487 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:39 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:39.487 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:39 smithi186 ceph-mon[36391]: Deploying daemon mds.c on smithi186 2024-03-16T20:54:39.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:39.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:39 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.186:6834/3505833451,v1:172.21.15.186:6835/3505833451] up:boot 2024-03-16T20:54:39.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:39 smithi008 ceph-mon[31434]: fsmap 6 up:standby 2024-03-16T20:54:39.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T20:54:39.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:39.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:39.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:39.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:39.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:39.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:39 smithi008 ceph-mon[31434]: Deploying daemon mds.c on smithi186 2024-03-16T20:54:39.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:39 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:39.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:39 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.186:6834/3505833451,v1:172.21.15.186:6835/3505833451] up:boot 2024-03-16T20:54:39.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:39 smithi170 ceph-mon[35947]: fsmap 6 up:standby 2024-03-16T20:54:39.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:39 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T20:54:39.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:39 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:39.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:39 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:39.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:39 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:39.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:39 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:39.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:39 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:39.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:39 smithi170 ceph-mon[35947]: Deploying daemon mds.c on smithi186 2024-03-16T20:54:39.741 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.972+0000 7f6360a00640 1 -- 172.21.15.8:0/1562027666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635c075530 msgr2=0x7f635c073980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.972+0000 7f6360a00640 1 --2- 172.21.15.8:0/1562027666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635c075530 0x7f635c073980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f634c009900 tx=0x7f634c02bc50 comp rx=0 tx=0).stop 2024-03-16T20:54:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.972+0000 7f6360a00640 1 -- 172.21.15.8:0/1562027666 shutdown_connections 2024-03-16T20:54:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.972+0000 7f6360a00640 1 --2- 172.21.15.8:0/1562027666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f635c1091f0 0x7f635c10b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.972+0000 7f6360a00640 1 --2- 172.21.15.8:0/1562027666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c073f50 0x7f635c0743d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.972+0000 7f6360a00640 1 --2- 172.21.15.8:0/1562027666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635c075530 0x7f635c073980 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.972+0000 7f6360a00640 1 -- 172.21.15.8:0/1562027666 >> 172.21.15.8:0/1562027666 conn(0x7f635c0fc8a0 msgr2=0x7f635c0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.972+0000 7f6360a00640 1 -- 172.21.15.8:0/1562027666 shutdown_connections 2024-03-16T20:54:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.972+0000 7f6360a00640 1 -- 172.21.15.8:0/1562027666 wait complete. 2024-03-16T20:54:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.972+0000 7f6360a00640 1 Processor -- start 2024-03-16T20:54:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.972+0000 7f6360a00640 1 -- start start 2024-03-16T20:54:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f6360a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f635c073f50 0x7f635c1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f6360a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c075530 0x7f635c199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f6360a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635c1091f0 0x7f635c1a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f6360a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c1a11d0 con 0x7f635c073f50 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f6360a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c1a1340 con 0x7f635c075530 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f6360a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c1a1500 con 0x7f635c1091f0 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f635a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f635c073f50 0x7f635c1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f635a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f635c073f50 0x7f635c1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32864/0 (socket says 172.21.15.8:32864) 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f635a800640 1 -- 172.21.15.8:0/2817184619 learned_addr learned my addr 172.21.15.8:0/2817184619 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f6359e00640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c075530 0x7f635c199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f635b200640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635c1091f0 0x7f635c1a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.973+0000 7f635a800640 1 -- 172.21.15.8:0/2817184619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635c1091f0 msgr2=0x7f635c1a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f635a800640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635c1091f0 0x7f635c1a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f635a800640 1 -- 172.21.15.8:0/2817184619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c075530 msgr2=0x7f635c199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f635a800640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c075530 0x7f635c199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f635a800640 1 -- 172.21.15.8:0/2817184619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c009560 con 0x7f635c073f50 2024-03-16T20:54:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f6359e00640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c075530 0x7f635c199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:54:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f635b200640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635c1091f0 0x7f635c1a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:54:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f635a800640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f635c073f50 0x7f635c1996e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f634c02c930 tx=0x7f634c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f6353400640 1 -- 172.21.15.8:0/2817184619 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c005010 con 0x7f635c073f50 2024-03-16T20:54:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f6360a00640 1 -- 172.21.15.8:0/2817184619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635c1a1780 con 0x7f635c073f50 2024-03-16T20:54:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f6353400640 1 -- 172.21.15.8:0/2817184619 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f634c005670 con 0x7f635c073f50 2024-03-16T20:54:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f6353400640 1 -- 172.21.15.8:0/2817184619 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c003ea0 con 0x7f635c073f50 2024-03-16T20:54:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.974+0000 7f6360a00640 1 -- 172.21.15.8:0/2817184619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635c1a1c80 con 0x7f635c073f50 2024-03-16T20:54:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.976+0000 7f6360a00640 1 -- 172.21.15.8:0/2817184619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635c107f20 con 0x7f635c073f50 2024-03-16T20:54:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.977+0000 7f6353400640 1 -- 172.21.15.8:0/2817184619 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f634c0037f0 con 0x7f635c073f50 2024-03-16T20:54:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.981+0000 7f6353400640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f63400a1ab0 0x7f63400a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.981+0000 7f6353400640 1 -- 172.21.15.8:0/2817184619 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f634c0ef700 con 0x7f635c073f50 2024-03-16T20:54:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.981+0000 7f6359e00640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f63400a1ab0 0x7f63400a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.981+0000 7f6359e00640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f63400a1ab0 0x7f63400a3f70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f635c19abf0 tx=0x7f634800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:39.984+0000 7f6353400640 1 -- 172.21.15.8:0/2817184619 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f634c0b8dc0 con 0x7f635c073f50 2024-03-16T20:54:40.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.230+0000 7f6360a00640 1 -- 172.21.15.8:0/2817184619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f635c02cf90 con 0x7f635c073f50 2024-03-16T20:54:40.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.231+0000 7f6353400640 1 -- 172.21.15.8:0/2817184619 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5280 (secure 0 0 0) 0x7f634c0bc480 con 0x7f635c073f50 2024-03-16T20:54:40.236 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:40.236 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2024-03-16T20:54:40.236 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 7 2024-03-16T20:54:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 -- 172.21.15.8:0/2817184619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f63400a1ab0 msgr2=0x7f63400a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f63400a1ab0 0x7f63400a3f70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f635c19abf0 tx=0x7f634800b390 comp rx=0 tx=0).stop 2024-03-16T20:54:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 -- 172.21.15.8:0/2817184619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f635c073f50 msgr2=0x7f635c1996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f635c073f50 0x7f635c1996e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f634c02c930 tx=0x7f634c004270 comp rx=0 tx=0).stop 2024-03-16T20:54:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 -- 172.21.15.8:0/2817184619 shutdown_connections 2024-03-16T20:54:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f63400a1ab0 0x7f63400a3f70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635c1091f0 0x7f635c1a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f635c075530 0x7f635c199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 --2- 172.21.15.8:0/2817184619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f635c073f50 0x7f635c1996e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 -- 172.21.15.8:0/2817184619 >> 172.21.15.8:0/2817184619 conn(0x7f635c0fc8a0 msgr2=0x7f635c1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 -- 172.21.15.8:0/2817184619 shutdown_connections 2024-03-16T20:54:40.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:40.234+0000 7f6360a00640 1 -- 172.21.15.8:0/2817184619 wait complete. 2024-03-16T20:54:40.534 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:40 smithi008 ceph-mon[31434]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:40.535 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:40 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2817184619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:40.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:40 smithi170 ceph-mon[35947]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:40.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:40 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2817184619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:40.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:40 smithi186 ceph-mon[36391]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:40.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:40 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2817184619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:40.643 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 20:54:40 smithi186 systemd[1]: Starting Ceph mds.c for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:40.976 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 20:54:40 smithi186 podman[67563]: 2024-03-16 20:54:40.612153934 +0000 UTC m=+0.018556139 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:40.976 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 20:54:40 smithi186 podman[67563]: 2024-03-16 20:54:40.718981256 +0000 UTC m=+0.125383461 container create 54671af5a324e2baa2e257d91e5b99c1caf26d522f5181d40117d928763bc3c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2) 2024-03-16T20:54:40.976 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 20:54:40 smithi186 podman[67563]: 2024-03-16 20:54:40.946454184 +0000 UTC m=+0.352856402 container init 54671af5a324e2baa2e257d91e5b99c1caf26d522f5181d40117d928763bc3c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-16T20:54:40.976 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 20:54:40 smithi186 podman[67563]: 2024-03-16 20:54:40.949150035 +0000 UTC m=+0.355552232 container start 54671af5a324e2baa2e257d91e5b99c1caf26d522f5181d40117d928763bc3c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-16T20:54:41.392 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 20:54:40 smithi186 ceph-mds[67582]: -- 172.21.15.186:0/81815921 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562a390c41a0 con 0x562a3909a800 2024-03-16T20:54:41.393 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 20:54:40 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c[67578]: starting mds.c at 2024-03-16T20:54:41.393 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 20:54:41 smithi186 bash[67563]: 54671af5a324e2baa2e257d91e5b99c1caf26d522f5181d40117d928763bc3c5 2024-03-16T20:54:41.393 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 20:54:41 smithi186 systemd[1]: Started Ceph mds.c for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:42.262 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:42.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:42 smithi170 ceph-mon[35947]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:42.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:42 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:42.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:42 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:42.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:42 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:42.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:42 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:42.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:42 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:42.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:42 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:42.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:42 smithi170 ceph-mon[35947]: Deploying daemon mds.h on smithi170 2024-03-16T20:54:42.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:42 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.186:6836/1748602428,v1:172.21.15.186:6837/1748602428] up:boot 2024-03-16T20:54:42.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:42 smithi170 ceph-mon[35947]: fsmap 7 up:standby 2024-03-16T20:54:42.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:42 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T20:54:42.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:42 smithi186 ceph-mon[36391]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:42.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:42 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:42.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:42 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:42.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:42 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:42.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:42 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:42.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:42 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:42.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:42 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:42.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:42 smithi186 ceph-mon[36391]: Deploying daemon mds.h on smithi170 2024-03-16T20:54:42.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:42 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.186:6836/1748602428,v1:172.21.15.186:6837/1748602428] up:boot 2024-03-16T20:54:42.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:42 smithi186 ceph-mon[36391]: fsmap 7 up:standby 2024-03-16T20:54:42.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:42 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T20:54:42.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:42 smithi008 ceph-mon[31434]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:42 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:42 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:42 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:42 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:42 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:42 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:42 smithi008 ceph-mon[31434]: Deploying daemon mds.h on smithi170 2024-03-16T20:54:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:42 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.186:6836/1748602428,v1:172.21.15.186:6837/1748602428] up:boot 2024-03-16T20:54:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:42 smithi008 ceph-mon[31434]: fsmap 7 up:standby 2024-03-16T20:54:42.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:42 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T20:54:42.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.493+0000 7f547a000640 1 -- 172.21.15.8:0/3249605425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5474103730 msgr2=0x7f5474103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:42.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.493+0000 7f547a000640 1 --2- 172.21.15.8:0/3249605425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5474103730 0x7f5474103b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5464009900 tx=0x7f546402bc30 comp rx=0 tx=0).stop 2024-03-16T20:54:42.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.493+0000 7f547a000640 1 -- 172.21.15.8:0/3249605425 shutdown_connections 2024-03-16T20:54:42.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.493+0000 7f547a000640 1 --2- 172.21.15.8:0/3249605425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54741052e0 0x7f547410bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:42.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.493+0000 7f547a000640 1 --2- 172.21.15.8:0/3249605425 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5474104920 0x7f5474104da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:42.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.493+0000 7f547a000640 1 --2- 172.21.15.8:0/3249605425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5474103730 0x7f5474103b50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:42.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.493+0000 7f547a000640 1 -- 172.21.15.8:0/3249605425 >> 172.21.15.8:0/3249605425 conn(0x7f54740feca0 msgr2=0x7f54741010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:42.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.493+0000 7f547a000640 1 -- 172.21.15.8:0/3249605425 shutdown_connections 2024-03-16T20:54:42.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.493+0000 7f547a000640 1 -- 172.21.15.8:0/3249605425 wait complete. 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.494+0000 7f547a000640 1 Processor -- start 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.494+0000 7f547a000640 1 -- start start 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f547a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5474103730 0x7f54741998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f547a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5474104920 0x7f5474199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f547a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54741052e0 0x7f54741a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f547a000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54741a13a0 con 0x7f5474103730 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f547a000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54741a1510 con 0x7f54741052e0 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f547a000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54741a16d0 con 0x7f5474104920 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f5473400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5474103730 0x7f54741998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f5473400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5474103730 0x7f54741998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32886/0 (socket says 172.21.15.8:32886) 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f5473400640 1 -- 172.21.15.8:0/3452723486 learned_addr learned my addr 172.21.15.8:0/3452723486 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f5472a00640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5474104920 0x7f5474199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:42.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f5473e00640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54741052e0 0x7f54741a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:42.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f5473400640 1 -- 172.21.15.8:0/3452723486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5474104920 msgr2=0x7f5474199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:42.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f5473400640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5474104920 0x7f5474199df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:42.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f5473400640 1 -- 172.21.15.8:0/3452723486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54741052e0 msgr2=0x7f54741a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:42.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f5473400640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54741052e0 0x7f54741a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:42.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.495+0000 7f5473400640 1 -- 172.21.15.8:0/3452723486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460009490 con 0x7f5474103730 2024-03-16T20:54:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.496+0000 7f5473400640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5474103730 0x7f54741998b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5464000c00 tx=0x7f5464005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.496+0000 7f546be00640 1 -- 172.21.15.8:0/3452723486 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464004350 con 0x7f5474103730 2024-03-16T20:54:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.496+0000 7f546be00640 1 -- 172.21.15.8:0/3452723486 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f54640044b0 con 0x7f5474103730 2024-03-16T20:54:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.496+0000 7f547a000640 1 -- 172.21.15.8:0/3452723486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546c009840 con 0x7f5474103730 2024-03-16T20:54:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.496+0000 7f546be00640 1 -- 172.21.15.8:0/3452723486 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464003d00 con 0x7f5474103730 2024-03-16T20:54:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.496+0000 7f547a000640 1 -- 172.21.15.8:0/3452723486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5464009560 con 0x7f5474103730 2024-03-16T20:54:42.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.497+0000 7f547a000640 1 -- 172.21.15.8:0/3452723486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5474068730 con 0x7f5474103730 2024-03-16T20:54:42.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.499+0000 7f546be00640 1 -- 172.21.15.8:0/3452723486 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f5464004e10 con 0x7f5474103730 2024-03-16T20:54:42.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.501+0000 7f546be00640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54580a1a30 0x7f54580a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:42.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.501+0000 7f546be00640 1 -- 172.21.15.8:0/3452723486 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f54640ef560 con 0x7f5474103730 2024-03-16T20:54:42.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.501+0000 7f5472a00640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54580a1a30 0x7f54580a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:42.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.502+0000 7f5472a00640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54580a1a30 0x7f54580a3ef0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f547419adc0 tx=0x7f5460005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:42.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.505+0000 7f546be00640 1 -- 172.21.15.8:0/3452723486 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f54640b8c10 con 0x7f5474103730 2024-03-16T20:54:42.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.748+0000 7f547a000640 1 -- 172.21.15.8:0/3452723486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f547410a9f0 con 0x7f5474103730 2024-03-16T20:54:42.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.749+0000 7f546be00640 1 -- 172.21.15.8:0/3452723486 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6074 (secure 0 0 0) 0x7f5464003e60 con 0x7f5474103730 2024-03-16T20:54:42.752 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:42.753 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2024-03-16T20:54:42.753 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2024-03-16T20:54:42.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.751+0000 7f547a000640 1 -- 172.21.15.8:0/3452723486 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54580a1a30 msgr2=0x7f54580a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:42.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.751+0000 7f547a000640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54580a1a30 0x7f54580a3ef0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f547419adc0 tx=0x7f5460005f90 comp rx=0 tx=0).stop 2024-03-16T20:54:42.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.751+0000 7f547a000640 1 -- 172.21.15.8:0/3452723486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5474103730 msgr2=0x7f54741998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.751+0000 7f547a000640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5474103730 0x7f54741998b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5464000c00 tx=0x7f5464005dc0 comp rx=0 tx=0).stop 2024-03-16T20:54:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.752+0000 7f547a000640 1 -- 172.21.15.8:0/3452723486 shutdown_connections 2024-03-16T20:54:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.752+0000 7f547a000640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54580a1a30 0x7f54580a3ef0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.752+0000 7f547a000640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54741052e0 0x7f54741a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.752+0000 7f547a000640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5474104920 0x7f5474199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.752+0000 7f547a000640 1 --2- 172.21.15.8:0/3452723486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5474103730 0x7f54741998b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.752+0000 7f547a000640 1 -- 172.21.15.8:0/3452723486 >> 172.21.15.8:0/3452723486 conn(0x7f54740feca0 msgr2=0x7f5474107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.752+0000 7f547a000640 1 -- 172.21.15.8:0/3452723486 shutdown_connections 2024-03-16T20:54:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:42.752+0000 7f547a000640 1 -- 172.21.15.8:0/3452723486 wait complete. 2024-03-16T20:54:43.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:43 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3452723486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:43.367 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 20:54:43 smithi170 systemd[1]: Starting Ceph mds.h for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:43.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:43 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3452723486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:43.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:43 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3452723486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:43.752 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 20:54:43 smithi170 podman[65925]: 2024-03-16 20:54:43.37953984 +0000 UTC m=+0.018133226 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:43.753 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 20:54:43 smithi170 podman[65925]: 2024-03-16 20:54:43.505060002 +0000 UTC m=+0.143653420 container create d4ad7e0332a297fc5b0a88228fb6a0c533ca6dbfa964d9710c5c3519f9b34331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h, org.label-schema.build-date=20240307, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T20:54:44.117 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 20:54:43 smithi170 podman[65925]: 2024-03-16 20:54:43.749373435 +0000 UTC m=+0.387966822 container init d4ad7e0332a297fc5b0a88228fb6a0c533ca6dbfa964d9710c5c3519f9b34331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T20:54:44.117 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 20:54:43 smithi170 podman[65925]: 2024-03-16 20:54:43.751924049 +0000 UTC m=+0.390517434 container start d4ad7e0332a297fc5b0a88228fb6a0c533ca6dbfa964d9710c5c3519f9b34331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-16T20:54:44.117 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 20:54:43 smithi170 ceph-mds[65944]: -- 172.21.15.170:0/2576741706 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55840fdb01a0 con 0x55840fd86c00 2024-03-16T20:54:44.117 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 20:54:43 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h[65940]: starting mds.h at 2024-03-16T20:54:44.117 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 20:54:43 smithi170 bash[65925]: d4ad7e0332a297fc5b0a88228fb6a0c533ca6dbfa964d9710c5c3519f9b34331 2024-03-16T20:54:44.117 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 20:54:43 smithi170 systemd[1]: Started Ceph mds.h for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:44.776 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.007+0000 7f2445e00640 1 -- 172.21.15.8:0/3385073854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2440103730 msgr2=0x7f2440103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.007+0000 7f2445e00640 1 --2- 172.21.15.8:0/3385073854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2440103730 0x7f2440103b50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2430009900 tx=0x7f243002bc30 comp rx=0 tx=0).stop 2024-03-16T20:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.008+0000 7f2445e00640 1 -- 172.21.15.8:0/3385073854 shutdown_connections 2024-03-16T20:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.008+0000 7f2445e00640 1 --2- 172.21.15.8:0/3385073854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24401052e0 0x7f244010bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.008+0000 7f2445e00640 1 --2- 172.21.15.8:0/3385073854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2440104920 0x7f2440104da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.008+0000 7f2445e00640 1 --2- 172.21.15.8:0/3385073854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2440103730 0x7f2440103b50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.008+0000 7f2445e00640 1 -- 172.21.15.8:0/3385073854 >> 172.21.15.8:0/3385073854 conn(0x7f24400fece0 msgr2=0x7f2440101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.008+0000 7f2445e00640 1 -- 172.21.15.8:0/3385073854 shutdown_connections 2024-03-16T20:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.008+0000 7f2445e00640 1 -- 172.21.15.8:0/3385073854 wait complete. 2024-03-16T20:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.009+0000 7f2445e00640 1 Processor -- start 2024-03-16T20:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.009+0000 7f2445e00640 1 -- start start 2024-03-16T20:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f2445e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2440103730 0x7f24401998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f2445e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2440104920 0x7f2440199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f2445e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24401052e0 0x7f24401a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f2445e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24401a13a0 con 0x7f24401052e0 2024-03-16T20:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f2445e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24401a1510 con 0x7f2440103730 2024-03-16T20:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f2445e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24401a16d0 con 0x7f2440104920 2024-03-16T20:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f243e000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2440104920 0x7f2440199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f243e000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2440104920 0x7f2440199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59312/0 (socket says 172.21.15.8:59312) 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f243e000640 1 -- 172.21.15.8:0/2278072762 learned_addr learned my addr 172.21.15.8:0/2278072762 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f243ea00640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2440103730 0x7f24401998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f243f400640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24401052e0 0x7f24401a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f243e000640 1 -- 172.21.15.8:0/2278072762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2440103730 msgr2=0x7f24401998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f243e000640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2440103730 0x7f24401998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f243e000640 1 -- 172.21.15.8:0/2278072762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24401052e0 msgr2=0x7f24401a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f243e000640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24401052e0 0x7f24401a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f243e000640 1 -- 172.21.15.8:0/2278072762 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c009490 con 0x7f2440104920 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.010+0000 7f243f400640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24401052e0 0x7f24401a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.011+0000 7f243e000640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2440104920 0x7f2440199df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f242c00ea60 tx=0x7f242c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.011+0000 7f2444a00640 1 -- 172.21.15.8:0/2278072762 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c00cde0 con 0x7f2440104920 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.011+0000 7f2445e00640 1 -- 172.21.15.8:0/2278072762 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2438009840 con 0x7f2440104920 2024-03-16T20:54:45.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.011+0000 7f2444a00640 1 -- 172.21.15.8:0/2278072762 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f242c0035f0 con 0x7f2440104920 2024-03-16T20:54:45.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.011+0000 7f2444a00640 1 -- 172.21.15.8:0/2278072762 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c010670 con 0x7f2440104920 2024-03-16T20:54:45.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.011+0000 7f2445e00640 1 -- 172.21.15.8:0/2278072762 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2430009560 con 0x7f2440104920 2024-03-16T20:54:45.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.012+0000 7f2445e00640 1 -- 172.21.15.8:0/2278072762 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244010a9f0 con 0x7f2440104920 2024-03-16T20:54:45.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.014+0000 7f2444a00640 1 -- 172.21.15.8:0/2278072762 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f242c003b80 con 0x7f2440104920 2024-03-16T20:54:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.017+0000 7f2444a00640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f24240a1ab0 0x7f24240a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.017+0000 7f2444a00640 1 -- 172.21.15.8:0/2278072762 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f242c014070 con 0x7f2440104920 2024-03-16T20:54:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.017+0000 7f243ea00640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f24240a1ab0 0x7f24240a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.018+0000 7f243ea00640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f24240a1ab0 0x7f24240a3f70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f243002c170 tx=0x7f2430000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:45.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.020+0000 7f2444a00640 1 -- 172.21.15.8:0/2278072762 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f242c096b00 con 0x7f2440104920 2024-03-16T20:54:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:44 smithi186 ceph-mon[36391]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:44 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] up:boot 2024-03-16T20:54:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:44 smithi186 ceph-mon[36391]: fsmap 8 up:standby 2024-03-16T20:54:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:44 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T20:54:45.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:44 smithi008 ceph-mon[31434]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:45.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:45.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:45.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:45.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:45.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:45.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:45.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:44 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] up:boot 2024-03-16T20:54:45.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:44 smithi008 ceph-mon[31434]: fsmap 8 up:standby 2024-03-16T20:54:45.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:44 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T20:54:45.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.265+0000 7f2445e00640 1 -- 172.21.15.8:0/2278072762 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f244010f2b0 con 0x7f2440104920 2024-03-16T20:54:45.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.267+0000 7f2444a00640 1 -- 172.21.15.8:0/2278072762 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6868 (secure 0 0 0) 0x7f242c09a1c0 con 0x7f2440104920 2024-03-16T20:54:45.270 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:45.271 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2024-03-16T20:54:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2024-03-16T20:54:45.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.269+0000 7f2445e00640 1 -- 172.21.15.8:0/2278072762 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f24240a1ab0 msgr2=0x7f24240a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:45.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.269+0000 7f2445e00640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f24240a1ab0 0x7f24240a3f70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f243002c170 tx=0x7f2430000bc0 comp rx=0 tx=0).stop 2024-03-16T20:54:45.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.269+0000 7f2445e00640 1 -- 172.21.15.8:0/2278072762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2440104920 msgr2=0x7f2440199df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:45.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.269+0000 7f2445e00640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2440104920 0x7f2440199df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f242c00ea60 tx=0x7f242c00ef20 comp rx=0 tx=0).stop 2024-03-16T20:54:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.270+0000 7f2445e00640 1 -- 172.21.15.8:0/2278072762 shutdown_connections 2024-03-16T20:54:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.270+0000 7f2445e00640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f24240a1ab0 0x7f24240a3f70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.270+0000 7f2445e00640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24401052e0 0x7f24401a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.270+0000 7f2445e00640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2440104920 0x7f2440199df0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.270+0000 7f2445e00640 1 --2- 172.21.15.8:0/2278072762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2440103730 0x7f24401998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.270+0000 7f2445e00640 1 -- 172.21.15.8:0/2278072762 >> 172.21.15.8:0/2278072762 conn(0x7f24400fece0 msgr2=0x7f2440107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.270+0000 7f2445e00640 1 -- 172.21.15.8:0/2278072762 shutdown_connections 2024-03-16T20:54:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:45.270+0000 7f2445e00640 1 -- 172.21.15.8:0/2278072762 wait complete. 2024-03-16T20:54:45.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:44 smithi170 ceph-mon[35947]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:45.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:45.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:45.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:45.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:45.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:45.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:45.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:44 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] up:boot 2024-03-16T20:54:45.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:44 smithi170 ceph-mon[35947]: fsmap 8 up:standby 2024-03-16T20:54:45.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:44 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T20:54:46.107 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:45 smithi186 ceph-mon[36391]: Deploying daemon mds.i on smithi186 2024-03-16T20:54:46.107 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:45 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2278072762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:46.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:45 smithi008 ceph-mon[31434]: Deploying daemon mds.i on smithi186 2024-03-16T20:54:46.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:45 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2278072762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:46.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:45 smithi170 ceph-mon[35947]: Deploying daemon mds.i on smithi186 2024-03-16T20:54:46.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:45 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2278072762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:46.392 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 20:54:46 smithi186 systemd[1]: Starting Ceph mds.i for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:46.796 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 20:54:46 smithi186 podman[67871]: 2024-03-16 20:54:46.41209716 +0000 UTC m=+0.018153007 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:46.796 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 20:54:46 smithi186 podman[67871]: 2024-03-16 20:54:46.522461188 +0000 UTC m=+0.128517016 container create d621d4c7b2006ca0d657b468743e59b718e317f4a7d468340708c7606799549b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=) 2024-03-16T20:54:46.796 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 20:54:46 smithi186 podman[67871]: 2024-03-16 20:54:46.792145949 +0000 UTC m=+0.398201773 container init d621d4c7b2006ca0d657b468743e59b718e317f4a7d468340708c7606799549b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-16T20:54:47.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:46 smithi186 ceph-mon[36391]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:47.143 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 20:54:46 smithi186 podman[67871]: 2024-03-16 20:54:46.79477101 +0000 UTC m=+0.400826842 container start d621d4c7b2006ca0d657b468743e59b718e317f4a7d468340708c7606799549b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-16T20:54:47.143 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 20:54:46 smithi186 ceph-mds[67890]: -- 172.21.15.186:0/2923630577 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55767337a1a0 con 0x557673350c00 2024-03-16T20:54:47.143 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 20:54:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i[67886]: starting mds.i at 2024-03-16T20:54:47.143 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 20:54:46 smithi186 bash[67871]: d621d4c7b2006ca0d657b468743e59b718e317f4a7d468340708c7606799549b 2024-03-16T20:54:47.143 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 20:54:46 smithi186 systemd[1]: Started Ceph mds.i for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:47.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:46 smithi008 ceph-mon[31434]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:47.293 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:47.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:46 smithi170 ceph-mon[35947]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:47.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.509+0000 7fb528a00640 1 -- 172.21.15.8:0/2806809134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb524103730 msgr2=0x7fb524103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:47.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.509+0000 7fb528a00640 1 --2- 172.21.15.8:0/2806809134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb524103730 0x7fb524103b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb514009900 tx=0x7fb51402bc30 comp rx=0 tx=0).stop 2024-03-16T20:54:47.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.509+0000 7fb528a00640 1 -- 172.21.15.8:0/2806809134 shutdown_connections 2024-03-16T20:54:47.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.509+0000 7fb528a00640 1 --2- 172.21.15.8:0/2806809134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5241052e0 0x7fb52410bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:47.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.509+0000 7fb528a00640 1 --2- 172.21.15.8:0/2806809134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb524104920 0x7fb524104da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:47.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.509+0000 7fb528a00640 1 --2- 172.21.15.8:0/2806809134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb524103730 0x7fb524103b50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:47.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.509+0000 7fb528a00640 1 -- 172.21.15.8:0/2806809134 >> 172.21.15.8:0/2806809134 conn(0x7fb5240feca0 msgr2=0x7fb5241010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:47.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.509+0000 7fb528a00640 1 -- 172.21.15.8:0/2806809134 shutdown_connections 2024-03-16T20:54:47.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.509+0000 7fb528a00640 1 -- 172.21.15.8:0/2806809134 wait complete. 2024-03-16T20:54:47.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.510+0000 7fb528a00640 1 Processor -- start 2024-03-16T20:54:47.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.510+0000 7fb528a00640 1 -- start start 2024-03-16T20:54:47.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.511+0000 7fb528a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb524103730 0x7fb5241998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.511+0000 7fb528a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb524104920 0x7fb524199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.511+0000 7fb528a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5241052e0 0x7fb5241a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.511+0000 7fb528a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5241a13b0 con 0x7fb524104920 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.511+0000 7fb528a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5241a1520 con 0x7fb524103730 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.511+0000 7fb528a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5241a16e0 con 0x7fb5241052e0 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.511+0000 7fb521e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb524103730 0x7fb5241998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.511+0000 7fb521400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb524104920 0x7fb524199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.511+0000 7fb521e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb524103730 0x7fb5241998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:33038/0 (socket says 172.21.15.8:33038) 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.511+0000 7fb521e00640 1 -- 172.21.15.8:0/4227897799 learned_addr learned my addr 172.21.15.8:0/4227897799 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.511+0000 7fb522800640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5241052e0 0x7fb5241a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb521e00640 1 -- 172.21.15.8:0/4227897799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5241052e0 msgr2=0x7fb5241a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb521e00640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5241052e0 0x7fb5241a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb521e00640 1 -- 172.21.15.8:0/4227897799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb524104920 msgr2=0x7fb524199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:47.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb521e00640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb524104920 0x7fb524199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:47.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb521e00640 1 -- 172.21.15.8:0/4227897799 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb514009560 con 0x7fb524103730 2024-03-16T20:54:47.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb522800640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5241052e0 0x7fb5241a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:54:47.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb521e00640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb524103730 0x7fb5241998c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb514009230 tx=0x7fb514005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:47.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb51aa00640 1 -- 172.21.15.8:0/4227897799 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5140044d0 con 0x7fb524103730 2024-03-16T20:54:47.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb528a00640 1 -- 172.21.15.8:0/4227897799 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5241a1960 con 0x7fb524103730 2024-03-16T20:54:47.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb51aa00640 1 -- 172.21.15.8:0/4227897799 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb514005310 con 0x7fb524103730 2024-03-16T20:54:47.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb51aa00640 1 -- 172.21.15.8:0/4227897799 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514034440 con 0x7fb524103730 2024-03-16T20:54:47.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.512+0000 7fb528a00640 1 -- 172.21.15.8:0/4227897799 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5241a1e60 con 0x7fb524103730 2024-03-16T20:54:47.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.514+0000 7fb528a00640 1 -- 172.21.15.8:0/4227897799 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52410aa50 con 0x7fb524103730 2024-03-16T20:54:47.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.516+0000 7fb51aa00640 1 -- 172.21.15.8:0/4227897799 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fb514003680 con 0x7fb524103730 2024-03-16T20:54:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.517+0000 7fb51aa00640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb5080a1a30 0x7fb5080a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:47.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.517+0000 7fb51aa00640 1 -- 172.21.15.8:0/4227897799 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb5140eefe0 con 0x7fb524103730 2024-03-16T20:54:47.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.517+0000 7fb521400640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb5080a1a30 0x7fb5080a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:47.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.518+0000 7fb521400640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb5080a1a30 0x7fb5080a3ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb52419add0 tx=0x7fb510005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:47.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.520+0000 7fb51aa00640 1 -- 172.21.15.8:0/4227897799 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb5140b86e0 con 0x7fb524103730 2024-03-16T20:54:47.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.771+0000 7fb528a00640 1 -- 172.21.15.8:0/4227897799 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb52410f260 con 0x7fb524103730 2024-03-16T20:54:47.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.772+0000 7fb51aa00640 1 -- 172.21.15.8:0/4227897799 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7664 (secure 0 0 0) 0x7fb5140bbda0 con 0x7fb524103730 2024-03-16T20:54:47.776 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:47.776 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-03-16T20:54:47.777 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 10 2024-03-16T20:54:47.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.775+0000 7fb528a00640 1 -- 172.21.15.8:0/4227897799 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb5080a1a30 msgr2=0x7fb5080a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:47.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.775+0000 7fb528a00640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb5080a1a30 0x7fb5080a3ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb52419add0 tx=0x7fb510005f90 comp rx=0 tx=0).stop 2024-03-16T20:54:47.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.775+0000 7fb528a00640 1 -- 172.21.15.8:0/4227897799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb524103730 msgr2=0x7fb5241998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:47.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.775+0000 7fb528a00640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb524103730 0x7fb5241998c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb514009230 tx=0x7fb514005d50 comp rx=0 tx=0).stop 2024-03-16T20:54:47.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.775+0000 7fb528a00640 1 -- 172.21.15.8:0/4227897799 shutdown_connections 2024-03-16T20:54:47.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.775+0000 7fb528a00640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb5080a1a30 0x7fb5080a3ef0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:47.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.775+0000 7fb528a00640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5241052e0 0x7fb5241a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:47.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.775+0000 7fb528a00640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb524104920 0x7fb524199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:47.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.775+0000 7fb528a00640 1 --2- 172.21.15.8:0/4227897799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb524103730 0x7fb5241998c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:47.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.775+0000 7fb528a00640 1 -- 172.21.15.8:0/4227897799 >> 172.21.15.8:0/4227897799 conn(0x7fb5240feca0 msgr2=0x7fb524107c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:47.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.776+0000 7fb528a00640 1 -- 172.21.15.8:0/4227897799 shutdown_connections 2024-03-16T20:54:47.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:47.776+0000 7fb528a00640 1 -- 172.21.15.8:0/4227897799 wait complete. 2024-03-16T20:54:48.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:47 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] up:boot 2024-03-16T20:54:48.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:47 smithi008 ceph-mon[31434]: fsmap 9 up:standby 2024-03-16T20:54:48.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:47 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T20:54:48.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:47 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:48.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:47 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:48.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:47 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:48.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:47 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:48.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:47 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:48.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:47 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:48.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:47 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/4227897799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:48.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:47 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] up:boot 2024-03-16T20:54:48.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:47 smithi170 ceph-mon[35947]: fsmap 9 up:standby 2024-03-16T20:54:48.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:47 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T20:54:48.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:47 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:48.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:47 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:48.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:47 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:48.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:47 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:48.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:47 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:48.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:47 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:48.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:47 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/4227897799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:48.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:47 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] up:boot 2024-03-16T20:54:48.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:47 smithi186 ceph-mon[36391]: fsmap 9 up:standby 2024-03-16T20:54:48.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:47 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T20:54:48.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:47 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:48.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:47 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:48.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:47 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:48.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:47 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:48.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:47 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:48.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:47 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:48.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:47 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/4227897799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:49.070 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:48 smithi008 ceph-mon[31434]: Deploying daemon mds.g on smithi008 2024-03-16T20:54:49.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:48 smithi008 ceph-mon[31434]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:49.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:48 smithi170 ceph-mon[35947]: Deploying daemon mds.g on smithi008 2024-03-16T20:54:49.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:48 smithi170 ceph-mon[35947]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:49.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:48 smithi186 ceph-mon[36391]: Deploying daemon mds.g on smithi008 2024-03-16T20:54:49.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:48 smithi186 ceph-mon[36391]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:49.798 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.207+0000 7f6f7be00640 1 -- 172.21.15.8:0/1396603268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f7c101dc0 msgr2=0x7f6f7c1041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.207+0000 7f6f7be00640 1 --2- 172.21.15.8:0/1396603268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f7c101dc0 0x7f6f7c1041b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009860 tx=0x7f6f6c02bb70 comp rx=0 tx=0).stop 2024-03-16T20:54:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.207+0000 7f6f7be00640 1 -- 172.21.15.8:0/1396603268 shutdown_connections 2024-03-16T20:54:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.207+0000 7f6f7be00640 1 --2- 172.21.15.8:0/1396603268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c107020 0x7f6f7c109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.207+0000 7f6f7be00640 1 --2- 172.21.15.8:0/1396603268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f7c1046f0 0x7f6f7c106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.207+0000 7f6f7be00640 1 --2- 172.21.15.8:0/1396603268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f7c101dc0 0x7f6f7c1041b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.207+0000 7f6f7be00640 1 -- 172.21.15.8:0/1396603268 >> 172.21.15.8:0/1396603268 conn(0x7f6f7c0fb7d0 msgr2=0x7f6f7c0fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.207+0000 7f6f7be00640 1 -- 172.21.15.8:0/1396603268 shutdown_connections 2024-03-16T20:54:50.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.207+0000 7f6f7be00640 1 -- 172.21.15.8:0/1396603268 wait complete. 2024-03-16T20:54:50.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.208+0000 7f6f7be00640 1 Processor -- start 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7be00640 1 -- start start 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f7c101dc0 0x7f6f7c196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c1046f0 0x7f6f7c1965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f7c107020 0x7f6f7c192bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7be00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c193360 con 0x7f6f7c1046f0 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c1934d0 con 0x7f6f7c101dc0 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c193690 con 0x7f6f7c107020 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c1046f0 0x7f6f7c1965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f7c101dc0 0x7f6f7c196060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f7c101dc0 0x7f6f7c196060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:53086/0 (socket says 172.21.15.8:53086) 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7aa00640 1 -- 172.21.15.8:0/3736026946 learned_addr learned my addr 172.21.15.8:0/3736026946 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c1046f0 0x7f6f7c1965a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50598/0 (socket says 172.21.15.8:50598) 2024-03-16T20:54:50.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.209+0000 7f6f7b400640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f7c107020 0x7f6f7c192bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:50.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.210+0000 7f6f7aa00640 1 -- 172.21.15.8:0/3736026946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f7c107020 msgr2=0x7f6f7c192bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:50.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.210+0000 7f6f7aa00640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f7c107020 0x7f6f7c192bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:50.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.210+0000 7f6f7aa00640 1 -- 172.21.15.8:0/3736026946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c1046f0 msgr2=0x7f6f7c1965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:50.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.210+0000 7f6f7aa00640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c1046f0 0x7f6f7c1965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:50.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.210+0000 7f6f7aa00640 1 -- 172.21.15.8:0/3736026946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f74009900 con 0x7f6f7c101dc0 2024-03-16T20:54:50.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.210+0000 7f6f7aa00640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f7c101dc0 0x7f6f7c196060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c005940 tx=0x7f6f6c0045c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:50.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.210+0000 7f6f73400640 1 -- 172.21.15.8:0/3736026946 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c02c510 con 0x7f6f7c101dc0 2024-03-16T20:54:50.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.210+0000 7f6f7be00640 1 -- 172.21.15.8:0/3736026946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c009490 con 0x7f6f7c101dc0 2024-03-16T20:54:50.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.210+0000 7f6f73400640 1 -- 172.21.15.8:0/3736026946 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6f6c02cb70 con 0x7f6f7c101dc0 2024-03-16T20:54:50.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.210+0000 7f6f73400640 1 -- 172.21.15.8:0/3736026946 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c032880 con 0x7f6f7c101dc0 2024-03-16T20:54:50.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.210+0000 7f6f7be00640 1 -- 172.21.15.8:0/3736026946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c199730 con 0x7f6f7c101dc0 2024-03-16T20:54:50.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.212+0000 7f6f7be00640 1 -- 172.21.15.8:0/3736026946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c108b70 con 0x7f6f7c101dc0 2024-03-16T20:54:50.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.214+0000 7f6f73400640 1 -- 172.21.15.8:0/3736026946 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f6f6c03b040 con 0x7f6f7c101dc0 2024-03-16T20:54:50.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.215+0000 7f6f73400640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6f600a1a30 0x7f6f600a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:50.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.215+0000 7f6f73400640 1 -- 172.21.15.8:0/3736026946 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6f6c0eee80 con 0x7f6f7c101dc0 2024-03-16T20:54:50.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.216+0000 7f6f7a000640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6f600a1a30 0x7f6f600a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:50.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.216+0000 7f6f7a000640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6f600a1a30 0x7f6f600a3ef0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c193fe0 tx=0x7f6f68005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:50.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.219+0000 7f6f73400640 1 -- 172.21.15.8:0/3736026946 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6f6c0b8540 con 0x7f6f7c101dc0 2024-03-16T20:54:50.475 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 20:54:50 smithi008 systemd[1]: Starting Ceph mds.g for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:50.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.473+0000 7f6f7be00640 1 -- 172.21.15.8:0/3736026946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f7c02cf60 con 0x7f6f7c101dc0 2024-03-16T20:54:50.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.474+0000 7f6f73400640 1 -- 172.21.15.8:0/3736026946 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7664 (secure 0 0 0) 0x7f6f6c0bbc00 con 0x7f6f7c101dc0 2024-03-16T20:54:50.478 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:50.478 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-03-16T20:54:50.479 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 10 2024-03-16T20:54:50.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 -- 172.21.15.8:0/3736026946 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6f600a1a30 msgr2=0x7f6f600a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:50.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6f600a1a30 0x7f6f600a3ef0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c193fe0 tx=0x7f6f68005f90 comp rx=0 tx=0).stop 2024-03-16T20:54:50.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 -- 172.21.15.8:0/3736026946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f7c101dc0 msgr2=0x7f6f7c196060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:50.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f7c101dc0 0x7f6f7c196060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c005940 tx=0x7f6f6c0045c0 comp rx=0 tx=0).stop 2024-03-16T20:54:50.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 -- 172.21.15.8:0/3736026946 shutdown_connections 2024-03-16T20:54:50.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6f600a1a30 0x7f6f600a3ef0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:50.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f7c107020 0x7f6f7c192bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:50.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c1046f0 0x7f6f7c1965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:50.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 --2- 172.21.15.8:0/3736026946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f7c101dc0 0x7f6f7c196060 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:50.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 -- 172.21.15.8:0/3736026946 >> 172.21.15.8:0/3736026946 conn(0x7f6f7c0fb7d0 msgr2=0x7f6f7c101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:50.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 -- 172.21.15.8:0/3736026946 shutdown_connections 2024-03-16T20:54:50.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:50.477+0000 7f6f7be00640 1 -- 172.21.15.8:0/3736026946 wait complete. 2024-03-16T20:54:50.744 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 20:54:50 smithi008 podman[72708]: 2024-03-16 20:54:50.375402622 +0000 UTC m=+0.034481872 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:50.744 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 20:54:50 smithi008 podman[72708]: 2024-03-16 20:54:50.515552299 +0000 UTC m=+0.174631556 container create 5bf90d69e465e865f743c20852334eded33d3ed9c2e7019d33563ceddf29690e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-03-16T20:54:51.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:50 smithi008 ceph-mon[31434]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:51.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:50 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3736026946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:51.244 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 20:54:50 smithi008 podman[72708]: 2024-03-16 20:54:50.777974986 +0000 UTC m=+0.437054280 container init 5bf90d69e465e865f743c20852334eded33d3ed9c2e7019d33563ceddf29690e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-g, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_CLEAN=True) 2024-03-16T20:54:51.244 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 20:54:50 smithi008 podman[72708]: 2024-03-16 20:54:50.7873106 +0000 UTC m=+0.446389855 container start 5bf90d69e465e865f743c20852334eded33d3ed9c2e7019d33563ceddf29690e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-g, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=) 2024-03-16T20:54:51.244 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 20:54:50 smithi008 ceph-mds[72737]: -- 172.21.15.8:0/2471997541 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557ce87d61a0 con 0x557ce87acc00 2024-03-16T20:54:51.244 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 20:54:50 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-g[72728]: starting mds.g at 2024-03-16T20:54:51.244 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 20:54:50 smithi008 bash[72708]: 5bf90d69e465e865f743c20852334eded33d3ed9c2e7019d33563ceddf29690e 2024-03-16T20:54:51.244 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 20:54:50 smithi008 systemd[1]: Started Ceph mds.g for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:51.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:50 smithi170 ceph-mon[35947]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:51.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:50 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3736026946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:51.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:50 smithi186 ceph-mon[36391]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:51.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:50 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3736026946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:51.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:51 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.8:6838/4078077734,v1:172.21.15.8:6839/4078077734] up:boot 2024-03-16T20:54:51.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:51 smithi008 ceph-mon[31434]: fsmap 10 up:standby 2024-03-16T20:54:51.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T20:54:51.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:51.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:51.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:51.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:51.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:51.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:51 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:52.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:51 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.8:6838/4078077734,v1:172.21.15.8:6839/4078077734] up:boot 2024-03-16T20:54:52.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:51 smithi170 ceph-mon[35947]: fsmap 10 up:standby 2024-03-16T20:54:52.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:51 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T20:54:52.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:51 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:52.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:51 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:52.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:51 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:52.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:51 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:52.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:51 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:52.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:51 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:52.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:51 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.8:6838/4078077734,v1:172.21.15.8:6839/4078077734] up:boot 2024-03-16T20:54:52.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:51 smithi186 ceph-mon[36391]: fsmap 10 up:standby 2024-03-16T20:54:52.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:51 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T20:54:52.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:51 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:52.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:51 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:52.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:51 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:52.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:51 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:52.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:51 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:52.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:51 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:52.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:52.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.732+0000 7f0927600640 1 -- 172.21.15.8:0/1878301349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09201030c0 msgr2=0x7f0920109950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:52.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.732+0000 7f0927600640 1 --2- 172.21.15.8:0/1878301349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09201030c0 0x7f0920109950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0918009ca0 tx=0x7f091802c100 comp rx=0 tx=0).stop 2024-03-16T20:54:52.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.733+0000 7f0927600640 1 -- 172.21.15.8:0/1878301349 shutdown_connections 2024-03-16T20:54:52.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.733+0000 7f0927600640 1 --2- 172.21.15.8:0/1878301349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09201030c0 0x7f0920109950 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:52.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.733+0000 7f0927600640 1 --2- 172.21.15.8:0/1878301349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0920102700 0x7f0920102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:52.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.733+0000 7f0927600640 1 --2- 172.21.15.8:0/1878301349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0920101510 0x7f0920101930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:52.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.733+0000 7f0927600640 1 -- 172.21.15.8:0/1878301349 >> 172.21.15.8:0/1878301349 conn(0x7f09200fcaa0 msgr2=0x7f09200feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:52.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.733+0000 7f0927600640 1 -- 172.21.15.8:0/1878301349 shutdown_connections 2024-03-16T20:54:52.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.733+0000 7f0927600640 1 -- 172.21.15.8:0/1878301349 wait complete. 2024-03-16T20:54:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.734+0000 7f0927600640 1 Processor -- start 2024-03-16T20:54:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.734+0000 7f0927600640 1 -- start start 2024-03-16T20:54:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.734+0000 7f0927600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0920101510 0x7f0920199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.734+0000 7f0927600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0920102700 0x7f0920199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.734+0000 7f0927600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09201030c0 0x7f09201a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.734+0000 7f0927600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09201a1310 con 0x7f0920102700 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.734+0000 7f0927600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09201a1480 con 0x7f09201030c0 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.734+0000 7f0927600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09201a1640 con 0x7f0920101510 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.735+0000 7f091fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0920102700 0x7f0920199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.735+0000 7f0924c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0920101510 0x7f0920199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.735+0000 7f0924c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0920101510 0x7f0920199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46584/0 (socket says 172.21.15.8:46584) 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.735+0000 7f0924c00640 1 -- 172.21.15.8:0/3080473669 learned_addr learned my addr 172.21.15.8:0/3080473669 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.735+0000 7f0925600640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09201030c0 0x7f09201a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.735+0000 7f091fe00640 1 -- 172.21.15.8:0/3080473669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0920101510 msgr2=0x7f0920199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.735+0000 7f091fe00640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0920101510 0x7f0920199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.735+0000 7f091fe00640 1 -- 172.21.15.8:0/3080473669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09201030c0 msgr2=0x7f09201a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.735+0000 7f091fe00640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09201030c0 0x7f09201a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.735+0000 7f091fe00640 1 -- 172.21.15.8:0/3080473669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0918009900 con 0x7f0920102700 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.735+0000 7f091fe00640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0920102700 0x7f0920199d60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f090c00e9f0 tx=0x7f090c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.736+0000 7f091d600640 1 -- 172.21.15.8:0/3080473669 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00ccc0 con 0x7f0920102700 2024-03-16T20:54:52.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.736+0000 7f091d600640 1 -- 172.21.15.8:0/3080473669 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f090c00ce20 con 0x7f0920102700 2024-03-16T20:54:52.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.736+0000 7f0927600640 1 -- 172.21.15.8:0/3080473669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09201a1920 con 0x7f0920102700 2024-03-16T20:54:52.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.736+0000 7f091d600640 1 -- 172.21.15.8:0/3080473669 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0189c0 con 0x7f0920102700 2024-03-16T20:54:52.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.736+0000 7f0927600640 1 -- 172.21.15.8:0/3080473669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09201a1e80 con 0x7f0920102700 2024-03-16T20:54:52.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.737+0000 7f0927600640 1 -- 172.21.15.8:0/3080473669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092010d030 con 0x7f0920102700 2024-03-16T20:54:52.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.739+0000 7f091d600640 1 -- 172.21.15.8:0/3080473669 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f090c018b20 con 0x7f0920102700 2024-03-16T20:54:52.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.740+0000 7f091d600640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f09080a1ab0 0x7f09080a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:52.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.741+0000 7f091d600640 1 -- 172.21.15.8:0/3080473669 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f090c014070 con 0x7f0920102700 2024-03-16T20:54:52.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.741+0000 7f0924c00640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f09080a1ab0 0x7f09080a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:52.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.741+0000 7f0924c00640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f09080a1ab0 0x7f09080a3f70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f09140058c0 tx=0x7f0914005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:52.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.745+0000 7f091d600640 1 -- 172.21.15.8:0/3080473669 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f090c053280 con 0x7f0920102700 2024-03-16T20:54:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.995+0000 7f0927600640 1 -- 172.21.15.8:0/3080473669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f092010d1f0 con 0x7f0920102700 2024-03-16T20:54:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:52.997+0000 7f091d600640 1 -- 172.21.15.8:0/3080473669 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8453 (secure 0 0 0) 0x7f090c0968d0 con 0x7f0920102700 2024-03-16T20:54:53.001 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:53.001 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-03-16T20:54:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 11 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 -- 172.21.15.8:0/3080473669 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f09080a1ab0 msgr2=0x7f09080a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f09080a1ab0 0x7f09080a3f70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f09140058c0 tx=0x7f0914005f90 comp rx=0 tx=0).stop 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 -- 172.21.15.8:0/3080473669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0920102700 msgr2=0x7f0920199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0920102700 0x7f0920199d60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f090c00e9f0 tx=0x7f090c00eeb0 comp rx=0 tx=0).stop 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 -- 172.21.15.8:0/3080473669 shutdown_connections 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f09080a1ab0 0x7f09080a3f70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09201030c0 0x7f09201a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0920102700 0x7f0920199d60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 --2- 172.21.15.8:0/3080473669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0920101510 0x7f0920199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 -- 172.21.15.8:0/3080473669 >> 172.21.15.8:0/3080473669 conn(0x7f09200fcaa0 msgr2=0x7f0920073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 -- 172.21.15.8:0/3080473669 shutdown_connections 2024-03-16T20:54:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:53.000+0000 7f0927600640 1 -- 172.21.15.8:0/3080473669 wait complete. 2024-03-16T20:54:53.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:52 smithi008 ceph-mon[31434]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:53.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:52 smithi008 ceph-mon[31434]: Deploying daemon mds.a on smithi008 2024-03-16T20:54:53.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:52 smithi170 ceph-mon[35947]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:53.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:52 smithi170 ceph-mon[35947]: Deploying daemon mds.a on smithi008 2024-03-16T20:54:53.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:52 smithi186 ceph-mon[36391]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:53.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:52 smithi186 ceph-mon[36391]: Deploying daemon mds.a on smithi008 2024-03-16T20:54:54.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:53 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3080473669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:54.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:53 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3080473669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:54.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:53 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3080473669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:54.662 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 20:54:54 smithi008 systemd[1]: Starting Ceph mds.a for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:54.936 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 20:54:54 smithi008 podman[73057]: 2024-03-16 20:54:54.563686589 +0000 UTC m=+0.040084033 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:54.936 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 20:54:54 smithi008 podman[73057]: 2024-03-16 20:54:54.680859737 +0000 UTC m=+0.157257209 container create 32c086b5946c528c7488d0b6a04ea91af446202b32b837d8e75768234fa7ee21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-a, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-16T20:54:55.025 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.228+0000 7fb4d0a00640 1 -- 172.21.15.8:0/1251069226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4cc103710 msgr2=0x7fb4cc103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.228+0000 7fb4d0a00640 1 --2- 172.21.15.8:0/1251069226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4cc103710 0x7fb4cc103b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009900 tx=0x7fb4bc02bc30 comp rx=0 tx=0).stop 2024-03-16T20:54:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.228+0000 7fb4d0a00640 1 -- 172.21.15.8:0/1251069226 shutdown_connections 2024-03-16T20:54:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.228+0000 7fb4d0a00640 1 --2- 172.21.15.8:0/1251069226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4cc1052c0 0x7fb4cc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.228+0000 7fb4d0a00640 1 --2- 172.21.15.8:0/1251069226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc104900 0x7fb4cc104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.228+0000 7fb4d0a00640 1 --2- 172.21.15.8:0/1251069226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4cc103710 0x7fb4cc103b30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.229+0000 7fb4d0a00640 1 -- 172.21.15.8:0/1251069226 >> 172.21.15.8:0/1251069226 conn(0x7fb4cc0feca0 msgr2=0x7fb4cc1010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.229+0000 7fb4d0a00640 1 -- 172.21.15.8:0/1251069226 shutdown_connections 2024-03-16T20:54:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.229+0000 7fb4d0a00640 1 -- 172.21.15.8:0/1251069226 wait complete. 2024-03-16T20:54:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.230+0000 7fb4d0a00640 1 Processor -- start 2024-03-16T20:54:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.230+0000 7fb4d0a00640 1 -- start start 2024-03-16T20:54:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.230+0000 7fb4d0a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4cc103710 0x7fb4cc1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.230+0000 7fb4d0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4cc104900 0x7fb4cc199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.230+0000 7fb4d0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc1052c0 0x7fb4cc1a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.230+0000 7fb4d0a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc1a1390 con 0x7fb4cc104900 2024-03-16T20:54:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.230+0000 7fb4d0a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc1a1500 con 0x7fb4cc1052c0 2024-03-16T20:54:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.230+0000 7fb4d0a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc1a16c0 con 0x7fb4cc103710 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.231+0000 7fb4c9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4cc104900 0x7fb4cc199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.231+0000 7fb4c9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4cc104900 0x7fb4cc199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50682/0 (socket says 172.21.15.8:50682) 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.231+0000 7fb4c9400640 1 -- 172.21.15.8:0/2338202099 learned_addr learned my addr 172.21.15.8:0/2338202099 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.231+0000 7fb4ca800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc1052c0 0x7fb4cc1a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.231+0000 7fb4c9e00640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4cc103710 0x7fb4cc1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.231+0000 7fb4c9e00640 1 -- 172.21.15.8:0/2338202099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc1052c0 msgr2=0x7fb4cc1a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.231+0000 7fb4c9e00640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc1052c0 0x7fb4cc1a0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.231+0000 7fb4c9e00640 1 -- 172.21.15.8:0/2338202099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4cc104900 msgr2=0x7fb4cc199de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.231+0000 7fb4c9e00640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4cc104900 0x7fb4cc199de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.231+0000 7fb4c9e00640 1 -- 172.21.15.8:0/2338202099 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc009560 con 0x7fb4cc103710 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.231+0000 7fb4c9e00640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4cc103710 0x7fb4cc1998a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009230 tx=0x7fb4bc005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.232+0000 7fb4c2a00640 1 -- 172.21.15.8:0/2338202099 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc004350 con 0x7fb4cc103710 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.232+0000 7fb4d0a00640 1 -- 172.21.15.8:0/2338202099 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4cc1a1940 con 0x7fb4cc103710 2024-03-16T20:54:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.232+0000 7fb4d0a00640 1 -- 172.21.15.8:0/2338202099 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4cc1a1e70 con 0x7fb4cc103710 2024-03-16T20:54:55.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.232+0000 7fb4c2a00640 1 -- 172.21.15.8:0/2338202099 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb4bc0044b0 con 0x7fb4cc103710 2024-03-16T20:54:55.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.232+0000 7fb4c2a00640 1 -- 172.21.15.8:0/2338202099 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc003d10 con 0x7fb4cc103710 2024-03-16T20:54:55.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.233+0000 7fb4d0a00640 1 -- 172.21.15.8:0/2338202099 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4cc068730 con 0x7fb4cc103710 2024-03-16T20:54:55.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.235+0000 7fb4c2a00640 1 -- 172.21.15.8:0/2338202099 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fb4bc004e10 con 0x7fb4cc103710 2024-03-16T20:54:55.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.236+0000 7fb4c2a00640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb4b00a1ab0 0x7fb4b00a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:55.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.236+0000 7fb4c2a00640 1 -- 172.21.15.8:0/2338202099 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb4bc0eef10 con 0x7fb4cc103710 2024-03-16T20:54:55.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.236+0000 7fb4c9400640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb4b00a1ab0 0x7fb4b00a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:55.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.237+0000 7fb4c9400640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb4b00a1ab0 0x7fb4b00a3f70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc19adb0 tx=0x7fb4b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:55.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:54 smithi008 ceph-mon[31434]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:55.243 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 20:54:54 smithi008 podman[73057]: 2024-03-16 20:54:54.976537306 +0000 UTC m=+0.452934788 container init 32c086b5946c528c7488d0b6a04ea91af446202b32b837d8e75768234fa7ee21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-a, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True) 2024-03-16T20:54:55.244 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 20:54:54 smithi008 podman[73057]: 2024-03-16 20:54:54.987445107 +0000 UTC m=+0.463842602 container start 32c086b5946c528c7488d0b6a04ea91af446202b32b837d8e75768234fa7ee21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T20:54:55.244 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 20:54:55 smithi008 ceph-mds[73076]: -- 172.21.15.8:0/1466047296 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564ff5e2c1a0 con 0x564ff5e02c00 2024-03-16T20:54:55.244 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 20:54:55 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-a[73072]: starting mds.a at 2024-03-16T20:54:55.244 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 20:54:55 smithi008 bash[73057]: 32c086b5946c528c7488d0b6a04ea91af446202b32b837d8e75768234fa7ee21 2024-03-16T20:54:55.244 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 20:54:55 smithi008 systemd[1]: Started Ceph mds.a for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:55.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.240+0000 7fb4c2a00640 1 -- 172.21.15.8:0/2338202099 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb4bc0b8520 con 0x7fb4cc103710 2024-03-16T20:54:55.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:54 smithi170 ceph-mon[35947]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:55.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:54 smithi186 ceph-mon[36391]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.487+0000 7fb4d0a00640 1 -- 172.21.15.8:0/2338202099 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4cc10a9d0 con 0x7fb4cc103710 2024-03-16T20:54:55.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.488+0000 7fb4c2a00640 1 -- 172.21.15.8:0/2338202099 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8453 (secure 0 0 0) 0x7fb4cc10a9d0 con 0x7fb4cc103710 2024-03-16T20:54:55.492 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:55.492 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-03-16T20:54:55.493 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 11 2024-03-16T20:54:55.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.493+0000 7fb4d0a00640 1 -- 172.21.15.8:0/2338202099 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb4b00a1ab0 msgr2=0x7fb4b00a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:55.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.493+0000 7fb4d0a00640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb4b00a1ab0 0x7fb4b00a3f70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc19adb0 tx=0x7fb4b8005f90 comp rx=0 tx=0).stop 2024-03-16T20:54:55.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.493+0000 7fb4d0a00640 1 -- 172.21.15.8:0/2338202099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4cc103710 msgr2=0x7fb4cc1998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:55.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.493+0000 7fb4d0a00640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4cc103710 0x7fb4cc1998a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009230 tx=0x7fb4bc005dc0 comp rx=0 tx=0).stop 2024-03-16T20:54:55.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.493+0000 7fb4d0a00640 1 -- 172.21.15.8:0/2338202099 shutdown_connections 2024-03-16T20:54:55.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.493+0000 7fb4d0a00640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb4b00a1ab0 0x7fb4b00a3f70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:55.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.493+0000 7fb4d0a00640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc1052c0 0x7fb4cc1a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:55.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.493+0000 7fb4d0a00640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4cc104900 0x7fb4cc199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:55.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.493+0000 7fb4d0a00640 1 --2- 172.21.15.8:0/2338202099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4cc103710 0x7fb4cc1998a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:55.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.493+0000 7fb4d0a00640 1 -- 172.21.15.8:0/2338202099 >> 172.21.15.8:0/2338202099 conn(0x7fb4cc0feca0 msgr2=0x7fb4cc107ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:55.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.494+0000 7fb4d0a00640 1 -- 172.21.15.8:0/2338202099 shutdown_connections 2024-03-16T20:54:55.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:55.494+0000 7fb4d0a00640 1 -- 172.21.15.8:0/2338202099 wait complete. 2024-03-16T20:54:56.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:56.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:56.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:56.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:56.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:56.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:56.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:56.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: Deploying daemon mds.b on smithi170 2024-03-16T20:54:56.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2338202099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:56.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.8:6840/1961952474,v1:172.21.15.8:6841/1961952474] up:boot 2024-03-16T20:54:56.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: fsmap 11 up:standby 2024-03-16T20:54:56.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:56 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T20:54:56.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:56.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:56.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: Deploying daemon mds.b on smithi170 2024-03-16T20:54:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2338202099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.8:6840/1961952474,v1:172.21.15.8:6841/1961952474] up:boot 2024-03-16T20:54:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: fsmap 11 up:standby 2024-03-16T20:54:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:56 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: Deploying daemon mds.b on smithi170 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2338202099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.8:6840/1961952474,v1:172.21.15.8:6841/1961952474] up:boot 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: fsmap 11 up:standby 2024-03-16T20:54:56.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:56 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T20:54:57.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:54:57.580 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 20:54:57 smithi170 systemd[1]: Starting Ceph mds.b for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T20:54:57.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.748+0000 7fbd27000640 1 -- 172.21.15.8:0/3276540454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd201050f0 msgr2=0x7fbd2010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:57.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.748+0000 7fbd27000640 1 --2- 172.21.15.8:0/3276540454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd201050f0 0x7fbd2010b980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009ca0 tx=0x7fbd1802c120 comp rx=0 tx=0).stop 2024-03-16T20:54:57.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.748+0000 7fbd27000640 1 -- 172.21.15.8:0/3276540454 shutdown_connections 2024-03-16T20:54:57.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.748+0000 7fbd27000640 1 --2- 172.21.15.8:0/3276540454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd201050f0 0x7fbd2010b980 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:57.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.748+0000 7fbd27000640 1 --2- 172.21.15.8:0/3276540454 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd20104730 0x7fbd20104bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:57.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.748+0000 7fbd27000640 1 --2- 172.21.15.8:0/3276540454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd20103540 0x7fbd20103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:57.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.748+0000 7fbd27000640 1 -- 172.21.15.8:0/3276540454 >> 172.21.15.8:0/3276540454 conn(0x7fbd200fead0 msgr2=0x7fbd20100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:57.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.748+0000 7fbd27000640 1 -- 172.21.15.8:0/3276540454 shutdown_connections 2024-03-16T20:54:57.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.748+0000 7fbd27000640 1 -- 172.21.15.8:0/3276540454 wait complete. 2024-03-16T20:54:57.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.749+0000 7fbd27000640 1 Processor -- start 2024-03-16T20:54:57.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.749+0000 7fbd27000640 1 -- start start 2024-03-16T20:54:57.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.749+0000 7fbd27000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd20103540 0x7fbd201996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:57.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd27000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd20104730 0x7fbd20199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:57.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd27000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd201050f0 0x7fbd201a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:57.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd27000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd201a11b0 con 0x7fbd20103540 2024-03-16T20:54:57.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd27000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd201a1320 con 0x7fbd20104730 2024-03-16T20:54:57.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd27000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd201a14e0 con 0x7fbd201050f0 2024-03-16T20:54:57.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd25c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd20103540 0x7fbd201996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:57.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd25200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd20104730 0x7fbd20199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:57.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd25c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd20103540 0x7fbd201996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50698/0 (socket says 172.21.15.8:50698) 2024-03-16T20:54:57.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd25c00640 1 -- 172.21.15.8:0/3320203564 learned_addr learned my addr 172.21.15.8:0/3320203564 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:54:57.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd26600640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd201050f0 0x7fbd201a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:57.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd25c00640 1 -- 172.21.15.8:0/3320203564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd201050f0 msgr2=0x7fbd201a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:57.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd25c00640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd201050f0 0x7fbd201a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:57.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd25c00640 1 -- 172.21.15.8:0/3320203564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd20104730 msgr2=0x7fbd20199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:57.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd25c00640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd20104730 0x7fbd20199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:57.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd25c00640 1 -- 172.21.15.8:0/3320203564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18009900 con 0x7fbd20103540 2024-03-16T20:54:57.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.750+0000 7fbd25200640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd20104730 0x7fbd20199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:54:57.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.751+0000 7fbd25c00640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd20103540 0x7fbd201996c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400b470 tx=0x7fbd1400b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:57.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.751+0000 7fbd1e000640 1 -- 172.21.15.8:0/3320203564 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14011890 con 0x7fbd20103540 2024-03-16T20:54:57.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.751+0000 7fbd1e000640 1 -- 172.21.15.8:0/3320203564 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbd140103e0 con 0x7fbd20103540 2024-03-16T20:54:57.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.751+0000 7fbd1e000640 1 -- 172.21.15.8:0/3320203564 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400f5a0 con 0x7fbd20103540 2024-03-16T20:54:57.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.751+0000 7fbd27000640 1 -- 172.21.15.8:0/3320203564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd201a17c0 con 0x7fbd20103540 2024-03-16T20:54:57.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.751+0000 7fbd27000640 1 -- 172.21.15.8:0/3320203564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd201a1c80 con 0x7fbd20103540 2024-03-16T20:54:57.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.752+0000 7fbd27000640 1 -- 172.21.15.8:0/3320203564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2010a800 con 0x7fbd20103540 2024-03-16T20:54:57.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.754+0000 7fbd1e000640 1 -- 172.21.15.8:0/3320203564 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fbd14010970 con 0x7fbd20103540 2024-03-16T20:54:57.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.755+0000 7fbd1e000640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd080a1ab0 0x7fbd080a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:54:57.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.756+0000 7fbd1e000640 1 -- 172.21.15.8:0/3320203564 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbd140ccc40 con 0x7fbd20103540 2024-03-16T20:54:57.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.756+0000 7fbd25200640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd080a1ab0 0x7fbd080a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:54:57.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.757+0000 7fbd25200640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd080a1ab0 0x7fbd080a3f70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd2019abd0 tx=0x7fbd0c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:54:57.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:57.761+0000 7fbd1e000640 1 -- 172.21.15.8:0/3320203564 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fbd14096250 con 0x7fbd20103540 2024-03-16T20:54:57.841 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 20:54:57 smithi170 podman[66233]: 2024-03-16 20:54:57.478843314 +0000 UTC m=+0.017845058 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T20:54:57.841 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 20:54:57 smithi170 podman[66233]: 2024-03-16 20:54:57.593524772 +0000 UTC m=+0.132526516 container create 693a35867200e383b5b83b2a03642783379b256fe78c71d3bc25dd0f37a903ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T20:54:57.841 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 20:54:57 smithi170 podman[66233]: 2024-03-16 20:54:57.837942309 +0000 UTC m=+0.376944070 container init 693a35867200e383b5b83b2a03642783379b256fe78c71d3bc25dd0f37a903ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T20:54:58.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.009+0000 7fbd27000640 1 -- 172.21.15.8:0/3320203564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd2010f0f0 con 0x7fbd20103540 2024-03-16T20:54:58.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.010+0000 7fbd1e000640 1 -- 172.21.15.8:0/3320203564 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9242 (secure 0 0 0) 0x7fbd14099910 con 0x7fbd20103540 2024-03-16T20:54:58.014 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:54:58.014 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-03-16T20:54:58.015 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 12 2024-03-16T20:54:58.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.013+0000 7fbd27000640 1 -- 172.21.15.8:0/3320203564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd080a1ab0 msgr2=0x7fbd080a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:58.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.013+0000 7fbd27000640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd080a1ab0 0x7fbd080a3f70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd2019abd0 tx=0x7fbd0c005f90 comp rx=0 tx=0).stop 2024-03-16T20:54:58.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.013+0000 7fbd27000640 1 -- 172.21.15.8:0/3320203564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd20103540 msgr2=0x7fbd201996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:54:58.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.013+0000 7fbd27000640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd20103540 0x7fbd201996c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400b470 tx=0x7fbd1400b930 comp rx=0 tx=0).stop 2024-03-16T20:54:58.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.013+0000 7fbd27000640 1 -- 172.21.15.8:0/3320203564 shutdown_connections 2024-03-16T20:54:58.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.013+0000 7fbd27000640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd080a1ab0 0x7fbd080a3f70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:58.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.013+0000 7fbd27000640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd201050f0 0x7fbd201a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:58.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.013+0000 7fbd27000640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd20104730 0x7fbd20199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:58.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.013+0000 7fbd27000640 1 --2- 172.21.15.8:0/3320203564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd20103540 0x7fbd201996c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:54:58.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.013+0000 7fbd27000640 1 -- 172.21.15.8:0/3320203564 >> 172.21.15.8:0/3320203564 conn(0x7fbd200fead0 msgr2=0x7fbd201079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:54:58.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.014+0000 7fbd27000640 1 -- 172.21.15.8:0/3320203564 shutdown_connections 2024-03-16T20:54:58.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:54:58.014+0000 7fbd27000640 1 -- 172.21.15.8:0/3320203564 wait complete. 2024-03-16T20:54:58.117 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 20:54:57 smithi170 podman[66233]: 2024-03-16 20:54:57.840776679 +0000 UTC m=+0.379778428 container start 693a35867200e383b5b83b2a03642783379b256fe78c71d3bc25dd0f37a903ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-16T20:54:58.117 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 20:54:57 smithi170 ceph-mds[66252]: -- 172.21.15.170:0/3699299002 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d8a3d681a0 con 0x55d8a3d3e800 2024-03-16T20:54:58.117 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 20:54:57 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b[66248]: starting mds.b at 2024-03-16T20:54:58.117 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 20:54:57 smithi170 bash[66233]: 693a35867200e383b5b83b2a03642783379b256fe78c71d3bc25dd0f37a903ab 2024-03-16T20:54:58.117 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 20:54:57 smithi170 systemd[1]: Started Ceph mds.b for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T20:54:58.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:58 smithi008 ceph-mon[31434]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:58.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:58 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3320203564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:58.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:58 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:58 smithi170 ceph-mon[35947]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:58.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:58 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3320203564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:58.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:58 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:58 smithi186 ceph-mon[36391]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:54:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:58 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3320203564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:54:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:58 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:54:59.386 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:59 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] up:boot 2024-03-16T20:54:59.387 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:59 smithi170 ceph-mon[35947]: fsmap 12 up:standby 2024-03-16T20:54:59.387 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:59 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T20:54:59.387 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:54:59 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:54:59.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:59 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] up:boot 2024-03-16T20:54:59.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:59 smithi008 ceph-mon[31434]: fsmap 12 up:standby 2024-03-16T20:54:59.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:59 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T20:54:59.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:54:59 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:54:59.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:59 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] up:boot 2024-03-16T20:54:59.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:59 smithi186 ceph-mon[36391]: fsmap 12 up:standby 2024-03-16T20:54:59.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:59 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T20:54:59.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:54:59 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:55:00.038 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:55:00.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.263+0000 7f13b0c00640 1 -- 172.21.15.8:0/3708585154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac103730 msgr2=0x7f13ac103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:00.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.263+0000 7f13b0c00640 1 --2- 172.21.15.8:0/3708585154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac103730 0x7f13ac103b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f139c009900 tx=0x7f139c02bc30 comp rx=0 tx=0).stop 2024-03-16T20:55:00.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.263+0000 7f13b0c00640 1 -- 172.21.15.8:0/3708585154 shutdown_connections 2024-03-16T20:55:00.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.263+0000 7f13b0c00640 1 --2- 172.21.15.8:0/3708585154 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13ac1052e0 0x7f13ac10bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.263+0000 7f13b0c00640 1 --2- 172.21.15.8:0/3708585154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13ac104920 0x7f13ac104da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.263+0000 7f13b0c00640 1 --2- 172.21.15.8:0/3708585154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac103730 0x7f13ac103b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.263+0000 7f13b0c00640 1 -- 172.21.15.8:0/3708585154 >> 172.21.15.8:0/3708585154 conn(0x7f13ac0fece0 msgr2=0x7f13ac101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:00.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.263+0000 7f13b0c00640 1 -- 172.21.15.8:0/3708585154 shutdown_connections 2024-03-16T20:55:00.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.263+0000 7f13b0c00640 1 -- 172.21.15.8:0/3708585154 wait complete. 2024-03-16T20:55:00.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.264+0000 7f13b0c00640 1 Processor -- start 2024-03-16T20:55:00.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.264+0000 7f13b0c00640 1 -- start start 2024-03-16T20:55:00.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13b0c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13ac103730 0x7f13ac1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:00.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13b0c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13ac104920 0x7f13ac199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:00.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13b0c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac1052e0 0x7f13ac1a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:00.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13b0c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac1a13b0 con 0x7f13ac1052e0 2024-03-16T20:55:00.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13b0c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac1a1520 con 0x7f13ac104920 2024-03-16T20:55:00.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13b0c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac1a16e0 con 0x7f13ac103730 2024-03-16T20:55:00.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13a9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13ac104920 0x7f13ac199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:00.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13aa800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac1052e0 0x7f13ac1a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:00.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13a9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13ac104920 0x7f13ac199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40924/0 (socket says 172.21.15.8:40924) 2024-03-16T20:55:00.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13a9400640 1 -- 172.21.15.8:0/3607962268 learned_addr learned my addr 172.21.15.8:0/3607962268 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13a9e00640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13ac103730 0x7f13ac1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13aa800640 1 -- 172.21.15.8:0/3607962268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13ac103730 msgr2=0x7f13ac1998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13aa800640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13ac103730 0x7f13ac1998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13aa800640 1 -- 172.21.15.8:0/3607962268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13ac104920 msgr2=0x7f13ac199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13aa800640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13ac104920 0x7f13ac199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13aa800640 1 -- 172.21.15.8:0/3607962268 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398009490 con 0x7f13ac1052e0 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.265+0000 7f13a9400640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13ac104920 0x7f13ac199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.266+0000 7f13aa800640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac1052e0 0x7f13ac1a0e70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009fd0 tx=0x7f13a400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.266+0000 7f13a2a00640 1 -- 172.21.15.8:0/3607962268 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a400ce20 con 0x7f13ac1052e0 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.266+0000 7f13a2a00640 1 -- 172.21.15.8:0/3607962268 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f13a4004b20 con 0x7f13ac1052e0 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.266+0000 7f13b0c00640 1 -- 172.21.15.8:0/3607962268 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c009560 con 0x7f13ac1052e0 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.266+0000 7f13a2a00640 1 -- 172.21.15.8:0/3607962268 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4010710 con 0x7f13ac1052e0 2024-03-16T20:55:00.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.266+0000 7f13b0c00640 1 -- 172.21.15.8:0/3607962268 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac1a1d40 con 0x7f13ac1052e0 2024-03-16T20:55:00.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.267+0000 7f13b0c00640 1 -- 172.21.15.8:0/3607962268 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ac10a9f0 con 0x7f13ac1052e0 2024-03-16T20:55:00.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.270+0000 7f13a2a00640 1 -- 172.21.15.8:0/3607962268 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f13a4004c90 con 0x7f13ac1052e0 2024-03-16T20:55:00.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.271+0000 7f13a2a00640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f13900a1a30 0x7f13900a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:00.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.271+0000 7f13a2a00640 1 -- 172.21.15.8:0/3607962268 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f13a4014070 con 0x7f13ac1052e0 2024-03-16T20:55:00.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.271+0000 7f13a9e00640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f13900a1a30 0x7f13900a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:00.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.272+0000 7f13a9e00640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f13900a1a30 0x7f13900a3ef0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f139c02c170 tx=0x7f139c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:00.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.275+0000 7f13a2a00640 1 -- 172.21.15.8:0/3607962268 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f13a4096ce0 con 0x7f13ac1052e0 2024-03-16T20:55:00.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:00 smithi008 ceph-mon[31434]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:00.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:00 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:00 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:00 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:00 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.544+0000 7f13b0c00640 1 -- 172.21.15.8:0/3607962268 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13ac02d000 con 0x7f13ac1052e0 2024-03-16T20:55:00.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.545+0000 7f13a2a00640 1 -- 172.21.15.8:0/3607962268 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10034 (secure 0 0 0) 0x7f13a409a3a0 con 0x7f13ac1052e0 2024-03-16T20:55:00.549 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:00.549 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24511,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24544,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2024-03-16T20:55:00.549 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 13 2024-03-16T20:55:00.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 -- 172.21.15.8:0/3607962268 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f13900a1a30 msgr2=0x7f13900a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:00.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f13900a1a30 0x7f13900a3ef0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f139c02c170 tx=0x7f139c000bc0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 -- 172.21.15.8:0/3607962268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac1052e0 msgr2=0x7f13ac1a0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac1052e0 0x7f13ac1a0e70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009fd0 tx=0x7f13a400ef10 comp rx=0 tx=0).stop 2024-03-16T20:55:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 -- 172.21.15.8:0/3607962268 shutdown_connections 2024-03-16T20:55:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f13900a1a30 0x7f13900a3ef0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ac1052e0 0x7f13ac1a0e70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13ac104920 0x7f13ac199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 --2- 172.21.15.8:0/3607962268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13ac103730 0x7f13ac1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 -- 172.21.15.8:0/3607962268 >> 172.21.15.8:0/3607962268 conn(0x7f13ac0fece0 msgr2=0x7f13ac107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 -- 172.21.15.8:0/3607962268 shutdown_connections 2024-03-16T20:55:00.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.548+0000 7f13b0c00640 1 -- 172.21.15.8:0/3607962268 wait complete. 2024-03-16T20:55:00.571 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:55:00.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:00 smithi170 ceph-mon[35947]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:00.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:00 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:00 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:00 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:00 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:00 smithi186 ceph-mon[36391]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:00.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:00 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:00 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:00 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:00 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.765+0000 7f4381e00640 1 -- 172.21.15.8:0/2923839827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f437c075530 msgr2=0x7f437c073980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.765+0000 7f4381e00640 1 --2- 172.21.15.8:0/2923839827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f437c075530 0x7f437c073980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4370009930 tx=0x7f437002bc30 comp rx=0 tx=0).stop 2024-03-16T20:55:00.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.765+0000 7f4381e00640 1 -- 172.21.15.8:0/2923839827 shutdown_connections 2024-03-16T20:55:00.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.765+0000 7f4381e00640 1 --2- 172.21.15.8:0/2923839827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f437c10d930 0x7f437c10fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.765+0000 7f4381e00640 1 --2- 172.21.15.8:0/2923839827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f437c073f50 0x7f437c0743d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.765+0000 7f4381e00640 1 --2- 172.21.15.8:0/2923839827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f437c075530 0x7f437c073980 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.765+0000 7f4381e00640 1 -- 172.21.15.8:0/2923839827 >> 172.21.15.8:0/2923839827 conn(0x7f437c0fc8d0 msgr2=0x7f437c0fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:00.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.765+0000 7f4381e00640 1 -- 172.21.15.8:0/2923839827 shutdown_connections 2024-03-16T20:55:00.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.765+0000 7f4381e00640 1 -- 172.21.15.8:0/2923839827 wait complete. 2024-03-16T20:55:00.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.766+0000 7f4381e00640 1 Processor -- start 2024-03-16T20:55:00.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f4381e00640 1 -- start start 2024-03-16T20:55:00.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f4381e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f437c073f50 0x7f437c19daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:00.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f4381e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f437c075530 0x7f437c19e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:00.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f4381e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f437c10d930 0x7f437c1a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:00.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f4381e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c1a55e0 con 0x7f437c10d930 2024-03-16T20:55:00.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f4381e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c1a5750 con 0x7f437c073f50 2024-03-16T20:55:00.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f4381e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c1a5910 con 0x7f437c075530 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f4381400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f437c10d930 0x7f437c1a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f437be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f437c075530 0x7f437c19e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f4381400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f437c10d930 0x7f437c1a50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40342/0 (socket says 172.21.15.8:40342) 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f4381400640 1 -- 172.21.15.8:0/33918580 learned_addr learned my addr 172.21.15.8:0/33918580 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.767+0000 7f437be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f437c075530 0x7f437c19e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:49710/0 (socket says 172.21.15.8:49710) 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.768+0000 7f4380a00640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f437c073f50 0x7f437c19daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.768+0000 7f4381400640 1 -- 172.21.15.8:0/33918580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f437c075530 msgr2=0x7f437c19e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.768+0000 7f4381400640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f437c075530 0x7f437c19e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.768+0000 7f4381400640 1 -- 172.21.15.8:0/33918580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f437c073f50 msgr2=0x7f437c19daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.768+0000 7f4381400640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f437c073f50 0x7f437c19daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.768+0000 7f4381400640 1 -- 172.21.15.8:0/33918580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4370009560 con 0x7f437c10d930 2024-03-16T20:55:00.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.768+0000 7f4380a00640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f437c073f50 0x7f437c19daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:00.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.768+0000 7f437be00640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f437c075530 0x7f437c19e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:00.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.769+0000 7f4381400640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f437c10d930 0x7f437c1a50a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f437400eb10 tx=0x7f437400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:00.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.769+0000 7f4379600640 1 -- 172.21.15.8:0/33918580 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374004b20 con 0x7f437c10d930 2024-03-16T20:55:00.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.769+0000 7f4379600640 1 -- 172.21.15.8:0/33918580 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4374004c80 con 0x7f437c10d930 2024-03-16T20:55:00.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.769+0000 7f4379600640 1 -- 172.21.15.8:0/33918580 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374010760 con 0x7f437c10d930 2024-03-16T20:55:00.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.769+0000 7f4381e00640 1 -- 172.21.15.8:0/33918580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437c1a5bf0 con 0x7f437c10d930 2024-03-16T20:55:00.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.769+0000 7f4381e00640 1 -- 172.21.15.8:0/33918580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437c1a6150 con 0x7f437c10d930 2024-03-16T20:55:00.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.771+0000 7f4381e00640 1 -- 172.21.15.8:0/33918580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437c103b00 con 0x7f437c10d930 2024-03-16T20:55:00.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.773+0000 7f4379600640 1 -- 172.21.15.8:0/33918580 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f4374005020 con 0x7f437c10d930 2024-03-16T20:55:00.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.774+0000 7f4379600640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43640a1ab0 0x7f43640a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:00.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.774+0000 7f4379600640 1 -- 172.21.15.8:0/33918580 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4374014070 con 0x7f437c10d930 2024-03-16T20:55:00.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.774+0000 7f4380a00640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43640a1ab0 0x7f43640a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:00.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.776+0000 7f4380a00640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43640a1ab0 0x7f43640a3f70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4370036040 tx=0x7f4370000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:00.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.779+0000 7f4379600640 1 -- 172.21.15.8:0/33918580 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4374096ab0 con 0x7f437c10d930 2024-03-16T20:55:00.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.989+0000 7f4381e00640 1 -- 172.21.15.8:0/33918580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f437c1134e0 con 0x7f437c10d930 2024-03-16T20:55:00.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.990+0000 7f4379600640 1 -- 172.21.15.8:0/33918580 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18385 (secure 0 0 0) 0x7f437409a170 con 0x7f437c10d930 2024-03-16T20:55:00.994 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:00.995 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":82,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:54:07.407682+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:55:00.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 -- 172.21.15.8:0/33918580 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43640a1ab0 msgr2=0x7f43640a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:00.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43640a1ab0 0x7f43640a3f70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4370036040 tx=0x7f4370000bc0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 -- 172.21.15.8:0/33918580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f437c10d930 msgr2=0x7f437c1a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f437c10d930 0x7f437c1a50a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f437400eb10 tx=0x7f437400c2d0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 -- 172.21.15.8:0/33918580 shutdown_connections 2024-03-16T20:55:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f43640a1ab0 0x7f43640a3f70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f437c10d930 0x7f437c1a50a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f437c075530 0x7f437c19e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 --2- 172.21.15.8:0/33918580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f437c073f50 0x7f437c19daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 -- 172.21.15.8:0/33918580 >> 172.21.15.8:0/33918580 conn(0x7f437c0fc8d0 msgr2=0x7f437c100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 -- 172.21.15.8:0/33918580 shutdown_connections 2024-03-16T20:55:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:00.993+0000 7f4381e00640 1 -- 172.21.15.8:0/33918580 wait complete. 2024-03-16T20:55:01.016 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T20:55:01.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T20:55:01.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.233+0000 7f6a8a400640 1 -- 172.21.15.8:0/1112678170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a841026f0 msgr2=0x7f6a84102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:01.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.233+0000 7f6a8a400640 1 --2- 172.21.15.8:0/1112678170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a841026f0 0x7f6a84102b70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009860 tx=0x7f6a7002bb70 comp rx=0 tx=0).stop 2024-03-16T20:55:01.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.233+0000 7f6a8a400640 1 -- 172.21.15.8:0/1112678170 shutdown_connections 2024-03-16T20:55:01.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.233+0000 7f6a8a400640 1 --2- 172.21.15.8:0/1112678170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a841030b0 0x7f6a84109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.233+0000 7f6a8a400640 1 --2- 172.21.15.8:0/1112678170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a841026f0 0x7f6a84102b70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.233+0000 7f6a8a400640 1 --2- 172.21.15.8:0/1112678170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a84101500 0x7f6a84101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.233+0000 7f6a8a400640 1 -- 172.21.15.8:0/1112678170 >> 172.21.15.8:0/1112678170 conn(0x7f6a840fca70 msgr2=0x7f6a840feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:01.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.233+0000 7f6a8a400640 1 -- 172.21.15.8:0/1112678170 shutdown_connections 2024-03-16T20:55:01.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.233+0000 7f6a8a400640 1 -- 172.21.15.8:0/1112678170 wait complete. 2024-03-16T20:55:01.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.234+0000 7f6a8a400640 1 Processor -- start 2024-03-16T20:55:01.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a8a400640 1 -- start start 2024-03-16T20:55:01.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a8a400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a84101500 0x7f6a84197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:01.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a8a400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a841026f0 0x7f6a84197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:01.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a8a400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a841030b0 0x7f6a8419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:01.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a8a400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8419f160 con 0x7f6a841026f0 2024-03-16T20:55:01.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a8a400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8419f2d0 con 0x7f6a841030b0 2024-03-16T20:55:01.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a8a400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8419f490 con 0x7f6a84101500 2024-03-16T20:55:01.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a82a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a841026f0 0x7f6a84197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:01.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a83400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a84101500 0x7f6a84197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:01.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a83400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a84101500 0x7f6a84197670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:49722/0 (socket says 172.21.15.8:49722) 2024-03-16T20:55:01.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a83400640 1 -- 172.21.15.8:0/3454437952 learned_addr learned my addr 172.21.15.8:0/3454437952 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:01.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.235+0000 7f6a83e00640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a841030b0 0x7f6a8419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:01.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.236+0000 7f6a83400640 1 -- 172.21.15.8:0/3454437952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a841030b0 msgr2=0x7f6a8419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:01.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.236+0000 7f6a83400640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a841030b0 0x7f6a8419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.236+0000 7f6a83400640 1 -- 172.21.15.8:0/3454437952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a841026f0 msgr2=0x7f6a84197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:01.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.236+0000 7f6a83400640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a841026f0 0x7f6a84197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.236+0000 7f6a83400640 1 -- 172.21.15.8:0/3454437952 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a74009560 con 0x7f6a84101500 2024-03-16T20:55:01.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.236+0000 7f6a82a00640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a841026f0 0x7f6a84197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:01.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.236+0000 7f6a83400640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a84101500 0x7f6a84197670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400e9a0 tx=0x7f6a7400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:01.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.236+0000 7f6a7be00640 1 -- 172.21.15.8:0/3454437952 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7400cd80 con 0x7f6a84101500 2024-03-16T20:55:01.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.236+0000 7f6a7be00640 1 -- 172.21.15.8:0/3454437952 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6a74010930 con 0x7f6a84101500 2024-03-16T20:55:01.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.237+0000 7f6a8a400640 1 -- 172.21.15.8:0/3454437952 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a70009490 con 0x7f6a84101500 2024-03-16T20:55:01.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.237+0000 7f6a7be00640 1 -- 172.21.15.8:0/3454437952 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74018a60 con 0x7f6a84101500 2024-03-16T20:55:01.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.237+0000 7f6a8a400640 1 -- 172.21.15.8:0/3454437952 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8419fac0 con 0x7f6a84101500 2024-03-16T20:55:01.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.238+0000 7f6a8a400640 1 -- 172.21.15.8:0/3454437952 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a841087c0 con 0x7f6a84101500 2024-03-16T20:55:01.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.241+0000 7f6a7be00640 1 -- 172.21.15.8:0/3454437952 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f6a74010aa0 con 0x7f6a84101500 2024-03-16T20:55:01.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.242+0000 7f6a7be00640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a680a1a30 0x7f6a680a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:01.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.242+0000 7f6a7be00640 1 -- 172.21.15.8:0/3454437952 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6a74014070 con 0x7f6a84101500 2024-03-16T20:55:01.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.242+0000 7f6a82a00640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a680a1a30 0x7f6a680a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:01.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.243+0000 7f6a82a00640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a680a1a30 0x7f6a680a3ef0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a7002c180 tx=0x7f6a70034c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.246+0000 7f6a7be00640 1 -- 172.21.15.8:0/3454437952 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6a74096b80 con 0x7f6a84101500 2024-03-16T20:55:01.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.459+0000 7f6a8a400640 1 -- 172.21.15.8:0/3454437952 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a8402cf90 con 0x7f6a84101500 2024-03-16T20:55:01.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.460+0000 7f6a7be00640 1 -- 172.21.15.8:0/3454437952 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a7409a240 con 0x7f6a84101500 2024-03-16T20:55:01.464 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T20:55:01.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 -- 172.21.15.8:0/3454437952 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a680a1a30 msgr2=0x7f6a680a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:01.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a680a1a30 0x7f6a680a3ef0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a7002c180 tx=0x7f6a70034c40 comp rx=0 tx=0).stop 2024-03-16T20:55:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 -- 172.21.15.8:0/3454437952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a84101500 msgr2=0x7f6a84197670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a84101500 0x7f6a84197670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400e9a0 tx=0x7f6a7400ee60 comp rx=0 tx=0).stop 2024-03-16T20:55:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 -- 172.21.15.8:0/3454437952 shutdown_connections 2024-03-16T20:55:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6a680a1a30 0x7f6a680a3ef0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a841030b0 0x7f6a8419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a841026f0 0x7f6a84197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 --2- 172.21.15.8:0/3454437952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a84101500 0x7f6a84197670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 -- 172.21.15.8:0/3454437952 >> 172.21.15.8:0/3454437952 conn(0x7f6a840fca70 msgr2=0x7f6a84105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:01.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 -- 172.21.15.8:0/3454437952 shutdown_connections 2024-03-16T20:55:01.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.463+0000 7f6a8a400640 1 -- 172.21.15.8:0/3454437952 wait complete. 2024-03-16T20:55:01.483 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:01 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3607962268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:55:01.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:01 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/33918580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:01.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:01 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:01.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:01 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:01.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:01 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:55:01.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:01 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:55:01.484 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:01 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:01.487 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T20:55:01.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:01 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3607962268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:55:01.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:01 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/33918580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:01.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:01 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:01.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:01 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:01.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:01 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:55:01.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:01 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:55:01.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:01 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:01 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3607962268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:55:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:01 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/33918580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:01 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:01 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:01 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:55:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:01 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:55:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:01 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.675+0000 7f4232000640 1 -- 172.21.15.8:0/1299848724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c103710 msgr2=0x7f422c103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.675+0000 7f4232000640 1 --2- 172.21.15.8:0/1299848724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c103710 0x7f422c103b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f421c009900 tx=0x7f421c02bc40 comp rx=0 tx=0).stop 2024-03-16T20:55:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.675+0000 7f4232000640 1 -- 172.21.15.8:0/1299848724 shutdown_connections 2024-03-16T20:55:01.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.675+0000 7f4232000640 1 --2- 172.21.15.8:0/1299848724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422c1052c0 0x7f422c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.675+0000 7f4232000640 1 --2- 172.21.15.8:0/1299848724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f422c104900 0x7f422c104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.675+0000 7f4232000640 1 --2- 172.21.15.8:0/1299848724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c103710 0x7f422c103b30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.675+0000 7f4232000640 1 -- 172.21.15.8:0/1299848724 >> 172.21.15.8:0/1299848724 conn(0x7f422c0feca0 msgr2=0x7f422c1010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.675+0000 7f4232000640 1 -- 172.21.15.8:0/1299848724 shutdown_connections 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.675+0000 7f4232000640 1 -- 172.21.15.8:0/1299848724 wait complete. 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.676+0000 7f4232000640 1 Processor -- start 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f4232000640 1 -- start start 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f4232000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c103710 0x7f422c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f4232000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422c104900 0x7f422c199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f4232000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f422c1052c0 0x7f422c1a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f4232000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c1a1380 con 0x7f422c104900 2024-03-16T20:55:01.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f4232000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c1a14f0 con 0x7f422c103710 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f4232000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c1a16b0 con 0x7f422c1052c0 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f422b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c103710 0x7f422c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f422b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c103710 0x7f422c199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40980/0 (socket says 172.21.15.8:40980) 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f422b400640 1 -- 172.21.15.8:0/744682041 learned_addr learned my addr 172.21.15.8:0/744682041 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f422be00640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f422c1052c0 0x7f422c1a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.677+0000 7f422aa00640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422c104900 0x7f422c199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.678+0000 7f422b400640 1 -- 172.21.15.8:0/744682041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f422c1052c0 msgr2=0x7f422c1a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.678+0000 7f422b400640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f422c1052c0 0x7f422c1a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.678+0000 7f422b400640 1 -- 172.21.15.8:0/744682041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422c104900 msgr2=0x7f422c199dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.678+0000 7f422b400640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422c104900 0x7f422c199dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.678+0000 7f422b400640 1 -- 172.21.15.8:0/744682041 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218009490 con 0x7f422c103710 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.678+0000 7f422b400640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c103710 0x7f422c199890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f421c000c00 tx=0x7f421c005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.678+0000 7f4223e00640 1 -- 172.21.15.8:0/744682041 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c004350 con 0x7f422c103710 2024-03-16T20:55:01.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.678+0000 7f4223e00640 1 -- 172.21.15.8:0/744682041 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f421c0044b0 con 0x7f422c103710 2024-03-16T20:55:01.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.678+0000 7f4232000640 1 -- 172.21.15.8:0/744682041 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421c009560 con 0x7f422c103710 2024-03-16T20:55:01.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.678+0000 7f4223e00640 1 -- 172.21.15.8:0/744682041 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c003db0 con 0x7f422c103710 2024-03-16T20:55:01.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.679+0000 7f4232000640 1 -- 172.21.15.8:0/744682041 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c1a1d00 con 0x7f422c103710 2024-03-16T20:55:01.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.680+0000 7f4232000640 1 -- 172.21.15.8:0/744682041 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c10a9d0 con 0x7f422c103710 2024-03-16T20:55:01.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.681+0000 7f4223e00640 1 -- 172.21.15.8:0/744682041 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f421c004e10 con 0x7f422c103710 2024-03-16T20:55:01.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.683+0000 7f4223e00640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42100a1ab0 0x7f42100a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:01.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.683+0000 7f4223e00640 1 -- 172.21.15.8:0/744682041 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f421c0ef720 con 0x7f422c103710 2024-03-16T20:55:01.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.683+0000 7f422aa00640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42100a1ab0 0x7f42100a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:01.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.684+0000 7f422aa00640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42100a1ab0 0x7f42100a3f70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f422c19ada0 tx=0x7f4218005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:01.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.686+0000 7f4223e00640 1 -- 172.21.15.8:0/744682041 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f421c0b8e50 con 0x7f422c103710 2024-03-16T20:55:01.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.892+0000 7f4232000640 1 -- 172.21.15.8:0/744682041 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f422c02d000 con 0x7f422c103710 2024-03-16T20:55:01.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.893+0000 7f4223e00640 1 -- 172.21.15.8:0/744682041 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7f421c0bc510 con 0x7f422c103710 2024-03-16T20:55:01.896 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:01.897 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2024-03-16T20:55:01.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T20:55:01.897 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2024-03-16T20:55:01.897 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2024-03-16T20:55:01.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T20:55:01.897 INFO:teuthology.orchestra.run.smithi008.stdout:] 2024-03-16T20:55:01.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.895+0000 7f4232000640 1 -- 172.21.15.8:0/744682041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42100a1ab0 msgr2=0x7f42100a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.895+0000 7f4232000640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42100a1ab0 0x7f42100a3f70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f422c19ada0 tx=0x7f4218005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.895+0000 7f4232000640 1 -- 172.21.15.8:0/744682041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c103710 msgr2=0x7f422c199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.895+0000 7f4232000640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c103710 0x7f422c199890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f421c000c00 tx=0x7f421c005dd0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.896+0000 7f4232000640 1 -- 172.21.15.8:0/744682041 shutdown_connections 2024-03-16T20:55:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.896+0000 7f4232000640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42100a1ab0 0x7f42100a3f70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.896+0000 7f4232000640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f422c1052c0 0x7f422c1a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.896+0000 7f4232000640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422c104900 0x7f422c199dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.896+0000 7f4232000640 1 --2- 172.21.15.8:0/744682041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c103710 0x7f422c199890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.896+0000 7f4232000640 1 -- 172.21.15.8:0/744682041 >> 172.21.15.8:0/744682041 conn(0x7f422c0feca0 msgr2=0x7f422c107ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.896+0000 7f4232000640 1 -- 172.21.15.8:0/744682041 shutdown_connections 2024-03-16T20:55:01.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:01.896+0000 7f4232000640 1 -- 172.21.15.8:0/744682041 wait complete. 2024-03-16T20:55:01.918 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T20:55:01.918 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T20:55:02.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.129+0000 7ff418000640 1 -- 172.21.15.8:0/1610513669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4101030b0 msgr2=0x7ff410109940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:02.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.129+0000 7ff418000640 1 --2- 172.21.15.8:0/1610513669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4101030b0 0x7ff410109940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff408009ca0 tx=0x7ff40802c100 comp rx=0 tx=0).stop 2024-03-16T20:55:02.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.130+0000 7ff418000640 1 -- 172.21.15.8:0/1610513669 shutdown_connections 2024-03-16T20:55:02.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.130+0000 7ff418000640 1 --2- 172.21.15.8:0/1610513669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4101030b0 0x7ff410109940 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:02.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.130+0000 7ff418000640 1 --2- 172.21.15.8:0/1610513669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4101026f0 0x7ff410102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:02.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.130+0000 7ff418000640 1 --2- 172.21.15.8:0/1610513669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff410101500 0x7ff410101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:02.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.130+0000 7ff418000640 1 -- 172.21.15.8:0/1610513669 >> 172.21.15.8:0/1610513669 conn(0x7ff4100fca90 msgr2=0x7ff4100feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:02.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.130+0000 7ff418000640 1 -- 172.21.15.8:0/1610513669 shutdown_connections 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.130+0000 7ff418000640 1 -- 172.21.15.8:0/1610513669 wait complete. 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff418000640 1 Processor -- start 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff418000640 1 -- start start 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff418000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff410101500 0x7ff4100752a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff418000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4101026f0 0x7ff4100738e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff418000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4101030b0 0x7ff410073e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff418000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff410074580 con 0x7ff410101500 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff418000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100746f0 con 0x7ff4101030b0 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff418000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4101a1700 con 0x7ff4101026f0 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff415600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff410101500 0x7ff4100752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff414c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4101026f0 0x7ff4100738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff416000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4101030b0 0x7ff410073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff415600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff410101500 0x7ff4100752a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40412/0 (socket says 172.21.15.8:40412) 2024-03-16T20:55:02.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.131+0000 7ff415600640 1 -- 172.21.15.8:0/831563889 learned_addr learned my addr 172.21.15.8:0/831563889 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:02.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.132+0000 7ff416000640 1 -- 172.21.15.8:0/831563889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4101026f0 msgr2=0x7ff4100738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:02.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.132+0000 7ff416000640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4101026f0 0x7ff4100738e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:02.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.132+0000 7ff416000640 1 -- 172.21.15.8:0/831563889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff410101500 msgr2=0x7ff4100752a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:02.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.132+0000 7ff416000640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff410101500 0x7ff4100752a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:02.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.132+0000 7ff416000640 1 -- 172.21.15.8:0/831563889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff408009900 con 0x7ff4101030b0 2024-03-16T20:55:02.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.132+0000 7ff414c00640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4101026f0 0x7ff4100738e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:02.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.132+0000 7ff416000640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4101030b0 0x7ff410073e20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff408037040 tx=0x7ff408032a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:02.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.133+0000 7ff40e000640 1 -- 172.21.15.8:0/831563889 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408034850 con 0x7ff4101030b0 2024-03-16T20:55:02.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.133+0000 7ff418000640 1 -- 172.21.15.8:0/831563889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4101a1950 con 0x7ff4101030b0 2024-03-16T20:55:02.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.133+0000 7ff40e000640 1 -- 172.21.15.8:0/831563889 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff408003e70 con 0x7ff4101030b0 2024-03-16T20:55:02.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.133+0000 7ff40e000640 1 -- 172.21.15.8:0/831563889 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40803f440 con 0x7ff4101030b0 2024-03-16T20:55:02.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.133+0000 7ff418000640 1 -- 172.21.15.8:0/831563889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4101a1e00 con 0x7ff4101030b0 2024-03-16T20:55:02.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.134+0000 7ff418000640 1 -- 172.21.15.8:0/831563889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4101087c0 con 0x7ff4101030b0 2024-03-16T20:55:02.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.137+0000 7ff40e000640 1 -- 172.21.15.8:0/831563889 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7ff40803b040 con 0x7ff4101030b0 2024-03-16T20:55:02.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.138+0000 7ff40e000640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3f80a1a30 0x7ff3f80a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:02.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.138+0000 7ff40e000640 1 -- 172.21.15.8:0/831563889 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff4080ef9d0 con 0x7ff4101030b0 2024-03-16T20:55:02.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.138+0000 7ff415600640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3f80a1a30 0x7ff3f80a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:02.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.139+0000 7ff415600640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3f80a1a30 0x7ff3f80a3ef0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4040058c0 tx=0x7ff404005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:02.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.142+0000 7ff40e000640 1 -- 172.21.15.8:0/831563889 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff4080b8fe0 con 0x7ff4101030b0 2024-03-16T20:55:02.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:02.353+0000 7ff418000640 1 -- 172.21.15.8:0/831563889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff41002d060 con 0x7ff4101030b0 2024-03-16T20:55:02.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:02 smithi008 ceph-mon[31434]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:02.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:02 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3454437952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:55:02.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:02 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:55:02.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:02 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/744682041' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-16T20:55:02.535 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:02 smithi186 ceph-mon[36391]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:02.536 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:02 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3454437952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:55:02.536 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:02 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:55:02.536 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:02 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/744682041' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-16T20:55:02.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:02 smithi170 ceph-mon[35947]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:02.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:02 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3454437952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:55:02.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:02 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:55:02.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:02 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/744682041' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-16T20:55:03.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.238+0000 7ff40e000640 1 -- 172.21.15.8:0/831563889 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff408032e90 con 0x7ff4101030b0 2024-03-16T20:55:03.243 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2024-03-16T20:55:03.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.244+0000 7ff418000640 1 -- 172.21.15.8:0/831563889 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3f80a1a30 msgr2=0x7ff3f80a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:03.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.244+0000 7ff418000640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3f80a1a30 0x7ff3f80a3ef0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4040058c0 tx=0x7ff404005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:03.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.244+0000 7ff418000640 1 -- 172.21.15.8:0/831563889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4101030b0 msgr2=0x7ff410073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:03.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.244+0000 7ff418000640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4101030b0 0x7ff410073e20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff408037040 tx=0x7ff408032a70 comp rx=0 tx=0).stop 2024-03-16T20:55:03.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.245+0000 7ff418000640 1 -- 172.21.15.8:0/831563889 shutdown_connections 2024-03-16T20:55:03.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.245+0000 7ff418000640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3f80a1a30 0x7ff3f80a3ef0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:03.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.245+0000 7ff418000640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4101030b0 0x7ff410073e20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:03.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.245+0000 7ff418000640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4101026f0 0x7ff4100738e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:03.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.245+0000 7ff418000640 1 --2- 172.21.15.8:0/831563889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff410101500 0x7ff4100752a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:03.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.245+0000 7ff418000640 1 -- 172.21.15.8:0/831563889 >> 172.21.15.8:0/831563889 conn(0x7ff4100fca90 msgr2=0x7ff410105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:03.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.247+0000 7ff418000640 1 -- 172.21.15.8:0/831563889 shutdown_connections 2024-03-16T20:55:03.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.247+0000 7ff418000640 1 -- 172.21.15.8:0/831563889 wait complete. 2024-03-16T20:55:03.275 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T20:55:03.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.463+0000 7f0a94400640 1 -- 172.21.15.8:0/649091338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c1006c0 msgr2=0x7f0a8c100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:03.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.463+0000 7f0a94400640 1 --2- 172.21.15.8:0/649091338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c1006c0 0x7f0a8c100b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009900 tx=0x7f0a7802bc50 comp rx=0 tx=0).stop 2024-03-16T20:55:03.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.463+0000 7f0a94400640 1 -- 172.21.15.8:0/649091338 shutdown_connections 2024-03-16T20:55:03.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.463+0000 7f0a94400640 1 --2- 172.21.15.8:0/649091338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a8c101060 0x7f0a8c1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:03.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.463+0000 7f0a94400640 1 --2- 172.21.15.8:0/649091338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c1006c0 0x7f0a8c100b20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:03.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.463+0000 7f0a94400640 1 --2- 172.21.15.8:0/649091338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a8c0ffd60 0x7f0a8c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:03.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.463+0000 7f0a94400640 1 -- 172.21.15.8:0/649091338 >> 172.21.15.8:0/649091338 conn(0x7f0a8c0fb980 msgr2=0x7f0a8c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:03.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.463+0000 7f0a94400640 1 -- 172.21.15.8:0/649091338 shutdown_connections 2024-03-16T20:55:03.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.463+0000 7f0a94400640 1 -- 172.21.15.8:0/649091338 wait complete. 2024-03-16T20:55:03.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a94400640 1 Processor -- start 2024-03-16T20:55:03.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a94400640 1 -- start start 2024-03-16T20:55:03.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a94400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a8c0ffd60 0x7f0a8c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:03.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a94400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a8c1006c0 0x7f0a8c199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:03.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a94400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c101060 0x7f0a8c1a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:03.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a94400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c1a13a0 con 0x7f0a8c0ffd60 2024-03-16T20:55:03.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a94400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c1a1510 con 0x7f0a8c1006c0 2024-03-16T20:55:03.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a94400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c1a16d0 con 0x7f0a8c101060 2024-03-16T20:55:03.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a91a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a8c0ffd60 0x7f0a8c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:03.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a91a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a8c0ffd60 0x7f0a8c1998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40430/0 (socket says 172.21.15.8:40430) 2024-03-16T20:55:03.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a91a00640 1 -- 172.21.15.8:0/3780915614 learned_addr learned my addr 172.21.15.8:0/3780915614 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:03.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.464+0000 7f0a91000640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a8c1006c0 0x7f0a8c199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:03.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.465+0000 7f0a92400640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c101060 0x7f0a8c1a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:03.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.465+0000 7f0a92400640 1 -- 172.21.15.8:0/3780915614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a8c1006c0 msgr2=0x7f0a8c199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.465+0000 7f0a92400640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a8c1006c0 0x7f0a8c199df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.465+0000 7f0a92400640 1 -- 172.21.15.8:0/3780915614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a8c0ffd60 msgr2=0x7f0a8c1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.465+0000 7f0a92400640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a8c0ffd60 0x7f0a8c1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.465+0000 7f0a92400640 1 -- 172.21.15.8:0/3780915614 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78009560 con 0x7f0a8c101060 2024-03-16T20:55:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.465+0000 7f0a91a00640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a8c0ffd60 0x7f0a8c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:03.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.465+0000 7f0a92400640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c101060 0x7f0a8c1a0e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400da10 tx=0x7f0a8400ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:03.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.465+0000 7f0a8a000640 1 -- 172.21.15.8:0/3780915614 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400bd70 con 0x7f0a8c101060 2024-03-16T20:55:03.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.466+0000 7f0a8a000640 1 -- 172.21.15.8:0/3780915614 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0a84003e70 con 0x7f0a8c101060 2024-03-16T20:55:03.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.466+0000 7f0a94400640 1 -- 172.21.15.8:0/3780915614 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c1a19b0 con 0x7f0a8c101060 2024-03-16T20:55:03.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.466+0000 7f0a8a000640 1 -- 172.21.15.8:0/3780915614 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84010770 con 0x7f0a8c101060 2024-03-16T20:55:03.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.466+0000 7f0a94400640 1 -- 172.21.15.8:0/3780915614 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c1a1e90 con 0x7f0a8c101060 2024-03-16T20:55:03.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.467+0000 7f0a94400640 1 -- 172.21.15.8:0/3780915614 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c10acb0 con 0x7f0a8c101060 2024-03-16T20:55:03.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.469+0000 7f0a8a000640 1 -- 172.21.15.8:0/3780915614 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f0a84004350 con 0x7f0a8c101060 2024-03-16T20:55:03.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.470+0000 7f0a8a000640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0a740a1ab0 0x7f0a740a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:03.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.470+0000 7f0a8a000640 1 -- 172.21.15.8:0/3780915614 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f0a840cd3b0 con 0x7f0a8c101060 2024-03-16T20:55:03.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.470+0000 7f0a91a00640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0a740a1ab0 0x7f0a740a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:03.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.471+0000 7f0a91a00640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0a740a1ab0 0x7f0a740a3f70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0a80011550 tx=0x7f0a80005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:03.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.474+0000 7f0a8a000640 1 -- 172.21.15.8:0/3780915614 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0a84096850 con 0x7f0a8c101060 2024-03-16T20:55:03.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:03 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/831563889' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T20:55:03.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:03 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T20:55:03.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:03 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/831563889' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T20:55:03.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:03 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T20:55:03.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:03 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/831563889' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T20:55:03.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:03 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T20:55:03.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:03.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:03.678+0000 7f0a94400640 1 -- 172.21.15.8:0/3780915614 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0a8c10f2a0 con 0x7f0a8c101060 2024-03-16T20:55:04.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.248+0000 7f0a8a000640 1 -- 172.21.15.8:0/3780915614 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0a84003fe0 con 0x7f0a8c101060 2024-03-16T20:55:04.254 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2024-03-16T20:55:04.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.255+0000 7f0a94400640 1 -- 172.21.15.8:0/3780915614 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0a740a1ab0 msgr2=0x7f0a740a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:04.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.255+0000 7f0a94400640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0a740a1ab0 0x7f0a740a3f70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0a80011550 tx=0x7f0a80005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:04.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.255+0000 7f0a94400640 1 -- 172.21.15.8:0/3780915614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c101060 msgr2=0x7f0a8c1a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.255+0000 7f0a94400640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c101060 0x7f0a8c1a0e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400da10 tx=0x7f0a8400ded0 comp rx=0 tx=0).stop 2024-03-16T20:55:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.257+0000 7f0a94400640 1 -- 172.21.15.8:0/3780915614 shutdown_connections 2024-03-16T20:55:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.257+0000 7f0a94400640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0a740a1ab0 0x7f0a740a3f70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.257+0000 7f0a94400640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c101060 0x7f0a8c1a0e60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.257+0000 7f0a94400640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a8c1006c0 0x7f0a8c199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.257+0000 7f0a94400640 1 --2- 172.21.15.8:0/3780915614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0a8c0ffd60 0x7f0a8c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.257+0000 7f0a94400640 1 -- 172.21.15.8:0/3780915614 >> 172.21.15.8:0/3780915614 conn(0x7f0a8c0fb980 msgr2=0x7f0a8c0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.257+0000 7f0a94400640 1 -- 172.21.15.8:0/3780915614 shutdown_connections 2024-03-16T20:55:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.257+0000 7f0a94400640 1 -- 172.21.15.8:0/3780915614 wait complete. 2024-03-16T20:55:04.292 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T20:55:04.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.474+0000 7f74cac00640 1 -- 172.21.15.8:0/2990804285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74c4105ed0 msgr2=0x7f74c4108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:04.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.474+0000 7f74cac00640 1 --2- 172.21.15.8:0/2990804285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74c4105ed0 0x7f74c4108360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009ca0 tx=0x7f74bc02c0f0 comp rx=0 tx=0).stop 2024-03-16T20:55:04.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.474+0000 7f74cac00640 1 -- 172.21.15.8:0/2990804285 shutdown_connections 2024-03-16T20:55:04.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.474+0000 7f74cac00640 1 --2- 172.21.15.8:0/2990804285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74c4105ed0 0x7f74c4108360 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.474+0000 7f74cac00640 1 --2- 172.21.15.8:0/2990804285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74c41034c0 0x7f74c41058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.474+0000 7f74cac00640 1 --2- 172.21.15.8:0/2990804285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c4100b90 0x7f74c4102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.474+0000 7f74cac00640 1 -- 172.21.15.8:0/2990804285 >> 172.21.15.8:0/2990804285 conn(0x7f74c40fab70 msgr2=0x7f74c40fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.475+0000 7f74cac00640 1 -- 172.21.15.8:0/2990804285 shutdown_connections 2024-03-16T20:55:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.475+0000 7f74cac00640 1 -- 172.21.15.8:0/2990804285 wait complete. 2024-03-16T20:55:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.475+0000 7f74cac00640 1 Processor -- start 2024-03-16T20:55:04.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74cac00640 1 -- start start 2024-03-16T20:55:04.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74cac00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c4100b90 0x7f74c41996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74cac00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74c41034c0 0x7f74c4199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74cac00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74c4105ed0 0x7f74c41a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74cac00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c41a11a0 con 0x7f74c4100b90 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74cac00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c41a1310 con 0x7f74c4105ed0 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74cac00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c41a14d0 con 0x7f74c41034c0 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74c9800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c4100b90 0x7f74c41996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74c9800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c4100b90 0x7f74c41996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40454/0 (socket says 172.21.15.8:40454) 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74c9800640 1 -- 172.21.15.8:0/381049998 learned_addr learned my addr 172.21.15.8:0/381049998 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74c8e00640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74c41034c0 0x7f74c4199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.476+0000 7f74ca200640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74c4105ed0 0x7f74c41a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.477+0000 7f74c9800640 1 -- 172.21.15.8:0/381049998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74c41034c0 msgr2=0x7f74c4199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:04.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.477+0000 7f74c9800640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74c41034c0 0x7f74c4199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:04.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.477+0000 7f74c9800640 1 -- 172.21.15.8:0/381049998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74c4105ed0 msgr2=0x7f74c41a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:04.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.477+0000 7f74c9800640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74c4105ed0 0x7f74c41a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:04.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.477+0000 7f74c9800640 1 -- 172.21.15.8:0/381049998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc009900 con 0x7f74c4100b90 2024-03-16T20:55:04.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.477+0000 7f74c9800640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c4100b90 0x7f74c41996b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f74b800e9c0 tx=0x7f74b800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:04.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.477+0000 7f74c2000640 1 -- 172.21.15.8:0/381049998 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8009700 con 0x7f74c4100b90 2024-03-16T20:55:04.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.477+0000 7f74cac00640 1 -- 172.21.15.8:0/381049998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c41a17b0 con 0x7f74c4100b90 2024-03-16T20:55:04.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.477+0000 7f74c2000640 1 -- 172.21.15.8:0/381049998 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f74b800cd80 con 0x7f74c4100b90 2024-03-16T20:55:04.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.477+0000 7f74c2000640 1 -- 172.21.15.8:0/381049998 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8010690 con 0x7f74c4100b90 2024-03-16T20:55:04.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.477+0000 7f74cac00640 1 -- 172.21.15.8:0/381049998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c41a1d10 con 0x7f74c4100b90 2024-03-16T20:55:04.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.478+0000 7f74cac00640 1 -- 172.21.15.8:0/381049998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c410be00 con 0x7f74c4100b90 2024-03-16T20:55:04.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.480+0000 7f74c2000640 1 -- 172.21.15.8:0/381049998 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f74b80046c0 con 0x7f74c4100b90 2024-03-16T20:55:04.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.481+0000 7f74c2000640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f74ac0a1ab0 0x7f74ac0a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:04.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.482+0000 7f74c2000640 1 -- 172.21.15.8:0/381049998 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f74b8014070 con 0x7f74c4100b90 2024-03-16T20:55:04.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.482+0000 7f74c8e00640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f74ac0a1ab0 0x7f74ac0a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:04.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.482+0000 7f74c8e00640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f74ac0a1ab0 0x7f74ac0a3f70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f74c419abc0 tx=0x7f74b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:04.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.486+0000 7f74c2000640 1 -- 172.21.15.8:0/381049998 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f74b8096990 con 0x7f74c4100b90 2024-03-16T20:55:04.519 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:04 smithi170 ceph-mon[35947]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:04.519 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:04 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-16T20:55:04.519 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:04 smithi170 ceph-mon[35947]: osdmap e83: 12 total, 12 up, 12 in 2024-03-16T20:55:04.519 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:04 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3780915614' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-16T20:55:04.519 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:04 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-16T20:55:04.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:04 smithi186 ceph-mon[36391]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:04.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:04 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-16T20:55:04.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:04 smithi186 ceph-mon[36391]: osdmap e83: 12 total, 12 up, 12 in 2024-03-16T20:55:04.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:04 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3780915614' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-16T20:55:04.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:04 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-16T20:55:04.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:04.723+0000 7f74cac00640 1 -- 172.21.15.8:0/381049998 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f74c410bfe0 con 0x7f74c4100b90 2024-03-16T20:55:04.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:04 smithi008 ceph-mon[31434]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:04.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:04 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-16T20:55:04.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:04 smithi008 ceph-mon[31434]: osdmap e83: 12 total, 12 up, 12 in 2024-03-16T20:55:04.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:04 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3780915614' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-16T20:55:04.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:04 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-16T20:55:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.290+0000 7f74c2000640 1 -- 172.21.15.8:0/381049998 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f74b80b8e60 con 0x7f74c4100b90 2024-03-16T20:55:05.297 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 2 and data pool 3 2024-03-16T20:55:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.299+0000 7f74cac00640 1 -- 172.21.15.8:0/381049998 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f74ac0a1ab0 msgr2=0x7f74ac0a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.299+0000 7f74cac00640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f74ac0a1ab0 0x7f74ac0a3f70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f74c419abc0 tx=0x7f74b0005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.299+0000 7f74cac00640 1 -- 172.21.15.8:0/381049998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c4100b90 msgr2=0x7f74c41996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.299+0000 7f74cac00640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c4100b90 0x7f74c41996b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f74b800e9c0 tx=0x7f74b800ee80 comp rx=0 tx=0).stop 2024-03-16T20:55:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.299+0000 7f74cac00640 1 -- 172.21.15.8:0/381049998 shutdown_connections 2024-03-16T20:55:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.299+0000 7f74cac00640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f74ac0a1ab0 0x7f74ac0a3f70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.299+0000 7f74cac00640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74c4105ed0 0x7f74c41a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.299+0000 7f74cac00640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74c41034c0 0x7f74c4199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.299+0000 7f74cac00640 1 --2- 172.21.15.8:0/381049998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74c4100b90 0x7f74c41996b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.299+0000 7f74cac00640 1 -- 172.21.15.8:0/381049998 >> 172.21.15.8:0/381049998 conn(0x7f74c40fab70 msgr2=0x7f74c40ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:05.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.300+0000 7f74cac00640 1 -- 172.21.15.8:0/381049998 shutdown_connections 2024-03-16T20:55:05.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.300+0000 7f74cac00640 1 -- 172.21.15.8:0/381049998 wait complete. 2024-03-16T20:55:05.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:55:05.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.506+0000 7f8739a00640 1 -- 172.21.15.8:0/3744285434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8734109500 msgr2=0x7f873410fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.506+0000 7f8739a00640 1 --2- 172.21.15.8:0/3744285434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8734109500 0x7f873410fd90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f872c009900 tx=0x7f872c02bc30 comp rx=0 tx=0).stop 2024-03-16T20:55:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.506+0000 7f8739a00640 1 -- 172.21.15.8:0/3744285434 shutdown_connections 2024-03-16T20:55:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.506+0000 7f8739a00640 1 --2- 172.21.15.8:0/3744285434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8734109500 0x7f873410fd90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.506+0000 7f8739a00640 1 --2- 172.21.15.8:0/3744285434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8734108b40 0x7f8734108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.506+0000 7f8739a00640 1 --2- 172.21.15.8:0/3744285434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8734107950 0x7f8734107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.506+0000 7f8739a00640 1 -- 172.21.15.8:0/3744285434 >> 172.21.15.8:0/3744285434 conn(0x7f8734076900 msgr2=0x7f8734078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.506+0000 7f8739a00640 1 -- 172.21.15.8:0/3744285434 shutdown_connections 2024-03-16T20:55:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.507+0000 7f8739a00640 1 -- 172.21.15.8:0/3744285434 wait complete. 2024-03-16T20:55:05.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.507+0000 7f8739a00640 1 Processor -- start 2024-03-16T20:55:05.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8739a00640 1 -- start start 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8739a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8734107950 0x7f873419da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8739a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8734108b40 0x7f873419df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8739a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8734109500 0x7f87341a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8739a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87341a5530 con 0x7f8734107950 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8739a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87341a56a0 con 0x7f8734108b40 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8739a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87341a5860 con 0x7f8734109500 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8733e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8734107950 0x7f873419da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8733e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8734107950 0x7f873419da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40474/0 (socket says 172.21.15.8:40474) 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8733e00640 1 -- 172.21.15.8:0/3560645293 learned_addr learned my addr 172.21.15.8:0/3560645293 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8733400640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8734108b40 0x7f873419df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8739000640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8734109500 0x7f87341a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8733e00640 1 -- 172.21.15.8:0/3560645293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8734109500 msgr2=0x7f87341a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8733e00640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8734109500 0x7f87341a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8733e00640 1 -- 172.21.15.8:0/3560645293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8734108b40 msgr2=0x7f873419df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8733e00640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8734108b40 0x7f873419df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8733e00640 1 -- 172.21.15.8:0/3560645293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c009560 con 0x7f8734107950 2024-03-16T20:55:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.508+0000 7f8739000640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8734109500 0x7f87341a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:55:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.509+0000 7f8733e00640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8734107950 0x7f873419da40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f872400ea80 tx=0x7f872400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.509+0000 7f8730c00640 1 -- 172.21.15.8:0/3560645293 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400ce40 con 0x7f8734107950 2024-03-16T20:55:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.509+0000 7f8730c00640 1 -- 172.21.15.8:0/3560645293 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8724011970 con 0x7f8734107950 2024-03-16T20:55:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.509+0000 7f8730c00640 1 -- 172.21.15.8:0/3560645293 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872401ac50 con 0x7f8734107950 2024-03-16T20:55:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.509+0000 7f8739a00640 1 -- 172.21.15.8:0/3560645293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87341a5b40 con 0x7f8734107950 2024-03-16T20:55:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.509+0000 7f8739a00640 1 -- 172.21.15.8:0/3560645293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87341a6000 con 0x7f8734107950 2024-03-16T20:55:05.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.510+0000 7f8739a00640 1 -- 172.21.15.8:0/3560645293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873410eba0 con 0x7f8734107950 2024-03-16T20:55:05.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.512+0000 7f8730c00640 1 -- 172.21.15.8:0/3560645293 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f8724011ae0 con 0x7f8734107950 2024-03-16T20:55:05.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.513+0000 7f8730c00640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87180a1a30 0x7f87180a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:05.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.513+0000 7f8730c00640 1 -- 172.21.15.8:0/3560645293 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f87240cd8e0 con 0x7f8734107950 2024-03-16T20:55:05.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.514+0000 7f8733400640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87180a1a30 0x7f87180a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:05.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.514+0000 7f8733400640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87180a1a30 0x7f87180a3ef0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f873419ef50 tx=0x7f871c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:05.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.518+0000 7f8730c00640 1 -- 172.21.15.8:0/3560645293 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8724096ba0 con 0x7f8734107950 2024-03-16T20:55:05.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:05 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:05.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:05 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-16T20:55:05.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:05 smithi170 ceph-mon[35947]: osdmap e84: 12 total, 12 up, 12 in 2024-03-16T20:55:05.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:05 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:05.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:05 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:55:05.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:05 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:55:05.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:05 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:05.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:05 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/381049998' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-16T20:55:05.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:05 smithi170 ceph-mon[35947]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-16T20:55:05.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:05 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:05.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:05 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-16T20:55:05.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:05 smithi186 ceph-mon[36391]: osdmap e84: 12 total, 12 up, 12 in 2024-03-16T20:55:05.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:05 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:05.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:05 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:55:05.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:05 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:55:05.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:05 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:05.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:05 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/381049998' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-16T20:55:05.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:05 smithi186 ceph-mon[36391]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-16T20:55:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.716+0000 7f8739a00640 1 -- 172.21.15.8:0/3560645293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f873402d0e0 con 0x7f8734107950 2024-03-16T20:55:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.720+0000 7f8730c00640 1 -- 172.21.15.8:0/3560645293 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22161 (secure 0 0 0) 0x7f872409a260 con 0x7f8734107950 2024-03-16T20:55:05.724 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:05.724 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":85,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:55:04.724822+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 -- 172.21.15.8:0/3560645293 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87180a1a30 msgr2=0x7f87180a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87180a1a30 0x7f87180a3ef0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f873419ef50 tx=0x7f871c005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 -- 172.21.15.8:0/3560645293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8734107950 msgr2=0x7f873419da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8734107950 0x7f873419da40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f872400ea80 tx=0x7f872400ef40 comp rx=0 tx=0).stop 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 -- 172.21.15.8:0/3560645293 shutdown_connections 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87180a1a30 0x7f87180a3ef0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8734109500 0x7f87341a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8734108b40 0x7f873419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 --2- 172.21.15.8:0/3560645293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8734107950 0x7f873419da40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 -- 172.21.15.8:0/3560645293 >> 172.21.15.8:0/3560645293 conn(0x7f8734076900 msgr2=0x7f873410bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 -- 172.21.15.8:0/3560645293 shutdown_connections 2024-03-16T20:55:05.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.723+0000 7f8739a00640 1 -- 172.21.15.8:0/3560645293 wait complete. 2024-03-16T20:55:05.742 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:05 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:05.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:05 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-16T20:55:05.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:05 smithi008 ceph-mon[31434]: osdmap e84: 12 total, 12 up, 12 in 2024-03-16T20:55:05.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:05 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:05.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:05 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:55:05.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:05 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:55:05.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:05 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:55:05.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:05 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/381049998' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-16T20:55:05.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:05 smithi008 ceph-mon[31434]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-16T20:55:05.746 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:55:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.960+0000 7f0018a00640 1 -- 172.21.15.8:0/3595104659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0014103550 msgr2=0x7f0014103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.960+0000 7f0018a00640 1 --2- 172.21.15.8:0/3595104659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0014103550 0x7f0014103970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0004009900 tx=0x7f000402bc30 comp rx=0 tx=0).stop 2024-03-16T20:55:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.960+0000 7f0018a00640 1 -- 172.21.15.8:0/3595104659 shutdown_connections 2024-03-16T20:55:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.960+0000 7f0018a00640 1 --2- 172.21.15.8:0/3595104659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0014105100 0x7f001410b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.960+0000 7f0018a00640 1 --2- 172.21.15.8:0/3595104659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0014104740 0x7f0014104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.960+0000 7f0018a00640 1 --2- 172.21.15.8:0/3595104659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0014103550 0x7f0014103970 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.960+0000 7f0018a00640 1 -- 172.21.15.8:0/3595104659 >> 172.21.15.8:0/3595104659 conn(0x7f00140feac0 msgr2=0x7f0014100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.960+0000 7f0018a00640 1 -- 172.21.15.8:0/3595104659 shutdown_connections 2024-03-16T20:55:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.960+0000 7f0018a00640 1 -- 172.21.15.8:0/3595104659 wait complete. 2024-03-16T20:55:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.961+0000 7f0018a00640 1 Processor -- start 2024-03-16T20:55:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.962+0000 7f0018a00640 1 -- start start 2024-03-16T20:55:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.962+0000 7f0018a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0014103550 0x7f00141996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.962+0000 7f0018a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0014104740 0x7f0014199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.962+0000 7f0018a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0014105100 0x7f00141a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.962+0000 7f0018a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00141a11d0 con 0x7f0014103550 2024-03-16T20:55:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.962+0000 7f0018a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00141a1340 con 0x7f0014105100 2024-03-16T20:55:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.962+0000 7f0018a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00141a1500 con 0x7f0014104740 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.962+0000 7f0013400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0014103550 0x7f00141996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.962+0000 7f0013400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0014103550 0x7f00141996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40482/0 (socket says 172.21.15.8:40482) 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.962+0000 7f0013400640 1 -- 172.21.15.8:0/2407965258 learned_addr learned my addr 172.21.15.8:0/2407965258 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.962+0000 7f0012a00640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0014104740 0x7f0014199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.963+0000 7f0013e00640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0014105100 0x7f00141a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.963+0000 7f0013400640 1 -- 172.21.15.8:0/2407965258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0014104740 msgr2=0x7f0014199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.963+0000 7f0013400640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0014104740 0x7f0014199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.963+0000 7f0013400640 1 -- 172.21.15.8:0/2407965258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0014105100 msgr2=0x7f00141a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.963+0000 7f0013400640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0014105100 0x7f00141a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.963+0000 7f0013400640 1 -- 172.21.15.8:0/2407965258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004009560 con 0x7f0014103550 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.963+0000 7f0013400640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0014103550 0x7f00141996e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0004000c00 tx=0x7f0004005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.963+0000 7f000be00640 1 -- 172.21.15.8:0/2407965258 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004004350 con 0x7f0014103550 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.963+0000 7f000be00640 1 -- 172.21.15.8:0/2407965258 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f00040044b0 con 0x7f0014103550 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.964+0000 7f0018a00640 1 -- 172.21.15.8:0/2407965258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00141a1780 con 0x7f0014103550 2024-03-16T20:55:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.964+0000 7f000be00640 1 -- 172.21.15.8:0/2407965258 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004003de0 con 0x7f0014103550 2024-03-16T20:55:05.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.964+0000 7f0018a00640 1 -- 172.21.15.8:0/2407965258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00141a1c90 con 0x7f0014103550 2024-03-16T20:55:05.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.965+0000 7f0018a00640 1 -- 172.21.15.8:0/2407965258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001410a870 con 0x7f0014103550 2024-03-16T20:55:05.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.967+0000 7f000be00640 1 -- 172.21.15.8:0/2407965258 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f0004004e10 con 0x7f0014103550 2024-03-16T20:55:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.968+0000 7f000be00640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efff80a1a30 0x7efff80a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.968+0000 7f000be00640 1 -- 172.21.15.8:0/2407965258 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f00040efd20 con 0x7f0014103550 2024-03-16T20:55:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.969+0000 7f0012a00640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efff80a1a30 0x7efff80a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.969+0000 7f0012a00640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efff80a1a30 0x7efff80a3ef0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f001419abf0 tx=0x7f0000005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:05.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:05.972+0000 7f000be00640 1 -- 172.21.15.8:0/2407965258 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f00040b8fe0 con 0x7f0014103550 2024-03-16T20:55:06.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.175+0000 7f0018a00640 1 -- 172.21.15.8:0/2407965258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f001402cf90 con 0x7f0014103550 2024-03-16T20:55:06.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.177+0000 7f000be00640 1 -- 172.21.15.8:0/2407965258 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22161 (secure 0 0 0) 0x7f00040bc6a0 con 0x7f0014103550 2024-03-16T20:55:06.181 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:06.182 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":85,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:55:04.724822+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:55:06.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 -- 172.21.15.8:0/2407965258 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efff80a1a30 msgr2=0x7efff80a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:06.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efff80a1a30 0x7efff80a3ef0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f001419abf0 tx=0x7f0000005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:06.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 -- 172.21.15.8:0/2407965258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0014103550 msgr2=0x7f00141996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:06.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0014103550 0x7f00141996e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0004000c00 tx=0x7f0004005dc0 comp rx=0 tx=0).stop 2024-03-16T20:55:06.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 -- 172.21.15.8:0/2407965258 shutdown_connections 2024-03-16T20:55:06.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efff80a1a30 0x7efff80a3ef0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:06.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0014105100 0x7f00141a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:06.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0014104740 0x7f0014199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:06.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 --2- 172.21.15.8:0/2407965258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0014103550 0x7f00141996e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:06.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 -- 172.21.15.8:0/2407965258 >> 172.21.15.8:0/2407965258 conn(0x7f00140feac0 msgr2=0x7f0014107a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:06.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 -- 172.21.15.8:0/2407965258 shutdown_connections 2024-03-16T20:55:06.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.180+0000 7f0018a00640 1 -- 172.21.15.8:0/2407965258 wait complete. 2024-03-16T20:55:06.205 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T20:55:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.429+0000 7fa249800640 1 -- 172.21.15.8:0/413730942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa244107a10 msgr2=0x7fa244107e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.429+0000 7fa249800640 1 --2- 172.21.15.8:0/413730942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa244107a10 0x7fa244107e30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa234009900 tx=0x7fa23402bc40 comp rx=0 tx=0).stop 2024-03-16T20:55:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.430+0000 7fa249800640 1 -- 172.21.15.8:0/413730942 shutdown_connections 2024-03-16T20:55:06.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.430+0000 7fa249800640 1 --2- 172.21.15.8:0/413730942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2441095c0 0x7fa24410fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:06.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.430+0000 7fa249800640 1 --2- 172.21.15.8:0/413730942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa244108c00 0x7fa244109080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:06.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.430+0000 7fa249800640 1 --2- 172.21.15.8:0/413730942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa244107a10 0x7fa244107e30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:06.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.430+0000 7fa249800640 1 -- 172.21.15.8:0/413730942 >> 172.21.15.8:0/413730942 conn(0x7fa2440769c0 msgr2=0x7fa244078de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:06.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.430+0000 7fa249800640 1 -- 172.21.15.8:0/413730942 shutdown_connections 2024-03-16T20:55:06.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.430+0000 7fa249800640 1 -- 172.21.15.8:0/413730942 wait complete. 2024-03-16T20:55:06.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.431+0000 7fa249800640 1 Processor -- start 2024-03-16T20:55:06.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.431+0000 7fa249800640 1 -- start start 2024-03-16T20:55:06.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.431+0000 7fa249800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa244107a10 0x7fa24419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:06.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa249800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa244108c00 0x7fa24419e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:06.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa249800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2441095c0 0x7fa2441a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:06.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa249800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441a5660 con 0x7fa2441095c0 2024-03-16T20:55:06.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa249800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441a57d0 con 0x7fa244107a10 2024-03-16T20:55:06.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa249800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441a5990 con 0x7fa244108c00 2024-03-16T20:55:06.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa243e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa244107a10 0x7fa24419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:06.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa248e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2441095c0 0x7fa2441a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:06.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa23be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa244108c00 0x7fa24419e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:06.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa243e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa244107a10 0x7fa24419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41108/0 (socket says 172.21.15.8:41108) 2024-03-16T20:55:06.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa243e00640 1 -- 172.21.15.8:0/3146382747 learned_addr learned my addr 172.21.15.8:0/3146382747 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa23be00640 1 -- 172.21.15.8:0/3146382747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa244107a10 msgr2=0x7fa24419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa23be00640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa244107a10 0x7fa24419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa23be00640 1 -- 172.21.15.8:0/3146382747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2441095c0 msgr2=0x7fa2441a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa23be00640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2441095c0 0x7fa2441a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa23be00640 1 -- 172.21.15.8:0/3146382747 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234009560 con 0x7fa244108c00 2024-03-16T20:55:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.432+0000 7fa243e00640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa244107a10 0x7fa24419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:06.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.433+0000 7fa23be00640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa244108c00 0x7fa24419e0b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00e9f0 tx=0x7fa22c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.433+0000 7fa241600640 1 -- 172.21.15.8:0/3146382747 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00ccc0 con 0x7fa244108c00 2024-03-16T20:55:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.433+0000 7fa249800640 1 -- 172.21.15.8:0/3146382747 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2441a5c70 con 0x7fa244108c00 2024-03-16T20:55:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.433+0000 7fa241600640 1 -- 172.21.15.8:0/3146382747 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa22c00ce20 con 0x7fa244108c00 2024-03-16T20:55:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.433+0000 7fa241600640 1 -- 172.21.15.8:0/3146382747 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c018860 con 0x7fa244108c00 2024-03-16T20:55:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.433+0000 7fa249800640 1 -- 172.21.15.8:0/3146382747 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2441a61d0 con 0x7fa244108c00 2024-03-16T20:55:06.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.434+0000 7fa249800640 1 -- 172.21.15.8:0/3146382747 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24410ed30 con 0x7fa244108c00 2024-03-16T20:55:06.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.436+0000 7fa241600640 1 -- 172.21.15.8:0/3146382747 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fa22c010b50 con 0x7fa244108c00 2024-03-16T20:55:06.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.437+0000 7fa241600640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa2280a1a30 0x7fa2280a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:06.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.438+0000 7fa241600640 1 -- 172.21.15.8:0/3146382747 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa22c014070 con 0x7fa244108c00 2024-03-16T20:55:06.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.438+0000 7fa243e00640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa2280a1a30 0x7fa2280a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:06.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.438+0000 7fa243e00640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa2280a1a30 0x7fa2280a3ef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa23402c920 tx=0x7fa23402cd70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:06.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.442+0000 7fa241600640 1 -- 172.21.15.8:0/3146382747 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa22c053280 con 0x7fa244108c00 2024-03-16T20:55:06.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:06 smithi008 ceph-mon[31434]: pgmap v315: 97 pgs: 19 creating+peering, 74 unknown, 4 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:06.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:06 smithi008 ceph-mon[31434]: osdmap e85: 12 total, 12 up, 12 in 2024-03-16T20:55:06.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:06 smithi008 ceph-mon[31434]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-16T20:55:06.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:06 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/381049998' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-16T20:55:06.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:06 smithi008 ceph-mon[31434]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-16T20:55:06.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:06 smithi008 ceph-mon[31434]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-16T20:55:06.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:06 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3560645293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:06.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:06 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2407965258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:06.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:06 smithi170 ceph-mon[35947]: pgmap v315: 97 pgs: 19 creating+peering, 74 unknown, 4 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:06.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:06 smithi170 ceph-mon[35947]: osdmap e85: 12 total, 12 up, 12 in 2024-03-16T20:55:06.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:06 smithi170 ceph-mon[35947]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-16T20:55:06.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:06 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/381049998' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-16T20:55:06.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:06 smithi170 ceph-mon[35947]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-16T20:55:06.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:06 smithi170 ceph-mon[35947]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-16T20:55:06.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:06 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3560645293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:06.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:06 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2407965258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:06 smithi186 ceph-mon[36391]: pgmap v315: 97 pgs: 19 creating+peering, 74 unknown, 4 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:06 smithi186 ceph-mon[36391]: osdmap e85: 12 total, 12 up, 12 in 2024-03-16T20:55:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:06 smithi186 ceph-mon[36391]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-16T20:55:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:06 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/381049998' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-16T20:55:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:06 smithi186 ceph-mon[36391]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-16T20:55:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:06 smithi186 ceph-mon[36391]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-16T20:55:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:06 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3560645293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:06.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:06 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2407965258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:06.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:06.688+0000 7fa249800640 1 -- 172.21.15.8:0/3146382747 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa24402cf60 con 0x7fa244108c00 2024-03-16T20:55:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.317+0000 7fa241600640 1 -- 172.21.15.8:0/3146382747 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa22c096a30 con 0x7fa244108c00 2024-03-16T20:55:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 -- 172.21.15.8:0/3146382747 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa2280a1a30 msgr2=0x7fa2280a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa2280a1a30 0x7fa2280a3ef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa23402c920 tx=0x7fa23402cd70 comp rx=0 tx=0).stop 2024-03-16T20:55:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 -- 172.21.15.8:0/3146382747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa244108c00 msgr2=0x7fa24419e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa244108c00 0x7fa24419e0b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00e9f0 tx=0x7fa22c00eeb0 comp rx=0 tx=0).stop 2024-03-16T20:55:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 -- 172.21.15.8:0/3146382747 shutdown_connections 2024-03-16T20:55:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa2280a1a30 0x7fa2280a3ef0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2441095c0 0x7fa2441a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa244108c00 0x7fa24419e0b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 --2- 172.21.15.8:0/3146382747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa244107a10 0x7fa24419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 -- 172.21.15.8:0/3146382747 >> 172.21.15.8:0/3146382747 conn(0x7fa2440769c0 msgr2=0x7fa24410bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 -- 172.21.15.8:0/3146382747 shutdown_connections 2024-03-16T20:55:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.321+0000 7fa249800640 1 -- 172.21.15.8:0/3146382747 wait complete. 2024-03-16T20:55:07.345 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-03-16T20:55:07.345 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-03-16T20:55:07.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.566+0000 7f5787000640 1 -- 172.21.15.8:0/3940745481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57801052c0 msgr2=0x7f578010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:07.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.566+0000 7f5787000640 1 --2- 172.21.15.8:0/3940745481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57801052c0 0x7f578010bb50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5778009ca0 tx=0x7f577802c100 comp rx=0 tx=0).stop 2024-03-16T20:55:07.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.566+0000 7f5787000640 1 -- 172.21.15.8:0/3940745481 shutdown_connections 2024-03-16T20:55:07.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.566+0000 7f5787000640 1 --2- 172.21.15.8:0/3940745481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57801052c0 0x7f578010bb50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:07.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.566+0000 7f5787000640 1 --2- 172.21.15.8:0/3940745481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5780104900 0x7f5780104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:07.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.566+0000 7f5787000640 1 --2- 172.21.15.8:0/3940745481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5780103710 0x7f5780103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:07.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.566+0000 7f5787000640 1 -- 172.21.15.8:0/3940745481 >> 172.21.15.8:0/3940745481 conn(0x7f57800feca0 msgr2=0x7f57801010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:07.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.566+0000 7f5787000640 1 -- 172.21.15.8:0/3940745481 shutdown_connections 2024-03-16T20:55:07.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.566+0000 7f5787000640 1 -- 172.21.15.8:0/3940745481 wait complete. 2024-03-16T20:55:07.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.567+0000 7f5787000640 1 Processor -- start 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.567+0000 7f5787000640 1 -- start start 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.567+0000 7f5787000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5780103710 0x7f5780199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.567+0000 7f5787000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5780104900 0x7f5780199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.567+0000 7f5787000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57801052c0 0x7f57801a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f5787000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57801a1300 con 0x7f5780104900 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f5787000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57801a1470 con 0x7f57801052c0 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f5787000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57801a1630 con 0x7f5780103710 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f5777e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5780104900 0x7f5780199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f577fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5780103710 0x7f5780199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f5785000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57801052c0 0x7f57801a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f577fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5780103710 0x7f5780199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:49868/0 (socket says 172.21.15.8:49868) 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f5777e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5780104900 0x7f5780199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40532/0 (socket says 172.21.15.8:40532) 2024-03-16T20:55:07.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f577fe00640 1 -- 172.21.15.8:0/504926564 learned_addr learned my addr 172.21.15.8:0/504926564 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f577fe00640 1 -- 172.21.15.8:0/504926564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57801052c0 msgr2=0x7f57801a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f577fe00640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57801052c0 0x7f57801a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f577fe00640 1 -- 172.21.15.8:0/504926564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5780104900 msgr2=0x7f5780199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f577fe00640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5780104900 0x7f5780199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f577fe00640 1 -- 172.21.15.8:0/504926564 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5768009490 con 0x7f5780103710 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f5785000640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57801052c0 0x7f57801a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.568+0000 7f577fe00640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5780103710 0x7f5780199810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f577000e9c0 tx=0x7f577000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.569+0000 7f577d600640 1 -- 172.21.15.8:0/504926564 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700096e0 con 0x7f5780103710 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.569+0000 7f577d600640 1 -- 172.21.15.8:0/504926564 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f577000cd80 con 0x7f5780103710 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.569+0000 7f5787000640 1 -- 172.21.15.8:0/504926564 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5778009900 con 0x7f5780103710 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.569+0000 7f577d600640 1 -- 172.21.15.8:0/504926564 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770010490 con 0x7f5780103710 2024-03-16T20:55:07.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.569+0000 7f5787000640 1 -- 172.21.15.8:0/504926564 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57801a1c40 con 0x7f5780103710 2024-03-16T20:55:07.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.570+0000 7f5787000640 1 -- 172.21.15.8:0/504926564 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578010a960 con 0x7f5780103710 2024-03-16T20:55:07.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.572+0000 7f577d600640 1 -- 172.21.15.8:0/504926564 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f5770003710 con 0x7f5780103710 2024-03-16T20:55:07.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.573+0000 7f577d600640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f57640a1a30 0x7f57640a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:07.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.573+0000 7f577d600640 1 -- 172.21.15.8:0/504926564 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5770014070 con 0x7f5780103710 2024-03-16T20:55:07.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.574+0000 7f5777e00640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f57640a1a30 0x7f57640a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:07.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.574+0000 7f5777e00640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f57640a1a30 0x7f57640a3ef0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f578019ad20 tx=0x7f5768005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:07.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.577+0000 7f577d600640 1 -- 172.21.15.8:0/504926564 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f57700969a0 con 0x7f5780103710 2024-03-16T20:55:07.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:07 smithi170 ceph-mon[35947]: osdmap e86: 12 total, 12 up, 12 in 2024-03-16T20:55:07.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:07 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] up:active 2024-03-16T20:55:07.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:07 smithi170 ceph-mon[35947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:07.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:07 smithi170 ceph-mon[35947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:07.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:07 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3146382747' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-16T20:55:07.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:07 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-16T20:55:07.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:07 smithi186 ceph-mon[36391]: osdmap e86: 12 total, 12 up, 12 in 2024-03-16T20:55:07.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:07 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] up:active 2024-03-16T20:55:07.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:07 smithi186 ceph-mon[36391]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:07.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:07 smithi186 ceph-mon[36391]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:07.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:07 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3146382747' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-16T20:55:07.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:07 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-16T20:55:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:07 smithi008 ceph-mon[31434]: osdmap e86: 12 total, 12 up, 12 in 2024-03-16T20:55:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:07 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] up:active 2024-03-16T20:55:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:07 smithi008 ceph-mon[31434]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:07 smithi008 ceph-mon[31434]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:07 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3146382747' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-16T20:55:07.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:07 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-16T20:55:07.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:07.819+0000 7f5787000640 1 -- 172.21.15.8:0/504926564 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f578010f240 con 0x7f5780103710 2024-03-16T20:55:08.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.327+0000 7f577d600640 1 -- 172.21.15.8:0/504926564 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f577009a060 con 0x7f5780103710 2024-03-16T20:55:08.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.331+0000 7f5787000640 1 -- 172.21.15.8:0/504926564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f57640a1a30 msgr2=0x7f57640a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:08.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.331+0000 7f5787000640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f57640a1a30 0x7f57640a3ef0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f578019ad20 tx=0x7f5768005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:08.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.331+0000 7f5787000640 1 -- 172.21.15.8:0/504926564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5780103710 msgr2=0x7f5780199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:08.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.331+0000 7f5787000640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5780103710 0x7f5780199810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f577000e9c0 tx=0x7f577000ee80 comp rx=0 tx=0).stop 2024-03-16T20:55:08.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.332+0000 7f5787000640 1 -- 172.21.15.8:0/504926564 shutdown_connections 2024-03-16T20:55:08.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.332+0000 7f5787000640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f57640a1a30 0x7f57640a3ef0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:08.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.332+0000 7f5787000640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57801052c0 0x7f57801a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:08.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.332+0000 7f5787000640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5780104900 0x7f5780199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:08.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.332+0000 7f5787000640 1 --2- 172.21.15.8:0/504926564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5780103710 0x7f5780199810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:08.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.332+0000 7f5787000640 1 -- 172.21.15.8:0/504926564 >> 172.21.15.8:0/504926564 conn(0x7f57800feca0 msgr2=0x7f5780107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:08.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.332+0000 7f5787000640 1 -- 172.21.15.8:0/504926564 shutdown_connections 2024-03-16T20:55:08.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.332+0000 7f5787000640 1 -- 172.21.15.8:0/504926564 wait complete. 2024-03-16T20:55:08.365 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-03-16T20:55:08.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:08 smithi008 ceph-mon[31434]: pgmap v318: 97 pgs: 4 creating+activating, 23 creating+peering, 38 unknown, 32 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:08.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:08 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-16T20:55:08.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:08 smithi008 ceph-mon[31434]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:08.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:08 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/504926564' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-16T20:55:08.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:08 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-16T20:55:08.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:08 smithi008 ceph-mon[31434]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-16T20:55:08.574 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:08 smithi008 ceph-mon[31434]: Cluster is now healthy 2024-03-16T20:55:08.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.577+0000 7fcca4800640 1 -- 172.21.15.8:0/2713412858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc9c1048a0 msgr2=0x7fcc9c106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:08.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.577+0000 7fcca4800640 1 --2- 172.21.15.8:0/2713412858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc9c1048a0 0x7fcc9c106c90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009860 tx=0x7fcc8c02bb70 comp rx=0 tx=0).stop 2024-03-16T20:55:08.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.577+0000 7fcca4800640 1 -- 172.21.15.8:0/2713412858 shutdown_connections 2024-03-16T20:55:08.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.577+0000 7fcca4800640 1 --2- 172.21.15.8:0/2713412858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c1071d0 0x7fcc9c109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:08.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.577+0000 7fcca4800640 1 --2- 172.21.15.8:0/2713412858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc9c1048a0 0x7fcc9c106c90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:08.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.577+0000 7fcca4800640 1 --2- 172.21.15.8:0/2713412858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc9c101f70 0x7fcc9c104360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:08.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.577+0000 7fcca4800640 1 -- 172.21.15.8:0/2713412858 >> 172.21.15.8:0/2713412858 conn(0x7fcc9c0fb980 msgr2=0x7fcc9c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:08.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.577+0000 7fcca4800640 1 -- 172.21.15.8:0/2713412858 shutdown_connections 2024-03-16T20:55:08.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.577+0000 7fcca4800640 1 -- 172.21.15.8:0/2713412858 wait complete. 2024-03-16T20:55:08.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.578+0000 7fcca4800640 1 Processor -- start 2024-03-16T20:55:08.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.578+0000 7fcca4800640 1 -- start start 2024-03-16T20:55:08.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca4800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc9c101f70 0x7fcc9c1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:08.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca4800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c1048a0 0x7fcc9c199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:08.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca4800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc9c1071d0 0x7fcc9c1a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:08.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca4800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c1a13c0 con 0x7fcc9c1048a0 2024-03-16T20:55:08.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca4800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c1a1530 con 0x7fcc9c1071d0 2024-03-16T20:55:08.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca4800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c1a16f0 con 0x7fcc9c101f70 2024-03-16T20:55:08.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca1e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc9c101f70 0x7fcc9c1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:08.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca2800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc9c1071d0 0x7fcc9c1a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:08.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca1e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc9c101f70 0x7fcc9c1998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58774/0 (socket says 172.21.15.8:58774) 2024-03-16T20:55:08.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca1e00640 1 -- 172.21.15.8:0/2804667973 learned_addr learned my addr 172.21.15.8:0/2804667973 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:08.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca1400640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c1048a0 0x7fcc9c199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:08.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca2800640 1 -- 172.21.15.8:0/2804667973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc9c101f70 msgr2=0x7fcc9c1998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:08.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca2800640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc9c101f70 0x7fcc9c1998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:08.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca2800640 1 -- 172.21.15.8:0/2804667973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c1048a0 msgr2=0x7fcc9c199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:08.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca2800640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c1048a0 0x7fcc9c199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:08.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca2800640 1 -- 172.21.15.8:0/2804667973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98009900 con 0x7fcc9c1071d0 2024-03-16T20:55:08.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.579+0000 7fcca1400640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c1048a0 0x7fcc9c199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:55:08.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.580+0000 7fcca2800640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc9c1071d0 0x7fcc9c1a0e80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000e970 tx=0x7fcc9000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:08.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.580+0000 7fcc96a00640 1 -- 172.21.15.8:0/2804667973 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000ccc0 con 0x7fcc9c1071d0 2024-03-16T20:55:08.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.580+0000 7fcc96a00640 1 -- 172.21.15.8:0/2804667973 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcc9000ce20 con 0x7fcc9c1071d0 2024-03-16T20:55:08.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.580+0000 7fcca4800640 1 -- 172.21.15.8:0/2804667973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc90009490 con 0x7fcc9c1071d0 2024-03-16T20:55:08.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.580+0000 7fcc96a00640 1 -- 172.21.15.8:0/2804667973 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90010690 con 0x7fcc9c1071d0 2024-03-16T20:55:08.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.580+0000 7fcca4800640 1 -- 172.21.15.8:0/2804667973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c009490 con 0x7fcc9c1071d0 2024-03-16T20:55:08.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.581+0000 7fcca4800640 1 -- 172.21.15.8:0/2804667973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9c108d20 con 0x7fcc9c1071d0 2024-03-16T20:55:08.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.583+0000 7fcc96a00640 1 -- 172.21.15.8:0/2804667973 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fcc90003e90 con 0x7fcc9c1071d0 2024-03-16T20:55:08.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.584+0000 7fcc96a00640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcc840a1ab0 0x7fcc840a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:08.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.585+0000 7fcc96a00640 1 -- 172.21.15.8:0/2804667973 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcc90014070 con 0x7fcc9c1071d0 2024-03-16T20:55:08.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.585+0000 7fcca1e00640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcc840a1ab0 0x7fcc840a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:08.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.585+0000 7fcca1e00640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcc840a1ab0 0x7fcc840a3f70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800e640 tx=0x7fcc98010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:08.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.588+0000 7fcc96a00640 1 -- 172.21.15.8:0/2804667973 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fcc90096a00 con 0x7fcc9c1071d0 2024-03-16T20:55:08.617 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 20:55:08 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b[66248]: 2024-03-16T20:55:08.214+0000 7f2c5d606700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T20:55:08.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:08 smithi170 ceph-mon[35947]: pgmap v318: 97 pgs: 4 creating+activating, 23 creating+peering, 38 unknown, 32 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:08.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:08 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-16T20:55:08.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:08 smithi170 ceph-mon[35947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:08.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:08 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/504926564' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-16T20:55:08.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:08 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-16T20:55:08.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:08 smithi170 ceph-mon[35947]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-16T20:55:08.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:08 smithi170 ceph-mon[35947]: Cluster is now healthy 2024-03-16T20:55:08.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:08 smithi186 ceph-mon[36391]: pgmap v318: 97 pgs: 4 creating+activating, 23 creating+peering, 38 unknown, 32 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:55:08.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:08 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-16T20:55:08.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:08 smithi186 ceph-mon[36391]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:08.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:08 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/504926564' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-16T20:55:08.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:08 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-16T20:55:08.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:08 smithi186 ceph-mon[36391]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-16T20:55:08.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:08 smithi186 ceph-mon[36391]: Cluster is now healthy 2024-03-16T20:55:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:08.832+0000 7fcca4800640 1 -- 172.21.15.8:0/2804667973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fcc9c02d000 con 0x7fcc9c1071d0 2024-03-16T20:55:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.338+0000 7fcc96a00640 1 -- 172.21.15.8:0/2804667973 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7fcc9009a0c0 con 0x7fcc9c1071d0 2024-03-16T20:55:09.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.342+0000 7fcca4800640 1 -- 172.21.15.8:0/2804667973 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcc840a1ab0 msgr2=0x7fcc840a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:09.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.342+0000 7fcca4800640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcc840a1ab0 0x7fcc840a3f70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800e640 tx=0x7fcc98010040 comp rx=0 tx=0).stop 2024-03-16T20:55:09.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.342+0000 7fcca4800640 1 -- 172.21.15.8:0/2804667973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc9c1071d0 msgr2=0x7fcc9c1a0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:09.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.342+0000 7fcca4800640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc9c1071d0 0x7fcc9c1a0e80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000e970 tx=0x7fcc9000ee30 comp rx=0 tx=0).stop 2024-03-16T20:55:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.342+0000 7fcca4800640 1 -- 172.21.15.8:0/2804667973 shutdown_connections 2024-03-16T20:55:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.342+0000 7fcca4800640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fcc840a1ab0 0x7fcc840a3f70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.342+0000 7fcca4800640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc9c1071d0 0x7fcc9c1a0e80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.342+0000 7fcca4800640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc9c1048a0 0x7fcc9c199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.342+0000 7fcca4800640 1 --2- 172.21.15.8:0/2804667973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc9c101f70 0x7fcc9c1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.342+0000 7fcca4800640 1 -- 172.21.15.8:0/2804667973 >> 172.21.15.8:0/2804667973 conn(0x7fcc9c0fb980 msgr2=0x7fcc9c101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.343+0000 7fcca4800640 1 -- 172.21.15.8:0/2804667973 shutdown_connections 2024-03-16T20:55:09.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.343+0000 7fcca4800640 1 -- 172.21.15.8:0/2804667973 wait complete. 2024-03-16T20:55:09.372 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-16T20:55:09.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.570+0000 7fb6eb400640 1 -- 172.21.15.8:0/3920439543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e4103730 msgr2=0x7fb6e4103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:09.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.570+0000 7fb6eb400640 1 --2- 172.21.15.8:0/3920439543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e4103730 0x7fb6e4103b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009860 tx=0x7fb6d402bb70 comp rx=0 tx=0).stop 2024-03-16T20:55:09.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.570+0000 7fb6eb400640 1 -- 172.21.15.8:0/3920439543 shutdown_connections 2024-03-16T20:55:09.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.570+0000 7fb6eb400640 1 --2- 172.21.15.8:0/3920439543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e41052e0 0x7fb6e410bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:09.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.570+0000 7fb6eb400640 1 --2- 172.21.15.8:0/3920439543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e4104920 0x7fb6e4104da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:09.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.570+0000 7fb6eb400640 1 --2- 172.21.15.8:0/3920439543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e4103730 0x7fb6e4103b50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:09.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.570+0000 7fb6eb400640 1 -- 172.21.15.8:0/3920439543 >> 172.21.15.8:0/3920439543 conn(0x7fb6e40feca0 msgr2=0x7fb6e41010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:09.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.570+0000 7fb6eb400640 1 -- 172.21.15.8:0/3920439543 shutdown_connections 2024-03-16T20:55:09.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.570+0000 7fb6eb400640 1 -- 172.21.15.8:0/3920439543 wait complete. 2024-03-16T20:55:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.572+0000 7fb6eb400640 1 Processor -- start 2024-03-16T20:55:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.572+0000 7fb6eb400640 1 -- start start 2024-03-16T20:55:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.572+0000 7fb6eb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e4103730 0x7fb6e41998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:09.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.572+0000 7fb6eb400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e4104920 0x7fb6e4199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.572+0000 7fb6eb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e41052e0 0x7fb6e41a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.572+0000 7fb6eb400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e41a13d0 con 0x7fb6e4103730 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.572+0000 7fb6eb400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e41a1540 con 0x7fb6e41052e0 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.572+0000 7fb6eb400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e41a1700 con 0x7fb6e4104920 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6e9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e41052e0 0x7fb6e41a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6e9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e41052e0 0x7fb6e41a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37508/0 (socket says 172.21.15.8:37508) 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6e9400640 1 -- 172.21.15.8:0/1124107150 learned_addr learned my addr 172.21.15.8:0/1124107150 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6dbe00640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e4104920 0x7fb6e4199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6e8a00640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e4103730 0x7fb6e41998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6e9400640 1 -- 172.21.15.8:0/1124107150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e4104920 msgr2=0x7fb6e4199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6e9400640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e4104920 0x7fb6e4199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6e9400640 1 -- 172.21.15.8:0/1124107150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e4103730 msgr2=0x7fb6e41998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:09.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6e9400640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e4103730 0x7fb6e41998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6e9400640 1 -- 172.21.15.8:0/1124107150 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc009560 con 0x7fb6e41052e0 2024-03-16T20:55:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6e9400640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e41052e0 0x7fb6e41a0e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00eb10 tx=0x7fb6dc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.573+0000 7fb6e2000640 1 -- 172.21.15.8:0/1124107150 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc004b20 con 0x7fb6e41052e0 2024-03-16T20:55:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.574+0000 7fb6e2000640 1 -- 172.21.15.8:0/1124107150 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb6dc004c80 con 0x7fb6e41052e0 2024-03-16T20:55:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.574+0000 7fb6e2000640 1 -- 172.21.15.8:0/1124107150 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc010760 con 0x7fb6e41052e0 2024-03-16T20:55:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.574+0000 7fb6eb400640 1 -- 172.21.15.8:0/1124107150 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d4009490 con 0x7fb6e41052e0 2024-03-16T20:55:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.574+0000 7fb6eb400640 1 -- 172.21.15.8:0/1124107150 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e41a1d10 con 0x7fb6e41052e0 2024-03-16T20:55:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.575+0000 7fb6eb400640 1 -- 172.21.15.8:0/1124107150 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e410a9f0 con 0x7fb6e41052e0 2024-03-16T20:55:09.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.577+0000 7fb6e2000640 1 -- 172.21.15.8:0/1124107150 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fb6dc005020 con 0x7fb6e41052e0 2024-03-16T20:55:09.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.578+0000 7fb6e2000640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6c80a1ab0 0x7fb6c80a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:09.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.578+0000 7fb6e2000640 1 -- 172.21.15.8:0/1124107150 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb6dc014070 con 0x7fb6e41052e0 2024-03-16T20:55:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.578+0000 7fb6e8a00640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6c80a1ab0 0x7fb6c80a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.579+0000 7fb6e8a00640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6c80a1ab0 0x7fb6c80a3f70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009830 tx=0x7fb6d4005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.582+0000 7fb6e2000640 1 -- 172.21.15.8:0/1124107150 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb6dc096bd0 con 0x7fb6e41052e0 2024-03-16T20:55:09.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:09 smithi170 ceph-mon[35947]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-16T20:55:09.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:09 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-16T20:55:09.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:09 smithi170 ceph-mon[35947]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-16T20:55:09.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:09 smithi170 ceph-mon[35947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:09.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:09 smithi170 ceph-mon[35947]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-16T20:55:09.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:09 smithi170 ceph-mon[35947]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-16T20:55:09.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:09 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2804667973' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-16T20:55:09.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:09 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-16T20:55:09.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:09 smithi186 ceph-mon[36391]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-16T20:55:09.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:09 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-16T20:55:09.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:09 smithi186 ceph-mon[36391]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-16T20:55:09.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:09 smithi186 ceph-mon[36391]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:09.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:09 smithi186 ceph-mon[36391]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-16T20:55:09.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:09 smithi186 ceph-mon[36391]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-16T20:55:09.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:09 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2804667973' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-16T20:55:09.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:09 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-16T20:55:09.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:09 smithi008 ceph-mon[31434]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-16T20:55:09.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:09 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-16T20:55:09.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:09 smithi008 ceph-mon[31434]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-16T20:55:09.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:09 smithi008 ceph-mon[31434]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T20:55:09.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:09 smithi008 ceph-mon[31434]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-16T20:55:09.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:09 smithi008 ceph-mon[31434]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-16T20:55:09.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:09 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2804667973' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-16T20:55:09.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:09 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-16T20:55:09.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:09.822+0000 7fb6eb400640 1 -- 172.21.15.8:0/1124107150 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fb6e402d060 con 0x7fb6e41052e0 2024-03-16T20:55:10.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.352+0000 7fb6e2000640 1 -- 172.21.15.8:0/1124107150 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb6dc09a290 con 0x7fb6e41052e0 2024-03-16T20:55:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.356+0000 7fb6eb400640 1 -- 172.21.15.8:0/1124107150 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6c80a1ab0 msgr2=0x7fb6c80a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.356+0000 7fb6eb400640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6c80a1ab0 0x7fb6c80a3f70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009830 tx=0x7fb6d4005da0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.356+0000 7fb6eb400640 1 -- 172.21.15.8:0/1124107150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e41052e0 msgr2=0x7fb6e41a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.356+0000 7fb6eb400640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e41052e0 0x7fb6e41a0e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00eb10 tx=0x7fb6dc00c2d0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.356+0000 7fb6eb400640 1 -- 172.21.15.8:0/1124107150 shutdown_connections 2024-03-16T20:55:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.356+0000 7fb6eb400640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6c80a1ab0 0x7fb6c80a3f70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.356+0000 7fb6eb400640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e41052e0 0x7fb6e41a0e90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.356+0000 7fb6eb400640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6e4104920 0x7fb6e4199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.356+0000 7fb6eb400640 1 --2- 172.21.15.8:0/1124107150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6e4103730 0x7fb6e41998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.356+0000 7fb6eb400640 1 -- 172.21.15.8:0/1124107150 >> 172.21.15.8:0/1124107150 conn(0x7fb6e40feca0 msgr2=0x7fb6e4107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.357+0000 7fb6eb400640 1 -- 172.21.15.8:0/1124107150 shutdown_connections 2024-03-16T20:55:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.357+0000 7fb6eb400640 1 -- 172.21.15.8:0/1124107150 wait complete. 2024-03-16T20:55:10.383 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-03-16T20:55:10.383 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-03-16T20:55:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.611+0000 7f32a7200640 1 -- 172.21.15.8:0/3524000492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32a81025c0 msgr2=0x7f32a8102a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.611+0000 7f32a7200640 1 --2- 172.21.15.8:0/3524000492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32a81025c0 0x7f32a8102a40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3290009900 tx=0x7f329002bc30 comp rx=0 tx=0).stop 2024-03-16T20:55:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.611+0000 7f32a7200640 1 -- 172.21.15.8:0/3524000492 shutdown_connections 2024-03-16T20:55:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.611+0000 7f32a7200640 1 --2- 172.21.15.8:0/3524000492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32a8102f80 0x7f32a8109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.611+0000 7f32a7200640 1 --2- 172.21.15.8:0/3524000492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32a81025c0 0x7f32a8102a40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.611+0000 7f32a7200640 1 --2- 172.21.15.8:0/3524000492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a81013d0 0x7f32a81017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.611+0000 7f32a7200640 1 -- 172.21.15.8:0/3524000492 >> 172.21.15.8:0/3524000492 conn(0x7f32a80fc960 msgr2=0x7f32a80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.611+0000 7f32a7200640 1 -- 172.21.15.8:0/3524000492 shutdown_connections 2024-03-16T20:55:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.611+0000 7f32a7200640 1 -- 172.21.15.8:0/3524000492 wait complete. 2024-03-16T20:55:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.612+0000 7f32a7200640 1 Processor -- start 2024-03-16T20:55:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.612+0000 7f32a7200640 1 -- start start 2024-03-16T20:55:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a7200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a81013d0 0x7f32a8197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a7200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32a81025c0 0x7f32a8197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a7200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32a8102f80 0x7f32a819ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a7200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a819f010 con 0x7f32a81013d0 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a7200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a819f180 con 0x7f32a8102f80 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a7200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a819f340 con 0x7f32a81025c0 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a81013d0 0x7f32a8197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a81013d0 0x7f32a8197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59490/0 (socket says 172.21.15.8:59490) 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a5e00640 1 -- 172.21.15.8:0/361441927 learned_addr learned my addr 172.21.15.8:0/361441927 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a6800640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32a8102f80 0x7f32a819ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f329d400640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32a81025c0 0x7f32a8197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a6800640 1 -- 172.21.15.8:0/361441927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32a81025c0 msgr2=0x7f32a8197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a6800640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32a81025c0 0x7f32a8197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a6800640 1 -- 172.21.15.8:0/361441927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a81013d0 msgr2=0x7f32a8197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.613+0000 7f32a6800640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a81013d0 0x7f32a8197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.614+0000 7f32a6800640 1 -- 172.21.15.8:0/361441927 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290009560 con 0x7f32a8102f80 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.614+0000 7f32a5e00640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a81013d0 0x7f32a8197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.614+0000 7f329d400640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32a81025c0 0x7f32a8197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.614+0000 7f32a6800640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32a8102f80 0x7f32a819ead0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f32a000e970 tx=0x7f32a000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:10.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:10 smithi170 ceph-mon[35947]: pgmap v319: 97 pgs: 4 creating+activating, 6 creating+peering, 87 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 8 op/s 2024-03-16T20:55:10.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:10 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-16T20:55:10.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:10 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] up:active 2024-03-16T20:55:10.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:10 smithi170 ceph-mon[35947]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-16T20:55:10.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:10 smithi170 ceph-mon[35947]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-16T20:55:10.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:10 smithi170 ceph-mon[35947]: Cluster is now healthy 2024-03-16T20:55:10.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:10 smithi170 ceph-mon[35947]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-16T20:55:10.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:10 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-03-16T20:55:10.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:10 smithi170 ceph-mon[35947]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-03-16T20:55:10.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:10 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1124107150' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-16T20:55:10.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:10 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-16T20:55:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.614+0000 7f329f400640 1 -- 172.21.15.8:0/361441927 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0009620 con 0x7f32a8102f80 2024-03-16T20:55:10.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.614+0000 7f329f400640 1 -- 172.21.15.8:0/361441927 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f32a000ccc0 con 0x7f32a8102f80 2024-03-16T20:55:10.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.614+0000 7f329f400640 1 -- 172.21.15.8:0/361441927 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00049e0 con 0x7f32a8102f80 2024-03-16T20:55:10.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.614+0000 7f32a7200640 1 -- 172.21.15.8:0/361441927 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a819f620 con 0x7f32a8102f80 2024-03-16T20:55:10.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.614+0000 7f32a7200640 1 -- 172.21.15.8:0/361441927 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a819fab0 con 0x7f32a8102f80 2024-03-16T20:55:10.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.615+0000 7f32a7200640 1 -- 172.21.15.8:0/361441927 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a8108620 con 0x7f32a8102f80 2024-03-16T20:55:10.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.617+0000 7f329f400640 1 -- 172.21.15.8:0/361441927 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f32a0005020 con 0x7f32a8102f80 2024-03-16T20:55:10.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.619+0000 7f329f400640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f328c0a1ab0 0x7f328c0a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:10.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.619+0000 7f329f400640 1 -- 172.21.15.8:0/361441927 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f32a0014070 con 0x7f32a8102f80 2024-03-16T20:55:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.619+0000 7f32a5e00640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f328c0a1ab0 0x7f328c0a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.620+0000 7f32a5e00640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f328c0a1ab0 0x7f328c0a3f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3298005c40 tx=0x7f32980097a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.623+0000 7f329f400640 1 -- 172.21.15.8:0/361441927 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f32a0096430 con 0x7f32a8102f80 2024-03-16T20:55:10.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:10 smithi186 ceph-mon[36391]: pgmap v319: 97 pgs: 4 creating+activating, 6 creating+peering, 87 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 8 op/s 2024-03-16T20:55:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:10 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-16T20:55:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:10 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] up:active 2024-03-16T20:55:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:10 smithi186 ceph-mon[36391]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-16T20:55:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:10 smithi186 ceph-mon[36391]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-16T20:55:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:10 smithi186 ceph-mon[36391]: Cluster is now healthy 2024-03-16T20:55:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:10 smithi186 ceph-mon[36391]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-16T20:55:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:10 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-03-16T20:55:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:10 smithi186 ceph-mon[36391]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-03-16T20:55:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:10 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1124107150' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-16T20:55:10.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:10 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-16T20:55:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-mon[31434]: pgmap v319: 97 pgs: 4 creating+activating, 6 creating+peering, 87 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 8 op/s 2024-03-16T20:55:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-16T20:55:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] up:active 2024-03-16T20:55:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-mon[31434]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-16T20:55:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-mon[31434]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-16T20:55:10.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-mon[31434]: Cluster is now healthy 2024-03-16T20:55:10.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-mon[31434]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-16T20:55:10.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-03-16T20:55:10.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-mon[31434]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-03-16T20:55:10.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1124107150' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-16T20:55:10.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-16T20:55:10.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.854+0000 7f32a7200640 1 -- 172.21.15.8:0/361441927 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f32a802d070 con 0x7f328c0a1ab0 2024-03-16T20:55:10.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.885+0000 7f329f400640 1 -- 172.21.15.8:0/361441927 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f32a802d070 con 0x7f328c0a1ab0 2024-03-16T20:55:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 -- 172.21.15.8:0/361441927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f328c0a1ab0 msgr2=0x7f328c0a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f328c0a1ab0 0x7f328c0a3f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3298005c40 tx=0x7f32980097a0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 -- 172.21.15.8:0/361441927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32a8102f80 msgr2=0x7f32a819ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32a8102f80 0x7f32a819ead0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f32a000e970 tx=0x7f32a000ee30 comp rx=0 tx=0).stop 2024-03-16T20:55:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 -- 172.21.15.8:0/361441927 shutdown_connections 2024-03-16T20:55:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f328c0a1ab0 0x7f328c0a3f70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32a8102f80 0x7f32a819ead0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32a81025c0 0x7f32a8197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 --2- 172.21.15.8:0/361441927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32a81013d0 0x7f32a8197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:10.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 -- 172.21.15.8:0/361441927 >> 172.21.15.8:0/361441927 conn(0x7f32a80fc960 msgr2=0x7f32a81057f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:10.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 -- 172.21.15.8:0/361441927 shutdown_connections 2024-03-16T20:55:10.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:10.889+0000 7f32a7200640 1 -- 172.21.15.8:0/361441927 wait complete. 2024-03-16T20:55:10.914 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-03-16T20:55:11.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.131+0000 7fe957200640 1 -- 172.21.15.8:0/1510307870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9581051c0 msgr2=0x7fe95810ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:11.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.131+0000 7fe957200640 1 --2- 172.21.15.8:0/1510307870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9581051c0 0x7fe95810ba50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe950009ca0 tx=0x7fe95002c100 comp rx=0 tx=0).stop 2024-03-16T20:55:11.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.132+0000 7fe957200640 1 -- 172.21.15.8:0/1510307870 shutdown_connections 2024-03-16T20:55:11.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.132+0000 7fe957200640 1 --2- 172.21.15.8:0/1510307870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9581051c0 0x7fe95810ba50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.132+0000 7fe957200640 1 --2- 172.21.15.8:0/1510307870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe958104800 0x7fe958104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.132+0000 7fe957200640 1 --2- 172.21.15.8:0/1510307870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe958103610 0x7fe958103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.132+0000 7fe957200640 1 -- 172.21.15.8:0/1510307870 >> 172.21.15.8:0/1510307870 conn(0x7fe9580feba0 msgr2=0x7fe958100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:11.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.132+0000 7fe957200640 1 -- 172.21.15.8:0/1510307870 shutdown_connections 2024-03-16T20:55:11.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.132+0000 7fe957200640 1 -- 172.21.15.8:0/1510307870 wait complete. 2024-03-16T20:55:11.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.133+0000 7fe957200640 1 Processor -- start 2024-03-16T20:55:11.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.133+0000 7fe957200640 1 -- start start 2024-03-16T20:55:11.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.133+0000 7fe957200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe958103610 0x7fe9581996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:11.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.133+0000 7fe957200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe958104800 0x7fe958199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:11.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.133+0000 7fe957200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9581051c0 0x7fe9581a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.133+0000 7fe957200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9581a11c0 con 0x7fe958103610 2024-03-16T20:55:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.133+0000 7fe957200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9581a1330 con 0x7fe958104800 2024-03-16T20:55:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.133+0000 7fe957200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9581a14f0 con 0x7fe9581051c0 2024-03-16T20:55:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.133+0000 7fe955e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe958103610 0x7fe9581996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.133+0000 7fe955e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe958103610 0x7fe9581996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59520/0 (socket says 172.21.15.8:59520) 2024-03-16T20:55:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe955e00640 1 -- 172.21.15.8:0/839589937 learned_addr learned my addr 172.21.15.8:0/839589937 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe955400640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe958104800 0x7fe958199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe956800640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9581051c0 0x7fe9581a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe955e00640 1 -- 172.21.15.8:0/839589937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9581051c0 msgr2=0x7fe9581a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe955e00640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9581051c0 0x7fe9581a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe955e00640 1 -- 172.21.15.8:0/839589937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe958104800 msgr2=0x7fe958199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:11.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe955e00640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe958104800 0x7fe958199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe955e00640 1 -- 172.21.15.8:0/839589937 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe950009900 con 0x7fe958103610 2024-03-16T20:55:11.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe955e00640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe958103610 0x7fe9581996d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe94800e9c0 tx=0x7fe94800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:11.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe94ea00640 1 -- 172.21.15.8:0/839589937 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948009700 con 0x7fe958103610 2024-03-16T20:55:11.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe94ea00640 1 -- 172.21.15.8:0/839589937 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe94800cd80 con 0x7fe958103610 2024-03-16T20:55:11.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe957200640 1 -- 172.21.15.8:0/839589937 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9581a17d0 con 0x7fe958103610 2024-03-16T20:55:11.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.134+0000 7fe94ea00640 1 -- 172.21.15.8:0/839589937 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948010690 con 0x7fe958103610 2024-03-16T20:55:11.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.135+0000 7fe957200640 1 -- 172.21.15.8:0/839589937 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9581a1ce0 con 0x7fe958103610 2024-03-16T20:55:11.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.136+0000 7fe957200640 1 -- 172.21.15.8:0/839589937 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95810a860 con 0x7fe958103610 2024-03-16T20:55:11.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.138+0000 7fe94ea00640 1 -- 172.21.15.8:0/839589937 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fe948003710 con 0x7fe958103610 2024-03-16T20:55:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.139+0000 7fe94ea00640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe93c0a1a30 0x7fe93c0a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.139+0000 7fe94ea00640 1 -- 172.21.15.8:0/839589937 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe948014070 con 0x7fe958103610 2024-03-16T20:55:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.139+0000 7fe955400640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe93c0a1a30 0x7fe93c0a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.140+0000 7fe955400640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe93c0a1a30 0x7fe93c0a3ef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe95819abe0 tx=0x7fe944005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.144+0000 7fe94ea00640 1 -- 172.21.15.8:0/839589937 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe948096a00 con 0x7fe958103610 2024-03-16T20:55:11.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:55:10.866+0000 7f2a5e800700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:55:11.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:55:10.866+0000 7f2a5e800700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:55:11.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:55:10.866+0000 7f2a5e800700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:55:11.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:55:10.866+0000 7f2a5e800700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:55:11.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:55:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:55:10.866+0000 7f2a5e800700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:55:11.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.384+0000 7fe957200640 1 -- 172.21.15.8:0/839589937 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fe95802cfd0 con 0x7fe93c0a1a30 2024-03-16T20:55:11.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.389+0000 7fe94ea00640 1 -- 172.21.15.8:0/839589937 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fe948096dd0 con 0x7fe958103610 2024-03-16T20:55:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.419+0000 7fe94ea00640 1 -- 172.21.15.8:0/839589937 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe95802cfd0 con 0x7fe93c0a1a30 2024-03-16T20:55:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.422+0000 7fe957200640 1 -- 172.21.15.8:0/839589937 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe93c0a1a30 msgr2=0x7fe93c0a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.422+0000 7fe957200640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe93c0a1a30 0x7fe93c0a3ef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe95819abe0 tx=0x7fe944005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.422+0000 7fe957200640 1 -- 172.21.15.8:0/839589937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe958103610 msgr2=0x7fe9581996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.422+0000 7fe957200640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe958103610 0x7fe9581996d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe94800e9c0 tx=0x7fe94800ee80 comp rx=0 tx=0).stop 2024-03-16T20:55:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.422+0000 7fe957200640 1 -- 172.21.15.8:0/839589937 shutdown_connections 2024-03-16T20:55:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.422+0000 7fe957200640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe93c0a1a30 0x7fe93c0a3ef0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.422+0000 7fe957200640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9581051c0 0x7fe9581a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.422+0000 7fe957200640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe958104800 0x7fe958199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.422+0000 7fe957200640 1 --2- 172.21.15.8:0/839589937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe958103610 0x7fe9581996d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.422+0000 7fe957200640 1 -- 172.21.15.8:0/839589937 >> 172.21.15.8:0/839589937 conn(0x7fe9580feba0 msgr2=0x7fe958107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.423+0000 7fe957200640 1 -- 172.21.15.8:0/839589937 shutdown_connections 2024-03-16T20:55:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.423+0000 7fe957200640 1 -- 172.21.15.8:0/839589937 wait complete. 2024-03-16T20:55:11.445 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-03-16T20:55:11.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:11 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-16T20:55:11.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:11 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] up:active 2024-03-16T20:55:11.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:11 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-03-16T20:55:11.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:11 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:55:11.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:11 smithi170 ceph-mon[35947]: from='client.24677 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:11.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:11 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-16T20:55:11.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:11 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] up:active 2024-03-16T20:55:11.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:11 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-03-16T20:55:11.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:11 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:55:11.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:11 smithi186 ceph-mon[36391]: from='client.24677 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:11.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.661+0000 7fa00fe00640 1 -- 172.21.15.8:0/2077533535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa010107a10 msgr2=0x7fa010107e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:11.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.661+0000 7fa00fe00640 1 --2- 172.21.15.8:0/2077533535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa010107a10 0x7fa010107e30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa000009900 tx=0x7fa00002bc40 comp rx=0 tx=0).stop 2024-03-16T20:55:11.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.661+0000 7fa00fe00640 1 -- 172.21.15.8:0/2077533535 shutdown_connections 2024-03-16T20:55:11.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.661+0000 7fa00fe00640 1 --2- 172.21.15.8:0/2077533535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0101095c0 0x7fa01010fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.661+0000 7fa00fe00640 1 --2- 172.21.15.8:0/2077533535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa010108c00 0x7fa010109080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.661+0000 7fa00fe00640 1 --2- 172.21.15.8:0/2077533535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa010107a10 0x7fa010107e30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.661+0000 7fa00fe00640 1 -- 172.21.15.8:0/2077533535 >> 172.21.15.8:0/2077533535 conn(0x7fa0100769c0 msgr2=0x7fa010078de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:11.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.661+0000 7fa00fe00640 1 -- 172.21.15.8:0/2077533535 shutdown_connections 2024-03-16T20:55:11.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.661+0000 7fa00fe00640 1 -- 172.21.15.8:0/2077533535 wait complete. 2024-03-16T20:55:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.662+0000 7fa00fe00640 1 Processor -- start 2024-03-16T20:55:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.662+0000 7fa00fe00640 1 -- start start 2024-03-16T20:55:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.663+0000 7fa00fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa010107a10 0x7fa01019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.663+0000 7fa00fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa010108c00 0x7fa01019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.663+0000 7fa00fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0101095c0 0x7fa0101a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.663+0000 7fa00fe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0101a56a0 con 0x7fa010108c00 2024-03-16T20:55:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.663+0000 7fa00fe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0101a5810 con 0x7fa0101095c0 2024-03-16T20:55:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.663+0000 7fa00fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0101a59d0 con 0x7fa010107a10 2024-03-16T20:55:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.663+0000 7fa00ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa010107a10 0x7fa01019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.663+0000 7fa00ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa010107a10 0x7fa01019dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58872/0 (socket says 172.21.15.8:58872) 2024-03-16T20:55:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.663+0000 7fa00ea00640 1 -- 172.21.15.8:0/3903793224 learned_addr learned my addr 172.21.15.8:0/3903793224 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.663+0000 7fa00e000640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa010108c00 0x7fa01019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.663+0000 7fa00f400640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0101095c0 0x7fa0101a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.664+0000 7fa00ea00640 1 -- 172.21.15.8:0/3903793224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0101095c0 msgr2=0x7fa0101a5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.664+0000 7fa00ea00640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0101095c0 0x7fa0101a5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.664+0000 7fa00ea00640 1 -- 172.21.15.8:0/3903793224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa010108c00 msgr2=0x7fa01019e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.664+0000 7fa00ea00640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa010108c00 0x7fa01019e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.664+0000 7fa00ea00640 1 -- 172.21.15.8:0/3903793224 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa008009840 con 0x7fa010107a10 2024-03-16T20:55:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.664+0000 7fa00ea00640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa010107a10 0x7fa01019dbb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa00002ce70 tx=0x7fa000005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:11.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.664+0000 7fa007400640 1 -- 172.21.15.8:0/3903793224 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000004e10 con 0x7fa010107a10 2024-03-16T20:55:11.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.664+0000 7fa00fe00640 1 -- 172.21.15.8:0/3903793224 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa000009560 con 0x7fa010107a10 2024-03-16T20:55:11.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.664+0000 7fa007400640 1 -- 172.21.15.8:0/3903793224 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa000005470 con 0x7fa010107a10 2024-03-16T20:55:11.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.664+0000 7fa007400640 1 -- 172.21.15.8:0/3903793224 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000034440 con 0x7fa010107a10 2024-03-16T20:55:11.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.664+0000 7fa00fe00640 1 -- 172.21.15.8:0/3903793224 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0101a5fc0 con 0x7fa010107a10 2024-03-16T20:55:11.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.666+0000 7fa00fe00640 1 -- 172.21.15.8:0/3903793224 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01010ed30 con 0x7fa010107a10 2024-03-16T20:55:11.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.667+0000 7fa007400640 1 -- 172.21.15.8:0/3903793224 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fa000003680 con 0x7fa010107a10 2024-03-16T20:55:11.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.669+0000 7fa007400640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ff40a1ac0 0x7f9ff40a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:11.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.669+0000 7fa007400640 1 -- 172.21.15.8:0/3903793224 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa0000ef630 con 0x7fa010107a10 2024-03-16T20:55:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.669+0000 7fa00e000640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ff40a1ac0 0x7f9ff40a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.670+0000 7fa00e000640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ff40a1ac0 0x7f9ff40a3f80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa01019f0c0 tx=0x7f9ff8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.675+0000 7fa007400640 1 -- 172.21.15.8:0/3903793224 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa0000b88a0 con 0x7fa010107a10 2024-03-16T20:55:11.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:11 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-16T20:55:11.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:11 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] up:active 2024-03-16T20:55:11.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:11 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-03-16T20:55:11.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:11 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:55:11.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:11 smithi008 ceph-mon[31434]: from='client.24677 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:11.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.908+0000 7fa00fe00640 1 -- 172.21.15.8:0/3903793224 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa01002cfd0 con 0x7f9ff40a1ac0 2024-03-16T20:55:11.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.919+0000 7fa007400640 1 -- 172.21.15.8:0/3903793224 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fa01002cfd0 con 0x7f9ff40a1ac0 2024-03-16T20:55:11.923 INFO:teuthology.orchestra.run.smithi008.stdout:/volumes/qa/sv_0/fcb28035-fec7-44ef-bacf-c185053c16cd 2024-03-16T20:55:11.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 -- 172.21.15.8:0/3903793224 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ff40a1ac0 msgr2=0x7f9ff40a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ff40a1ac0 0x7f9ff40a3f80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa01019f0c0 tx=0x7f9ff8005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 -- 172.21.15.8:0/3903793224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa010107a10 msgr2=0x7fa01019dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa010107a10 0x7fa01019dbb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa00002ce70 tx=0x7fa000005dc0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 -- 172.21.15.8:0/3903793224 shutdown_connections 2024-03-16T20:55:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ff40a1ac0 0x7f9ff40a3f80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0101095c0 0x7fa0101a5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa010108c00 0x7fa01019e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 --2- 172.21.15.8:0/3903793224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa010107a10 0x7fa01019dbb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 -- 172.21.15.8:0/3903793224 >> 172.21.15.8:0/3903793224 conn(0x7fa0100769c0 msgr2=0x7fa01010bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 -- 172.21.15.8:0/3903793224 shutdown_connections 2024-03-16T20:55:11.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:11.922+0000 7fa00fe00640 1 -- 172.21.15.8:0/3903793224 wait complete. 2024-03-16T20:55:11.945 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-03-16T20:55:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.171+0000 7f887ac00640 1 -- 172.21.15.8:0/3707995647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8874073ef0 msgr2=0x7f8874074350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.171+0000 7f887ac00640 1 --2- 172.21.15.8:0/3707995647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8874073ef0 0x7f8874074350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8860009900 tx=0x7f886002bcd0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.172+0000 7f887ac00640 1 -- 172.21.15.8:0/3707995647 shutdown_connections 2024-03-16T20:55:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.172+0000 7f887ac00640 1 --2- 172.21.15.8:0/3707995647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8874109390 0x7f887410b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.172+0000 7f887ac00640 1 --2- 172.21.15.8:0/3707995647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8874073ef0 0x7f8874074350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.172+0000 7f887ac00640 1 --2- 172.21.15.8:0/3707995647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88740754d0 0x7f8874073920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.172+0000 7f887ac00640 1 -- 172.21.15.8:0/3707995647 >> 172.21.15.8:0/3707995647 conn(0x7f88740fca90 msgr2=0x7f88740feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.172+0000 7f887ac00640 1 -- 172.21.15.8:0/3707995647 shutdown_connections 2024-03-16T20:55:12.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.172+0000 7f887ac00640 1 -- 172.21.15.8:0/3707995647 wait complete. 2024-03-16T20:55:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.173+0000 7f887ac00640 1 Processor -- start 2024-03-16T20:55:12.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.173+0000 7f887ac00640 1 -- start start 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.173+0000 7f887ac00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8874073ef0 0x7f8874199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.173+0000 7f887ac00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88740754d0 0x7f8874199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.173+0000 7f887ac00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8874109390 0x7f88741a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.173+0000 7f887ac00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88741a1360 con 0x7f8874109390 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.173+0000 7f887ac00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88741a14d0 con 0x7f8874073ef0 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.173+0000 7f887ac00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88741a1690 con 0x7f88740754d0 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.173+0000 7f8873e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8874073ef0 0x7f8874199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8873e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8874073ef0 0x7f8874199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37582/0 (socket says 172.21.15.8:37582) 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8878c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8874109390 0x7f88741a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8873e00640 1 -- 172.21.15.8:0/2132800165 learned_addr learned my addr 172.21.15.8:0/2132800165 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8873400640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88740754d0 0x7f8874199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:12.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8873e00640 1 -- 172.21.15.8:0/2132800165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88740754d0 msgr2=0x7f8874199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8873e00640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88740754d0 0x7f8874199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8873e00640 1 -- 172.21.15.8:0/2132800165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8874109390 msgr2=0x7f88741a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8873e00640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8874109390 0x7f88741a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8873e00640 1 -- 172.21.15.8:0/2132800165 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860009560 con 0x7f8874073ef0 2024-03-16T20:55:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8873e00640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8874073ef0 0x7f8874199870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f886400d950 tx=0x7f886400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8870c00640 1 -- 172.21.15.8:0/2132800165 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8864009a30 con 0x7f8874073ef0 2024-03-16T20:55:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8870c00640 1 -- 172.21.15.8:0/2132800165 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8864009b90 con 0x7f8874073ef0 2024-03-16T20:55:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.174+0000 7f8870c00640 1 -- 172.21.15.8:0/2132800165 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8864004a00 con 0x7f8874073ef0 2024-03-16T20:55:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.175+0000 7f887ac00640 1 -- 172.21.15.8:0/2132800165 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88741a1970 con 0x7f8874073ef0 2024-03-16T20:55:12.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.175+0000 7f887ac00640 1 -- 172.21.15.8:0/2132800165 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88741a1e50 con 0x7f8874073ef0 2024-03-16T20:55:12.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.176+0000 7f887ac00640 1 -- 172.21.15.8:0/2132800165 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8874108150 con 0x7f8874073ef0 2024-03-16T20:55:12.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.177+0000 7f8870c00640 1 -- 172.21.15.8:0/2132800165 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f8864009d00 con 0x7f8874073ef0 2024-03-16T20:55:12.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.179+0000 7f8870c00640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f88580a1ac0 0x7f88580a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:12.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.179+0000 7f8870c00640 1 -- 172.21.15.8:0/2132800165 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f88640ccea0 con 0x7f8874073ef0 2024-03-16T20:55:12.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.179+0000 7f8873400640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f88580a1ac0 0x7f88580a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:12.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.180+0000 7f8873400640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f88580a1ac0 0x7f88580a3f80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8860005ab0 tx=0x7f886002df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:12.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.183+0000 7f8870c00640 1 -- 172.21.15.8:0/2132800165 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8864096000 con 0x7f8874073ef0 2024-03-16T20:55:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.424+0000 7f887ac00640 1 -- 172.21.15.8:0/2132800165 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f887402d150 con 0x7f88580a1ac0 2024-03-16T20:55:12.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.453+0000 7f8870c00640 1 -- 172.21.15.8:0/2132800165 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f887402d150 con 0x7f88580a1ac0 2024-03-16T20:55:12.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.456+0000 7f887ac00640 1 -- 172.21.15.8:0/2132800165 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f88580a1ac0 msgr2=0x7f88580a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:12.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.456+0000 7f887ac00640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f88580a1ac0 0x7f88580a3f80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8860005ab0 tx=0x7f886002df90 comp rx=0 tx=0).stop 2024-03-16T20:55:12.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.456+0000 7f887ac00640 1 -- 172.21.15.8:0/2132800165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8874073ef0 msgr2=0x7f8874199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:12.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.456+0000 7f887ac00640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8874073ef0 0x7f8874199870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f886400d950 tx=0x7f886400de10 comp rx=0 tx=0).stop 2024-03-16T20:55:12.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.456+0000 7f887ac00640 1 -- 172.21.15.8:0/2132800165 shutdown_connections 2024-03-16T20:55:12.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.456+0000 7f887ac00640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f88580a1ac0 0x7f88580a3f80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.456+0000 7f887ac00640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8874109390 0x7f88741a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.456+0000 7f887ac00640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88740754d0 0x7f8874199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.456+0000 7f887ac00640 1 --2- 172.21.15.8:0/2132800165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8874073ef0 0x7f8874199870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.456+0000 7f887ac00640 1 -- 172.21.15.8:0/2132800165 >> 172.21.15.8:0/2132800165 conn(0x7f88740fca90 msgr2=0x7f8874105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:12.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.457+0000 7f887ac00640 1 -- 172.21.15.8:0/2132800165 shutdown_connections 2024-03-16T20:55:12.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.457+0000 7f887ac00640 1 -- 172.21.15.8:0/2132800165 wait complete. 2024-03-16T20:55:12.481 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-03-16T20:55:12.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:12 smithi186 ceph-mon[36391]: pgmap v320: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 11 op/s 2024-03-16T20:55:12.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:12 smithi186 ceph-mon[36391]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:12.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:12 smithi186 ceph-mon[36391]: mgrmap e17: x(active, since 8m), standbys: y, z 2024-03-16T20:55:12.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:12 smithi186 ceph-mon[36391]: from='client.24691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:12.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.709+0000 7f2b24400640 1 -- 172.21.15.8:0/455585804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b1c1096c0 msgr2=0x7f2b1c10ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:12.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.709+0000 7f2b24400640 1 --2- 172.21.15.8:0/455585804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b1c1096c0 0x7f2b1c10ff50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009ca0 tx=0x7f2b1402c100 comp rx=0 tx=0).stop 2024-03-16T20:55:12.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.709+0000 7f2b24400640 1 -- 172.21.15.8:0/455585804 shutdown_connections 2024-03-16T20:55:12.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.709+0000 7f2b24400640 1 --2- 172.21.15.8:0/455585804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b1c1096c0 0x7f2b1c10ff50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.709+0000 7f2b24400640 1 --2- 172.21.15.8:0/455585804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c108d00 0x7f2b1c109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.709+0000 7f2b24400640 1 --2- 172.21.15.8:0/455585804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c107b10 0x7f2b1c107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.709+0000 7f2b24400640 1 -- 172.21.15.8:0/455585804 >> 172.21.15.8:0/455585804 conn(0x7f2b1c076ab0 msgr2=0x7f2b1c078ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:12.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.709+0000 7f2b24400640 1 -- 172.21.15.8:0/455585804 shutdown_connections 2024-03-16T20:55:12.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.709+0000 7f2b24400640 1 -- 172.21.15.8:0/455585804 wait complete. 2024-03-16T20:55:12.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.710+0000 7f2b24400640 1 Processor -- start 2024-03-16T20:55:12.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b24400640 1 -- start start 2024-03-16T20:55:12.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b24400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c107b10 0x7f2b1c19dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:12.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b24400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b1c108d00 0x7f2b1c19e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:12.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b24400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c1096c0 0x7f2b1c1a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:12.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b24400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1a5740 con 0x7f2b1c107b10 2024-03-16T20:55:12.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b24400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1a58b0 con 0x7f2b1c108d00 2024-03-16T20:55:12.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b24400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1a5a70 con 0x7f2b1c1096c0 2024-03-16T20:55:12.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b21000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b1c108d00 0x7f2b1c19e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:12.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b22400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c1096c0 0x7f2b1c1a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:12.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b21000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b1c108d00 0x7f2b1c19e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37586/0 (socket says 172.21.15.8:37586) 2024-03-16T20:55:12.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b21000640 1 -- 172.21.15.8:0/1900143838 learned_addr learned my addr 172.21.15.8:0/1900143838 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:12.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b22400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c1096c0 0x7f2b1c1a51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58920/0 (socket says 172.21.15.8:58920) 2024-03-16T20:55:12.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.711+0000 7f2b21a00640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c107b10 0x7f2b1c19dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:12.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b22400640 1 -- 172.21.15.8:0/1900143838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b1c108d00 msgr2=0x7f2b1c19e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:12.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b22400640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b1c108d00 0x7f2b1c19e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b22400640 1 -- 172.21.15.8:0/1900143838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c107b10 msgr2=0x7f2b1c19dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:12.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b22400640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c107b10 0x7f2b1c19dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b22400640 1 -- 172.21.15.8:0/1900143838 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b08009490 con 0x7f2b1c1096c0 2024-03-16T20:55:12.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b21a00640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c107b10 0x7f2b1c19dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:55:12.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b21000640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b1c108d00 0x7f2b1c19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:12.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b22400640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c1096c0 0x7f2b1c1a51d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2b1402c640 tx=0x7f2b14032af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:12.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b1a000640 1 -- 172.21.15.8:0/1900143838 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14034850 con 0x7f2b1c1096c0 2024-03-16T20:55:12.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b24400640 1 -- 172.21.15.8:0/1900143838 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b14009900 con 0x7f2b1c1096c0 2024-03-16T20:55:12.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b1a000640 1 -- 172.21.15.8:0/1900143838 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2b14003e70 con 0x7f2b1c1096c0 2024-03-16T20:55:12.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b1a000640 1 -- 172.21.15.8:0/1900143838 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1403f440 con 0x7f2b1c1096c0 2024-03-16T20:55:12.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.712+0000 7f2b24400640 1 -- 172.21.15.8:0/1900143838 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c1a5fe0 con 0x7f2b1c1096c0 2024-03-16T20:55:12.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.714+0000 7f2b24400640 1 -- 172.21.15.8:0/1900143838 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c10edd0 con 0x7f2b1c1096c0 2024-03-16T20:55:12.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.715+0000 7f2b1a000640 1 -- 172.21.15.8:0/1900143838 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f2b1403b040 con 0x7f2b1c1096c0 2024-03-16T20:55:12.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.717+0000 7f2b1a000640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2b040a1ac0 0x7f2b040a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:12.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.717+0000 7f2b1a000640 1 -- 172.21.15.8:0/1900143838 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2b140eff70 con 0x7f2b1c1096c0 2024-03-16T20:55:12.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.717+0000 7f2b21a00640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2b040a1ac0 0x7f2b040a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:12.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.718+0000 7f2b21a00640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2b040a1ac0 0x7f2b040a3f80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c19f130 tx=0x7f2b10005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:12.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.721+0000 7f2b1a000640 1 -- 172.21.15.8:0/1900143838 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2b140b9150 con 0x7f2b1c1096c0 2024-03-16T20:55:12.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:12 smithi008 ceph-mon[31434]: pgmap v320: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 11 op/s 2024-03-16T20:55:12.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:12 smithi008 ceph-mon[31434]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:12.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:12 smithi008 ceph-mon[31434]: mgrmap e17: x(active, since 8m), standbys: y, z 2024-03-16T20:55:12.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:12 smithi008 ceph-mon[31434]: from='client.24691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:12.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:12 smithi170 ceph-mon[35947]: pgmap v320: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 11 op/s 2024-03-16T20:55:12.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:12 smithi170 ceph-mon[35947]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:12.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:12 smithi170 ceph-mon[35947]: mgrmap e17: x(active, since 8m), standbys: y, z 2024-03-16T20:55:12.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:12 smithi170 ceph-mon[35947]: from='client.24691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:12.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.953+0000 7f2b24400640 1 -- 172.21.15.8:0/1900143838 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b1c02d0d0 con 0x7f2b040a1ac0 2024-03-16T20:55:12.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.964+0000 7f2b1a000640 1 -- 172.21.15.8:0/1900143838 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f2b1c02d0d0 con 0x7f2b040a1ac0 2024-03-16T20:55:12.968 INFO:teuthology.orchestra.run.smithi008.stdout:/volumes/qa/sv_1/bff7f1a0-a01a-4a4a-8f6c-b8e31af3fad7 2024-03-16T20:55:12.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.967+0000 7f2b24400640 1 -- 172.21.15.8:0/1900143838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2b040a1ac0 msgr2=0x7f2b040a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:12.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.967+0000 7f2b24400640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2b040a1ac0 0x7f2b040a3f80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c19f130 tx=0x7f2b10005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:12.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.967+0000 7f2b24400640 1 -- 172.21.15.8:0/1900143838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c1096c0 msgr2=0x7f2b1c1a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:12.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.967+0000 7f2b24400640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c1096c0 0x7f2b1c1a51d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2b1402c640 tx=0x7f2b14032af0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.967+0000 7f2b24400640 1 -- 172.21.15.8:0/1900143838 shutdown_connections 2024-03-16T20:55:12.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.967+0000 7f2b24400640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f2b040a1ac0 0x7f2b040a3f80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.967+0000 7f2b24400640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c1096c0 0x7f2b1c1a51d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.967+0000 7f2b24400640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b1c108d00 0x7f2b1c19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.967+0000 7f2b24400640 1 --2- 172.21.15.8:0/1900143838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c107b10 0x7f2b1c19dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:12.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.967+0000 7f2b24400640 1 -- 172.21.15.8:0/1900143838 >> 172.21.15.8:0/1900143838 conn(0x7f2b1c076ab0 msgr2=0x7f2b1c10bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:12.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.968+0000 7f2b24400640 1 -- 172.21.15.8:0/1900143838 shutdown_connections 2024-03-16T20:55:12.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:12.968+0000 7f2b24400640 1 -- 172.21.15.8:0/1900143838 wait complete. 2024-03-16T20:55:12.991 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:55:13.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.205+0000 7f4c46600640 1 -- 172.21.15.8:0/1487482527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c40109220 msgr2=0x7f4c4010b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:13.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.205+0000 7f4c46600640 1 --2- 172.21.15.8:0/1487482527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c40109220 0x7f4c4010b6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009ca0 tx=0x7f4c3802c0f0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.205+0000 7f4c46600640 1 -- 172.21.15.8:0/1487482527 shutdown_connections 2024-03-16T20:55:13.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.205+0000 7f4c46600640 1 --2- 172.21.15.8:0/1487482527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c40109220 0x7f4c4010b6b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.205+0000 7f4c46600640 1 --2- 172.21.15.8:0/1487482527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40073f50 0x7f4c400743d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.205+0000 7f4c46600640 1 --2- 172.21.15.8:0/1487482527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075530 0x7f4c40073980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.205+0000 7f4c46600640 1 -- 172.21.15.8:0/1487482527 >> 172.21.15.8:0/1487482527 conn(0x7f4c400fc8d0 msgr2=0x7f4c400fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:13.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.205+0000 7f4c46600640 1 -- 172.21.15.8:0/1487482527 shutdown_connections 2024-03-16T20:55:13.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.206+0000 7f4c46600640 1 -- 172.21.15.8:0/1487482527 wait complete. 2024-03-16T20:55:13.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.206+0000 7f4c46600640 1 Processor -- start 2024-03-16T20:55:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c46600640 1 -- start start 2024-03-16T20:55:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c46600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c40073f50 0x7f4c40199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c46600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075530 0x7f4c40199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c46600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40109220 0x7f4c401a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c46600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401a1140 con 0x7f4c40075530 2024-03-16T20:55:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c46600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401a12b0 con 0x7f4c40073f50 2024-03-16T20:55:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c46600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401a1470 con 0x7f4c40109220 2024-03-16T20:55:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c45200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c40073f50 0x7f4c40199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c45200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c40073f50 0x7f4c40199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37616/0 (socket says 172.21.15.8:37616) 2024-03-16T20:55:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c45200640 1 -- 172.21.15.8:0/1062666619 learned_addr learned my addr 172.21.15.8:0/1062666619 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c37e00640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075530 0x7f4c40199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.207+0000 7f4c45c00640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40109220 0x7f4c401a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.208+0000 7f4c45200640 1 -- 172.21.15.8:0/1062666619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40109220 msgr2=0x7f4c401a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.208+0000 7f4c45200640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40109220 0x7f4c401a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.208+0000 7f4c45200640 1 -- 172.21.15.8:0/1062666619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075530 msgr2=0x7f4c40199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.208+0000 7f4c45200640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075530 0x7f4c40199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.208+0000 7f4c45200640 1 -- 172.21.15.8:0/1062666619 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c38009900 con 0x7f4c40073f50 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.208+0000 7f4c45200640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c40073f50 0x7f4c40199650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000e9f0 tx=0x7f4c3000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.208+0000 7f4c3e000640 1 -- 172.21.15.8:0/1062666619 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30009700 con 0x7f4c40073f50 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.208+0000 7f4c3e000640 1 -- 172.21.15.8:0/1062666619 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4c3000cd80 con 0x7f4c40073f50 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.208+0000 7f4c3e000640 1 -- 172.21.15.8:0/1062666619 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c300189c0 con 0x7f4c40073f50 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.208+0000 7f4c46600640 1 -- 172.21.15.8:0/1062666619 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c401a1750 con 0x7f4c40073f50 2024-03-16T20:55:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.209+0000 7f4c46600640 1 -- 172.21.15.8:0/1062666619 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c401a1c60 con 0x7f4c40073f50 2024-03-16T20:55:13.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.210+0000 7f4c46600640 1 -- 172.21.15.8:0/1062666619 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c40107f50 con 0x7f4c40073f50 2024-03-16T20:55:13.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.211+0000 7f4c3e000640 1 -- 172.21.15.8:0/1062666619 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f4c30018b20 con 0x7f4c40073f50 2024-03-16T20:55:13.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.213+0000 7f4c3e000640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c240a1ac0 0x7f4c240a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:13.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.213+0000 7f4c3e000640 1 -- 172.21.15.8:0/1062666619 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4c30014070 con 0x7f4c40073f50 2024-03-16T20:55:13.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.213+0000 7f4c37e00640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c240a1ac0 0x7f4c240a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:13.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.214+0000 7f4c37e00640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c240a1ac0 0x7f4c240a3f80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4c4019ab60 tx=0x7f4c28005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:13.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.217+0000 7f4c3e000640 1 -- 172.21.15.8:0/1062666619 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4c30053280 con 0x7f4c40073f50 2024-03-16T20:55:13.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.471+0000 7f4c46600640 1 -- 172.21.15.8:0/1062666619 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c4010f080 con 0x7f4c40073f50 2024-03-16T20:55:13.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.472+0000 7f4c3e000640 1 -- 172.21.15.8:0/1062666619 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f4c4010f080 con 0x7f4c40073f50 2024-03-16T20:55:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:13.476 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:55:10.355515+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24593,24544]},"id":1}]} 2024-03-16T20:55:13.476 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2024-03-16T20:55:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 -- 172.21.15.8:0/1062666619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c240a1ac0 msgr2=0x7f4c240a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c240a1ac0 0x7f4c240a3f80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4c4019ab60 tx=0x7f4c28005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 -- 172.21.15.8:0/1062666619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c40073f50 msgr2=0x7f4c40199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c40073f50 0x7f4c40199650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000e9f0 tx=0x7f4c3000eeb0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 -- 172.21.15.8:0/1062666619 shutdown_connections 2024-03-16T20:55:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c240a1ac0 0x7f4c240a3f80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40109220 0x7f4c401a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075530 0x7f4c40199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 --2- 172.21.15.8:0/1062666619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c40073f50 0x7f4c40199650 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 -- 172.21.15.8:0/1062666619 >> 172.21.15.8:0/1062666619 conn(0x7f4c400fc8d0 msgr2=0x7f4c40105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 -- 172.21.15.8:0/1062666619 shutdown_connections 2024-03-16T20:55:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.475+0000 7f4c46600640 1 -- 172.21.15.8:0/1062666619 wait complete. 2024-03-16T20:55:13.499 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:55:13.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:13 smithi186 ceph-mon[36391]: from='client.24698 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:13.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.717+0000 7ff7c9a00640 1 -- 172.21.15.8:0/4139854833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c4108b40 msgr2=0x7ff7c4108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:13.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.717+0000 7ff7c9a00640 1 --2- 172.21.15.8:0/4139854833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c4108b40 0x7ff7c4108fc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009900 tx=0x7ff7ac02bc30 comp rx=0 tx=0).stop 2024-03-16T20:55:13.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.717+0000 7ff7c9a00640 1 -- 172.21.15.8:0/4139854833 shutdown_connections 2024-03-16T20:55:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.717+0000 7ff7c9a00640 1 --2- 172.21.15.8:0/4139854833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c4109500 0x7ff7c410fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.717+0000 7ff7c9a00640 1 --2- 172.21.15.8:0/4139854833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c4108b40 0x7ff7c4108fc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.717+0000 7ff7c9a00640 1 --2- 172.21.15.8:0/4139854833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c4107950 0x7ff7c4107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.717+0000 7ff7c9a00640 1 -- 172.21.15.8:0/4139854833 >> 172.21.15.8:0/4139854833 conn(0x7ff7c4076900 msgr2=0x7ff7c4078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.717+0000 7ff7c9a00640 1 -- 172.21.15.8:0/4139854833 shutdown_connections 2024-03-16T20:55:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.717+0000 7ff7c9a00640 1 -- 172.21.15.8:0/4139854833 wait complete. 2024-03-16T20:55:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.719+0000 7ff7c9a00640 1 Processor -- start 2024-03-16T20:55:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.719+0000 7ff7c9a00640 1 -- start start 2024-03-16T20:55:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.719+0000 7ff7c9a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c4107950 0x7ff7c419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.719+0000 7ff7c9a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c4108b40 0x7ff7c419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.719+0000 7ff7c9a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c4109500 0x7ff7c41a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.719+0000 7ff7c9a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c41a5540 con 0x7ff7c4107950 2024-03-16T20:55:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.719+0000 7ff7c9a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c41a56b0 con 0x7ff7c4109500 2024-03-16T20:55:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.719+0000 7ff7c9a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c41a5870 con 0x7ff7c4108b40 2024-03-16T20:55:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.719+0000 7ff7c3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c4107950 0x7ff7c419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.719+0000 7ff7c3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c4107950 0x7ff7c419da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59610/0 (socket says 172.21.15.8:59610) 2024-03-16T20:55:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.720+0000 7ff7c3e00640 1 -- 172.21.15.8:0/1327084629 learned_addr learned my addr 172.21.15.8:0/1327084629 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.720+0000 7ff7bbe00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c4108b40 0x7ff7c419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.720+0000 7ff7c9000640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c4109500 0x7ff7c41a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.720+0000 7ff7bbe00640 1 -- 172.21.15.8:0/1327084629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c4109500 msgr2=0x7ff7c41a5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.720+0000 7ff7bbe00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c4109500 0x7ff7c41a5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.720+0000 7ff7bbe00640 1 -- 172.21.15.8:0/1327084629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c4107950 msgr2=0x7ff7c419da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.720+0000 7ff7bbe00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c4107950 0x7ff7c419da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.720+0000 7ff7bbe00640 1 -- 172.21.15.8:0/1327084629 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac009560 con 0x7ff7c4108b40 2024-03-16T20:55:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.720+0000 7ff7c9000640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c4109500 0x7ff7c41a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.720+0000 7ff7bbe00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c4108b40 0x7ff7c419df90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac02c170 tx=0x7ff7ac005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.721+0000 7ff7c1600640 1 -- 172.21.15.8:0/1327084629 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac005010 con 0x7ff7c4108b40 2024-03-16T20:55:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.721+0000 7ff7c9a00640 1 -- 172.21.15.8:0/1327084629 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c41a5af0 con 0x7ff7c4108b40 2024-03-16T20:55:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.721+0000 7ff7c1600640 1 -- 172.21.15.8:0/1327084629 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff7ac005670 con 0x7ff7c4108b40 2024-03-16T20:55:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.721+0000 7ff7c1600640 1 -- 172.21.15.8:0/1327084629 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac034440 con 0x7ff7c4108b40 2024-03-16T20:55:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.721+0000 7ff7c9a00640 1 -- 172.21.15.8:0/1327084629 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c41a5fa0 con 0x7ff7c4108b40 2024-03-16T20:55:13.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.722+0000 7ff7c9a00640 1 -- 172.21.15.8:0/1327084629 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c410ec10 con 0x7ff7c4108b40 2024-03-16T20:55:13.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.724+0000 7ff7c1600640 1 -- 172.21.15.8:0/1327084629 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7ff7ac003780 con 0x7ff7c4108b40 2024-03-16T20:55:13.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.725+0000 7ff7c1600640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff7a80a1ac0 0x7ff7a80a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:13.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.725+0000 7ff7c1600640 1 -- 172.21.15.8:0/1327084629 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff7ac0ef4a0 con 0x7ff7c4108b40 2024-03-16T20:55:13.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.725+0000 7ff7c3e00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff7a80a1ac0 0x7ff7a80a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:13.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.726+0000 7ff7c3e00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff7a80a1ac0 0x7ff7a80a3f80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4005fd0 tx=0x7ff7b400b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:13.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.729+0000 7ff7c1600640 1 -- 172.21.15.8:0/1327084629 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff7ac0b87c0 con 0x7ff7c4108b40 2024-03-16T20:55:13.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:13 smithi008 ceph-mon[31434]: from='client.24698 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:13.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:13 smithi170 ceph-mon[35947]: from='client.24698 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:13.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.932+0000 7ff7c9a00640 1 -- 172.21.15.8:0/1327084629 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7c4113680 con 0x7ff7c4108b40 2024-03-16T20:55:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:13.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.933+0000 7ff7c1600640 1 -- 172.21.15.8:0/1327084629 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22148 (secure 0 0 0) 0x7ff7ac0bbe80 con 0x7ff7c4108b40 2024-03-16T20:55:13.939 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:55:06.246550+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:55:13.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 -- 172.21.15.8:0/1327084629 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff7a80a1ac0 msgr2=0x7ff7a80a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:13.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff7a80a1ac0 0x7ff7a80a3f80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4005fd0 tx=0x7ff7b400b4a0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 -- 172.21.15.8:0/1327084629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c4108b40 msgr2=0x7ff7c419df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c4108b40 0x7ff7c419df90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac02c170 tx=0x7ff7ac005e50 comp rx=0 tx=0).stop 2024-03-16T20:55:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 -- 172.21.15.8:0/1327084629 shutdown_connections 2024-03-16T20:55:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff7a80a1ac0 0x7ff7a80a3f80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c4109500 0x7ff7c41a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c4108b40 0x7ff7c419df90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 --2- 172.21.15.8:0/1327084629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7c4107950 0x7ff7c419da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 -- 172.21.15.8:0/1327084629 >> 172.21.15.8:0/1327084629 conn(0x7ff7c4076900 msgr2=0x7ff7c410bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 -- 172.21.15.8:0/1327084629 shutdown_connections 2024-03-16T20:55:13.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:13.936+0000 7ff7c9a00640 1 -- 172.21.15.8:0/1327084629 wait complete. 2024-03-16T20:55:13.960 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T20:55:13.960 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T20:55:14.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.183+0000 7fb39b200640 1 -- 172.21.15.8:0/2421854152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb39c107950 msgr2=0x7fb39c107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:14.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.183+0000 7fb39b200640 1 --2- 172.21.15.8:0/2421854152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb39c107950 0x7fb39c107d70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009900 tx=0x7fb38c02bc50 comp rx=0 tx=0).stop 2024-03-16T20:55:14.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.183+0000 7fb39b200640 1 -- 172.21.15.8:0/2421854152 shutdown_connections 2024-03-16T20:55:14.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.183+0000 7fb39b200640 1 --2- 172.21.15.8:0/2421854152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39c109500 0x7fb39c10fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.183+0000 7fb39b200640 1 --2- 172.21.15.8:0/2421854152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb39c108b40 0x7fb39c108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.183+0000 7fb39b200640 1 --2- 172.21.15.8:0/2421854152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb39c107950 0x7fb39c107d70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.183+0000 7fb39b200640 1 -- 172.21.15.8:0/2421854152 >> 172.21.15.8:0/2421854152 conn(0x7fb39c076900 msgr2=0x7fb39c078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:14.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.183+0000 7fb39b200640 1 -- 172.21.15.8:0/2421854152 shutdown_connections 2024-03-16T20:55:14.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.184+0000 7fb39b200640 1 -- 172.21.15.8:0/2421854152 wait complete. 2024-03-16T20:55:14.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.184+0000 7fb39b200640 1 Processor -- start 2024-03-16T20:55:14.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb39b200640 1 -- start start 2024-03-16T20:55:14.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb39b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb39c107950 0x7fb39c19daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:14.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb39b200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb39c108b40 0x7fb39c19dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:14.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb39b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39c109500 0x7fb39c1a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:14.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb39b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c1a5590 con 0x7fb39c109500 2024-03-16T20:55:14.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb39b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c1a5700 con 0x7fb39c107950 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb39b200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c1a58c0 con 0x7fb39c108b40 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb399e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb39c107950 0x7fb39c19daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb399400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb39c108b40 0x7fb39c19dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb399e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb39c107950 0x7fb39c19daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37662/0 (socket says 172.21.15.8:37662) 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb39a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39c109500 0x7fb39c1a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.185+0000 7fb399e00640 1 -- 172.21.15.8:0/2786804667 learned_addr learned my addr 172.21.15.8:0/2786804667 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb399e00640 1 -- 172.21.15.8:0/2786804667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb39c108b40 msgr2=0x7fb39c19dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb399e00640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb39c108b40 0x7fb39c19dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb399e00640 1 -- 172.21.15.8:0/2786804667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39c109500 msgr2=0x7fb39c1a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb399e00640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39c109500 0x7fb39c1a5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb399e00640 1 -- 172.21.15.8:0/2786804667 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c009560 con 0x7fb39c107950 2024-03-16T20:55:14.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb399400640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb39c108b40 0x7fb39c19dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:14.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb39a800640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39c109500 0x7fb39c1a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:14.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb399e00640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb39c107950 0x7fb39c19daa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb38c02efd0 tx=0x7fb38c005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:14.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb392a00640 1 -- 172.21.15.8:0/2786804667 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c004e10 con 0x7fb39c107950 2024-03-16T20:55:14.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb39b200640 1 -- 172.21.15.8:0/2786804667 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39c1a5b40 con 0x7fb39c107950 2024-03-16T20:55:14.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb392a00640 1 -- 172.21.15.8:0/2786804667 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb38c005470 con 0x7fb39c107950 2024-03-16T20:55:14.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb392a00640 1 -- 172.21.15.8:0/2786804667 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c034440 con 0x7fb39c107950 2024-03-16T20:55:14.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.186+0000 7fb39b200640 1 -- 172.21.15.8:0/2786804667 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39c1a5fc0 con 0x7fb39c107950 2024-03-16T20:55:14.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.187+0000 7fb39b200640 1 -- 172.21.15.8:0/2786804667 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39c10eba0 con 0x7fb39c107950 2024-03-16T20:55:14.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.189+0000 7fb392a00640 1 -- 172.21.15.8:0/2786804667 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fb38c0035f0 con 0x7fb39c107950 2024-03-16T20:55:14.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.191+0000 7fb392a00640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb3800a1ac0 0x7fb3800a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:14.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.191+0000 7fb392a00640 1 -- 172.21.15.8:0/2786804667 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb38c0ef7c0 con 0x7fb39c107950 2024-03-16T20:55:14.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.191+0000 7fb399400640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb3800a1ac0 0x7fb3800a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:14.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.192+0000 7fb399400640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb3800a1ac0 0x7fb3800a3f80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb39c19efb0 tx=0x7fb388005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:14.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.195+0000 7fb392a00640 1 -- 172.21.15.8:0/2786804667 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb38c0b8ae0 con 0x7fb39c107950 2024-03-16T20:55:14.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.396+0000 7fb39b200640 1 -- 172.21.15.8:0/2786804667 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb39c02d0a0 con 0x7fb3800a1ac0 2024-03-16T20:55:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.423+0000 7fb392a00640 1 -- 172.21.15.8:0/2786804667 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258865 (secure 0 0 0) 0x7fb39c02d0a0 con 0x7fb3800a1ac0 2024-03-16T20:55:14.431 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:14.433 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-16T20:55:14.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 -- 172.21.15.8:0/2786804667 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb3800a1ac0 msgr2=0x7fb3800a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:14.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb3800a1ac0 0x7fb3800a3f80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb39c19efb0 tx=0x7fb388005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:14.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 -- 172.21.15.8:0/2786804667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb39c107950 msgr2=0x7fb39c19daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:14.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb39c107950 0x7fb39c19daa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb38c02efd0 tx=0x7fb38c005dd0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 -- 172.21.15.8:0/2786804667 shutdown_connections 2024-03-16T20:55:14.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb3800a1ac0 0x7fb3800a3f80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb39c109500 0x7fb39c1a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb39c108b40 0x7fb39c19dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 --2- 172.21.15.8:0/2786804667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb39c107950 0x7fb39c19daa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 -- 172.21.15.8:0/2786804667 >> 172.21.15.8:0/2786804667 conn(0x7fb39c076900 msgr2=0x7fb39c10bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:14.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 -- 172.21.15.8:0/2786804667 shutdown_connections 2024-03-16T20:55:14.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.429+0000 7fb39b200640 1 -- 172.21.15.8:0/2786804667 wait complete. 2024-03-16T20:55:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-03-16T20:55:13.081632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593652,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":139,"num_read_kb":122,"num_write":277,"num_write_kb":2963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":245,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364492,"kb_used_data":11152,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577332,"statfs":{"total":1151940427776,"available":1151567187968,"internally_reserved":0,"allocated":11419648,"data_stored":7089796,"data_compressed":107565,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3284,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":96,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003511"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892208+0000","last_change":"2024-03-16T20:55:05.301473+0000","last_active":"2024-03-16T20:55:06.892208+0000","last_peered":"2024-03-16T20:55:06.892208+0000","last_clean":"2024-03-16T20:55:06.892208+0000","last_became_active":"2024-03-16T20:55:05.301166+0000","last_became_peered":"2024-03-16T20:55:05.301166+0000","last_unstale":"2024-03-16T20:55:06.892208+0000","last_undegraded":"2024-03-16T20:55:06.892208+0000","last_fullsized":"2024-03-16T20:55:06.892208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:06:51.838382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.673516+0000","last_change":"2024-03-16T20:55:05.295895+0000","last_active":"2024-03-16T20:55:06.673516+0000","last_peered":"2024-03-16T20:55:06.673516+0000","last_clean":"2024-03-16T20:55:06.673516+0000","last_became_active":"2024-03-16T20:55:05.295365+0000","last_became_peered":"2024-03-16T20:55:05.295365+0000","last_unstale":"2024-03-16T20:55:06.673516+0000","last_undegraded":"2024-03-16T20:55:06.673516+0000","last_fullsized":"2024-03-16T20:55:06.673516+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:28:20.342348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.673174+0000","last_change":"2024-03-16T20:55:05.299049+0000","last_active":"2024-03-16T20:55:06.673174+0000","last_peered":"2024-03-16T20:55:06.673174+0000","last_clean":"2024-03-16T20:55:06.673174+0000","last_became_active":"2024-03-16T20:55:05.292758+0000","last_became_peered":"2024-03-16T20:55:05.292758+0000","last_unstale":"2024-03-16T20:55:06.673174+0000","last_undegraded":"2024-03-16T20:55:06.673174+0000","last_fullsized":"2024-03-16T20:55:06.673174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:20:36.276639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251645+0000","last_change":"2024-03-16T20:55:05.274453+0000","last_active":"2024-03-16T20:55:06.251645+0000","last_peered":"2024-03-16T20:55:06.251645+0000","last_clean":"2024-03-16T20:55:06.251645+0000","last_became_active":"2024-03-16T20:55:05.273648+0000","last_became_peered":"2024-03-16T20:55:05.273648+0000","last_unstale":"2024-03-16T20:55:06.251645+0000","last_undegraded":"2024-03-16T20:55:06.251645+0000","last_fullsized":"2024-03-16T20:55:06.251645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:08:37.297906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891049+0000","last_change":"2024-03-16T20:55:05.291272+0000","last_active":"2024-03-16T20:55:06.891049+0000","last_peered":"2024-03-16T20:55:06.891049+0000","last_clean":"2024-03-16T20:55:06.891049+0000","last_became_active":"2024-03-16T20:55:05.290788+0000","last_became_peered":"2024-03-16T20:55:05.290788+0000","last_unstale":"2024-03-16T20:55:06.891049+0000","last_undegraded":"2024-03-16T20:55:06.891049+0000","last_fullsized":"2024-03-16T20:55:06.891049+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:36:42.842797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.390070+0000","last_change":"2024-03-16T20:55:05.289977+0000","last_active":"2024-03-16T20:55:06.390070+0000","last_peered":"2024-03-16T20:55:06.390070+0000","last_clean":"2024-03-16T20:55:06.390070+0000","last_became_active":"2024-03-16T20:55:05.289520+0000","last_became_peered":"2024-03-16T20:55:05.289520+0000","last_unstale":"2024-03-16T20:55:06.390070+0000","last_undegraded":"2024-03-16T20:55:06.390070+0000","last_fullsized":"2024-03-16T20:55:06.390070+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:25:49.270854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534927+0000","last_change":"2024-03-16T20:55:05.286244+0000","last_active":"2024-03-16T20:55:07.534927+0000","last_peered":"2024-03-16T20:55:07.534927+0000","last_clean":"2024-03-16T20:55:07.534927+0000","last_became_active":"2024-03-16T20:55:05.285871+0000","last_became_peered":"2024-03-16T20:55:05.285871+0000","last_unstale":"2024-03-16T20:55:07.534927+0000","last_undegraded":"2024-03-16T20:55:07.534927+0000","last_fullsized":"2024-03-16T20:55:07.534927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:24:47.334046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.893514+0000","last_change":"2024-03-16T20:55:05.293902+0000","last_active":"2024-03-16T20:55:06.893514+0000","last_peered":"2024-03-16T20:55:06.893514+0000","last_clean":"2024-03-16T20:55:06.893514+0000","last_became_active":"2024-03-16T20:55:05.284424+0000","last_became_peered":"2024-03-16T20:55:05.284424+0000","last_unstale":"2024-03-16T20:55:06.893514+0000","last_undegraded":"2024-03-16T20:55:06.893514+0000","last_fullsized":"2024-03-16T20:55:06.893514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:09:15.024337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890451+0000","last_change":"2024-03-16T20:55:05.271434+0000","last_active":"2024-03-16T20:55:06.890451+0000","last_peered":"2024-03-16T20:55:06.890451+0000","last_clean":"2024-03-16T20:55:06.890451+0000","last_became_active":"2024-03-16T20:55:05.271014+0000","last_became_peered":"2024-03-16T20:55:05.271014+0000","last_unstale":"2024-03-16T20:55:06.890451+0000","last_undegraded":"2024-03-16T20:55:06.890451+0000","last_fullsized":"2024-03-16T20:55:06.890451+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:09:47.133987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.390299+0000","last_change":"2024-03-16T20:55:05.275108+0000","last_active":"2024-03-16T20:55:06.390299+0000","last_peered":"2024-03-16T20:55:06.390299+0000","last_clean":"2024-03-16T20:55:06.390299+0000","last_became_active":"2024-03-16T20:55:05.274659+0000","last_became_peered":"2024-03-16T20:55:05.274659+0000","last_unstale":"2024-03-16T20:55:06.390299+0000","last_undegraded":"2024-03-16T20:55:06.390299+0000","last_fullsized":"2024-03-16T20:55:06.390299+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:10:16.801309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534950+0000","last_change":"2024-03-16T20:55:05.273322+0000","last_active":"2024-03-16T20:55:07.534950+0000","last_peered":"2024-03-16T20:55:07.534950+0000","last_clean":"2024-03-16T20:55:07.534950+0000","last_became_active":"2024-03-16T20:55:05.272999+0000","last_became_peered":"2024-03-16T20:55:05.272999+0000","last_unstale":"2024-03-16T20:55:07.534950+0000","last_undegraded":"2024-03-16T20:55:07.534950+0000","last_fullsized":"2024-03-16T20:55:07.534950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:49:43.426765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251602+0000","last_change":"2024-03-16T20:55:05.274729+0000","last_active":"2024-03-16T20:55:06.251602+0000","last_peered":"2024-03-16T20:55:06.251602+0000","last_clean":"2024-03-16T20:55:06.251602+0000","last_became_active":"2024-03-16T20:55:05.274131+0000","last_became_peered":"2024-03-16T20:55:05.274131+0000","last_unstale":"2024-03-16T20:55:06.251602+0000","last_undegraded":"2024-03-16T20:55:06.251602+0000","last_fullsized":"2024-03-16T20:55:06.251602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:59:43.413956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.252228+0000","last_change":"2024-03-16T20:55:05.272792+0000","last_active":"2024-03-16T20:55:06.252228+0000","last_peered":"2024-03-16T20:55:06.252228+0000","last_clean":"2024-03-16T20:55:06.252228+0000","last_became_active":"2024-03-16T20:55:05.272048+0000","last_became_peered":"2024-03-16T20:55:05.272048+0000","last_unstale":"2024-03-16T20:55:06.252228+0000","last_undegraded":"2024-03-16T20:55:06.252228+0000","last_fullsized":"2024-03-16T20:55:06.252228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:55:17.608196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.672381+0000","last_change":"2024-03-16T20:55:05.282707+0000","last_active":"2024-03-16T20:55:06.672381+0000","last_peered":"2024-03-16T20:55:06.672381+0000","last_clean":"2024-03-16T20:55:06.672381+0000","last_became_active":"2024-03-16T20:55:05.282168+0000","last_became_peered":"2024-03-16T20:55:05.282168+0000","last_unstale":"2024-03-16T20:55:06.672381+0000","last_undegraded":"2024-03-16T20:55:06.672381+0000","last_fullsized":"2024-03-16T20:55:06.672381+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:33:59.464303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.672403+0000","last_change":"2024-03-16T20:55:05.290291+0000","last_active":"2024-03-16T20:55:06.672403+0000","last_peered":"2024-03-16T20:55:06.672403+0000","last_clean":"2024-03-16T20:55:06.672403+0000","last_became_active":"2024-03-16T20:55:05.289952+0000","last_became_peered":"2024-03-16T20:55:05.289952+0000","last_unstale":"2024-03-16T20:55:06.672403+0000","last_undegraded":"2024-03-16T20:55:06.672403+0000","last_fullsized":"2024-03-16T20:55:06.672403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:05.334408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890001+0000","last_change":"2024-03-16T20:55:05.284252+0000","last_active":"2024-03-16T20:55:06.890001+0000","last_peered":"2024-03-16T20:55:06.890001+0000","last_clean":"2024-03-16T20:55:06.890001+0000","last_became_active":"2024-03-16T20:55:05.283804+0000","last_became_peered":"2024-03-16T20:55:05.283804+0000","last_unstale":"2024-03-16T20:55:06.890001+0000","last_undegraded":"2024-03-16T20:55:06.890001+0000","last_fullsized":"2024-03-16T20:55:06.890001+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:03:17.942719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892291+0000","last_change":"2024-03-16T20:55:05.296118+0000","last_active":"2024-03-16T20:55:06.892291+0000","last_peered":"2024-03-16T20:55:06.892291+0000","last_clean":"2024-03-16T20:55:06.892291+0000","last_became_active":"2024-03-16T20:55:05.295783+0000","last_became_peered":"2024-03-16T20:55:05.295783+0000","last_unstale":"2024-03-16T20:55:06.892291+0000","last_undegraded":"2024-03-16T20:55:06.892291+0000","last_fullsized":"2024-03-16T20:55:06.892291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:36:15.463748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.893553+0000","last_change":"2024-03-16T20:55:05.287221+0000","last_active":"2024-03-16T20:55:06.893553+0000","last_peered":"2024-03-16T20:55:06.893553+0000","last_clean":"2024-03-16T20:55:06.893553+0000","last_became_active":"2024-03-16T20:55:05.286553+0000","last_became_peered":"2024-03-16T20:55:05.286553+0000","last_unstale":"2024-03-16T20:55:06.893553+0000","last_undegraded":"2024-03-16T20:55:06.893553+0000","last_fullsized":"2024-03-16T20:55:06.893553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:33:25.688231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.252126+0000","last_change":"2024-03-16T20:55:05.280111+0000","last_active":"2024-03-16T20:55:06.252126+0000","last_peered":"2024-03-16T20:55:06.252126+0000","last_clean":"2024-03-16T20:55:06.252126+0000","last_became_active":"2024-03-16T20:55:05.279857+0000","last_became_peered":"2024-03-16T20:55:05.279857+0000","last_unstale":"2024-03-16T20:55:06.252126+0000","last_undegraded":"2024-03-16T20:55:06.252126+0000","last_fullsized":"2024-03-16T20:55:06.252126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:57:18.205253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.893365+0000","last_change":"2024-03-16T20:55:04.268836+0000","last_active":"2024-03-16T20:55:06.893365+0000","last_peered":"2024-03-16T20:55:06.893365+0000","last_clean":"2024-03-16T20:55:06.893365+0000","last_became_active":"2024-03-16T20:55:04.266502+0000","last_became_peered":"2024-03-16T20:55:04.266502+0000","last_unstale":"2024-03-16T20:55:06.893365+0000","last_undegraded":"2024-03-16T20:55:06.893365+0000","last_fullsized":"2024-03-16T20:55:06.893365+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:12:33.717454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.895533+0000","last_change":"2024-03-16T20:55:05.280158+0000","last_active":"2024-03-16T20:55:06.895533+0000","last_peered":"2024-03-16T20:55:06.895533+0000","last_clean":"2024-03-16T20:55:06.895533+0000","last_became_active":"2024-03-16T20:55:05.278918+0000","last_became_peered":"2024-03-16T20:55:05.278918+0000","last_unstale":"2024-03-16T20:55:06.895533+0000","last_undegraded":"2024-03-16T20:55:06.895533+0000","last_fullsized":"2024-03-16T20:55:06.895533+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:27:34.158596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.886238+0000","last_change":"2024-03-16T20:55:04.283366+0000","last_active":"2024-03-16T20:55:07.886238+0000","last_peered":"2024-03-16T20:55:07.886238+0000","last_clean":"2024-03-16T20:55:07.886238+0000","last_became_active":"2024-03-16T20:55:04.283016+0000","last_became_peered":"2024-03-16T20:55:04.283016+0000","last_unstale":"2024-03-16T20:55:07.886238+0000","last_undegraded":"2024-03-16T20:55:07.886238+0000","last_fullsized":"2024-03-16T20:55:07.886238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:41.163294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.673783+0000","last_change":"2024-03-16T20:55:05.299005+0000","last_active":"2024-03-16T20:55:06.673783+0000","last_peered":"2024-03-16T20:55:06.673783+0000","last_clean":"2024-03-16T20:55:06.673783+0000","last_became_active":"2024-03-16T20:55:05.296527+0000","last_became_peered":"2024-03-16T20:55:05.296527+0000","last_unstale":"2024-03-16T20:55:06.673783+0000","last_undegraded":"2024-03-16T20:55:06.673783+0000","last_fullsized":"2024-03-16T20:55:06.673783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:56:51.451900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891119+0000","last_change":"2024-03-16T20:55:04.259210+0000","last_active":"2024-03-16T20:55:06.891119+0000","last_peered":"2024-03-16T20:55:06.891119+0000","last_clean":"2024-03-16T20:55:06.891119+0000","last_became_active":"2024-03-16T20:55:04.258828+0000","last_became_peered":"2024-03-16T20:55:04.258828+0000","last_unstale":"2024-03-16T20:55:06.891119+0000","last_undegraded":"2024-03-16T20:55:06.891119+0000","last_fullsized":"2024-03-16T20:55:06.891119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:21:14.497086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890145+0000","last_change":"2024-03-16T20:55:05.272053+0000","last_active":"2024-03-16T20:55:06.890145+0000","last_peered":"2024-03-16T20:55:06.890145+0000","last_clean":"2024-03-16T20:55:06.890145+0000","last_became_active":"2024-03-16T20:55:05.271435+0000","last_became_peered":"2024-03-16T20:55:05.271435+0000","last_unstale":"2024-03-16T20:55:06.890145+0000","last_undegraded":"2024-03-16T20:55:06.890145+0000","last_fullsized":"2024-03-16T20:55:06.890145+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:08:47.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891041+0000","last_change":"2024-03-16T20:55:04.261051+0000","last_active":"2024-03-16T20:55:06.891041+0000","last_peered":"2024-03-16T20:55:06.891041+0000","last_clean":"2024-03-16T20:55:06.891041+0000","last_became_active":"2024-03-16T20:55:04.260701+0000","last_became_peered":"2024-03-16T20:55:04.260701+0000","last_unstale":"2024-03-16T20:55:06.891041+0000","last_undegraded":"2024-03-16T20:55:06.891041+0000","last_fullsized":"2024-03-16T20:55:06.891041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:30:05.233891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891582+0000","last_change":"2024-03-16T20:55:05.270047+0000","last_active":"2024-03-16T20:55:06.891582+0000","last_peered":"2024-03-16T20:55:06.891582+0000","last_clean":"2024-03-16T20:55:06.891582+0000","last_became_active":"2024-03-16T20:55:05.269045+0000","last_became_peered":"2024-03-16T20:55:05.269045+0000","last_unstale":"2024-03-16T20:55:06.891582+0000","last_undegraded":"2024-03-16T20:55:06.891582+0000","last_fullsized":"2024-03-16T20:55:06.891582+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:54:19.289648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891040+0000","last_change":"2024-03-16T20:55:04.258871+0000","last_active":"2024-03-16T20:55:06.891040+0000","last_peered":"2024-03-16T20:55:06.891040+0000","last_clean":"2024-03-16T20:55:06.891040+0000","last_became_active":"2024-03-16T20:55:04.258462+0000","last_became_peered":"2024-03-16T20:55:04.258462+0000","last_unstale":"2024-03-16T20:55:06.891040+0000","last_undegraded":"2024-03-16T20:55:06.891040+0000","last_fullsized":"2024-03-16T20:55:06.891040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:16:29.832814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890701+0000","last_change":"2024-03-16T20:55:05.290789+0000","last_active":"2024-03-16T20:55:06.890701+0000","last_peered":"2024-03-16T20:55:06.890701+0000","last_clean":"2024-03-16T20:55:06.890701+0000","last_became_active":"2024-03-16T20:55:05.290367+0000","last_became_peered":"2024-03-16T20:55:05.290367+0000","last_unstale":"2024-03-16T20:55:06.890701+0000","last_undegraded":"2024-03-16T20:55:06.890701+0000","last_fullsized":"2024-03-16T20:55:06.890701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:23:38.509837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:09.359636+0000","last_change":"2024-03-16T20:55:04.264980+0000","last_active":"2024-03-16T20:55:09.359636+0000","last_peered":"2024-03-16T20:55:09.359636+0000","last_clean":"2024-03-16T20:55:09.359636+0000","last_became_active":"2024-03-16T20:55:04.264634+0000","last_became_peered":"2024-03-16T20:55:04.264634+0000","last_unstale":"2024-03-16T20:55:09.359636+0000","last_undegraded":"2024-03-16T20:55:09.359636+0000","last_fullsized":"2024-03-16T20:55:09.359636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:16:52.713847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891359+0000","last_change":"2024-03-16T20:55:05.286139+0000","last_active":"2024-03-16T20:55:06.891359+0000","last_peered":"2024-03-16T20:55:06.891359+0000","last_clean":"2024-03-16T20:55:06.891359+0000","last_became_active":"2024-03-16T20:55:05.285751+0000","last_became_peered":"2024-03-16T20:55:05.285751+0000","last_unstale":"2024-03-16T20:55:06.891359+0000","last_undegraded":"2024-03-16T20:55:06.891359+0000","last_fullsized":"2024-03-16T20:55:06.891359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:01:02.448785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:09.361390+0000","last_change":"2024-03-16T20:55:04.282416+0000","last_active":"2024-03-16T20:55:09.361390+0000","last_peered":"2024-03-16T20:55:09.361390+0000","last_clean":"2024-03-16T20:55:09.361390+0000","last_became_active":"2024-03-16T20:55:04.280504+0000","last_became_peered":"2024-03-16T20:55:04.280504+0000","last_unstale":"2024-03-16T20:55:09.361390+0000","last_undegraded":"2024-03-16T20:55:09.361390+0000","last_fullsized":"2024-03-16T20:55:09.361390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:23.940976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.894378+0000","last_change":"2024-03-16T20:55:05.289210+0000","last_active":"2024-03-16T20:55:06.894378+0000","last_peered":"2024-03-16T20:55:06.894378+0000","last_clean":"2024-03-16T20:55:06.894378+0000","last_became_active":"2024-03-16T20:55:05.286738+0000","last_became_peered":"2024-03-16T20:55:05.286738+0000","last_unstale":"2024-03-16T20:55:06.894378+0000","last_undegraded":"2024-03-16T20:55:06.894378+0000","last_fullsized":"2024-03-16T20:55:06.894378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:43:45.266727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891362+0000","last_change":"2024-03-16T20:55:04.258925+0000","last_active":"2024-03-16T20:55:06.891362+0000","last_peered":"2024-03-16T20:55:06.891362+0000","last_clean":"2024-03-16T20:55:06.891362+0000","last_became_active":"2024-03-16T20:55:04.258578+0000","last_became_peered":"2024-03-16T20:55:04.258578+0000","last_unstale":"2024-03-16T20:55:06.891362+0000","last_undegraded":"2024-03-16T20:55:06.891362+0000","last_fullsized":"2024-03-16T20:55:06.891362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:52.812547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892567+0000","last_change":"2024-03-16T20:55:05.302122+0000","last_active":"2024-03-16T20:55:06.892567+0000","last_peered":"2024-03-16T20:55:06.892567+0000","last_clean":"2024-03-16T20:55:06.892567+0000","last_became_active":"2024-03-16T20:55:05.301743+0000","last_became_peered":"2024-03-16T20:55:05.301743+0000","last_unstale":"2024-03-16T20:55:06.892567+0000","last_undegraded":"2024-03-16T20:55:06.892567+0000","last_fullsized":"2024-03-16T20:55:06.892567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:32:51.691780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.348476+0000","last_change":"2024-03-16T20:55:04.270015+0000","last_active":"2024-03-16T20:55:08.348476+0000","last_peered":"2024-03-16T20:55:08.348476+0000","last_clean":"2024-03-16T20:55:08.348476+0000","last_became_active":"2024-03-16T20:55:04.269563+0000","last_became_peered":"2024-03-16T20:55:04.269563+0000","last_unstale":"2024-03-16T20:55:08.348476+0000","last_undegraded":"2024-03-16T20:55:08.348476+0000","last_fullsized":"2024-03-16T20:55:08.348476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:39:21.768540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890349+0000","last_change":"2024-03-16T20:55:05.290639+0000","last_active":"2024-03-16T20:55:06.890349+0000","last_peered":"2024-03-16T20:55:06.890349+0000","last_clean":"2024-03-16T20:55:06.890349+0000","last_became_active":"2024-03-16T20:55:05.290255+0000","last_became_peered":"2024-03-16T20:55:05.290255+0000","last_unstale":"2024-03-16T20:55:06.890349+0000","last_undegraded":"2024-03-16T20:55:06.890349+0000","last_fullsized":"2024-03-16T20:55:06.890349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:36:13.303557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.343718+0000","last_change":"2024-03-16T20:55:04.260407+0000","last_active":"2024-03-16T20:55:08.343718+0000","last_peered":"2024-03-16T20:55:08.343718+0000","last_clean":"2024-03-16T20:55:08.343718+0000","last_became_active":"2024-03-16T20:55:04.259817+0000","last_became_peered":"2024-03-16T20:55:04.259817+0000","last_unstale":"2024-03-16T20:55:08.343718+0000","last_undegraded":"2024-03-16T20:55:08.343718+0000","last_fullsized":"2024-03-16T20:55:08.343718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:07.995508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.673693+0000","last_change":"2024-03-16T20:55:05.295327+0000","last_active":"2024-03-16T20:55:06.673693+0000","last_peered":"2024-03-16T20:55:06.673693+0000","last_clean":"2024-03-16T20:55:06.673693+0000","last_became_active":"2024-03-16T20:55:05.294948+0000","last_became_peered":"2024-03-16T20:55:05.294948+0000","last_unstale":"2024-03-16T20:55:06.673693+0000","last_undegraded":"2024-03-16T20:55:06.673693+0000","last_fullsized":"2024-03-16T20:55:06.673693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:29.305366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891524+0000","last_change":"2024-03-16T20:55:04.264571+0000","last_active":"2024-03-16T20:55:06.891524+0000","last_peered":"2024-03-16T20:55:06.891524+0000","last_clean":"2024-03-16T20:55:06.891524+0000","last_became_active":"2024-03-16T20:55:04.264200+0000","last_became_peered":"2024-03-16T20:55:04.264200+0000","last_unstale":"2024-03-16T20:55:06.891524+0000","last_undegraded":"2024-03-16T20:55:06.891524+0000","last_fullsized":"2024-03-16T20:55:06.891524+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:38:58.457250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890218+0000","last_change":"2024-03-16T20:55:05.272855+0000","last_active":"2024-03-16T20:55:06.890218+0000","last_peered":"2024-03-16T20:55:06.890218+0000","last_clean":"2024-03-16T20:55:06.890218+0000","last_became_active":"2024-03-16T20:55:05.272500+0000","last_became_peered":"2024-03-16T20:55:05.272500+0000","last_unstale":"2024-03-16T20:55:06.890218+0000","last_undegraded":"2024-03-16T20:55:06.890218+0000","last_fullsized":"2024-03-16T20:55:06.890218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:50:17.121966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.344164+0000","last_change":"2024-03-16T20:55:04.260050+0000","last_active":"2024-03-16T20:55:08.344164+0000","last_peered":"2024-03-16T20:55:08.344164+0000","last_clean":"2024-03-16T20:55:08.344164+0000","last_became_active":"2024-03-16T20:55:04.259662+0000","last_became_peered":"2024-03-16T20:55:04.259662+0000","last_unstale":"2024-03-16T20:55:08.344164+0000","last_undegraded":"2024-03-16T20:55:08.344164+0000","last_fullsized":"2024-03-16T20:55:08.344164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:45:46.999980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891715+0000","last_change":"2024-03-16T20:55:05.272337+0000","last_active":"2024-03-16T20:55:06.891715+0000","last_peered":"2024-03-16T20:55:06.891715+0000","last_clean":"2024-03-16T20:55:06.891715+0000","last_became_active":"2024-03-16T20:55:05.271761+0000","last_became_peered":"2024-03-16T20:55:05.271761+0000","last_unstale":"2024-03-16T20:55:06.891715+0000","last_undegraded":"2024-03-16T20:55:06.891715+0000","last_fullsized":"2024-03-16T20:55:06.891715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:50:22.079709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:09.356970+0000","last_change":"2024-03-16T20:55:04.275606+0000","last_active":"2024-03-16T20:55:09.356970+0000","last_peered":"2024-03-16T20:55:09.356970+0000","last_clean":"2024-03-16T20:55:09.356970+0000","last_became_active":"2024-03-16T20:55:04.275268+0000","last_became_peered":"2024-03-16T20:55:04.275268+0000","last_unstale":"2024-03-16T20:55:09.356970+0000","last_undegraded":"2024-03-16T20:55:09.356970+0000","last_fullsized":"2024-03-16T20:55:09.356970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:27:34.248831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251766+0000","last_change":"2024-03-16T20:55:05.290619+0000","last_active":"2024-03-16T20:55:06.251766+0000","last_peered":"2024-03-16T20:55:06.251766+0000","last_clean":"2024-03-16T20:55:06.251766+0000","last_became_active":"2024-03-16T20:55:05.289943+0000","last_became_peered":"2024-03-16T20:55:05.289943+0000","last_unstale":"2024-03-16T20:55:06.251766+0000","last_undegraded":"2024-03-16T20:55:06.251766+0000","last_fullsized":"2024-03-16T20:55:06.251766+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:30.569777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891199+0000","last_change":"2024-03-16T20:55:04.274206+0000","last_active":"2024-03-16T20:55:06.891199+0000","last_peered":"2024-03-16T20:55:06.891199+0000","last_clean":"2024-03-16T20:55:06.891199+0000","last_became_active":"2024-03-16T20:55:04.273834+0000","last_became_peered":"2024-03-16T20:55:04.273834+0000","last_unstale":"2024-03-16T20:55:06.891199+0000","last_undegraded":"2024-03-16T20:55:06.891199+0000","last_fullsized":"2024-03-16T20:55:06.891199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:36:04.720463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534987+0000","last_change":"2024-03-16T20:55:05.280265+0000","last_active":"2024-03-16T20:55:07.534987+0000","last_peered":"2024-03-16T20:55:07.534987+0000","last_clean":"2024-03-16T20:55:07.534987+0000","last_became_active":"2024-03-16T20:55:05.279774+0000","last_became_peered":"2024-03-16T20:55:05.279774+0000","last_unstale":"2024-03-16T20:55:07.534987+0000","last_undegraded":"2024-03-16T20:55:07.534987+0000","last_fullsized":"2024-03-16T20:55:07.534987+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:34:52.855290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251134+0000","last_change":"2024-03-16T20:55:04.256314+0000","last_active":"2024-03-16T20:55:06.251134+0000","last_peered":"2024-03-16T20:55:06.251134+0000","last_clean":"2024-03-16T20:55:06.251134+0000","last_became_active":"2024-03-16T20:55:04.255940+0000","last_became_peered":"2024-03-16T20:55:04.255940+0000","last_unstale":"2024-03-16T20:55:06.251134+0000","last_undegraded":"2024-03-16T20:55:06.251134+0000","last_fullsized":"2024-03-16T20:55:06.251134+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:27:09.660107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534698+0000","last_change":"2024-03-16T20:55:05.271562+0000","last_active":"2024-03-16T20:55:07.534698+0000","last_peered":"2024-03-16T20:55:07.534698+0000","last_clean":"2024-03-16T20:55:07.534698+0000","last_became_active":"2024-03-16T20:55:05.271214+0000","last_became_peered":"2024-03-16T20:55:05.271214+0000","last_unstale":"2024-03-16T20:55:07.534698+0000","last_undegraded":"2024-03-16T20:55:07.534698+0000","last_fullsized":"2024-03-16T20:55:07.534698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:42:35.104345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'10","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.343890+0000","last_change":"2024-03-16T20:55:04.269684+0000","last_active":"2024-03-16T20:55:08.343890+0000","last_peered":"2024-03-16T20:55:08.343890+0000","last_clean":"2024-03-16T20:55:08.343890+0000","last_became_active":"2024-03-16T20:55:04.269256+0000","last_became_peered":"2024-03-16T20:55:04.269256+0000","last_unstale":"2024-03-16T20:55:08.343890+0000","last_undegraded":"2024-03-16T20:55:08.343890+0000","last_fullsized":"2024-03-16T20:55:08.343890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:37:42.919889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890900+0000","last_change":"2024-03-16T20:55:05.269751+0000","last_active":"2024-03-16T20:55:06.890900+0000","last_peered":"2024-03-16T20:55:06.890900+0000","last_clean":"2024-03-16T20:55:06.890900+0000","last_became_active":"2024-03-16T20:55:05.269375+0000","last_became_peered":"2024-03-16T20:55:05.269375+0000","last_unstale":"2024-03-16T20:55:06.890900+0000","last_undegraded":"2024-03-16T20:55:06.890900+0000","last_fullsized":"2024-03-16T20:55:06.890900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:57:00.751155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891068+0000","last_change":"2024-03-16T20:55:04.254352+0000","last_active":"2024-03-16T20:55:06.891068+0000","last_peered":"2024-03-16T20:55:06.891068+0000","last_clean":"2024-03-16T20:55:06.891068+0000","last_became_active":"2024-03-16T20:55:04.253895+0000","last_became_peered":"2024-03-16T20:55:04.253895+0000","last_unstale":"2024-03-16T20:55:06.891068+0000","last_undegraded":"2024-03-16T20:55:06.891068+0000","last_fullsized":"2024-03-16T20:55:06.891068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:35:15.796341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892097+0000","last_change":"2024-03-16T20:55:05.271148+0000","last_active":"2024-03-16T20:55:06.892097+0000","last_peered":"2024-03-16T20:55:06.892097+0000","last_clean":"2024-03-16T20:55:06.892097+0000","last_became_active":"2024-03-16T20:55:05.270836+0000","last_became_peered":"2024-03-16T20:55:05.270836+0000","last_unstale":"2024-03-16T20:55:06.892097+0000","last_undegraded":"2024-03-16T20:55:06.892097+0000","last_fullsized":"2024-03-16T20:55:06.892097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:12:49.526828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892974+0000","last_change":"2024-03-16T20:55:04.277152+0000","last_active":"2024-03-16T20:55:06.892974+0000","last_peered":"2024-03-16T20:55:06.892974+0000","last_clean":"2024-03-16T20:55:06.892974+0000","last_became_active":"2024-03-16T20:55:04.276666+0000","last_became_peered":"2024-03-16T20:55:04.276666+0000","last_unstale":"2024-03-16T20:55:06.892974+0000","last_undegraded":"2024-03-16T20:55:06.892974+0000","last_fullsized":"2024-03-16T20:55:06.892974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:39:04.919957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.390114+0000","last_change":"2024-03-16T20:55:05.291187+0000","last_active":"2024-03-16T20:55:06.390114+0000","last_peered":"2024-03-16T20:55:06.390114+0000","last_clean":"2024-03-16T20:55:06.390114+0000","last_became_active":"2024-03-16T20:55:05.290835+0000","last_became_peered":"2024-03-16T20:55:05.290835+0000","last_unstale":"2024-03-16T20:55:06.390114+0000","last_undegraded":"2024-03-16T20:55:06.390114+0000","last_fullsized":"2024-03-16T20:55:06.390114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:25:14.404610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534834+0000","last_change":"2024-03-16T20:55:04.270960+0000","last_active":"2024-03-16T20:55:07.534834+0000","last_peered":"2024-03-16T20:55:07.534834+0000","last_clean":"2024-03-16T20:55:07.534834+0000","last_became_active":"2024-03-16T20:55:04.270605+0000","last_became_peered":"2024-03-16T20:55:04.270605+0000","last_unstale":"2024-03-16T20:55:07.534834+0000","last_undegraded":"2024-03-16T20:55:07.534834+0000","last_fullsized":"2024-03-16T20:55:07.534834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:06:53.529116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.390281+0000","last_change":"2024-03-16T20:55:05.303690+0000","last_active":"2024-03-16T20:55:06.390281+0000","last_peered":"2024-03-16T20:55:06.390281+0000","last_clean":"2024-03-16T20:55:06.390281+0000","last_became_active":"2024-03-16T20:55:05.303096+0000","last_became_peered":"2024-03-16T20:55:05.303096+0000","last_unstale":"2024-03-16T20:55:06.390281+0000","last_undegraded":"2024-03-16T20:55:06.390281+0000","last_fullsized":"2024-03-16T20:55:06.390281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:03:25.139693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891269+0000","last_change":"2024-03-16T20:55:05.268277+0000","last_active":"2024-03-16T20:55:06.891269+0000","last_peered":"2024-03-16T20:55:06.891269+0000","last_clean":"2024-03-16T20:55:06.891269+0000","last_became_active":"2024-03-16T20:55:05.267955+0000","last_became_peered":"2024-03-16T20:55:05.267955+0000","last_unstale":"2024-03-16T20:55:06.891269+0000","last_undegraded":"2024-03-16T20:55:06.891269+0000","last_fullsized":"2024-03-16T20:55:06.891269+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:20:21.633055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:11.366074+0000","last_change":"2024-03-16T20:55:04.277286+0000","last_active":"2024-03-16T20:55:11.366074+0000","last_peered":"2024-03-16T20:55:11.366074+0000","last_clean":"2024-03-16T20:55:11.366074+0000","last_became_active":"2024-03-16T20:55:04.276855+0000","last_became_peered":"2024-03-16T20:55:04.276855+0000","last_unstale":"2024-03-16T20:55:11.366074+0000","last_undegraded":"2024-03-16T20:55:11.366074+0000","last_fullsized":"2024-03-16T20:55:11.366074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:22:19.590782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.895277+0000","last_change":"2024-03-16T20:55:05.280255+0000","last_active":"2024-03-16T20:55:06.895277+0000","last_peered":"2024-03-16T20:55:06.895277+0000","last_clean":"2024-03-16T20:55:06.895277+0000","last_became_active":"2024-03-16T20:55:05.279762+0000","last_became_peered":"2024-03-16T20:55:05.279762+0000","last_unstale":"2024-03-16T20:55:06.895277+0000","last_undegraded":"2024-03-16T20:55:06.895277+0000","last_fullsized":"2024-03-16T20:55:06.895277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:31.687047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.344378+0000","last_change":"2024-03-16T20:55:04.263605+0000","last_active":"2024-03-16T20:55:08.344378+0000","last_peered":"2024-03-16T20:55:08.344378+0000","last_clean":"2024-03-16T20:55:08.344378+0000","last_became_active":"2024-03-16T20:55:04.263189+0000","last_became_peered":"2024-03-16T20:55:04.263189+0000","last_unstale":"2024-03-16T20:55:08.344378+0000","last_undegraded":"2024-03-16T20:55:08.344378+0000","last_fullsized":"2024-03-16T20:55:08.344378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:28:11.377134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":347,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534643+0000","last_change":"2024-03-16T20:53:44.281432+0000","last_active":"2024-03-16T20:55:07.534643+0000","last_peered":"2024-03-16T20:55:07.534643+0000","last_clean":"2024-03-16T20:55:07.534643+0000","last_became_active":"2024-03-16T20:53:44.280927+0000","last_became_peered":"2024-03-16T20:53:44.280927+0000","last_unstale":"2024-03-16T20:55:07.534643+0000","last_undegraded":"2024-03-16T20:55:07.534643+0000","last_fullsized":"2024-03-16T20:55:07.534643+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_clean_scrub_stamp":"2024-03-16T20:49:51.705234+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:01:00.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251400+0000","last_change":"2024-03-16T20:55:05.277432+0000","last_active":"2024-03-16T20:55:06.251400+0000","last_peered":"2024-03-16T20:55:06.251400+0000","last_clean":"2024-03-16T20:55:06.251400+0000","last_became_active":"2024-03-16T20:55:05.274798+0000","last_became_peered":"2024-03-16T20:55:05.274798+0000","last_unstale":"2024-03-16T20:55:06.251400+0000","last_undegraded":"2024-03-16T20:55:06.251400+0000","last_fullsized":"2024-03-16T20:55:06.251400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:24:51.315100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534824+0000","last_change":"2024-03-16T20:55:04.256842+0000","last_active":"2024-03-16T20:55:07.534824+0000","last_peered":"2024-03-16T20:55:07.534824+0000","last_clean":"2024-03-16T20:55:07.534824+0000","last_became_active":"2024-03-16T20:55:04.256493+0000","last_became_peered":"2024-03-16T20:55:04.256493+0000","last_unstale":"2024-03-16T20:55:07.534824+0000","last_undegraded":"2024-03-16T20:55:07.534824+0000","last_fullsized":"2024-03-16T20:55:07.534824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:08.836034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890961+0000","last_change":"2024-03-16T20:55:04.265503+0000","last_active":"2024-03-16T20:55:06.890961+0000","last_peered":"2024-03-16T20:55:06.890961+0000","last_clean":"2024-03-16T20:55:06.890961+0000","last_became_active":"2024-03-16T20:55:04.265017+0000","last_became_peered":"2024-03-16T20:55:04.265017+0000","last_unstale":"2024-03-16T20:55:06.890961+0000","last_undegraded":"2024-03-16T20:55:06.890961+0000","last_fullsized":"2024-03-16T20:55:06.890961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:28.485079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251850+0000","last_change":"2024-03-16T20:55:05.289100+0000","last_active":"2024-03-16T20:55:06.251850+0000","last_peered":"2024-03-16T20:55:06.251850+0000","last_clean":"2024-03-16T20:55:06.251850+0000","last_became_active":"2024-03-16T20:55:05.288122+0000","last_became_peered":"2024-03-16T20:55:05.288122+0000","last_unstale":"2024-03-16T20:55:06.251850+0000","last_undegraded":"2024-03-16T20:55:06.251850+0000","last_fullsized":"2024-03-16T20:55:06.251850+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:03.222038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.893439+0000","last_change":"2024-03-16T20:55:04.282230+0000","last_active":"2024-03-16T20:55:06.893439+0000","last_peered":"2024-03-16T20:55:06.893439+0000","last_clean":"2024-03-16T20:55:06.893439+0000","last_became_active":"2024-03-16T20:55:04.281917+0000","last_became_peered":"2024-03-16T20:55:04.281917+0000","last_unstale":"2024-03-16T20:55:06.893439+0000","last_undegraded":"2024-03-16T20:55:06.893439+0000","last_fullsized":"2024-03-16T20:55:06.893439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:18:36.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.895913+0000","last_change":"2024-03-16T20:55:05.293378+0000","last_active":"2024-03-16T20:55:06.895913+0000","last_peered":"2024-03-16T20:55:06.895913+0000","last_clean":"2024-03-16T20:55:06.895913+0000","last_became_active":"2024-03-16T20:55:05.288648+0000","last_became_peered":"2024-03-16T20:55:05.288648+0000","last_unstale":"2024-03-16T20:55:06.895913+0000","last_undegraded":"2024-03-16T20:55:06.895913+0000","last_fullsized":"2024-03-16T20:55:06.895913+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:37:58.270760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.343611+0000","last_change":"2024-03-16T20:55:04.268766+0000","last_active":"2024-03-16T20:55:08.343611+0000","last_peered":"2024-03-16T20:55:08.343611+0000","last_clean":"2024-03-16T20:55:08.343611+0000","last_became_active":"2024-03-16T20:55:04.268429+0000","last_became_peered":"2024-03-16T20:55:04.268429+0000","last_unstale":"2024-03-16T20:55:08.343611+0000","last_undegraded":"2024-03-16T20:55:08.343611+0000","last_fullsized":"2024-03-16T20:55:08.343611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:43.872155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.673603+0000","last_change":"2024-03-16T20:55:05.310349+0000","last_active":"2024-03-16T20:55:06.673603+0000","last_peered":"2024-03-16T20:55:06.673603+0000","last_clean":"2024-03-16T20:55:06.673603+0000","last_became_active":"2024-03-16T20:55:05.307987+0000","last_became_peered":"2024-03-16T20:55:05.307987+0000","last_unstale":"2024-03-16T20:55:06.673603+0000","last_undegraded":"2024-03-16T20:55:06.673603+0000","last_fullsized":"2024-03-16T20:55:06.673603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:19:38.142783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.343611+0000","last_change":"2024-03-16T20:55:04.269683+0000","last_active":"2024-03-16T20:55:08.343611+0000","last_peered":"2024-03-16T20:55:08.343611+0000","last_clean":"2024-03-16T20:55:08.343611+0000","last_became_active":"2024-03-16T20:55:04.269258+0000","last_became_peered":"2024-03-16T20:55:04.269258+0000","last_unstale":"2024-03-16T20:55:08.343611+0000","last_undegraded":"2024-03-16T20:55:08.343611+0000","last_fullsized":"2024-03-16T20:55:08.343611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:24:10.417179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890646+0000","last_change":"2024-03-16T20:55:05.272238+0000","last_active":"2024-03-16T20:55:06.890646+0000","last_peered":"2024-03-16T20:55:06.890646+0000","last_clean":"2024-03-16T20:55:06.890646+0000","last_became_active":"2024-03-16T20:55:05.270379+0000","last_became_peered":"2024-03-16T20:55:05.270379+0000","last_unstale":"2024-03-16T20:55:06.890646+0000","last_undegraded":"2024-03-16T20:55:06.890646+0000","last_fullsized":"2024-03-16T20:55:06.890646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:16:11.348601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.347496+0000","last_change":"2024-03-16T20:55:04.280008+0000","last_active":"2024-03-16T20:55:08.347496+0000","last_peered":"2024-03-16T20:55:08.347496+0000","last_clean":"2024-03-16T20:55:08.347496+0000","last_became_active":"2024-03-16T20:55:04.279683+0000","last_became_peered":"2024-03-16T20:55:04.279683+0000","last_unstale":"2024-03-16T20:55:08.347496+0000","last_undegraded":"2024-03-16T20:55:08.347496+0000","last_fullsized":"2024-03-16T20:55:08.347496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:15.734826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891807+0000","last_change":"2024-03-16T20:55:05.287219+0000","last_active":"2024-03-16T20:55:06.891807+0000","last_peered":"2024-03-16T20:55:06.891807+0000","last_clean":"2024-03-16T20:55:06.891807+0000","last_became_active":"2024-03-16T20:55:05.286899+0000","last_became_peered":"2024-03-16T20:55:05.286899+0000","last_unstale":"2024-03-16T20:55:06.891807+0000","last_undegraded":"2024-03-16T20:55:06.891807+0000","last_fullsized":"2024-03-16T20:55:06.891807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:33:01.483415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251774+0000","last_change":"2024-03-16T20:55:04.264489+0000","last_active":"2024-03-16T20:55:06.251774+0000","last_peered":"2024-03-16T20:55:06.251774+0000","last_clean":"2024-03-16T20:55:06.251774+0000","last_became_active":"2024-03-16T20:55:04.264101+0000","last_became_peered":"2024-03-16T20:55:04.264101+0000","last_unstale":"2024-03-16T20:55:06.251774+0000","last_undegraded":"2024-03-16T20:55:06.251774+0000","last_fullsized":"2024-03-16T20:55:06.251774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:40:48.755800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.894306+0000","last_change":"2024-03-16T20:55:05.311463+0000","last_active":"2024-03-16T20:55:06.894306+0000","last_peered":"2024-03-16T20:55:06.894306+0000","last_clean":"2024-03-16T20:55:06.894306+0000","last_became_active":"2024-03-16T20:55:05.310852+0000","last_became_peered":"2024-03-16T20:55:05.310852+0000","last_unstale":"2024-03-16T20:55:06.894306+0000","last_undegraded":"2024-03-16T20:55:06.894306+0000","last_fullsized":"2024-03-16T20:55:06.894306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:51:52.980193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.344391+0000","last_change":"2024-03-16T20:55:04.260372+0000","last_active":"2024-03-16T20:55:08.344391+0000","last_peered":"2024-03-16T20:55:08.344391+0000","last_clean":"2024-03-16T20:55:08.344391+0000","last_became_active":"2024-03-16T20:55:04.259273+0000","last_became_peered":"2024-03-16T20:55:04.259273+0000","last_unstale":"2024-03-16T20:55:08.344391+0000","last_undegraded":"2024-03-16T20:55:08.344391+0000","last_fullsized":"2024-03-16T20:55:08.344391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:21:25.212520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.535071+0000","last_change":"2024-03-16T20:55:05.280088+0000","last_active":"2024-03-16T20:55:07.535071+0000","last_peered":"2024-03-16T20:55:07.535071+0000","last_clean":"2024-03-16T20:55:07.535071+0000","last_became_active":"2024-03-16T20:55:05.279745+0000","last_became_peered":"2024-03-16T20:55:05.279745+0000","last_unstale":"2024-03-16T20:55:07.535071+0000","last_undegraded":"2024-03-16T20:55:07.535071+0000","last_fullsized":"2024-03-16T20:55:07.535071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:02:08.797287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:09.357103+0000","last_change":"2024-03-16T20:55:04.275221+0000","last_active":"2024-03-16T20:55:09.357103+0000","last_peered":"2024-03-16T20:55:09.357103+0000","last_clean":"2024-03-16T20:55:09.357103+0000","last_became_active":"2024-03-16T20:55:04.274887+0000","last_became_peered":"2024-03-16T20:55:04.274887+0000","last_unstale":"2024-03-16T20:55:09.357103+0000","last_undegraded":"2024-03-16T20:55:09.357103+0000","last_fullsized":"2024-03-16T20:55:09.357103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:35.333864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.535113+0000","last_change":"2024-03-16T20:55:05.272444+0000","last_active":"2024-03-16T20:55:07.535113+0000","last_peered":"2024-03-16T20:55:07.535113+0000","last_clean":"2024-03-16T20:55:07.535113+0000","last_became_active":"2024-03-16T20:55:05.272104+0000","last_became_peered":"2024-03-16T20:55:05.272104+0000","last_unstale":"2024-03-16T20:55:07.535113+0000","last_undegraded":"2024-03-16T20:55:07.535113+0000","last_fullsized":"2024-03-16T20:55:07.535113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:35.480408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891166+0000","last_change":"2024-03-16T20:55:04.274212+0000","last_active":"2024-03-16T20:55:06.891166+0000","last_peered":"2024-03-16T20:55:06.891166+0000","last_clean":"2024-03-16T20:55:06.891166+0000","last_became_active":"2024-03-16T20:55:04.273785+0000","last_became_peered":"2024-03-16T20:55:04.273785+0000","last_unstale":"2024-03-16T20:55:06.891166+0000","last_undegraded":"2024-03-16T20:55:06.891166+0000","last_fullsized":"2024-03-16T20:55:06.891166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:29:00.924789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.535047+0000","last_change":"2024-03-16T20:55:05.278590+0000","last_active":"2024-03-16T20:55:07.535047+0000","last_peered":"2024-03-16T20:55:07.535047+0000","last_clean":"2024-03-16T20:55:07.535047+0000","last_became_active":"2024-03-16T20:55:05.278183+0000","last_became_peered":"2024-03-16T20:55:05.278183+0000","last_unstale":"2024-03-16T20:55:07.535047+0000","last_undegraded":"2024-03-16T20:55:07.535047+0000","last_fullsized":"2024-03-16T20:55:07.535047+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:52:18.918653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251905+0000","last_change":"2024-03-16T20:55:04.279568+0000","last_active":"2024-03-16T20:55:06.251905+0000","last_peered":"2024-03-16T20:55:06.251905+0000","last_clean":"2024-03-16T20:55:06.251905+0000","last_became_active":"2024-03-16T20:55:04.278125+0000","last_became_peered":"2024-03-16T20:55:04.278125+0000","last_unstale":"2024-03-16T20:55:06.251905+0000","last_undegraded":"2024-03-16T20:55:06.251905+0000","last_fullsized":"2024-03-16T20:55:06.251905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:13:20.417216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.535059+0000","last_change":"2024-03-16T20:55:05.269732+0000","last_active":"2024-03-16T20:55:07.535059+0000","last_peered":"2024-03-16T20:55:07.535059+0000","last_clean":"2024-03-16T20:55:07.535059+0000","last_became_active":"2024-03-16T20:55:05.269260+0000","last_became_peered":"2024-03-16T20:55:05.269260+0000","last_unstale":"2024-03-16T20:55:07.535059+0000","last_undegraded":"2024-03-16T20:55:07.535059+0000","last_fullsized":"2024-03-16T20:55:07.535059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:10:03.312009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892046+0000","last_change":"2024-03-16T20:55:05.272321+0000","last_active":"2024-03-16T20:55:06.892046+0000","last_peered":"2024-03-16T20:55:06.892046+0000","last_clean":"2024-03-16T20:55:06.892046+0000","last_became_active":"2024-03-16T20:55:05.272000+0000","last_became_peered":"2024-03-16T20:55:05.272000+0000","last_unstale":"2024-03-16T20:55:06.892046+0000","last_undegraded":"2024-03-16T20:55:06.892046+0000","last_fullsized":"2024-03-16T20:55:06.892046+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:04:44.773709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251958+0000","last_change":"2024-03-16T20:55:05.277283+0000","last_active":"2024-03-16T20:55:06.251958+0000","last_peered":"2024-03-16T20:55:06.251958+0000","last_clean":"2024-03-16T20:55:06.251958+0000","last_became_active":"2024-03-16T20:55:05.276878+0000","last_became_peered":"2024-03-16T20:55:05.276878+0000","last_unstale":"2024-03-16T20:55:06.251958+0000","last_undegraded":"2024-03-16T20:55:06.251958+0000","last_fullsized":"2024-03-16T20:55:06.251958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:35:25.064399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251770+0000","last_change":"2024-03-16T20:55:05.287329+0000","last_active":"2024-03-16T20:55:06.251770+0000","last_peered":"2024-03-16T20:55:06.251770+0000","last_clean":"2024-03-16T20:55:06.251770+0000","last_became_active":"2024-03-16T20:55:05.286893+0000","last_became_peered":"2024-03-16T20:55:05.286893+0000","last_unstale":"2024-03-16T20:55:06.251770+0000","last_undegraded":"2024-03-16T20:55:06.251770+0000","last_fullsized":"2024-03-16T20:55:06.251770+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:43:29.560525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.672904+0000","last_change":"2024-03-16T20:55:05.307115+0000","last_active":"2024-03-16T20:55:06.672904+0000","last_peered":"2024-03-16T20:55:06.672904+0000","last_clean":"2024-03-16T20:55:06.672904+0000","last_became_active":"2024-03-16T20:55:05.306719+0000","last_became_peered":"2024-03-16T20:55:05.306719+0000","last_unstale":"2024-03-16T20:55:06.672904+0000","last_undegraded":"2024-03-16T20:55:06.672904+0000","last_fullsized":"2024-03-16T20:55:06.672904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:46:48.568626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.252002+0000","last_change":"2024-03-16T20:55:05.300207+0000","last_active":"2024-03-16T20:55:06.252002+0000","last_peered":"2024-03-16T20:55:06.252002+0000","last_clean":"2024-03-16T20:55:06.252002+0000","last_became_active":"2024-03-16T20:55:05.298892+0000","last_became_peered":"2024-03-16T20:55:05.298892+0000","last_unstale":"2024-03-16T20:55:06.252002+0000","last_undegraded":"2024-03-16T20:55:06.252002+0000","last_fullsized":"2024-03-16T20:55:06.252002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:29.158690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892125+0000","last_change":"2024-03-16T20:55:05.272135+0000","last_active":"2024-03-16T20:55:06.892125+0000","last_peered":"2024-03-16T20:55:06.892125+0000","last_clean":"2024-03-16T20:55:06.892125+0000","last_became_active":"2024-03-16T20:55:05.271779+0000","last_became_peered":"2024-03-16T20:55:05.271779+0000","last_unstale":"2024-03-16T20:55:06.892125+0000","last_undegraded":"2024-03-16T20:55:06.892125+0000","last_fullsized":"2024-03-16T20:55:06.892125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:42:58.085726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.252256+0000","last_change":"2024-03-16T20:55:05.268810+0000","last_active":"2024-03-16T20:55:06.252256+0000","last_peered":"2024-03-16T20:55:06.252256+0000","last_clean":"2024-03-16T20:55:06.252256+0000","last_became_active":"2024-03-16T20:55:05.268473+0000","last_became_peered":"2024-03-16T20:55:05.268473+0000","last_unstale":"2024-03-16T20:55:06.252256+0000","last_undegraded":"2024-03-16T20:55:06.252256+0000","last_fullsized":"2024-03-16T20:55:06.252256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:48:00.990207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.895570+0000","last_change":"2024-03-16T20:55:05.284121+0000","last_active":"2024-03-16T20:55:06.895570+0000","last_peered":"2024-03-16T20:55:06.895570+0000","last_clean":"2024-03-16T20:55:06.895570+0000","last_became_active":"2024-03-16T20:55:05.283588+0000","last_became_peered":"2024-03-16T20:55:05.283588+0000","last_unstale":"2024-03-16T20:55:06.895570+0000","last_undegraded":"2024-03-16T20:55:06.895570+0000","last_fullsized":"2024-03-16T20:55:06.895570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:05:56.679346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890682+0000","last_change":"2024-03-16T20:55:05.285912+0000","last_active":"2024-03-16T20:55:06.890682+0000","last_peered":"2024-03-16T20:55:06.890682+0000","last_clean":"2024-03-16T20:55:06.890682+0000","last_became_active":"2024-03-16T20:55:05.285523+0000","last_became_peered":"2024-03-16T20:55:05.285523+0000","last_unstale":"2024-03-16T20:55:06.890682+0000","last_undegraded":"2024-03-16T20:55:06.890682+0000","last_fullsized":"2024-03-16T20:55:06.890682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:57:35.147086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.894259+0000","last_change":"2024-03-16T20:55:05.277957+0000","last_active":"2024-03-16T20:55:06.894259+0000","last_peered":"2024-03-16T20:55:06.894259+0000","last_clean":"2024-03-16T20:55:06.894259+0000","last_became_active":"2024-03-16T20:55:05.277610+0000","last_became_peered":"2024-03-16T20:55:05.277610+0000","last_unstale":"2024-03-16T20:55:06.894259+0000","last_undegraded":"2024-03-16T20:55:06.894259+0000","last_fullsized":"2024-03-16T20:55:06.894259+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:54:29.010945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890199+0000","last_change":"2024-03-16T20:55:05.288112+0000","last_active":"2024-03-16T20:55:06.890199+0000","last_peered":"2024-03-16T20:55:06.890199+0000","last_clean":"2024-03-16T20:55:06.890199+0000","last_became_active":"2024-03-16T20:55:05.287791+0000","last_became_peered":"2024-03-16T20:55:05.287791+0000","last_unstale":"2024-03-16T20:55:06.890199+0000","last_undegraded":"2024-03-16T20:55:06.890199+0000","last_fullsized":"2024-03-16T20:55:06.890199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:55:57.625981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.252100+0000","last_change":"2024-03-16T20:55:05.311327+0000","last_active":"2024-03-16T20:55:06.252100+0000","last_peered":"2024-03-16T20:55:06.252100+0000","last_clean":"2024-03-16T20:55:06.252100+0000","last_became_active":"2024-03-16T20:55:05.310820+0000","last_became_peered":"2024-03-16T20:55:05.310820+0000","last_unstale":"2024-03-16T20:55:06.252100+0000","last_undegraded":"2024-03-16T20:55:06.252100+0000","last_fullsized":"2024-03-16T20:55:06.252100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:38:26.081078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891875+0000","last_change":"2024-03-16T20:55:05.277942+0000","last_active":"2024-03-16T20:55:06.891875+0000","last_peered":"2024-03-16T20:55:06.891875+0000","last_clean":"2024-03-16T20:55:06.891875+0000","last_became_active":"2024-03-16T20:55:05.277588+0000","last_became_peered":"2024-03-16T20:55:05.277588+0000","last_unstale":"2024-03-16T20:55:06.891875+0000","last_undegraded":"2024-03-16T20:55:06.891875+0000","last_fullsized":"2024-03-16T20:55:06.891875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:32:38.464939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":211842,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3284,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":96,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":32299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350990,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":442154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":1035130,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776152,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":937984,"data_stored":442356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037792,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":929792,"data_stored":442176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299429,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":983040,"data_stored":1033144,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462954,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":441779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":937984,"data_stored":449784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":443050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":958464,"data_stored":444534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149755,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":441973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888118,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":441594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724592,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1032122,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T20:55:14.457 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T20:55:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:14 smithi186 ceph-mon[36391]: from='client.24703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:14 smithi186 ceph-mon[36391]: pgmap v321: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 3.1 KiB/s wr, 12 op/s 2024-03-16T20:55:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:14 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1062666619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:55:14.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:14 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1327084629' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.714+0000 7fbd3da00640 1 -- 172.21.15.8:0/3440495386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd38109200 msgr2=0x7fbd3810b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.714+0000 7fbd3da00640 1 --2- 172.21.15.8:0/3440495386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd38109200 0x7fbd3810b690 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009ca0 tx=0x7fbd3002c0f0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.714+0000 7fbd3da00640 1 -- 172.21.15.8:0/3440495386 shutdown_connections 2024-03-16T20:55:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.714+0000 7fbd3da00640 1 --2- 172.21.15.8:0/3440495386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd38109200 0x7fbd3810b690 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.714+0000 7fbd3da00640 1 --2- 172.21.15.8:0/3440495386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38073f50 0x7fbd380743d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.714+0000 7fbd3da00640 1 --2- 172.21.15.8:0/3440495386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38075530 0x7fbd38073980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.714+0000 7fbd3da00640 1 -- 172.21.15.8:0/3440495386 >> 172.21.15.8:0/3440495386 conn(0x7fbd380fc8d0 msgr2=0x7fbd380fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.714+0000 7fbd3da00640 1 -- 172.21.15.8:0/3440495386 shutdown_connections 2024-03-16T20:55:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.714+0000 7fbd3da00640 1 -- 172.21.15.8:0/3440495386 wait complete. 2024-03-16T20:55:14.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.715+0000 7fbd3da00640 1 Processor -- start 2024-03-16T20:55:14.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.715+0000 7fbd3da00640 1 -- start start 2024-03-16T20:55:14.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.715+0000 7fbd3da00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd38073f50 0x7fbd38199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:14.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.715+0000 7fbd3da00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38075530 0x7fbd38199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:14.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.715+0000 7fbd3da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38109200 0x7fbd381a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:14.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.715+0000 7fbd3da00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd381a1120 con 0x7fbd38075530 2024-03-16T20:55:14.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.715+0000 7fbd3da00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd381a1290 con 0x7fbd38109200 2024-03-16T20:55:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.715+0000 7fbd3da00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd381a1450 con 0x7fbd38073f50 2024-03-16T20:55:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd3d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38109200 0x7fbd381a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd2fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38075530 0x7fbd38199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd37e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd38073f50 0x7fbd38199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd3d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38109200 0x7fbd381a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37688/0 (socket says 172.21.15.8:37688) 2024-03-16T20:55:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd37e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd38073f50 0x7fbd38199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58990/0 (socket says 172.21.15.8:58990) 2024-03-16T20:55:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd3d000640 1 -- 172.21.15.8:0/1249387403 learned_addr learned my addr 172.21.15.8:0/1249387403 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd2fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38075530 0x7fbd38199b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59628/0 (socket says 172.21.15.8:59628) 2024-03-16T20:55:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd2fe00640 1 -- 172.21.15.8:0/1249387403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd38073f50 msgr2=0x7fbd38199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd2fe00640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd38073f50 0x7fbd38199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd2fe00640 1 -- 172.21.15.8:0/1249387403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38109200 msgr2=0x7fbd381a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd2fe00640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38109200 0x7fbd381a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd2fe00640 1 -- 172.21.15.8:0/1249387403 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30009900 con 0x7fbd38075530 2024-03-16T20:55:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd3d000640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38109200 0x7fbd381a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.716+0000 7fbd2fe00640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38075530 0x7fbd38199b70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000e9f0 tx=0x7fbd2000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.717+0000 7fbd35600640 1 -- 172.21.15.8:0/1249387403 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000ccc0 con 0x7fbd38075530 2024-03-16T20:55:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.717+0000 7fbd3da00640 1 -- 172.21.15.8:0/1249387403 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd381a1730 con 0x7fbd38075530 2024-03-16T20:55:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.717+0000 7fbd35600640 1 -- 172.21.15.8:0/1249387403 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbd2000ce20 con 0x7fbd38075530 2024-03-16T20:55:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.717+0000 7fbd35600640 1 -- 172.21.15.8:0/1249387403 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200189c0 con 0x7fbd38075530 2024-03-16T20:55:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.717+0000 7fbd3da00640 1 -- 172.21.15.8:0/1249387403 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd381a1c90 con 0x7fbd38075530 2024-03-16T20:55:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.718+0000 7fbd3da00640 1 -- 172.21.15.8:0/1249387403 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd38107f30 con 0x7fbd38075530 2024-03-16T20:55:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.720+0000 7fbd35600640 1 -- 172.21.15.8:0/1249387403 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fbd20018b20 con 0x7fbd38075530 2024-03-16T20:55:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.721+0000 7fbd35600640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd1c0a1ac0 0x7fbd1c0a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.722+0000 7fbd35600640 1 -- 172.21.15.8:0/1249387403 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbd20014070 con 0x7fbd38075530 2024-03-16T20:55:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.722+0000 7fbd37e00640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd1c0a1ac0 0x7fbd1c0a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.722+0000 7fbd37e00640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd1c0a1ac0 0x7fbd1c0a3f80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009bd0 tx=0x7fbd28005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.726+0000 7fbd35600640 1 -- 172.21.15.8:0/1249387403 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fbd20053280 con 0x7fbd38075530 2024-03-16T20:55:14.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:14 smithi008 ceph-mon[31434]: from='client.24703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:14.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:14 smithi008 ceph-mon[31434]: pgmap v321: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 3.1 KiB/s wr, 12 op/s 2024-03-16T20:55:14.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:14 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1062666619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:55:14.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:14 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1327084629' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:14 smithi170 ceph-mon[35947]: from='client.24703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:55:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:14 smithi170 ceph-mon[35947]: pgmap v321: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 3.1 KiB/s wr, 12 op/s 2024-03-16T20:55:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:14 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1062666619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:55:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:14 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1327084629' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:14.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.925+0000 7fbd3da00640 1 -- 172.21.15.8:0/1249387403 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd3802cfd0 con 0x7fbd1c0a1ac0 2024-03-16T20:55:14.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.949+0000 7fbd35600640 1 -- 172.21.15.8:0/1249387403 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258865 (secure 0 0 0) 0x7fbd3802cfd0 con 0x7fbd1c0a1ac0 2024-03-16T20:55:14.957 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:14.958 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-16T20:55:14.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.955+0000 7fbd3da00640 1 -- 172.21.15.8:0/1249387403 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd1c0a1ac0 msgr2=0x7fbd1c0a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:14.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.955+0000 7fbd3da00640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd1c0a1ac0 0x7fbd1c0a3f80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009bd0 tx=0x7fbd28005f90 comp rx=0 tx=0).stop 2024-03-16T20:55:14.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.955+0000 7fbd3da00640 1 -- 172.21.15.8:0/1249387403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38075530 msgr2=0x7fbd38199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:14.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.955+0000 7fbd3da00640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38075530 0x7fbd38199b70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000e9f0 tx=0x7fbd2000eeb0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.955+0000 7fbd3da00640 1 -- 172.21.15.8:0/1249387403 shutdown_connections 2024-03-16T20:55:14.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.955+0000 7fbd3da00640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fbd1c0a1ac0 0x7fbd1c0a3f80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.955+0000 7fbd3da00640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38109200 0x7fbd381a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.955+0000 7fbd3da00640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38075530 0x7fbd38199b70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.955+0000 7fbd3da00640 1 --2- 172.21.15.8:0/1249387403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd38073f50 0x7fbd38199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:14.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.955+0000 7fbd3da00640 1 -- 172.21.15.8:0/1249387403 >> 172.21.15.8:0/1249387403 conn(0x7fbd380fc8d0 msgr2=0x7fbd38105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:14.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.956+0000 7fbd3da00640 1 -- 172.21.15.8:0/1249387403 shutdown_connections 2024-03-16T20:55:14.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:14.956+0000 7fbd3da00640 1 -- 172.21.15.8:0/1249387403 wait complete. 2024-03-16T20:55:14.982 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-03-16T20:55:13.081632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593652,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":139,"num_read_kb":122,"num_write":277,"num_write_kb":2963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":245,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364492,"kb_used_data":11152,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577332,"statfs":{"total":1151940427776,"available":1151567187968,"internally_reserved":0,"allocated":11419648,"data_stored":7089796,"data_compressed":107565,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3284,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":96,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003511"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892208+0000","last_change":"2024-03-16T20:55:05.301473+0000","last_active":"2024-03-16T20:55:06.892208+0000","last_peered":"2024-03-16T20:55:06.892208+0000","last_clean":"2024-03-16T20:55:06.892208+0000","last_became_active":"2024-03-16T20:55:05.301166+0000","last_became_peered":"2024-03-16T20:55:05.301166+0000","last_unstale":"2024-03-16T20:55:06.892208+0000","last_undegraded":"2024-03-16T20:55:06.892208+0000","last_fullsized":"2024-03-16T20:55:06.892208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:06:51.838382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.673516+0000","last_change":"2024-03-16T20:55:05.295895+0000","last_active":"2024-03-16T20:55:06.673516+0000","last_peered":"2024-03-16T20:55:06.673516+0000","last_clean":"2024-03-16T20:55:06.673516+0000","last_became_active":"2024-03-16T20:55:05.295365+0000","last_became_peered":"2024-03-16T20:55:05.295365+0000","last_unstale":"2024-03-16T20:55:06.673516+0000","last_undegraded":"2024-03-16T20:55:06.673516+0000","last_fullsized":"2024-03-16T20:55:06.673516+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:28:20.342348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.673174+0000","last_change":"2024-03-16T20:55:05.299049+0000","last_active":"2024-03-16T20:55:06.673174+0000","last_peered":"2024-03-16T20:55:06.673174+0000","last_clean":"2024-03-16T20:55:06.673174+0000","last_became_active":"2024-03-16T20:55:05.292758+0000","last_became_peered":"2024-03-16T20:55:05.292758+0000","last_unstale":"2024-03-16T20:55:06.673174+0000","last_undegraded":"2024-03-16T20:55:06.673174+0000","last_fullsized":"2024-03-16T20:55:06.673174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:20:36.276639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251645+0000","last_change":"2024-03-16T20:55:05.274453+0000","last_active":"2024-03-16T20:55:06.251645+0000","last_peered":"2024-03-16T20:55:06.251645+0000","last_clean":"2024-03-16T20:55:06.251645+0000","last_became_active":"2024-03-16T20:55:05.273648+0000","last_became_peered":"2024-03-16T20:55:05.273648+0000","last_unstale":"2024-03-16T20:55:06.251645+0000","last_undegraded":"2024-03-16T20:55:06.251645+0000","last_fullsized":"2024-03-16T20:55:06.251645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:08:37.297906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891049+0000","last_change":"2024-03-16T20:55:05.291272+0000","last_active":"2024-03-16T20:55:06.891049+0000","last_peered":"2024-03-16T20:55:06.891049+0000","last_clean":"2024-03-16T20:55:06.891049+0000","last_became_active":"2024-03-16T20:55:05.290788+0000","last_became_peered":"2024-03-16T20:55:05.290788+0000","last_unstale":"2024-03-16T20:55:06.891049+0000","last_undegraded":"2024-03-16T20:55:06.891049+0000","last_fullsized":"2024-03-16T20:55:06.891049+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:36:42.842797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.390070+0000","last_change":"2024-03-16T20:55:05.289977+0000","last_active":"2024-03-16T20:55:06.390070+0000","last_peered":"2024-03-16T20:55:06.390070+0000","last_clean":"2024-03-16T20:55:06.390070+0000","last_became_active":"2024-03-16T20:55:05.289520+0000","last_became_peered":"2024-03-16T20:55:05.289520+0000","last_unstale":"2024-03-16T20:55:06.390070+0000","last_undegraded":"2024-03-16T20:55:06.390070+0000","last_fullsized":"2024-03-16T20:55:06.390070+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:25:49.270854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534927+0000","last_change":"2024-03-16T20:55:05.286244+0000","last_active":"2024-03-16T20:55:07.534927+0000","last_peered":"2024-03-16T20:55:07.534927+0000","last_clean":"2024-03-16T20:55:07.534927+0000","last_became_active":"2024-03-16T20:55:05.285871+0000","last_became_peered":"2024-03-16T20:55:05.285871+0000","last_unstale":"2024-03-16T20:55:07.534927+0000","last_undegraded":"2024-03-16T20:55:07.534927+0000","last_fullsized":"2024-03-16T20:55:07.534927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:24:47.334046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.893514+0000","last_change":"2024-03-16T20:55:05.293902+0000","last_active":"2024-03-16T20:55:06.893514+0000","last_peered":"2024-03-16T20:55:06.893514+0000","last_clean":"2024-03-16T20:55:06.893514+0000","last_became_active":"2024-03-16T20:55:05.284424+0000","last_became_peered":"2024-03-16T20:55:05.284424+0000","last_unstale":"2024-03-16T20:55:06.893514+0000","last_undegraded":"2024-03-16T20:55:06.893514+0000","last_fullsized":"2024-03-16T20:55:06.893514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:09:15.024337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890451+0000","last_change":"2024-03-16T20:55:05.271434+0000","last_active":"2024-03-16T20:55:06.890451+0000","last_peered":"2024-03-16T20:55:06.890451+0000","last_clean":"2024-03-16T20:55:06.890451+0000","last_became_active":"2024-03-16T20:55:05.271014+0000","last_became_peered":"2024-03-16T20:55:05.271014+0000","last_unstale":"2024-03-16T20:55:06.890451+0000","last_undegraded":"2024-03-16T20:55:06.890451+0000","last_fullsized":"2024-03-16T20:55:06.890451+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:09:47.133987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.390299+0000","last_change":"2024-03-16T20:55:05.275108+0000","last_active":"2024-03-16T20:55:06.390299+0000","last_peered":"2024-03-16T20:55:06.390299+0000","last_clean":"2024-03-16T20:55:06.390299+0000","last_became_active":"2024-03-16T20:55:05.274659+0000","last_became_peered":"2024-03-16T20:55:05.274659+0000","last_unstale":"2024-03-16T20:55:06.390299+0000","last_undegraded":"2024-03-16T20:55:06.390299+0000","last_fullsized":"2024-03-16T20:55:06.390299+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:10:16.801309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534950+0000","last_change":"2024-03-16T20:55:05.273322+0000","last_active":"2024-03-16T20:55:07.534950+0000","last_peered":"2024-03-16T20:55:07.534950+0000","last_clean":"2024-03-16T20:55:07.534950+0000","last_became_active":"2024-03-16T20:55:05.272999+0000","last_became_peered":"2024-03-16T20:55:05.272999+0000","last_unstale":"2024-03-16T20:55:07.534950+0000","last_undegraded":"2024-03-16T20:55:07.534950+0000","last_fullsized":"2024-03-16T20:55:07.534950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:49:43.426765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251602+0000","last_change":"2024-03-16T20:55:05.274729+0000","last_active":"2024-03-16T20:55:06.251602+0000","last_peered":"2024-03-16T20:55:06.251602+0000","last_clean":"2024-03-16T20:55:06.251602+0000","last_became_active":"2024-03-16T20:55:05.274131+0000","last_became_peered":"2024-03-16T20:55:05.274131+0000","last_unstale":"2024-03-16T20:55:06.251602+0000","last_undegraded":"2024-03-16T20:55:06.251602+0000","last_fullsized":"2024-03-16T20:55:06.251602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:59:43.413956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.252228+0000","last_change":"2024-03-16T20:55:05.272792+0000","last_active":"2024-03-16T20:55:06.252228+0000","last_peered":"2024-03-16T20:55:06.252228+0000","last_clean":"2024-03-16T20:55:06.252228+0000","last_became_active":"2024-03-16T20:55:05.272048+0000","last_became_peered":"2024-03-16T20:55:05.272048+0000","last_unstale":"2024-03-16T20:55:06.252228+0000","last_undegraded":"2024-03-16T20:55:06.252228+0000","last_fullsized":"2024-03-16T20:55:06.252228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:55:17.608196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.672381+0000","last_change":"2024-03-16T20:55:05.282707+0000","last_active":"2024-03-16T20:55:06.672381+0000","last_peered":"2024-03-16T20:55:06.672381+0000","last_clean":"2024-03-16T20:55:06.672381+0000","last_became_active":"2024-03-16T20:55:05.282168+0000","last_became_peered":"2024-03-16T20:55:05.282168+0000","last_unstale":"2024-03-16T20:55:06.672381+0000","last_undegraded":"2024-03-16T20:55:06.672381+0000","last_fullsized":"2024-03-16T20:55:06.672381+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:33:59.464303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.672403+0000","last_change":"2024-03-16T20:55:05.290291+0000","last_active":"2024-03-16T20:55:06.672403+0000","last_peered":"2024-03-16T20:55:06.672403+0000","last_clean":"2024-03-16T20:55:06.672403+0000","last_became_active":"2024-03-16T20:55:05.289952+0000","last_became_peered":"2024-03-16T20:55:05.289952+0000","last_unstale":"2024-03-16T20:55:06.672403+0000","last_undegraded":"2024-03-16T20:55:06.672403+0000","last_fullsized":"2024-03-16T20:55:06.672403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:05.334408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890001+0000","last_change":"2024-03-16T20:55:05.284252+0000","last_active":"2024-03-16T20:55:06.890001+0000","last_peered":"2024-03-16T20:55:06.890001+0000","last_clean":"2024-03-16T20:55:06.890001+0000","last_became_active":"2024-03-16T20:55:05.283804+0000","last_became_peered":"2024-03-16T20:55:05.283804+0000","last_unstale":"2024-03-16T20:55:06.890001+0000","last_undegraded":"2024-03-16T20:55:06.890001+0000","last_fullsized":"2024-03-16T20:55:06.890001+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:03:17.942719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892291+0000","last_change":"2024-03-16T20:55:05.296118+0000","last_active":"2024-03-16T20:55:06.892291+0000","last_peered":"2024-03-16T20:55:06.892291+0000","last_clean":"2024-03-16T20:55:06.892291+0000","last_became_active":"2024-03-16T20:55:05.295783+0000","last_became_peered":"2024-03-16T20:55:05.295783+0000","last_unstale":"2024-03-16T20:55:06.892291+0000","last_undegraded":"2024-03-16T20:55:06.892291+0000","last_fullsized":"2024-03-16T20:55:06.892291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:36:15.463748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.893553+0000","last_change":"2024-03-16T20:55:05.287221+0000","last_active":"2024-03-16T20:55:06.893553+0000","last_peered":"2024-03-16T20:55:06.893553+0000","last_clean":"2024-03-16T20:55:06.893553+0000","last_became_active":"2024-03-16T20:55:05.286553+0000","last_became_peered":"2024-03-16T20:55:05.286553+0000","last_unstale":"2024-03-16T20:55:06.893553+0000","last_undegraded":"2024-03-16T20:55:06.893553+0000","last_fullsized":"2024-03-16T20:55:06.893553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:33:25.688231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.252126+0000","last_change":"2024-03-16T20:55:05.280111+0000","last_active":"2024-03-16T20:55:06.252126+0000","last_peered":"2024-03-16T20:55:06.252126+0000","last_clean":"2024-03-16T20:55:06.252126+0000","last_became_active":"2024-03-16T20:55:05.279857+0000","last_became_peered":"2024-03-16T20:55:05.279857+0000","last_unstale":"2024-03-16T20:55:06.252126+0000","last_undegraded":"2024-03-16T20:55:06.252126+0000","last_fullsized":"2024-03-16T20:55:06.252126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:57:18.205253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.893365+0000","last_change":"2024-03-16T20:55:04.268836+0000","last_active":"2024-03-16T20:55:06.893365+0000","last_peered":"2024-03-16T20:55:06.893365+0000","last_clean":"2024-03-16T20:55:06.893365+0000","last_became_active":"2024-03-16T20:55:04.266502+0000","last_became_peered":"2024-03-16T20:55:04.266502+0000","last_unstale":"2024-03-16T20:55:06.893365+0000","last_undegraded":"2024-03-16T20:55:06.893365+0000","last_fullsized":"2024-03-16T20:55:06.893365+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:12:33.717454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.895533+0000","last_change":"2024-03-16T20:55:05.280158+0000","last_active":"2024-03-16T20:55:06.895533+0000","last_peered":"2024-03-16T20:55:06.895533+0000","last_clean":"2024-03-16T20:55:06.895533+0000","last_became_active":"2024-03-16T20:55:05.278918+0000","last_became_peered":"2024-03-16T20:55:05.278918+0000","last_unstale":"2024-03-16T20:55:06.895533+0000","last_undegraded":"2024-03-16T20:55:06.895533+0000","last_fullsized":"2024-03-16T20:55:06.895533+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:27:34.158596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.886238+0000","last_change":"2024-03-16T20:55:04.283366+0000","last_active":"2024-03-16T20:55:07.886238+0000","last_peered":"2024-03-16T20:55:07.886238+0000","last_clean":"2024-03-16T20:55:07.886238+0000","last_became_active":"2024-03-16T20:55:04.283016+0000","last_became_peered":"2024-03-16T20:55:04.283016+0000","last_unstale":"2024-03-16T20:55:07.886238+0000","last_undegraded":"2024-03-16T20:55:07.886238+0000","last_fullsized":"2024-03-16T20:55:07.886238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:41.163294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.673783+0000","last_change":"2024-03-16T20:55:05.299005+0000","last_active":"2024-03-16T20:55:06.673783+0000","last_peered":"2024-03-16T20:55:06.673783+0000","last_clean":"2024-03-16T20:55:06.673783+0000","last_became_active":"2024-03-16T20:55:05.296527+0000","last_became_peered":"2024-03-16T20:55:05.296527+0000","last_unstale":"2024-03-16T20:55:06.673783+0000","last_undegraded":"2024-03-16T20:55:06.673783+0000","last_fullsized":"2024-03-16T20:55:06.673783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:56:51.451900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891119+0000","last_change":"2024-03-16T20:55:04.259210+0000","last_active":"2024-03-16T20:55:06.891119+0000","last_peered":"2024-03-16T20:55:06.891119+0000","last_clean":"2024-03-16T20:55:06.891119+0000","last_became_active":"2024-03-16T20:55:04.258828+0000","last_became_peered":"2024-03-16T20:55:04.258828+0000","last_unstale":"2024-03-16T20:55:06.891119+0000","last_undegraded":"2024-03-16T20:55:06.891119+0000","last_fullsized":"2024-03-16T20:55:06.891119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:21:14.497086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890145+0000","last_change":"2024-03-16T20:55:05.272053+0000","last_active":"2024-03-16T20:55:06.890145+0000","last_peered":"2024-03-16T20:55:06.890145+0000","last_clean":"2024-03-16T20:55:06.890145+0000","last_became_active":"2024-03-16T20:55:05.271435+0000","last_became_peered":"2024-03-16T20:55:05.271435+0000","last_unstale":"2024-03-16T20:55:06.890145+0000","last_undegraded":"2024-03-16T20:55:06.890145+0000","last_fullsized":"2024-03-16T20:55:06.890145+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:08:47.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891041+0000","last_change":"2024-03-16T20:55:04.261051+0000","last_active":"2024-03-16T20:55:06.891041+0000","last_peered":"2024-03-16T20:55:06.891041+0000","last_clean":"2024-03-16T20:55:06.891041+0000","last_became_active":"2024-03-16T20:55:04.260701+0000","last_became_peered":"2024-03-16T20:55:04.260701+0000","last_unstale":"2024-03-16T20:55:06.891041+0000","last_undegraded":"2024-03-16T20:55:06.891041+0000","last_fullsized":"2024-03-16T20:55:06.891041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:30:05.233891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891582+0000","last_change":"2024-03-16T20:55:05.270047+0000","last_active":"2024-03-16T20:55:06.891582+0000","last_peered":"2024-03-16T20:55:06.891582+0000","last_clean":"2024-03-16T20:55:06.891582+0000","last_became_active":"2024-03-16T20:55:05.269045+0000","last_became_peered":"2024-03-16T20:55:05.269045+0000","last_unstale":"2024-03-16T20:55:06.891582+0000","last_undegraded":"2024-03-16T20:55:06.891582+0000","last_fullsized":"2024-03-16T20:55:06.891582+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:54:19.289648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891040+0000","last_change":"2024-03-16T20:55:04.258871+0000","last_active":"2024-03-16T20:55:06.891040+0000","last_peered":"2024-03-16T20:55:06.891040+0000","last_clean":"2024-03-16T20:55:06.891040+0000","last_became_active":"2024-03-16T20:55:04.258462+0000","last_became_peered":"2024-03-16T20:55:04.258462+0000","last_unstale":"2024-03-16T20:55:06.891040+0000","last_undegraded":"2024-03-16T20:55:06.891040+0000","last_fullsized":"2024-03-16T20:55:06.891040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:16:29.832814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890701+0000","last_change":"2024-03-16T20:55:05.290789+0000","last_active":"2024-03-16T20:55:06.890701+0000","last_peered":"2024-03-16T20:55:06.890701+0000","last_clean":"2024-03-16T20:55:06.890701+0000","last_became_active":"2024-03-16T20:55:05.290367+0000","last_became_peered":"2024-03-16T20:55:05.290367+0000","last_unstale":"2024-03-16T20:55:06.890701+0000","last_undegraded":"2024-03-16T20:55:06.890701+0000","last_fullsized":"2024-03-16T20:55:06.890701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:23:38.509837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:09.359636+0000","last_change":"2024-03-16T20:55:04.264980+0000","last_active":"2024-03-16T20:55:09.359636+0000","last_peered":"2024-03-16T20:55:09.359636+0000","last_clean":"2024-03-16T20:55:09.359636+0000","last_became_active":"2024-03-16T20:55:04.264634+0000","last_became_peered":"2024-03-16T20:55:04.264634+0000","last_unstale":"2024-03-16T20:55:09.359636+0000","last_undegraded":"2024-03-16T20:55:09.359636+0000","last_fullsized":"2024-03-16T20:55:09.359636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:16:52.713847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891359+0000","last_change":"2024-03-16T20:55:05.286139+0000","last_active":"2024-03-16T20:55:06.891359+0000","last_peered":"2024-03-16T20:55:06.891359+0000","last_clean":"2024-03-16T20:55:06.891359+0000","last_became_active":"2024-03-16T20:55:05.285751+0000","last_became_peered":"2024-03-16T20:55:05.285751+0000","last_unstale":"2024-03-16T20:55:06.891359+0000","last_undegraded":"2024-03-16T20:55:06.891359+0000","last_fullsized":"2024-03-16T20:55:06.891359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:01:02.448785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:09.361390+0000","last_change":"2024-03-16T20:55:04.282416+0000","last_active":"2024-03-16T20:55:09.361390+0000","last_peered":"2024-03-16T20:55:09.361390+0000","last_clean":"2024-03-16T20:55:09.361390+0000","last_became_active":"2024-03-16T20:55:04.280504+0000","last_became_peered":"2024-03-16T20:55:04.280504+0000","last_unstale":"2024-03-16T20:55:09.361390+0000","last_undegraded":"2024-03-16T20:55:09.361390+0000","last_fullsized":"2024-03-16T20:55:09.361390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:23.940976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.894378+0000","last_change":"2024-03-16T20:55:05.289210+0000","last_active":"2024-03-16T20:55:06.894378+0000","last_peered":"2024-03-16T20:55:06.894378+0000","last_clean":"2024-03-16T20:55:06.894378+0000","last_became_active":"2024-03-16T20:55:05.286738+0000","last_became_peered":"2024-03-16T20:55:05.286738+0000","last_unstale":"2024-03-16T20:55:06.894378+0000","last_undegraded":"2024-03-16T20:55:06.894378+0000","last_fullsized":"2024-03-16T20:55:06.894378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:43:45.266727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891362+0000","last_change":"2024-03-16T20:55:04.258925+0000","last_active":"2024-03-16T20:55:06.891362+0000","last_peered":"2024-03-16T20:55:06.891362+0000","last_clean":"2024-03-16T20:55:06.891362+0000","last_became_active":"2024-03-16T20:55:04.258578+0000","last_became_peered":"2024-03-16T20:55:04.258578+0000","last_unstale":"2024-03-16T20:55:06.891362+0000","last_undegraded":"2024-03-16T20:55:06.891362+0000","last_fullsized":"2024-03-16T20:55:06.891362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:52.812547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892567+0000","last_change":"2024-03-16T20:55:05.302122+0000","last_active":"2024-03-16T20:55:06.892567+0000","last_peered":"2024-03-16T20:55:06.892567+0000","last_clean":"2024-03-16T20:55:06.892567+0000","last_became_active":"2024-03-16T20:55:05.301743+0000","last_became_peered":"2024-03-16T20:55:05.301743+0000","last_unstale":"2024-03-16T20:55:06.892567+0000","last_undegraded":"2024-03-16T20:55:06.892567+0000","last_fullsized":"2024-03-16T20:55:06.892567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:32:51.691780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.348476+0000","last_change":"2024-03-16T20:55:04.270015+0000","last_active":"2024-03-16T20:55:08.348476+0000","last_peered":"2024-03-16T20:55:08.348476+0000","last_clean":"2024-03-16T20:55:08.348476+0000","last_became_active":"2024-03-16T20:55:04.269563+0000","last_became_peered":"2024-03-16T20:55:04.269563+0000","last_unstale":"2024-03-16T20:55:08.348476+0000","last_undegraded":"2024-03-16T20:55:08.348476+0000","last_fullsized":"2024-03-16T20:55:08.348476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:39:21.768540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890349+0000","last_change":"2024-03-16T20:55:05.290639+0000","last_active":"2024-03-16T20:55:06.890349+0000","last_peered":"2024-03-16T20:55:06.890349+0000","last_clean":"2024-03-16T20:55:06.890349+0000","last_became_active":"2024-03-16T20:55:05.290255+0000","last_became_peered":"2024-03-16T20:55:05.290255+0000","last_unstale":"2024-03-16T20:55:06.890349+0000","last_undegraded":"2024-03-16T20:55:06.890349+0000","last_fullsized":"2024-03-16T20:55:06.890349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:36:13.303557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.343718+0000","last_change":"2024-03-16T20:55:04.260407+0000","last_active":"2024-03-16T20:55:08.343718+0000","last_peered":"2024-03-16T20:55:08.343718+0000","last_clean":"2024-03-16T20:55:08.343718+0000","last_became_active":"2024-03-16T20:55:04.259817+0000","last_became_peered":"2024-03-16T20:55:04.259817+0000","last_unstale":"2024-03-16T20:55:08.343718+0000","last_undegraded":"2024-03-16T20:55:08.343718+0000","last_fullsized":"2024-03-16T20:55:08.343718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:07.995508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.673693+0000","last_change":"2024-03-16T20:55:05.295327+0000","last_active":"2024-03-16T20:55:06.673693+0000","last_peered":"2024-03-16T20:55:06.673693+0000","last_clean":"2024-03-16T20:55:06.673693+0000","last_became_active":"2024-03-16T20:55:05.294948+0000","last_became_peered":"2024-03-16T20:55:05.294948+0000","last_unstale":"2024-03-16T20:55:06.673693+0000","last_undegraded":"2024-03-16T20:55:06.673693+0000","last_fullsized":"2024-03-16T20:55:06.673693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:29.305366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891524+0000","last_change":"2024-03-16T20:55:04.264571+0000","last_active":"2024-03-16T20:55:06.891524+0000","last_peered":"2024-03-16T20:55:06.891524+0000","last_clean":"2024-03-16T20:55:06.891524+0000","last_became_active":"2024-03-16T20:55:04.264200+0000","last_became_peered":"2024-03-16T20:55:04.264200+0000","last_unstale":"2024-03-16T20:55:06.891524+0000","last_undegraded":"2024-03-16T20:55:06.891524+0000","last_fullsized":"2024-03-16T20:55:06.891524+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:38:58.457250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890218+0000","last_change":"2024-03-16T20:55:05.272855+0000","last_active":"2024-03-16T20:55:06.890218+0000","last_peered":"2024-03-16T20:55:06.890218+0000","last_clean":"2024-03-16T20:55:06.890218+0000","last_became_active":"2024-03-16T20:55:05.272500+0000","last_became_peered":"2024-03-16T20:55:05.272500+0000","last_unstale":"2024-03-16T20:55:06.890218+0000","last_undegraded":"2024-03-16T20:55:06.890218+0000","last_fullsized":"2024-03-16T20:55:06.890218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:50:17.121966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.344164+0000","last_change":"2024-03-16T20:55:04.260050+0000","last_active":"2024-03-16T20:55:08.344164+0000","last_peered":"2024-03-16T20:55:08.344164+0000","last_clean":"2024-03-16T20:55:08.344164+0000","last_became_active":"2024-03-16T20:55:04.259662+0000","last_became_peered":"2024-03-16T20:55:04.259662+0000","last_unstale":"2024-03-16T20:55:08.344164+0000","last_undegraded":"2024-03-16T20:55:08.344164+0000","last_fullsized":"2024-03-16T20:55:08.344164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:45:46.999980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891715+0000","last_change":"2024-03-16T20:55:05.272337+0000","last_active":"2024-03-16T20:55:06.891715+0000","last_peered":"2024-03-16T20:55:06.891715+0000","last_clean":"2024-03-16T20:55:06.891715+0000","last_became_active":"2024-03-16T20:55:05.271761+0000","last_became_peered":"2024-03-16T20:55:05.271761+0000","last_unstale":"2024-03-16T20:55:06.891715+0000","last_undegraded":"2024-03-16T20:55:06.891715+0000","last_fullsized":"2024-03-16T20:55:06.891715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:50:22.079709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:09.356970+0000","last_change":"2024-03-16T20:55:04.275606+0000","last_active":"2024-03-16T20:55:09.356970+0000","last_peered":"2024-03-16T20:55:09.356970+0000","last_clean":"2024-03-16T20:55:09.356970+0000","last_became_active":"2024-03-16T20:55:04.275268+0000","last_became_peered":"2024-03-16T20:55:04.275268+0000","last_unstale":"2024-03-16T20:55:09.356970+0000","last_undegraded":"2024-03-16T20:55:09.356970+0000","last_fullsized":"2024-03-16T20:55:09.356970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:27:34.248831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251766+0000","last_change":"2024-03-16T20:55:05.290619+0000","last_active":"2024-03-16T20:55:06.251766+0000","last_peered":"2024-03-16T20:55:06.251766+0000","last_clean":"2024-03-16T20:55:06.251766+0000","last_became_active":"2024-03-16T20:55:05.289943+0000","last_became_peered":"2024-03-16T20:55:05.289943+0000","last_unstale":"2024-03-16T20:55:06.251766+0000","last_undegraded":"2024-03-16T20:55:06.251766+0000","last_fullsized":"2024-03-16T20:55:06.251766+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:30.569777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891199+0000","last_change":"2024-03-16T20:55:04.274206+0000","last_active":"2024-03-16T20:55:06.891199+0000","last_peered":"2024-03-16T20:55:06.891199+0000","last_clean":"2024-03-16T20:55:06.891199+0000","last_became_active":"2024-03-16T20:55:04.273834+0000","last_became_peered":"2024-03-16T20:55:04.273834+0000","last_unstale":"2024-03-16T20:55:06.891199+0000","last_undegraded":"2024-03-16T20:55:06.891199+0000","last_fullsized":"2024-03-16T20:55:06.891199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:36:04.720463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534987+0000","last_change":"2024-03-16T20:55:05.280265+0000","last_active":"2024-03-16T20:55:07.534987+0000","last_peered":"2024-03-16T20:55:07.534987+0000","last_clean":"2024-03-16T20:55:07.534987+0000","last_became_active":"2024-03-16T20:55:05.279774+0000","last_became_peered":"2024-03-16T20:55:05.279774+0000","last_unstale":"2024-03-16T20:55:07.534987+0000","last_undegraded":"2024-03-16T20:55:07.534987+0000","last_fullsized":"2024-03-16T20:55:07.534987+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:34:52.855290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251134+0000","last_change":"2024-03-16T20:55:04.256314+0000","last_active":"2024-03-16T20:55:06.251134+0000","last_peered":"2024-03-16T20:55:06.251134+0000","last_clean":"2024-03-16T20:55:06.251134+0000","last_became_active":"2024-03-16T20:55:04.255940+0000","last_became_peered":"2024-03-16T20:55:04.255940+0000","last_unstale":"2024-03-16T20:55:06.251134+0000","last_undegraded":"2024-03-16T20:55:06.251134+0000","last_fullsized":"2024-03-16T20:55:06.251134+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:27:09.660107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534698+0000","last_change":"2024-03-16T20:55:05.271562+0000","last_active":"2024-03-16T20:55:07.534698+0000","last_peered":"2024-03-16T20:55:07.534698+0000","last_clean":"2024-03-16T20:55:07.534698+0000","last_became_active":"2024-03-16T20:55:05.271214+0000","last_became_peered":"2024-03-16T20:55:05.271214+0000","last_unstale":"2024-03-16T20:55:07.534698+0000","last_undegraded":"2024-03-16T20:55:07.534698+0000","last_fullsized":"2024-03-16T20:55:07.534698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:42:35.104345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'10","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.343890+0000","last_change":"2024-03-16T20:55:04.269684+0000","last_active":"2024-03-16T20:55:08.343890+0000","last_peered":"2024-03-16T20:55:08.343890+0000","last_clean":"2024-03-16T20:55:08.343890+0000","last_became_active":"2024-03-16T20:55:04.269256+0000","last_became_peered":"2024-03-16T20:55:04.269256+0000","last_unstale":"2024-03-16T20:55:08.343890+0000","last_undegraded":"2024-03-16T20:55:08.343890+0000","last_fullsized":"2024-03-16T20:55:08.343890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:37:42.919889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890900+0000","last_change":"2024-03-16T20:55:05.269751+0000","last_active":"2024-03-16T20:55:06.890900+0000","last_peered":"2024-03-16T20:55:06.890900+0000","last_clean":"2024-03-16T20:55:06.890900+0000","last_became_active":"2024-03-16T20:55:05.269375+0000","last_became_peered":"2024-03-16T20:55:05.269375+0000","last_unstale":"2024-03-16T20:55:06.890900+0000","last_undegraded":"2024-03-16T20:55:06.890900+0000","last_fullsized":"2024-03-16T20:55:06.890900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:57:00.751155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891068+0000","last_change":"2024-03-16T20:55:04.254352+0000","last_active":"2024-03-16T20:55:06.891068+0000","last_peered":"2024-03-16T20:55:06.891068+0000","last_clean":"2024-03-16T20:55:06.891068+0000","last_became_active":"2024-03-16T20:55:04.253895+0000","last_became_peered":"2024-03-16T20:55:04.253895+0000","last_unstale":"2024-03-16T20:55:06.891068+0000","last_undegraded":"2024-03-16T20:55:06.891068+0000","last_fullsized":"2024-03-16T20:55:06.891068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:35:15.796341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892097+0000","last_change":"2024-03-16T20:55:05.271148+0000","last_active":"2024-03-16T20:55:06.892097+0000","last_peered":"2024-03-16T20:55:06.892097+0000","last_clean":"2024-03-16T20:55:06.892097+0000","last_became_active":"2024-03-16T20:55:05.270836+0000","last_became_peered":"2024-03-16T20:55:05.270836+0000","last_unstale":"2024-03-16T20:55:06.892097+0000","last_undegraded":"2024-03-16T20:55:06.892097+0000","last_fullsized":"2024-03-16T20:55:06.892097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:12:49.526828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892974+0000","last_change":"2024-03-16T20:55:04.277152+0000","last_active":"2024-03-16T20:55:06.892974+0000","last_peered":"2024-03-16T20:55:06.892974+0000","last_clean":"2024-03-16T20:55:06.892974+0000","last_became_active":"2024-03-16T20:55:04.276666+0000","last_became_peered":"2024-03-16T20:55:04.276666+0000","last_unstale":"2024-03-16T20:55:06.892974+0000","last_undegraded":"2024-03-16T20:55:06.892974+0000","last_fullsized":"2024-03-16T20:55:06.892974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:39:04.919957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.390114+0000","last_change":"2024-03-16T20:55:05.291187+0000","last_active":"2024-03-16T20:55:06.390114+0000","last_peered":"2024-03-16T20:55:06.390114+0000","last_clean":"2024-03-16T20:55:06.390114+0000","last_became_active":"2024-03-16T20:55:05.290835+0000","last_became_peered":"2024-03-16T20:55:05.290835+0000","last_unstale":"2024-03-16T20:55:06.390114+0000","last_undegraded":"2024-03-16T20:55:06.390114+0000","last_fullsized":"2024-03-16T20:55:06.390114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:25:14.404610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534834+0000","last_change":"2024-03-16T20:55:04.270960+0000","last_active":"2024-03-16T20:55:07.534834+0000","last_peered":"2024-03-16T20:55:07.534834+0000","last_clean":"2024-03-16T20:55:07.534834+0000","last_became_active":"2024-03-16T20:55:04.270605+0000","last_became_peered":"2024-03-16T20:55:04.270605+0000","last_unstale":"2024-03-16T20:55:07.534834+0000","last_undegraded":"2024-03-16T20:55:07.534834+0000","last_fullsized":"2024-03-16T20:55:07.534834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:06:53.529116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.390281+0000","last_change":"2024-03-16T20:55:05.303690+0000","last_active":"2024-03-16T20:55:06.390281+0000","last_peered":"2024-03-16T20:55:06.390281+0000","last_clean":"2024-03-16T20:55:06.390281+0000","last_became_active":"2024-03-16T20:55:05.303096+0000","last_became_peered":"2024-03-16T20:55:05.303096+0000","last_unstale":"2024-03-16T20:55:06.390281+0000","last_undegraded":"2024-03-16T20:55:06.390281+0000","last_fullsized":"2024-03-16T20:55:06.390281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:03:25.139693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891269+0000","last_change":"2024-03-16T20:55:05.268277+0000","last_active":"2024-03-16T20:55:06.891269+0000","last_peered":"2024-03-16T20:55:06.891269+0000","last_clean":"2024-03-16T20:55:06.891269+0000","last_became_active":"2024-03-16T20:55:05.267955+0000","last_became_peered":"2024-03-16T20:55:05.267955+0000","last_unstale":"2024-03-16T20:55:06.891269+0000","last_undegraded":"2024-03-16T20:55:06.891269+0000","last_fullsized":"2024-03-16T20:55:06.891269+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:20:21.633055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:11.366074+0000","last_change":"2024-03-16T20:55:04.277286+0000","last_active":"2024-03-16T20:55:11.366074+0000","last_peered":"2024-03-16T20:55:11.366074+0000","last_clean":"2024-03-16T20:55:11.366074+0000","last_became_active":"2024-03-16T20:55:04.276855+0000","last_became_peered":"2024-03-16T20:55:04.276855+0000","last_unstale":"2024-03-16T20:55:11.366074+0000","last_undegraded":"2024-03-16T20:55:11.366074+0000","last_fullsized":"2024-03-16T20:55:11.366074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:22:19.590782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.895277+0000","last_change":"2024-03-16T20:55:05.280255+0000","last_active":"2024-03-16T20:55:06.895277+0000","last_peered":"2024-03-16T20:55:06.895277+0000","last_clean":"2024-03-16T20:55:06.895277+0000","last_became_active":"2024-03-16T20:55:05.279762+0000","last_became_peered":"2024-03-16T20:55:05.279762+0000","last_unstale":"2024-03-16T20:55:06.895277+0000","last_undegraded":"2024-03-16T20:55:06.895277+0000","last_fullsized":"2024-03-16T20:55:06.895277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:31.687047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.344378+0000","last_change":"2024-03-16T20:55:04.263605+0000","last_active":"2024-03-16T20:55:08.344378+0000","last_peered":"2024-03-16T20:55:08.344378+0000","last_clean":"2024-03-16T20:55:08.344378+0000","last_became_active":"2024-03-16T20:55:04.263189+0000","last_became_peered":"2024-03-16T20:55:04.263189+0000","last_unstale":"2024-03-16T20:55:08.344378+0000","last_undegraded":"2024-03-16T20:55:08.344378+0000","last_fullsized":"2024-03-16T20:55:08.344378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:28:11.377134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":347,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534643+0000","last_change":"2024-03-16T20:53:44.281432+0000","last_active":"2024-03-16T20:55:07.534643+0000","last_peered":"2024-03-16T20:55:07.534643+0000","last_clean":"2024-03-16T20:55:07.534643+0000","last_became_active":"2024-03-16T20:53:44.280927+0000","last_became_peered":"2024-03-16T20:53:44.280927+0000","last_unstale":"2024-03-16T20:55:07.534643+0000","last_undegraded":"2024-03-16T20:55:07.534643+0000","last_fullsized":"2024-03-16T20:55:07.534643+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_clean_scrub_stamp":"2024-03-16T20:49:51.705234+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:01:00.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251400+0000","last_change":"2024-03-16T20:55:05.277432+0000","last_active":"2024-03-16T20:55:06.251400+0000","last_peered":"2024-03-16T20:55:06.251400+0000","last_clean":"2024-03-16T20:55:06.251400+0000","last_became_active":"2024-03-16T20:55:05.274798+0000","last_became_peered":"2024-03-16T20:55:05.274798+0000","last_unstale":"2024-03-16T20:55:06.251400+0000","last_undegraded":"2024-03-16T20:55:06.251400+0000","last_fullsized":"2024-03-16T20:55:06.251400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:24:51.315100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.534824+0000","last_change":"2024-03-16T20:55:04.256842+0000","last_active":"2024-03-16T20:55:07.534824+0000","last_peered":"2024-03-16T20:55:07.534824+0000","last_clean":"2024-03-16T20:55:07.534824+0000","last_became_active":"2024-03-16T20:55:04.256493+0000","last_became_peered":"2024-03-16T20:55:04.256493+0000","last_unstale":"2024-03-16T20:55:07.534824+0000","last_undegraded":"2024-03-16T20:55:07.534824+0000","last_fullsized":"2024-03-16T20:55:07.534824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:08.836034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890961+0000","last_change":"2024-03-16T20:55:04.265503+0000","last_active":"2024-03-16T20:55:06.890961+0000","last_peered":"2024-03-16T20:55:06.890961+0000","last_clean":"2024-03-16T20:55:06.890961+0000","last_became_active":"2024-03-16T20:55:04.265017+0000","last_became_peered":"2024-03-16T20:55:04.265017+0000","last_unstale":"2024-03-16T20:55:06.890961+0000","last_undegraded":"2024-03-16T20:55:06.890961+0000","last_fullsized":"2024-03-16T20:55:06.890961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:28.485079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251850+0000","last_change":"2024-03-16T20:55:05.289100+0000","last_active":"2024-03-16T20:55:06.251850+0000","last_peered":"2024-03-16T20:55:06.251850+0000","last_clean":"2024-03-16T20:55:06.251850+0000","last_became_active":"2024-03-16T20:55:05.288122+0000","last_became_peered":"2024-03-16T20:55:05.288122+0000","last_unstale":"2024-03-16T20:55:06.251850+0000","last_undegraded":"2024-03-16T20:55:06.251850+0000","last_fullsized":"2024-03-16T20:55:06.251850+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:03.222038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.893439+0000","last_change":"2024-03-16T20:55:04.282230+0000","last_active":"2024-03-16T20:55:06.893439+0000","last_peered":"2024-03-16T20:55:06.893439+0000","last_clean":"2024-03-16T20:55:06.893439+0000","last_became_active":"2024-03-16T20:55:04.281917+0000","last_became_peered":"2024-03-16T20:55:04.281917+0000","last_unstale":"2024-03-16T20:55:06.893439+0000","last_undegraded":"2024-03-16T20:55:06.893439+0000","last_fullsized":"2024-03-16T20:55:06.893439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:18:36.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.895913+0000","last_change":"2024-03-16T20:55:05.293378+0000","last_active":"2024-03-16T20:55:06.895913+0000","last_peered":"2024-03-16T20:55:06.895913+0000","last_clean":"2024-03-16T20:55:06.895913+0000","last_became_active":"2024-03-16T20:55:05.288648+0000","last_became_peered":"2024-03-16T20:55:05.288648+0000","last_unstale":"2024-03-16T20:55:06.895913+0000","last_undegraded":"2024-03-16T20:55:06.895913+0000","last_fullsized":"2024-03-16T20:55:06.895913+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:37:58.270760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.343611+0000","last_change":"2024-03-16T20:55:04.268766+0000","last_active":"2024-03-16T20:55:08.343611+0000","last_peered":"2024-03-16T20:55:08.343611+0000","last_clean":"2024-03-16T20:55:08.343611+0000","last_became_active":"2024-03-16T20:55:04.268429+0000","last_became_peered":"2024-03-16T20:55:04.268429+0000","last_unstale":"2024-03-16T20:55:08.343611+0000","last_undegraded":"2024-03-16T20:55:08.343611+0000","last_fullsized":"2024-03-16T20:55:08.343611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:43.872155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.673603+0000","last_change":"2024-03-16T20:55:05.310349+0000","last_active":"2024-03-16T20:55:06.673603+0000","last_peered":"2024-03-16T20:55:06.673603+0000","last_clean":"2024-03-16T20:55:06.673603+0000","last_became_active":"2024-03-16T20:55:05.307987+0000","last_became_peered":"2024-03-16T20:55:05.307987+0000","last_unstale":"2024-03-16T20:55:06.673603+0000","last_undegraded":"2024-03-16T20:55:06.673603+0000","last_fullsized":"2024-03-16T20:55:06.673603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:19:38.142783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.343611+0000","last_change":"2024-03-16T20:55:04.269683+0000","last_active":"2024-03-16T20:55:08.343611+0000","last_peered":"2024-03-16T20:55:08.343611+0000","last_clean":"2024-03-16T20:55:08.343611+0000","last_became_active":"2024-03-16T20:55:04.269258+0000","last_became_peered":"2024-03-16T20:55:04.269258+0000","last_unstale":"2024-03-16T20:55:08.343611+0000","last_undegraded":"2024-03-16T20:55:08.343611+0000","last_fullsized":"2024-03-16T20:55:08.343611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:24:10.417179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890646+0000","last_change":"2024-03-16T20:55:05.272238+0000","last_active":"2024-03-16T20:55:06.890646+0000","last_peered":"2024-03-16T20:55:06.890646+0000","last_clean":"2024-03-16T20:55:06.890646+0000","last_became_active":"2024-03-16T20:55:05.270379+0000","last_became_peered":"2024-03-16T20:55:05.270379+0000","last_unstale":"2024-03-16T20:55:06.890646+0000","last_undegraded":"2024-03-16T20:55:06.890646+0000","last_fullsized":"2024-03-16T20:55:06.890646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:16:11.348601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.347496+0000","last_change":"2024-03-16T20:55:04.280008+0000","last_active":"2024-03-16T20:55:08.347496+0000","last_peered":"2024-03-16T20:55:08.347496+0000","last_clean":"2024-03-16T20:55:08.347496+0000","last_became_active":"2024-03-16T20:55:04.279683+0000","last_became_peered":"2024-03-16T20:55:04.279683+0000","last_unstale":"2024-03-16T20:55:08.347496+0000","last_undegraded":"2024-03-16T20:55:08.347496+0000","last_fullsized":"2024-03-16T20:55:08.347496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:15.734826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891807+0000","last_change":"2024-03-16T20:55:05.287219+0000","last_active":"2024-03-16T20:55:06.891807+0000","last_peered":"2024-03-16T20:55:06.891807+0000","last_clean":"2024-03-16T20:55:06.891807+0000","last_became_active":"2024-03-16T20:55:05.286899+0000","last_became_peered":"2024-03-16T20:55:05.286899+0000","last_unstale":"2024-03-16T20:55:06.891807+0000","last_undegraded":"2024-03-16T20:55:06.891807+0000","last_fullsized":"2024-03-16T20:55:06.891807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:33:01.483415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251774+0000","last_change":"2024-03-16T20:55:04.264489+0000","last_active":"2024-03-16T20:55:06.251774+0000","last_peered":"2024-03-16T20:55:06.251774+0000","last_clean":"2024-03-16T20:55:06.251774+0000","last_became_active":"2024-03-16T20:55:04.264101+0000","last_became_peered":"2024-03-16T20:55:04.264101+0000","last_unstale":"2024-03-16T20:55:06.251774+0000","last_undegraded":"2024-03-16T20:55:06.251774+0000","last_fullsized":"2024-03-16T20:55:06.251774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:40:48.755800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.894306+0000","last_change":"2024-03-16T20:55:05.311463+0000","last_active":"2024-03-16T20:55:06.894306+0000","last_peered":"2024-03-16T20:55:06.894306+0000","last_clean":"2024-03-16T20:55:06.894306+0000","last_became_active":"2024-03-16T20:55:05.310852+0000","last_became_peered":"2024-03-16T20:55:05.310852+0000","last_unstale":"2024-03-16T20:55:06.894306+0000","last_undegraded":"2024-03-16T20:55:06.894306+0000","last_fullsized":"2024-03-16T20:55:06.894306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:51:52.980193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:08.344391+0000","last_change":"2024-03-16T20:55:04.260372+0000","last_active":"2024-03-16T20:55:08.344391+0000","last_peered":"2024-03-16T20:55:08.344391+0000","last_clean":"2024-03-16T20:55:08.344391+0000","last_became_active":"2024-03-16T20:55:04.259273+0000","last_became_peered":"2024-03-16T20:55:04.259273+0000","last_unstale":"2024-03-16T20:55:08.344391+0000","last_undegraded":"2024-03-16T20:55:08.344391+0000","last_fullsized":"2024-03-16T20:55:08.344391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:21:25.212520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.535071+0000","last_change":"2024-03-16T20:55:05.280088+0000","last_active":"2024-03-16T20:55:07.535071+0000","last_peered":"2024-03-16T20:55:07.535071+0000","last_clean":"2024-03-16T20:55:07.535071+0000","last_became_active":"2024-03-16T20:55:05.279745+0000","last_became_peered":"2024-03-16T20:55:05.279745+0000","last_unstale":"2024-03-16T20:55:07.535071+0000","last_undegraded":"2024-03-16T20:55:07.535071+0000","last_fullsized":"2024-03-16T20:55:07.535071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:02:08.797287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:09.357103+0000","last_change":"2024-03-16T20:55:04.275221+0000","last_active":"2024-03-16T20:55:09.357103+0000","last_peered":"2024-03-16T20:55:09.357103+0000","last_clean":"2024-03-16T20:55:09.357103+0000","last_became_active":"2024-03-16T20:55:04.274887+0000","last_became_peered":"2024-03-16T20:55:04.274887+0000","last_unstale":"2024-03-16T20:55:09.357103+0000","last_undegraded":"2024-03-16T20:55:09.357103+0000","last_fullsized":"2024-03-16T20:55:09.357103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:35.333864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.535113+0000","last_change":"2024-03-16T20:55:05.272444+0000","last_active":"2024-03-16T20:55:07.535113+0000","last_peered":"2024-03-16T20:55:07.535113+0000","last_clean":"2024-03-16T20:55:07.535113+0000","last_became_active":"2024-03-16T20:55:05.272104+0000","last_became_peered":"2024-03-16T20:55:05.272104+0000","last_unstale":"2024-03-16T20:55:07.535113+0000","last_undegraded":"2024-03-16T20:55:07.535113+0000","last_fullsized":"2024-03-16T20:55:07.535113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:35.480408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891166+0000","last_change":"2024-03-16T20:55:04.274212+0000","last_active":"2024-03-16T20:55:06.891166+0000","last_peered":"2024-03-16T20:55:06.891166+0000","last_clean":"2024-03-16T20:55:06.891166+0000","last_became_active":"2024-03-16T20:55:04.273785+0000","last_became_peered":"2024-03-16T20:55:04.273785+0000","last_unstale":"2024-03-16T20:55:06.891166+0000","last_undegraded":"2024-03-16T20:55:06.891166+0000","last_fullsized":"2024-03-16T20:55:06.891166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:29:00.924789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.535047+0000","last_change":"2024-03-16T20:55:05.278590+0000","last_active":"2024-03-16T20:55:07.535047+0000","last_peered":"2024-03-16T20:55:07.535047+0000","last_clean":"2024-03-16T20:55:07.535047+0000","last_became_active":"2024-03-16T20:55:05.278183+0000","last_became_peered":"2024-03-16T20:55:05.278183+0000","last_unstale":"2024-03-16T20:55:07.535047+0000","last_undegraded":"2024-03-16T20:55:07.535047+0000","last_fullsized":"2024-03-16T20:55:07.535047+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:52:18.918653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251905+0000","last_change":"2024-03-16T20:55:04.279568+0000","last_active":"2024-03-16T20:55:06.251905+0000","last_peered":"2024-03-16T20:55:06.251905+0000","last_clean":"2024-03-16T20:55:06.251905+0000","last_became_active":"2024-03-16T20:55:04.278125+0000","last_became_peered":"2024-03-16T20:55:04.278125+0000","last_unstale":"2024-03-16T20:55:06.251905+0000","last_undegraded":"2024-03-16T20:55:06.251905+0000","last_fullsized":"2024-03-16T20:55:06.251905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:13:20.417216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:07.535059+0000","last_change":"2024-03-16T20:55:05.269732+0000","last_active":"2024-03-16T20:55:07.535059+0000","last_peered":"2024-03-16T20:55:07.535059+0000","last_clean":"2024-03-16T20:55:07.535059+0000","last_became_active":"2024-03-16T20:55:05.269260+0000","last_became_peered":"2024-03-16T20:55:05.269260+0000","last_unstale":"2024-03-16T20:55:07.535059+0000","last_undegraded":"2024-03-16T20:55:07.535059+0000","last_fullsized":"2024-03-16T20:55:07.535059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:10:03.312009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892046+0000","last_change":"2024-03-16T20:55:05.272321+0000","last_active":"2024-03-16T20:55:06.892046+0000","last_peered":"2024-03-16T20:55:06.892046+0000","last_clean":"2024-03-16T20:55:06.892046+0000","last_became_active":"2024-03-16T20:55:05.272000+0000","last_became_peered":"2024-03-16T20:55:05.272000+0000","last_unstale":"2024-03-16T20:55:06.892046+0000","last_undegraded":"2024-03-16T20:55:06.892046+0000","last_fullsized":"2024-03-16T20:55:06.892046+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:04:44.773709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251958+0000","last_change":"2024-03-16T20:55:05.277283+0000","last_active":"2024-03-16T20:55:06.251958+0000","last_peered":"2024-03-16T20:55:06.251958+0000","last_clean":"2024-03-16T20:55:06.251958+0000","last_became_active":"2024-03-16T20:55:05.276878+0000","last_became_peered":"2024-03-16T20:55:05.276878+0000","last_unstale":"2024-03-16T20:55:06.251958+0000","last_undegraded":"2024-03-16T20:55:06.251958+0000","last_fullsized":"2024-03-16T20:55:06.251958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:35:25.064399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.251770+0000","last_change":"2024-03-16T20:55:05.287329+0000","last_active":"2024-03-16T20:55:06.251770+0000","last_peered":"2024-03-16T20:55:06.251770+0000","last_clean":"2024-03-16T20:55:06.251770+0000","last_became_active":"2024-03-16T20:55:05.286893+0000","last_became_peered":"2024-03-16T20:55:05.286893+0000","last_unstale":"2024-03-16T20:55:06.251770+0000","last_undegraded":"2024-03-16T20:55:06.251770+0000","last_fullsized":"2024-03-16T20:55:06.251770+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:43:29.560525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.672904+0000","last_change":"2024-03-16T20:55:05.307115+0000","last_active":"2024-03-16T20:55:06.672904+0000","last_peered":"2024-03-16T20:55:06.672904+0000","last_clean":"2024-03-16T20:55:06.672904+0000","last_became_active":"2024-03-16T20:55:05.306719+0000","last_became_peered":"2024-03-16T20:55:05.306719+0000","last_unstale":"2024-03-16T20:55:06.672904+0000","last_undegraded":"2024-03-16T20:55:06.672904+0000","last_fullsized":"2024-03-16T20:55:06.672904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:46:48.568626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.252002+0000","last_change":"2024-03-16T20:55:05.300207+0000","last_active":"2024-03-16T20:55:06.252002+0000","last_peered":"2024-03-16T20:55:06.252002+0000","last_clean":"2024-03-16T20:55:06.252002+0000","last_became_active":"2024-03-16T20:55:05.298892+0000","last_became_peered":"2024-03-16T20:55:05.298892+0000","last_unstale":"2024-03-16T20:55:06.252002+0000","last_undegraded":"2024-03-16T20:55:06.252002+0000","last_fullsized":"2024-03-16T20:55:06.252002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:29.158690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.892125+0000","last_change":"2024-03-16T20:55:05.272135+0000","last_active":"2024-03-16T20:55:06.892125+0000","last_peered":"2024-03-16T20:55:06.892125+0000","last_clean":"2024-03-16T20:55:06.892125+0000","last_became_active":"2024-03-16T20:55:05.271779+0000","last_became_peered":"2024-03-16T20:55:05.271779+0000","last_unstale":"2024-03-16T20:55:06.892125+0000","last_undegraded":"2024-03-16T20:55:06.892125+0000","last_fullsized":"2024-03-16T20:55:06.892125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:42:58.085726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.252256+0000","last_change":"2024-03-16T20:55:05.268810+0000","last_active":"2024-03-16T20:55:06.252256+0000","last_peered":"2024-03-16T20:55:06.252256+0000","last_clean":"2024-03-16T20:55:06.252256+0000","last_became_active":"2024-03-16T20:55:05.268473+0000","last_became_peered":"2024-03-16T20:55:05.268473+0000","last_unstale":"2024-03-16T20:55:06.252256+0000","last_undegraded":"2024-03-16T20:55:06.252256+0000","last_fullsized":"2024-03-16T20:55:06.252256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:48:00.990207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.895570+0000","last_change":"2024-03-16T20:55:05.284121+0000","last_active":"2024-03-16T20:55:06.895570+0000","last_peered":"2024-03-16T20:55:06.895570+0000","last_clean":"2024-03-16T20:55:06.895570+0000","last_became_active":"2024-03-16T20:55:05.283588+0000","last_became_peered":"2024-03-16T20:55:05.283588+0000","last_unstale":"2024-03-16T20:55:06.895570+0000","last_undegraded":"2024-03-16T20:55:06.895570+0000","last_fullsized":"2024-03-16T20:55:06.895570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:05:56.679346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890682+0000","last_change":"2024-03-16T20:55:05.285912+0000","last_active":"2024-03-16T20:55:06.890682+0000","last_peered":"2024-03-16T20:55:06.890682+0000","last_clean":"2024-03-16T20:55:06.890682+0000","last_became_active":"2024-03-16T20:55:05.285523+0000","last_became_peered":"2024-03-16T20:55:05.285523+0000","last_unstale":"2024-03-16T20:55:06.890682+0000","last_undegraded":"2024-03-16T20:55:06.890682+0000","last_fullsized":"2024-03-16T20:55:06.890682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:57:35.147086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.894259+0000","last_change":"2024-03-16T20:55:05.277957+0000","last_active":"2024-03-16T20:55:06.894259+0000","last_peered":"2024-03-16T20:55:06.894259+0000","last_clean":"2024-03-16T20:55:06.894259+0000","last_became_active":"2024-03-16T20:55:05.277610+0000","last_became_peered":"2024-03-16T20:55:05.277610+0000","last_unstale":"2024-03-16T20:55:06.894259+0000","last_undegraded":"2024-03-16T20:55:06.894259+0000","last_fullsized":"2024-03-16T20:55:06.894259+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:54:29.010945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.890199+0000","last_change":"2024-03-16T20:55:05.288112+0000","last_active":"2024-03-16T20:55:06.890199+0000","last_peered":"2024-03-16T20:55:06.890199+0000","last_clean":"2024-03-16T20:55:06.890199+0000","last_became_active":"2024-03-16T20:55:05.287791+0000","last_became_peered":"2024-03-16T20:55:05.287791+0000","last_unstale":"2024-03-16T20:55:06.890199+0000","last_undegraded":"2024-03-16T20:55:06.890199+0000","last_fullsized":"2024-03-16T20:55:06.890199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:55:57.625981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.252100+0000","last_change":"2024-03-16T20:55:05.311327+0000","last_active":"2024-03-16T20:55:06.252100+0000","last_peered":"2024-03-16T20:55:06.252100+0000","last_clean":"2024-03-16T20:55:06.252100+0000","last_became_active":"2024-03-16T20:55:05.310820+0000","last_became_peered":"2024-03-16T20:55:05.310820+0000","last_unstale":"2024-03-16T20:55:06.252100+0000","last_undegraded":"2024-03-16T20:55:06.252100+0000","last_fullsized":"2024-03-16T20:55:06.252100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:38:26.081078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-16T20:55:06.891875+0000","last_change":"2024-03-16T20:55:05.277942+0000","last_active":"2024-03-16T20:55:06.891875+0000","last_peered":"2024-03-16T20:55:06.891875+0000","last_clean":"2024-03-16T20:55:06.891875+0000","last_became_active":"2024-03-16T20:55:05.277588+0000","last_became_peered":"2024-03-16T20:55:05.277588+0000","last_unstale":"2024-03-16T20:55:06.891875+0000","last_undegraded":"2024-03-16T20:55:06.891875+0000","last_fullsized":"2024-03-16T20:55:06.891875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:32:38.464939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":211842,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3284,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":96,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":32299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350990,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":442154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":1035130,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776152,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":937984,"data_stored":442356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037792,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":929792,"data_stored":442176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299429,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":983040,"data_stored":1033144,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462954,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":441779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":937984,"data_stored":449784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":443050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":958464,"data_stored":444534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149755,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":441973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888118,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":441594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724592,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1032122,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T20:55:14.986 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T20:55:14.986 INFO:tasks.cephadm:Setting up client nodes... 2024-03-16T20:55:14.987 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-16T20:55:15.491 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:15.725 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:15 smithi008 ceph-mon[31434]: from='client.24722 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:55:15.725 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:15 smithi008 ceph-mon[31434]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:55:15.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:15 smithi170 ceph-mon[35947]: from='client.24722 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:55:15.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:15 smithi170 ceph-mon[35947]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:55:15.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:15 smithi186 ceph-mon[36391]: from='client.24722 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:55:15.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:15 smithi186 ceph-mon[36391]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:55:16.742 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:16 smithi008 ceph-mon[31434]: pgmap v322: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.4 KiB/s wr, 16 op/s 2024-03-16T20:55:16.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:16 smithi170 ceph-mon[35947]: pgmap v322: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.4 KiB/s wr, 16 op/s 2024-03-16T20:55:16.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:16 smithi186 ceph-mon[36391]: pgmap v322: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.4 KiB/s wr, 16 op/s 2024-03-16T20:55:17.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.795+0000 7f08c6200700 1 -- 172.21.15.8:0/1596015255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c00785a0 msgr2=0x7f08c0078e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:17.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.795+0000 7f08c6200700 1 --2- 172.21.15.8:0/1596015255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c00785a0 0x7f08c0078e20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f08b800b0a0 tx=0x7f08b800b3b0 comp rx=0 tx=0).stop 2024-03-16T20:55:17.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.795+0000 7f08c6200700 1 -- 172.21.15.8:0/1596015255 shutdown_connections 2024-03-16T20:55:17.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.795+0000 7f08c6200700 1 --2- 172.21.15.8:0/1596015255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08c0076990 0x7f08c0076db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:17.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.795+0000 7f08c6200700 1 --2- 172.21.15.8:0/1596015255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c00785a0 0x7f08c0078e20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:17.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.795+0000 7f08c6200700 1 --2- 172.21.15.8:0/1596015255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c0077be0 0x7f08c0078060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:17.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.795+0000 7f08c6200700 1 -- 172.21.15.8:0/1596015255 >> 172.21.15.8:0/1596015255 conn(0x7f08c00ff800 msgr2=0x7f08c0101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:17.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.795+0000 7f08c6200700 1 -- 172.21.15.8:0/1596015255 shutdown_connections 2024-03-16T20:55:17.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.795+0000 7f08c6200700 1 -- 172.21.15.8:0/1596015255 wait complete. 2024-03-16T20:55:17.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.796+0000 7f08c6200700 1 Processor -- start 2024-03-16T20:55:17.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.796+0000 7f08c6200700 1 -- start start 2024-03-16T20:55:17.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.796+0000 7f08c6200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c0076990 0x7f08c019e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:17.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08c6200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08c0077be0 0x7f08c019ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:17.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08c6200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c00785a0 0x7f08c01a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:17.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08c6200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c01a6290 con 0x7f08c0077be0 2024-03-16T20:55:17.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08c6200700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c01a63d0 con 0x7f08c00785a0 2024-03-16T20:55:17.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08c6200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c01a6560 con 0x7f08c0076990 2024-03-16T20:55:17.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08bf400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c0076990 0x7f08c019e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:17.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08bf400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c0076990 0x7f08c019e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59012/0 (socket says 172.21.15.8:59012) 2024-03-16T20:55:17.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08bf400700 1 -- 172.21.15.8:0/3159490633 learned_addr learned my addr 172.21.15.8:0/3159490633 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:17.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08bfe00700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c00785a0 0x7f08c01a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:17.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08bea00700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08c0077be0 0x7f08c019ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:17.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08bf400700 1 -- 172.21.15.8:0/3159490633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c00785a0 msgr2=0x7f08c01a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:17.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08bf400700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c00785a0 0x7f08c01a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:17.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08bf400700 1 -- 172.21.15.8:0/3159490633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08c0077be0 msgr2=0x7f08c019ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:17.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08bf400700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08c0077be0 0x7f08c019ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:17.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08bf400700 1 -- 172.21.15.8:0/3159490633 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8009d00 con 0x7f08c0076990 2024-03-16T20:55:17.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.797+0000 7f08bea00700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08c0077be0 0x7f08c019ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:55:17.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.798+0000 7f08bf400700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c0076990 0x7f08c019e700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f08b000e9d0 tx=0x7f08b000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:17.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.798+0000 7f08b7e00700 1 -- 172.21.15.8:0/3159490633 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0009790 con 0x7f08c0076990 2024-03-16T20:55:17.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.798+0000 7f08b7e00700 1 -- 172.21.15.8:0/3159490633 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f08b000cbd0 con 0x7f08c0076990 2024-03-16T20:55:17.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.798+0000 7f08b7e00700 1 -- 172.21.15.8:0/3159490633 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0018680 con 0x7f08c0076990 2024-03-16T20:55:17.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.798+0000 7f08c6200700 1 -- 172.21.15.8:0/3159490633 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c01a6840 con 0x7f08c0076990 2024-03-16T20:55:17.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.798+0000 7f08c6200700 1 -- 172.21.15.8:0/3159490633 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c01a6cf0 con 0x7f08c0076990 2024-03-16T20:55:17.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.799+0000 7f08c6200700 1 -- 172.21.15.8:0/3159490633 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c0110c70 con 0x7f08c0076990 2024-03-16T20:55:17.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.801+0000 7f08b7e00700 1 -- 172.21.15.8:0/3159490633 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f08b000cd40 con 0x7f08c0076990 2024-03-16T20:55:17.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.802+0000 7f08b7e00700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f08a40a1c80 0x7f08a40a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:17.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.802+0000 7f08b7e00700 1 -- 172.21.15.8:0/3159490633 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f08b0014070 con 0x7f08c0076990 2024-03-16T20:55:17.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.803+0000 7f08bea00700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f08a40a1c80 0x7f08a40a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:17.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.803+0000 7f08bea00700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f08a40a1c80 0x7f08a40a4140 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009cb0 tx=0x7f08ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:17.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:17.806+0000 7f08b7e00700 1 -- 172.21.15.8:0/3159490633 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f08b0053280 con 0x7f08c0076990 2024-03-16T20:55:18.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.122+0000 7f08c6200700 1 -- 172.21.15.8:0/3159490633 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f08c00504f0 con 0x7f08c0076990 2024-03-16T20:55:18.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.129+0000 7f08b7e00700 1 -- 172.21.15.8:0/3159490633 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f08b0096860 con 0x7f08c0076990 2024-03-16T20:55:18.133 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2024-03-16T20:55:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQA2B/ZlinlqBxAAmIaM1SCkztx8zch7tuy45A== 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.132+0000 7f08c6200700 1 -- 172.21.15.8:0/3159490633 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f08a40a1c80 msgr2=0x7f08a40a4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.132+0000 7f08c6200700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f08a40a1c80 0x7f08a40a4140 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009cb0 tx=0x7f08ac009260 comp rx=0 tx=0).stop 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.132+0000 7f08c6200700 1 -- 172.21.15.8:0/3159490633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c0076990 msgr2=0x7f08c019e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.132+0000 7f08c6200700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c0076990 0x7f08c019e700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f08b000e9d0 tx=0x7f08b000ece0 comp rx=0 tx=0).stop 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.133+0000 7f08c6200700 1 -- 172.21.15.8:0/3159490633 shutdown_connections 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.133+0000 7f08c6200700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f08a40a1c80 0x7f08a40a4140 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.133+0000 7f08c6200700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c00785a0 0x7f08c01a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.133+0000 7f08c6200700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c0076990 0x7f08c019e700 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.133+0000 7f08c6200700 1 --2- 172.21.15.8:0/3159490633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08c0077be0 0x7f08c019ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.133+0000 7f08c6200700 1 -- 172.21.15.8:0/3159490633 >> 172.21.15.8:0/3159490633 conn(0x7f08c00ff800 msgr2=0x7f08c0101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.133+0000 7f08c6200700 1 -- 172.21.15.8:0/3159490633 shutdown_connections 2024-03-16T20:55:18.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:18.133+0000 7f08c6200700 1 -- 172.21.15.8:0/3159490633 wait complete. 2024-03-16T20:55:18.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:18 smithi008 ceph-mon[31434]: pgmap v323: 97 pgs: 97 active+clean; 624 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2024-03-16T20:55:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:18 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3159490633' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-16T20:55:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:18 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-16T20:55:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:18 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-16T20:55:18.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:18 smithi170 ceph-mon[35947]: pgmap v323: 97 pgs: 97 active+clean; 624 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2024-03-16T20:55:18.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:18 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3159490633' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-16T20:55:18.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:18 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-16T20:55:18.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:18 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-16T20:55:18.884 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:55:18.884 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-16T20:55:18.884 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-16T20:55:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:18 smithi186 ceph-mon[36391]: pgmap v323: 97 pgs: 97 active+clean; 624 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2024-03-16T20:55:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:18 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3159490633' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-16T20:55:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:18 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-16T20:55:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:18 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-16T20:55:19.055 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-16T20:55:19.055 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-16T20:55:19.055 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph mgr dump --format=json 2024-03-16T20:55:19.584 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:20.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:20 smithi008 ceph-mon[31434]: pgmap v324: 97 pgs: 97 active+clean; 624 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2024-03-16T20:55:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:20 smithi170 ceph-mon[35947]: pgmap v324: 97 pgs: 97 active+clean; 624 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2024-03-16T20:55:20.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:20 smithi186 ceph-mon[36391]: pgmap v324: 97 pgs: 97 active+clean; 624 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2024-03-16T20:55:21.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.889+0000 7fad77800700 1 -- 172.21.15.8:0/201398999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad7006a630 msgr2=0x7fad7010ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:21.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.889+0000 7fad77800700 1 --2- 172.21.15.8:0/201398999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad7006a630 0x7fad7010ee70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fad6800b0a0 tx=0x7fad6800b3b0 comp rx=0 tx=0).stop 2024-03-16T20:55:21.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.889+0000 7fad77800700 1 -- 172.21.15.8:0/201398999 shutdown_connections 2024-03-16T20:55:21.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.889+0000 7fad77800700 1 --2- 172.21.15.8:0/201398999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad7006a630 0x7fad7010ee70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:21.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.889+0000 7fad77800700 1 --2- 172.21.15.8:0/201398999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad70108030 0x7fad70108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:21.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.889+0000 7fad77800700 1 --2- 172.21.15.8:0/201398999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad70069c90 0x7fad7006a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:21.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.889+0000 7fad77800700 1 -- 172.21.15.8:0/201398999 >> 172.21.15.8:0/201398999 conn(0x7fad70077e10 msgr2=0x7fad70078220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:21.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.889+0000 7fad77800700 1 -- 172.21.15.8:0/201398999 shutdown_connections 2024-03-16T20:55:21.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.890+0000 7fad77800700 1 -- 172.21.15.8:0/201398999 wait complete. 2024-03-16T20:55:21.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad77800700 1 Processor -- start 2024-03-16T20:55:21.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad77800700 1 -- start start 2024-03-16T20:55:21.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad77800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad70069c90 0x7fad701a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:21.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad77800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad7006a630 0x7fad701a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:21.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad77800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70108030 0x7fad7019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:21.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad77800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7019af70 con 0x7fad7006a630 2024-03-16T20:55:21.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad77800700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7019b0e0 con 0x7fad70108030 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad77800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7019b2a0 con 0x7fad70069c90 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad74e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad70069c90 0x7fad701a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad75800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70108030 0x7fad7019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad74e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad70069c90 0x7fad701a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:45316/0 (socket says 172.21.15.8:45316) 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.891+0000 7fad74e00700 1 -- 172.21.15.8:0/3760513523 learned_addr learned my addr 172.21.15.8:0/3760513523 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.892+0000 7fad6fe00700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad7006a630 0x7fad701a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.892+0000 7fad75800700 1 -- 172.21.15.8:0/3760513523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad70069c90 msgr2=0x7fad701a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.892+0000 7fad75800700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad70069c90 0x7fad701a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.892+0000 7fad75800700 1 -- 172.21.15.8:0/3760513523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad7006a630 msgr2=0x7fad701a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.892+0000 7fad75800700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad7006a630 0x7fad701a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.892+0000 7fad75800700 1 -- 172.21.15.8:0/3760513523 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68009d00 con 0x7fad70108030 2024-03-16T20:55:21.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.892+0000 7fad74e00700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad70069c90 0x7fad701a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.892+0000 7fad75800700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70108030 0x7fad7019a7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad68009fd0 tx=0x7fad68004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.892+0000 7fad6d600700 1 -- 172.21.15.8:0/3760513523 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6800e040 con 0x7fad70108030 2024-03-16T20:55:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.892+0000 7fad6d600700 1 -- 172.21.15.8:0/3760513523 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fad68009410 con 0x7fad70108030 2024-03-16T20:55:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.893+0000 7fad77800700 1 -- 172.21.15.8:0/3760513523 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7019b520 con 0x7fad70108030 2024-03-16T20:55:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.893+0000 7fad6d600700 1 -- 172.21.15.8:0/3760513523 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad680052a0 con 0x7fad70108030 2024-03-16T20:55:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.893+0000 7fad77800700 1 -- 172.21.15.8:0/3760513523 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad701a7620 con 0x7fad70108030 2024-03-16T20:55:21.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.894+0000 7fad77800700 1 -- 172.21.15.8:0/3760513523 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad701036e0 con 0x7fad70108030 2024-03-16T20:55:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.896+0000 7fad6d600700 1 -- 172.21.15.8:0/3760513523 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fad6801d470 con 0x7fad70108030 2024-03-16T20:55:21.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.897+0000 7fad6d600700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fad580a1bd0 0x7fad580a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:21.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.897+0000 7fad6d600700 1 -- 172.21.15.8:0/3760513523 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fad680ce6f0 con 0x7fad70108030 2024-03-16T20:55:21.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.897+0000 7fad74e00700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fad580a1bd0 0x7fad580a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:21.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.898+0000 7fad74e00700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fad580a1bd0 0x7fad580a4090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fad64011550 tx=0x7fad64009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:21.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:21.905+0000 7fad6d600700 1 -- 172.21.15.8:0/3760513523 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fad680978e0 con 0x7fad70108030 2024-03-16T20:55:22.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.192+0000 7fad77800700 1 -- 172.21.15.8:0/3760513523 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fad70112190 con 0x7fad70108030 2024-03-16T20:55:22.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.202+0000 7fad6d600700 1 -- 172.21.15.8:0/3760513523 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260654 (secure 0 0 0) 0x7fad6809afa0 con 0x7fad70108030 2024-03-16T20:55:22.207 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.207+0000 7fad77800700 1 -- 172.21.15.8:0/3760513523 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fad580a1bd0 msgr2=0x7fad580a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.207+0000 7fad77800700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fad580a1bd0 0x7fad580a4090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fad64011550 tx=0x7fad64009260 comp rx=0 tx=0).stop 2024-03-16T20:55:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.207+0000 7fad77800700 1 -- 172.21.15.8:0/3760513523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70108030 msgr2=0x7fad7019a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.207+0000 7fad77800700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70108030 0x7fad7019a7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad68009fd0 tx=0x7fad68004c80 comp rx=0 tx=0).stop 2024-03-16T20:55:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.207+0000 7fad77800700 1 -- 172.21.15.8:0/3760513523 shutdown_connections 2024-03-16T20:55:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.207+0000 7fad77800700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fad580a1bd0 0x7fad580a4090 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.207+0000 7fad77800700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70108030 0x7fad7019a7c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.207+0000 7fad77800700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad70069c90 0x7fad701a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.207+0000 7fad77800700 1 --2- 172.21.15.8:0/3760513523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad7006a630 0x7fad701a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.207+0000 7fad77800700 1 -- 172.21.15.8:0/3760513523 >> 172.21.15.8:0/3760513523 conn(0x7fad70077e10 msgr2=0x7fad700ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.208+0000 7fad77800700 1 -- 172.21.15.8:0/3760513523 shutdown_connections 2024-03-16T20:55:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:22.208+0000 7fad77800700 1 -- 172.21.15.8:0/3760513523 wait complete. 2024-03-16T20:55:22.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:22 smithi008 ceph-mon[31434]: pgmap v325: 97 pgs: 97 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.2 KiB/s wr, 15 op/s 2024-03-16T20:55:22.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:22 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3760513523' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-16T20:55:22.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:22 smithi170 ceph-mon[35947]: pgmap v325: 97 pgs: 97 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.2 KiB/s wr, 15 op/s 2024-03-16T20:55:22.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:22 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3760513523' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-16T20:55:22.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:22 smithi186 ceph-mon[36391]: pgmap v325: 97 pgs: 97 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.2 KiB/s wr, 15 op/s 2024-03-16T20:55:22.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:22 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3760513523' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-16T20:55:23.081 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1064583862},{"type":"v1","addr":"172.21.15.8:6801","nonce":1064583862}]},"active_addr":"172.21.15.8:6801/1064583862","active_change":"2024-03-16T20:47:02.936261+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.8:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":2780502436}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":4186367083}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":3503977705}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":3780969288}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":1800563359}]}]} 2024-03-16T20:55:23.087 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-16T20:55:23.087 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-16T20:55:23.088 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd dump --format=json 2024-03-16T20:55:23.568 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:24.663 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:24 smithi008 ceph-mon[31434]: pgmap v326: 97 pgs: 97 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-03-16T20:55:24.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:24 smithi170 ceph-mon[35947]: pgmap v326: 97 pgs: 97 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-03-16T20:55:24.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:24 smithi186 ceph-mon[36391]: pgmap v326: 97 pgs: 97 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-03-16T20:55:25.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.949+0000 7f9d41200700 1 -- 172.21.15.8:0/785510002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3c106110 msgr2=0x7f9d3c10dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:25.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.949+0000 7f9d41200700 1 --2- 172.21.15.8:0/785510002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3c106110 0x7f9d3c10dce0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009f90 tx=0x7f9d3400b330 comp rx=0 tx=0).stop 2024-03-16T20:55:25.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.949+0000 7f9d41200700 1 -- 172.21.15.8:0/785510002 shutdown_connections 2024-03-16T20:55:25.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.949+0000 7f9d41200700 1 --2- 172.21.15.8:0/785510002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3c101030 0x7f9d3c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:25.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.949+0000 7f9d41200700 1 --2- 172.21.15.8:0/785510002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3c106110 0x7f9d3c10dce0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:25.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.949+0000 7f9d41200700 1 --2- 172.21.15.8:0/785510002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d3c1019e0 0x7f9d3c105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:25.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.949+0000 7f9d41200700 1 -- 172.21.15.8:0/785510002 >> 172.21.15.8:0/785510002 conn(0x7f9d3c0fc8a0 msgr2=0x7f9d3c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:25.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.949+0000 7f9d41200700 1 -- 172.21.15.8:0/785510002 shutdown_connections 2024-03-16T20:55:25.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.949+0000 7f9d41200700 1 -- 172.21.15.8:0/785510002 wait complete. 2024-03-16T20:55:25.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.950+0000 7f9d41200700 1 Processor -- start 2024-03-16T20:55:25.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.951+0000 7f9d41200700 1 -- start start 2024-03-16T20:55:25.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.951+0000 7f9d41200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3c101030 0x7f9d3c1a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.951+0000 7f9d41200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3c1019e0 0x7f9d3c1a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.951+0000 7f9d41200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d3c106110 0x7f9d3c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.951+0000 7f9d41200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c19ae00 con 0x7f9d3c101030 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.951+0000 7f9d41200700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c19af70 con 0x7f9d3c106110 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.951+0000 7f9d41200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c19b130 con 0x7f9d3c1019e0 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.951+0000 7f9d3b400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3c101030 0x7f9d3c1a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.951+0000 7f9d33e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3c1019e0 0x7f9d3c1a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.951+0000 7f9d3b400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3c101030 0x7f9d3c1a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43298/0 (socket says 172.21.15.8:43298) 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.951+0000 7f9d3b400700 1 -- 172.21.15.8:0/1845534433 learned_addr learned my addr 172.21.15.8:0/1845534433 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.952+0000 7f9d3be00700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d3c106110 0x7f9d3c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.952+0000 7f9d33e00700 1 -- 172.21.15.8:0/1845534433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d3c106110 msgr2=0x7f9d3c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.952+0000 7f9d33e00700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d3c106110 0x7f9d3c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:25.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.952+0000 7f9d33e00700 1 -- 172.21.15.8:0/1845534433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3c101030 msgr2=0x7f9d3c1a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:25.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.952+0000 7f9d33e00700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3c101030 0x7f9d3c1a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:25.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.952+0000 7f9d33e00700 1 -- 172.21.15.8:0/1845534433 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d240095f0 con 0x7f9d3c1019e0 2024-03-16T20:55:25.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.952+0000 7f9d33e00700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3c1019e0 0x7f9d3c1a0ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9d24005fd0 tx=0x7f9d2400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:25.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.952+0000 7f9d38c00700 1 -- 172.21.15.8:0/1845534433 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2400cbd0 con 0x7f9d3c1019e0 2024-03-16T20:55:25.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.952+0000 7f9d38c00700 1 -- 172.21.15.8:0/1845534433 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9d24004520 con 0x7f9d3c1019e0 2024-03-16T20:55:25.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.952+0000 7f9d38c00700 1 -- 172.21.15.8:0/1845534433 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24010430 con 0x7f9d3c1019e0 2024-03-16T20:55:25.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.952+0000 7f9d41200700 1 -- 172.21.15.8:0/1845534433 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d34009c40 con 0x7f9d3c1019e0 2024-03-16T20:55:25.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.953+0000 7f9d41200700 1 -- 172.21.15.8:0/1845534433 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3c1a7500 con 0x7f9d3c1019e0 2024-03-16T20:55:25.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.954+0000 7f9d41200700 1 -- 172.21.15.8:0/1845534433 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3c1041a0 con 0x7f9d3c1019e0 2024-03-16T20:55:25.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.955+0000 7f9d38c00700 1 -- 172.21.15.8:0/1845534433 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f9d24003680 con 0x7f9d3c1019e0 2024-03-16T20:55:25.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.957+0000 7f9d38c00700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d200a1bd0 0x7f9d200a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:25.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.957+0000 7f9d38c00700 1 -- 172.21.15.8:0/1845534433 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9d24014070 con 0x7f9d3c1019e0 2024-03-16T20:55:25.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.957+0000 7f9d3b400700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d200a1bd0 0x7f9d200a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:25.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.958+0000 7f9d3b400700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d200a1bd0 0x7f9d200a4090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009d20 tx=0x7f9d2c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:25.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:25.961+0000 7f9d38c00700 1 -- 172.21.15.8:0/1845534433 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9d240968c0 con 0x7f9d3c1019e0 2024-03-16T20:55:26.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.186+0000 7f9d41200700 1 -- 172.21.15.8:0/1845534433 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d3c19bb80 con 0x7f9d3c1019e0 2024-03-16T20:55:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.188+0000 7f9d38c00700 1 -- 172.21.15.8:0/1845534433 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22148 (secure 0 0 0) 0x7f9d24099f80 con 0x7f9d3c1019e0 2024-03-16T20:55:26.193 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:26.194 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:55:06.246550+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:55:26.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 -- 172.21.15.8:0/1845534433 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d200a1bd0 msgr2=0x7f9d200a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:26.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d200a1bd0 0x7f9d200a4090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009d20 tx=0x7f9d2c009260 comp rx=0 tx=0).stop 2024-03-16T20:55:26.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 -- 172.21.15.8:0/1845534433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3c1019e0 msgr2=0x7f9d3c1a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:26.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3c1019e0 0x7f9d3c1a0ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9d24005fd0 tx=0x7f9d2400ee70 comp rx=0 tx=0).stop 2024-03-16T20:55:26.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 -- 172.21.15.8:0/1845534433 shutdown_connections 2024-03-16T20:55:26.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d200a1bd0 0x7f9d200a4090 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:26.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d3c101030 0x7f9d3c1a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:26.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d3c106110 0x7f9d3c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:26.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 --2- 172.21.15.8:0/1845534433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3c1019e0 0x7f9d3c1a0ac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:26.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 -- 172.21.15.8:0/1845534433 >> 172.21.15.8:0/1845534433 conn(0x7f9d3c0fc8a0 msgr2=0x7f9d3c10c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:26.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 -- 172.21.15.8:0/1845534433 shutdown_connections 2024-03-16T20:55:26.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:26.191+0000 7f9d41200700 1 -- 172.21.15.8:0/1845534433 wait complete. 2024-03-16T20:55:26.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:26 smithi008 ceph-mon[31434]: pgmap v327: 97 pgs: 97 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-03-16T20:55:26.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:26 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1845534433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:26.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:26 smithi170 ceph-mon[35947]: pgmap v327: 97 pgs: 97 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-03-16T20:55:26.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:26 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1845534433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:26.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:26 smithi186 ceph-mon[36391]: pgmap v327: 97 pgs: 97 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-03-16T20:55:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:26 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1845534433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:27.094 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-16T20:55:27.094 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd dump --format=json 2024-03-16T20:55:27.560 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:28.740 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:28 smithi008 ceph-mon[31434]: pgmap v328: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-03-16T20:55:28.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:28 smithi170 ceph-mon[35947]: pgmap v328: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-03-16T20:55:28.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:28 smithi186 ceph-mon[36391]: pgmap v328: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-03-16T20:55:29.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.667+0000 7f9af9000700 1 -- 172.21.15.8:0/363211081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af4108ef0 msgr2=0x7f9af4115360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:29.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.667+0000 7f9af9000700 1 --2- 172.21.15.8:0/363211081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af4108ef0 0x7f9af4115360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00b0a0 tx=0x7f9aec00b3b0 comp rx=0 tx=0).stop 2024-03-16T20:55:29.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.667+0000 7f9af9000700 1 -- 172.21.15.8:0/363211081 shutdown_connections 2024-03-16T20:55:29.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.667+0000 7f9af9000700 1 --2- 172.21.15.8:0/363211081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af4108ef0 0x7f9af4115360 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:29.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.667+0000 7f9af9000700 1 --2- 172.21.15.8:0/363211081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af410e590 0x7f9af410e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:29.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.667+0000 7f9af9000700 1 --2- 172.21.15.8:0/363211081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9af4108530 0x7f9af41089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:29.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.667+0000 7f9af9000700 1 -- 172.21.15.8:0/363211081 >> 172.21.15.8:0/363211081 conn(0x7f9af4077c80 msgr2=0x7f9af407a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:29.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.667+0000 7f9af9000700 1 -- 172.21.15.8:0/363211081 shutdown_connections 2024-03-16T20:55:29.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.667+0000 7f9af9000700 1 -- 172.21.15.8:0/363211081 wait complete. 2024-03-16T20:55:29.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.669+0000 7f9af9000700 1 Processor -- start 2024-03-16T20:55:29.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.669+0000 7f9af9000700 1 -- start start 2024-03-16T20:55:29.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.669+0000 7f9af9000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af4108530 0x7f9af41a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:29.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.669+0000 7f9af9000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9af4108ef0 0x7f9af41a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:29.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af9000700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af410e590 0x7f9af419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:29.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af9000700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af419ef70 con 0x7f9af4108ef0 2024-03-16T20:55:29.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af9000700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af419f0b0 con 0x7f9af410e590 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af9000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af419f270 con 0x7f9af4108530 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af3e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af410e590 0x7f9af419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af2a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9af4108ef0 0x7f9af41a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af3400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af4108530 0x7f9af41a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af3e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af410e590 0x7f9af419e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:59338/0 (socket says 172.21.15.8:59338) 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af3e00700 1 -- 172.21.15.8:0/130872221 learned_addr learned my addr 172.21.15.8:0/130872221 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af3400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af4108530 0x7f9af41a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47460/0 (socket says 172.21.15.8:47460) 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af3e00700 1 -- 172.21.15.8:0/130872221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af4108530 msgr2=0x7f9af41a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af3e00700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af4108530 0x7f9af41a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af3e00700 1 -- 172.21.15.8:0/130872221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9af4108ef0 msgr2=0x7f9af41a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af3e00700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9af4108ef0 0x7f9af41a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:29.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.670+0000 7f9af3e00700 1 -- 172.21.15.8:0/130872221 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec009d00 con 0x7f9af410e590 2024-03-16T20:55:29.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.671+0000 7f9af3e00700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af410e590 0x7f9af419e910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009fd0 tx=0x7f9aec004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:29.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.671+0000 7f9aebe00700 1 -- 172.21.15.8:0/130872221 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00e040 con 0x7f9af410e590 2024-03-16T20:55:29.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.671+0000 7f9aebe00700 1 -- 172.21.15.8:0/130872221 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9aec00be20 con 0x7f9af410e590 2024-03-16T20:55:29.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.671+0000 7f9aebe00700 1 -- 172.21.15.8:0/130872221 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0053b0 con 0x7f9af410e590 2024-03-16T20:55:29.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.671+0000 7f9af9000700 1 -- 172.21.15.8:0/130872221 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af419f4f0 con 0x7f9af410e590 2024-03-16T20:55:29.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.671+0000 7f9af9000700 1 -- 172.21.15.8:0/130872221 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af41ab7f0 con 0x7f9af410e590 2024-03-16T20:55:29.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.672+0000 7f9af9000700 1 -- 172.21.15.8:0/130872221 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af4068ca0 con 0x7f9af410e590 2024-03-16T20:55:29.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.674+0000 7f9aebe00700 1 -- 172.21.15.8:0/130872221 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f9aec005510 con 0x7f9af410e590 2024-03-16T20:55:29.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.675+0000 7f9aebe00700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ad80a1bd0 0x7f9ad80a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:29.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.676+0000 7f9aebe00700 1 -- 172.21.15.8:0/130872221 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9aec0ce900 con 0x7f9af410e590 2024-03-16T20:55:29.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.676+0000 7f9af3400700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ad80a1bd0 0x7f9ad80a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:29.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.676+0000 7f9af3400700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ad80a1bd0 0x7f9ad80a4090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9af419fa50 tx=0x7f9ae4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:29.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.678+0000 7f9aebe00700 1 -- 172.21.15.8:0/130872221 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9aec097af0 con 0x7f9af410e590 2024-03-16T20:55:29.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.904+0000 7f9af9000700 1 -- 172.21.15.8:0/130872221 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9af4118730 con 0x7f9af410e590 2024-03-16T20:55:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.906+0000 7f9aebe00700 1 -- 172.21.15.8:0/130872221 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22148 (secure 0 0 0) 0x7f9aec09b1b0 con 0x7f9af410e590 2024-03-16T20:55:29.911 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:55:29.913 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:55:06.246550+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:55:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.909+0000 7f9af9000700 1 -- 172.21.15.8:0/130872221 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ad80a1bd0 msgr2=0x7f9ad80a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.909+0000 7f9af9000700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ad80a1bd0 0x7f9ad80a4090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9af419fa50 tx=0x7f9ae4009260 comp rx=0 tx=0).stop 2024-03-16T20:55:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.909+0000 7f9af9000700 1 -- 172.21.15.8:0/130872221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af410e590 msgr2=0x7f9af419e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.909+0000 7f9af9000700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af410e590 0x7f9af419e910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009fd0 tx=0x7f9aec004c80 comp rx=0 tx=0).stop 2024-03-16T20:55:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.909+0000 7f9af9000700 1 -- 172.21.15.8:0/130872221 shutdown_connections 2024-03-16T20:55:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.909+0000 7f9af9000700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9ad80a1bd0 0x7f9ad80a4090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.909+0000 7f9af9000700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af410e590 0x7f9af419e910 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.909+0000 7f9af9000700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9af4108530 0x7f9af41a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.909+0000 7f9af9000700 1 --2- 172.21.15.8:0/130872221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9af4108ef0 0x7f9af41a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.909+0000 7f9af9000700 1 -- 172.21.15.8:0/130872221 >> 172.21.15.8:0/130872221 conn(0x7f9af4077c80 msgr2=0x7f9af4079080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.909+0000 7f9af9000700 1 -- 172.21.15.8:0/130872221 shutdown_connections 2024-03-16T20:55:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:29.910+0000 7f9af9000700 1 -- 172.21.15.8:0/130872221 wait complete. 2024-03-16T20:55:30.679 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:30 smithi008 ceph-mon[31434]: pgmap v329: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-16T20:55:30.679 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:30 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/130872221' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:30.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-16T20:55:30.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-16T20:55:30.754 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-16T20:55:30.754 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-16T20:55:30.754 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-16T20:55:30.755 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-16T20:55:30.755 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-03-16T20:55:30.755 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-03-16T20:55:30.756 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2024-03-16T20:55:30.756 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2024-03-16T20:55:30.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2024-03-16T20:55:30.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2024-03-16T20:55:30.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:30 smithi170 ceph-mon[35947]: pgmap v329: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-16T20:55:30.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:30 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/130872221' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:30.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:30 smithi186 ceph-mon[36391]: pgmap v329: 97 pgs: 97 active+clean; 635 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-16T20:55:30.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:30 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/130872221' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:55:31.832 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:31.841 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:31.862 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:32.006 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:32.010 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:32.013 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:32.015 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:32.017 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:32.020 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:32.670 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:32 smithi008 ceph-mon[31434]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-16T20:55:32.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:32 smithi170 ceph-mon[35947]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-16T20:55:32.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:32 smithi186 ceph-mon[36391]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-16T20:55:34.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:34 smithi008 ceph-mon[31434]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:55:34.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:34 smithi170 ceph-mon[35947]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:55:34.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:34 smithi186 ceph-mon[36391]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:55:36.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:36 smithi008 ceph-mon[31434]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:55:36.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:36 smithi170 ceph-mon[35947]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:55:36.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:36 smithi186 ceph-mon[36391]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:55:38.695 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:38 smithi186 ceph-mon[36391]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:55:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:38 smithi008 ceph-mon[31434]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:55:38.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:38 smithi170 ceph-mon[35947]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:55:40.452 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:40.456 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:40.713 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:40 smithi008 ceph-mon[31434]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-16T20:55:40.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:40 smithi170 ceph-mon[35947]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-16T20:55:40.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:40 smithi186 ceph-mon[36391]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-16T20:55:42.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.525+0000 7fce95a00700 1 -- 172.21.15.8:0/3504656530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce90069c90 msgr2=0x7fce9006a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.525+0000 7fce95a00700 1 --2- 172.21.15.8:0/3504656530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce90069c90 0x7fce9006a0f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009990 tx=0x7fce7c009ca0 comp rx=0 tx=0).stop 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.525+0000 7fce95a00700 1 -- 172.21.15.8:0/3504656530 shutdown_connections 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.525+0000 7fce95a00700 1 --2- 172.21.15.8:0/3504656530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce90108030 0x7fce90108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.525+0000 7fce95a00700 1 --2- 172.21.15.8:0/3504656530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce9006a630 0x7fce9010ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.525+0000 7fce95a00700 1 --2- 172.21.15.8:0/3504656530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce90069c90 0x7fce9006a0f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.525+0000 7fce95a00700 1 -- 172.21.15.8:0/3504656530 >> 172.21.15.8:0/3504656530 conn(0x7fce90077e10 msgr2=0x7fce90078220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.525+0000 7fce95a00700 1 -- 172.21.15.8:0/3504656530 shutdown_connections 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.525+0000 7fce95a00700 1 -- 172.21.15.8:0/3504656530 wait complete. 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.526+0000 7fce95a00700 1 Processor -- start 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.526+0000 7fce95a00700 1 -- start start 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.527+0000 7fce95a00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce90069c90 0x7fce901a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:42.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.527+0000 7fce95a00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce9006a630 0x7fce901a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.527+0000 7fce95a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce90108030 0x7fce9019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.527+0000 7fce95a00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9019ac80 con 0x7fce90108030 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.527+0000 7fce95a00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9019adc0 con 0x7fce90069c90 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.527+0000 7fce95a00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9019af80 con 0x7fce9006a630 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.527+0000 7fce8ea00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce90069c90 0x7fce901a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.527+0000 7fce8ea00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce90069c90 0x7fce901a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48084/0 (socket says 172.21.15.8:48084) 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.527+0000 7fce8ea00700 1 -- 172.21.15.8:0/524715897 learned_addr learned my addr 172.21.15.8:0/524715897 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.527+0000 7fce8e000700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce9006a630 0x7fce901a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.527+0000 7fce8f400700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce90108030 0x7fce9019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.528+0000 7fce8ea00700 1 -- 172.21.15.8:0/524715897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce9006a630 msgr2=0x7fce901a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.528+0000 7fce8ea00700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce9006a630 0x7fce901a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.528+0000 7fce8ea00700 1 -- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce90108030 msgr2=0x7fce9019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.528+0000 7fce8ea00700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce90108030 0x7fce9019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:42.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.528+0000 7fce8ea00700 1 -- 172.21.15.8:0/524715897 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c0095f0 con 0x7fce90069c90 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.528+0000 7fce8ea00700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce90069c90 0x7fce901a0460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce8000d980 tx=0x7fce8000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.528+0000 7fce87400700 1 -- 172.21.15.8:0/524715897 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80004220 con 0x7fce90069c90 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.528+0000 7fce87400700 1 -- 172.21.15.8:0/524715897 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fce80007640 con 0x7fce90069c90 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.528+0000 7fce87400700 1 -- 172.21.15.8:0/524715897 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8000b750 con 0x7fce90069c90 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.528+0000 7fce95a00700 1 -- 172.21.15.8:0/524715897 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9019b260 con 0x7fce90069c90 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.528+0000 7fce95a00700 1 -- 172.21.15.8:0/524715897 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce901a7500 con 0x7fce90069c90 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.529+0000 7fce95a00700 1 -- 172.21.15.8:0/524715897 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce901036e0 con 0x7fce90069c90 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.534+0000 7fce87400700 1 -- 172.21.15.8:0/524715897 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fce8000b8b0 con 0x7fce90069c90 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.536+0000 7fce87400700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fce740a1b50 0x7fce740a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.536+0000 7fce87400700 1 -- 172.21.15.8:0/524715897 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fce800cd8d0 con 0x7fce90069c90 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.536+0000 7fce8e000700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fce740a1b50 0x7fce740a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.537+0000 7fce87400700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660] conn(0x7fce740ab330 0x7fce740ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.537+0000 7fce87400700 1 -- 172.21.15.8:0/524715897 --> [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce740ade00 con 0x7fce740ab330 2024-03-16T20:55:42.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.537+0000 7fce87400700 1 -- 172.21.15.8:0/524715897 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce800cdc40 con 0x7fce90069c90 2024-03-16T20:55:42.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.537+0000 7fce8f400700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660] conn(0x7fce740ab330 0x7fce740ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:42.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.537+0000 7fce8e000700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fce740a1b50 0x7fce740a4010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fce90102f30 tx=0x7fce7c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:42.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.538+0000 7fce8f400700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660] conn(0x7fce740ab330 0x7fce740ad750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:42.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.539+0000 7fce87400700 1 -- 172.21.15.8:0/524715897 <== osd.9 v2:172.21.15.8:6826/882658660 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fce740ade00 con 0x7fce740ab330 2024-03-16T20:55:42.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.558+0000 7fce95a00700 1 -- 172.21.15.8:0/524715897 --> [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fce90112490 con 0x7fce740ab330 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.558+0000 7fce87400700 1 -- 172.21.15.8:0/524715897 <== osd.9 v2:172.21.15.8:6826/882658660 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fce90112490 con 0x7fce740ab330 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.559+0000 7fce95a00700 1 -- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660] conn(0x7fce740ab330 msgr2=0x7fce740ad750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.559+0000 7fce95a00700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660] conn(0x7fce740ab330 0x7fce740ad750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.559+0000 7fce95a00700 1 -- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fce740a1b50 msgr2=0x7fce740a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.559+0000 7fce95a00700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fce740a1b50 0x7fce740a4010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fce90102f30 tx=0x7fce7c005fd0 comp rx=0 tx=0).stop 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.559+0000 7fce95a00700 1 -- 172.21.15.8:0/524715897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce90069c90 msgr2=0x7fce901a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.559+0000 7fce95a00700 1 --2- 172.21.15.8:0/524715897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce90069c90 0x7fce901a0460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce8000d980 tx=0x7fce8000dc90 comp rx=0 tx=0).stop 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.560+0000 7fce8f400700 1 -- 172.21.15.8:0/524715897 reap_dead start 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.560+0000 7fce95a00700 1 -- 172.21.15.8:0/524715897 shutdown_connections 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.560+0000 7fce95a00700 1 -- 172.21.15.8:0/524715897 >> 172.21.15.8:0/524715897 conn(0x7fce90077e10 msgr2=0x7fce9010d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.560+0000 7fce95a00700 1 -- 172.21.15.8:0/524715897 shutdown_connections 2024-03-16T20:55:42.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:42.560+0000 7fce95a00700 1 -- 172.21.15.8:0/524715897 wait complete. 2024-03-16T20:55:42.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:42 smithi008 ceph-mon[31434]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-03-16T20:55:42.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:42 smithi170 ceph-mon[35947]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-03-16T20:55:42.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:42 smithi186 ceph-mon[36391]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-03-16T20:55:44.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.100+0000 7f424aa00700 1 -- 172.21.15.8:0/3850963662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4244101880 msgr2=0x7f424410dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.100+0000 7f424aa00700 1 --2- 172.21.15.8:0/3850963662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4244101880 0x7f424410dd60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f423c00b0a0 tx=0x7f423c00b3b0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.100+0000 7f424aa00700 1 -- 172.21.15.8:0/3850963662 shutdown_connections 2024-03-16T20:55:44.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.100+0000 7f424aa00700 1 --2- 172.21.15.8:0/3850963662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4244101880 0x7f424410dd60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.100+0000 7f424aa00700 1 --2- 172.21.15.8:0/3850963662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4244106f20 0x7f4244107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.100+0000 7f424aa00700 1 --2- 172.21.15.8:0/3850963662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4244100ee0 0x7f4244101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.100+0000 7f424aa00700 1 -- 172.21.15.8:0/3850963662 >> 172.21.15.8:0/3850963662 conn(0x7f4244077e10 msgr2=0x7f4244078220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:44.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.100+0000 7f424aa00700 1 -- 172.21.15.8:0/3850963662 shutdown_connections 2024-03-16T20:55:44.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.100+0000 7f424aa00700 1 -- 172.21.15.8:0/3850963662 wait complete. 2024-03-16T20:55:44.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.102+0000 7f424aa00700 1 Processor -- start 2024-03-16T20:55:44.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.102+0000 7f424aa00700 1 -- start start 2024-03-16T20:55:44.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.102+0000 7f424aa00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4244100ee0 0x7f4244102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:44.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.102+0000 7f424aa00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4244101880 0x7f4244103360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:44.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.102+0000 7f424aa00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4244106f20 0x7f42441038a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:44.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.102+0000 7f424aa00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42441a6b80 con 0x7f4244106f20 2024-03-16T20:55:44.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.102+0000 7f424aa00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42441a6cf0 con 0x7f4244101880 2024-03-16T20:55:44.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.102+0000 7f424aa00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42441a6eb0 con 0x7f4244100ee0 2024-03-16T20:55:44.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.103+0000 7f4243e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4244100ee0 0x7f4244102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:44.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.103+0000 7f4243e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4244100ee0 0x7f4244102e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:45868/0 (socket says 172.21.15.8:45868) 2024-03-16T20:55:44.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.103+0000 7f4243e00700 1 -- 172.21.15.8:0/3311489488 learned_addr learned my addr 172.21.15.8:0/3311489488 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:44.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.103+0000 7f4243400700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4244101880 0x7f4244103360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:44.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.103+0000 7f4248a00700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4244106f20 0x7f42441038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:44.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.103+0000 7f4243e00700 1 -- 172.21.15.8:0/3311489488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4244101880 msgr2=0x7f4244103360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.103+0000 7f4243e00700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4244101880 0x7f4244103360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.103+0000 7f4243e00700 1 -- 172.21.15.8:0/3311489488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4244106f20 msgr2=0x7f42441038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.103+0000 7f4243e00700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4244106f20 0x7f42441038a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.103+0000 7f4243e00700 1 -- 172.21.15.8:0/3311489488 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c009d00 con 0x7f4244100ee0 2024-03-16T20:55:44.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.103+0000 7f4243e00700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4244100ee0 0x7f4244102e20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f423400e9a0 tx=0x7f423400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:44.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.104+0000 7f4240c00700 1 -- 172.21.15.8:0/3311489488 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234009790 con 0x7f4244100ee0 2024-03-16T20:55:44.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.104+0000 7f4240c00700 1 -- 172.21.15.8:0/3311489488 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f423400cbd0 con 0x7f4244100ee0 2024-03-16T20:55:44.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.104+0000 7f424aa00700 1 -- 172.21.15.8:0/3311489488 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42441a7190 con 0x7f4244100ee0 2024-03-16T20:55:44.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.104+0000 7f4240c00700 1 -- 172.21.15.8:0/3311489488 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42340187e0 con 0x7f4244100ee0 2024-03-16T20:55:44.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.104+0000 7f424aa00700 1 -- 172.21.15.8:0/3311489488 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42441a76e0 con 0x7f4244100ee0 2024-03-16T20:55:44.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.105+0000 7f424aa00700 1 -- 172.21.15.8:0/3311489488 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4244111310 con 0x7f4244100ee0 2024-03-16T20:55:44.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.107+0000 7f4240c00700 1 -- 172.21.15.8:0/3311489488 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f42340109c0 con 0x7f4244100ee0 2024-03-16T20:55:44.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.109+0000 7f4240c00700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42280a1bd0 0x7f42280a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:44.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.109+0000 7f4240c00700 1 -- 172.21.15.8:0/3311489488 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4234014070 con 0x7f4244100ee0 2024-03-16T20:55:44.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.109+0000 7f4243400700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42280a1bd0 0x7f42280a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:44.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.110+0000 7f4240c00700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716] conn(0x7f42280ab3b0 0x7f42280ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:44.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.110+0000 7f4240c00700 1 -- 172.21.15.8:0/3311489488 --> [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f42280ade80 con 0x7f42280ab3b0 2024-03-16T20:55:44.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.110+0000 7f4240c00700 1 -- 172.21.15.8:0/3311489488 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42340cdcd0 con 0x7f4244100ee0 2024-03-16T20:55:44.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.110+0000 7f4248a00700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716] conn(0x7f42280ab3b0 0x7f42280ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:44.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.110+0000 7f4243400700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42280a1bd0 0x7f42280a4090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f424406ace0 tx=0x7f4230009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:44.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.111+0000 7f4248a00700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716] conn(0x7f42280ab3b0 0x7f42280ad7d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:44.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.112+0000 7f4240c00700 1 -- 172.21.15.8:0/3311489488 <== osd.7 v2:172.21.15.170:6816/1049528716 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f42280ade80 con 0x7f42280ab3b0 2024-03-16T20:55:44.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.131+0000 7f424aa00700 1 -- 172.21.15.8:0/3311489488 --> [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42440ffab0 con 0x7f42280ab3b0 2024-03-16T20:55:44.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.131+0000 7f4240c00700 1 -- 172.21.15.8:0/3311489488 <== osd.7 v2:172.21.15.170:6816/1049528716 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f42440ffab0 con 0x7f42280ab3b0 2024-03-16T20:55:44.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.132+0000 7f424aa00700 1 -- 172.21.15.8:0/3311489488 >> [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716] conn(0x7f42280ab3b0 msgr2=0x7f42280ad7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.132+0000 7f424aa00700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716] conn(0x7f42280ab3b0 0x7f42280ad7d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.132+0000 7f424aa00700 1 -- 172.21.15.8:0/3311489488 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42280a1bd0 msgr2=0x7f42280a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.132+0000 7f424aa00700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42280a1bd0 0x7f42280a4090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f424406ace0 tx=0x7f4230009260 comp rx=0 tx=0).stop 2024-03-16T20:55:44.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.132+0000 7f424aa00700 1 -- 172.21.15.8:0/3311489488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4244100ee0 msgr2=0x7f4244102e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.132+0000 7f424aa00700 1 --2- 172.21.15.8:0/3311489488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4244100ee0 0x7f4244102e20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f423400e9a0 tx=0x7f423400ecb0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.132+0000 7f4248a00700 1 -- 172.21.15.8:0/3311489488 reap_dead start 2024-03-16T20:55:44.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.132+0000 7f424aa00700 1 -- 172.21.15.8:0/3311489488 shutdown_connections 2024-03-16T20:55:44.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.132+0000 7f424aa00700 1 -- 172.21.15.8:0/3311489488 >> 172.21.15.8:0/3311489488 conn(0x7f4244077e10 msgr2=0x7f42441050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:44.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.132+0000 7f424aa00700 1 -- 172.21.15.8:0/3311489488 shutdown_connections 2024-03-16T20:55:44.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.132+0000 7f424aa00700 1 -- 172.21.15.8:0/3311489488 wait complete. 2024-03-16T20:55:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:44 smithi008 ceph-mon[31434]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-16T20:55:44.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:44 smithi170 ceph-mon[35947]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-16T20:55:44.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:44 smithi186 ceph-mon[36391]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-16T20:55:44.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.777+0000 7efc60400700 1 -- 172.21.15.8:0/1830794458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc58102030 msgr2=0x7efc581024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.777+0000 7efc60400700 1 --2- 172.21.15.8:0/1830794458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc58102030 0x7efc581024b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efc44009990 tx=0x7efc44009ca0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.778+0000 7efc60400700 1 -- 172.21.15.8:0/1830794458 shutdown_connections 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.778+0000 7efc60400700 1 --2- 172.21.15.8:0/1830794458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc58108010 0x7efc581083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.778+0000 7efc60400700 1 --2- 172.21.15.8:0/1830794458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc581029f0 0x7efc5810ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.778+0000 7efc60400700 1 --2- 172.21.15.8:0/1830794458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc58102030 0x7efc581024b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.778+0000 7efc60400700 1 -- 172.21.15.8:0/1830794458 >> 172.21.15.8:0/1830794458 conn(0x7efc58079110 msgr2=0x7efc58079520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.778+0000 7efc60400700 1 -- 172.21.15.8:0/1830794458 shutdown_connections 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.778+0000 7efc60400700 1 -- 172.21.15.8:0/1830794458 wait complete. 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.779+0000 7efc60400700 1 Processor -- start 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.779+0000 7efc60400700 1 -- start start 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.780+0000 7efc60400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc58102030 0x7efc58198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.780+0000 7efc60400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc581029f0 0x7efc58198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.780+0000 7efc60400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc58108010 0x7efc5819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:44.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.780+0000 7efc60400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5819d4a0 con 0x7efc58108010 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.780+0000 7efc60400700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5819d610 con 0x7efc58102030 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.780+0000 7efc60400700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5819d7d0 con 0x7efc581029f0 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.780+0000 7efc5d000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc581029f0 0x7efc58198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.780+0000 7efc5da00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc58102030 0x7efc58198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.780+0000 7efc5d000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc581029f0 0x7efc58198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:45882/0 (socket says 172.21.15.8:45882) 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.780+0000 7efc5d000700 1 -- 172.21.15.8:0/3766510243 learned_addr learned my addr 172.21.15.8:0/3766510243 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.780+0000 7efc5e400700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc58108010 0x7efc5819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc5da00700 1 -- 172.21.15.8:0/3766510243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc581029f0 msgr2=0x7efc58198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc5da00700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc581029f0 0x7efc58198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc5da00700 1 -- 172.21.15.8:0/3766510243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc58108010 msgr2=0x7efc5819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc5da00700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc58108010 0x7efc5819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc5da00700 1 -- 172.21.15.8:0/3766510243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440095f0 con 0x7efc58102030 2024-03-16T20:55:44.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc5d000700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efc581029f0 0x7efc58198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc5da00700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc58102030 0x7efc58198610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00e9f0 tx=0x7efc4c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc56000700 1 -- 172.21.15.8:0/3766510243 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00c9c0 con 0x7efc58102030 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc60400700 1 -- 172.21.15.8:0/3766510243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5819dab0 con 0x7efc58102030 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc56000700 1 -- 172.21.15.8:0/3766510243 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7efc4c00cb20 con 0x7efc58102030 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc56000700 1 -- 172.21.15.8:0/3766510243 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c018680 con 0x7efc58102030 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.781+0000 7efc60400700 1 -- 172.21.15.8:0/3766510243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc581a5310 con 0x7efc58102030 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.782+0000 7efc60400700 1 -- 172.21.15.8:0/3766510243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc581036c0 con 0x7efc58102030 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.785+0000 7efc56000700 1 -- 172.21.15.8:0/3766510243 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7efc4c00cc90 con 0x7efc58102030 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.786+0000 7efc56000700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efc400a1b50 0x7efc400a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.786+0000 7efc56000700 1 -- 172.21.15.8:0/3766510243 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efc4c014070 con 0x7efc58102030 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.786+0000 7efc5d000700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efc400a1b50 0x7efc400a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.786+0000 7efc56000700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423] conn(0x7efc400ab330 0x7efc400ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.786+0000 7efc56000700 1 -- 172.21.15.8:0/3766510243 --> [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc400ade00 con 0x7efc400ab330 2024-03-16T20:55:44.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.786+0000 7efc56000700 1 -- 172.21.15.8:0/3766510243 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc4c0cdfe0 con 0x7efc58102030 2024-03-16T20:55:44.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.787+0000 7efc5e400700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423] conn(0x7efc400ab330 0x7efc400ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:44.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.787+0000 7efc5d000700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efc400a1b50 0x7efc400a4010 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc580796f0 tx=0x7efc4400b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:44.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.787+0000 7efc5e400700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423] conn(0x7efc400ab330 0x7efc400ad750 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:44.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.789+0000 7efc56000700 1 -- 172.21.15.8:0/3766510243 <== osd.11 v2:172.21.15.186:6824/367869423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efc400ade00 con 0x7efc400ab330 2024-03-16T20:55:44.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.807+0000 7efc60400700 1 -- 172.21.15.8:0/3766510243 --> [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc581124b0 con 0x7efc400ab330 2024-03-16T20:55:44.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.807+0000 7efc56000700 1 -- 172.21.15.8:0/3766510243 <== osd.11 v2:172.21.15.186:6824/367869423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efc581124b0 con 0x7efc400ab330 2024-03-16T20:55:44.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.808+0000 7efc60400700 1 -- 172.21.15.8:0/3766510243 >> [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423] conn(0x7efc400ab330 msgr2=0x7efc400ad750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.808+0000 7efc60400700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423] conn(0x7efc400ab330 0x7efc400ad750 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:44.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.808+0000 7efc60400700 1 -- 172.21.15.8:0/3766510243 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efc400a1b50 msgr2=0x7efc400a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.808+0000 7efc60400700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efc400a1b50 0x7efc400a4010 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc580796f0 tx=0x7efc4400b280 comp rx=0 tx=0).stop 2024-03-16T20:55:44.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.808+0000 7efc60400700 1 -- 172.21.15.8:0/3766510243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc58102030 msgr2=0x7efc58198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:44.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.808+0000 7efc60400700 1 --2- 172.21.15.8:0/3766510243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc58102030 0x7efc58198610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00e9f0 tx=0x7efc4c00ed00 comp rx=0 tx=0).stop 2024-03-16T20:55:44.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.808+0000 7efc5e400700 1 -- 172.21.15.8:0/3766510243 reap_dead start 2024-03-16T20:55:44.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.808+0000 7efc60400700 1 -- 172.21.15.8:0/3766510243 shutdown_connections 2024-03-16T20:55:44.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.808+0000 7efc60400700 1 -- 172.21.15.8:0/3766510243 >> 172.21.15.8:0/3766510243 conn(0x7efc58079110 msgr2=0x7efc58100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:44.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.808+0000 7efc60400700 1 -- 172.21.15.8:0/3766510243 shutdown_connections 2024-03-16T20:55:44.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:44.808+0000 7efc60400700 1 -- 172.21.15.8:0/3766510243 wait complete. 2024-03-16T20:55:45.429 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:55:46.177 INFO:teuthology.orchestra.run.smithi008.stdout:347892350997 2024-03-16T20:55:46.178 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.11 2024-03-16T20:55:46.525 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:46 smithi008 ceph-mon[31434]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:55:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:46 smithi170 ceph-mon[35947]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:55:46.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:46 smithi186 ceph-mon[36391]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:55:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.516+0000 7fa876a00700 1 -- 172.21.15.8:0/1115457048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa870069c90 msgr2=0x7fa87006a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.516+0000 7fa876a00700 1 --2- 172.21.15.8:0/1115457048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa870069c90 0x7fa87006a0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0099c0 tx=0x7fa85c009cd0 comp rx=0 tx=0).stop 2024-03-16T20:55:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.516+0000 7fa876a00700 1 -- 172.21.15.8:0/1115457048 shutdown_connections 2024-03-16T20:55:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.516+0000 7fa876a00700 1 --2- 172.21.15.8:0/1115457048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa870108030 0x7fa870108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.516+0000 7fa876a00700 1 --2- 172.21.15.8:0/1115457048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa87006a630 0x7fa87010ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.516+0000 7fa876a00700 1 --2- 172.21.15.8:0/1115457048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa870069c90 0x7fa87006a0f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.516+0000 7fa876a00700 1 -- 172.21.15.8:0/1115457048 >> 172.21.15.8:0/1115457048 conn(0x7fa870077e10 msgr2=0x7fa870078220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.516+0000 7fa876a00700 1 -- 172.21.15.8:0/1115457048 shutdown_connections 2024-03-16T20:55:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.516+0000 7fa876a00700 1 -- 172.21.15.8:0/1115457048 wait complete. 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.517+0000 7fa876a00700 1 Processor -- start 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.517+0000 7fa876a00700 1 -- start start 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.517+0000 7fa876a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa870069c90 0x7fa870198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.517+0000 7fa876a00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa87006a630 0x7fa870198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa876a00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa870108030 0x7fa87019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa876a00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87019d4f0 con 0x7fa870069c90 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa876a00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87019d660 con 0x7fa870108030 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa876a00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87019d820 con 0x7fa87006a630 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa86f400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa87006a630 0x7fa870198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa86f400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa87006a630 0x7fa870198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:45894/0 (socket says 172.21.15.8:45894) 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa86f400700 1 -- 172.21.15.8:0/3372163795 learned_addr learned my addr 172.21.15.8:0/3372163795 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa86fe00700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa870069c90 0x7fa870198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa86f400700 1 -- 172.21.15.8:0/3372163795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa870108030 msgr2=0x7fa87019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa874a00700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa870108030 0x7fa87019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa86f400700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa870108030 0x7fa87019cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa86f400700 1 -- 172.21.15.8:0/3372163795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa870069c90 msgr2=0x7fa870198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa86f400700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa870069c90 0x7fa870198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.518+0000 7fa86f400700 1 -- 172.21.15.8:0/3372163795 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c0095f0 con 0x7fa87006a630 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.519+0000 7fa86fe00700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa870069c90 0x7fa870198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.519+0000 7fa874a00700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa870108030 0x7fa87019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.519+0000 7fa86f400700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa87006a630 0x7fa870198b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009990 tx=0x7fa85c0057d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.519+0000 7fa86cc00700 1 -- 172.21.15.8:0/3372163795 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c01d070 con 0x7fa87006a630 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.519+0000 7fa86cc00700 1 -- 172.21.15.8:0/3372163795 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa85c00fda0 con 0x7fa87006a630 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.519+0000 7fa876a00700 1 -- 172.21.15.8:0/3372163795 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87019daa0 con 0x7fa87006a630 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.519+0000 7fa86cc00700 1 -- 172.21.15.8:0/3372163795 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0173f0 con 0x7fa87006a630 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.519+0000 7fa876a00700 1 -- 172.21.15.8:0/3372163795 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8701a5360 con 0x7fa87006a630 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.520+0000 7fa866000700 1 -- 172.21.15.8:0/3372163795 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa8701036e0 con 0x7fa87006a630 2024-03-16T20:55:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.522+0000 7fa86cc00700 1 -- 172.21.15.8:0/3372163795 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fa85c022600 con 0x7fa87006a630 2024-03-16T20:55:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.523+0000 7fa86cc00700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa8540a1bd0 0x7fa8540a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.524+0000 7fa86cc00700 1 -- 172.21.15.8:0/3372163795 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa85c0ce6b0 con 0x7fa87006a630 2024-03-16T20:55:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.524+0000 7fa86fe00700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa8540a1bd0 0x7fa8540a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.524+0000 7fa86cc00700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152] conn(0x7fa8540ab3b0 0x7fa8540ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.524+0000 7fa86cc00700 1 -- 172.21.15.8:0/3372163795 --> [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8540ade80 con 0x7fa8540ab3b0 2024-03-16T20:55:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.524+0000 7fa86cc00700 1 -- 172.21.15.8:0/3372163795 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa85c0d0c90 con 0x7fa87006a630 2024-03-16T20:55:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.524+0000 7fa874a00700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152] conn(0x7fa8540ab3b0 0x7fa8540ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.525+0000 7fa86fe00700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa8540a1bd0 0x7fa8540a4090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa860009c90 tx=0x7fa860009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.525+0000 7fa874a00700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152] conn(0x7fa8540ab3b0 0x7fa8540ad7d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.526+0000 7fa86cc00700 1 -- 172.21.15.8:0/3372163795 <== osd.10 v2:172.21.15.170:6824/1955752152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa8540ade80 con 0x7fa8540ab3b0 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.544+0000 7fa866000700 1 -- 172.21.15.8:0/3372163795 --> [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa870112490 con 0x7fa8540ab3b0 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.545+0000 7fa86cc00700 1 -- 172.21.15.8:0/3372163795 <== osd.10 v2:172.21.15.170:6824/1955752152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa870112490 con 0x7fa8540ab3b0 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.545+0000 7fa866000700 1 -- 172.21.15.8:0/3372163795 >> [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152] conn(0x7fa8540ab3b0 msgr2=0x7fa8540ad7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.545+0000 7fa866000700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152] conn(0x7fa8540ab3b0 0x7fa8540ad7d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.546+0000 7fa866000700 1 -- 172.21.15.8:0/3372163795 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa8540a1bd0 msgr2=0x7fa8540a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.546+0000 7fa866000700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa8540a1bd0 0x7fa8540a4090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa860009c90 tx=0x7fa860009260 comp rx=0 tx=0).stop 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.546+0000 7fa866000700 1 -- 172.21.15.8:0/3372163795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa87006a630 msgr2=0x7fa870198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.546+0000 7fa866000700 1 --2- 172.21.15.8:0/3372163795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa87006a630 0x7fa870198b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009990 tx=0x7fa85c0057d0 comp rx=0 tx=0).stop 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.546+0000 7fa874a00700 1 -- 172.21.15.8:0/3372163795 reap_dead start 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.546+0000 7fa866000700 1 -- 172.21.15.8:0/3372163795 shutdown_connections 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.546+0000 7fa866000700 1 -- 172.21.15.8:0/3372163795 >> 172.21.15.8:0/3372163795 conn(0x7fa870077e10 msgr2=0x7fa8700ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.546+0000 7fa866000700 1 -- 172.21.15.8:0/3372163795 shutdown_connections 2024-03-16T20:55:47.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:47.546+0000 7fa866000700 1 -- 172.21.15.8:0/3372163795 wait complete. 2024-03-16T20:55:48.208 INFO:teuthology.orchestra.run.smithi008.stdout:223338299437 2024-03-16T20:55:48.208 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-03-16T20:55:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:48 smithi008 ceph-mon[31434]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:55:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:48 smithi170 ceph-mon[35947]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:55:48.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:48 smithi186 ceph-mon[36391]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:55:50.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.654+0000 7f7d76e00700 1 -- 172.21.15.8:0/1340068392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d70105de0 msgr2=0x7f7d70106260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:50.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.654+0000 7f7d76e00700 1 --2- 172.21.15.8:0/1340068392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d70105de0 0x7f7d70106260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009990 tx=0x7f7d5c009ca0 comp rx=0 tx=0).stop 2024-03-16T20:55:50.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.654+0000 7f7d76e00700 1 -- 172.21.15.8:0/1340068392 shutdown_connections 2024-03-16T20:55:50.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.654+0000 7f7d76e00700 1 --2- 172.21.15.8:0/1340068392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d701044f0 0x7f7d701048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:50.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.654+0000 7f7d76e00700 1 --2- 172.21.15.8:0/1340068392 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d701067a0 0x7f7d70111180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:50.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.654+0000 7f7d76e00700 1 --2- 172.21.15.8:0/1340068392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d70105de0 0x7f7d70106260 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:50.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.654+0000 7f7d76e00700 1 -- 172.21.15.8:0/1340068392 >> 172.21.15.8:0/1340068392 conn(0x7f7d700ffc80 msgr2=0x7f7d701020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:50.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.654+0000 7f7d76e00700 1 -- 172.21.15.8:0/1340068392 shutdown_connections 2024-03-16T20:55:50.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.654+0000 7f7d76e00700 1 -- 172.21.15.8:0/1340068392 wait complete. 2024-03-16T20:55:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.655+0000 7f7d76e00700 1 Processor -- start 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d76e00700 1 -- start start 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d76e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d701044f0 0x7f7d701a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d76e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d70105de0 0x7f7d701a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d76e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d701067a0 0x7f7d7019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d76e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7019ae10 con 0x7f7d701067a0 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d76e00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7019af80 con 0x7f7d70105de0 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d76e00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7019b140 con 0x7f7d701044f0 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d6fe00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d701044f0 0x7f7d701a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d6f400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d70105de0 0x7f7d701a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d74e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d701067a0 0x7f7d7019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d6fe00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d701044f0 0x7f7d701a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52428/0 (socket says 172.21.15.8:52428) 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d6f400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d70105de0 0x7f7d701a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32966/0 (socket says 172.21.15.8:32966) 2024-03-16T20:55:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.656+0000 7f7d6fe00700 1 -- 172.21.15.8:0/692592421 learned_addr learned my addr 172.21.15.8:0/692592421 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.657+0000 7f7d6fe00700 1 -- 172.21.15.8:0/692592421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d70105de0 msgr2=0x7f7d701a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.657+0000 7f7d6fe00700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d70105de0 0x7f7d701a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.657+0000 7f7d6fe00700 1 -- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d701067a0 msgr2=0x7f7d7019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.657+0000 7f7d6fe00700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d701067a0 0x7f7d7019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.657+0000 7f7d6fe00700 1 -- 172.21.15.8:0/692592421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c0095f0 con 0x7f7d701044f0 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.657+0000 7f7d6f400700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d70105de0 0x7f7d701a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.657+0000 7f7d6fe00700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d701044f0 0x7f7d701a0590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000e9a0 tx=0x7f7d6000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.657+0000 7f7d6cc00700 1 -- 172.21.15.8:0/692592421 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60009790 con 0x7f7d701044f0 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.657+0000 7f7d6cc00700 1 -- 172.21.15.8:0/692592421 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7d60010430 con 0x7f7d701044f0 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.657+0000 7f7d76e00700 1 -- 172.21.15.8:0/692592421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7019b420 con 0x7f7d701044f0 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.657+0000 7f7d6cc00700 1 -- 172.21.15.8:0/692592421 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60018680 con 0x7f7d701044f0 2024-03-16T20:55:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.658+0000 7f7d76e00700 1 -- 172.21.15.8:0/692592421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d701a7510 con 0x7f7d701044f0 2024-03-16T20:55:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.658+0000 7f7d76e00700 1 -- 172.21.15.8:0/692592421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d701058f0 con 0x7f7d701044f0 2024-03-16T20:55:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.660+0000 7f7d6cc00700 1 -- 172.21.15.8:0/692592421 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f7d600109a0 con 0x7f7d701044f0 2024-03-16T20:55:50.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.662+0000 7f7d6cc00700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f7d540a1b50 0x7f7d540a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:50.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.662+0000 7f7d6cc00700 1 -- 172.21.15.8:0/692592421 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7d60014070 con 0x7f7d701044f0 2024-03-16T20:55:50.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.662+0000 7f7d6f400700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f7d540a1b50 0x7f7d540a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:50.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.662+0000 7f7d6cc00700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487] conn(0x7f7d540ab330 0x7f7d540ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:50.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.662+0000 7f7d6cc00700 1 -- 172.21.15.8:0/692592421 --> [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d540ade00 con 0x7f7d540ab330 2024-03-16T20:55:50.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.662+0000 7f7d6cc00700 1 -- 172.21.15.8:0/692592421 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d600cfb30 con 0x7f7d701044f0 2024-03-16T20:55:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.663+0000 7f7d74e00700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487] conn(0x7f7d540ab330 0x7f7d540ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.663+0000 7f7d6f400700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f7d540a1b50 0x7f7d540a4010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00b2e0 tx=0x7f7d5c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.663+0000 7f7d74e00700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487] conn(0x7f7d540ab330 0x7f7d540ad750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:50.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.664+0000 7f7d6cc00700 1 -- 172.21.15.8:0/692592421 <== osd.3 v2:172.21.15.8:6810/3279202487 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7d540ade00 con 0x7f7d540ab330 2024-03-16T20:55:50.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.685+0000 7f7d76e00700 1 -- 172.21.15.8:0/692592421 --> [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7d70114770 con 0x7f7d540ab330 2024-03-16T20:55:50.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.685+0000 7f7d6cc00700 1 -- 172.21.15.8:0/692592421 <== osd.3 v2:172.21.15.8:6810/3279202487 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7d70114770 con 0x7f7d540ab330 2024-03-16T20:55:50.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.686+0000 7f7d76e00700 1 -- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487] conn(0x7f7d540ab330 msgr2=0x7f7d540ad750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.686+0000 7f7d76e00700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487] conn(0x7f7d540ab330 0x7f7d540ad750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.686+0000 7f7d76e00700 1 -- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f7d540a1b50 msgr2=0x7f7d540a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.686+0000 7f7d76e00700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f7d540a1b50 0x7f7d540a4010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00b2e0 tx=0x7f7d5c005960 comp rx=0 tx=0).stop 2024-03-16T20:55:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.686+0000 7f7d76e00700 1 -- 172.21.15.8:0/692592421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d701044f0 msgr2=0x7f7d701a0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.686+0000 7f7d76e00700 1 --2- 172.21.15.8:0/692592421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d701044f0 0x7f7d701a0590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000e9a0 tx=0x7f7d6000ecb0 comp rx=0 tx=0).stop 2024-03-16T20:55:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.686+0000 7f7d74e00700 1 -- 172.21.15.8:0/692592421 reap_dead start 2024-03-16T20:55:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.686+0000 7f7d76e00700 1 -- 172.21.15.8:0/692592421 shutdown_connections 2024-03-16T20:55:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.686+0000 7f7d76e00700 1 -- 172.21.15.8:0/692592421 >> 172.21.15.8:0/692592421 conn(0x7f7d700ffc80 msgr2=0x7f7d70100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.686+0000 7f7d76e00700 1 -- 172.21.15.8:0/692592421 shutdown_connections 2024-03-16T20:55:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.686+0000 7f7d76e00700 1 -- 172.21.15.8:0/692592421 wait complete. 2024-03-16T20:55:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:50 smithi008 ceph-mon[31434]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-16T20:55:50.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:50 smithi170 ceph-mon[35947]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-16T20:55:50.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:50 smithi186 ceph-mon[36391]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-16T20:55:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.854+0000 7f61a0200700 1 -- 172.21.15.8:0/2602889078 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6198108fb0 msgr2=0x7f61981154c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.854+0000 7f61a0200700 1 --2- 172.21.15.8:0/2602889078 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6198108fb0 0x7f61981154c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f619000b0a0 tx=0x7f619000b3b0 comp rx=0 tx=0).stop 2024-03-16T20:55:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.854+0000 7f61a0200700 1 -- 172.21.15.8:0/2602889078 shutdown_connections 2024-03-16T20:55:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.854+0000 7f61a0200700 1 --2- 172.21.15.8:0/2602889078 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f619810e680 0x7f619810ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.854+0000 7f61a0200700 1 --2- 172.21.15.8:0/2602889078 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6198108fb0 0x7f61981154c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.854+0000 7f61a0200700 1 --2- 172.21.15.8:0/2602889078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61981085f0 0x7f6198108a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.854+0000 7f61a0200700 1 -- 172.21.15.8:0/2602889078 >> 172.21.15.8:0/2602889078 conn(0x7f61980757b0 msgr2=0x7f6198077bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.855+0000 7f61a0200700 1 -- 172.21.15.8:0/2602889078 shutdown_connections 2024-03-16T20:55:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.855+0000 7f61a0200700 1 -- 172.21.15.8:0/2602889078 wait complete. 2024-03-16T20:55:51.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.856+0000 7f61a0200700 1 Processor -- start 2024-03-16T20:55:51.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.857+0000 7f61a0200700 1 -- start start 2024-03-16T20:55:51.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.857+0000 7f61a0200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61981085f0 0x7f619819ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:51.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.857+0000 7f61a0200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6198108fb0 0x7f619819f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:51.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.857+0000 7f61a0200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f619810e680 0x7f61981a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:51.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f61a0200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61981a3cb0 con 0x7f6198108fb0 2024-03-16T20:55:51.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f61a0200700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61981a3e20 con 0x7f619810e680 2024-03-16T20:55:51.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f61a0200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61981a3fe0 con 0x7f61981085f0 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f619e200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f619810e680 0x7f61981a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f619d800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61981085f0 0x7f619819ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f619e200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f619810e680 0x7f61981a36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32996/0 (socket says 172.21.15.8:32996) 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f619e200700 1 -- 172.21.15.8:0/281074947 learned_addr learned my addr 172.21.15.8:0/281074947 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f619ce00700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6198108fb0 0x7f619819f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f619e200700 1 -- 172.21.15.8:0/281074947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61981085f0 msgr2=0x7f619819ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f619e200700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61981085f0 0x7f619819ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f619e200700 1 -- 172.21.15.8:0/281074947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6198108fb0 msgr2=0x7f619819f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f619e200700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6198108fb0 0x7f619819f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f619e200700 1 -- 172.21.15.8:0/281074947 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190009d00 con 0x7f619810e680 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.858+0000 7f619d800700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61981085f0 0x7f619819ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.859+0000 7f619e200700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f619810e680 0x7f61981a36a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f619000b070 tx=0x7f6190009460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:51.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.859+0000 7f6196000700 1 -- 172.21.15.8:0/281074947 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619000e040 con 0x7f619810e680 2024-03-16T20:55:51.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.859+0000 7f6196000700 1 -- 172.21.15.8:0/281074947 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f619001d480 con 0x7f619810e680 2024-03-16T20:55:51.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.859+0000 7f6196000700 1 -- 172.21.15.8:0/281074947 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619001b6b0 con 0x7f619810e680 2024-03-16T20:55:51.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.859+0000 7f61a0200700 1 -- 172.21.15.8:0/281074947 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61981a4260 con 0x7f619810e680 2024-03-16T20:55:51.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.859+0000 7f61a0200700 1 -- 172.21.15.8:0/281074947 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61981abb20 con 0x7f619810e680 2024-03-16T20:55:51.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.860+0000 7f61a0200700 1 -- 172.21.15.8:0/281074947 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f61981a4540 con 0x7f619810e680 2024-03-16T20:55:51.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.862+0000 7f6196000700 1 -- 172.21.15.8:0/281074947 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f619001d5f0 con 0x7f619810e680 2024-03-16T20:55:51.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.864+0000 7f6196000700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61800a1bd0 0x7f61800a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:51.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.864+0000 7f6196000700 1 -- 172.21.15.8:0/281074947 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f61900cf150 con 0x7f619810e680 2024-03-16T20:55:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.864+0000 7f619d800700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61800a1bd0 0x7f61800a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.864+0000 7f6196000700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318] conn(0x7f61800ab3b0 0x7f61800ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.864+0000 7f6196000700 1 -- 172.21.15.8:0/281074947 --> [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61800ade80 con 0x7f61800ab3b0 2024-03-16T20:55:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.864+0000 7f6196000700 1 -- 172.21.15.8:0/281074947 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61900cf4c0 con 0x7f619810e680 2024-03-16T20:55:51.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.864+0000 7f619ce00700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318] conn(0x7f61800ab3b0 0x7f61800ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:51.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.865+0000 7f619d800700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61800a1bd0 0x7f61800a4090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6198109730 tx=0x7f618c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:51.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.865+0000 7f619ce00700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318] conn(0x7f61800ab3b0 0x7f61800ad7d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:51.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.866+0000 7f6196000700 1 -- 172.21.15.8:0/281074947 <== osd.8 v2:172.21.15.186:6816/1658595318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f61800ade80 con 0x7f61800ab3b0 2024-03-16T20:55:51.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.884+0000 7f61a0200700 1 -- 172.21.15.8:0/281074947 --> [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f61980626f0 con 0x7f61800ab3b0 2024-03-16T20:55:51.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.884+0000 7f6196000700 1 -- 172.21.15.8:0/281074947 <== osd.8 v2:172.21.15.186:6816/1658595318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f61980626f0 con 0x7f61800ab3b0 2024-03-16T20:55:51.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.885+0000 7f61a0200700 1 -- 172.21.15.8:0/281074947 >> [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318] conn(0x7f61800ab3b0 msgr2=0x7f61800ad7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:51.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.885+0000 7f61a0200700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318] conn(0x7f61800ab3b0 0x7f61800ad7d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:51.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.885+0000 7f61a0200700 1 -- 172.21.15.8:0/281074947 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61800a1bd0 msgr2=0x7f61800a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:51.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.885+0000 7f61a0200700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61800a1bd0 0x7f61800a4090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6198109730 tx=0x7f618c009260 comp rx=0 tx=0).stop 2024-03-16T20:55:51.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.885+0000 7f61a0200700 1 -- 172.21.15.8:0/281074947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f619810e680 msgr2=0x7f61981a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:51.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.885+0000 7f61a0200700 1 --2- 172.21.15.8:0/281074947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f619810e680 0x7f61981a36a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f619000b070 tx=0x7f6190009460 comp rx=0 tx=0).stop 2024-03-16T20:55:51.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.885+0000 7f619e200700 1 -- 172.21.15.8:0/281074947 reap_dead start 2024-03-16T20:55:51.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.885+0000 7f61a0200700 1 -- 172.21.15.8:0/281074947 shutdown_connections 2024-03-16T20:55:51.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.885+0000 7f61a0200700 1 -- 172.21.15.8:0/281074947 >> 172.21.15.8:0/281074947 conn(0x7f61980757b0 msgr2=0x7f6198076c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:51.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.885+0000 7f61a0200700 1 -- 172.21.15.8:0/281074947 shutdown_connections 2024-03-16T20:55:51.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:51.886+0000 7f61a0200700 1 -- 172.21.15.8:0/281074947 wait complete. 2024-03-16T20:55:52.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.350+0000 7f3346800700 1 -- 172.21.15.8:0/345567032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3340107340 msgr2=0x7f334010ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.350+0000 7f3346800700 1 --2- 172.21.15.8:0/345567032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3340107340 0x7f334010ef10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3338009990 tx=0x7f3338009ca0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.350+0000 7f3346800700 1 -- 172.21.15.8:0/345567032 shutdown_connections 2024-03-16T20:55:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.350+0000 7f3346800700 1 --2- 172.21.15.8:0/345567032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3340102260 0x7f3340102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.350+0000 7f3346800700 1 --2- 172.21.15.8:0/345567032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3340107340 0x7f334010ef10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.350+0000 7f3346800700 1 --2- 172.21.15.8:0/345567032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3340102c10 0x7f3340106c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.350+0000 7f3346800700 1 -- 172.21.15.8:0/345567032 >> 172.21.15.8:0/345567032 conn(0x7f33400fdab0 msgr2=0x7f33400ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.350+0000 7f3346800700 1 -- 172.21.15.8:0/345567032 shutdown_connections 2024-03-16T20:55:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.350+0000 7f3346800700 1 -- 172.21.15.8:0/345567032 wait complete. 2024-03-16T20:55:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.351+0000 7f3346800700 1 Processor -- start 2024-03-16T20:55:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f3346800700 1 -- start start 2024-03-16T20:55:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f3346800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3340102260 0x7f33401a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f3346800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3340102c10 0x7f33401a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f3346800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3340107340 0x7f334019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f3346800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334019ade0 con 0x7f3340102260 2024-03-16T20:55:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f3346800700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334019af50 con 0x7f3340107340 2024-03-16T20:55:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f3346800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334019b110 con 0x7f3340102c10 2024-03-16T20:55:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f333ea00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3340102c10 0x7f33401a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f333ea00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3340102c10 0x7f33401a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52420/0 (socket says 172.21.15.8:52420) 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f333ea00700 1 -- 172.21.15.8:0/3766457522 learned_addr learned my addr 172.21.15.8:0/3766457522 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f333fe00700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3340107340 0x7f334019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.352+0000 7f333f400700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3340102260 0x7f33401a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.353+0000 7f333ea00700 1 -- 172.21.15.8:0/3766457522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3340107340 msgr2=0x7f334019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.353+0000 7f333ea00700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3340107340 0x7f334019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.353+0000 7f333ea00700 1 -- 172.21.15.8:0/3766457522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3340102260 msgr2=0x7f33401a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.353+0000 7f333ea00700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3340102260 0x7f33401a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.353+0000 7f333ea00700 1 -- 172.21.15.8:0/3766457522 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33380095f0 con 0x7f3340102c10 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.353+0000 7f333ea00700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3340102c10 0x7f33401a0aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f332c00e970 tx=0x7f332c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.353+0000 7f3337e00700 1 -- 172.21.15.8:0/3766457522 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c009790 con 0x7f3340102c10 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.353+0000 7f3337e00700 1 -- 172.21.15.8:0/3766457522 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f332c00c7e0 con 0x7f3340102c10 2024-03-16T20:55:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.353+0000 7f3346800700 1 -- 172.21.15.8:0/3766457522 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334019b3f0 con 0x7f3340102c10 2024-03-16T20:55:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.353+0000 7f3337e00700 1 -- 172.21.15.8:0/3766457522 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c005680 con 0x7f3340102c10 2024-03-16T20:55:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.353+0000 7f3346800700 1 -- 172.21.15.8:0/3766457522 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33401a74e0 con 0x7f3340102c10 2024-03-16T20:55:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.354+0000 7f3346800700 1 -- 172.21.15.8:0/3766457522 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3340103740 con 0x7f3340102c10 2024-03-16T20:55:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.357+0000 7f3337e00700 1 -- 172.21.15.8:0/3766457522 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f332c00c950 con 0x7f3340102c10 2024-03-16T20:55:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.359+0000 7f3337e00700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f33240a1b50 0x7f33240a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.359+0000 7f3337e00700 1 -- 172.21.15.8:0/3766457522 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f332c014070 con 0x7f3340102c10 2024-03-16T20:55:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.359+0000 7f333f400700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f33240a1b50 0x7f33240a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.359+0000 7f3337e00700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577] conn(0x7f33240ab330 0x7f33240ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.359+0000 7f3337e00700 1 -- 172.21.15.8:0/3766457522 --> [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33240ade00 con 0x7f33240ab330 2024-03-16T20:55:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.359+0000 7f3337e00700 1 -- 172.21.15.8:0/3766457522 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f332c0cdbe0 con 0x7f3340102c10 2024-03-16T20:55:52.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.359+0000 7f333fe00700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577] conn(0x7f33240ab330 0x7f33240ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:52.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.360+0000 7f333f400700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f33240a1b50 0x7f33240a4010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f333000f540 tx=0x7f333000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:52.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.360+0000 7f333fe00700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577] conn(0x7f33240ab330 0x7f33240ad750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:52.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.361+0000 7f3337e00700 1 -- 172.21.15.8:0/3766457522 <== osd.5 v2:172.21.15.186:6808/1795818577 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f33240ade00 con 0x7f33240ab330 2024-03-16T20:55:52.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.380+0000 7f3346800700 1 -- 172.21.15.8:0/3766457522 --> [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3340112540 con 0x7f33240ab330 2024-03-16T20:55:52.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.380+0000 7f3337e00700 1 -- 172.21.15.8:0/3766457522 <== osd.5 v2:172.21.15.186:6808/1795818577 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3340112540 con 0x7f33240ab330 2024-03-16T20:55:52.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.381+0000 7f3346800700 1 -- 172.21.15.8:0/3766457522 >> [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577] conn(0x7f33240ab330 msgr2=0x7f33240ad750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.381+0000 7f3346800700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577] conn(0x7f33240ab330 0x7f33240ad750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.381+0000 7f3346800700 1 -- 172.21.15.8:0/3766457522 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f33240a1b50 msgr2=0x7f33240a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.381+0000 7f3346800700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f33240a1b50 0x7f33240a4010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f333000f540 tx=0x7f333000b040 comp rx=0 tx=0).stop 2024-03-16T20:55:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.381+0000 7f3346800700 1 -- 172.21.15.8:0/3766457522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3340102c10 msgr2=0x7f33401a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.381+0000 7f3346800700 1 --2- 172.21.15.8:0/3766457522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3340102c10 0x7f33401a0aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f332c00e970 tx=0x7f332c00ec80 comp rx=0 tx=0).stop 2024-03-16T20:55:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.381+0000 7f333fe00700 1 -- 172.21.15.8:0/3766457522 reap_dead start 2024-03-16T20:55:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.381+0000 7f3346800700 1 -- 172.21.15.8:0/3766457522 shutdown_connections 2024-03-16T20:55:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.381+0000 7f3346800700 1 -- 172.21.15.8:0/3766457522 >> 172.21.15.8:0/3766457522 conn(0x7f33400fdab0 msgr2=0x7f33400fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.382+0000 7f3346800700 1 -- 172.21.15.8:0/3766457522 shutdown_connections 2024-03-16T20:55:52.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.382+0000 7f3346800700 1 -- 172.21.15.8:0/3766457522 wait complete. 2024-03-16T20:55:52.681 INFO:teuthology.orchestra.run.smithi008.stdout:292057776159 2024-03-16T20:55:52.681 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.9 2024-03-16T20:55:52.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.636+0000 7fa510000700 1 -- 172.21.15.8:0/1852558289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa508108010 msgr2=0x7fa5081083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.637+0000 7fa510000700 1 --2- 172.21.15.8:0/1852558289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa508108010 0x7fa5081083f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009990 tx=0x7fa4fc009ca0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.637+0000 7fa510000700 1 -- 172.21.15.8:0/1852558289 shutdown_connections 2024-03-16T20:55:52.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.637+0000 7fa510000700 1 --2- 172.21.15.8:0/1852558289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5081029f0 0x7fa50810ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.637+0000 7fa510000700 1 --2- 172.21.15.8:0/1852558289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa508108010 0x7fa5081083f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.637+0000 7fa510000700 1 --2- 172.21.15.8:0/1852558289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa508102030 0x7fa5081024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.637+0000 7fa510000700 1 -- 172.21.15.8:0/1852558289 >> 172.21.15.8:0/1852558289 conn(0x7fa508079110 msgr2=0x7fa508079520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:52.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.637+0000 7fa510000700 1 -- 172.21.15.8:0/1852558289 shutdown_connections 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.637+0000 7fa510000700 1 -- 172.21.15.8:0/1852558289 wait complete. 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.638+0000 7fa510000700 1 Processor -- start 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.638+0000 7fa510000700 1 -- start start 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa510000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa508102030 0x7fa5081a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa510000700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5081029f0 0x7fa5081a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa510000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa508108010 0x7fa50819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa510000700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50819ac40 con 0x7fa508108010 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa510000700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50819ad80 con 0x7fa5081029f0 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa510000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50819af40 con 0x7fa508102030 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50d600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa508102030 0x7fa5081a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50cc00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5081029f0 0x7fa5081a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50d600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa508102030 0x7fa5081a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52374/0 (socket says 172.21.15.8:52374) 2024-03-16T20:55:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50d600700 1 -- 172.21.15.8:0/1145179878 learned_addr learned my addr 172.21.15.8:0/1145179878 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50cc00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5081029f0 0x7fa5081a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32890/0 (socket says 172.21.15.8:32890) 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50e000700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa508108010 0x7fa50819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50d600700 1 -- 172.21.15.8:0/1145179878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5081029f0 msgr2=0x7fa5081a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50d600700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5081029f0 0x7fa5081a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50d600700 1 -- 172.21.15.8:0/1145179878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa508108010 msgr2=0x7fa50819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50d600700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa508108010 0x7fa50819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50d600700 1 -- 172.21.15.8:0/1145179878 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc0095f0 con 0x7fa508102030 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50e000700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa508108010 0x7fa50819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.639+0000 7fa50cc00700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5081029f0 0x7fa5081a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.640+0000 7fa50d600700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa508102030 0x7fa5081a0420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc000c00 tx=0x7fa4fc005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.640+0000 7fa506000700 1 -- 172.21.15.8:0/1145179878 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc01d070 con 0x7fa508102030 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.640+0000 7fa506000700 1 -- 172.21.15.8:0/1145179878 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa4fc00be60 con 0x7fa508102030 2024-03-16T20:55:52.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.640+0000 7fa510000700 1 -- 172.21.15.8:0/1145179878 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50819b1c0 con 0x7fa508102030 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.640+0000 7fa506000700 1 -- 172.21.15.8:0/1145179878 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc017650 con 0x7fa508102030 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.640+0000 7fa510000700 1 -- 172.21.15.8:0/1145179878 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5081a74c0 con 0x7fa508102030 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.641+0000 7fa510000700 1 -- 172.21.15.8:0/1145179878 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5081036c0 con 0x7fa508102030 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.643+0000 7fa506000700 1 -- 172.21.15.8:0/1145179878 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fa4fc022470 con 0x7fa508102030 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.644+0000 7fa506000700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa4f00a1b50 0x7fa4f00a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.645+0000 7fa506000700 1 -- 172.21.15.8:0/1145179878 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa4fc0ce9e0 con 0x7fa508102030 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.645+0000 7fa50cc00700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa4f00a1b50 0x7fa4f00a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.645+0000 7fa506000700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677] conn(0x7fa4f00ab330 0x7fa4f00ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.645+0000 7fa506000700 1 -- 172.21.15.8:0/1145179878 --> [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4f00ade00 con 0x7fa4f00ab330 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.645+0000 7fa506000700 1 -- 172.21.15.8:0/1145179878 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4fc0d32a0 con 0x7fa508102030 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.645+0000 7fa50e000700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677] conn(0x7fa4f00ab330 0x7fa4f00ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.645+0000 7fa50cc00700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa4f00a1b50 0x7fa4f00a4010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa508079a50 tx=0x7fa4f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:52.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.646+0000 7fa50e000700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677] conn(0x7fa4f00ab330 0x7fa4f00ad750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:52.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.647+0000 7fa506000700 1 -- 172.21.15.8:0/1145179878 <== osd.4 v2:172.21.15.170:6808/1263992677 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa4f00ade00 con 0x7fa4f00ab330 2024-03-16T20:55:52.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.665+0000 7fa510000700 1 -- 172.21.15.8:0/1145179878 --> [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa5081124b0 con 0x7fa4f00ab330 2024-03-16T20:55:52.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.666+0000 7fa506000700 1 -- 172.21.15.8:0/1145179878 <== osd.4 v2:172.21.15.170:6808/1263992677 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa5081124b0 con 0x7fa4f00ab330 2024-03-16T20:55:52.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.666+0000 7fa510000700 1 -- 172.21.15.8:0/1145179878 >> [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677] conn(0x7fa4f00ab330 msgr2=0x7fa4f00ad750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.666+0000 7fa510000700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677] conn(0x7fa4f00ab330 0x7fa4f00ad750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:52.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.667+0000 7fa510000700 1 -- 172.21.15.8:0/1145179878 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa4f00a1b50 msgr2=0x7fa4f00a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.667+0000 7fa510000700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa4f00a1b50 0x7fa4f00a4010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa508079a50 tx=0x7fa4f4009260 comp rx=0 tx=0).stop 2024-03-16T20:55:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.667+0000 7fa510000700 1 -- 172.21.15.8:0/1145179878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa508102030 msgr2=0x7fa5081a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.667+0000 7fa510000700 1 --2- 172.21.15.8:0/1145179878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa508102030 0x7fa5081a0420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc000c00 tx=0x7fa4fc005740 comp rx=0 tx=0).stop 2024-03-16T20:55:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.667+0000 7fa50e000700 1 -- 172.21.15.8:0/1145179878 reap_dead start 2024-03-16T20:55:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.667+0000 7fa510000700 1 -- 172.21.15.8:0/1145179878 shutdown_connections 2024-03-16T20:55:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.667+0000 7fa510000700 1 -- 172.21.15.8:0/1145179878 >> 172.21.15.8:0/1145179878 conn(0x7fa508079110 msgr2=0x7fa50810d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.667+0000 7fa510000700 1 -- 172.21.15.8:0/1145179878 shutdown_connections 2024-03-16T20:55:52.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:49.667+0000 7fa510000700 1 -- 172.21.15.8:0/1145179878 wait complete. 2024-03-16T20:55:52.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:52 smithi008 ceph-mon[31434]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:55:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:52 smithi170 ceph-mon[35947]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:55:52.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:52 smithi186 ceph-mon[36391]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:55:53.785 INFO:teuthology.orchestra.run.smithi008.stdout:111669149763 2024-03-16T20:55:53.786 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-16T20:55:54.694 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:54 smithi008 ceph-mon[31434]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:55:54.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.689+0000 7fd110800700 1 -- 172.21.15.8:0/3761222728 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd108074300 msgr2=0x7fd1080746e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.689+0000 7fd110800700 1 --2- 172.21.15.8:0/3761222728 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd108074300 0x7fd1080746e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009990 tx=0x7fd0fc009ca0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.689+0000 7fd110800700 1 -- 172.21.15.8:0/3761222728 shutdown_connections 2024-03-16T20:55:54.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.689+0000 7fd110800700 1 --2- 172.21.15.8:0/3761222728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd10810e8c0 0x7fd108110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.689+0000 7fd110800700 1 --2- 172.21.15.8:0/3761222728 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd108074300 0x7fd1080746e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.689+0000 7fd110800700 1 --2- 172.21.15.8:0/3761222728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd108074c20 0x7fd10810e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.689+0000 7fd110800700 1 -- 172.21.15.8:0/3761222728 >> 172.21.15.8:0/3761222728 conn(0x7fd1080fdab0 msgr2=0x7fd1080ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:54.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.689+0000 7fd110800700 1 -- 172.21.15.8:0/3761222728 shutdown_connections 2024-03-16T20:55:54.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.689+0000 7fd110800700 1 -- 172.21.15.8:0/3761222728 wait complete. 2024-03-16T20:55:54.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.690+0000 7fd110800700 1 Processor -- start 2024-03-16T20:55:54.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.691+0000 7fd110800700 1 -- start start 2024-03-16T20:55:54.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.691+0000 7fd110800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd108074300 0x7fd108101fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:54.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.691+0000 7fd110800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd108074c20 0x7fd108102520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:54.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.691+0000 7fd110800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd10810e8c0 0x7fd108102a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:54.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.691+0000 7fd110800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1081aada0 con 0x7fd108074c20 2024-03-16T20:55:54.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.691+0000 7fd110800700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1081aaee0 con 0x7fd108074300 2024-03-16T20:55:54.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.691+0000 7fd110800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1081ab070 con 0x7fd10810e8c0 2024-03-16T20:55:54.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.691+0000 7fd10de00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd108074300 0x7fd108101fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:54.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd10de00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd108074300 0x7fd108101fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:33026/0 (socket says 172.21.15.8:33026) 2024-03-16T20:55:54.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd10de00700 1 -- 172.21.15.8:0/3563206480 learned_addr learned my addr 172.21.15.8:0/3563206480 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:54.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd10e800700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd10810e8c0 0x7fd108102a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:54.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd10d400700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd108074c20 0x7fd108102520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:54.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd10de00700 1 -- 172.21.15.8:0/3563206480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd10810e8c0 msgr2=0x7fd108102a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd10de00700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd10810e8c0 0x7fd108102a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd10de00700 1 -- 172.21.15.8:0/3563206480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd108074c20 msgr2=0x7fd108102520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd10de00700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd108074c20 0x7fd108102520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd10de00700 1 -- 172.21.15.8:0/3563206480 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0095f0 con 0x7fd108074300 2024-03-16T20:55:54.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd10e800700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd10810e8c0 0x7fd108102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:55:54.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd10de00700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd108074300 0x7fd108101fe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc005910 tx=0x7fd0fc00be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:54.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.692+0000 7fd102a00700 1 -- 172.21.15.8:0/3563206480 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc01d070 con 0x7fd108074300 2024-03-16T20:55:54.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.693+0000 7fd102a00700 1 -- 172.21.15.8:0/3563206480 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd0fc00fb10 con 0x7fd108074300 2024-03-16T20:55:54.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.693+0000 7fd102a00700 1 -- 172.21.15.8:0/3563206480 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc017650 con 0x7fd108074300 2024-03-16T20:55:54.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.693+0000 7fd110800700 1 -- 172.21.15.8:0/3563206480 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1081ab2f0 con 0x7fd108074300 2024-03-16T20:55:54.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.693+0000 7fd110800700 1 -- 172.21.15.8:0/3563206480 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1081ab740 con 0x7fd108074300 2024-03-16T20:55:54.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.694+0000 7fd110800700 1 -- 172.21.15.8:0/3563206480 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1081146e0 con 0x7fd108074300 2024-03-16T20:55:54.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.696+0000 7fd102a00700 1 -- 172.21.15.8:0/3563206480 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fd0fc00fc80 con 0x7fd108074300 2024-03-16T20:55:54.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.697+0000 7fd102a00700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd0f00a1c00 0x7fd0f00a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:54.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.697+0000 7fd102a00700 1 -- 172.21.15.8:0/3563206480 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd0fc0ce800 con 0x7fd108074300 2024-03-16T20:55:54.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.697+0000 7fd10d400700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd0f00a1c00 0x7fd0f00a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:54.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.697+0000 7fd102a00700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520] conn(0x7fd0f00ab3e0 0x7fd0f00ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:54.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.698+0000 7fd102a00700 1 -- 172.21.15.8:0/3563206480 --> [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0f00adeb0 con 0x7fd0f00ab3e0 2024-03-16T20:55:54.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.698+0000 7fd102a00700 1 -- 172.21.15.8:0/3563206480 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0fc0d0de0 con 0x7fd108074300 2024-03-16T20:55:54.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.698+0000 7fd10e800700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520] conn(0x7fd0f00ab3e0 0x7fd0f00ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:54.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.698+0000 7fd10d400700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd0f00a1c00 0x7fd0f00a40c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8005ea0 tx=0x7fd0f8005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:54.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.698+0000 7fd10e800700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520] conn(0x7fd0f00ab3e0 0x7fd0f00ad800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:54.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.699+0000 7fd102a00700 1 -- 172.21.15.8:0/3563206480 <== osd.1 v2:172.21.15.170:6800/1357795520 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd0f00adeb0 con 0x7fd0f00ab3e0 2024-03-16T20:55:54.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.717+0000 7fd110800700 1 -- 172.21.15.8:0/3563206480 --> [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1080ff1d0 con 0x7fd0f00ab3e0 2024-03-16T20:55:54.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.718+0000 7fd102a00700 1 -- 172.21.15.8:0/3563206480 <== osd.1 v2:172.21.15.170:6800/1357795520 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1080ff1d0 con 0x7fd0f00ab3e0 2024-03-16T20:55:54.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.718+0000 7fd110800700 1 -- 172.21.15.8:0/3563206480 >> [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520] conn(0x7fd0f00ab3e0 msgr2=0x7fd0f00ad800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.718+0000 7fd110800700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520] conn(0x7fd0f00ab3e0 0x7fd0f00ad800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.719+0000 7fd110800700 1 -- 172.21.15.8:0/3563206480 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd0f00a1c00 msgr2=0x7fd0f00a40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.719+0000 7fd110800700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd0f00a1c00 0x7fd0f00a40c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8005ea0 tx=0x7fd0f8005e30 comp rx=0 tx=0).stop 2024-03-16T20:55:54.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.719+0000 7fd110800700 1 -- 172.21.15.8:0/3563206480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd108074300 msgr2=0x7fd108101fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.719+0000 7fd110800700 1 --2- 172.21.15.8:0/3563206480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd108074300 0x7fd108101fe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc005910 tx=0x7fd0fc00be50 comp rx=0 tx=0).stop 2024-03-16T20:55:54.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.719+0000 7fd10e800700 1 -- 172.21.15.8:0/3563206480 reap_dead start 2024-03-16T20:55:54.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.719+0000 7fd110800700 1 -- 172.21.15.8:0/3563206480 shutdown_connections 2024-03-16T20:55:54.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.719+0000 7fd110800700 1 -- 172.21.15.8:0/3563206480 >> 172.21.15.8:0/3563206480 conn(0x7fd1080fdab0 msgr2=0x7fd1080fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:54.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.719+0000 7fd110800700 1 -- 172.21.15.8:0/3563206480 shutdown_connections 2024-03-16T20:55:54.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:54.719+0000 7fd110800700 1 -- 172.21.15.8:0/3563206480 wait complete. 2024-03-16T20:55:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.058+0000 7f562c800700 1 -- 172.21.15.8:0/1461094890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5624074d30 msgr2=0x7f562410e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.058+0000 7f562c800700 1 --2- 172.21.15.8:0/1461094890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5624074d30 0x7f562410e2c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5614009990 tx=0x7f5614009ca0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.058+0000 7f562c800700 1 -- 172.21.15.8:0/1461094890 shutdown_connections 2024-03-16T20:55:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.058+0000 7f562c800700 1 --2- 172.21.15.8:0/1461094890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5624074410 0x7f56240747f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.058+0000 7f562c800700 1 --2- 172.21.15.8:0/1461094890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f562410e800 0x7f5624110c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.058+0000 7f562c800700 1 --2- 172.21.15.8:0/1461094890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5624074d30 0x7f562410e2c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.058+0000 7f562c800700 1 -- 172.21.15.8:0/1461094890 >> 172.21.15.8:0/1461094890 conn(0x7f56240fda90 msgr2=0x7f56240ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.058+0000 7f562c800700 1 -- 172.21.15.8:0/1461094890 shutdown_connections 2024-03-16T20:55:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.058+0000 7f562c800700 1 -- 172.21.15.8:0/1461094890 wait complete. 2024-03-16T20:55:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.059+0000 7f562c800700 1 Processor -- start 2024-03-16T20:55:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.060+0000 7f562c800700 1 -- start start 2024-03-16T20:55:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.060+0000 7f562c800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5624074410 0x7f56241a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.060+0000 7f562c800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5624074d30 0x7f56241a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.060+0000 7f562c800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f562410e800 0x7f562419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.060+0000 7f562c800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562419af00 con 0x7f562410e800 2024-03-16T20:55:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.060+0000 7f562c800700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562419b070 con 0x7f5624074410 2024-03-16T20:55:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.060+0000 7f562c800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562419b230 con 0x7f5624074d30 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.060+0000 7f5629e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5624074410 0x7f56241a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.060+0000 7f5629400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5624074d30 0x7f56241a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f5629e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5624074410 0x7f56241a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32922/0 (socket says 172.21.15.8:32922) 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f5629e00700 1 -- 172.21.15.8:0/1679089121 learned_addr learned my addr 172.21.15.8:0/1679089121 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f562a800700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f562410e800 0x7f562419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f5629e00700 1 -- 172.21.15.8:0/1679089121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5624074d30 msgr2=0x7f56241a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f5629e00700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5624074d30 0x7f56241a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f5629e00700 1 -- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f562410e800 msgr2=0x7f562419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f5629e00700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f562410e800 0x7f562419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f5629e00700 1 -- 172.21.15.8:0/1679089121 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56140095f0 con 0x7f5624074410 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f5629400700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5624074d30 0x7f56241a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f5629e00700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5624074410 0x7f56241a0630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f561800e9a0 tx=0x7f561800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f561ea00700 1 -- 172.21.15.8:0/1679089121 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5618009790 con 0x7f5624074410 2024-03-16T20:55:54.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f561ea00700 1 -- 172.21.15.8:0/1679089121 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f5618010430 con 0x7f5624074410 2024-03-16T20:55:54.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.061+0000 7f562c800700 1 -- 172.21.15.8:0/1679089121 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562419b510 con 0x7f5624074410 2024-03-16T20:55:54.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.062+0000 7f561ea00700 1 -- 172.21.15.8:0/1679089121 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5618018680 con 0x7f5624074410 2024-03-16T20:55:54.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.062+0000 7f562c800700 1 -- 172.21.15.8:0/1679089121 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56241a7600 con 0x7f5624074410 2024-03-16T20:55:54.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.062+0000 7f562c800700 1 -- 172.21.15.8:0/1679089121 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5624114680 con 0x7f5624074410 2024-03-16T20:55:54.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.064+0000 7f561ea00700 1 -- 172.21.15.8:0/1679089121 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f56180109a0 con 0x7f5624074410 2024-03-16T20:55:54.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.066+0000 7f561ea00700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f560c0a1bd0 0x7f560c0a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.066+0000 7f561ea00700 1 -- 172.21.15.8:0/1679089121 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5618014070 con 0x7f5624074410 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.066+0000 7f5629400700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f560c0a1bd0 0x7f560c0a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.066+0000 7f561ea00700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859] conn(0x7f560c0ab3b0 0x7f560c0ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.066+0000 7f561ea00700 1 -- 172.21.15.8:0/1679089121 --> [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f560c0ade80 con 0x7f560c0ab3b0 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.066+0000 7f561ea00700 1 -- 172.21.15.8:0/1679089121 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56180cd9c0 con 0x7f5624074410 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.066+0000 7f562a800700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859] conn(0x7f560c0ab3b0 0x7f560c0ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.067+0000 7f5629400700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f560c0a1bd0 0x7f560c0a4090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f562419bec0 tx=0x7f561400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.067+0000 7f562a800700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859] conn(0x7f560c0ab3b0 0x7f560c0ad7d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.068+0000 7f561ea00700 1 -- 172.21.15.8:0/1679089121 <== osd.0 v2:172.21.15.8:6802/3522564859 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f560c0ade80 con 0x7f560c0ab3b0 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.094+0000 7f562c800700 1 -- 172.21.15.8:0/1679089121 --> [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5624062720 con 0x7f560c0ab3b0 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.095+0000 7f561ea00700 1 -- 172.21.15.8:0/1679089121 <== osd.0 v2:172.21.15.8:6802/3522564859 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5624062720 con 0x7f560c0ab3b0 2024-03-16T20:55:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.095+0000 7f562c800700 1 -- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859] conn(0x7f560c0ab3b0 msgr2=0x7f560c0ad7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.095+0000 7f562c800700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859] conn(0x7f560c0ab3b0 0x7f560c0ad7d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.095+0000 7f562c800700 1 -- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f560c0a1bd0 msgr2=0x7f560c0a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.095+0000 7f562c800700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f560c0a1bd0 0x7f560c0a4090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f562419bec0 tx=0x7f561400b260 comp rx=0 tx=0).stop 2024-03-16T20:55:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.095+0000 7f562c800700 1 -- 172.21.15.8:0/1679089121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5624074410 msgr2=0x7f56241a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.095+0000 7f562c800700 1 --2- 172.21.15.8:0/1679089121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5624074410 0x7f56241a0630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f561800e9a0 tx=0x7f561800ecb0 comp rx=0 tx=0).stop 2024-03-16T20:55:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.096+0000 7f562a800700 1 -- 172.21.15.8:0/1679089121 reap_dead start 2024-03-16T20:55:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.096+0000 7f562c800700 1 -- 172.21.15.8:0/1679089121 shutdown_connections 2024-03-16T20:55:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.096+0000 7f562c800700 1 -- 172.21.15.8:0/1679089121 >> 172.21.15.8:0/1679089121 conn(0x7f56240fda90 msgr2=0x7f56240fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.096+0000 7f562c800700 1 -- 172.21.15.8:0/1679089121 shutdown_connections 2024-03-16T20:55:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:50.096+0000 7f562c800700 1 -- 172.21.15.8:0/1679089121 wait complete. 2024-03-16T20:55:54.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:54 smithi170 ceph-mon[35947]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:55:54.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:54 smithi186 ceph-mon[36391]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:55:56.384 INFO:teuthology.orchestra.run.smithi008.stdout:55834574928 2024-03-16T20:55:56.385 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-16T20:55:56.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:56 smithi008 ceph-mon[31434]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:55:56.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:56 smithi170 ceph-mon[35947]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:55:56.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:56 smithi186 ceph-mon[36391]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:55:57.063 INFO:teuthology.orchestra.run.smithi008.stdout:146028888127 2024-03-16T20:55:57.064 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-16T20:55:57.065 INFO:teuthology.orchestra.run.smithi008.stdout:313532612635 2024-03-16T20:55:57.065 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.10 2024-03-16T20:55:57.294 INFO:teuthology.orchestra.run.smithi008.stdout:167503724601 2024-03-16T20:55:57.294 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-16T20:55:57.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.269+0000 7fd9e7400700 1 -- 172.21.15.8:0/2852556537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9e006a630 msgr2=0x7fd9e010ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:57.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.269+0000 7fd9e7400700 1 --2- 172.21.15.8:0/2852556537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9e006a630 0x7fd9e010ee70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800b0a0 tx=0x7fd9d800b3b0 comp rx=0 tx=0).stop 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.269+0000 7fd9e7400700 1 -- 172.21.15.8:0/2852556537 shutdown_connections 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.269+0000 7fd9e7400700 1 --2- 172.21.15.8:0/2852556537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9e006a630 0x7fd9e010ee70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.269+0000 7fd9e7400700 1 --2- 172.21.15.8:0/2852556537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9e0108030 0x7fd9e0108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.269+0000 7fd9e7400700 1 --2- 172.21.15.8:0/2852556537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9e0069c90 0x7fd9e006a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.269+0000 7fd9e7400700 1 -- 172.21.15.8:0/2852556537 >> 172.21.15.8:0/2852556537 conn(0x7fd9e0077e10 msgr2=0x7fd9e0078220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.269+0000 7fd9e7400700 1 -- 172.21.15.8:0/2852556537 shutdown_connections 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.269+0000 7fd9e7400700 1 -- 172.21.15.8:0/2852556537 wait complete. 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.271+0000 7fd9e7400700 1 Processor -- start 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.271+0000 7fd9e7400700 1 -- start start 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.271+0000 7fd9e7400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9e0069c90 0x7fd9e0100fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.272+0000 7fd9e7400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9e006a630 0x7fd9e01014f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:57.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.272+0000 7fd9e7400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9e0108030 0x7fd9e0101a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.272+0000 7fd9e7400700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e01a6ae0 con 0x7fd9e0108030 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.272+0000 7fd9e7400700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e01a6c50 con 0x7fd9e0069c90 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.272+0000 7fd9e7400700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e01a6e10 con 0x7fd9e006a630 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.272+0000 7fd9e4a00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9e0069c90 0x7fd9e0100fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.272+0000 7fd9e4a00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9e0069c90 0x7fd9e0100fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:33044/0 (socket says 172.21.15.8:33044) 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.272+0000 7fd9e4a00700 1 -- 172.21.15.8:0/1901281933 learned_addr learned my addr 172.21.15.8:0/1901281933 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.272+0000 7fd9e5400700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9e0108030 0x7fd9e0101a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.272+0000 7fd9dfe00700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9e006a630 0x7fd9e01014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.273+0000 7fd9e4a00700 1 -- 172.21.15.8:0/1901281933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9e006a630 msgr2=0x7fd9e01014f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.273+0000 7fd9e4a00700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9e006a630 0x7fd9e01014f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.273+0000 7fd9e4a00700 1 -- 172.21.15.8:0/1901281933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9e0108030 msgr2=0x7fd9e0101a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.273+0000 7fd9e4a00700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9e0108030 0x7fd9e0101a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.273+0000 7fd9e4a00700 1 -- 172.21.15.8:0/1901281933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc009520 con 0x7fd9e0069c90 2024-03-16T20:55:57.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.273+0000 7fd9e5400700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9e0108030 0x7fd9e0101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.273+0000 7fd9e4a00700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9e0069c90 0x7fd9e0100fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400e9a0 tx=0x7fd9d400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.273+0000 7fd9dd600700 1 -- 172.21.15.8:0/1901281933 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4009790 con 0x7fd9e0069c90 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.274+0000 7fd9dd600700 1 -- 172.21.15.8:0/1901281933 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd9d400cbd0 con 0x7fd9e0069c90 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.274+0000 7fd9dd600700 1 -- 172.21.15.8:0/1901281933 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40187e0 con 0x7fd9e0069c90 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.274+0000 7fd9e7400700 1 -- 172.21.15.8:0/1901281933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d8009d00 con 0x7fd9e0069c90 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.274+0000 7fd9e7400700 1 -- 172.21.15.8:0/1901281933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e01a7410 con 0x7fd9e0069c90 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.275+0000 7fd9e7400700 1 -- 172.21.15.8:0/1901281933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9e0112420 con 0x7fd9e0069c90 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.279+0000 7fd9dd600700 1 -- 172.21.15.8:0/1901281933 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fd9d40109c0 con 0x7fd9e0069c90 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.281+0000 7fd9dd600700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd9c80a1bd0 0x7fd9c80a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.281+0000 7fd9dd600700 1 -- 172.21.15.8:0/1901281933 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd9d4014070 con 0x7fd9e0069c90 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.281+0000 7fd9dfe00700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd9c80a1bd0 0x7fd9c80a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.282+0000 7fd9dd600700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805] conn(0x7fd9c80ab3b0 0x7fd9c80ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.282+0000 7fd9dd600700 1 -- 172.21.15.8:0/1901281933 --> [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9c80ade80 con 0x7fd9c80ab3b0 2024-03-16T20:55:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.282+0000 7fd9dd600700 1 -- 172.21.15.8:0/1901281933 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9d40cfa90 con 0x7fd9e0069c90 2024-03-16T20:55:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.282+0000 7fd9e5400700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805] conn(0x7fd9c80ab3b0 0x7fd9c80ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.282+0000 7fd9dfe00700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd9c80a1bd0 0x7fd9c80a4090 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0078330 tx=0x7fd9cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.283+0000 7fd9e5400700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805] conn(0x7fd9c80ab3b0 0x7fd9c80ad7d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.284+0000 7fd9dd600700 1 -- 172.21.15.8:0/1901281933 <== osd.2 v2:172.21.15.186:6800/1176857805 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd9c80ade80 con 0x7fd9c80ab3b0 2024-03-16T20:55:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.323+0000 7fd9e7400700 1 -- 172.21.15.8:0/1901281933 --> [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9e0100310 con 0x7fd9c80ab3b0 2024-03-16T20:55:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.323+0000 7fd9dd600700 1 -- 172.21.15.8:0/1901281933 <== osd.2 v2:172.21.15.186:6800/1176857805 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd9e0100310 con 0x7fd9c80ab3b0 2024-03-16T20:55:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.324+0000 7fd9e7400700 1 -- 172.21.15.8:0/1901281933 >> [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805] conn(0x7fd9c80ab3b0 msgr2=0x7fd9c80ad7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.324+0000 7fd9e7400700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805] conn(0x7fd9c80ab3b0 0x7fd9c80ad7d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.324+0000 7fd9e7400700 1 -- 172.21.15.8:0/1901281933 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd9c80a1bd0 msgr2=0x7fd9c80a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.324+0000 7fd9e7400700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd9c80a1bd0 0x7fd9c80a4090 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0078330 tx=0x7fd9cc009260 comp rx=0 tx=0).stop 2024-03-16T20:55:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.324+0000 7fd9e7400700 1 -- 172.21.15.8:0/1901281933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9e0069c90 msgr2=0x7fd9e0100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.324+0000 7fd9e7400700 1 --2- 172.21.15.8:0/1901281933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9e0069c90 0x7fd9e0100fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400e9a0 tx=0x7fd9d400ecb0 comp rx=0 tx=0).stop 2024-03-16T20:55:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.324+0000 7fd9e5400700 1 -- 172.21.15.8:0/1901281933 reap_dead start 2024-03-16T20:55:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.324+0000 7fd9e7400700 1 -- 172.21.15.8:0/1901281933 shutdown_connections 2024-03-16T20:55:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.324+0000 7fd9e7400700 1 -- 172.21.15.8:0/1901281933 >> 172.21.15.8:0/1901281933 conn(0x7fd9e0077e10 msgr2=0x7fd9e00ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.325+0000 7fd9e7400700 1 -- 172.21.15.8:0/1901281933 shutdown_connections 2024-03-16T20:55:57.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:57.325+0000 7fd9e7400700 1 -- 172.21.15.8:0/1901281933 wait complete. 2024-03-16T20:55:57.978 INFO:teuthology.orchestra.run.smithi008.stdout:34359738452 2024-03-16T20:55:57.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-16T20:55:58.714 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:55:58 smithi008 ceph-mon[31434]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:55:58.767 INFO:teuthology.orchestra.run.smithi008.stdout:77309411405 2024-03-16T20:55:58.767 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-16T20:55:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:55:58 smithi170 ceph-mon[35947]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:55:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:55:58 smithi186 ceph-mon[36391]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:55:59.595 INFO:teuthology.orchestra.run.smithi008.stdout:257698037801 2024-03-16T20:55:59.595 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.8 2024-03-16T20:55:59.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.581+0000 7f4157200700 1 -- 172.21.15.8:0/1353864561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4150102290 msgr2=0x7f4150102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:59.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.581+0000 7f4157200700 1 --2- 172.21.15.8:0/1353864561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4150102290 0x7f4150102670 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4140009990 tx=0x7f4140009ca0 comp rx=0 tx=0).stop 2024-03-16T20:55:59.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.582+0000 7f4157200700 1 -- 172.21.15.8:0/1353864561 shutdown_connections 2024-03-16T20:55:59.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.582+0000 7f4157200700 1 --2- 172.21.15.8:0/1353864561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4150107360 0x7f415010ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:59.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.582+0000 7f4157200700 1 --2- 172.21.15.8:0/1353864561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4150102290 0x7f4150102670 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:59.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.582+0000 7f4157200700 1 --2- 172.21.15.8:0/1353864561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4150102c40 0x7f4150106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:59.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.582+0000 7f4157200700 1 -- 172.21.15.8:0/1353864561 >> 172.21.15.8:0/1353864561 conn(0x7f4150079140 msgr2=0x7f4150079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:59.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.582+0000 7f4157200700 1 -- 172.21.15.8:0/1353864561 shutdown_connections 2024-03-16T20:55:59.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.582+0000 7f4157200700 1 -- 172.21.15.8:0/1353864561 wait complete. 2024-03-16T20:55:59.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.583+0000 7f4157200700 1 Processor -- start 2024-03-16T20:55:59.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.584+0000 7f4157200700 1 -- start start 2024-03-16T20:55:59.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.584+0000 7f4157200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4150102290 0x7f4150198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:59.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.584+0000 7f4157200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4150102c40 0x7f4150198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:59.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.584+0000 7f4157200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4150107360 0x7f415019cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:59.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.584+0000 7f4157200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415019d5f0 con 0x7f4150102290 2024-03-16T20:55:59.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.584+0000 7f4157200700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415019d760 con 0x7f4150102c40 2024-03-16T20:55:59.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.584+0000 7f4157200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415019d920 con 0x7f4150107360 2024-03-16T20:55:59.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.585+0000 7f414fe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4150102290 0x7f4150198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:59.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.585+0000 7f414f400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4150102c40 0x7f4150198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:59.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.585+0000 7f414f400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4150102c40 0x7f4150198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42158/0 (socket says 172.21.15.8:42158) 2024-03-16T20:55:59.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.585+0000 7f414fe00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4150102290 0x7f4150198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40346/0 (socket says 172.21.15.8:40346) 2024-03-16T20:55:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.585+0000 7f414f400700 1 -- 172.21.15.8:0/621074363 learned_addr learned my addr 172.21.15.8:0/621074363 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:55:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.585+0000 7f4155200700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4150107360 0x7f415019cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.585+0000 7f414f400700 1 -- 172.21.15.8:0/621074363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4150107360 msgr2=0x7f415019cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.585+0000 7f414f400700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4150107360 0x7f415019cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.585+0000 7f414f400700 1 -- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4150102290 msgr2=0x7f4150198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.585+0000 7f414f400700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4150102290 0x7f4150198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.585+0000 7f414f400700 1 -- 172.21.15.8:0/621074363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41400095f0 con 0x7f4150102c40 2024-03-16T20:55:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.586+0000 7f414f400700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4150102c40 0x7f4150198c50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f413c00e970 tx=0x7f413c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.586+0000 7f414cc00700 1 -- 172.21.15.8:0/621074363 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c009790 con 0x7f4150102c40 2024-03-16T20:55:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.586+0000 7f414cc00700 1 -- 172.21.15.8:0/621074363 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f413c00eec0 con 0x7f4150102c40 2024-03-16T20:55:59.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.586+0000 7f414cc00700 1 -- 172.21.15.8:0/621074363 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c005700 con 0x7f4150102c40 2024-03-16T20:55:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.586+0000 7f4157200700 1 -- 172.21.15.8:0/621074363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415019dc00 con 0x7f4150102c40 2024-03-16T20:55:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.586+0000 7f4157200700 1 -- 172.21.15.8:0/621074363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41501a5460 con 0x7f4150102c40 2024-03-16T20:55:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.587+0000 7f4157200700 1 -- 172.21.15.8:0/621074363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4150112590 con 0x7f4150102c40 2024-03-16T20:55:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.589+0000 7f414cc00700 1 -- 172.21.15.8:0/621074363 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f413c004750 con 0x7f4150102c40 2024-03-16T20:55:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.591+0000 7f414cc00700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f41340a1bd0 0x7f41340a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.591+0000 7f414cc00700 1 -- 172.21.15.8:0/621074363 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f413c014070 con 0x7f4150102c40 2024-03-16T20:55:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.591+0000 7f414fe00700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f41340a1bd0 0x7f41340a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.591+0000 7f414cc00700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181] conn(0x7f41340ab3b0 0x7f41340ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:55:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.591+0000 7f414cc00700 1 -- 172.21.15.8:0/621074363 --> [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41340ade80 con 0x7f41340ab3b0 2024-03-16T20:55:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.591+0000 7f414cc00700 1 -- 172.21.15.8:0/621074363 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f413c0cfb90 con 0x7f4150102c40 2024-03-16T20:55:59.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.592+0000 7f4155200700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181] conn(0x7f41340ab3b0 0x7f41340ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:55:59.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.592+0000 7f414fe00700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f41340a1bd0 0x7f41340a4090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f414000b2e0 tx=0x7f4140005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:59.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.592+0000 7f4155200700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181] conn(0x7f41340ab3b0 0x7f41340ad7d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:55:59.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.594+0000 7f414cc00700 1 -- 172.21.15.8:0/621074363 <== osd.6 v2:172.21.15.8:6818/53202181 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f41340ade80 con 0x7f41340ab3b0 2024-03-16T20:55:59.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.612+0000 7f4157200700 1 -- 172.21.15.8:0/621074363 --> [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41500626f0 con 0x7f41340ab3b0 2024-03-16T20:55:59.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.613+0000 7f414cc00700 1 -- 172.21.15.8:0/621074363 <== osd.6 v2:172.21.15.8:6818/53202181 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f41500626f0 con 0x7f41340ab3b0 2024-03-16T20:55:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.613+0000 7f4157200700 1 -- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181] conn(0x7f41340ab3b0 msgr2=0x7f41340ad7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.613+0000 7f4157200700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181] conn(0x7f41340ab3b0 0x7f41340ad7d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:55:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.613+0000 7f4157200700 1 -- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f41340a1bd0 msgr2=0x7f41340a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.613+0000 7f4157200700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f41340a1bd0 0x7f41340a4090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f414000b2e0 tx=0x7f4140005fd0 comp rx=0 tx=0).stop 2024-03-16T20:55:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.613+0000 7f4157200700 1 -- 172.21.15.8:0/621074363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4150102c40 msgr2=0x7f4150198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:55:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.613+0000 7f4157200700 1 --2- 172.21.15.8:0/621074363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4150102c40 0x7f4150198c50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f413c00e970 tx=0x7f413c00ec80 comp rx=0 tx=0).stop 2024-03-16T20:55:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.613+0000 7f4155200700 1 -- 172.21.15.8:0/621074363 reap_dead start 2024-03-16T20:55:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.613+0000 7f4157200700 1 -- 172.21.15.8:0/621074363 shutdown_connections 2024-03-16T20:55:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.613+0000 7f4157200700 1 -- 172.21.15.8:0/621074363 >> 172.21.15.8:0/621074363 conn(0x7f4150079140 msgr2=0x7f4150100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:55:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.614+0000 7f4157200700 1 -- 172.21.15.8:0/621074363 shutdown_connections 2024-03-16T20:55:59.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:55:59.614+0000 7f4157200700 1 -- 172.21.15.8:0/621074363 wait complete. 2024-03-16T20:56:00.443 INFO:teuthology.orchestra.run.smithi008.stdout:201863462964 2024-03-16T20:56:00.444 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-03-16T20:56:00.496 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:00.496 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:00.554 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:00.559 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:00.584 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:00.630 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:00 smithi008 ceph-mon[31434]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:56:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:00 smithi170 ceph-mon[35947]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:56:00.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:00 smithi186 ceph-mon[36391]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:56:01.017 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:01.020 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:01.020 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:01.024 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:01.686 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:01.687 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:02.530 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:02 smithi008 ceph-mon[31434]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-16T20:56:02.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:02 smithi170 ceph-mon[35947]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-16T20:56:02.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:02 smithi186 ceph-mon[36391]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-16T20:56:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-16T20:56:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-03-16T20:56:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-03-16T20:56:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-03-16T20:56:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-03-16T20:56:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-03-16T20:56:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-03-16T20:56:03.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:03 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-03-16T20:56:03.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-16T20:56:03.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-03-16T20:56:03.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-03-16T20:56:03.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-03-16T20:56:03.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-03-16T20:56:03.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-03-16T20:56:03.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-03-16T20:56:03.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:03 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-03-16T20:56:03.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-16T20:56:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-03-16T20:56:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-03-16T20:56:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-03-16T20:56:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-03-16T20:56:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-03-16T20:56:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-03-16T20:56:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:03 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-03-16T20:56:04.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:04 smithi008 ceph-mon[31434]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:04.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-16T20:56:04.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-03-16T20:56:04.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-03-16T20:56:04.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-03-16T20:56:04.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-03-16T20:56:04.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-03-16T20:56:04.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-03-16T20:56:04.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:04 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-03-16T20:56:04.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:04 smithi008 ceph-mon[31434]: osdmap e87: 12 total, 12 up, 12 in 2024-03-16T20:56:04.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:04 smithi170 ceph-mon[35947]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:04.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-16T20:56:04.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-03-16T20:56:04.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-03-16T20:56:04.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-03-16T20:56:04.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-03-16T20:56:04.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-03-16T20:56:04.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-03-16T20:56:04.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:04 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-03-16T20:56:04.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:04 smithi170 ceph-mon[35947]: osdmap e87: 12 total, 12 up, 12 in 2024-03-16T20:56:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:04 smithi186 ceph-mon[36391]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-16T20:56:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-03-16T20:56:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-03-16T20:56:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-03-16T20:56:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-03-16T20:56:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-03-16T20:56:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-03-16T20:56:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:04 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-03-16T20:56:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:04 smithi186 ceph-mon[36391]: osdmap e87: 12 total, 12 up, 12 in 2024-03-16T20:56:05.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:05 smithi186 ceph-mon[36391]: osdmap e88: 12 total, 12 up, 12 in 2024-03-16T20:56:05.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:05 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:56:05.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:05 smithi170 ceph-mon[35947]: osdmap e88: 12 total, 12 up, 12 in 2024-03-16T20:56:05.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:05 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:56:05.910 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:05 smithi008 ceph-mon[31434]: osdmap e88: 12 total, 12 up, 12 in 2024-03-16T20:56:05.910 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:05 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:56:06.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:06 smithi008 ceph-mon[31434]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:56:06.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:06 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:06.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:06 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:06.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:06 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:06.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:06 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:06 smithi170 ceph-mon[35947]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:56:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:06 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:06 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:06 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:06 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:06.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:06 smithi186 ceph-mon[36391]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:56:06.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:06 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:06.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:06 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:06.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:06 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:06.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:06 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:08.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:08 smithi008 ceph-mon[31434]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 28 B/s, 1 objects/s recovering 2024-03-16T20:56:08.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:08 smithi170 ceph-mon[35947]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 28 B/s, 1 objects/s recovering 2024-03-16T20:56:08.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:08 smithi186 ceph-mon[36391]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 28 B/s, 1 objects/s recovering 2024-03-16T20:56:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:10.657 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:10 smithi008 ceph-mon[31434]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5 op/s; 28 B/s, 1 objects/s recovering 2024-03-16T20:56:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:10 smithi170 ceph-mon[35947]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5 op/s; 28 B/s, 1 objects/s recovering 2024-03-16T20:56:10.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:10 smithi186 ceph-mon[36391]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5 op/s; 28 B/s, 1 objects/s recovering 2024-03-16T20:56:11.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.134+0000 7f1b79200700 1 -- 172.21.15.8:0/1312104390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74105f10 msgr2=0x7f1b741062f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:11.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.134+0000 7f1b79200700 1 --2- 172.21.15.8:0/1312104390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74105f10 0x7f1b741062f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009990 tx=0x7f1b64009ca0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.134+0000 7f1b79200700 1 -- 172.21.15.8:0/1312104390 shutdown_connections 2024-03-16T20:56:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.134+0000 7f1b79200700 1 --2- 172.21.15.8:0/1312104390 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b74107590 0x7f1b7410dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.134+0000 7f1b79200700 1 --2- 172.21.15.8:0/1312104390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74105f10 0x7f1b741062f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.134+0000 7f1b79200700 1 --2- 172.21.15.8:0/1312104390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b74106bd0 0x7f1b74107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.134+0000 7f1b79200700 1 -- 172.21.15.8:0/1312104390 >> 172.21.15.8:0/1312104390 conn(0x7f1b740770b0 msgr2=0x7f1b740fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.134+0000 7f1b79200700 1 -- 172.21.15.8:0/1312104390 shutdown_connections 2024-03-16T20:56:11.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.134+0000 7f1b79200700 1 -- 172.21.15.8:0/1312104390 wait complete. 2024-03-16T20:56:11.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.136+0000 7f1b79200700 1 Processor -- start 2024-03-16T20:56:11.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.136+0000 7f1b79200700 1 -- start start 2024-03-16T20:56:11.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.137+0000 7f1b79200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b74105f10 0x7f1b741a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:11.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.137+0000 7f1b79200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b74106bd0 0x7f1b741a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:11.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.137+0000 7f1b79200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74107590 0x7f1b7419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:11.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.137+0000 7f1b79200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7419abf0 con 0x7f1b74106bd0 2024-03-16T20:56:11.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.137+0000 7f1b79200700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7419ad30 con 0x7f1b74107590 2024-03-16T20:56:11.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.137+0000 7f1b79200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7419aef0 con 0x7f1b74105f10 2024-03-16T20:56:11.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.137+0000 7f1b71e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b74105f10 0x7f1b741a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:11.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.137+0000 7f1b71e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b74105f10 0x7f1b741a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44532/0 (socket says 172.21.15.8:44532) 2024-03-16T20:56:11.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.137+0000 7f1b71e00700 1 -- 172.21.15.8:0/198967731 learned_addr learned my addr 172.21.15.8:0/198967731 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:11.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.138+0000 7f1b71400700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b74106bd0 0x7f1b741a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:11.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.138+0000 7f1b71e00700 1 -- 172.21.15.8:0/198967731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74107590 msgr2=0x7f1b7419a590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T20:56:11.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.138+0000 7f1b71e00700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74107590 0x7f1b7419a590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.138+0000 7f1b71e00700 1 -- 172.21.15.8:0/198967731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b74106bd0 msgr2=0x7f1b741a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.138+0000 7f1b71e00700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b74106bd0 0x7f1b741a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.138+0000 7f1b71e00700 1 -- 172.21.15.8:0/198967731 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b60009520 con 0x7f1b74105f10 2024-03-16T20:56:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.138+0000 7f1b71400700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b74106bd0 0x7f1b741a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:56:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.138+0000 7f1b71e00700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b74105f10 0x7f1b741a03d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b64005910 tx=0x7f1b6400b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.138+0000 7f1b6aa00700 1 -- 172.21.15.8:0/198967731 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6401d070 con 0x7f1b74105f10 2024-03-16T20:56:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.139+0000 7f1b6aa00700 1 -- 172.21.15.8:0/198967731 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1b64004d30 con 0x7f1b74105f10 2024-03-16T20:56:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.139+0000 7f1b6aa00700 1 -- 172.21.15.8:0/198967731 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640055a0 con 0x7f1b74105f10 2024-03-16T20:56:11.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.139+0000 7f1b79200700 1 -- 172.21.15.8:0/198967731 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b640095f0 con 0x7f1b74105f10 2024-03-16T20:56:11.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.139+0000 7f1b79200700 1 -- 172.21.15.8:0/198967731 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7419b340 con 0x7f1b74105f10 2024-03-16T20:56:11.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.140+0000 7f1b79200700 1 -- 172.21.15.8:0/198967731 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b74068ca0 con 0x7f1b74105f10 2024-03-16T20:56:11.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.142+0000 7f1b6aa00700 1 -- 172.21.15.8:0/198967731 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f1b64004800 con 0x7f1b74105f10 2024-03-16T20:56:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.143+0000 7f1b6aa00700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b580a1bd0 0x7f1b580a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:11.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.144+0000 7f1b6aa00700 1 -- 172.21.15.8:0/198967731 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1b640ce740 con 0x7f1b74105f10 2024-03-16T20:56:11.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.144+0000 7f1b71400700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b580a1bd0 0x7f1b580a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:11.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.145+0000 7f1b71400700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b580a1bd0 0x7f1b580a4090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b74103220 tx=0x7f1b60009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:11.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.147+0000 7f1b6aa00700 1 -- 172.21.15.8:0/198967731 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1b6405d280 con 0x7f1b74105f10 2024-03-16T20:56:11.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.402+0000 7f1b79200700 1 -- 172.21.15.8:0/198967731 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1b74111280 con 0x7f1b74105f10 2024-03-16T20:56:11.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.403+0000 7f1b6aa00700 1 -- 172.21.15.8:0/198967731 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b64097830 con 0x7f1b74105f10 2024-03-16T20:56:11.407 INFO:teuthology.orchestra.run.smithi008.stdout:55834574931 2024-03-16T20:56:11.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 -- 172.21.15.8:0/198967731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b580a1bd0 msgr2=0x7f1b580a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b580a1bd0 0x7f1b580a4090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b74103220 tx=0x7f1b60009260 comp rx=0 tx=0).stop 2024-03-16T20:56:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 -- 172.21.15.8:0/198967731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b74105f10 msgr2=0x7f1b741a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b74105f10 0x7f1b741a03d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b64005910 tx=0x7f1b6400b8f0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 -- 172.21.15.8:0/198967731 shutdown_connections 2024-03-16T20:56:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1b580a1bd0 0x7f1b580a4090 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b74107590 0x7f1b7419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b74105f10 0x7f1b741a03d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 --2- 172.21.15.8:0/198967731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b74106bd0 0x7f1b741a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 -- 172.21.15.8:0/198967731 >> 172.21.15.8:0/198967731 conn(0x7f1b740770b0 msgr2=0x7f1b740fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 -- 172.21.15.8:0/198967731 shutdown_connections 2024-03-16T20:56:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.406+0000 7f1b79200700 1 -- 172.21.15.8:0/198967731 wait complete. 2024-03-16T20:56:11.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.402+0000 7f0f6a600700 1 -- 172.21.15.8:0/993679579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f64107200 msgr2=0x7f0f6410edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:11.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.402+0000 7f0f6a600700 1 --2- 172.21.15.8:0/993679579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f64107200 0x7f0f6410edd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00b0a0 tx=0x7f0f5c00b3b0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.402+0000 7f0f6a600700 1 -- 172.21.15.8:0/993679579 shutdown_connections 2024-03-16T20:56:11.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.402+0000 7f0f6a600700 1 --2- 172.21.15.8:0/993679579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f64102120 0x7f0f64102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.402+0000 7f0f6a600700 1 --2- 172.21.15.8:0/993679579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f64107200 0x7f0f6410edd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.402+0000 7f0f6a600700 1 --2- 172.21.15.8:0/993679579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f64102ad0 0x7f0f64106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.402+0000 7f0f6a600700 1 -- 172.21.15.8:0/993679579 >> 172.21.15.8:0/993679579 conn(0x7f0f640fd9b0 msgr2=0x7f0f640ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:11.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.402+0000 7f0f6a600700 1 -- 172.21.15.8:0/993679579 shutdown_connections 2024-03-16T20:56:11.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.402+0000 7f0f6a600700 1 -- 172.21.15.8:0/993679579 wait complete. 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.404+0000 7f0f6a600700 1 Processor -- start 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.404+0000 7f0f6a600700 1 -- start start 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.405+0000 7f0f6a600700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f64102120 0x7f0f641a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.405+0000 7f0f6a600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f64102ad0 0x7f0f641a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.405+0000 7f0f6a600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f64107200 0x7f0f6419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.405+0000 7f0f6a600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6419ac60 con 0x7f0f64107200 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.405+0000 7f0f6a600700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6419ada0 con 0x7f0f64102120 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.405+0000 7f0f6a600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6419af60 con 0x7f0f64102ad0 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.405+0000 7f0f63e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f64102ad0 0x7f0f641a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.405+0000 7f0f63e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f64102ad0 0x7f0f641a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44514/0 (socket says 172.21.15.8:44514) 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.405+0000 7f0f63e00700 1 -- 172.21.15.8:0/1917416750 learned_addr learned my addr 172.21.15.8:0/1917416750 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.405+0000 7f0f69c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f64107200 0x7f0f6419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:11.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.405+0000 7f0f69200700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f64102120 0x7f0f641a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.406+0000 7f0f63e00700 1 -- 172.21.15.8:0/1917416750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f64102120 msgr2=0x7f0f641a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.406+0000 7f0f63e00700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f64102120 0x7f0f641a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.406+0000 7f0f63e00700 1 -- 172.21.15.8:0/1917416750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f64107200 msgr2=0x7f0f6419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.406+0000 7f0f63e00700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f64107200 0x7f0f6419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.406+0000 7f0f63e00700 1 -- 172.21.15.8:0/1917416750 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f50009520 con 0x7f0f64102ad0 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.406+0000 7f0f63e00700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f64102ad0 0x7f0f641a0980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000ea30 tx=0x7f0f5000ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.406+0000 7f0f61600700 1 -- 172.21.15.8:0/1917416750 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000cbd0 con 0x7f0f64102ad0 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.406+0000 7f0f61600700 1 -- 172.21.15.8:0/1917416750 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0f5000eed0 con 0x7f0f64102ad0 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.406+0000 7f0f61600700 1 -- 172.21.15.8:0/1917416750 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f50010430 con 0x7f0f64102ad0 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.407+0000 7f0f6a600700 1 -- 172.21.15.8:0/1917416750 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c009d00 con 0x7f0f64102ad0 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.407+0000 7f0f6a600700 1 -- 172.21.15.8:0/1917416750 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f641a7310 con 0x7f0f64102ad0 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.408+0000 7f0f6a600700 1 -- 172.21.15.8:0/1917416750 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f64068ca0 con 0x7f0f64102ad0 2024-03-16T20:56:11.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.410+0000 7f0f61600700 1 -- 172.21.15.8:0/1917416750 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f0f50003ed0 con 0x7f0f64102ad0 2024-03-16T20:56:11.521 INFO:teuthology.orchestra.run.smithi008.stdout:167503724605 2024-03-16T20:56:11.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.411+0000 7f0f61600700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0f4c0a1bd0 0x7f0f4c0a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:11.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.411+0000 7f0f61600700 1 -- 172.21.15.8:0/1917416750 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0f50014070 con 0x7f0f64102ad0 2024-03-16T20:56:11.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.411+0000 7f0f69200700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0f4c0a1bd0 0x7f0f4c0a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:11.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.412+0000 7f0f69200700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0f4c0a1bd0 0x7f0f4c0a4090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009c60 tx=0x7f0f58009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:11.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.415+0000 7f0f61600700 1 -- 172.21.15.8:0/1917416750 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0f500967e0 con 0x7f0f64102ad0 2024-03-16T20:56:11.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.649+0000 7f0f6a600700 1 -- 172.21.15.8:0/1917416750 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0f6419bb30 con 0x7f0f64102ad0 2024-03-16T20:56:11.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.649+0000 7f0f61600700 1 -- 172.21.15.8:0/1917416750 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f50099ea0 con 0x7f0f64102ad0 2024-03-16T20:56:11.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.653+0000 7f0f6a600700 1 -- 172.21.15.8:0/1917416750 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0f4c0a1bd0 msgr2=0x7f0f4c0a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:11.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.653+0000 7f0f6a600700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0f4c0a1bd0 0x7f0f4c0a4090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009c60 tx=0x7f0f58009260 comp rx=0 tx=0).stop 2024-03-16T20:56:11.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.653+0000 7f0f6a600700 1 -- 172.21.15.8:0/1917416750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f64102ad0 msgr2=0x7f0f641a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:11.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.653+0000 7f0f6a600700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f64102ad0 0x7f0f641a0980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000ea30 tx=0x7f0f5000ed40 comp rx=0 tx=0).stop 2024-03-16T20:56:11.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.653+0000 7f0f6a600700 1 -- 172.21.15.8:0/1917416750 shutdown_connections 2024-03-16T20:56:11.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.653+0000 7f0f6a600700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0f4c0a1bd0 0x7f0f4c0a4090 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.653+0000 7f0f6a600700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f64107200 0x7f0f6419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.653+0000 7f0f6a600700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f64102120 0x7f0f641a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.653+0000 7f0f6a600700 1 --2- 172.21.15.8:0/1917416750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f64102ad0 0x7f0f641a0980 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:11.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.653+0000 7f0f6a600700 1 -- 172.21.15.8:0/1917416750 >> 172.21.15.8:0/1917416750 conn(0x7f0f640fd9b0 msgr2=0x7f0f6410eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:11.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.653+0000 7f0f6a600700 1 -- 172.21.15.8:0/1917416750 shutdown_connections 2024-03-16T20:56:11.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:10.654+0000 7f0f6a600700 1 -- 172.21.15.8:0/1917416750 wait complete. 2024-03-16T20:56:11.847 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:11 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1917416750' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-16T20:56:11.847 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:11 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/198967731' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-16T20:56:11.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:11 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1917416750' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-16T20:56:11.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:11 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/198967731' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-16T20:56:11.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:11 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1917416750' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-16T20:56:11.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:11 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/198967731' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-16T20:56:12.788 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724601 got 167503724605 for osd.5 2024-03-16T20:56:12.788 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:12.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:12 smithi008 ceph-mon[31434]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 28 B/s, 1 objects/s recovering 2024-03-16T20:56:12.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:12 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2025081386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-16T20:56:12.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:12 smithi170 ceph-mon[35947]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 28 B/s, 1 objects/s recovering 2024-03-16T20:56:12.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:12 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2025081386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-16T20:56:12.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:12 smithi186 ceph-mon[36391]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 28 B/s, 1 objects/s recovering 2024-03-16T20:56:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:12 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2025081386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.416+0000 7f604ba00700 1 -- 172.21.15.8:0/1615504999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6044102290 msgr2=0x7f6044102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.416+0000 7f604ba00700 1 --2- 172.21.15.8:0/1615504999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6044102290 0x7f6044102670 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6038009990 tx=0x7f6038009ca0 comp rx=0 tx=0).stop 2024-03-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.416+0000 7f604ba00700 1 -- 172.21.15.8:0/1615504999 shutdown_connections 2024-03-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.416+0000 7f604ba00700 1 --2- 172.21.15.8:0/1615504999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6044107360 0x7f604410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.416+0000 7f604ba00700 1 --2- 172.21.15.8:0/1615504999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6044102290 0x7f6044102670 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.416+0000 7f604ba00700 1 --2- 172.21.15.8:0/1615504999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044102c40 0x7f6044106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.416+0000 7f604ba00700 1 -- 172.21.15.8:0/1615504999 >> 172.21.15.8:0/1615504999 conn(0x7f6044079140 msgr2=0x7f6044079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.416+0000 7f604ba00700 1 -- 172.21.15.8:0/1615504999 shutdown_connections 2024-03-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.416+0000 7f604ba00700 1 -- 172.21.15.8:0/1615504999 wait complete. 2024-03-16T20:56:13.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.418+0000 7f604ba00700 1 Processor -- start 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.418+0000 7f604ba00700 1 -- start start 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.418+0000 7f604ba00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044102290 0x7f6044198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.418+0000 7f604ba00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6044102c40 0x7f6044198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.418+0000 7f604ba00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6044107360 0x7f604419cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.418+0000 7f604ba00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604419d5f0 con 0x7f6044102290 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.418+0000 7f604ba00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604419d760 con 0x7f6044107360 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.418+0000 7f604ba00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604419d920 con 0x7f6044102c40 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.419+0000 7f6049a00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6044107360 0x7f604419cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.419+0000 7f6049000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044102290 0x7f6044198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.419+0000 7f6049a00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6044107360 0x7f604419cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55314/0 (socket says 172.21.15.8:55314) 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.419+0000 7f6043e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6044102c40 0x7f6044198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.419+0000 7f6049a00700 1 -- 172.21.15.8:0/2025081386 learned_addr learned my addr 172.21.15.8:0/2025081386 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:13.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.419+0000 7f6049a00700 1 -- 172.21.15.8:0/2025081386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6044102c40 msgr2=0x7f6044198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.419+0000 7f6049a00700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6044102c40 0x7f6044198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.419+0000 7f6049a00700 1 -- 172.21.15.8:0/2025081386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044102290 msgr2=0x7f6044198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.419+0000 7f6049a00700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044102290 0x7f6044198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.419+0000 7f6049a00700 1 -- 172.21.15.8:0/2025081386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60380095f0 con 0x7f6044107360 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.420+0000 7f6049a00700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6044107360 0x7f604419cfe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f603c00efc0 tx=0x7f603c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.420+0000 7f6041600700 1 -- 172.21.15.8:0/2025081386 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c018070 con 0x7f6044107360 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.420+0000 7f6041600700 1 -- 172.21.15.8:0/2025081386 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f603c00f040 con 0x7f6044107360 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.420+0000 7f6041600700 1 -- 172.21.15.8:0/2025081386 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c00cd80 con 0x7f6044107360 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.420+0000 7f604ba00700 1 -- 172.21.15.8:0/2025081386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604419dba0 con 0x7f6044107360 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.420+0000 7f604ba00700 1 -- 172.21.15.8:0/2025081386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60440743e0 con 0x7f6044107360 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.421+0000 7f604ba00700 1 -- 172.21.15.8:0/2025081386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604410a590 con 0x7f6044107360 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.423+0000 7f6041600700 1 -- 172.21.15.8:0/2025081386 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f603c004ad0 con 0x7f6044107360 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.424+0000 7f6041600700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f602c0a1bd0 0x7f602c0a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.425+0000 7f6041600700 1 -- 172.21.15.8:0/2025081386 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f603c0cce40 con 0x7f6044107360 2024-03-16T20:56:13.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.425+0000 7f6049000700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f602c0a1bd0 0x7f602c0a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:13.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.426+0000 7f6049000700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f602c0a1bd0 0x7f602c0a4090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6038006010 tx=0x7f603800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:13.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.429+0000 7f6041600700 1 -- 172.21.15.8:0/2025081386 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f603c095f30 con 0x7f6044107360 2024-03-16T20:56:13.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.660+0000 7f604ba00700 1 -- 172.21.15.8:0/2025081386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f6044068ca0 con 0x7f6044107360 2024-03-16T20:56:13.408 INFO:teuthology.orchestra.run.smithi008.stdout:347892351002 2024-03-16T20:56:13.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.661+0000 7f6041600700 1 -- 172.21.15.8:0/2025081386 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f603c0995f0 con 0x7f6044107360 2024-03-16T20:56:13.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.663+0000 7f604ba00700 1 -- 172.21.15.8:0/2025081386 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f602c0a1bd0 msgr2=0x7f602c0a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:13.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.663+0000 7f604ba00700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f602c0a1bd0 0x7f602c0a4090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6038006010 tx=0x7f603800b260 comp rx=0 tx=0).stop 2024-03-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.663+0000 7f604ba00700 1 -- 172.21.15.8:0/2025081386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6044107360 msgr2=0x7f604419cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.663+0000 7f604ba00700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6044107360 0x7f604419cfe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f603c00efc0 tx=0x7f603c00c3a0 comp rx=0 tx=0).stop 2024-03-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.664+0000 7f604ba00700 1 -- 172.21.15.8:0/2025081386 shutdown_connections 2024-03-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.664+0000 7f604ba00700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f602c0a1bd0 0x7f602c0a4090 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.664+0000 7f604ba00700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044102290 0x7f6044198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.664+0000 7f604ba00700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6044107360 0x7f604419cfe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.664+0000 7f604ba00700 1 --2- 172.21.15.8:0/2025081386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6044102c40 0x7f6044198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.664+0000 7f604ba00700 1 -- 172.21.15.8:0/2025081386 >> 172.21.15.8:0/2025081386 conn(0x7f6044079140 msgr2=0x7f6044106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.664+0000 7f604ba00700 1 -- 172.21.15.8:0/2025081386 shutdown_connections 2024-03-16T20:56:13.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:11.664+0000 7f604ba00700 1 -- 172.21.15.8:0/2025081386 wait complete. 2024-03-16T20:56:13.742 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:13 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3031685455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-16T20:56:13.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:13 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3031685455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-16T20:56:13.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:13 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3031685455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-16T20:56:14.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:14 smithi008 ceph-mon[31434]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 23 B/s, 1 objects/s recovering 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.799+0000 7f0fc8600700 1 -- 172.21.15.8:0/2207800972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc0104400 msgr2=0x7f0fc01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.799+0000 7f0fc8600700 1 --2- 172.21.15.8:0/2207800972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc0104400 0x7f0fc01047e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400b0a0 tx=0x7f0fb400b3b0 comp rx=0 tx=0).stop 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.799+0000 7f0fc8600700 1 -- 172.21.15.8:0/2207800972 shutdown_connections 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.799+0000 7f0fc8600700 1 --2- 172.21.15.8:0/2207800972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc01094e0 0x7f0fc01110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.799+0000 7f0fc8600700 1 --2- 172.21.15.8:0/2207800972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc0104400 0x7f0fc01047e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.799+0000 7f0fc8600700 1 --2- 172.21.15.8:0/2207800972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc0104db0 0x7f0fc0108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.799+0000 7f0fc8600700 1 -- 172.21.15.8:0/2207800972 >> 172.21.15.8:0/2207800972 conn(0x7f0fc00ffcb0 msgr2=0x7f0fc01020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.799+0000 7f0fc8600700 1 -- 172.21.15.8:0/2207800972 shutdown_connections 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.799+0000 7f0fc8600700 1 -- 172.21.15.8:0/2207800972 wait complete. 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.800+0000 7f0fc8600700 1 Processor -- start 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.800+0000 7f0fc8600700 1 -- start start 2024-03-16T20:56:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.801+0000 7f0fc8600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc0104400 0x7f0fc01a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.801+0000 7f0fc8600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc0104db0 0x7f0fc01a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.801+0000 7f0fc8600700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc01094e0 0x7f0fc019a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.801+0000 7f0fc8600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc019af10 con 0x7f0fc0104db0 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.801+0000 7f0fc8600700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc019b080 con 0x7f0fc01094e0 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.801+0000 7f0fc8600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc019b240 con 0x7f0fc0104400 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.801+0000 7f0fc5c00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc0104400 0x7f0fc01a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.801+0000 7f0fc5c00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc0104400 0x7f0fc01a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44564/0 (socket says 172.21.15.8:44564) 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.801+0000 7f0fc5c00700 1 -- 172.21.15.8:0/3031685455 learned_addr learned my addr 172.21.15.8:0/3031685455 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.801+0000 7f0fc5200700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc0104db0 0x7f0fc01a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.802+0000 7f0fc6600700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc01094e0 0x7f0fc019a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.802+0000 7f0fc5c00700 1 -- 172.21.15.8:0/3031685455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc01094e0 msgr2=0x7f0fc019a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.802+0000 7f0fc5c00700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc01094e0 0x7f0fc019a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.802+0000 7f0fc5c00700 1 -- 172.21.15.8:0/3031685455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc0104db0 msgr2=0x7f0fc01a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.802+0000 7f0fc5c00700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc0104db0 0x7f0fc01a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.802+0000 7f0fc5c00700 1 -- 172.21.15.8:0/3031685455 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb4009d00 con 0x7f0fc0104400 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.802+0000 7f0fc6600700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc01094e0 0x7f0fc019a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.802+0000 7f0fc5c00700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc0104400 0x7f0fc01a0690 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400b070 tx=0x7f0fb4004a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.803+0000 7f0fbe000700 1 -- 172.21.15.8:0/3031685455 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400e040 con 0x7f0fc0104400 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.803+0000 7f0fbe000700 1 -- 172.21.15.8:0/3031685455 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0fb40077c0 con 0x7f0fc0104400 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.803+0000 7f0fc8600700 1 -- 172.21.15.8:0/3031685455 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc019b4c0 con 0x7f0fc0104400 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.803+0000 7f0fbe000700 1 -- 172.21.15.8:0/3031685455 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb401b740 con 0x7f0fc0104400 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.803+0000 7f0fc8600700 1 -- 172.21.15.8:0/3031685455 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc01a76c0 con 0x7f0fc0104400 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.804+0000 7f0fc8600700 1 -- 172.21.15.8:0/3031685455 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc010c710 con 0x7f0fc0104400 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.806+0000 7f0fbe000700 1 -- 172.21.15.8:0/3031685455 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f0fb401b8a0 con 0x7f0fc0104400 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.807+0000 7f0fbe000700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0fa80a1bd0 0x7f0fa80a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.808+0000 7f0fbe000700 1 -- 172.21.15.8:0/3031685455 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0fb40ceee0 con 0x7f0fc0104400 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.808+0000 7f0fc5200700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0fa80a1bd0 0x7f0fa80a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.809+0000 7f0fc5200700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0fa80a1bd0 0x7f0fa80a4090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0102380 tx=0x7f0fac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:12.810+0000 7f0fbe000700 1 -- 172.21.15.8:0/3031685455 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0fb4097fd0 con 0x7f0fc0104400 2024-03-16T20:56:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.042+0000 7f0fc8600700 1 -- 172.21.15.8:0/3031685455 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0fc019bd40 con 0x7f0fc0104400 2024-03-16T20:56:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.043+0000 7f0fbe000700 1 -- 172.21.15.8:0/3031685455 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fb409b690 con 0x7f0fc0104400 2024-03-16T20:56:14.853 INFO:teuthology.orchestra.run.smithi008.stdout:34359738457 2024-03-16T20:56:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 -- 172.21.15.8:0/3031685455 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0fa80a1bd0 msgr2=0x7f0fa80a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0fa80a1bd0 0x7f0fa80a4090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0102380 tx=0x7f0fac009260 comp rx=0 tx=0).stop 2024-03-16T20:56:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 -- 172.21.15.8:0/3031685455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc0104400 msgr2=0x7f0fc01a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc0104400 0x7f0fc01a0690 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400b070 tx=0x7f0fb4004a50 comp rx=0 tx=0).stop 2024-03-16T20:56:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 -- 172.21.15.8:0/3031685455 shutdown_connections 2024-03-16T20:56:14.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f0fa80a1bd0 0x7f0fa80a4090 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:14.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc01094e0 0x7f0fc019a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:14.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc0104400 0x7f0fc01a0690 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:14.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 --2- 172.21.15.8:0/3031685455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc0104db0 0x7f0fc01a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:14.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 -- 172.21.15.8:0/3031685455 >> 172.21.15.8:0/3031685455 conn(0x7f0fc00ffcb0 msgr2=0x7f0fc0108670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:14.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 -- 172.21.15.8:0/3031685455 shutdown_connections 2024-03-16T20:56:14.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:13.046+0000 7f0fc8600700 1 -- 172.21.15.8:0/3031685455 wait complete. 2024-03-16T20:56:14.866 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:14 smithi170 ceph-mon[35947]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 23 B/s, 1 objects/s recovering 2024-03-16T20:56:14.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:14 smithi186 ceph-mon[36391]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 23 B/s, 1 objects/s recovering 2024-03-16T20:56:16.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:16 smithi170 ceph-mon[35947]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 21 B/s, 0 objects/s recovering 2024-03-16T20:56:16.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:16 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2463415012' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-16T20:56:16.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:16 smithi186 ceph-mon[36391]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 21 B/s, 0 objects/s recovering 2024-03-16T20:56:16.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:16 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2463415012' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-16T20:56:16.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:16 smithi008 ceph-mon[31434]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 21 B/s, 0 objects/s recovering 2024-03-16T20:56:16.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:16 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2463415012' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-16T20:56:17.206 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574928 got 55834574931 for osd.1 2024-03-16T20:56:17.206 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:18.492 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350997 got 347892351002 for osd.11 2024-03-16T20:56:18.492 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:18.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.350+0000 7f3126000700 1 -- 172.21.15.8:0/271905321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3120109510 msgr2=0x7f31201110e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:18.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.350+0000 7f3126000700 1 --2- 172.21.15.8:0/271905321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3120109510 0x7f31201110e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f311800b0a0 tx=0x7f311800b3b0 comp rx=0 tx=0).stop 2024-03-16T20:56:18.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.350+0000 7f3126000700 1 -- 172.21.15.8:0/271905321 shutdown_connections 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.350+0000 7f3126000700 1 --2- 172.21.15.8:0/271905321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3120109510 0x7f31201110e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.350+0000 7f3126000700 1 --2- 172.21.15.8:0/271905321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3120104430 0x7f3120104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.350+0000 7f3126000700 1 --2- 172.21.15.8:0/271905321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3120104de0 0x7f3120108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.350+0000 7f3126000700 1 -- 172.21.15.8:0/271905321 >> 172.21.15.8:0/271905321 conn(0x7f31200ffcc0 msgr2=0x7f31201020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.350+0000 7f3126000700 1 -- 172.21.15.8:0/271905321 shutdown_connections 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.350+0000 7f3126000700 1 -- 172.21.15.8:0/271905321 wait complete. 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.351+0000 7f3126000700 1 Processor -- start 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.351+0000 7f3126000700 1 -- start start 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.352+0000 7f3126000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3120104430 0x7f31201a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.352+0000 7f3126000700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3120104de0 0x7f31201a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.352+0000 7f3126000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3120109510 0x7f312019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.352+0000 7f3126000700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312019aed0 con 0x7f3120104430 2024-03-16T20:56:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.352+0000 7f3126000700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312019b040 con 0x7f3120104de0 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.352+0000 7f3126000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312019b200 con 0x7f3120109510 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.352+0000 7f311f400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3120104430 0x7f31201a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.352+0000 7f311f400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3120104430 0x7f31201a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58286/0 (socket says 172.21.15.8:58286) 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.352+0000 7f311f400700 1 -- 172.21.15.8:0/2463415012 learned_addr learned my addr 172.21.15.8:0/2463415012 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.352+0000 7f311fe00700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3120109510 0x7f312019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.352+0000 7f311ea00700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3120104de0 0x7f31201a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f311f400700 1 -- 172.21.15.8:0/2463415012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3120109510 msgr2=0x7f312019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f311f400700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3120109510 0x7f312019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f311f400700 1 -- 172.21.15.8:0/2463415012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3120104de0 msgr2=0x7f31201a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f311f400700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3120104de0 0x7f31201a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f311f400700 1 -- 172.21.15.8:0/2463415012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3118009d00 con 0x7f3120104430 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f311fe00700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3120109510 0x7f312019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f311f400700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3120104430 0x7f31201a0650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f311000e9a0 tx=0x7f311000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f3117e00700 1 -- 172.21.15.8:0/2463415012 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3110009790 con 0x7f3120104430 2024-03-16T20:56:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f3126000700 1 -- 172.21.15.8:0/2463415012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312019b4e0 con 0x7f3120104430 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f3117e00700 1 -- 172.21.15.8:0/2463415012 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3110010430 con 0x7f3120104430 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f3117e00700 1 -- 172.21.15.8:0/2463415012 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3110018680 con 0x7f3120104430 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.353+0000 7f3126000700 1 -- 172.21.15.8:0/2463415012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31201a7620 con 0x7f3120104430 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.355+0000 7f3126000700 1 -- 172.21.15.8:0/2463415012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3120105910 con 0x7f3120104430 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.357+0000 7f3117e00700 1 -- 172.21.15.8:0/2463415012 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f31100109a0 con 0x7f3120104430 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.358+0000 7f3117e00700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f31040a1b50 0x7f31040a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.358+0000 7f3117e00700 1 -- 172.21.15.8:0/2463415012 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3110014070 con 0x7f3120104430 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.358+0000 7f311ea00700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f31040a1b50 0x7f31040a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.359+0000 7f311ea00700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f31040a1b50 0x7f31040a4010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f312019bee0 tx=0x7f310c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.363+0000 7f3117e00700 1 -- 172.21.15.8:0/2463415012 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3110053280 con 0x7f3120104430 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.596+0000 7f3126000700 1 -- 172.21.15.8:0/2463415012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f3120114400 con 0x7f3120104430 2024-03-16T20:56:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.597+0000 7f3117e00700 1 -- 172.21.15.8:0/2463415012 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f3110096870 con 0x7f3120104430 2024-03-16T20:56:18.535 INFO:teuthology.orchestra.run.smithi008.stdout:313532612640 2024-03-16T20:56:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 -- 172.21.15.8:0/2463415012 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f31040a1b50 msgr2=0x7f31040a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f31040a1b50 0x7f31040a4010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f312019bee0 tx=0x7f310c009260 comp rx=0 tx=0).stop 2024-03-16T20:56:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 -- 172.21.15.8:0/2463415012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3120104430 msgr2=0x7f31201a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3120104430 0x7f31201a0650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f311000e9a0 tx=0x7f311000ecb0 comp rx=0 tx=0).stop 2024-03-16T20:56:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 -- 172.21.15.8:0/2463415012 shutdown_connections 2024-03-16T20:56:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f31040a1b50 0x7f31040a4010 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3120104430 0x7f31201a0650 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3120109510 0x7f312019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 --2- 172.21.15.8:0/2463415012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3120104de0 0x7f31201a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:18.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 -- 172.21.15.8:0/2463415012 >> 172.21.15.8:0/2463415012 conn(0x7f31200ffcc0 msgr2=0x7f3120100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:18.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 -- 172.21.15.8:0/2463415012 shutdown_connections 2024-03-16T20:56:18.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:15.600+0000 7f3126000700 1 -- 172.21.15.8:0/2463415012 wait complete. 2024-03-16T20:56:18.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:18 smithi170 ceph-mon[35947]: pgmap v355: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 19 B/s, 0 objects/s recovering 2024-03-16T20:56:18.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:18 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/4157078476' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-16T20:56:18.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:18 smithi186 ceph-mon[36391]: pgmap v355: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 19 B/s, 0 objects/s recovering 2024-03-16T20:56:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:18 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/4157078476' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-16T20:56:18.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:18 smithi008 ceph-mon[31434]: pgmap v355: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 19 B/s, 0 objects/s recovering 2024-03-16T20:56:18.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:18 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/4157078476' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-16T20:56:19.293 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738452 got 34359738457 for osd.0 2024-03-16T20:56:19.294 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:19.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.554+0000 7f9d76e00700 1 -- 172.21.15.8:0/2695965815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d70103080 msgr2=0x7f9d70103460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:19.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.554+0000 7f9d76e00700 1 --2- 172.21.15.8:0/2695965815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d70103080 0x7f9d70103460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009990 tx=0x7f9d64009ca0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.554+0000 7f9d76e00700 1 -- 172.21.15.8:0/2695965815 shutdown_connections 2024-03-16T20:56:19.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.554+0000 7f9d76e00700 1 --2- 172.21.15.8:0/2695965815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d7010c4b0 0x7f9d7010e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.554+0000 7f9d76e00700 1 --2- 172.21.15.8:0/2695965815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d70103080 0x7f9d70103460 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.554+0000 7f9d76e00700 1 --2- 172.21.15.8:0/2695965815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d701039a0 0x7f9d7010be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.554+0000 7f9d76e00700 1 -- 172.21.15.8:0/2695965815 >> 172.21.15.8:0/2695965815 conn(0x7f9d700fc8b0 msgr2=0x7f9d700fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.555+0000 7f9d76e00700 1 -- 172.21.15.8:0/2695965815 shutdown_connections 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.555+0000 7f9d76e00700 1 -- 172.21.15.8:0/2695965815 wait complete. 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.556+0000 7f9d76e00700 1 Processor -- start 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.556+0000 7f9d76e00700 1 -- start start 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.556+0000 7f9d76e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70103080 0x7f9d70198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.556+0000 7f9d76e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d701039a0 0x7f9d70198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.556+0000 7f9d76e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d7010c4b0 0x7f9d7019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.556+0000 7f9d76e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7019d3f0 con 0x7f9d70103080 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.556+0000 7f9d76e00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7019d560 con 0x7f9d7010c4b0 2024-03-16T20:56:19.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.556+0000 7f9d76e00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7019d720 con 0x7f9d701039a0 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.556+0000 7f9d75a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70103080 0x7f9d70198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d75000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d701039a0 0x7f9d70198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d76400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d7010c4b0 0x7f9d7019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d75000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d701039a0 0x7f9d70198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44598/0 (socket says 172.21.15.8:44598) 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d76400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d7010c4b0 0x7f9d7019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55378/0 (socket says 172.21.15.8:55378) 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d75000700 1 -- 172.21.15.8:0/4157078476 learned_addr learned my addr 172.21.15.8:0/4157078476 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d75000700 1 -- 172.21.15.8:0/4157078476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d7010c4b0 msgr2=0x7f9d7019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d75000700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d7010c4b0 0x7f9d7019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d75000700 1 -- 172.21.15.8:0/4157078476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70103080 msgr2=0x7f9d70198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d75000700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70103080 0x7f9d70198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d75000700 1 -- 172.21.15.8:0/4157078476 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d640095f0 con 0x7f9d701039a0 2024-03-16T20:56:19.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d76400700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d7010c4b0 0x7f9d7019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.557+0000 7f9d75000700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d701039a0 0x7f9d70198a50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00e9c0 tx=0x7f9d5c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.558+0000 7f9d6e000700 1 -- 172.21.15.8:0/4157078476 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c0096e0 con 0x7f9d701039a0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.558+0000 7f9d6e000700 1 -- 172.21.15.8:0/4157078476 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9d5c00c7c0 con 0x7f9d701039a0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.558+0000 7f9d76e00700 1 -- 172.21.15.8:0/4157078476 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7019da00 con 0x7f9d701039a0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.558+0000 7f9d6e000700 1 -- 172.21.15.8:0/4157078476 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c005580 con 0x7f9d701039a0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.558+0000 7f9d76e00700 1 -- 172.21.15.8:0/4157078476 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d701a5260 con 0x7f9d701039a0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.559+0000 7f9d76e00700 1 -- 172.21.15.8:0/4157078476 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d70068ca0 con 0x7f9d701039a0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.561+0000 7f9d6e000700 1 -- 172.21.15.8:0/4157078476 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f9d5c00c930 con 0x7f9d701039a0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.562+0000 7f9d6e000700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d580a1bd0 0x7f9d580a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.562+0000 7f9d6e000700 1 -- 172.21.15.8:0/4157078476 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9d5c014070 con 0x7f9d701039a0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.562+0000 7f9d75a00700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d580a1bd0 0x7f9d580a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.563+0000 7f9d75a00700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d580a1bd0 0x7f9d580a4090 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400b2e0 tx=0x7f9d64005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.564+0000 7f9d6e000700 1 -- 172.21.15.8:0/4157078476 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9d5c096740 con 0x7f9d701039a0 2024-03-16T20:56:19.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.816+0000 7f9d76e00700 1 -- 172.21.15.8:0/4157078476 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d70199870 con 0x7f9d701039a0 2024-03-16T20:56:19.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.817+0000 7f9d6e000700 1 -- 172.21.15.8:0/4157078476 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d5c099e00 con 0x7f9d701039a0 2024-03-16T20:56:19.476 INFO:teuthology.orchestra.run.smithi008.stdout:77309411409 2024-03-16T20:56:19.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 -- 172.21.15.8:0/4157078476 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d580a1bd0 msgr2=0x7f9d580a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:19.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d580a1bd0 0x7f9d580a4090 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400b2e0 tx=0x7f9d64005fd0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 -- 172.21.15.8:0/4157078476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d701039a0 msgr2=0x7f9d70198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:19.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d701039a0 0x7f9d70198a50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00e9c0 tx=0x7f9d5c00ecd0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 -- 172.21.15.8:0/4157078476 shutdown_connections 2024-03-16T20:56:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9d580a1bd0 0x7f9d580a4090 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70103080 0x7f9d70198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d7010c4b0 0x7f9d7019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 --2- 172.21.15.8:0/4157078476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d701039a0 0x7f9d70198a50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 -- 172.21.15.8:0/4157078476 >> 172.21.15.8:0/4157078476 conn(0x7f9d700fc8b0 msgr2=0x7f9d7010e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 -- 172.21.15.8:0/4157078476 shutdown_connections 2024-03-16T20:56:19.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:17.820+0000 7f9d76e00700 1 -- 172.21.15.8:0/4157078476 wait complete. 2024-03-16T20:56:20.184 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612635 got 313532612640 for osd.10 2024-03-16T20:56:20.184 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:20.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:20 smithi008 ceph-mon[31434]: pgmap v356: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:56:20.837 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:20 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/194438336' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-16T20:56:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:20 smithi170 ceph-mon[35947]: pgmap v356: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:56:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:20 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/194438336' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-16T20:56:20.880 INFO:teuthology.orchestra.run.smithi008.stdout:292057776166 2024-03-16T20:56:20.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.597+0000 7ffb3d000700 1 -- 172.21.15.8:0/4100403291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb381080b0 msgr2=0x7ffb38108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:20.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.597+0000 7ffb3d000700 1 --2- 172.21.15.8:0/4100403291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb381080b0 0x7ffb38108490 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb280099c0 tx=0x7ffb28009cd0 comp rx=0 tx=0).stop 2024-03-16T20:56:20.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.597+0000 7ffb3d000700 1 -- 172.21.15.8:0/4100403291 shutdown_connections 2024-03-16T20:56:20.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.597+0000 7ffb3d000700 1 --2- 172.21.15.8:0/4100403291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38102a20 0x7ffb3810eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.597+0000 7ffb3d000700 1 --2- 172.21.15.8:0/4100403291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb381080b0 0x7ffb38108490 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.597+0000 7ffb3d000700 1 --2- 172.21.15.8:0/4100403291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb38102060 0x7ffb381024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.597+0000 7ffb3d000700 1 -- 172.21.15.8:0/4100403291 >> 172.21.15.8:0/4100403291 conn(0x7ffb38079130 msgr2=0x7ffb38079540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.597+0000 7ffb3d000700 1 -- 172.21.15.8:0/4100403291 shutdown_connections 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.597+0000 7ffb3d000700 1 -- 172.21.15.8:0/4100403291 wait complete. 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.598+0000 7ffb3d000700 1 Processor -- start 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.598+0000 7ffb3d000700 1 -- start start 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.598+0000 7ffb3d000700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38102060 0x7ffb381a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.598+0000 7ffb3d000700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb38102a20 0x7ffb381a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.598+0000 7ffb3d000700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb381080b0 0x7ffb3819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.598+0000 7ffb3d000700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3819ae00 con 0x7ffb38102060 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.598+0000 7ffb3d000700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3819af70 con 0x7ffb38102a20 2024-03-16T20:56:20.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.598+0000 7ffb3d000700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3819b130 con 0x7ffb381080b0 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.599+0000 7ffb35400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb38102a20 0x7ffb381a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.599+0000 7ffb35e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38102060 0x7ffb381a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.599+0000 7ffb35400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb38102a20 0x7ffb381a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36166/0 (socket says 172.21.15.8:36166) 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.599+0000 7ffb35400700 1 -- 172.21.15.8:0/1200043129 learned_addr learned my addr 172.21.15.8:0/1200043129 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.599+0000 7ffb36800700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb381080b0 0x7ffb3819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.599+0000 7ffb35e00700 1 -- 172.21.15.8:0/1200043129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb381080b0 msgr2=0x7ffb3819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.599+0000 7ffb35e00700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb381080b0 0x7ffb3819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.599+0000 7ffb35e00700 1 -- 172.21.15.8:0/1200043129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb38102a20 msgr2=0x7ffb381a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.599+0000 7ffb35e00700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb38102a20 0x7ffb381a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.599+0000 7ffb35e00700 1 -- 172.21.15.8:0/1200043129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280095f0 con 0x7ffb38102060 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.599+0000 7ffb35e00700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38102060 0x7ffb381a0580 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffb280098e0 tx=0x7ffb2800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.600+0000 7ffb2ea00700 1 -- 172.21.15.8:0/1200043129 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2801d070 con 0x7ffb38102060 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.600+0000 7ffb2ea00700 1 -- 172.21.15.8:0/1200043129 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ffb2800fb70 con 0x7ffb38102060 2024-03-16T20:56:20.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.600+0000 7ffb3d000700 1 -- 172.21.15.8:0/1200043129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3819b3b0 con 0x7ffb38102060 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.600+0000 7ffb2ea00700 1 -- 172.21.15.8:0/1200043129 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28022d40 con 0x7ffb38102060 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.600+0000 7ffb3d000700 1 -- 172.21.15.8:0/1200043129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb381a7500 con 0x7ffb38102060 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.601+0000 7ffb3d000700 1 -- 172.21.15.8:0/1200043129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb38103720 con 0x7ffb38102060 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.603+0000 7ffb2ea00700 1 -- 172.21.15.8:0/1200043129 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7ffb2800fce0 con 0x7ffb38102060 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.604+0000 7ffb2ea00700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffb1c0a1b50 0x7ffb1c0a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.605+0000 7ffb2ea00700 1 -- 172.21.15.8:0/1200043129 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ffb280ce620 con 0x7ffb38102060 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.605+0000 7ffb35400700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffb1c0a1b50 0x7ffb1c0a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.606+0000 7ffb35400700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffb1c0a1b50 0x7ffb1c0a4010 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffb3819be10 tx=0x7ffb24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.610+0000 7ffb2ea00700 1 -- 172.21.15.8:0/1200043129 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ffb28097710 con 0x7ffb38102060 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.833+0000 7ffb3d000700 1 -- 172.21.15.8:0/1200043129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7ffb38112210 con 0x7ffb38102060 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.834+0000 7ffb2ea00700 1 -- 172.21.15.8:0/1200043129 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb2809add0 con 0x7ffb38102060 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 -- 172.21.15.8:0/1200043129 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffb1c0a1b50 msgr2=0x7ffb1c0a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffb1c0a1b50 0x7ffb1c0a4010 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffb3819be10 tx=0x7ffb24009260 comp rx=0 tx=0).stop 2024-03-16T20:56:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 -- 172.21.15.8:0/1200043129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38102060 msgr2=0x7ffb381a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:20.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38102060 0x7ffb381a0580 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffb280098e0 tx=0x7ffb2800bfd0 comp rx=0 tx=0).stop 2024-03-16T20:56:20.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 -- 172.21.15.8:0/1200043129 shutdown_connections 2024-03-16T20:56:20.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ffb1c0a1b50 0x7ffb1c0a4010 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:20.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb38102060 0x7ffb381a0580 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:20.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb381080b0 0x7ffb3819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:20.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 --2- 172.21.15.8:0/1200043129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb38102a20 0x7ffb381a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:20.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 -- 172.21.15.8:0/1200043129 >> 172.21.15.8:0/1200043129 conn(0x7ffb38079130 msgr2=0x7ffb3810d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:20.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 -- 172.21.15.8:0/1200043129 shutdown_connections 2024-03-16T20:56:20.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.837+0000 7ffb3d000700 1 -- 172.21.15.8:0/1200043129 wait complete. 2024-03-16T20:56:20.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:20 smithi186 ceph-mon[36391]: pgmap v356: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:56:20.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:20 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/194438336' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-16T20:56:21.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.145+0000 7fb181800700 1 -- 172.21.15.8:0/1902763749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb17c102060 msgr2=0x7fb17c1024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:21.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.145+0000 7fb181800700 1 --2- 172.21.15.8:0/1902763749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb17c102060 0x7fb17c1024e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb1680099c0 tx=0x7fb168009cd0 comp rx=0 tx=0).stop 2024-03-16T20:56:21.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.145+0000 7fb181800700 1 -- 172.21.15.8:0/1902763749 shutdown_connections 2024-03-16T20:56:21.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.145+0000 7fb181800700 1 --2- 172.21.15.8:0/1902763749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb17c1080b0 0x7fb17c108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:21.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.145+0000 7fb181800700 1 --2- 172.21.15.8:0/1902763749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb17c102a20 0x7fb17c10eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:21.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.145+0000 7fb181800700 1 --2- 172.21.15.8:0/1902763749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb17c102060 0x7fb17c1024e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:21.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.145+0000 7fb181800700 1 -- 172.21.15.8:0/1902763749 >> 172.21.15.8:0/1902763749 conn(0x7fb17c079130 msgr2=0x7fb17c079540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:21.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.146+0000 7fb181800700 1 -- 172.21.15.8:0/1902763749 shutdown_connections 2024-03-16T20:56:21.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.146+0000 7fb181800700 1 -- 172.21.15.8:0/1902763749 wait complete. 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.147+0000 7fb181800700 1 Processor -- start 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.147+0000 7fb181800700 1 -- start start 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.147+0000 7fb181800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb17c102060 0x7fb17c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.147+0000 7fb181800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb17c102a20 0x7fb17c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.147+0000 7fb181800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb17c1080b0 0x7fb17c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.147+0000 7fb181800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c19d520 con 0x7fb17c102a20 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.147+0000 7fb181800700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c19d690 con 0x7fb17c1080b0 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.147+0000 7fb181800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c19d850 con 0x7fb17c102060 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.148+0000 7fb17aa00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb17c102060 0x7fb17c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.148+0000 7fb17aa00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb17c102060 0x7fb17c198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38938/0 (socket says 172.21.15.8:38938) 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.148+0000 7fb17aa00700 1 -- 172.21.15.8:0/194438336 learned_addr learned my addr 172.21.15.8:0/194438336 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:21.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.148+0000 7fb17a000700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb17c102a20 0x7fb17c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.148+0000 7fb17b400700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb17c1080b0 0x7fb17c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.148+0000 7fb17aa00700 1 -- 172.21.15.8:0/194438336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb17c1080b0 msgr2=0x7fb17c19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.148+0000 7fb17aa00700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb17c1080b0 0x7fb17c19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.148+0000 7fb17aa00700 1 -- 172.21.15.8:0/194438336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb17c102a20 msgr2=0x7fb17c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.148+0000 7fb17aa00700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb17c102a20 0x7fb17c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.148+0000 7fb17aa00700 1 -- 172.21.15.8:0/194438336 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1680095f0 con 0x7fb17c102060 2024-03-16T20:56:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.149+0000 7fb17aa00700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb17c102060 0x7fb17c198640 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00d950 tx=0x7fb16c00dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.149+0000 7fb173400700 1 -- 172.21.15.8:0/194438336 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c009b40 con 0x7fb17c102060 2024-03-16T20:56:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.149+0000 7fb173400700 1 -- 172.21.15.8:0/194438336 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb16c009ca0 con 0x7fb17c102060 2024-03-16T20:56:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.149+0000 7fb173400700 1 -- 172.21.15.8:0/194438336 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00f740 con 0x7fb17c102060 2024-03-16T20:56:21.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.149+0000 7fb181800700 1 -- 172.21.15.8:0/194438336 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c19db30 con 0x7fb17c102060 2024-03-16T20:56:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.149+0000 7fb181800700 1 -- 172.21.15.8:0/194438336 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c1a5390 con 0x7fb17c102060 2024-03-16T20:56:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.150+0000 7fb181800700 1 -- 172.21.15.8:0/194438336 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c10a490 con 0x7fb17c102060 2024-03-16T20:56:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.152+0000 7fb173400700 1 -- 172.21.15.8:0/194438336 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fb16c010460 con 0x7fb17c102060 2024-03-16T20:56:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.153+0000 7fb173400700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb1600a1bd0 0x7fb1600a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.153+0000 7fb173400700 1 -- 172.21.15.8:0/194438336 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb16c0cd850 con 0x7fb17c102060 2024-03-16T20:56:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.153+0000 7fb17a000700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb1600a1bd0 0x7fb1600a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:21.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.154+0000 7fb17a000700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb1600a1bd0 0x7fb1600a4090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb168009fd0 tx=0x7fb1680058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:257698037807 2024-03-16T20:56:21.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.158+0000 7fb173400700 1 -- 172.21.15.8:0/194438336 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb16c0968b0 con 0x7fb17c102060 2024-03-16T20:56:21.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.396+0000 7fb181800700 1 -- 172.21.15.8:0/194438336 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fb17c1999a0 con 0x7fb17c102060 2024-03-16T20:56:21.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.397+0000 7fb173400700 1 -- 172.21.15.8:0/194438336 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb16c099f70 con 0x7fb17c102060 2024-03-16T20:56:21.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.399+0000 7fb181800700 1 -- 172.21.15.8:0/194438336 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb1600a1bd0 msgr2=0x7fb1600a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:21.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.399+0000 7fb181800700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb1600a1bd0 0x7fb1600a4090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb168009fd0 tx=0x7fb1680058e0 comp rx=0 tx=0).stop 2024-03-16T20:56:21.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.399+0000 7fb181800700 1 -- 172.21.15.8:0/194438336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb17c102060 msgr2=0x7fb17c198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:21.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.399+0000 7fb181800700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb17c102060 0x7fb17c198640 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00d950 tx=0x7fb16c00dd10 comp rx=0 tx=0).stop 2024-03-16T20:56:21.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.399+0000 7fb181800700 1 -- 172.21.15.8:0/194438336 shutdown_connections 2024-03-16T20:56:21.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.399+0000 7fb181800700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb1600a1bd0 0x7fb1600a4090 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:21.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.399+0000 7fb181800700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb17c1080b0 0x7fb17c19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:21.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.400+0000 7fb181800700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb17c102060 0x7fb17c198640 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:21.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.400+0000 7fb181800700 1 --2- 172.21.15.8:0/194438336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb17c102a20 0x7fb17c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:21.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.400+0000 7fb181800700 1 -- 172.21.15.8:0/194438336 >> 172.21.15.8:0/194438336 conn(0x7fb17c079130 msgr2=0x7fb17c100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:21.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.400+0000 7fb181800700 1 -- 172.21.15.8:0/194438336 shutdown_connections 2024-03-16T20:56:21.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:20.400+0000 7fb181800700 1 -- 172.21.15.8:0/194438336 wait complete. 2024-03-16T20:56:21.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:21 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1200043129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-16T20:56:21.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:21 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1200043129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-16T20:56:21.930 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:21 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1200043129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-16T20:56:22.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:22 smithi008 ceph-mon[31434]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:22.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:22 smithi170 ceph-mon[35947]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:22.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:22 smithi186 ceph-mon[36391]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:23.709 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037801 got 257698037807 for osd.8 2024-03-16T20:56:23.709 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:24.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:24 smithi170 ceph-mon[35947]: pgmap v358: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:24.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:24 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/589230644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-16T20:56:24.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:24 smithi186 ceph-mon[36391]: pgmap v358: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:24.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:24 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/589230644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-16T20:56:24.919 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:24 smithi008 ceph-mon[31434]: pgmap v358: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:24.919 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:24 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/589230644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-16T20:56:25.062 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411405 got 77309411409 for osd.2 2024-03-16T20:56:25.062 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:25.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.091+0000 7fe005e00700 1 -- 172.21.15.8:0/1131577306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0001080b0 msgr2=0x7fe000108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.091+0000 7fe005e00700 1 --2- 172.21.15.8:0/1131577306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0001080b0 0x7fe000108490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdff000b0d0 tx=0x7fdff000b3e0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.091+0000 7fe005e00700 1 -- 172.21.15.8:0/1131577306 shutdown_connections 2024-03-16T20:56:25.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.091+0000 7fe005e00700 1 --2- 172.21.15.8:0/1131577306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe000102a20 0x7fe00010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.091+0000 7fe005e00700 1 --2- 172.21.15.8:0/1131577306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0001080b0 0x7fe000108490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.091+0000 7fe005e00700 1 --2- 172.21.15.8:0/1131577306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe000102060 0x7fe0001024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.091+0000 7fe005e00700 1 -- 172.21.15.8:0/1131577306 >> 172.21.15.8:0/1131577306 conn(0x7fe000079130 msgr2=0x7fe000079540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.091+0000 7fe005e00700 1 -- 172.21.15.8:0/1131577306 shutdown_connections 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.091+0000 7fe005e00700 1 -- 172.21.15.8:0/1131577306 wait complete. 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.092+0000 7fe005e00700 1 Processor -- start 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.092+0000 7fe005e00700 1 -- start start 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.093+0000 7fe005e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe000102060 0x7fe0001a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.093+0000 7fe005e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe000102a20 0x7fe0001a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.093+0000 7fe005e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0001080b0 0x7fe00019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.093+0000 7fe005e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00019ae80 con 0x7fe000102a20 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.093+0000 7fe005e00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00019aff0 con 0x7fe000102060 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.093+0000 7fe005e00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00019b1b0 con 0x7fe0001080b0 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.093+0000 7fdffea00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe000102060 0x7fe0001a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.093+0000 7fdfff400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0001080b0 0x7fe00019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.093+0000 7fdffea00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe000102060 0x7fe0001a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36230/0 (socket says 172.21.15.8:36230) 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.093+0000 7fdffea00700 1 -- 172.21.15.8:0/3816472586 learned_addr learned my addr 172.21.15.8:0/3816472586 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.093+0000 7fdfefe00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe000102a20 0x7fe0001a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.094+0000 7fdffea00700 1 -- 172.21.15.8:0/3816472586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0001080b0 msgr2=0x7fe00019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.094+0000 7fdffea00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0001080b0 0x7fe00019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.094+0000 7fdffea00700 1 -- 172.21.15.8:0/3816472586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe000102a20 msgr2=0x7fe0001a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.094+0000 7fdffea00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe000102a20 0x7fe0001a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.094+0000 7fdffea00700 1 -- 172.21.15.8:0/3816472586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe8009520 con 0x7fe000102060 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.094+0000 7fdffea00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe000102060 0x7fe0001a0650 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdff0000f80 tx=0x7fdff00094a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.094+0000 7fe004a00700 1 -- 172.21.15.8:0/3816472586 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff000e040 con 0x7fe000102060 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.094+0000 7fe004a00700 1 -- 172.21.15.8:0/3816472586 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fdff001d480 con 0x7fe000102060 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.094+0000 7fe004a00700 1 -- 172.21.15.8:0/3816472586 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff001b6b0 con 0x7fe000102060 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.094+0000 7fe005e00700 1 -- 172.21.15.8:0/3816472586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff0009d00 con 0x7fe000102060 2024-03-16T20:56:25.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.095+0000 7fe005e00700 1 -- 172.21.15.8:0/3816472586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0001a74b0 con 0x7fe000102060 2024-03-16T20:56:25.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.096+0000 7fe005e00700 1 -- 172.21.15.8:0/3816472586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe000103720 con 0x7fe000102060 2024-03-16T20:56:25.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.098+0000 7fe004a00700 1 -- 172.21.15.8:0/3816472586 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fdff001d5f0 con 0x7fe000102060 2024-03-16T20:56:25.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.099+0000 7fe004a00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdfe00a1b50 0x7fdfe00a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.099+0000 7fe004a00700 1 -- 172.21.15.8:0/3816472586 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdff00cec80 con 0x7fe000102060 2024-03-16T20:56:25.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.099+0000 7fdfefe00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdfe00a1b50 0x7fdfe00a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.100+0000 7fdfefe00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdfe00a1b50 0x7fdfe00a4010 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe0001010d0 tx=0x7fdfe8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:25.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.103+0000 7fe004a00700 1 -- 172.21.15.8:0/3816472586 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fdff0097dd0 con 0x7fe000102060 2024-03-16T20:56:25.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.269+0000 7f5c27200700 1 -- 172.21.15.8:0/3312095224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c2006a8e0 msgr2=0x7f5c2006acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.269+0000 7f5c27200700 1 --2- 172.21.15.8:0/3312095224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c2006a8e0 0x7f5c2006acc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009990 tx=0x7f5c10009ca0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.269+0000 7f5c27200700 1 -- 172.21.15.8:0/3312095224 shutdown_connections 2024-03-16T20:56:25.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.269+0000 7f5c27200700 1 --2- 172.21.15.8:0/3312095224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c20107320 0x7f5c2010eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.269+0000 7f5c27200700 1 --2- 172.21.15.8:0/3312095224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c2006a8e0 0x7f5c2006acc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.269+0000 7f5c27200700 1 --2- 172.21.15.8:0/3312095224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c2006b290 0x7f5c20106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.269+0000 7f5c27200700 1 -- 172.21.15.8:0/3312095224 >> 172.21.15.8:0/3312095224 conn(0x7f5c20077da0 msgr2=0x7f5c200781b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.270+0000 7f5c27200700 1 -- 172.21.15.8:0/3312095224 shutdown_connections 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.270+0000 7f5c27200700 1 -- 172.21.15.8:0/3312095224 wait complete. 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.271+0000 7f5c27200700 1 Processor -- start 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.271+0000 7f5c27200700 1 -- start start 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.271+0000 7f5c27200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c2006a8e0 0x7f5c201a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.271+0000 7f5c27200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c2006b290 0x7f5c201a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c27200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c20107320 0x7f5c2019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c27200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2019adf0 con 0x7f5c2006b290 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c27200700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2019af60 con 0x7f5c20107320 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c27200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2019b120 con 0x7f5c2006a8e0 2024-03-16T20:56:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c1fe00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c2006a8e0 0x7f5c201a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c1f400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c2006b290 0x7f5c201a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c1fe00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c2006a8e0 0x7f5c201a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38974/0 (socket says 172.21.15.8:38974) 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c1fe00700 1 -- 172.21.15.8:0/589230644 learned_addr learned my addr 172.21.15.8:0/589230644 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c25200700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c20107320 0x7f5c2019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c1fe00700 1 -- 172.21.15.8:0/589230644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c20107320 msgr2=0x7f5c2019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c1fe00700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c20107320 0x7f5c2019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c1fe00700 1 -- 172.21.15.8:0/589230644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c2006b290 msgr2=0x7f5c201a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c1fe00700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c2006b290 0x7f5c201a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c1fe00700 1 -- 172.21.15.8:0/589230644 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100095f0 con 0x7f5c2006a8e0 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c25200700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c20107320 0x7f5c2019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.272+0000 7f5c1f400700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c2006b290 0x7f5c201a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.273+0000 7f5c1fe00700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c2006a8e0 0x7f5c201a0570 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5c10000c00 tx=0x7f5c10005530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.273+0000 7f5c1cc00700 1 -- 172.21.15.8:0/589230644 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1001d070 con 0x7f5c2006a8e0 2024-03-16T20:56:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.273+0000 7f5c1cc00700 1 -- 172.21.15.8:0/589230644 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f5c1000fd20 con 0x7f5c2006a8e0 2024-03-16T20:56:25.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.273+0000 7f5c1cc00700 1 -- 172.21.15.8:0/589230644 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c100173f0 con 0x7f5c2006a8e0 2024-03-16T20:56:25.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.273+0000 7f5c27200700 1 -- 172.21.15.8:0/589230644 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2019b3a0 con 0x7f5c2006a8e0 2024-03-16T20:56:25.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.273+0000 7f5c27200700 1 -- 172.21.15.8:0/589230644 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c201a74f0 con 0x7f5c2006a8e0 2024-03-16T20:56:25.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.275+0000 7f5c27200700 1 -- 172.21.15.8:0/589230644 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c20103720 con 0x7f5c2006a8e0 2024-03-16T20:56:25.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.276+0000 7f5c1cc00700 1 -- 172.21.15.8:0/589230644 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f5c1000f820 con 0x7f5c2006a8e0 2024-03-16T20:56:25.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.278+0000 7f5c1cc00700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5c040a1bd0 0x7f5c040a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.278+0000 7f5c1cc00700 1 -- 172.21.15.8:0/589230644 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5c100ce950 con 0x7f5c2006a8e0 2024-03-16T20:56:25.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.278+0000 7f5c1f400700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5c040a1bd0 0x7f5c040a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.279+0000 7f5c1f400700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5c040a1bd0 0x7f5c040a4090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5c2019be00 tx=0x7f5c0c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:25.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.284+0000 7f5c1cc00700 1 -- 172.21.15.8:0/589230644 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5c1005d280 con 0x7f5c2006a8e0 2024-03-16T20:56:25.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.532+0000 7f5c27200700 1 -- 172.21.15.8:0/589230644 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5c20112200 con 0x7f5c2006a8e0 2024-03-16T20:56:25.240 INFO:teuthology.orchestra.run.smithi008.stdout:201863462969 2024-03-16T20:56:25.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.533+0000 7f5c1cc00700 1 -- 172.21.15.8:0/589230644 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c10097a40 con 0x7f5c2006a8e0 2024-03-16T20:56:25.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 -- 172.21.15.8:0/589230644 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5c040a1bd0 msgr2=0x7f5c040a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5c040a1bd0 0x7f5c040a4090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5c2019be00 tx=0x7f5c0c00b410 comp rx=0 tx=0).stop 2024-03-16T20:56:25.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 -- 172.21.15.8:0/589230644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c2006a8e0 msgr2=0x7f5c201a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c2006a8e0 0x7f5c201a0570 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5c10000c00 tx=0x7f5c10005530 comp rx=0 tx=0).stop 2024-03-16T20:56:25.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 -- 172.21.15.8:0/589230644 shutdown_connections 2024-03-16T20:56:25.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f5c040a1bd0 0x7f5c040a4090 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c20107320 0x7f5c2019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c2006a8e0 0x7f5c201a0570 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 --2- 172.21.15.8:0/589230644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c2006b290 0x7f5c201a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 -- 172.21.15.8:0/589230644 >> 172.21.15.8:0/589230644 conn(0x7f5c20077da0 msgr2=0x7f5c201023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:25.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 -- 172.21.15.8:0/589230644 shutdown_connections 2024-03-16T20:56:25.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.536+0000 7f5c27200700 1 -- 172.21.15.8:0/589230644 wait complete. 2024-03-16T20:56:25.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.344+0000 7fe005e00700 1 -- 172.21.15.8:0/3816472586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe000112210 con 0x7fe000102060 2024-03-16T20:56:25.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.345+0000 7fe004a00700 1 -- 172.21.15.8:0/3816472586 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdff009b490 con 0x7fe000102060 2024-03-16T20:56:25.349 INFO:teuthology.orchestra.run.smithi008.stdout:146028888133 2024-03-16T20:56:25.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.348+0000 7fe005e00700 1 -- 172.21.15.8:0/3816472586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdfe00a1b50 msgr2=0x7fdfe00a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.348+0000 7fe005e00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdfe00a1b50 0x7fdfe00a4010 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe0001010d0 tx=0x7fdfe8009260 comp rx=0 tx=0).stop 2024-03-16T20:56:25.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.348+0000 7fe005e00700 1 -- 172.21.15.8:0/3816472586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe000102060 msgr2=0x7fe0001a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.348+0000 7fe005e00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe000102060 0x7fe0001a0650 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdff0000f80 tx=0x7fdff00094a0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.348+0000 7fe005e00700 1 -- 172.21.15.8:0/3816472586 shutdown_connections 2024-03-16T20:56:25.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.348+0000 7fe005e00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdfe00a1b50 0x7fdfe00a4010 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.348+0000 7fe005e00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0001080b0 0x7fe00019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.348+0000 7fe005e00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe000102060 0x7fe0001a0650 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.348+0000 7fe005e00700 1 --2- 172.21.15.8:0/3816472586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe000102a20 0x7fe0001a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.348+0000 7fe005e00700 1 -- 172.21.15.8:0/3816472586 >> 172.21.15.8:0/3816472586 conn(0x7fe000079130 msgr2=0x7fe00010d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:25.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.349+0000 7fe005e00700 1 -- 172.21.15.8:0/3816472586 shutdown_connections 2024-03-16T20:56:25.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:25.349+0000 7fe005e00700 1 -- 172.21.15.8:0/3816472586 wait complete. 2024-03-16T20:56:25.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:25 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2406072045' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-16T20:56:25.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:25 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3816472586' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-16T20:56:25.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:25 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2406072045' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-16T20:56:25.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:25 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3816472586' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-16T20:56:25.893 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:25 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2406072045' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-16T20:56:25.893 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:25 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3816472586' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-16T20:56:25.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.390+0000 7f876f800700 1 -- 172.21.15.8:0/2366611890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8768108010 msgr2=0x7f87681083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.390+0000 7f876f800700 1 --2- 172.21.15.8:0/2366611890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8768108010 0x7f87681083f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f875c0099c0 tx=0x7f875c009cd0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.391+0000 7f876f800700 1 -- 172.21.15.8:0/2366611890 shutdown_connections 2024-03-16T20:56:25.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.391+0000 7f876f800700 1 --2- 172.21.15.8:0/2366611890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87681029f0 0x7f876810ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.391+0000 7f876f800700 1 --2- 172.21.15.8:0/2366611890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8768108010 0x7f87681083f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.391+0000 7f876f800700 1 --2- 172.21.15.8:0/2366611890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8768102030 0x7f87681024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.391+0000 7f876f800700 1 -- 172.21.15.8:0/2366611890 >> 172.21.15.8:0/2366611890 conn(0x7f8768079110 msgr2=0x7f8768079520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.391+0000 7f876f800700 1 -- 172.21.15.8:0/2366611890 shutdown_connections 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.391+0000 7f876f800700 1 -- 172.21.15.8:0/2366611890 wait complete. 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.392+0000 7f876f800700 1 Processor -- start 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876f800700 1 -- start start 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876f800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768102030 0x7f87681a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876f800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87681029f0 0x7f87681a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876f800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8768108010 0x7f876819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876f800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876819ac60 con 0x7f8768102030 2024-03-16T20:56:25.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876f800700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876819ada0 con 0x7f8768108010 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876f800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876819af60 con 0x7f87681029f0 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876ce00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768102030 0x7f87681a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876d800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8768108010 0x7f876819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f8767e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87681029f0 0x7f87681a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876d800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8768108010 0x7f876819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36224/0 (socket says 172.21.15.8:36224) 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f8767e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87681029f0 0x7f87681a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39000/0 (socket says 172.21.15.8:39000) 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876ce00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768102030 0x7f87681a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53370/0 (socket says 172.21.15.8:53370) 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.393+0000 7f876d800700 1 -- 172.21.15.8:0/2406072045 learned_addr learned my addr 172.21.15.8:0/2406072045 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.394+0000 7f8767e00700 1 -- 172.21.15.8:0/2406072045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8768108010 msgr2=0x7f876819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.394+0000 7f8767e00700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8768108010 0x7f876819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.394+0000 7f8767e00700 1 -- 172.21.15.8:0/2406072045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768102030 msgr2=0x7f87681a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.394+0000 7f8767e00700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768102030 0x7f87681a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.394+0000 7f8767e00700 1 -- 172.21.15.8:0/2406072045 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c0095f0 con 0x7f87681029f0 2024-03-16T20:56:25.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.394+0000 7f8767e00700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87681029f0 0x7f87681a0980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f875400e9f0 tx=0x7f875400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.394+0000 7f8765600700 1 -- 172.21.15.8:0/2406072045 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875400c9c0 con 0x7f87681029f0 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.394+0000 7f8765600700 1 -- 172.21.15.8:0/2406072045 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f875400cb20 con 0x7f87681029f0 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.394+0000 7f876f800700 1 -- 172.21.15.8:0/2406072045 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876819b240 con 0x7f87681029f0 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.394+0000 7f8765600700 1 -- 172.21.15.8:0/2406072045 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8754018680 con 0x7f87681029f0 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.394+0000 7f876f800700 1 -- 172.21.15.8:0/2406072045 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87681a74e0 con 0x7f87681029f0 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.396+0000 7f876f800700 1 -- 172.21.15.8:0/2406072045 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8768068ca0 con 0x7f87681029f0 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.397+0000 7f8765600700 1 -- 172.21.15.8:0/2406072045 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f875400cc90 con 0x7f87681029f0 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.399+0000 7f8765600700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87500a1bd0 0x7f87500a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.399+0000 7f8765600700 1 -- 172.21.15.8:0/2406072045 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8754014070 con 0x7f87681029f0 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.399+0000 7f876ce00700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87500a1bd0 0x7f87500a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.400+0000 7f876ce00700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87500a1bd0 0x7f87500a4090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f875c000c00 tx=0x7f875c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:25.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.402+0000 7f8765600700 1 -- 172.21.15.8:0/2406072045 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8754053280 con 0x7f87681029f0 2024-03-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi008.stdout:223338299444 2024-03-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.665+0000 7f876f800700 1 -- 172.21.15.8:0/2406072045 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f876819bb30 con 0x7f87681029f0 2024-03-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.666+0000 7f8765600700 1 -- 172.21.15.8:0/2406072045 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8754096690 con 0x7f87681029f0 2024-03-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.668+0000 7f876f800700 1 -- 172.21.15.8:0/2406072045 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87500a1bd0 msgr2=0x7f87500a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.668+0000 7f876f800700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87500a1bd0 0x7f87500a4090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f875c000c00 tx=0x7f875c005fb0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.668+0000 7f876f800700 1 -- 172.21.15.8:0/2406072045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87681029f0 msgr2=0x7f87681a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.668+0000 7f876f800700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87681029f0 0x7f87681a0980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f875400e9f0 tx=0x7f875400ed00 comp rx=0 tx=0).stop 2024-03-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.668+0000 7f876f800700 1 -- 172.21.15.8:0/2406072045 shutdown_connections 2024-03-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.668+0000 7f876f800700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f87500a1bd0 0x7f87500a4090 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.668+0000 7f876f800700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768102030 0x7f87681a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.668+0000 7f876f800700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8768108010 0x7f876819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.668+0000 7f876f800700 1 --2- 172.21.15.8:0/2406072045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87681029f0 0x7f87681a0980 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.668+0000 7f876f800700 1 -- 172.21.15.8:0/2406072045 >> 172.21.15.8:0/2406072045 conn(0x7f8768079110 msgr2=0x7f87681009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.669+0000 7f876f800700 1 -- 172.21.15.8:0/2406072045 shutdown_connections 2024-03-16T20:56:25.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:24.669+0000 7f876f800700 1 -- 172.21.15.8:0/2406072045 wait complete. 2024-03-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.461+0000 7fb6be200700 1 -- 172.21.15.8:0/1417936088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6b81039a0 msgr2=0x7fb6b810be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.461+0000 7fb6be200700 1 --2- 172.21.15.8:0/1417936088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6b81039a0 0x7fb6b810be90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009990 tx=0x7fb6a4009ca0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.462+0000 7fb6be200700 1 -- 172.21.15.8:0/1417936088 shutdown_connections 2024-03-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.462+0000 7fb6be200700 1 --2- 172.21.15.8:0/1417936088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b810c4b0 0x7fb6b810e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.462+0000 7fb6be200700 1 --2- 172.21.15.8:0/1417936088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b8103080 0x7fb6b8103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.462+0000 7fb6be200700 1 --2- 172.21.15.8:0/1417936088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6b81039a0 0x7fb6b810be90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.462+0000 7fb6be200700 1 -- 172.21.15.8:0/1417936088 >> 172.21.15.8:0/1417936088 conn(0x7fb6b80fc8b0 msgr2=0x7fb6b80fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.462+0000 7fb6be200700 1 -- 172.21.15.8:0/1417936088 shutdown_connections 2024-03-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.462+0000 7fb6be200700 1 -- 172.21.15.8:0/1417936088 wait complete. 2024-03-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.463+0000 7fb6be200700 1 Processor -- start 2024-03-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.463+0000 7fb6be200700 1 -- start start 2024-03-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6be200700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b8103080 0x7fb6b8100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6be200700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b81039a0 0x7fb6b8101220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6be200700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6b810c4b0 0x7fb6b8101760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6be200700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b81a6950 con 0x7fb6b81039a0 2024-03-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6be200700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b81a6ac0 con 0x7fb6b8103080 2024-03-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6be200700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b81a6c80 con 0x7fb6b810c4b0 2024-03-16T20:56:26.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6bce00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b8103080 0x7fb6b8100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6bd800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6b810c4b0 0x7fb6b8101760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6bce00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b8103080 0x7fb6b8100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36246/0 (socket says 172.21.15.8:36246) 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6bce00700 1 -- 172.21.15.8:0/2295985935 learned_addr learned my addr 172.21.15.8:0/2295985935 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6bd800700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6b810c4b0 0x7fb6b8101760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39026/0 (socket says 172.21.15.8:39026) 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.464+0000 7fb6b7e00700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b81039a0 0x7fb6b8101220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.465+0000 7fb6bce00700 1 -- 172.21.15.8:0/2295985935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6b810c4b0 msgr2=0x7fb6b8101760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.465+0000 7fb6bce00700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6b810c4b0 0x7fb6b8101760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.465+0000 7fb6bce00700 1 -- 172.21.15.8:0/2295985935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b81039a0 msgr2=0x7fb6b8101220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.465+0000 7fb6bce00700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b81039a0 0x7fb6b8101220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.465+0000 7fb6bce00700 1 -- 172.21.15.8:0/2295985935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40095f0 con 0x7fb6b8103080 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.465+0000 7fb6bce00700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b8103080 0x7fb6b8100ce0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00e9a0 tx=0x7fb6ac00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.465+0000 7fb6b5600700 1 -- 172.21.15.8:0/2295985935 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac009790 con 0x7fb6b8103080 2024-03-16T20:56:26.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.465+0000 7fb6b5600700 1 -- 172.21.15.8:0/2295985935 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb6ac00cbd0 con 0x7fb6b8103080 2024-03-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.465+0000 7fb6be200700 1 -- 172.21.15.8:0/2295985935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b81a6f60 con 0x7fb6b8103080 2024-03-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.465+0000 7fb6b5600700 1 -- 172.21.15.8:0/2295985935 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0187e0 con 0x7fb6b8103080 2024-03-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.465+0000 7fb6be200700 1 -- 172.21.15.8:0/2295985935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b81a73d0 con 0x7fb6b8103080 2024-03-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.466+0000 7fb6be200700 1 -- 172.21.15.8:0/2295985935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b81075e0 con 0x7fb6b8103080 2024-03-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.469+0000 7fb6b5600700 1 -- 172.21.15.8:0/2295985935 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7fb6ac0109c0 con 0x7fb6b8103080 2024-03-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.470+0000 7fb6b5600700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6a00a1b50 0x7fb6a00a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.470+0000 7fb6b5600700 1 -- 172.21.15.8:0/2295985935 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb6ac014070 con 0x7fb6b8103080 2024-03-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.470+0000 7fb6b7e00700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6a00a1b50 0x7fb6a00a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.471+0000 7fb6b7e00700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6a00a1b50 0x7fb6a00a4010 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb6b81004b0 tx=0x7fb6a4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:26.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.476+0000 7fb6b5600700 1 -- 172.21.15.8:0/2295985935 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb6ac096ac0 con 0x7fb6b8103080 2024-03-16T20:56:26.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.707+0000 7fb6be200700 1 -- 172.21.15.8:0/2295985935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6b8068ca0 con 0x7fb6b8103080 2024-03-16T20:56:26.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.708+0000 7fb6b5600700 1 -- 172.21.15.8:0/2295985935 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6ac09a180 con 0x7fb6b8103080 2024-03-16T20:56:26.713 INFO:teuthology.orchestra.run.smithi008.stdout:111669149770 2024-03-16T20:56:26.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 -- 172.21.15.8:0/2295985935 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6a00a1b50 msgr2=0x7fb6a00a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:26.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6a00a1b50 0x7fb6a00a4010 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb6b81004b0 tx=0x7fb6a4005fd0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 -- 172.21.15.8:0/2295985935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b8103080 msgr2=0x7fb6b8100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:26.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b8103080 0x7fb6b8100ce0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00e9a0 tx=0x7fb6ac00ecb0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 -- 172.21.15.8:0/2295985935 shutdown_connections 2024-03-16T20:56:26.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6a00a1b50 0x7fb6a00a4010 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6b810c4b0 0x7fb6b8101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b8103080 0x7fb6b8100ce0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 --2- 172.21.15.8:0/2295985935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b81039a0 0x7fb6b8101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 -- 172.21.15.8:0/2295985935 >> 172.21.15.8:0/2295985935 conn(0x7fb6b80fc8b0 msgr2=0x7fb6b80fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 -- 172.21.15.8:0/2295985935 shutdown_connections 2024-03-16T20:56:26.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:26.711+0000 7fb6be200700 1 -- 172.21.15.8:0/2295985935 wait complete. 2024-03-16T20:56:26.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:26 smithi170 ceph-mon[35947]: pgmap v359: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:56:26.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:26 smithi186 ceph-mon[36391]: pgmap v359: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:56:26.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:26 smithi008 ceph-mon[31434]: pgmap v359: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:56:27.266 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776159 got 292057776166 for osd.9 2024-03-16T20:56:27.267 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:27.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:27 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2295985935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-16T20:56:27.890 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:27 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2295985935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-16T20:56:27.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:27 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2295985935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-16T20:56:27.963 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299437 got 223338299444 for osd.7 2024-03-16T20:56:27.963 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:28.058 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462964 got 201863462969 for osd.6 2024-03-16T20:56:28.059 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:28.626 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149763 got 111669149770 for osd.3 2024-03-16T20:56:28.626 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:28.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:28 smithi170 ceph-mon[35947]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:28.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:28 smithi186 ceph-mon[36391]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:28 smithi008 ceph-mon[31434]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:29.214 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888127 got 146028888133 for osd.4 2024-03-16T20:56:29.214 DEBUG:teuthology.parallel:result is None 2024-03-16T20:56:29.214 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-16T20:56:29.214 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph pg dump --format=json 2024-03-16T20:56:29.958 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:30.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:30 smithi008 ceph-mon[31434]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:56:30.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:30 smithi186 ceph-mon[36391]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:56:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:30 smithi170 ceph-mon[35947]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:56:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.341+0000 7f54b9600700 1 -- 172.21.15.8:0/1946515399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b41030e0 msgr2=0x7f54b41034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.341+0000 7f54b9600700 1 --2- 172.21.15.8:0/1946515399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b41030e0 0x7f54b41034c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f54a40098f0 tx=0x7f54a4009c00 comp rx=0 tx=0).stop 2024-03-16T20:56:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.341+0000 7f54b9600700 1 -- 172.21.15.8:0/1946515399 shutdown_connections 2024-03-16T20:56:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.341+0000 7f54b9600700 1 --2- 172.21.15.8:0/1946515399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b410c4c0 0x7f54b410e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.341+0000 7f54b9600700 1 --2- 172.21.15.8:0/1946515399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b41030e0 0x7f54b41034c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.341+0000 7f54b9600700 1 --2- 172.21.15.8:0/1946515399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b4103a00 0x7f54b410bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.341+0000 7f54b9600700 1 -- 172.21.15.8:0/1946515399 >> 172.21.15.8:0/1946515399 conn(0x7f54b40fc8b0 msgr2=0x7f54b40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.341+0000 7f54b9600700 1 -- 172.21.15.8:0/1946515399 shutdown_connections 2024-03-16T20:56:32.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.342+0000 7f54b9600700 1 -- 172.21.15.8:0/1946515399 wait complete. 2024-03-16T20:56:32.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.343+0000 7f54b9600700 1 Processor -- start 2024-03-16T20:56:32.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.343+0000 7f54b9600700 1 -- start start 2024-03-16T20:56:32.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.343+0000 7f54b9600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41030e0 0x7f54b41a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:32.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.343+0000 7f54b9600700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b4103a00 0x7f54b41a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:32.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.343+0000 7f54b9600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b410c4c0 0x7f54b419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:32.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.343+0000 7f54b9600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b419abf0 con 0x7f54b410c4c0 2024-03-16T20:56:32.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.343+0000 7f54b9600700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b419ad30 con 0x7f54b4103a00 2024-03-16T20:56:32.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.343+0000 7f54b9600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b419aef0 con 0x7f54b41030e0 2024-03-16T20:56:32.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.343+0000 7f54b3e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41030e0 0x7f54b41a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:32.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.344+0000 7f54b3400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b4103a00 0x7f54b41a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:32.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.344+0000 7f54b3e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41030e0 0x7f54b41a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:43022/0 (socket says 172.21.15.8:43022) 2024-03-16T20:56:32.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.344+0000 7f54b3e00700 1 -- 172.21.15.8:0/1423643014 learned_addr learned my addr 172.21.15.8:0/1423643014 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:32.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.344+0000 7f54b8c00700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b410c4c0 0x7f54b419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:32.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.344+0000 7f54b3e00700 1 -- 172.21.15.8:0/1423643014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b4103a00 msgr2=0x7f54b41a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:32.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.344+0000 7f54b3e00700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b4103a00 0x7f54b41a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:32.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.344+0000 7f54b3e00700 1 -- 172.21.15.8:0/1423643014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b410c4c0 msgr2=0x7f54b419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:32.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.344+0000 7f54b3e00700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b410c4c0 0x7f54b419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:32.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.344+0000 7f54b3e00700 1 -- 172.21.15.8:0/1423643014 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a4009520 con 0x7f54b41030e0 2024-03-16T20:56:32.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.344+0000 7f54b3e00700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41030e0 0x7f54b41a03d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f54a4005950 tx=0x7f54a4010fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:32.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.345+0000 7f54b0c00700 1 -- 172.21.15.8:0/1423643014 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a401c070 con 0x7f54b41030e0 2024-03-16T20:56:32.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.345+0000 7f54b0c00700 1 -- 172.21.15.8:0/1423643014 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f54a400b560 con 0x7f54b41030e0 2024-03-16T20:56:32.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.345+0000 7f54b9600700 1 -- 172.21.15.8:0/1423643014 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b419b170 con 0x7f54b41030e0 2024-03-16T20:56:32.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.345+0000 7f54b9600700 1 -- 172.21.15.8:0/1423643014 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b41a7470 con 0x7f54b41030e0 2024-03-16T20:56:32.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.345+0000 7f54b0c00700 1 -- 172.21.15.8:0/1423643014 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40039c0 con 0x7f54b41030e0 2024-03-16T20:56:32.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.346+0000 7f54b9600700 1 -- 172.21.15.8:0/1423643014 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b4068ca0 con 0x7f54b41030e0 2024-03-16T20:56:32.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.348+0000 7f54b0c00700 1 -- 172.21.15.8:0/1423643014 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136329+0+0 (secure 0 0 0) 0x7f54a4020030 con 0x7f54b41030e0 2024-03-16T20:56:32.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.350+0000 7f54b0c00700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54980a1bd0 0x7f54980a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:32.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.350+0000 7f54b0c00700 1 -- 172.21.15.8:0/1423643014 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f54a40ce420 con 0x7f54b41030e0 2024-03-16T20:56:32.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.350+0000 7f54b3400700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54980a1bd0 0x7f54980a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:32.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.351+0000 7f54b3400700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54980a1bd0 0x7f54980a4090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f54b410dd40 tx=0x7f54a0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:32.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.354+0000 7f54b0c00700 1 -- 172.21.15.8:0/1423643014 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f54a4097510 con 0x7f54b41030e0 2024-03-16T20:56:32.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.579+0000 7f54b9600700 1 -- 172.21.15.8:0/1423643014 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54b41120f0 con 0x7f54980a1bd0 2024-03-16T20:56:32.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.591+0000 7f54b0c00700 1 -- 172.21.15.8:0/1423643014 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258906 (secure 0 0 0) 0x7f54b41120f0 con 0x7f54980a1bd0 2024-03-16T20:56:32.599 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:56:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 -- 172.21.15.8:0/1423643014 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54980a1bd0 msgr2=0x7f54980a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54980a1bd0 0x7f54980a4090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f54b410dd40 tx=0x7f54a0009310 comp rx=0 tx=0).stop 2024-03-16T20:56:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 -- 172.21.15.8:0/1423643014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41030e0 msgr2=0x7f54b41a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41030e0 0x7f54b41a03d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f54a4005950 tx=0x7f54a4010fe0 comp rx=0 tx=0).stop 2024-03-16T20:56:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 -- 172.21.15.8:0/1423643014 shutdown_connections 2024-03-16T20:56:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54980a1bd0 0x7f54980a4090 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54b410c4c0 0x7f54b419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41030e0 0x7f54b41a03d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 --2- 172.21.15.8:0/1423643014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b4103a00 0x7f54b41a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 -- 172.21.15.8:0/1423643014 >> 172.21.15.8:0/1423643014 conn(0x7f54b40fc8b0 msgr2=0x7f54b410e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 -- 172.21.15.8:0/1423643014 shutdown_connections 2024-03-16T20:56:32.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:32.597+0000 7f54b9600700 1 -- 172.21.15.8:0/1423643014 wait complete. 2024-03-16T20:56:32.602 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-16T20:56:32.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:32 smithi186 ceph-mon[36391]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:32.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:32 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:32.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:32 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:32.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:32 smithi008 ceph-mon[31434]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:32.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:32 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:32.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:32 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:33.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:32 smithi170 ceph-mon[35947]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:33.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:32 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:33.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:32 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:33.630 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2024-03-16T20:56:31.115754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658520,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":638,"num_read_kb":441,"num_write":345,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1180965,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365060,"kb_used_data":11664,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576764,"statfs":{"total":1151940427776,"available":1151566606336,"internally_reserved":0,"allocated":11943936,"data_stored":7479552,"data_compressed":113112,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005459"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512846+0000","last_change":"2024-03-16T20:55:05.301473+0000","last_active":"2024-03-16T20:56:04.512846+0000","last_peered":"2024-03-16T20:56:04.512846+0000","last_clean":"2024-03-16T20:56:04.512846+0000","last_became_active":"2024-03-16T20:55:05.301166+0000","last_became_peered":"2024-03-16T20:55:05.301166+0000","last_unstale":"2024-03-16T20:56:04.512846+0000","last_undegraded":"2024-03-16T20:56:04.512846+0000","last_fullsized":"2024-03-16T20:56:04.512846+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:06:51.838382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.527363+0000","last_change":"2024-03-16T20:55:05.295895+0000","last_active":"2024-03-16T20:56:04.527363+0000","last_peered":"2024-03-16T20:56:04.527363+0000","last_clean":"2024-03-16T20:56:04.527363+0000","last_became_active":"2024-03-16T20:55:05.295365+0000","last_became_peered":"2024-03-16T20:55:05.295365+0000","last_unstale":"2024-03-16T20:56:04.527363+0000","last_undegraded":"2024-03-16T20:56:04.527363+0000","last_fullsized":"2024-03-16T20:56:04.527363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:28:20.342348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.526932+0000","last_change":"2024-03-16T20:55:05.299049+0000","last_active":"2024-03-16T20:56:04.526932+0000","last_peered":"2024-03-16T20:56:04.526932+0000","last_clean":"2024-03-16T20:56:04.526932+0000","last_became_active":"2024-03-16T20:55:05.292758+0000","last_became_peered":"2024-03-16T20:55:05.292758+0000","last_unstale":"2024-03-16T20:56:04.526932+0000","last_undegraded":"2024-03-16T20:56:04.526932+0000","last_fullsized":"2024-03-16T20:56:04.526932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:20:36.276639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903936+0000","last_change":"2024-03-16T20:55:05.274453+0000","last_active":"2024-03-16T20:56:04.903936+0000","last_peered":"2024-03-16T20:56:04.903936+0000","last_clean":"2024-03-16T20:56:04.903936+0000","last_became_active":"2024-03-16T20:55:05.273648+0000","last_became_peered":"2024-03-16T20:55:05.273648+0000","last_unstale":"2024-03-16T20:56:04.903936+0000","last_undegraded":"2024-03-16T20:56:04.903936+0000","last_fullsized":"2024-03-16T20:56:04.903936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:08:37.297906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514692+0000","last_change":"2024-03-16T20:55:05.291272+0000","last_active":"2024-03-16T20:56:04.514692+0000","last_peered":"2024-03-16T20:56:04.514692+0000","last_clean":"2024-03-16T20:56:04.514692+0000","last_became_active":"2024-03-16T20:55:05.290788+0000","last_became_peered":"2024-03-16T20:55:05.290788+0000","last_unstale":"2024-03-16T20:56:04.514692+0000","last_undegraded":"2024-03-16T20:56:04.514692+0000","last_fullsized":"2024-03-16T20:56:04.514692+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:36:42.842797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513425+0000","last_change":"2024-03-16T20:55:05.289977+0000","last_active":"2024-03-16T20:56:04.513425+0000","last_peered":"2024-03-16T20:56:04.513425+0000","last_clean":"2024-03-16T20:56:04.513425+0000","last_became_active":"2024-03-16T20:55:05.289520+0000","last_became_peered":"2024-03-16T20:55:05.289520+0000","last_unstale":"2024-03-16T20:56:04.513425+0000","last_undegraded":"2024-03-16T20:56:04.513425+0000","last_fullsized":"2024-03-16T20:56:04.513425+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:25:49.270854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929996+0000","last_change":"2024-03-16T20:55:05.286244+0000","last_active":"2024-03-16T20:56:04.929996+0000","last_peered":"2024-03-16T20:56:04.929996+0000","last_clean":"2024-03-16T20:56:04.929996+0000","last_became_active":"2024-03-16T20:55:05.285871+0000","last_became_peered":"2024-03-16T20:55:05.285871+0000","last_unstale":"2024-03-16T20:56:04.929996+0000","last_undegraded":"2024-03-16T20:56:04.929996+0000","last_fullsized":"2024-03-16T20:56:04.929996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:24:47.334046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.509069+0000","last_change":"2024-03-16T20:55:05.293902+0000","last_active":"2024-03-16T20:56:04.509069+0000","last_peered":"2024-03-16T20:56:04.509069+0000","last_clean":"2024-03-16T20:56:04.509069+0000","last_became_active":"2024-03-16T20:55:05.284424+0000","last_became_peered":"2024-03-16T20:55:05.284424+0000","last_unstale":"2024-03-16T20:56:04.509069+0000","last_undegraded":"2024-03-16T20:56:04.509069+0000","last_fullsized":"2024-03-16T20:56:04.509069+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:09:15.024337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929755+0000","last_change":"2024-03-16T20:55:05.271434+0000","last_active":"2024-03-16T20:56:04.929755+0000","last_peered":"2024-03-16T20:56:04.929755+0000","last_clean":"2024-03-16T20:56:04.929755+0000","last_became_active":"2024-03-16T20:55:05.271014+0000","last_became_peered":"2024-03-16T20:55:05.271014+0000","last_unstale":"2024-03-16T20:56:04.929755+0000","last_undegraded":"2024-03-16T20:56:04.929755+0000","last_fullsized":"2024-03-16T20:56:04.929755+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:09:47.133987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513693+0000","last_change":"2024-03-16T20:55:05.275108+0000","last_active":"2024-03-16T20:56:04.513693+0000","last_peered":"2024-03-16T20:56:04.513693+0000","last_clean":"2024-03-16T20:56:04.513693+0000","last_became_active":"2024-03-16T20:55:05.274659+0000","last_became_peered":"2024-03-16T20:55:05.274659+0000","last_unstale":"2024-03-16T20:56:04.513693+0000","last_undegraded":"2024-03-16T20:56:04.513693+0000","last_fullsized":"2024-03-16T20:56:04.513693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:10:16.801309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930418+0000","last_change":"2024-03-16T20:55:05.273322+0000","last_active":"2024-03-16T20:56:04.930418+0000","last_peered":"2024-03-16T20:56:04.930418+0000","last_clean":"2024-03-16T20:56:04.930418+0000","last_became_active":"2024-03-16T20:55:05.272999+0000","last_became_peered":"2024-03-16T20:55:05.272999+0000","last_unstale":"2024-03-16T20:56:04.930418+0000","last_undegraded":"2024-03-16T20:56:04.930418+0000","last_fullsized":"2024-03-16T20:56:04.930418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:49:43.426765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903797+0000","last_change":"2024-03-16T20:55:05.274729+0000","last_active":"2024-03-16T20:56:04.903797+0000","last_peered":"2024-03-16T20:56:04.903797+0000","last_clean":"2024-03-16T20:56:04.903797+0000","last_became_active":"2024-03-16T20:55:05.274131+0000","last_became_peered":"2024-03-16T20:55:05.274131+0000","last_unstale":"2024-03-16T20:56:04.903797+0000","last_undegraded":"2024-03-16T20:56:04.903797+0000","last_fullsized":"2024-03-16T20:56:04.903797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:59:43.413956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.522061+0000","last_change":"2024-03-16T20:56:04.522061+0000","last_active":"2024-03-16T20:56:04.522061+0000","last_peered":"2024-03-16T20:56:04.522061+0000","last_clean":"2024-03-16T20:56:04.522061+0000","last_became_active":"2024-03-16T20:56:04.521622+0000","last_became_peered":"2024-03-16T20:56:04.521622+0000","last_unstale":"2024-03-16T20:56:04.522061+0000","last_undegraded":"2024-03-16T20:56:04.522061+0000","last_fullsized":"2024-03-16T20:56:04.522061+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:00:52.309217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.523958+0000","last_change":"2024-03-16T20:55:05.282707+0000","last_active":"2024-03-16T20:56:04.523958+0000","last_peered":"2024-03-16T20:56:04.523958+0000","last_clean":"2024-03-16T20:56:04.523958+0000","last_became_active":"2024-03-16T20:55:05.282168+0000","last_became_peered":"2024-03-16T20:55:05.282168+0000","last_unstale":"2024-03-16T20:56:04.523958+0000","last_undegraded":"2024-03-16T20:56:04.523958+0000","last_fullsized":"2024-03-16T20:56:04.523958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:33:59.464303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.524056+0000","last_change":"2024-03-16T20:55:05.290291+0000","last_active":"2024-03-16T20:56:04.524056+0000","last_peered":"2024-03-16T20:56:04.524056+0000","last_clean":"2024-03-16T20:56:04.524056+0000","last_became_active":"2024-03-16T20:55:05.289952+0000","last_became_peered":"2024-03-16T20:55:05.289952+0000","last_unstale":"2024-03-16T20:56:04.524056+0000","last_undegraded":"2024-03-16T20:56:04.524056+0000","last_fullsized":"2024-03-16T20:56:04.524056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:05.334408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929339+0000","last_change":"2024-03-16T20:55:05.284252+0000","last_active":"2024-03-16T20:56:04.929339+0000","last_peered":"2024-03-16T20:56:04.929339+0000","last_clean":"2024-03-16T20:56:04.929339+0000","last_became_active":"2024-03-16T20:55:05.283804+0000","last_became_peered":"2024-03-16T20:55:05.283804+0000","last_unstale":"2024-03-16T20:56:04.929339+0000","last_undegraded":"2024-03-16T20:56:04.929339+0000","last_fullsized":"2024-03-16T20:56:04.929339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:03:17.942719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512937+0000","last_change":"2024-03-16T20:55:05.296118+0000","last_active":"2024-03-16T20:56:04.512937+0000","last_peered":"2024-03-16T20:56:04.512937+0000","last_clean":"2024-03-16T20:56:04.512937+0000","last_became_active":"2024-03-16T20:55:05.295783+0000","last_became_peered":"2024-03-16T20:55:05.295783+0000","last_unstale":"2024-03-16T20:56:04.512937+0000","last_undegraded":"2024-03-16T20:56:04.512937+0000","last_fullsized":"2024-03-16T20:56:04.512937+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:36:15.463748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516820+0000","last_change":"2024-03-16T20:55:05.287221+0000","last_active":"2024-03-16T20:56:04.516820+0000","last_peered":"2024-03-16T20:56:04.516820+0000","last_clean":"2024-03-16T20:56:04.516820+0000","last_became_active":"2024-03-16T20:55:05.286553+0000","last_became_peered":"2024-03-16T20:55:05.286553+0000","last_unstale":"2024-03-16T20:56:04.516820+0000","last_undegraded":"2024-03-16T20:56:04.516820+0000","last_fullsized":"2024-03-16T20:56:04.516820+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:33:25.688231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513629+0000","last_change":"2024-03-16T20:55:05.280111+0000","last_active":"2024-03-16T20:56:04.513629+0000","last_peered":"2024-03-16T20:56:04.513629+0000","last_clean":"2024-03-16T20:56:04.513629+0000","last_became_active":"2024-03-16T20:55:05.279857+0000","last_became_peered":"2024-03-16T20:55:05.279857+0000","last_unstale":"2024-03-16T20:56:04.513629+0000","last_undegraded":"2024-03-16T20:56:04.513629+0000","last_fullsized":"2024-03-16T20:56:04.513629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:57:18.205253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516250+0000","last_change":"2024-03-16T20:55:04.268836+0000","last_active":"2024-03-16T20:56:04.516250+0000","last_peered":"2024-03-16T20:56:04.516250+0000","last_clean":"2024-03-16T20:56:04.516250+0000","last_became_active":"2024-03-16T20:55:04.266502+0000","last_became_peered":"2024-03-16T20:55:04.266502+0000","last_unstale":"2024-03-16T20:56:04.516250+0000","last_undegraded":"2024-03-16T20:56:04.516250+0000","last_fullsized":"2024-03-16T20:56:04.516250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:12:33.717454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513612+0000","last_change":"2024-03-16T20:55:05.280158+0000","last_active":"2024-03-16T20:56:04.513612+0000","last_peered":"2024-03-16T20:56:04.513612+0000","last_clean":"2024-03-16T20:56:04.513612+0000","last_became_active":"2024-03-16T20:55:05.278918+0000","last_became_peered":"2024-03-16T20:55:05.278918+0000","last_unstale":"2024-03-16T20:56:04.513612+0000","last_undegraded":"2024-03-16T20:56:04.513612+0000","last_fullsized":"2024-03-16T20:56:04.513612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:27:34.158596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513307+0000","last_change":"2024-03-16T20:55:04.283366+0000","last_active":"2024-03-16T20:56:04.513307+0000","last_peered":"2024-03-16T20:56:04.513307+0000","last_clean":"2024-03-16T20:56:04.513307+0000","last_became_active":"2024-03-16T20:55:04.283016+0000","last_became_peered":"2024-03-16T20:55:04.283016+0000","last_unstale":"2024-03-16T20:56:04.513307+0000","last_undegraded":"2024-03-16T20:56:04.513307+0000","last_fullsized":"2024-03-16T20:56:04.513307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:41.163294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.525943+0000","last_change":"2024-03-16T20:55:05.299005+0000","last_active":"2024-03-16T20:56:04.525943+0000","last_peered":"2024-03-16T20:56:04.525943+0000","last_clean":"2024-03-16T20:56:04.525943+0000","last_became_active":"2024-03-16T20:55:05.296527+0000","last_became_peered":"2024-03-16T20:55:05.296527+0000","last_unstale":"2024-03-16T20:56:04.525943+0000","last_undegraded":"2024-03-16T20:56:04.525943+0000","last_fullsized":"2024-03-16T20:56:04.525943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:56:51.451900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515248+0000","last_change":"2024-03-16T20:55:04.259210+0000","last_active":"2024-03-16T20:56:04.515248+0000","last_peered":"2024-03-16T20:56:04.515248+0000","last_clean":"2024-03-16T20:56:04.515248+0000","last_became_active":"2024-03-16T20:55:04.258828+0000","last_became_peered":"2024-03-16T20:55:04.258828+0000","last_unstale":"2024-03-16T20:56:04.515248+0000","last_undegraded":"2024-03-16T20:56:04.515248+0000","last_fullsized":"2024-03-16T20:56:04.515248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:21:14.497086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929486+0000","last_change":"2024-03-16T20:55:05.272053+0000","last_active":"2024-03-16T20:56:04.929486+0000","last_peered":"2024-03-16T20:56:04.929486+0000","last_clean":"2024-03-16T20:56:04.929486+0000","last_became_active":"2024-03-16T20:55:05.271435+0000","last_became_peered":"2024-03-16T20:55:05.271435+0000","last_unstale":"2024-03-16T20:56:04.929486+0000","last_undegraded":"2024-03-16T20:56:04.929486+0000","last_fullsized":"2024-03-16T20:56:04.929486+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:08:47.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514977+0000","last_change":"2024-03-16T20:55:04.261051+0000","last_active":"2024-03-16T20:56:04.514977+0000","last_peered":"2024-03-16T20:56:04.514977+0000","last_clean":"2024-03-16T20:56:04.514977+0000","last_became_active":"2024-03-16T20:55:04.260701+0000","last_became_peered":"2024-03-16T20:55:04.260701+0000","last_unstale":"2024-03-16T20:56:04.514977+0000","last_undegraded":"2024-03-16T20:56:04.514977+0000","last_fullsized":"2024-03-16T20:56:04.514977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:30:05.233891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605484+0000","last_change":"2024-03-16T20:55:05.270047+0000","last_active":"2024-03-16T20:56:04.605484+0000","last_peered":"2024-03-16T20:56:04.605484+0000","last_clean":"2024-03-16T20:56:04.605484+0000","last_became_active":"2024-03-16T20:55:05.269045+0000","last_became_peered":"2024-03-16T20:55:05.269045+0000","last_unstale":"2024-03-16T20:56:04.605484+0000","last_undegraded":"2024-03-16T20:56:04.605484+0000","last_fullsized":"2024-03-16T20:56:04.605484+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:54:19.289648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":104,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:26.443277+0000","last_change":"2024-03-16T20:55:04.258871+0000","last_active":"2024-03-16T20:56:26.443277+0000","last_peered":"2024-03-16T20:56:26.443277+0000","last_clean":"2024-03-16T20:56:26.443277+0000","last_became_active":"2024-03-16T20:55:04.258462+0000","last_became_peered":"2024-03-16T20:55:04.258462+0000","last_unstale":"2024-03-16T20:56:26.443277+0000","last_undegraded":"2024-03-16T20:56:26.443277+0000","last_fullsized":"2024-03-16T20:56:26.443277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:16:29.832814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514785+0000","last_change":"2024-03-16T20:55:05.290789+0000","last_active":"2024-03-16T20:56:04.514785+0000","last_peered":"2024-03-16T20:56:04.514785+0000","last_clean":"2024-03-16T20:56:04.514785+0000","last_became_active":"2024-03-16T20:55:05.290367+0000","last_became_peered":"2024-03-16T20:55:05.290367+0000","last_unstale":"2024-03-16T20:56:04.514785+0000","last_undegraded":"2024-03-16T20:56:04.514785+0000","last_fullsized":"2024-03-16T20:56:04.514785+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:23:38.509837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513422+0000","last_change":"2024-03-16T20:55:04.264980+0000","last_active":"2024-03-16T20:56:04.513422+0000","last_peered":"2024-03-16T20:56:04.513422+0000","last_clean":"2024-03-16T20:56:04.513422+0000","last_became_active":"2024-03-16T20:55:04.264634+0000","last_became_peered":"2024-03-16T20:55:04.264634+0000","last_unstale":"2024-03-16T20:56:04.513422+0000","last_undegraded":"2024-03-16T20:56:04.513422+0000","last_fullsized":"2024-03-16T20:56:04.513422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:16:52.713847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605329+0000","last_change":"2024-03-16T20:55:05.286139+0000","last_active":"2024-03-16T20:56:04.605329+0000","last_peered":"2024-03-16T20:56:04.605329+0000","last_clean":"2024-03-16T20:56:04.605329+0000","last_became_active":"2024-03-16T20:55:05.285751+0000","last_became_peered":"2024-03-16T20:55:05.285751+0000","last_unstale":"2024-03-16T20:56:04.605329+0000","last_undegraded":"2024-03-16T20:56:04.605329+0000","last_fullsized":"2024-03-16T20:56:04.605329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:01:02.448785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.517679+0000","last_change":"2024-03-16T20:55:04.282416+0000","last_active":"2024-03-16T20:56:04.517679+0000","last_peered":"2024-03-16T20:56:04.517679+0000","last_clean":"2024-03-16T20:56:04.517679+0000","last_became_active":"2024-03-16T20:55:04.280504+0000","last_became_peered":"2024-03-16T20:55:04.280504+0000","last_unstale":"2024-03-16T20:56:04.517679+0000","last_undegraded":"2024-03-16T20:56:04.517679+0000","last_fullsized":"2024-03-16T20:56:04.517679+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:23.940976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.509431+0000","last_change":"2024-03-16T20:55:05.289210+0000","last_active":"2024-03-16T20:56:04.509431+0000","last_peered":"2024-03-16T20:56:04.509431+0000","last_clean":"2024-03-16T20:56:04.509431+0000","last_became_active":"2024-03-16T20:55:05.286738+0000","last_became_peered":"2024-03-16T20:55:05.286738+0000","last_unstale":"2024-03-16T20:56:04.509431+0000","last_undegraded":"2024-03-16T20:56:04.509431+0000","last_fullsized":"2024-03-16T20:56:04.509431+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:43:45.266727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605215+0000","last_change":"2024-03-16T20:55:04.258925+0000","last_active":"2024-03-16T20:56:04.605215+0000","last_peered":"2024-03-16T20:56:04.605215+0000","last_clean":"2024-03-16T20:56:04.605215+0000","last_became_active":"2024-03-16T20:55:04.258578+0000","last_became_peered":"2024-03-16T20:55:04.258578+0000","last_unstale":"2024-03-16T20:56:04.605215+0000","last_undegraded":"2024-03-16T20:56:04.605215+0000","last_fullsized":"2024-03-16T20:56:04.605215+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:52.812547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.509799+0000","last_change":"2024-03-16T20:55:05.302122+0000","last_active":"2024-03-16T20:56:04.509799+0000","last_peered":"2024-03-16T20:56:04.509799+0000","last_clean":"2024-03-16T20:56:04.509799+0000","last_became_active":"2024-03-16T20:55:05.301743+0000","last_became_peered":"2024-03-16T20:55:05.301743+0000","last_unstale":"2024-03-16T20:56:04.509799+0000","last_undegraded":"2024-03-16T20:56:04.509799+0000","last_fullsized":"2024-03-16T20:56:04.509799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:32:51.691780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:28.444775+0000","last_change":"2024-03-16T20:55:04.270015+0000","last_active":"2024-03-16T20:56:28.444775+0000","last_peered":"2024-03-16T20:56:28.444775+0000","last_clean":"2024-03-16T20:56:28.444775+0000","last_became_active":"2024-03-16T20:55:04.269563+0000","last_became_peered":"2024-03-16T20:55:04.269563+0000","last_unstale":"2024-03-16T20:56:28.444775+0000","last_undegraded":"2024-03-16T20:56:28.444775+0000","last_fullsized":"2024-03-16T20:56:28.444775+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:39:21.768540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929992+0000","last_change":"2024-03-16T20:55:05.290639+0000","last_active":"2024-03-16T20:56:04.929992+0000","last_peered":"2024-03-16T20:56:04.929992+0000","last_clean":"2024-03-16T20:56:04.929992+0000","last_became_active":"2024-03-16T20:55:05.290255+0000","last_became_peered":"2024-03-16T20:55:05.290255+0000","last_unstale":"2024-03-16T20:56:04.929992+0000","last_undegraded":"2024-03-16T20:56:04.929992+0000","last_fullsized":"2024-03-16T20:56:04.929992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:36:13.303557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930519+0000","last_change":"2024-03-16T20:55:04.260407+0000","last_active":"2024-03-16T20:56:04.930519+0000","last_peered":"2024-03-16T20:56:04.930519+0000","last_clean":"2024-03-16T20:56:04.930519+0000","last_became_active":"2024-03-16T20:55:04.259817+0000","last_became_peered":"2024-03-16T20:55:04.259817+0000","last_unstale":"2024-03-16T20:56:04.930519+0000","last_undegraded":"2024-03-16T20:56:04.930519+0000","last_fullsized":"2024-03-16T20:56:04.930519+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:07.995508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.525812+0000","last_change":"2024-03-16T20:55:05.295327+0000","last_active":"2024-03-16T20:56:04.525812+0000","last_peered":"2024-03-16T20:56:04.525812+0000","last_clean":"2024-03-16T20:56:04.525812+0000","last_became_active":"2024-03-16T20:55:05.294948+0000","last_became_peered":"2024-03-16T20:55:05.294948+0000","last_unstale":"2024-03-16T20:56:04.525812+0000","last_undegraded":"2024-03-16T20:56:04.525812+0000","last_fullsized":"2024-03-16T20:56:04.525812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:29.305366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605588+0000","last_change":"2024-03-16T20:55:04.264571+0000","last_active":"2024-03-16T20:56:04.605588+0000","last_peered":"2024-03-16T20:56:04.605588+0000","last_clean":"2024-03-16T20:56:04.605588+0000","last_became_active":"2024-03-16T20:55:04.264200+0000","last_became_peered":"2024-03-16T20:55:04.264200+0000","last_unstale":"2024-03-16T20:56:04.605588+0000","last_undegraded":"2024-03-16T20:56:04.605588+0000","last_fullsized":"2024-03-16T20:56:04.605588+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:38:58.457250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929587+0000","last_change":"2024-03-16T20:55:05.272855+0000","last_active":"2024-03-16T20:56:04.929587+0000","last_peered":"2024-03-16T20:56:04.929587+0000","last_clean":"2024-03-16T20:56:04.929587+0000","last_became_active":"2024-03-16T20:55:05.272500+0000","last_became_peered":"2024-03-16T20:55:05.272500+0000","last_unstale":"2024-03-16T20:56:04.929587+0000","last_undegraded":"2024-03-16T20:56:04.929587+0000","last_fullsized":"2024-03-16T20:56:04.929587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:50:17.121966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'32","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:29.445690+0000","last_change":"2024-03-16T20:55:04.260050+0000","last_active":"2024-03-16T20:56:29.445690+0000","last_peered":"2024-03-16T20:56:29.445690+0000","last_clean":"2024-03-16T20:56:29.445690+0000","last_became_active":"2024-03-16T20:55:04.259662+0000","last_became_peered":"2024-03-16T20:55:04.259662+0000","last_unstale":"2024-03-16T20:56:29.445690+0000","last_undegraded":"2024-03-16T20:56:29.445690+0000","last_fullsized":"2024-03-16T20:56:29.445690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:45:46.999980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63917,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":169,"num_read_kb":146,"num_write":33,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514817+0000","last_change":"2024-03-16T20:55:05.272337+0000","last_active":"2024-03-16T20:56:04.514817+0000","last_peered":"2024-03-16T20:56:04.514817+0000","last_clean":"2024-03-16T20:56:04.514817+0000","last_became_active":"2024-03-16T20:55:05.271761+0000","last_became_peered":"2024-03-16T20:55:05.271761+0000","last_unstale":"2024-03-16T20:56:04.514817+0000","last_undegraded":"2024-03-16T20:56:04.514817+0000","last_fullsized":"2024-03-16T20:56:04.514817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:50:22.079709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513362+0000","last_change":"2024-03-16T20:55:04.275606+0000","last_active":"2024-03-16T20:56:04.513362+0000","last_peered":"2024-03-16T20:56:04.513362+0000","last_clean":"2024-03-16T20:56:04.513362+0000","last_became_active":"2024-03-16T20:55:04.275268+0000","last_became_peered":"2024-03-16T20:55:04.275268+0000","last_unstale":"2024-03-16T20:56:04.513362+0000","last_undegraded":"2024-03-16T20:56:04.513362+0000","last_fullsized":"2024-03-16T20:56:04.513362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:27:34.248831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515315+0000","last_change":"2024-03-16T20:55:05.290619+0000","last_active":"2024-03-16T20:56:04.515315+0000","last_peered":"2024-03-16T20:56:04.515315+0000","last_clean":"2024-03-16T20:56:04.515315+0000","last_became_active":"2024-03-16T20:55:05.289943+0000","last_became_peered":"2024-03-16T20:55:05.289943+0000","last_unstale":"2024-03-16T20:56:04.515315+0000","last_undegraded":"2024-03-16T20:56:04.515315+0000","last_fullsized":"2024-03-16T20:56:04.515315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:30.569777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605239+0000","last_change":"2024-03-16T20:55:04.274206+0000","last_active":"2024-03-16T20:56:04.605239+0000","last_peered":"2024-03-16T20:56:04.605239+0000","last_clean":"2024-03-16T20:56:04.605239+0000","last_became_active":"2024-03-16T20:55:04.273834+0000","last_became_peered":"2024-03-16T20:55:04.273834+0000","last_unstale":"2024-03-16T20:56:04.605239+0000","last_undegraded":"2024-03-16T20:56:04.605239+0000","last_fullsized":"2024-03-16T20:56:04.605239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:36:04.720463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930357+0000","last_change":"2024-03-16T20:55:05.280265+0000","last_active":"2024-03-16T20:56:04.930357+0000","last_peered":"2024-03-16T20:56:04.930357+0000","last_clean":"2024-03-16T20:56:04.930357+0000","last_became_active":"2024-03-16T20:55:05.279774+0000","last_became_peered":"2024-03-16T20:55:05.279774+0000","last_unstale":"2024-03-16T20:56:04.930357+0000","last_undegraded":"2024-03-16T20:56:04.930357+0000","last_fullsized":"2024-03-16T20:56:04.930357+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:34:52.855290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'4","reported_seq":105,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:27.482460+0000","last_change":"2024-03-16T20:55:04.256314+0000","last_active":"2024-03-16T20:56:27.482460+0000","last_peered":"2024-03-16T20:56:27.482460+0000","last_clean":"2024-03-16T20:56:27.482460+0000","last_became_active":"2024-03-16T20:55:04.255940+0000","last_became_peered":"2024-03-16T20:55:04.255940+0000","last_unstale":"2024-03-16T20:56:27.482460+0000","last_undegraded":"2024-03-16T20:56:27.482460+0000","last_fullsized":"2024-03-16T20:56:27.482460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:27:09.660107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929915+0000","last_change":"2024-03-16T20:55:05.271562+0000","last_active":"2024-03-16T20:56:04.929915+0000","last_peered":"2024-03-16T20:56:04.929915+0000","last_clean":"2024-03-16T20:56:04.929915+0000","last_became_active":"2024-03-16T20:55:05.271214+0000","last_became_peered":"2024-03-16T20:55:05.271214+0000","last_unstale":"2024-03-16T20:56:04.929915+0000","last_undegraded":"2024-03-16T20:56:04.929915+0000","last_fullsized":"2024-03-16T20:56:04.929915+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:42:35.104345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.537648+0000","last_change":"2024-03-16T20:56:04.537276+0000","last_active":"2024-03-16T20:56:04.537648+0000","last_peered":"2024-03-16T20:56:04.537648+0000","last_clean":"2024-03-16T20:56:04.537648+0000","last_became_active":"2024-03-16T20:56:04.526059+0000","last_became_peered":"2024-03-16T20:56:04.526059+0000","last_unstale":"2024-03-16T20:56:04.537648+0000","last_undegraded":"2024-03-16T20:56:04.537648+0000","last_fullsized":"2024-03-16T20:56:04.537648+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:17:50.898269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605410+0000","last_change":"2024-03-16T20:55:05.269751+0000","last_active":"2024-03-16T20:56:04.605410+0000","last_peered":"2024-03-16T20:56:04.605410+0000","last_clean":"2024-03-16T20:56:04.605410+0000","last_became_active":"2024-03-16T20:55:05.269375+0000","last_became_peered":"2024-03-16T20:55:05.269375+0000","last_unstale":"2024-03-16T20:56:04.605410+0000","last_undegraded":"2024-03-16T20:56:04.605410+0000","last_fullsized":"2024-03-16T20:56:04.605410+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:57:00.751155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515245+0000","last_change":"2024-03-16T20:55:04.254352+0000","last_active":"2024-03-16T20:56:04.515245+0000","last_peered":"2024-03-16T20:56:04.515245+0000","last_clean":"2024-03-16T20:56:04.515245+0000","last_became_active":"2024-03-16T20:55:04.253895+0000","last_became_peered":"2024-03-16T20:55:04.253895+0000","last_unstale":"2024-03-16T20:56:04.515245+0000","last_undegraded":"2024-03-16T20:56:04.515245+0000","last_fullsized":"2024-03-16T20:56:04.515245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:35:15.796341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512697+0000","last_change":"2024-03-16T20:55:05.271148+0000","last_active":"2024-03-16T20:56:04.512697+0000","last_peered":"2024-03-16T20:56:04.512697+0000","last_clean":"2024-03-16T20:56:04.512697+0000","last_became_active":"2024-03-16T20:55:05.270836+0000","last_became_peered":"2024-03-16T20:55:05.270836+0000","last_unstale":"2024-03-16T20:56:04.512697+0000","last_undegraded":"2024-03-16T20:56:04.512697+0000","last_fullsized":"2024-03-16T20:56:04.512697+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:12:49.526828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516116+0000","last_change":"2024-03-16T20:55:04.277152+0000","last_active":"2024-03-16T20:56:04.516116+0000","last_peered":"2024-03-16T20:56:04.516116+0000","last_clean":"2024-03-16T20:56:04.516116+0000","last_became_active":"2024-03-16T20:55:04.276666+0000","last_became_peered":"2024-03-16T20:55:04.276666+0000","last_unstale":"2024-03-16T20:56:04.516116+0000","last_undegraded":"2024-03-16T20:56:04.516116+0000","last_fullsized":"2024-03-16T20:56:04.516116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:39:04.919957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.529323+0000","last_change":"2024-03-16T20:56:04.529323+0000","last_active":"2024-03-16T20:56:04.529323+0000","last_peered":"2024-03-16T20:56:04.529323+0000","last_clean":"2024-03-16T20:56:04.529323+0000","last_became_active":"2024-03-16T20:56:04.521484+0000","last_became_peered":"2024-03-16T20:56:04.521484+0000","last_unstale":"2024-03-16T20:56:04.529323+0000","last_undegraded":"2024-03-16T20:56:04.529323+0000","last_fullsized":"2024-03-16T20:56:04.529323+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:00:31.203774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930092+0000","last_change":"2024-03-16T20:55:04.270960+0000","last_active":"2024-03-16T20:56:04.930092+0000","last_peered":"2024-03-16T20:56:04.930092+0000","last_clean":"2024-03-16T20:56:04.930092+0000","last_became_active":"2024-03-16T20:55:04.270605+0000","last_became_peered":"2024-03-16T20:55:04.270605+0000","last_unstale":"2024-03-16T20:56:04.930092+0000","last_undegraded":"2024-03-16T20:56:04.930092+0000","last_fullsized":"2024-03-16T20:56:04.930092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:06:53.529116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513667+0000","last_change":"2024-03-16T20:55:05.303690+0000","last_active":"2024-03-16T20:56:04.513667+0000","last_peered":"2024-03-16T20:56:04.513667+0000","last_clean":"2024-03-16T20:56:04.513667+0000","last_became_active":"2024-03-16T20:55:05.303096+0000","last_became_peered":"2024-03-16T20:55:05.303096+0000","last_unstale":"2024-03-16T20:56:04.513667+0000","last_undegraded":"2024-03-16T20:56:04.513667+0000","last_fullsized":"2024-03-16T20:56:04.513667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:03:25.139693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605248+0000","last_change":"2024-03-16T20:55:05.268277+0000","last_active":"2024-03-16T20:56:04.605248+0000","last_peered":"2024-03-16T20:56:04.605248+0000","last_clean":"2024-03-16T20:56:04.605248+0000","last_became_active":"2024-03-16T20:55:05.267955+0000","last_became_peered":"2024-03-16T20:55:05.267955+0000","last_unstale":"2024-03-16T20:56:04.605248+0000","last_undegraded":"2024-03-16T20:56:04.605248+0000","last_fullsized":"2024-03-16T20:56:04.605248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:20:21.633055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":101,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:26.480362+0000","last_change":"2024-03-16T20:55:04.277286+0000","last_active":"2024-03-16T20:56:26.480362+0000","last_peered":"2024-03-16T20:56:26.480362+0000","last_clean":"2024-03-16T20:56:26.480362+0000","last_became_active":"2024-03-16T20:55:04.276855+0000","last_became_peered":"2024-03-16T20:55:04.276855+0000","last_unstale":"2024-03-16T20:56:26.480362+0000","last_undegraded":"2024-03-16T20:56:26.480362+0000","last_fullsized":"2024-03-16T20:56:26.480362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:22:19.590782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512552+0000","last_change":"2024-03-16T20:55:05.280255+0000","last_active":"2024-03-16T20:56:04.512552+0000","last_peered":"2024-03-16T20:56:04.512552+0000","last_clean":"2024-03-16T20:56:04.512552+0000","last_became_active":"2024-03-16T20:55:05.279762+0000","last_became_peered":"2024-03-16T20:55:05.279762+0000","last_unstale":"2024-03-16T20:56:04.512552+0000","last_undegraded":"2024-03-16T20:56:04.512552+0000","last_fullsized":"2024-03-16T20:56:04.512552+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:31.687047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903822+0000","last_change":"2024-03-16T20:55:04.263605+0000","last_active":"2024-03-16T20:56:04.903822+0000","last_peered":"2024-03-16T20:56:04.903822+0000","last_clean":"2024-03-16T20:56:04.903822+0000","last_became_active":"2024-03-16T20:55:04.263189+0000","last_became_peered":"2024-03-16T20:55:04.263189+0000","last_unstale":"2024-03-16T20:56:04.903822+0000","last_undegraded":"2024-03-16T20:56:04.903822+0000","last_fullsized":"2024-03-16T20:56:04.903822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:28:11.377134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":352,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930006+0000","last_change":"2024-03-16T20:53:44.281432+0000","last_active":"2024-03-16T20:56:04.930006+0000","last_peered":"2024-03-16T20:56:04.930006+0000","last_clean":"2024-03-16T20:56:04.930006+0000","last_became_active":"2024-03-16T20:53:44.280927+0000","last_became_peered":"2024-03-16T20:53:44.280927+0000","last_unstale":"2024-03-16T20:56:04.930006+0000","last_undegraded":"2024-03-16T20:56:04.930006+0000","last_fullsized":"2024-03-16T20:56:04.930006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_clean_scrub_stamp":"2024-03-16T20:49:51.705234+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:01:00.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.525541+0000","last_change":"2024-03-16T20:56:04.525541+0000","last_active":"2024-03-16T20:56:04.525541+0000","last_peered":"2024-03-16T20:56:04.525541+0000","last_clean":"2024-03-16T20:56:04.525541+0000","last_became_active":"2024-03-16T20:56:04.522548+0000","last_became_peered":"2024-03-16T20:56:04.522548+0000","last_unstale":"2024-03-16T20:56:04.525541+0000","last_undegraded":"2024-03-16T20:56:04.525541+0000","last_fullsized":"2024-03-16T20:56:04.525541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:35:54.115845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930068+0000","last_change":"2024-03-16T20:55:04.256842+0000","last_active":"2024-03-16T20:56:04.930068+0000","last_peered":"2024-03-16T20:56:04.930068+0000","last_clean":"2024-03-16T20:56:04.930068+0000","last_became_active":"2024-03-16T20:55:04.256493+0000","last_became_peered":"2024-03-16T20:55:04.256493+0000","last_unstale":"2024-03-16T20:56:04.930068+0000","last_undegraded":"2024-03-16T20:56:04.930068+0000","last_fullsized":"2024-03-16T20:56:04.930068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:08.836034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515097+0000","last_change":"2024-03-16T20:55:04.265503+0000","last_active":"2024-03-16T20:56:04.515097+0000","last_peered":"2024-03-16T20:56:04.515097+0000","last_clean":"2024-03-16T20:56:04.515097+0000","last_became_active":"2024-03-16T20:55:04.265017+0000","last_became_peered":"2024-03-16T20:55:04.265017+0000","last_unstale":"2024-03-16T20:56:04.515097+0000","last_undegraded":"2024-03-16T20:56:04.515097+0000","last_fullsized":"2024-03-16T20:56:04.515097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:28.485079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515090+0000","last_change":"2024-03-16T20:55:05.289100+0000","last_active":"2024-03-16T20:56:04.515090+0000","last_peered":"2024-03-16T20:56:04.515090+0000","last_clean":"2024-03-16T20:56:04.515090+0000","last_became_active":"2024-03-16T20:55:05.288122+0000","last_became_peered":"2024-03-16T20:55:05.288122+0000","last_unstale":"2024-03-16T20:56:04.515090+0000","last_undegraded":"2024-03-16T20:56:04.515090+0000","last_fullsized":"2024-03-16T20:56:04.515090+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:03.222038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516654+0000","last_change":"2024-03-16T20:55:04.282230+0000","last_active":"2024-03-16T20:56:04.516654+0000","last_peered":"2024-03-16T20:56:04.516654+0000","last_clean":"2024-03-16T20:56:04.516654+0000","last_became_active":"2024-03-16T20:55:04.281917+0000","last_became_peered":"2024-03-16T20:55:04.281917+0000","last_unstale":"2024-03-16T20:56:04.516654+0000","last_undegraded":"2024-03-16T20:56:04.516654+0000","last_fullsized":"2024-03-16T20:56:04.516654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:18:36.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514180+0000","last_change":"2024-03-16T20:55:05.293378+0000","last_active":"2024-03-16T20:56:04.514180+0000","last_peered":"2024-03-16T20:56:04.514180+0000","last_clean":"2024-03-16T20:56:04.514180+0000","last_became_active":"2024-03-16T20:55:05.288648+0000","last_became_peered":"2024-03-16T20:55:05.288648+0000","last_unstale":"2024-03-16T20:56:04.514180+0000","last_undegraded":"2024-03-16T20:56:04.514180+0000","last_fullsized":"2024-03-16T20:56:04.514180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:37:58.270760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903946+0000","last_change":"2024-03-16T20:55:04.268766+0000","last_active":"2024-03-16T20:56:04.903946+0000","last_peered":"2024-03-16T20:56:04.903946+0000","last_clean":"2024-03-16T20:56:04.903946+0000","last_became_active":"2024-03-16T20:55:04.268429+0000","last_became_peered":"2024-03-16T20:55:04.268429+0000","last_unstale":"2024-03-16T20:56:04.903946+0000","last_undegraded":"2024-03-16T20:56:04.903946+0000","last_fullsized":"2024-03-16T20:56:04.903946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:43.872155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.527529+0000","last_change":"2024-03-16T20:55:05.310349+0000","last_active":"2024-03-16T20:56:04.527529+0000","last_peered":"2024-03-16T20:56:04.527529+0000","last_clean":"2024-03-16T20:56:04.527529+0000","last_became_active":"2024-03-16T20:55:05.307987+0000","last_became_peered":"2024-03-16T20:55:05.307987+0000","last_unstale":"2024-03-16T20:56:04.527529+0000","last_undegraded":"2024-03-16T20:56:04.527529+0000","last_fullsized":"2024-03-16T20:56:04.527529+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:19:38.142783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929344+0000","last_change":"2024-03-16T20:55:04.269683+0000","last_active":"2024-03-16T20:56:04.929344+0000","last_peered":"2024-03-16T20:56:04.929344+0000","last_clean":"2024-03-16T20:56:04.929344+0000","last_became_active":"2024-03-16T20:55:04.269258+0000","last_became_peered":"2024-03-16T20:55:04.269258+0000","last_unstale":"2024-03-16T20:56:04.929344+0000","last_undegraded":"2024-03-16T20:56:04.929344+0000","last_fullsized":"2024-03-16T20:56:04.929344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:24:10.417179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514556+0000","last_change":"2024-03-16T20:55:05.272238+0000","last_active":"2024-03-16T20:56:04.514556+0000","last_peered":"2024-03-16T20:56:04.514556+0000","last_clean":"2024-03-16T20:56:04.514556+0000","last_became_active":"2024-03-16T20:55:05.270379+0000","last_became_peered":"2024-03-16T20:55:05.270379+0000","last_unstale":"2024-03-16T20:56:04.514556+0000","last_undegraded":"2024-03-16T20:56:04.514556+0000","last_fullsized":"2024-03-16T20:56:04.514556+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:16:11.348601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512082+0000","last_change":"2024-03-16T20:55:04.280008+0000","last_active":"2024-03-16T20:56:04.512082+0000","last_peered":"2024-03-16T20:56:04.512082+0000","last_clean":"2024-03-16T20:56:04.512082+0000","last_became_active":"2024-03-16T20:55:04.279683+0000","last_became_peered":"2024-03-16T20:55:04.279683+0000","last_unstale":"2024-03-16T20:56:04.512082+0000","last_undegraded":"2024-03-16T20:56:04.512082+0000","last_fullsized":"2024-03-16T20:56:04.512082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:15.734826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512539+0000","last_change":"2024-03-16T20:55:05.287219+0000","last_active":"2024-03-16T20:56:04.512539+0000","last_peered":"2024-03-16T20:56:04.512539+0000","last_clean":"2024-03-16T20:56:04.512539+0000","last_became_active":"2024-03-16T20:55:05.286899+0000","last_became_peered":"2024-03-16T20:55:05.286899+0000","last_unstale":"2024-03-16T20:56:04.512539+0000","last_undegraded":"2024-03-16T20:56:04.512539+0000","last_fullsized":"2024-03-16T20:56:04.512539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:33:01.483415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.520859+0000","last_change":"2024-03-16T20:56:04.520433+0000","last_active":"2024-03-16T20:56:04.520859+0000","last_peered":"2024-03-16T20:56:04.520859+0000","last_clean":"2024-03-16T20:56:04.520859+0000","last_became_active":"2024-03-16T20:56:04.516521+0000","last_became_peered":"2024-03-16T20:56:04.516521+0000","last_unstale":"2024-03-16T20:56:04.520859+0000","last_undegraded":"2024-03-16T20:56:04.520859+0000","last_fullsized":"2024-03-16T20:56:04.520859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:44:38.094213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.511716+0000","last_change":"2024-03-16T20:55:05.311463+0000","last_active":"2024-03-16T20:56:04.511716+0000","last_peered":"2024-03-16T20:56:04.511716+0000","last_clean":"2024-03-16T20:56:04.511716+0000","last_became_active":"2024-03-16T20:55:05.310852+0000","last_became_peered":"2024-03-16T20:55:05.310852+0000","last_unstale":"2024-03-16T20:56:04.511716+0000","last_undegraded":"2024-03-16T20:56:04.511716+0000","last_fullsized":"2024-03-16T20:56:04.511716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:51:52.980193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514599+0000","last_change":"2024-03-16T20:55:04.260372+0000","last_active":"2024-03-16T20:56:04.514599+0000","last_peered":"2024-03-16T20:56:04.514599+0000","last_clean":"2024-03-16T20:56:04.514599+0000","last_became_active":"2024-03-16T20:55:04.259273+0000","last_became_peered":"2024-03-16T20:55:04.259273+0000","last_unstale":"2024-03-16T20:56:04.514599+0000","last_undegraded":"2024-03-16T20:56:04.514599+0000","last_fullsized":"2024-03-16T20:56:04.514599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:21:25.212520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930239+0000","last_change":"2024-03-16T20:55:05.280088+0000","last_active":"2024-03-16T20:56:04.930239+0000","last_peered":"2024-03-16T20:56:04.930239+0000","last_clean":"2024-03-16T20:56:04.930239+0000","last_became_active":"2024-03-16T20:55:05.279745+0000","last_became_peered":"2024-03-16T20:55:05.279745+0000","last_unstale":"2024-03-16T20:56:04.930239+0000","last_undegraded":"2024-03-16T20:56:04.930239+0000","last_fullsized":"2024-03-16T20:56:04.930239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:02:08.797287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513520+0000","last_change":"2024-03-16T20:55:04.275221+0000","last_active":"2024-03-16T20:56:04.513520+0000","last_peered":"2024-03-16T20:56:04.513520+0000","last_clean":"2024-03-16T20:56:04.513520+0000","last_became_active":"2024-03-16T20:55:04.274887+0000","last_became_peered":"2024-03-16T20:55:04.274887+0000","last_unstale":"2024-03-16T20:56:04.513520+0000","last_undegraded":"2024-03-16T20:56:04.513520+0000","last_fullsized":"2024-03-16T20:56:04.513520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:35.333864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930536+0000","last_change":"2024-03-16T20:55:05.272444+0000","last_active":"2024-03-16T20:56:04.930536+0000","last_peered":"2024-03-16T20:56:04.930536+0000","last_clean":"2024-03-16T20:56:04.930536+0000","last_became_active":"2024-03-16T20:55:05.272104+0000","last_became_peered":"2024-03-16T20:55:05.272104+0000","last_unstale":"2024-03-16T20:56:04.930536+0000","last_undegraded":"2024-03-16T20:56:04.930536+0000","last_fullsized":"2024-03-16T20:56:04.930536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:35.480408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605367+0000","last_change":"2024-03-16T20:55:04.274212+0000","last_active":"2024-03-16T20:56:04.605367+0000","last_peered":"2024-03-16T20:56:04.605367+0000","last_clean":"2024-03-16T20:56:04.605367+0000","last_became_active":"2024-03-16T20:55:04.273785+0000","last_became_peered":"2024-03-16T20:55:04.273785+0000","last_unstale":"2024-03-16T20:56:04.605367+0000","last_undegraded":"2024-03-16T20:56:04.605367+0000","last_fullsized":"2024-03-16T20:56:04.605367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:29:00.924789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930375+0000","last_change":"2024-03-16T20:55:05.278590+0000","last_active":"2024-03-16T20:56:04.930375+0000","last_peered":"2024-03-16T20:56:04.930375+0000","last_clean":"2024-03-16T20:56:04.930375+0000","last_became_active":"2024-03-16T20:55:05.278183+0000","last_became_peered":"2024-03-16T20:55:05.278183+0000","last_unstale":"2024-03-16T20:56:04.930375+0000","last_undegraded":"2024-03-16T20:56:04.930375+0000","last_fullsized":"2024-03-16T20:56:04.930375+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:52:18.918653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515832+0000","last_change":"2024-03-16T20:55:04.279568+0000","last_active":"2024-03-16T20:56:04.515832+0000","last_peered":"2024-03-16T20:56:04.515832+0000","last_clean":"2024-03-16T20:56:04.515832+0000","last_became_active":"2024-03-16T20:55:04.278125+0000","last_became_peered":"2024-03-16T20:55:04.278125+0000","last_unstale":"2024-03-16T20:56:04.515832+0000","last_undegraded":"2024-03-16T20:56:04.515832+0000","last_fullsized":"2024-03-16T20:56:04.515832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:13:20.417216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930553+0000","last_change":"2024-03-16T20:55:05.269732+0000","last_active":"2024-03-16T20:56:04.930553+0000","last_peered":"2024-03-16T20:56:04.930553+0000","last_clean":"2024-03-16T20:56:04.930553+0000","last_became_active":"2024-03-16T20:55:05.269260+0000","last_became_peered":"2024-03-16T20:55:05.269260+0000","last_unstale":"2024-03-16T20:56:04.930553+0000","last_undegraded":"2024-03-16T20:56:04.930553+0000","last_fullsized":"2024-03-16T20:56:04.930553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:10:03.312009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512646+0000","last_change":"2024-03-16T20:55:05.272321+0000","last_active":"2024-03-16T20:56:04.512646+0000","last_peered":"2024-03-16T20:56:04.512646+0000","last_clean":"2024-03-16T20:56:04.512646+0000","last_became_active":"2024-03-16T20:55:05.272000+0000","last_became_peered":"2024-03-16T20:55:05.272000+0000","last_unstale":"2024-03-16T20:56:04.512646+0000","last_undegraded":"2024-03-16T20:56:04.512646+0000","last_fullsized":"2024-03-16T20:56:04.512646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:04:44.773709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.931594+0000","last_change":"2024-03-16T20:56:04.931594+0000","last_active":"2024-03-16T20:56:04.931594+0000","last_peered":"2024-03-16T20:56:04.931594+0000","last_clean":"2024-03-16T20:56:04.931594+0000","last_became_active":"2024-03-16T20:56:04.931169+0000","last_became_peered":"2024-03-16T20:56:04.931169+0000","last_unstale":"2024-03-16T20:56:04.931594+0000","last_undegraded":"2024-03-16T20:56:04.931594+0000","last_fullsized":"2024-03-16T20:56:04.931594+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:32:34.858387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513134+0000","last_change":"2024-03-16T20:55:05.287329+0000","last_active":"2024-03-16T20:56:04.513134+0000","last_peered":"2024-03-16T20:56:04.513134+0000","last_clean":"2024-03-16T20:56:04.513134+0000","last_became_active":"2024-03-16T20:55:05.286893+0000","last_became_peered":"2024-03-16T20:55:05.286893+0000","last_unstale":"2024-03-16T20:56:04.513134+0000","last_undegraded":"2024-03-16T20:56:04.513134+0000","last_fullsized":"2024-03-16T20:56:04.513134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:43:29.560525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.528956+0000","last_change":"2024-03-16T20:56:04.528956+0000","last_active":"2024-03-16T20:56:04.528956+0000","last_peered":"2024-03-16T20:56:04.528956+0000","last_clean":"2024-03-16T20:56:04.528956+0000","last_became_active":"2024-03-16T20:56:04.528503+0000","last_became_peered":"2024-03-16T20:56:04.528503+0000","last_unstale":"2024-03-16T20:56:04.528956+0000","last_undegraded":"2024-03-16T20:56:04.528956+0000","last_fullsized":"2024-03-16T20:56:04.528956+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:48:36.267693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515262+0000","last_change":"2024-03-16T20:55:05.300207+0000","last_active":"2024-03-16T20:56:04.515262+0000","last_peered":"2024-03-16T20:56:04.515262+0000","last_clean":"2024-03-16T20:56:04.515262+0000","last_became_active":"2024-03-16T20:55:05.298892+0000","last_became_peered":"2024-03-16T20:55:05.298892+0000","last_unstale":"2024-03-16T20:56:04.515262+0000","last_undegraded":"2024-03-16T20:56:04.515262+0000","last_fullsized":"2024-03-16T20:56:04.515262+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:29.158690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512718+0000","last_change":"2024-03-16T20:55:05.272135+0000","last_active":"2024-03-16T20:56:04.512718+0000","last_peered":"2024-03-16T20:56:04.512718+0000","last_clean":"2024-03-16T20:56:04.512718+0000","last_became_active":"2024-03-16T20:55:05.271779+0000","last_became_peered":"2024-03-16T20:55:05.271779+0000","last_unstale":"2024-03-16T20:56:04.512718+0000","last_undegraded":"2024-03-16T20:56:04.512718+0000","last_fullsized":"2024-03-16T20:56:04.512718+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:42:58.085726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513919+0000","last_change":"2024-03-16T20:55:05.268810+0000","last_active":"2024-03-16T20:56:04.513919+0000","last_peered":"2024-03-16T20:56:04.513919+0000","last_clean":"2024-03-16T20:56:04.513919+0000","last_became_active":"2024-03-16T20:55:05.268473+0000","last_became_peered":"2024-03-16T20:55:05.268473+0000","last_unstale":"2024-03-16T20:56:04.513919+0000","last_undegraded":"2024-03-16T20:56:04.513919+0000","last_fullsized":"2024-03-16T20:56:04.513919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:48:00.990207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513019+0000","last_change":"2024-03-16T20:55:05.284121+0000","last_active":"2024-03-16T20:56:04.513019+0000","last_peered":"2024-03-16T20:56:04.513019+0000","last_clean":"2024-03-16T20:56:04.513019+0000","last_became_active":"2024-03-16T20:55:05.283588+0000","last_became_peered":"2024-03-16T20:55:05.283588+0000","last_unstale":"2024-03-16T20:56:04.513019+0000","last_undegraded":"2024-03-16T20:56:04.513019+0000","last_fullsized":"2024-03-16T20:56:04.513019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:05:56.679346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.527344+0000","last_change":"2024-03-16T20:56:04.525435+0000","last_active":"2024-03-16T20:56:04.527344+0000","last_peered":"2024-03-16T20:56:04.527344+0000","last_clean":"2024-03-16T20:56:04.527344+0000","last_became_active":"2024-03-16T20:56:04.524924+0000","last_became_peered":"2024-03-16T20:56:04.524924+0000","last_unstale":"2024-03-16T20:56:04.527344+0000","last_undegraded":"2024-03-16T20:56:04.527344+0000","last_fullsized":"2024-03-16T20:56:04.527344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:36:49.367824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.510068+0000","last_change":"2024-03-16T20:55:05.277957+0000","last_active":"2024-03-16T20:56:04.510068+0000","last_peered":"2024-03-16T20:56:04.510068+0000","last_clean":"2024-03-16T20:56:04.510068+0000","last_became_active":"2024-03-16T20:55:05.277610+0000","last_became_peered":"2024-03-16T20:55:05.277610+0000","last_unstale":"2024-03-16T20:56:04.510068+0000","last_undegraded":"2024-03-16T20:56:04.510068+0000","last_fullsized":"2024-03-16T20:56:04.510068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:54:29.010945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930101+0000","last_change":"2024-03-16T20:55:05.288112+0000","last_active":"2024-03-16T20:56:04.930101+0000","last_peered":"2024-03-16T20:56:04.930101+0000","last_clean":"2024-03-16T20:56:04.930101+0000","last_became_active":"2024-03-16T20:55:05.287791+0000","last_became_peered":"2024-03-16T20:55:05.287791+0000","last_unstale":"2024-03-16T20:56:04.930101+0000","last_undegraded":"2024-03-16T20:56:04.930101+0000","last_fullsized":"2024-03-16T20:56:04.930101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:55:57.625981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516416+0000","last_change":"2024-03-16T20:55:05.311327+0000","last_active":"2024-03-16T20:56:04.516416+0000","last_peered":"2024-03-16T20:56:04.516416+0000","last_clean":"2024-03-16T20:56:04.516416+0000","last_became_active":"2024-03-16T20:55:05.310820+0000","last_became_peered":"2024-03-16T20:55:05.310820+0000","last_unstale":"2024-03-16T20:56:04.516416+0000","last_undegraded":"2024-03-16T20:56:04.516416+0000","last_fullsized":"2024-03-16T20:56:04.516416+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:38:26.081078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513379+0000","last_change":"2024-03-16T20:55:05.277942+0000","last_active":"2024-03-16T20:56:04.513379+0000","last_peered":"2024-03-16T20:56:04.513379+0000","last_clean":"2024-03-16T20:56:04.513379+0000","last_became_active":"2024-03-16T20:55:05.277588+0000","last_became_peered":"2024-03-16T20:55:05.277588+0000","last_unstale":"2024-03-16T20:56:04.513379+0000","last_undegraded":"2024-03-16T20:56:04.513379+0000","last_fullsized":"2024-03-16T20:56:04.513379+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:32:38.464939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":211842,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67918,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":502,"num_read_kb":322,"num_write":162,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":203754,"data_compressed":5547,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351006,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":459360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612644,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":1115037,"data_compressed":37704,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776169,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":459601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037809,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":459292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1015808,"data_stored":1051334,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462970,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":458873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1015808,"data_stored":522583,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":460144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1040384,"data_stored":523933,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149771,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":459067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888135,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":459701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724609,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":1050627,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":63917,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65267,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65886,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T20:56:33.634 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph pg dump --format=json 2024-03-16T20:56:33.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:33 smithi186 ceph-mon[36391]: from='client.24901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:56:33.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:33 smithi008 ceph-mon[31434]: from='client.24901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:56:34.018 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:33 smithi170 ceph-mon[35947]: from='client.24901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:56:34.129 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:34.892 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:34 smithi186 ceph-mon[36391]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:34.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:34 smithi186 ceph-mon[36391]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-03-16T20:56:34.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:34 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:56:34.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:34 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:56:34.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:34 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:34.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:34 smithi008 ceph-mon[31434]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:34.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:34 smithi008 ceph-mon[31434]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-03-16T20:56:34.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:34 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:56:34.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:34 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:56:34.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:34 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:35.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:34 smithi170 ceph-mon[35947]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:35.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:34 smithi170 ceph-mon[35947]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-03-16T20:56:35.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:34 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:56:35.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:34 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:56:35.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:34 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:56:36.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.427+0000 7fa1f7e00700 1 -- 172.21.15.8:0/308316075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f8108530 msgr2=0x7fa1f81089b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:36.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.427+0000 7fa1f7e00700 1 --2- 172.21.15.8:0/308316075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f8108530 0x7fa1f81089b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000b0d0 tx=0x7fa1e000b3e0 comp rx=0 tx=0).stop 2024-03-16T20:56:36.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.427+0000 7fa1f7e00700 1 -- 172.21.15.8:0/308316075 shutdown_connections 2024-03-16T20:56:36.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.427+0000 7fa1f7e00700 1 --2- 172.21.15.8:0/308316075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f810e590 0x7fa1f810e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:36.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.427+0000 7fa1f7e00700 1 --2- 172.21.15.8:0/308316075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f8108ef0 0x7fa1f8115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:36.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.427+0000 7fa1f7e00700 1 --2- 172.21.15.8:0/308316075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f8108530 0x7fa1f81089b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:36.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.427+0000 7fa1f7e00700 1 -- 172.21.15.8:0/308316075 >> 172.21.15.8:0/308316075 conn(0x7fa1f8077c80 msgr2=0x7fa1f807a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:36.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.427+0000 7fa1f7e00700 1 -- 172.21.15.8:0/308316075 shutdown_connections 2024-03-16T20:56:36.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.428+0000 7fa1f7e00700 1 -- 172.21.15.8:0/308316075 wait complete. 2024-03-16T20:56:36.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.429+0000 7fa1f7e00700 1 Processor -- start 2024-03-16T20:56:36.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.429+0000 7fa1f7e00700 1 -- start start 2024-03-16T20:56:36.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.430+0000 7fa1f7e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f8108530 0x7fa1f81a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:36.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.430+0000 7fa1f7e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f8108ef0 0x7fa1f81a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:36.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.430+0000 7fa1f7e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f810e590 0x7fa1f819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:36.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.430+0000 7fa1f7e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f819f0a0 con 0x7fa1f810e590 2024-03-16T20:56:36.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.430+0000 7fa1f7e00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f819f1e0 con 0x7fa1f8108ef0 2024-03-16T20:56:36.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.430+0000 7fa1f7e00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f819f3a0 con 0x7fa1f8108530 2024-03-16T20:56:36.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.430+0000 7fa1f6a00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f8108530 0x7fa1f81a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:36.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.430+0000 7fa1f7400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f810e590 0x7fa1f819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:36.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.430+0000 7fa1f6a00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f8108530 0x7fa1f81a4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:43030/0 (socket says 172.21.15.8:43030) 2024-03-16T20:56:36.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.430+0000 7fa1f6a00700 1 -- 172.21.15.8:0/1357703174 learned_addr learned my addr 172.21.15.8:0/1357703174 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:36.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.430+0000 7fa1ee000700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f8108ef0 0x7fa1f81a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:36.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1f6a00700 1 -- 172.21.15.8:0/1357703174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f8108ef0 msgr2=0x7fa1f81a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:36.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1f6a00700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f8108ef0 0x7fa1f81a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:36.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1f6a00700 1 -- 172.21.15.8:0/1357703174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f810e590 msgr2=0x7fa1f819ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:36.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1f6a00700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f810e590 0x7fa1f819ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:36.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1f6a00700 1 -- 172.21.15.8:0/1357703174 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f0009520 con 0x7fa1f8108530 2024-03-16T20:56:36.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1ee000700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f8108ef0 0x7fa1f81a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:36.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1f6a00700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f8108530 0x7fa1f81a4880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800e9a0 tx=0x7fa1e800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:36.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1efe00700 1 -- 172.21.15.8:0/1357703174 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8009790 con 0x7fa1f8108530 2024-03-16T20:56:36.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1efe00700 1 -- 172.21.15.8:0/1357703174 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa1e8010430 con 0x7fa1f8108530 2024-03-16T20:56:36.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1f7e00700 1 -- 172.21.15.8:0/1357703174 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e0009d00 con 0x7fa1f8108530 2024-03-16T20:56:36.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1efe00700 1 -- 172.21.15.8:0/1357703174 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8018680 con 0x7fa1f8108530 2024-03-16T20:56:36.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.431+0000 7fa1f7e00700 1 -- 172.21.15.8:0/1357703174 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f81ab750 con 0x7fa1f8108530 2024-03-16T20:56:36.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.432+0000 7fa1f7e00700 1 -- 172.21.15.8:0/1357703174 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f8110a20 con 0x7fa1f8108530 2024-03-16T20:56:36.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.434+0000 7fa1efe00700 1 -- 172.21.15.8:0/1357703174 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fa1e80109a0 con 0x7fa1f8108530 2024-03-16T20:56:36.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.436+0000 7fa1efe00700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa1dc0a1b40 0x7fa1dc0a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:36.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.436+0000 7fa1efe00700 1 -- 172.21.15.8:0/1357703174 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa1e8014070 con 0x7fa1f8108530 2024-03-16T20:56:36.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.436+0000 7fa1ee000700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa1dc0a1b40 0x7fa1dc0a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:36.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.437+0000 7fa1ee000700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa1dc0a1b40 0x7fa1dc0a4000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009fd0 tx=0x7fa1e000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:36.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.443+0000 7fa1efe00700 1 -- 172.21.15.8:0/1357703174 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa1e8053280 con 0x7fa1f8108530 2024-03-16T20:56:36.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.666+0000 7fa1f7e00700 1 -- 172.21.15.8:0/1357703174 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1f819ff70 con 0x7fa1dc0a1b40 2024-03-16T20:56:36.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.690+0000 7fa1efe00700 1 -- 172.21.15.8:0/1357703174 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259007 (secure 0 0 0) 0x7fa1f819ff70 con 0x7fa1dc0a1b40 2024-03-16T20:56:36.694 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:36 smithi008 ceph-mon[31434]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T20:56:36.696 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.698+0000 7fa1f7e00700 1 -- 172.21.15.8:0/1357703174 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa1dc0a1b40 msgr2=0x7fa1dc0a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.698+0000 7fa1f7e00700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa1dc0a1b40 0x7fa1dc0a4000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009fd0 tx=0x7fa1e000b040 comp rx=0 tx=0).stop 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.698+0000 7fa1f7e00700 1 -- 172.21.15.8:0/1357703174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f8108530 msgr2=0x7fa1f81a4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.698+0000 7fa1f7e00700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f8108530 0x7fa1f81a4880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800e9a0 tx=0x7fa1e800ecb0 comp rx=0 tx=0).stop 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.698+0000 7fa1f7e00700 1 -- 172.21.15.8:0/1357703174 shutdown_connections 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.698+0000 7fa1f7e00700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa1dc0a1b40 0x7fa1dc0a4000 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.698+0000 7fa1f7e00700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f810e590 0x7fa1f819ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.698+0000 7fa1f7e00700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f8108530 0x7fa1f81a4880 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.698+0000 7fa1f7e00700 1 --2- 172.21.15.8:0/1357703174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f8108ef0 0x7fa1f81a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.698+0000 7fa1f7e00700 1 -- 172.21.15.8:0/1357703174 >> 172.21.15.8:0/1357703174 conn(0x7fa1f8077c80 msgr2=0x7fa1f8079300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.699+0000 7fa1f7e00700 1 -- 172.21.15.8:0/1357703174 shutdown_connections 2024-03-16T20:56:36.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:36.699+0000 7fa1f7e00700 1 -- 172.21.15.8:0/1357703174 wait complete. 2024-03-16T20:56:36.704 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-16T20:56:37.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:36 smithi170 ceph-mon[35947]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T20:56:37.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:36 smithi186 ceph-mon[36391]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T20:56:37.551 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2024-03-16T20:56:35.117067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658661,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":654,"num_read_kb":447,"num_write":348,"num_write_kb":3053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1180965,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365036,"kb_used_data":11664,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576788,"statfs":{"total":1151940427776,"available":1151566630912,"internally_reserved":0,"allocated":11943936,"data_stored":7479834,"data_compressed":113112,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004888"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512846+0000","last_change":"2024-03-16T20:55:05.301473+0000","last_active":"2024-03-16T20:56:04.512846+0000","last_peered":"2024-03-16T20:56:04.512846+0000","last_clean":"2024-03-16T20:56:04.512846+0000","last_became_active":"2024-03-16T20:55:05.301166+0000","last_became_peered":"2024-03-16T20:55:05.301166+0000","last_unstale":"2024-03-16T20:56:04.512846+0000","last_undegraded":"2024-03-16T20:56:04.512846+0000","last_fullsized":"2024-03-16T20:56:04.512846+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:06:51.838382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.527363+0000","last_change":"2024-03-16T20:55:05.295895+0000","last_active":"2024-03-16T20:56:04.527363+0000","last_peered":"2024-03-16T20:56:04.527363+0000","last_clean":"2024-03-16T20:56:04.527363+0000","last_became_active":"2024-03-16T20:55:05.295365+0000","last_became_peered":"2024-03-16T20:55:05.295365+0000","last_unstale":"2024-03-16T20:56:04.527363+0000","last_undegraded":"2024-03-16T20:56:04.527363+0000","last_fullsized":"2024-03-16T20:56:04.527363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:28:20.342348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.526932+0000","last_change":"2024-03-16T20:55:05.299049+0000","last_active":"2024-03-16T20:56:04.526932+0000","last_peered":"2024-03-16T20:56:04.526932+0000","last_clean":"2024-03-16T20:56:04.526932+0000","last_became_active":"2024-03-16T20:55:05.292758+0000","last_became_peered":"2024-03-16T20:55:05.292758+0000","last_unstale":"2024-03-16T20:56:04.526932+0000","last_undegraded":"2024-03-16T20:56:04.526932+0000","last_fullsized":"2024-03-16T20:56:04.526932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:20:36.276639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.073504+0000","last_change":"2024-03-16T20:55:05.274453+0000","last_active":"2024-03-16T20:56:33.073504+0000","last_peered":"2024-03-16T20:56:33.073504+0000","last_clean":"2024-03-16T20:56:33.073504+0000","last_became_active":"2024-03-16T20:55:05.273648+0000","last_became_peered":"2024-03-16T20:55:05.273648+0000","last_unstale":"2024-03-16T20:56:33.073504+0000","last_undegraded":"2024-03-16T20:56:33.073504+0000","last_fullsized":"2024-03-16T20:56:33.073504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:08:37.297906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.102846+0000","last_change":"2024-03-16T20:55:05.291272+0000","last_active":"2024-03-16T20:56:33.102846+0000","last_peered":"2024-03-16T20:56:33.102846+0000","last_clean":"2024-03-16T20:56:33.102846+0000","last_became_active":"2024-03-16T20:55:05.290788+0000","last_became_peered":"2024-03-16T20:55:05.290788+0000","last_unstale":"2024-03-16T20:56:33.102846+0000","last_undegraded":"2024-03-16T20:56:33.102846+0000","last_fullsized":"2024-03-16T20:56:33.102846+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:36:42.842797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513425+0000","last_change":"2024-03-16T20:55:05.289977+0000","last_active":"2024-03-16T20:56:04.513425+0000","last_peered":"2024-03-16T20:56:04.513425+0000","last_clean":"2024-03-16T20:56:04.513425+0000","last_became_active":"2024-03-16T20:55:05.289520+0000","last_became_peered":"2024-03-16T20:55:05.289520+0000","last_unstale":"2024-03-16T20:56:04.513425+0000","last_undegraded":"2024-03-16T20:56:04.513425+0000","last_fullsized":"2024-03-16T20:56:04.513425+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:25:49.270854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092814+0000","last_change":"2024-03-16T20:55:05.286244+0000","last_active":"2024-03-16T20:56:33.092814+0000","last_peered":"2024-03-16T20:56:33.092814+0000","last_clean":"2024-03-16T20:56:33.092814+0000","last_became_active":"2024-03-16T20:55:05.285871+0000","last_became_peered":"2024-03-16T20:55:05.285871+0000","last_unstale":"2024-03-16T20:56:33.092814+0000","last_undegraded":"2024-03-16T20:56:33.092814+0000","last_fullsized":"2024-03-16T20:56:33.092814+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:24:47.334046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.509069+0000","last_change":"2024-03-16T20:55:05.293902+0000","last_active":"2024-03-16T20:56:04.509069+0000","last_peered":"2024-03-16T20:56:04.509069+0000","last_clean":"2024-03-16T20:56:04.509069+0000","last_became_active":"2024-03-16T20:55:05.284424+0000","last_became_peered":"2024-03-16T20:55:05.284424+0000","last_unstale":"2024-03-16T20:56:04.509069+0000","last_undegraded":"2024-03-16T20:56:04.509069+0000","last_fullsized":"2024-03-16T20:56:04.509069+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:09:15.024337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929755+0000","last_change":"2024-03-16T20:55:05.271434+0000","last_active":"2024-03-16T20:56:04.929755+0000","last_peered":"2024-03-16T20:56:04.929755+0000","last_clean":"2024-03-16T20:56:04.929755+0000","last_became_active":"2024-03-16T20:55:05.271014+0000","last_became_peered":"2024-03-16T20:55:05.271014+0000","last_unstale":"2024-03-16T20:56:04.929755+0000","last_undegraded":"2024-03-16T20:56:04.929755+0000","last_fullsized":"2024-03-16T20:56:04.929755+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:09:47.133987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513693+0000","last_change":"2024-03-16T20:55:05.275108+0000","last_active":"2024-03-16T20:56:04.513693+0000","last_peered":"2024-03-16T20:56:04.513693+0000","last_clean":"2024-03-16T20:56:04.513693+0000","last_became_active":"2024-03-16T20:55:05.274659+0000","last_became_peered":"2024-03-16T20:55:05.274659+0000","last_unstale":"2024-03-16T20:56:04.513693+0000","last_undegraded":"2024-03-16T20:56:04.513693+0000","last_fullsized":"2024-03-16T20:56:04.513693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:10:16.801309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092679+0000","last_change":"2024-03-16T20:55:05.273322+0000","last_active":"2024-03-16T20:56:33.092679+0000","last_peered":"2024-03-16T20:56:33.092679+0000","last_clean":"2024-03-16T20:56:33.092679+0000","last_became_active":"2024-03-16T20:55:05.272999+0000","last_became_peered":"2024-03-16T20:55:05.272999+0000","last_unstale":"2024-03-16T20:56:33.092679+0000","last_undegraded":"2024-03-16T20:56:33.092679+0000","last_fullsized":"2024-03-16T20:56:33.092679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:49:43.426765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.082928+0000","last_change":"2024-03-16T20:55:05.274729+0000","last_active":"2024-03-16T20:56:33.082928+0000","last_peered":"2024-03-16T20:56:33.082928+0000","last_clean":"2024-03-16T20:56:33.082928+0000","last_became_active":"2024-03-16T20:55:05.274131+0000","last_became_peered":"2024-03-16T20:55:05.274131+0000","last_unstale":"2024-03-16T20:56:33.082928+0000","last_undegraded":"2024-03-16T20:56:33.082928+0000","last_fullsized":"2024-03-16T20:56:33.082928+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:59:43.413956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.522061+0000","last_change":"2024-03-16T20:56:04.522061+0000","last_active":"2024-03-16T20:56:04.522061+0000","last_peered":"2024-03-16T20:56:04.522061+0000","last_clean":"2024-03-16T20:56:04.522061+0000","last_became_active":"2024-03-16T20:56:04.521622+0000","last_became_peered":"2024-03-16T20:56:04.521622+0000","last_unstale":"2024-03-16T20:56:04.522061+0000","last_undegraded":"2024-03-16T20:56:04.522061+0000","last_fullsized":"2024-03-16T20:56:04.522061+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:00:52.309217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.523958+0000","last_change":"2024-03-16T20:55:05.282707+0000","last_active":"2024-03-16T20:56:04.523958+0000","last_peered":"2024-03-16T20:56:04.523958+0000","last_clean":"2024-03-16T20:56:04.523958+0000","last_became_active":"2024-03-16T20:55:05.282168+0000","last_became_peered":"2024-03-16T20:55:05.282168+0000","last_unstale":"2024-03-16T20:56:04.523958+0000","last_undegraded":"2024-03-16T20:56:04.523958+0000","last_fullsized":"2024-03-16T20:56:04.523958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:33:59.464303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.524056+0000","last_change":"2024-03-16T20:55:05.290291+0000","last_active":"2024-03-16T20:56:04.524056+0000","last_peered":"2024-03-16T20:56:04.524056+0000","last_clean":"2024-03-16T20:56:04.524056+0000","last_became_active":"2024-03-16T20:55:05.289952+0000","last_became_peered":"2024-03-16T20:55:05.289952+0000","last_unstale":"2024-03-16T20:56:04.524056+0000","last_undegraded":"2024-03-16T20:56:04.524056+0000","last_fullsized":"2024-03-16T20:56:04.524056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:05.334408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929339+0000","last_change":"2024-03-16T20:55:05.284252+0000","last_active":"2024-03-16T20:56:04.929339+0000","last_peered":"2024-03-16T20:56:04.929339+0000","last_clean":"2024-03-16T20:56:04.929339+0000","last_became_active":"2024-03-16T20:55:05.283804+0000","last_became_peered":"2024-03-16T20:55:05.283804+0000","last_unstale":"2024-03-16T20:56:04.929339+0000","last_undegraded":"2024-03-16T20:56:04.929339+0000","last_fullsized":"2024-03-16T20:56:04.929339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:03:17.942719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512937+0000","last_change":"2024-03-16T20:55:05.296118+0000","last_active":"2024-03-16T20:56:04.512937+0000","last_peered":"2024-03-16T20:56:04.512937+0000","last_clean":"2024-03-16T20:56:04.512937+0000","last_became_active":"2024-03-16T20:55:05.295783+0000","last_became_peered":"2024-03-16T20:55:05.295783+0000","last_unstale":"2024-03-16T20:56:04.512937+0000","last_undegraded":"2024-03-16T20:56:04.512937+0000","last_fullsized":"2024-03-16T20:56:04.512937+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:36:15.463748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.103325+0000","last_change":"2024-03-16T20:55:05.287221+0000","last_active":"2024-03-16T20:56:33.103325+0000","last_peered":"2024-03-16T20:56:33.103325+0000","last_clean":"2024-03-16T20:56:33.103325+0000","last_became_active":"2024-03-16T20:55:05.286553+0000","last_became_peered":"2024-03-16T20:55:05.286553+0000","last_unstale":"2024-03-16T20:56:33.103325+0000","last_undegraded":"2024-03-16T20:56:33.103325+0000","last_fullsized":"2024-03-16T20:56:33.103325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:33:25.688231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513629+0000","last_change":"2024-03-16T20:55:05.280111+0000","last_active":"2024-03-16T20:56:04.513629+0000","last_peered":"2024-03-16T20:56:04.513629+0000","last_clean":"2024-03-16T20:56:04.513629+0000","last_became_active":"2024-03-16T20:55:05.279857+0000","last_became_peered":"2024-03-16T20:55:05.279857+0000","last_unstale":"2024-03-16T20:56:04.513629+0000","last_undegraded":"2024-03-16T20:56:04.513629+0000","last_fullsized":"2024-03-16T20:56:04.513629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:57:18.205253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516250+0000","last_change":"2024-03-16T20:55:04.268836+0000","last_active":"2024-03-16T20:56:04.516250+0000","last_peered":"2024-03-16T20:56:04.516250+0000","last_clean":"2024-03-16T20:56:04.516250+0000","last_became_active":"2024-03-16T20:55:04.266502+0000","last_became_peered":"2024-03-16T20:55:04.266502+0000","last_unstale":"2024-03-16T20:56:04.516250+0000","last_undegraded":"2024-03-16T20:56:04.516250+0000","last_fullsized":"2024-03-16T20:56:04.516250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:12:33.717454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513612+0000","last_change":"2024-03-16T20:55:05.280158+0000","last_active":"2024-03-16T20:56:04.513612+0000","last_peered":"2024-03-16T20:56:04.513612+0000","last_clean":"2024-03-16T20:56:04.513612+0000","last_became_active":"2024-03-16T20:55:05.278918+0000","last_became_peered":"2024-03-16T20:55:05.278918+0000","last_unstale":"2024-03-16T20:56:04.513612+0000","last_undegraded":"2024-03-16T20:56:04.513612+0000","last_fullsized":"2024-03-16T20:56:04.513612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:27:34.158596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513307+0000","last_change":"2024-03-16T20:55:04.283366+0000","last_active":"2024-03-16T20:56:04.513307+0000","last_peered":"2024-03-16T20:56:04.513307+0000","last_clean":"2024-03-16T20:56:04.513307+0000","last_became_active":"2024-03-16T20:55:04.283016+0000","last_became_peered":"2024-03-16T20:55:04.283016+0000","last_unstale":"2024-03-16T20:56:04.513307+0000","last_undegraded":"2024-03-16T20:56:04.513307+0000","last_fullsized":"2024-03-16T20:56:04.513307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:41.163294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.525943+0000","last_change":"2024-03-16T20:55:05.299005+0000","last_active":"2024-03-16T20:56:04.525943+0000","last_peered":"2024-03-16T20:56:04.525943+0000","last_clean":"2024-03-16T20:56:04.525943+0000","last_became_active":"2024-03-16T20:55:05.296527+0000","last_became_peered":"2024-03-16T20:55:05.296527+0000","last_unstale":"2024-03-16T20:56:04.525943+0000","last_undegraded":"2024-03-16T20:56:04.525943+0000","last_fullsized":"2024-03-16T20:56:04.525943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:56:51.451900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515248+0000","last_change":"2024-03-16T20:55:04.259210+0000","last_active":"2024-03-16T20:56:04.515248+0000","last_peered":"2024-03-16T20:56:04.515248+0000","last_clean":"2024-03-16T20:56:04.515248+0000","last_became_active":"2024-03-16T20:55:04.258828+0000","last_became_peered":"2024-03-16T20:55:04.258828+0000","last_unstale":"2024-03-16T20:56:04.515248+0000","last_undegraded":"2024-03-16T20:56:04.515248+0000","last_fullsized":"2024-03-16T20:56:04.515248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:21:14.497086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929486+0000","last_change":"2024-03-16T20:55:05.272053+0000","last_active":"2024-03-16T20:56:04.929486+0000","last_peered":"2024-03-16T20:56:04.929486+0000","last_clean":"2024-03-16T20:56:04.929486+0000","last_became_active":"2024-03-16T20:55:05.271435+0000","last_became_peered":"2024-03-16T20:55:05.271435+0000","last_unstale":"2024-03-16T20:56:04.929486+0000","last_undegraded":"2024-03-16T20:56:04.929486+0000","last_fullsized":"2024-03-16T20:56:04.929486+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:08:47.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514977+0000","last_change":"2024-03-16T20:55:04.261051+0000","last_active":"2024-03-16T20:56:04.514977+0000","last_peered":"2024-03-16T20:56:04.514977+0000","last_clean":"2024-03-16T20:56:04.514977+0000","last_became_active":"2024-03-16T20:55:04.260701+0000","last_became_peered":"2024-03-16T20:55:04.260701+0000","last_unstale":"2024-03-16T20:56:04.514977+0000","last_undegraded":"2024-03-16T20:56:04.514977+0000","last_fullsized":"2024-03-16T20:56:04.514977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:30:05.233891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.099430+0000","last_change":"2024-03-16T20:55:05.270047+0000","last_active":"2024-03-16T20:56:33.099430+0000","last_peered":"2024-03-16T20:56:33.099430+0000","last_clean":"2024-03-16T20:56:33.099430+0000","last_became_active":"2024-03-16T20:55:05.269045+0000","last_became_peered":"2024-03-16T20:55:05.269045+0000","last_unstale":"2024-03-16T20:56:33.099430+0000","last_undegraded":"2024-03-16T20:56:33.099430+0000","last_fullsized":"2024-03-16T20:56:33.099430+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:54:19.289648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":109,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:31.448206+0000","last_change":"2024-03-16T20:55:04.258871+0000","last_active":"2024-03-16T20:56:31.448206+0000","last_peered":"2024-03-16T20:56:31.448206+0000","last_clean":"2024-03-16T20:56:31.448206+0000","last_became_active":"2024-03-16T20:55:04.258462+0000","last_became_peered":"2024-03-16T20:55:04.258462+0000","last_unstale":"2024-03-16T20:56:31.448206+0000","last_undegraded":"2024-03-16T20:56:31.448206+0000","last_fullsized":"2024-03-16T20:56:31.448206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:16:29.832814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.086810+0000","last_change":"2024-03-16T20:55:05.290789+0000","last_active":"2024-03-16T20:56:33.086810+0000","last_peered":"2024-03-16T20:56:33.086810+0000","last_clean":"2024-03-16T20:56:33.086810+0000","last_became_active":"2024-03-16T20:55:05.290367+0000","last_became_peered":"2024-03-16T20:55:05.290367+0000","last_unstale":"2024-03-16T20:56:33.086810+0000","last_undegraded":"2024-03-16T20:56:33.086810+0000","last_fullsized":"2024-03-16T20:56:33.086810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:23:38.509837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513422+0000","last_change":"2024-03-16T20:55:04.264980+0000","last_active":"2024-03-16T20:56:04.513422+0000","last_peered":"2024-03-16T20:56:04.513422+0000","last_clean":"2024-03-16T20:56:04.513422+0000","last_became_active":"2024-03-16T20:55:04.264634+0000","last_became_peered":"2024-03-16T20:55:04.264634+0000","last_unstale":"2024-03-16T20:56:04.513422+0000","last_undegraded":"2024-03-16T20:56:04.513422+0000","last_fullsized":"2024-03-16T20:56:04.513422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:16:52.713847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.111066+0000","last_change":"2024-03-16T20:55:05.286139+0000","last_active":"2024-03-16T20:56:33.111066+0000","last_peered":"2024-03-16T20:56:33.111066+0000","last_clean":"2024-03-16T20:56:33.111066+0000","last_became_active":"2024-03-16T20:55:05.285751+0000","last_became_peered":"2024-03-16T20:55:05.285751+0000","last_unstale":"2024-03-16T20:56:33.111066+0000","last_undegraded":"2024-03-16T20:56:33.111066+0000","last_fullsized":"2024-03-16T20:56:33.111066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:01:02.448785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.517679+0000","last_change":"2024-03-16T20:55:04.282416+0000","last_active":"2024-03-16T20:56:04.517679+0000","last_peered":"2024-03-16T20:56:04.517679+0000","last_clean":"2024-03-16T20:56:04.517679+0000","last_became_active":"2024-03-16T20:55:04.280504+0000","last_became_peered":"2024-03-16T20:55:04.280504+0000","last_unstale":"2024-03-16T20:56:04.517679+0000","last_undegraded":"2024-03-16T20:56:04.517679+0000","last_fullsized":"2024-03-16T20:56:04.517679+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:23.940976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.509431+0000","last_change":"2024-03-16T20:55:05.289210+0000","last_active":"2024-03-16T20:56:04.509431+0000","last_peered":"2024-03-16T20:56:04.509431+0000","last_clean":"2024-03-16T20:56:04.509431+0000","last_became_active":"2024-03-16T20:55:05.286738+0000","last_became_peered":"2024-03-16T20:55:05.286738+0000","last_unstale":"2024-03-16T20:56:04.509431+0000","last_undegraded":"2024-03-16T20:56:04.509431+0000","last_fullsized":"2024-03-16T20:56:04.509431+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:43:45.266727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605215+0000","last_change":"2024-03-16T20:55:04.258925+0000","last_active":"2024-03-16T20:56:04.605215+0000","last_peered":"2024-03-16T20:56:04.605215+0000","last_clean":"2024-03-16T20:56:04.605215+0000","last_became_active":"2024-03-16T20:55:04.258578+0000","last_became_peered":"2024-03-16T20:55:04.258578+0000","last_unstale":"2024-03-16T20:56:04.605215+0000","last_undegraded":"2024-03-16T20:56:04.605215+0000","last_fullsized":"2024-03-16T20:56:04.605215+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:52.812547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.120954+0000","last_change":"2024-03-16T20:55:05.302122+0000","last_active":"2024-03-16T20:56:33.120954+0000","last_peered":"2024-03-16T20:56:33.120954+0000","last_clean":"2024-03-16T20:56:33.120954+0000","last_became_active":"2024-03-16T20:55:05.301743+0000","last_became_peered":"2024-03-16T20:55:05.301743+0000","last_unstale":"2024-03-16T20:56:33.120954+0000","last_undegraded":"2024-03-16T20:56:33.120954+0000","last_fullsized":"2024-03-16T20:56:33.120954+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:32:51.691780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:28.444775+0000","last_change":"2024-03-16T20:55:04.270015+0000","last_active":"2024-03-16T20:56:28.444775+0000","last_peered":"2024-03-16T20:56:28.444775+0000","last_clean":"2024-03-16T20:56:28.444775+0000","last_became_active":"2024-03-16T20:55:04.269563+0000","last_became_peered":"2024-03-16T20:55:04.269563+0000","last_unstale":"2024-03-16T20:56:28.444775+0000","last_undegraded":"2024-03-16T20:56:28.444775+0000","last_fullsized":"2024-03-16T20:56:28.444775+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:39:21.768540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929992+0000","last_change":"2024-03-16T20:55:05.290639+0000","last_active":"2024-03-16T20:56:04.929992+0000","last_peered":"2024-03-16T20:56:04.929992+0000","last_clean":"2024-03-16T20:56:04.929992+0000","last_became_active":"2024-03-16T20:55:05.290255+0000","last_became_peered":"2024-03-16T20:55:05.290255+0000","last_unstale":"2024-03-16T20:56:04.929992+0000","last_undegraded":"2024-03-16T20:56:04.929992+0000","last_fullsized":"2024-03-16T20:56:04.929992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:36:13.303557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930519+0000","last_change":"2024-03-16T20:55:04.260407+0000","last_active":"2024-03-16T20:56:04.930519+0000","last_peered":"2024-03-16T20:56:04.930519+0000","last_clean":"2024-03-16T20:56:04.930519+0000","last_became_active":"2024-03-16T20:55:04.259817+0000","last_became_peered":"2024-03-16T20:55:04.259817+0000","last_unstale":"2024-03-16T20:56:04.930519+0000","last_undegraded":"2024-03-16T20:56:04.930519+0000","last_fullsized":"2024-03-16T20:56:04.930519+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:07.995508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.525812+0000","last_change":"2024-03-16T20:55:05.295327+0000","last_active":"2024-03-16T20:56:04.525812+0000","last_peered":"2024-03-16T20:56:04.525812+0000","last_clean":"2024-03-16T20:56:04.525812+0000","last_became_active":"2024-03-16T20:55:05.294948+0000","last_became_peered":"2024-03-16T20:55:05.294948+0000","last_unstale":"2024-03-16T20:56:04.525812+0000","last_undegraded":"2024-03-16T20:56:04.525812+0000","last_fullsized":"2024-03-16T20:56:04.525812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:29.305366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605588+0000","last_change":"2024-03-16T20:55:04.264571+0000","last_active":"2024-03-16T20:56:04.605588+0000","last_peered":"2024-03-16T20:56:04.605588+0000","last_clean":"2024-03-16T20:56:04.605588+0000","last_became_active":"2024-03-16T20:55:04.264200+0000","last_became_peered":"2024-03-16T20:55:04.264200+0000","last_unstale":"2024-03-16T20:56:04.605588+0000","last_undegraded":"2024-03-16T20:56:04.605588+0000","last_fullsized":"2024-03-16T20:56:04.605588+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:38:58.457250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929587+0000","last_change":"2024-03-16T20:55:05.272855+0000","last_active":"2024-03-16T20:56:04.929587+0000","last_peered":"2024-03-16T20:56:04.929587+0000","last_clean":"2024-03-16T20:56:04.929587+0000","last_became_active":"2024-03-16T20:55:05.272500+0000","last_became_peered":"2024-03-16T20:55:05.272500+0000","last_unstale":"2024-03-16T20:56:04.929587+0000","last_undegraded":"2024-03-16T20:56:04.929587+0000","last_fullsized":"2024-03-16T20:56:04.929587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:50:17.121966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'32","reported_seq":220,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:29.445690+0000","last_change":"2024-03-16T20:55:04.260050+0000","last_active":"2024-03-16T20:56:29.445690+0000","last_peered":"2024-03-16T20:56:29.445690+0000","last_clean":"2024-03-16T20:56:29.445690+0000","last_became_active":"2024-03-16T20:55:04.259662+0000","last_became_peered":"2024-03-16T20:55:04.259662+0000","last_unstale":"2024-03-16T20:56:29.445690+0000","last_undegraded":"2024-03-16T20:56:29.445690+0000","last_fullsized":"2024-03-16T20:56:29.445690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:45:46.999980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63917,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":169,"num_read_kb":146,"num_write":33,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.090644+0000","last_change":"2024-03-16T20:55:05.272337+0000","last_active":"2024-03-16T20:56:33.090644+0000","last_peered":"2024-03-16T20:56:33.090644+0000","last_clean":"2024-03-16T20:56:33.090644+0000","last_became_active":"2024-03-16T20:55:05.271761+0000","last_became_peered":"2024-03-16T20:55:05.271761+0000","last_unstale":"2024-03-16T20:56:33.090644+0000","last_undegraded":"2024-03-16T20:56:33.090644+0000","last_fullsized":"2024-03-16T20:56:33.090644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:50:22.079709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513362+0000","last_change":"2024-03-16T20:55:04.275606+0000","last_active":"2024-03-16T20:56:04.513362+0000","last_peered":"2024-03-16T20:56:04.513362+0000","last_clean":"2024-03-16T20:56:04.513362+0000","last_became_active":"2024-03-16T20:55:04.275268+0000","last_became_peered":"2024-03-16T20:55:04.275268+0000","last_unstale":"2024-03-16T20:56:04.513362+0000","last_undegraded":"2024-03-16T20:56:04.513362+0000","last_fullsized":"2024-03-16T20:56:04.513362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:27:34.248831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515315+0000","last_change":"2024-03-16T20:55:05.290619+0000","last_active":"2024-03-16T20:56:04.515315+0000","last_peered":"2024-03-16T20:56:04.515315+0000","last_clean":"2024-03-16T20:56:04.515315+0000","last_became_active":"2024-03-16T20:55:05.289943+0000","last_became_peered":"2024-03-16T20:55:05.289943+0000","last_unstale":"2024-03-16T20:56:04.515315+0000","last_undegraded":"2024-03-16T20:56:04.515315+0000","last_fullsized":"2024-03-16T20:56:04.515315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:30.569777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605239+0000","last_change":"2024-03-16T20:55:04.274206+0000","last_active":"2024-03-16T20:56:04.605239+0000","last_peered":"2024-03-16T20:56:04.605239+0000","last_clean":"2024-03-16T20:56:04.605239+0000","last_became_active":"2024-03-16T20:55:04.273834+0000","last_became_peered":"2024-03-16T20:55:04.273834+0000","last_unstale":"2024-03-16T20:56:04.605239+0000","last_undegraded":"2024-03-16T20:56:04.605239+0000","last_fullsized":"2024-03-16T20:56:04.605239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:36:04.720463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.124927+0000","last_change":"2024-03-16T20:55:05.280265+0000","last_active":"2024-03-16T20:56:33.124927+0000","last_peered":"2024-03-16T20:56:33.124927+0000","last_clean":"2024-03-16T20:56:33.124927+0000","last_became_active":"2024-03-16T20:55:05.279774+0000","last_became_peered":"2024-03-16T20:55:05.279774+0000","last_unstale":"2024-03-16T20:56:33.124927+0000","last_undegraded":"2024-03-16T20:56:33.124927+0000","last_fullsized":"2024-03-16T20:56:33.124927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:34:52.855290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":112,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.491843+0000","last_change":"2024-03-16T20:55:04.256314+0000","last_active":"2024-03-16T20:56:33.491843+0000","last_peered":"2024-03-16T20:56:33.491843+0000","last_clean":"2024-03-16T20:56:33.491843+0000","last_became_active":"2024-03-16T20:55:04.255940+0000","last_became_peered":"2024-03-16T20:55:04.255940+0000","last_unstale":"2024-03-16T20:56:33.491843+0000","last_undegraded":"2024-03-16T20:56:33.491843+0000","last_fullsized":"2024-03-16T20:56:33.491843+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:27:09.660107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.093217+0000","last_change":"2024-03-16T20:55:05.271562+0000","last_active":"2024-03-16T20:56:33.093217+0000","last_peered":"2024-03-16T20:56:33.093217+0000","last_clean":"2024-03-16T20:56:33.093217+0000","last_became_active":"2024-03-16T20:55:05.271214+0000","last_became_peered":"2024-03-16T20:55:05.271214+0000","last_unstale":"2024-03-16T20:56:33.093217+0000","last_undegraded":"2024-03-16T20:56:33.093217+0000","last_fullsized":"2024-03-16T20:56:33.093217+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:42:35.104345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.537648+0000","last_change":"2024-03-16T20:56:04.537276+0000","last_active":"2024-03-16T20:56:04.537648+0000","last_peered":"2024-03-16T20:56:04.537648+0000","last_clean":"2024-03-16T20:56:04.537648+0000","last_became_active":"2024-03-16T20:56:04.526059+0000","last_became_peered":"2024-03-16T20:56:04.526059+0000","last_unstale":"2024-03-16T20:56:04.537648+0000","last_undegraded":"2024-03-16T20:56:04.537648+0000","last_fullsized":"2024-03-16T20:56:04.537648+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:17:50.898269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.098794+0000","last_change":"2024-03-16T20:55:05.269751+0000","last_active":"2024-03-16T20:56:33.098794+0000","last_peered":"2024-03-16T20:56:33.098794+0000","last_clean":"2024-03-16T20:56:33.098794+0000","last_became_active":"2024-03-16T20:55:05.269375+0000","last_became_peered":"2024-03-16T20:55:05.269375+0000","last_unstale":"2024-03-16T20:56:33.098794+0000","last_undegraded":"2024-03-16T20:56:33.098794+0000","last_fullsized":"2024-03-16T20:56:33.098794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:57:00.751155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515245+0000","last_change":"2024-03-16T20:55:04.254352+0000","last_active":"2024-03-16T20:56:04.515245+0000","last_peered":"2024-03-16T20:56:04.515245+0000","last_clean":"2024-03-16T20:56:04.515245+0000","last_became_active":"2024-03-16T20:55:04.253895+0000","last_became_peered":"2024-03-16T20:55:04.253895+0000","last_unstale":"2024-03-16T20:56:04.515245+0000","last_undegraded":"2024-03-16T20:56:04.515245+0000","last_fullsized":"2024-03-16T20:56:04.515245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:35:15.796341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512697+0000","last_change":"2024-03-16T20:55:05.271148+0000","last_active":"2024-03-16T20:56:04.512697+0000","last_peered":"2024-03-16T20:56:04.512697+0000","last_clean":"2024-03-16T20:56:04.512697+0000","last_became_active":"2024-03-16T20:55:05.270836+0000","last_became_peered":"2024-03-16T20:55:05.270836+0000","last_unstale":"2024-03-16T20:56:04.512697+0000","last_undegraded":"2024-03-16T20:56:04.512697+0000","last_fullsized":"2024-03-16T20:56:04.512697+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:12:49.526828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516116+0000","last_change":"2024-03-16T20:55:04.277152+0000","last_active":"2024-03-16T20:56:04.516116+0000","last_peered":"2024-03-16T20:56:04.516116+0000","last_clean":"2024-03-16T20:56:04.516116+0000","last_became_active":"2024-03-16T20:55:04.276666+0000","last_became_peered":"2024-03-16T20:55:04.276666+0000","last_unstale":"2024-03-16T20:56:04.516116+0000","last_undegraded":"2024-03-16T20:56:04.516116+0000","last_fullsized":"2024-03-16T20:56:04.516116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:39:04.919957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.529323+0000","last_change":"2024-03-16T20:56:04.529323+0000","last_active":"2024-03-16T20:56:04.529323+0000","last_peered":"2024-03-16T20:56:04.529323+0000","last_clean":"2024-03-16T20:56:04.529323+0000","last_became_active":"2024-03-16T20:56:04.521484+0000","last_became_peered":"2024-03-16T20:56:04.521484+0000","last_unstale":"2024-03-16T20:56:04.529323+0000","last_undegraded":"2024-03-16T20:56:04.529323+0000","last_fullsized":"2024-03-16T20:56:04.529323+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:00:31.203774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930092+0000","last_change":"2024-03-16T20:55:04.270960+0000","last_active":"2024-03-16T20:56:04.930092+0000","last_peered":"2024-03-16T20:56:04.930092+0000","last_clean":"2024-03-16T20:56:04.930092+0000","last_became_active":"2024-03-16T20:55:04.270605+0000","last_became_peered":"2024-03-16T20:55:04.270605+0000","last_unstale":"2024-03-16T20:56:04.930092+0000","last_undegraded":"2024-03-16T20:56:04.930092+0000","last_fullsized":"2024-03-16T20:56:04.930092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:06:53.529116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513667+0000","last_change":"2024-03-16T20:55:05.303690+0000","last_active":"2024-03-16T20:56:04.513667+0000","last_peered":"2024-03-16T20:56:04.513667+0000","last_clean":"2024-03-16T20:56:04.513667+0000","last_became_active":"2024-03-16T20:55:05.303096+0000","last_became_peered":"2024-03-16T20:55:05.303096+0000","last_unstale":"2024-03-16T20:56:04.513667+0000","last_undegraded":"2024-03-16T20:56:04.513667+0000","last_fullsized":"2024-03-16T20:56:04.513667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:03:25.139693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.081319+0000","last_change":"2024-03-16T20:55:05.268277+0000","last_active":"2024-03-16T20:56:33.081319+0000","last_peered":"2024-03-16T20:56:33.081319+0000","last_clean":"2024-03-16T20:56:33.081319+0000","last_became_active":"2024-03-16T20:55:05.267955+0000","last_became_peered":"2024-03-16T20:55:05.267955+0000","last_unstale":"2024-03-16T20:56:33.081319+0000","last_undegraded":"2024-03-16T20:56:33.081319+0000","last_fullsized":"2024-03-16T20:56:33.081319+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:20:21.633055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":106,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:31.488000+0000","last_change":"2024-03-16T20:55:04.277286+0000","last_active":"2024-03-16T20:56:31.488000+0000","last_peered":"2024-03-16T20:56:31.488000+0000","last_clean":"2024-03-16T20:56:31.488000+0000","last_became_active":"2024-03-16T20:55:04.276855+0000","last_became_peered":"2024-03-16T20:55:04.276855+0000","last_unstale":"2024-03-16T20:56:31.488000+0000","last_undegraded":"2024-03-16T20:56:31.488000+0000","last_fullsized":"2024-03-16T20:56:31.488000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:22:19.590782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512552+0000","last_change":"2024-03-16T20:55:05.280255+0000","last_active":"2024-03-16T20:56:04.512552+0000","last_peered":"2024-03-16T20:56:04.512552+0000","last_clean":"2024-03-16T20:56:04.512552+0000","last_became_active":"2024-03-16T20:55:05.279762+0000","last_became_peered":"2024-03-16T20:55:05.279762+0000","last_unstale":"2024-03-16T20:56:04.512552+0000","last_undegraded":"2024-03-16T20:56:04.512552+0000","last_fullsized":"2024-03-16T20:56:04.512552+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:31.687047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903822+0000","last_change":"2024-03-16T20:55:04.263605+0000","last_active":"2024-03-16T20:56:04.903822+0000","last_peered":"2024-03-16T20:56:04.903822+0000","last_clean":"2024-03-16T20:56:04.903822+0000","last_became_active":"2024-03-16T20:55:04.263189+0000","last_became_peered":"2024-03-16T20:55:04.263189+0000","last_unstale":"2024-03-16T20:56:04.903822+0000","last_undegraded":"2024-03-16T20:56:04.903822+0000","last_fullsized":"2024-03-16T20:56:04.903822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:28:11.377134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":352,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930006+0000","last_change":"2024-03-16T20:53:44.281432+0000","last_active":"2024-03-16T20:56:04.930006+0000","last_peered":"2024-03-16T20:56:04.930006+0000","last_clean":"2024-03-16T20:56:04.930006+0000","last_became_active":"2024-03-16T20:53:44.280927+0000","last_became_peered":"2024-03-16T20:53:44.280927+0000","last_unstale":"2024-03-16T20:56:04.930006+0000","last_undegraded":"2024-03-16T20:56:04.930006+0000","last_fullsized":"2024-03-16T20:56:04.930006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_clean_scrub_stamp":"2024-03-16T20:49:51.705234+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:01:00.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.525541+0000","last_change":"2024-03-16T20:56:04.525541+0000","last_active":"2024-03-16T20:56:04.525541+0000","last_peered":"2024-03-16T20:56:04.525541+0000","last_clean":"2024-03-16T20:56:04.525541+0000","last_became_active":"2024-03-16T20:56:04.522548+0000","last_became_peered":"2024-03-16T20:56:04.522548+0000","last_unstale":"2024-03-16T20:56:04.525541+0000","last_undegraded":"2024-03-16T20:56:04.525541+0000","last_fullsized":"2024-03-16T20:56:04.525541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:35:54.115845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930068+0000","last_change":"2024-03-16T20:55:04.256842+0000","last_active":"2024-03-16T20:56:04.930068+0000","last_peered":"2024-03-16T20:56:04.930068+0000","last_clean":"2024-03-16T20:56:04.930068+0000","last_became_active":"2024-03-16T20:55:04.256493+0000","last_became_peered":"2024-03-16T20:55:04.256493+0000","last_unstale":"2024-03-16T20:56:04.930068+0000","last_undegraded":"2024-03-16T20:56:04.930068+0000","last_fullsized":"2024-03-16T20:56:04.930068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:08.836034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515097+0000","last_change":"2024-03-16T20:55:04.265503+0000","last_active":"2024-03-16T20:56:04.515097+0000","last_peered":"2024-03-16T20:56:04.515097+0000","last_clean":"2024-03-16T20:56:04.515097+0000","last_became_active":"2024-03-16T20:55:04.265017+0000","last_became_peered":"2024-03-16T20:55:04.265017+0000","last_unstale":"2024-03-16T20:56:04.515097+0000","last_undegraded":"2024-03-16T20:56:04.515097+0000","last_fullsized":"2024-03-16T20:56:04.515097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:28.485079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515090+0000","last_change":"2024-03-16T20:55:05.289100+0000","last_active":"2024-03-16T20:56:04.515090+0000","last_peered":"2024-03-16T20:56:04.515090+0000","last_clean":"2024-03-16T20:56:04.515090+0000","last_became_active":"2024-03-16T20:55:05.288122+0000","last_became_peered":"2024-03-16T20:55:05.288122+0000","last_unstale":"2024-03-16T20:56:04.515090+0000","last_undegraded":"2024-03-16T20:56:04.515090+0000","last_fullsized":"2024-03-16T20:56:04.515090+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:03.222038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'10","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516731+0000","last_change":"2024-03-16T20:55:04.282230+0000","last_active":"2024-03-16T20:56:04.516731+0000","last_peered":"2024-03-16T20:56:04.516731+0000","last_clean":"2024-03-16T20:56:04.516731+0000","last_became_active":"2024-03-16T20:55:04.281917+0000","last_became_peered":"2024-03-16T20:55:04.281917+0000","last_unstale":"2024-03-16T20:56:04.516731+0000","last_undegraded":"2024-03-16T20:56:04.516731+0000","last_fullsized":"2024-03-16T20:56:04.516731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:18:36.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514180+0000","last_change":"2024-03-16T20:55:05.293378+0000","last_active":"2024-03-16T20:56:04.514180+0000","last_peered":"2024-03-16T20:56:04.514180+0000","last_clean":"2024-03-16T20:56:04.514180+0000","last_became_active":"2024-03-16T20:55:05.288648+0000","last_became_peered":"2024-03-16T20:55:05.288648+0000","last_unstale":"2024-03-16T20:56:04.514180+0000","last_undegraded":"2024-03-16T20:56:04.514180+0000","last_fullsized":"2024-03-16T20:56:04.514180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:37:58.270760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903946+0000","last_change":"2024-03-16T20:55:04.268766+0000","last_active":"2024-03-16T20:56:04.903946+0000","last_peered":"2024-03-16T20:56:04.903946+0000","last_clean":"2024-03-16T20:56:04.903946+0000","last_became_active":"2024-03-16T20:55:04.268429+0000","last_became_peered":"2024-03-16T20:55:04.268429+0000","last_unstale":"2024-03-16T20:56:04.903946+0000","last_undegraded":"2024-03-16T20:56:04.903946+0000","last_fullsized":"2024-03-16T20:56:04.903946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:43.872155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.527529+0000","last_change":"2024-03-16T20:55:05.310349+0000","last_active":"2024-03-16T20:56:04.527529+0000","last_peered":"2024-03-16T20:56:04.527529+0000","last_clean":"2024-03-16T20:56:04.527529+0000","last_became_active":"2024-03-16T20:55:05.307987+0000","last_became_peered":"2024-03-16T20:55:05.307987+0000","last_unstale":"2024-03-16T20:56:04.527529+0000","last_undegraded":"2024-03-16T20:56:04.527529+0000","last_fullsized":"2024-03-16T20:56:04.527529+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:19:38.142783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929344+0000","last_change":"2024-03-16T20:55:04.269683+0000","last_active":"2024-03-16T20:56:04.929344+0000","last_peered":"2024-03-16T20:56:04.929344+0000","last_clean":"2024-03-16T20:56:04.929344+0000","last_became_active":"2024-03-16T20:55:04.269258+0000","last_became_peered":"2024-03-16T20:55:04.269258+0000","last_unstale":"2024-03-16T20:56:04.929344+0000","last_undegraded":"2024-03-16T20:56:04.929344+0000","last_fullsized":"2024-03-16T20:56:04.929344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:24:10.417179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.051904+0000","last_change":"2024-03-16T20:55:05.272238+0000","last_active":"2024-03-16T20:56:33.051904+0000","last_peered":"2024-03-16T20:56:33.051904+0000","last_clean":"2024-03-16T20:56:33.051904+0000","last_became_active":"2024-03-16T20:55:05.270379+0000","last_became_peered":"2024-03-16T20:55:05.270379+0000","last_unstale":"2024-03-16T20:56:33.051904+0000","last_undegraded":"2024-03-16T20:56:33.051904+0000","last_fullsized":"2024-03-16T20:56:33.051904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:16:11.348601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512082+0000","last_change":"2024-03-16T20:55:04.280008+0000","last_active":"2024-03-16T20:56:04.512082+0000","last_peered":"2024-03-16T20:56:04.512082+0000","last_clean":"2024-03-16T20:56:04.512082+0000","last_became_active":"2024-03-16T20:55:04.279683+0000","last_became_peered":"2024-03-16T20:55:04.279683+0000","last_unstale":"2024-03-16T20:56:04.512082+0000","last_undegraded":"2024-03-16T20:56:04.512082+0000","last_fullsized":"2024-03-16T20:56:04.512082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:15.734826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512539+0000","last_change":"2024-03-16T20:55:05.287219+0000","last_active":"2024-03-16T20:56:04.512539+0000","last_peered":"2024-03-16T20:56:04.512539+0000","last_clean":"2024-03-16T20:56:04.512539+0000","last_became_active":"2024-03-16T20:55:05.286899+0000","last_became_peered":"2024-03-16T20:55:05.286899+0000","last_unstale":"2024-03-16T20:56:04.512539+0000","last_undegraded":"2024-03-16T20:56:04.512539+0000","last_fullsized":"2024-03-16T20:56:04.512539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:33:01.483415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.520859+0000","last_change":"2024-03-16T20:56:04.520433+0000","last_active":"2024-03-16T20:56:04.520859+0000","last_peered":"2024-03-16T20:56:04.520859+0000","last_clean":"2024-03-16T20:56:04.520859+0000","last_became_active":"2024-03-16T20:56:04.516521+0000","last_became_peered":"2024-03-16T20:56:04.516521+0000","last_unstale":"2024-03-16T20:56:04.520859+0000","last_undegraded":"2024-03-16T20:56:04.520859+0000","last_fullsized":"2024-03-16T20:56:04.520859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:44:38.094213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.511716+0000","last_change":"2024-03-16T20:55:05.311463+0000","last_active":"2024-03-16T20:56:04.511716+0000","last_peered":"2024-03-16T20:56:04.511716+0000","last_clean":"2024-03-16T20:56:04.511716+0000","last_became_active":"2024-03-16T20:55:05.310852+0000","last_became_peered":"2024-03-16T20:55:05.310852+0000","last_unstale":"2024-03-16T20:56:04.511716+0000","last_undegraded":"2024-03-16T20:56:04.511716+0000","last_fullsized":"2024-03-16T20:56:04.511716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:51:52.980193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514599+0000","last_change":"2024-03-16T20:55:04.260372+0000","last_active":"2024-03-16T20:56:04.514599+0000","last_peered":"2024-03-16T20:56:04.514599+0000","last_clean":"2024-03-16T20:56:04.514599+0000","last_became_active":"2024-03-16T20:55:04.259273+0000","last_became_peered":"2024-03-16T20:55:04.259273+0000","last_unstale":"2024-03-16T20:56:04.514599+0000","last_undegraded":"2024-03-16T20:56:04.514599+0000","last_fullsized":"2024-03-16T20:56:04.514599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:21:25.212520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.119064+0000","last_change":"2024-03-16T20:55:05.280088+0000","last_active":"2024-03-16T20:56:33.119064+0000","last_peered":"2024-03-16T20:56:33.119064+0000","last_clean":"2024-03-16T20:56:33.119064+0000","last_became_active":"2024-03-16T20:55:05.279745+0000","last_became_peered":"2024-03-16T20:55:05.279745+0000","last_unstale":"2024-03-16T20:56:33.119064+0000","last_undegraded":"2024-03-16T20:56:33.119064+0000","last_fullsized":"2024-03-16T20:56:33.119064+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:02:08.797287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513520+0000","last_change":"2024-03-16T20:55:04.275221+0000","last_active":"2024-03-16T20:56:04.513520+0000","last_peered":"2024-03-16T20:56:04.513520+0000","last_clean":"2024-03-16T20:56:04.513520+0000","last_became_active":"2024-03-16T20:55:04.274887+0000","last_became_peered":"2024-03-16T20:55:04.274887+0000","last_unstale":"2024-03-16T20:56:04.513520+0000","last_undegraded":"2024-03-16T20:56:04.513520+0000","last_fullsized":"2024-03-16T20:56:04.513520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:35.333864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.093077+0000","last_change":"2024-03-16T20:55:05.272444+0000","last_active":"2024-03-16T20:56:33.093077+0000","last_peered":"2024-03-16T20:56:33.093077+0000","last_clean":"2024-03-16T20:56:33.093077+0000","last_became_active":"2024-03-16T20:55:05.272104+0000","last_became_peered":"2024-03-16T20:55:05.272104+0000","last_unstale":"2024-03-16T20:56:33.093077+0000","last_undegraded":"2024-03-16T20:56:33.093077+0000","last_fullsized":"2024-03-16T20:56:33.093077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:35.480408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605367+0000","last_change":"2024-03-16T20:55:04.274212+0000","last_active":"2024-03-16T20:56:04.605367+0000","last_peered":"2024-03-16T20:56:04.605367+0000","last_clean":"2024-03-16T20:56:04.605367+0000","last_became_active":"2024-03-16T20:55:04.273785+0000","last_became_peered":"2024-03-16T20:55:04.273785+0000","last_unstale":"2024-03-16T20:56:04.605367+0000","last_undegraded":"2024-03-16T20:56:04.605367+0000","last_fullsized":"2024-03-16T20:56:04.605367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:29:00.924789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.108157+0000","last_change":"2024-03-16T20:55:05.278590+0000","last_active":"2024-03-16T20:56:33.108157+0000","last_peered":"2024-03-16T20:56:33.108157+0000","last_clean":"2024-03-16T20:56:33.108157+0000","last_became_active":"2024-03-16T20:55:05.278183+0000","last_became_peered":"2024-03-16T20:55:05.278183+0000","last_unstale":"2024-03-16T20:56:33.108157+0000","last_undegraded":"2024-03-16T20:56:33.108157+0000","last_fullsized":"2024-03-16T20:56:33.108157+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:52:18.918653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515832+0000","last_change":"2024-03-16T20:55:04.279568+0000","last_active":"2024-03-16T20:56:04.515832+0000","last_peered":"2024-03-16T20:56:04.515832+0000","last_clean":"2024-03-16T20:56:04.515832+0000","last_became_active":"2024-03-16T20:55:04.278125+0000","last_became_peered":"2024-03-16T20:55:04.278125+0000","last_unstale":"2024-03-16T20:56:04.515832+0000","last_undegraded":"2024-03-16T20:56:04.515832+0000","last_fullsized":"2024-03-16T20:56:04.515832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:13:20.417216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092506+0000","last_change":"2024-03-16T20:55:05.269732+0000","last_active":"2024-03-16T20:56:33.092506+0000","last_peered":"2024-03-16T20:56:33.092506+0000","last_clean":"2024-03-16T20:56:33.092506+0000","last_became_active":"2024-03-16T20:55:05.269260+0000","last_became_peered":"2024-03-16T20:55:05.269260+0000","last_unstale":"2024-03-16T20:56:33.092506+0000","last_undegraded":"2024-03-16T20:56:33.092506+0000","last_fullsized":"2024-03-16T20:56:33.092506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:10:03.312009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512646+0000","last_change":"2024-03-16T20:55:05.272321+0000","last_active":"2024-03-16T20:56:04.512646+0000","last_peered":"2024-03-16T20:56:04.512646+0000","last_clean":"2024-03-16T20:56:04.512646+0000","last_became_active":"2024-03-16T20:55:05.272000+0000","last_became_peered":"2024-03-16T20:55:05.272000+0000","last_unstale":"2024-03-16T20:56:04.512646+0000","last_undegraded":"2024-03-16T20:56:04.512646+0000","last_fullsized":"2024-03-16T20:56:04.512646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:04:44.773709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.931594+0000","last_change":"2024-03-16T20:56:04.931594+0000","last_active":"2024-03-16T20:56:04.931594+0000","last_peered":"2024-03-16T20:56:04.931594+0000","last_clean":"2024-03-16T20:56:04.931594+0000","last_became_active":"2024-03-16T20:56:04.931169+0000","last_became_peered":"2024-03-16T20:56:04.931169+0000","last_unstale":"2024-03-16T20:56:04.931594+0000","last_undegraded":"2024-03-16T20:56:04.931594+0000","last_fullsized":"2024-03-16T20:56:04.931594+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:32:34.858387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513134+0000","last_change":"2024-03-16T20:55:05.287329+0000","last_active":"2024-03-16T20:56:04.513134+0000","last_peered":"2024-03-16T20:56:04.513134+0000","last_clean":"2024-03-16T20:56:04.513134+0000","last_became_active":"2024-03-16T20:55:05.286893+0000","last_became_peered":"2024-03-16T20:55:05.286893+0000","last_unstale":"2024-03-16T20:56:04.513134+0000","last_undegraded":"2024-03-16T20:56:04.513134+0000","last_fullsized":"2024-03-16T20:56:04.513134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:43:29.560525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.528956+0000","last_change":"2024-03-16T20:56:04.528956+0000","last_active":"2024-03-16T20:56:04.528956+0000","last_peered":"2024-03-16T20:56:04.528956+0000","last_clean":"2024-03-16T20:56:04.528956+0000","last_became_active":"2024-03-16T20:56:04.528503+0000","last_became_peered":"2024-03-16T20:56:04.528503+0000","last_unstale":"2024-03-16T20:56:04.528956+0000","last_undegraded":"2024-03-16T20:56:04.528956+0000","last_fullsized":"2024-03-16T20:56:04.528956+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:48:36.267693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515262+0000","last_change":"2024-03-16T20:55:05.300207+0000","last_active":"2024-03-16T20:56:04.515262+0000","last_peered":"2024-03-16T20:56:04.515262+0000","last_clean":"2024-03-16T20:56:04.515262+0000","last_became_active":"2024-03-16T20:55:05.298892+0000","last_became_peered":"2024-03-16T20:55:05.298892+0000","last_unstale":"2024-03-16T20:56:04.515262+0000","last_undegraded":"2024-03-16T20:56:04.515262+0000","last_fullsized":"2024-03-16T20:56:04.515262+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:29.158690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512718+0000","last_change":"2024-03-16T20:55:05.272135+0000","last_active":"2024-03-16T20:56:04.512718+0000","last_peered":"2024-03-16T20:56:04.512718+0000","last_clean":"2024-03-16T20:56:04.512718+0000","last_became_active":"2024-03-16T20:55:05.271779+0000","last_became_peered":"2024-03-16T20:55:05.271779+0000","last_unstale":"2024-03-16T20:56:04.512718+0000","last_undegraded":"2024-03-16T20:56:04.512718+0000","last_fullsized":"2024-03-16T20:56:04.512718+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:42:58.085726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513919+0000","last_change":"2024-03-16T20:55:05.268810+0000","last_active":"2024-03-16T20:56:04.513919+0000","last_peered":"2024-03-16T20:56:04.513919+0000","last_clean":"2024-03-16T20:56:04.513919+0000","last_became_active":"2024-03-16T20:55:05.268473+0000","last_became_peered":"2024-03-16T20:55:05.268473+0000","last_unstale":"2024-03-16T20:56:04.513919+0000","last_undegraded":"2024-03-16T20:56:04.513919+0000","last_fullsized":"2024-03-16T20:56:04.513919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:48:00.990207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513019+0000","last_change":"2024-03-16T20:55:05.284121+0000","last_active":"2024-03-16T20:56:04.513019+0000","last_peered":"2024-03-16T20:56:04.513019+0000","last_clean":"2024-03-16T20:56:04.513019+0000","last_became_active":"2024-03-16T20:55:05.283588+0000","last_became_peered":"2024-03-16T20:55:05.283588+0000","last_unstale":"2024-03-16T20:56:04.513019+0000","last_undegraded":"2024-03-16T20:56:04.513019+0000","last_fullsized":"2024-03-16T20:56:04.513019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:05:56.679346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.527344+0000","last_change":"2024-03-16T20:56:04.525435+0000","last_active":"2024-03-16T20:56:04.527344+0000","last_peered":"2024-03-16T20:56:04.527344+0000","last_clean":"2024-03-16T20:56:04.527344+0000","last_became_active":"2024-03-16T20:56:04.524924+0000","last_became_peered":"2024-03-16T20:56:04.524924+0000","last_unstale":"2024-03-16T20:56:04.527344+0000","last_undegraded":"2024-03-16T20:56:04.527344+0000","last_fullsized":"2024-03-16T20:56:04.527344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:36:49.367824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.510068+0000","last_change":"2024-03-16T20:55:05.277957+0000","last_active":"2024-03-16T20:56:04.510068+0000","last_peered":"2024-03-16T20:56:04.510068+0000","last_clean":"2024-03-16T20:56:04.510068+0000","last_became_active":"2024-03-16T20:55:05.277610+0000","last_became_peered":"2024-03-16T20:55:05.277610+0000","last_unstale":"2024-03-16T20:56:04.510068+0000","last_undegraded":"2024-03-16T20:56:04.510068+0000","last_fullsized":"2024-03-16T20:56:04.510068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:54:29.010945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930101+0000","last_change":"2024-03-16T20:55:05.288112+0000","last_active":"2024-03-16T20:56:04.930101+0000","last_peered":"2024-03-16T20:56:04.930101+0000","last_clean":"2024-03-16T20:56:04.930101+0000","last_became_active":"2024-03-16T20:55:05.287791+0000","last_became_peered":"2024-03-16T20:55:05.287791+0000","last_unstale":"2024-03-16T20:56:04.930101+0000","last_undegraded":"2024-03-16T20:56:04.930101+0000","last_fullsized":"2024-03-16T20:56:04.930101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:55:57.625981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516416+0000","last_change":"2024-03-16T20:55:05.311327+0000","last_active":"2024-03-16T20:56:04.516416+0000","last_peered":"2024-03-16T20:56:04.516416+0000","last_clean":"2024-03-16T20:56:04.516416+0000","last_became_active":"2024-03-16T20:55:05.310820+0000","last_became_peered":"2024-03-16T20:55:05.310820+0000","last_unstale":"2024-03-16T20:56:04.516416+0000","last_undegraded":"2024-03-16T20:56:04.516416+0000","last_fullsized":"2024-03-16T20:56:04.516416+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:38:26.081078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513379+0000","last_change":"2024-03-16T20:55:05.277942+0000","last_active":"2024-03-16T20:56:04.513379+0000","last_peered":"2024-03-16T20:56:04.513379+0000","last_clean":"2024-03-16T20:56:04.513379+0000","last_became_active":"2024-03-16T20:55:05.277588+0000","last_became_peered":"2024-03-16T20:55:05.277588+0000","last_unstale":"2024-03-16T20:56:04.513379+0000","last_undegraded":"2024-03-16T20:56:04.513379+0000","last_fullsized":"2024-03-16T20:56:04.513379+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:32:38.464939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":211842,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68059,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":518,"num_read_kb":328,"num_write":165,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":204036,"data_compressed":5547,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351007,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":459360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612644,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":1115037,"data_compressed":37704,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776170,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":970752,"data_stored":459601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037810,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":958464,"data_stored":459292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":1051475,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462971,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":458873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1015808,"data_stored":522583,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":460144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1040384,"data_stored":523933,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":459067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888136,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":459842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724610,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":1050627,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":63917,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65267,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65886,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T20:56:37.556 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-16T20:56:37.556 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-16T20:56:37.556 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-16T20:56:37.556 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph health --format=json 2024-03-16T20:56:37.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:37 smithi008 ceph-mon[31434]: from='client.24907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:56:38.044 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:37 smithi186 ceph-mon[36391]: from='client.24907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:56:38.078 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:38.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:37 smithi170 ceph-mon[35947]: from='client.24907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:56:38.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:38 smithi008 ceph-mon[31434]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-16T20:56:39.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:38 smithi170 ceph-mon[35947]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-16T20:56:39.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:38 smithi186 ceph-mon[36391]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-16T20:56:40.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.478+0000 7f6165600700 1 -- 172.21.15.8:0/3906972562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6160109530 msgr2=0x7f6160111100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:40.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.478+0000 7f6165600700 1 --2- 172.21.15.8:0/3906972562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6160109530 0x7f6160111100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6158009f90 tx=0x7f615800b330 comp rx=0 tx=0).stop 2024-03-16T20:56:40.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.478+0000 7f6165600700 1 -- 172.21.15.8:0/3906972562 shutdown_connections 2024-03-16T20:56:40.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.478+0000 7f6165600700 1 --2- 172.21.15.8:0/3906972562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6160109530 0x7f6160111100 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:40.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.478+0000 7f6165600700 1 --2- 172.21.15.8:0/3906972562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6160104450 0x7f6160104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:40.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.478+0000 7f6165600700 1 --2- 172.21.15.8:0/3906972562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6160104e00 0x7f6160108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.478+0000 7f6165600700 1 -- 172.21.15.8:0/3906972562 >> 172.21.15.8:0/3906972562 conn(0x7f61600ffcc0 msgr2=0x7f61601020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.478+0000 7f6165600700 1 -- 172.21.15.8:0/3906972562 shutdown_connections 2024-03-16T20:56:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.478+0000 7f6165600700 1 -- 172.21.15.8:0/3906972562 wait complete. 2024-03-16T20:56:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.479+0000 7f6165600700 1 Processor -- start 2024-03-16T20:56:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.479+0000 7f6165600700 1 -- start start 2024-03-16T20:56:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f6165600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6160104450 0x7f61601a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f6165600700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6160104e00 0x7f61601a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f6165600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6160109530 0x7f616019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f6165600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616019af30 con 0x7f6160104450 2024-03-16T20:56:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f6165600700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616019b0a0 con 0x7f6160104e00 2024-03-16T20:56:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f6165600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616019b260 con 0x7f6160109530 2024-03-16T20:56:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f615ea00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6160104450 0x7f61601a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f615e000700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6160104e00 0x7f61601a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f615ea00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6160104450 0x7f61601a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51836/0 (socket says 172.21.15.8:51836) 2024-03-16T20:56:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f615e000700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6160104e00 0x7f61601a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58726/0 (socket says 172.21.15.8:58726) 2024-03-16T20:56:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f615ea00700 1 -- 172.21.15.8:0/2624926874 learned_addr learned my addr 172.21.15.8:0/2624926874 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f615f400700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6160109530 0x7f616019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f615e000700 1 -- 172.21.15.8:0/2624926874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6160109530 msgr2=0x7f616019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:40.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f615e000700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6160109530 0x7f616019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:40.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f615e000700 1 -- 172.21.15.8:0/2624926874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6160104450 msgr2=0x7f61601a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:40.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f615e000700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6160104450 0x7f61601a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:40.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.480+0000 7f615e000700 1 -- 172.21.15.8:0/2624926874 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c0094c0 con 0x7f6160104e00 2024-03-16T20:56:40.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.481+0000 7f615e000700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6160104e00 0x7f61601a0ba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f614c00ea30 tx=0x7f614c00ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:40.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.481+0000 7f6157400700 1 -- 172.21.15.8:0/2624926874 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00cbd0 con 0x7f6160104e00 2024-03-16T20:56:40.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.481+0000 7f6165600700 1 -- 172.21.15.8:0/2624926874 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6158009c40 con 0x7f6160104e00 2024-03-16T20:56:40.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.481+0000 7f6157400700 1 -- 172.21.15.8:0/2624926874 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f614c00eed0 con 0x7f6160104e00 2024-03-16T20:56:40.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.481+0000 7f6157400700 1 -- 172.21.15.8:0/2624926874 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c005290 con 0x7f6160104e00 2024-03-16T20:56:40.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.481+0000 7f6165600700 1 -- 172.21.15.8:0/2624926874 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61601a75e0 con 0x7f6160104e00 2024-03-16T20:56:40.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.482+0000 7f6165600700 1 -- 172.21.15.8:0/2624926874 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6160105930 con 0x7f6160104e00 2024-03-16T20:56:40.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.484+0000 7f6157400700 1 -- 172.21.15.8:0/2624926874 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f614c004750 con 0x7f6160104e00 2024-03-16T20:56:40.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.485+0000 7f6157400700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61440a1ac0 0x7f61440a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:40.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.485+0000 7f6157400700 1 -- 172.21.15.8:0/2624926874 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f614c014070 con 0x7f6160104e00 2024-03-16T20:56:40.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.486+0000 7f615ea00700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61440a1ac0 0x7f61440a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:40.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.486+0000 7f615ea00700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61440a1ac0 0x7f61440a3f80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6150005950 tx=0x7f6150009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:40.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.489+0000 7f6157400700 1 -- 172.21.15.8:0/2624926874 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f614c096750 con 0x7f6160104e00 2024-03-16T20:56:40.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.767+0000 7f6165600700 1 -- 172.21.15.8:0/2624926874 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6160114420 con 0x7f6160104e00 2024-03-16T20:56:40.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.768+0000 7f6157400700 1 -- 172.21.15.8:0/2624926874 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f614c099e10 con 0x7f6160104e00 2024-03-16T20:56:40.773 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:56:40.773 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-16T20:56:40.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 -- 172.21.15.8:0/2624926874 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61440a1ac0 msgr2=0x7f61440a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:40.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61440a1ac0 0x7f61440a3f80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6150005950 tx=0x7f6150009310 comp rx=0 tx=0).stop 2024-03-16T20:56:40.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 -- 172.21.15.8:0/2624926874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6160104e00 msgr2=0x7f61601a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:40.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6160104e00 0x7f61601a0ba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f614c00ea30 tx=0x7f614c00ed40 comp rx=0 tx=0).stop 2024-03-16T20:56:40.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 -- 172.21.15.8:0/2624926874 shutdown_connections 2024-03-16T20:56:40.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f61440a1ac0 0x7f61440a3f80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:40.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6160104450 0x7f61601a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:40.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6160109530 0x7f616019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:40.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 --2- 172.21.15.8:0/2624926874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6160104e00 0x7f61601a0ba0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:40.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 -- 172.21.15.8:0/2624926874 >> 172.21.15.8:0/2624926874 conn(0x7f61600ffcc0 msgr2=0x7f6160100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:40.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 -- 172.21.15.8:0/2624926874 shutdown_connections 2024-03-16T20:56:40.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:40.771+0000 7f6165600700 1 -- 172.21.15.8:0/2624926874 wait complete. 2024-03-16T20:56:40.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:40 smithi008 ceph-mon[31434]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:41.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:40 smithi170 ceph-mon[35947]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:41.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:40 smithi186 ceph-mon[36391]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:41.744 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-16T20:56:41.745 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:56:41.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.970+0000 7f1c70800640 1 -- 172.21.15.8:0/1260996401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c68075530 msgr2=0x7f1c68073980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:41.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.970+0000 7f1c70800640 1 --2- 172.21.15.8:0/1260996401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c68075530 0x7f1c68073980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009930 tx=0x7f1c5c02bc30 comp rx=0 tx=0).stop 2024-03-16T20:56:41.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.970+0000 7f1c70800640 1 -- 172.21.15.8:0/1260996401 shutdown_connections 2024-03-16T20:56:41.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.970+0000 7f1c70800640 1 --2- 172.21.15.8:0/1260996401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c6810dad0 0x7f1c6810fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:41.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.970+0000 7f1c70800640 1 --2- 172.21.15.8:0/1260996401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c68073f50 0x7f1c680743d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:41.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.970+0000 7f1c70800640 1 --2- 172.21.15.8:0/1260996401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c68075530 0x7f1c68073980 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:41.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.970+0000 7f1c70800640 1 -- 172.21.15.8:0/1260996401 >> 172.21.15.8:0/1260996401 conn(0x7f1c680fcad0 msgr2=0x7f1c680feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:41.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.970+0000 7f1c70800640 1 -- 172.21.15.8:0/1260996401 shutdown_connections 2024-03-16T20:56:41.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.970+0000 7f1c70800640 1 -- 172.21.15.8:0/1260996401 wait complete. 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.971+0000 7f1c70800640 1 Processor -- start 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.971+0000 7f1c70800640 1 -- start start 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c70800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c68073f50 0x7f1c6819dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c70800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c68075530 0x7f1c6819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c70800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c6810dad0 0x7f1c681a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c70800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c681a5790 con 0x7f1c68075530 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c70800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c681a5900 con 0x7f1c68073f50 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c70800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c681a5ac0 con 0x7f1c6810dad0 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c6de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c68073f50 0x7f1c6819dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c6de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c68073f50 0x7f1c6819dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58740/0 (socket says 172.21.15.8:58740) 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c6de00640 1 -- 172.21.15.8:0/710281049 learned_addr learned my addr 172.21.15.8:0/710281049 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:41.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c6d400640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c68075530 0x7f1c6819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c6e800640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c6810dad0 0x7f1c681a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c6de00640 1 -- 172.21.15.8:0/710281049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c6810dad0 msgr2=0x7f1c681a5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c6de00640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c6810dad0 0x7f1c681a5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c6de00640 1 -- 172.21.15.8:0/710281049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c68075530 msgr2=0x7f1c6819e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c6de00640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c68075530 0x7f1c6819e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c6de00640 1 -- 172.21.15.8:0/710281049 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c64009840 con 0x7f1c68073f50 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.972+0000 7f1c6e800640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c6810dad0 0x7f1c681a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.973+0000 7f1c6de00640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c68073f50 0x7f1c6819dc80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c000c00 tx=0x7f1c5c005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.973+0000 7f1c62a00640 1 -- 172.21.15.8:0/710281049 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c004350 con 0x7f1c68073f50 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.973+0000 7f1c62a00640 1 -- 172.21.15.8:0/710281049 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1c5c0044b0 con 0x7f1c68073f50 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.973+0000 7f1c70800640 1 -- 172.21.15.8:0/710281049 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c009560 con 0x7f1c68073f50 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.973+0000 7f1c62a00640 1 -- 172.21.15.8:0/710281049 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c003d00 con 0x7f1c68073f50 2024-03-16T20:56:41.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.973+0000 7f1c70800640 1 -- 172.21.15.8:0/710281049 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c681a6110 con 0x7f1c68073f50 2024-03-16T20:56:41.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.974+0000 7f1c70800640 1 -- 172.21.15.8:0/710281049 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c68103ca0 con 0x7f1c68073f50 2024-03-16T20:56:41.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.976+0000 7f1c62a00640 1 -- 172.21.15.8:0/710281049 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f1c5c004e10 con 0x7f1c68073f50 2024-03-16T20:56:41.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.977+0000 7f1c62a00640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1c500a1ab0 0x7f1c500a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:41.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.978+0000 7f1c62a00640 1 -- 172.21.15.8:0/710281049 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1c5c0ef9f0 con 0x7f1c68073f50 2024-03-16T20:56:41.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.978+0000 7f1c6d400640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1c500a1ab0 0x7f1c500a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:41.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.978+0000 7f1c6d400640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1c500a1ab0 0x7f1c500a3f70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1c6819f180 tx=0x7f1c58005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:41.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:41.986+0000 7f1c62a00640 1 -- 172.21.15.8:0/710281049 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1c5c0b8bb0 con 0x7f1c68073f50 2024-03-16T20:56:41.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:41 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2624926874' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-16T20:56:42.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:41 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2624926874' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-16T20:56:42.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:41 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2624926874' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-16T20:56:42.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.189+0000 7f1c70800640 1 -- 172.21.15.8:0/710281049 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c6802d060 con 0x7f1c68073f50 2024-03-16T20:56:42.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.192+0000 7f1c62a00640 1 -- 172.21.15.8:0/710281049 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22581 (secure 0 0 0) 0x7f1c5c043090 con 0x7f1c68073f50 2024-03-16T20:56:42.197 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:56:42.197 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:56:04.502777+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:56:42.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 -- 172.21.15.8:0/710281049 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1c500a1ab0 msgr2=0x7f1c500a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:42.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1c500a1ab0 0x7f1c500a3f70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1c6819f180 tx=0x7f1c58005f90 comp rx=0 tx=0).stop 2024-03-16T20:56:42.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 -- 172.21.15.8:0/710281049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c68073f50 msgr2=0x7f1c6819dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:42.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c68073f50 0x7f1c6819dc80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c000c00 tx=0x7f1c5c005dc0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 -- 172.21.15.8:0/710281049 shutdown_connections 2024-03-16T20:56:42.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1c500a1ab0 0x7f1c500a3f70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c6810dad0 0x7f1c681a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c68075530 0x7f1c6819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 --2- 172.21.15.8:0/710281049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c68073f50 0x7f1c6819dc80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 -- 172.21.15.8:0/710281049 >> 172.21.15.8:0/710281049 conn(0x7f1c680fcad0 msgr2=0x7f1c68100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:42.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 -- 172.21.15.8:0/710281049 shutdown_connections 2024-03-16T20:56:42.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.195+0000 7f1c70800640 1 -- 172.21.15.8:0/710281049 wait complete. 2024-03-16T20:56:42.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T20:55:02.896774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T20:55:04.228958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T20:56:42.220 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T20:56:42.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.435+0000 7f2787200640 1 -- 172.21.15.8:0/3683556350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2788107a10 msgr2=0x7f2788107e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:42.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.435+0000 7f2787200640 1 --2- 172.21.15.8:0/3683556350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2788107a10 0x7f2788107e30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2778009900 tx=0x7f277802bc50 comp rx=0 tx=0).stop 2024-03-16T20:56:42.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.435+0000 7f2787200640 1 -- 172.21.15.8:0/3683556350 shutdown_connections 2024-03-16T20:56:42.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.435+0000 7f2787200640 1 --2- 172.21.15.8:0/3683556350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27881095c0 0x7f278810fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.435+0000 7f2787200640 1 --2- 172.21.15.8:0/3683556350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788108c00 0x7f2788109080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.435+0000 7f2787200640 1 --2- 172.21.15.8:0/3683556350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2788107a10 0x7f2788107e30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.435+0000 7f2787200640 1 -- 172.21.15.8:0/3683556350 >> 172.21.15.8:0/3683556350 conn(0x7f27880769c0 msgr2=0x7f2788078de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:42.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.435+0000 7f2787200640 1 -- 172.21.15.8:0/3683556350 shutdown_connections 2024-03-16T20:56:42.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.435+0000 7f2787200640 1 -- 172.21.15.8:0/3683556350 wait complete. 2024-03-16T20:56:42.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.436+0000 7f2787200640 1 Processor -- start 2024-03-16T20:56:42.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.436+0000 7f2787200640 1 -- start start 2024-03-16T20:56:42.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f2787200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788107a10 0x7f278819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:42.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f2787200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2788108c00 0x7f278819e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:42.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f2787200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27881095c0 0x7f27881a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:42.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f2787200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27881a5660 con 0x7f27881095c0 2024-03-16T20:56:42.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f2787200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27881a57d0 con 0x7f2788107a10 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f2787200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27881a5990 con 0x7f2788108c00 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f2785e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788107a10 0x7f278819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f277fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2788108c00 0x7f278819e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f2785e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788107a10 0x7f278819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58758/0 (socket says 172.21.15.8:58758) 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f2785e00640 1 -- 172.21.15.8:0/2333962705 learned_addr learned my addr 172.21.15.8:0/2333962705 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f2786800640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27881095c0 0x7f27881a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f277fe00640 1 -- 172.21.15.8:0/2333962705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788107a10 msgr2=0x7f278819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.437+0000 7f277fe00640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788107a10 0x7f278819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.438+0000 7f277fe00640 1 -- 172.21.15.8:0/2333962705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27881095c0 msgr2=0x7f27881a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.438+0000 7f277fe00640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27881095c0 0x7f27881a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.438+0000 7f277fe00640 1 -- 172.21.15.8:0/2333962705 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2778009560 con 0x7f2788108c00 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.438+0000 7f277fe00640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2788108c00 0x7f278819e0b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f277000e9f0 tx=0x7f277000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.438+0000 7f277ea00640 1 -- 172.21.15.8:0/2333962705 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000ccc0 con 0x7f2788108c00 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.438+0000 7f277ea00640 1 -- 172.21.15.8:0/2333962705 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f277000ce20 con 0x7f2788108c00 2024-03-16T20:56:42.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.438+0000 7f277ea00640 1 -- 172.21.15.8:0/2333962705 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27700189c0 con 0x7f2788108c00 2024-03-16T20:56:42.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.438+0000 7f2787200640 1 -- 172.21.15.8:0/2333962705 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27881a5c70 con 0x7f2788108c00 2024-03-16T20:56:42.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.438+0000 7f2787200640 1 -- 172.21.15.8:0/2333962705 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27881a6130 con 0x7f2788108c00 2024-03-16T20:56:42.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.439+0000 7f2787200640 1 -- 172.21.15.8:0/2333962705 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278810ed30 con 0x7f2788108c00 2024-03-16T20:56:42.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.441+0000 7f277ea00640 1 -- 172.21.15.8:0/2333962705 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f2770018b20 con 0x7f2788108c00 2024-03-16T20:56:42.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.442+0000 7f277ea00640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f276c0a1ab0 0x7f276c0a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:42.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.443+0000 7f277ea00640 1 -- 172.21.15.8:0/2333962705 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2770014070 con 0x7f2788108c00 2024-03-16T20:56:42.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.443+0000 7f2785e00640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f276c0a1ab0 0x7f276c0a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:42.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.443+0000 7f2785e00640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f276c0a1ab0 0x7f276c0a3f70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f277802c930 tx=0x7f277802cb10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:42.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.447+0000 7f277ea00640 1 -- 172.21.15.8:0/2333962705 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2770053280 con 0x7f2788108c00 2024-03-16T20:56:42.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.651+0000 7f2787200640 1 -- 172.21.15.8:0/2333962705 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f278802d060 con 0x7f2788108c00 2024-03-16T20:56:42.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.651+0000 7f277ea00640 1 -- 172.21.15.8:0/2333962705 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27700968d0 con 0x7f2788108c00 2024-03-16T20:56:42.657 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.654+0000 7f2787200640 1 -- 172.21.15.8:0/2333962705 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f276c0a1ab0 msgr2=0x7f276c0a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.654+0000 7f2787200640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f276c0a1ab0 0x7f276c0a3f70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f277802c930 tx=0x7f277802cb10 comp rx=0 tx=0).stop 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.654+0000 7f2787200640 1 -- 172.21.15.8:0/2333962705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2788108c00 msgr2=0x7f278819e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.654+0000 7f2787200640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2788108c00 0x7f278819e0b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f277000e9f0 tx=0x7f277000eeb0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.655+0000 7f2787200640 1 -- 172.21.15.8:0/2333962705 shutdown_connections 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.655+0000 7f2787200640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f276c0a1ab0 0x7f276c0a3f70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.655+0000 7f2787200640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27881095c0 0x7f27881a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.655+0000 7f2787200640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2788108c00 0x7f278819e0b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.655+0000 7f2787200640 1 --2- 172.21.15.8:0/2333962705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788107a10 0x7f278819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.655+0000 7f2787200640 1 -- 172.21.15.8:0/2333962705 >> 172.21.15.8:0/2333962705 conn(0x7f27880769c0 msgr2=0x7f278810bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.655+0000 7f2787200640 1 -- 172.21.15.8:0/2333962705 shutdown_connections 2024-03-16T20:56:42.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.655+0000 7f2787200640 1 -- 172.21.15.8:0/2333962705 wait complete. 2024-03-16T20:56:42.679 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T20:56:42.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.897+0000 7f64c5e00640 1 -- 172.21.15.8:0/4076700580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c0105ed0 msgr2=0x7f64c0108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:42.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.897+0000 7f64c5e00640 1 --2- 172.21.15.8:0/4076700580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c0105ed0 0x7f64c0108360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009be0 tx=0x7f64b802bef0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.897+0000 7f64c5e00640 1 -- 172.21.15.8:0/4076700580 shutdown_connections 2024-03-16T20:56:42.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.897+0000 7f64c5e00640 1 --2- 172.21.15.8:0/4076700580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c0105ed0 0x7f64c0108360 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.897+0000 7f64c5e00640 1 --2- 172.21.15.8:0/4076700580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64c01034c0 0x7f64c01058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.897+0000 7f64c5e00640 1 --2- 172.21.15.8:0/4076700580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64c0100b90 0x7f64c0102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.897+0000 7f64c5e00640 1 -- 172.21.15.8:0/4076700580 >> 172.21.15.8:0/4076700580 conn(0x7f64c00fab70 msgr2=0x7f64c00fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:42.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.897+0000 7f64c5e00640 1 -- 172.21.15.8:0/4076700580 shutdown_connections 2024-03-16T20:56:42.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.897+0000 7f64c5e00640 1 -- 172.21.15.8:0/4076700580 wait complete. 2024-03-16T20:56:42.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.899+0000 7f64c5e00640 1 Processor -- start 2024-03-16T20:56:42.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.899+0000 7f64c5e00640 1 -- start start 2024-03-16T20:56:42.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.899+0000 7f64c5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64c0100b90 0x7f64c01996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.899+0000 7f64c5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64c01034c0 0x7f64c0199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.899+0000 7f64c5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c0105ed0 0x7f64c01a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.899+0000 7f64c5e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c01a11e0 con 0x7f64c0100b90 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.899+0000 7f64c5e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c01a1350 con 0x7f64c0105ed0 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.899+0000 7f64c5e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c01a1510 con 0x7f64c01034c0 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.899+0000 7f64c4a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64c0100b90 0x7f64c01996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64bfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64c01034c0 0x7f64c0199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64c4a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64c0100b90 0x7f64c01996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51888/0 (socket says 172.21.15.8:51888) 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64c4a00640 1 -- 172.21.15.8:0/3932291812 learned_addr learned my addr 172.21.15.8:0/3932291812 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64c5400640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c0105ed0 0x7f64c01a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64bfe00640 1 -- 172.21.15.8:0/3932291812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c0105ed0 msgr2=0x7f64c01a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64bfe00640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c0105ed0 0x7f64c01a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64bfe00640 1 -- 172.21.15.8:0/3932291812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64c0100b90 msgr2=0x7f64c01996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:42.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64bfe00640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64c0100b90 0x7f64c01996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:42.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64bfe00640 1 -- 172.21.15.8:0/3932291812 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac009560 con 0x7f64c01034c0 2024-03-16T20:56:42.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64bfe00640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64c01034c0 0x7f64c0199c30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64ac005fd0 tx=0x7f64ac00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:42.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64bd600640 1 -- 172.21.15.8:0/3932291812 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac00cd00 con 0x7f64c01034c0 2024-03-16T20:56:42.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.900+0000 7f64bd600640 1 -- 172.21.15.8:0/3932291812 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f64ac00ce60 con 0x7f64c01034c0 2024-03-16T20:56:42.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.901+0000 7f64c5e00640 1 -- 172.21.15.8:0/3932291812 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b8009840 con 0x7f64c01034c0 2024-03-16T20:56:42.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.901+0000 7f64bd600640 1 -- 172.21.15.8:0/3932291812 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac010690 con 0x7f64c01034c0 2024-03-16T20:56:42.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.901+0000 7f64c5e00640 1 -- 172.21.15.8:0/3932291812 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c01a1bc0 con 0x7f64c01034c0 2024-03-16T20:56:42.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.902+0000 7f64c5e00640 1 -- 172.21.15.8:0/3932291812 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c01079c0 con 0x7f64c01034c0 2024-03-16T20:56:42.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.904+0000 7f64bd600640 1 -- 172.21.15.8:0/3932291812 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f64ac0037f0 con 0x7f64c01034c0 2024-03-16T20:56:42.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.905+0000 7f64bd600640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f64a80a1ab0 0x7f64a80a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:42.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.905+0000 7f64bd600640 1 -- 172.21.15.8:0/3932291812 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f64ac014070 con 0x7f64c01034c0 2024-03-16T20:56:42.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.905+0000 7f64c4a00640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f64a80a1ab0 0x7f64a80a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:42.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.906+0000 7f64c4a00640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f64a80a1ab0 0x7f64a80a3f70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f64b40058c0 tx=0x7f64b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:42.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:42.911+0000 7f64bd600640 1 -- 172.21.15.8:0/3932291812 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f64ac096910 con 0x7f64c01034c0 2024-03-16T20:56:42.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:42 smithi008 ceph-mon[31434]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:42.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:42 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/710281049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:56:42.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:42 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2333962705' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:56:43.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.111+0000 7f64c5e00640 1 -- 172.21.15.8:0/3932291812 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64c002cf60 con 0x7f64c01034c0 2024-03-16T20:56:43.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:42 smithi170 ceph-mon[35947]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:43.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:42 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/710281049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:56:43.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:42 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2333962705' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:56:43.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.112+0000 7f64bd600640 1 -- 172.21.15.8:0/3932291812 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64ac099fd0 con 0x7f64c01034c0 2024-03-16T20:56:43.117 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-16T20:56:43.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.114+0000 7f64c5e00640 1 -- 172.21.15.8:0/3932291812 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f64a80a1ab0 msgr2=0x7f64a80a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.114+0000 7f64c5e00640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f64a80a1ab0 0x7f64a80a3f70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f64b40058c0 tx=0x7f64b4005f90 comp rx=0 tx=0).stop 2024-03-16T20:56:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.114+0000 7f64c5e00640 1 -- 172.21.15.8:0/3932291812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64c01034c0 msgr2=0x7f64c0199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.114+0000 7f64c5e00640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64c01034c0 0x7f64c0199c30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64ac005fd0 tx=0x7f64ac00ee50 comp rx=0 tx=0).stop 2024-03-16T20:56:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.114+0000 7f64c5e00640 1 -- 172.21.15.8:0/3932291812 shutdown_connections 2024-03-16T20:56:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.114+0000 7f64c5e00640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f64a80a1ab0 0x7f64a80a3f70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.114+0000 7f64c5e00640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c0105ed0 0x7f64c01a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.114+0000 7f64c5e00640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64c01034c0 0x7f64c0199c30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.114+0000 7f64c5e00640 1 --2- 172.21.15.8:0/3932291812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64c0100b90 0x7f64c01996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.114+0000 7f64c5e00640 1 -- 172.21.15.8:0/3932291812 >> 172.21.15.8:0/3932291812 conn(0x7f64c00fab70 msgr2=0x7f64c010a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.115+0000 7f64c5e00640 1 -- 172.21.15.8:0/3932291812 shutdown_connections 2024-03-16T20:56:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.115+0000 7f64c5e00640 1 -- 172.21.15.8:0/3932291812 wait complete. 2024-03-16T20:56:43.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T20:56:43.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:42 smithi186 ceph-mon[36391]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:43.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:42 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/710281049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:56:43.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:42 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2333962705' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.362+0000 7f3869800640 1 -- 172.21.15.8:0/3911827037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38640ffc60 msgr2=0x7f3864102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.362+0000 7f3869800640 1 --2- 172.21.15.8:0/3911827037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38640ffc60 0x7f3864102090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3854009be0 tx=0x7f385402bef0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.363+0000 7f3869800640 1 -- 172.21.15.8:0/3911827037 shutdown_connections 2024-03-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.363+0000 7f3869800640 1 --2- 172.21.15.8:0/3911827037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3864104f80 0x7f3864105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.363+0000 7f3869800640 1 --2- 172.21.15.8:0/3911827037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38641025d0 0x7f3864104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.363+0000 7f3869800640 1 --2- 172.21.15.8:0/3911827037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38640ffc60 0x7f3864102090 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.363+0000 7f3869800640 1 -- 172.21.15.8:0/3911827037 >> 172.21.15.8:0/3911827037 conn(0x7f38640fb860 msgr2=0x7f38640fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.363+0000 7f3869800640 1 -- 172.21.15.8:0/3911827037 shutdown_connections 2024-03-16T20:56:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.363+0000 7f3869800640 1 -- 172.21.15.8:0/3911827037 wait complete. 2024-03-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.364+0000 7f3869800640 1 Processor -- start 2024-03-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.364+0000 7f3869800640 1 -- start start 2024-03-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.364+0000 7f3869800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38640ffc60 0x7f386419db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.364+0000 7f3869800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38641025d0 0x7f386419e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.364+0000 7f3869800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3864104f80 0x7f38641a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:43.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3869800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38641a5620 con 0x7f3864104f80 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3869800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38641a5790 con 0x7f38640ffc60 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3869800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38641a5950 con 0x7f38641025d0 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3863e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38640ffc60 0x7f386419db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3863e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38640ffc60 0x7f386419db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58794/0 (socket says 172.21.15.8:58794) 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3863e00640 1 -- 172.21.15.8:0/1280680442 learned_addr learned my addr 172.21.15.8:0/1280680442 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3863400640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38641025d0 0x7f386419e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3868e00640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3864104f80 0x7f38641a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3863e00640 1 -- 172.21.15.8:0/1280680442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38641025d0 msgr2=0x7f386419e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3863e00640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38641025d0 0x7f386419e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3863e00640 1 -- 172.21.15.8:0/1280680442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3864104f80 msgr2=0x7f38641a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3863e00640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3864104f80 0x7f38641a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.365+0000 7f3863e00640 1 -- 172.21.15.8:0/1280680442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009560 con 0x7f38640ffc60 2024-03-16T20:56:43.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.366+0000 7f3863e00640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38640ffc60 0x7f386419db30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f385402c500 tx=0x7f38540338f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.366+0000 7f3860c00640 1 -- 172.21.15.8:0/1280680442 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854003b80 con 0x7f38640ffc60 2024-03-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.366+0000 7f3860c00640 1 -- 172.21.15.8:0/1280680442 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3854003ce0 con 0x7f38640ffc60 2024-03-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.366+0000 7f3860c00640 1 -- 172.21.15.8:0/1280680442 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854034b70 con 0x7f38640ffc60 2024-03-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.366+0000 7f3869800640 1 -- 172.21.15.8:0/1280680442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3854009840 con 0x7f38640ffc60 2024-03-16T20:56:43.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.366+0000 7f3869800640 1 -- 172.21.15.8:0/1280680442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38641a5f00 con 0x7f38640ffc60 2024-03-16T20:56:43.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.367+0000 7f3869800640 1 -- 172.21.15.8:0/1280680442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38640fd350 con 0x7f38640ffc60 2024-03-16T20:56:43.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.369+0000 7f3860c00640 1 -- 172.21.15.8:0/1280680442 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f3854004040 con 0x7f38640ffc60 2024-03-16T20:56:43.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.370+0000 7f3860c00640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f38480a1ab0 0x7f38480a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:43.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.370+0000 7f3860c00640 1 -- 172.21.15.8:0/1280680442 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f38540f02b0 con 0x7f38640ffc60 2024-03-16T20:56:43.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.371+0000 7f3863400640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f38480a1ab0 0x7f38480a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:43.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.371+0000 7f3863400640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f38480a1ab0 0x7f38480a3f70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f386419f040 tx=0x7f384c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:43.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.374+0000 7f3860c00640 1 -- 172.21.15.8:0/1280680442 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f38540b9470 con 0x7f38640ffc60 2024-03-16T20:56:43.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.577+0000 7f3869800640 1 -- 172.21.15.8:0/1280680442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f386402cf90 con 0x7f38640ffc60 2024-03-16T20:56:43.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.577+0000 7f3860c00640 1 -- 172.21.15.8:0/1280680442 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38540bcb30 con 0x7f38640ffc60 2024-03-16T20:56:43.583 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-16T20:56:43.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.580+0000 7f3869800640 1 -- 172.21.15.8:0/1280680442 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f38480a1ab0 msgr2=0x7f38480a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:43.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.580+0000 7f3869800640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f38480a1ab0 0x7f38480a3f70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f386419f040 tx=0x7f384c009260 comp rx=0 tx=0).stop 2024-03-16T20:56:43.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.580+0000 7f3869800640 1 -- 172.21.15.8:0/1280680442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38640ffc60 msgr2=0x7f386419db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:43.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.580+0000 7f3869800640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38640ffc60 0x7f386419db30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f385402c500 tx=0x7f38540338f0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.581+0000 7f3869800640 1 -- 172.21.15.8:0/1280680442 shutdown_connections 2024-03-16T20:56:43.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.581+0000 7f3869800640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f38480a1ab0 0x7f38480a3f70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.581+0000 7f3869800640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3864104f80 0x7f38641a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.581+0000 7f3869800640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38641025d0 0x7f386419e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.581+0000 7f3869800640 1 --2- 172.21.15.8:0/1280680442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38640ffc60 0x7f386419db30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.581+0000 7f3869800640 1 -- 172.21.15.8:0/1280680442 >> 172.21.15.8:0/1280680442 conn(0x7f38640fb860 msgr2=0x7f3864102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:43.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.581+0000 7f3869800640 1 -- 172.21.15.8:0/1280680442 shutdown_connections 2024-03-16T20:56:43.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.581+0000 7f3869800640 1 -- 172.21.15.8:0/1280680442 wait complete. 2024-03-16T20:56:43.606 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:56:43.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.827+0000 7f4931800640 1 -- 172.21.15.8:0/2378850526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f492c107950 msgr2=0x7f492c107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:43.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.827+0000 7f4931800640 1 --2- 172.21.15.8:0/2378850526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f492c107950 0x7f492c107d70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f491c009900 tx=0x7f491c02bc30 comp rx=0 tx=0).stop 2024-03-16T20:56:43.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.827+0000 7f4931800640 1 -- 172.21.15.8:0/2378850526 shutdown_connections 2024-03-16T20:56:43.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.827+0000 7f4931800640 1 --2- 172.21.15.8:0/2378850526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c109500 0x7f492c10fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.827+0000 7f4931800640 1 --2- 172.21.15.8:0/2378850526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f492c108b40 0x7f492c108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.827+0000 7f4931800640 1 --2- 172.21.15.8:0/2378850526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f492c107950 0x7f492c107d70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.827+0000 7f4931800640 1 -- 172.21.15.8:0/2378850526 >> 172.21.15.8:0/2378850526 conn(0x7f492c076900 msgr2=0x7f492c078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:43.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.827+0000 7f4931800640 1 -- 172.21.15.8:0/2378850526 shutdown_connections 2024-03-16T20:56:43.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.827+0000 7f4931800640 1 -- 172.21.15.8:0/2378850526 wait complete. 2024-03-16T20:56:43.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.828+0000 7f4931800640 1 Processor -- start 2024-03-16T20:56:43.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.828+0000 7f4931800640 1 -- start start 2024-03-16T20:56:43.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.828+0000 7f4931800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c107950 0x7f492c19dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:43.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.828+0000 7f4931800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f492c108b40 0x7f492c19e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:43.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.828+0000 7f4931800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f492c109500 0x7f492c1a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:43.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.828+0000 7f4931800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1a55c0 con 0x7f492c109500 2024-03-16T20:56:43.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.828+0000 7f4931800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1a5730 con 0x7f492c108b40 2024-03-16T20:56:43.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.828+0000 7f4931800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1a58f0 con 0x7f492c107950 2024-03-16T20:56:43.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.828+0000 7f4923e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f492c108b40 0x7f492c19e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:43.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.829+0000 7f4930e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f492c109500 0x7f492c1a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.829+0000 7f492be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c107950 0x7f492c19dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.829+0000 7f4923e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f492c108b40 0x7f492c19e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58810/0 (socket says 172.21.15.8:58810) 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.829+0000 7f4923e00640 1 -- 172.21.15.8:0/3427386148 learned_addr learned my addr 172.21.15.8:0/3427386148 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.829+0000 7f492be00640 1 -- 172.21.15.8:0/3427386148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f492c108b40 msgr2=0x7f492c19e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.829+0000 7f492be00640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f492c108b40 0x7f492c19e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.829+0000 7f492be00640 1 -- 172.21.15.8:0/3427386148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f492c109500 msgr2=0x7f492c1a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.829+0000 7f492be00640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f492c109500 0x7f492c1a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.829+0000 7f492be00640 1 -- 172.21.15.8:0/3427386148 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4924009840 con 0x7f492c107950 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.829+0000 7f492be00640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c107950 0x7f492c19dad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f491c009230 tx=0x7f491c004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.830+0000 7f4929600640 1 -- 172.21.15.8:0/3427386148 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c004440 con 0x7f492c107950 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.830+0000 7f4929600640 1 -- 172.21.15.8:0/3427386148 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f491c005310 con 0x7f492c107950 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.830+0000 7f4931800640 1 -- 172.21.15.8:0/3427386148 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c009560 con 0x7f492c107950 2024-03-16T20:56:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.830+0000 7f4929600640 1 -- 172.21.15.8:0/3427386148 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c003c40 con 0x7f492c107950 2024-03-16T20:56:43.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.830+0000 7f4931800640 1 -- 172.21.15.8:0/3427386148 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c1a5f10 con 0x7f492c107950 2024-03-16T20:56:43.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.831+0000 7f4931800640 1 -- 172.21.15.8:0/3427386148 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c068650 con 0x7f492c107950 2024-03-16T20:56:43.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.832+0000 7f4929600640 1 -- 172.21.15.8:0/3427386148 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f491c005480 con 0x7f492c107950 2024-03-16T20:56:43.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.834+0000 7f4929600640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f49100a1ab0 0x7f49100a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:43.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.834+0000 7f4929600640 1 -- 172.21.15.8:0/3427386148 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f491c0efa90 con 0x7f492c107950 2024-03-16T20:56:43.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.834+0000 7f4923e00640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f49100a1ab0 0x7f49100a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:43.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.835+0000 7f4923e00640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f49100a1ab0 0x7f49100a3f70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f492c19efe0 tx=0x7f491400b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:43.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:43.838+0000 7f4929600640 1 -- 172.21.15.8:0/3427386148 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f491c0b8c50 con 0x7f492c107950 2024-03-16T20:56:43.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:43 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3932291812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:56:43.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:43 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1280680442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:56:44.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.081+0000 7f4931800640 1 -- 172.21.15.8:0/3427386148 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f492c10ec10 con 0x7f492c107950 2024-03-16T20:56:44.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.082+0000 7f4929600640 1 -- 172.21.15.8:0/3427386148 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f491c043020 con 0x7f492c107950 2024-03-16T20:56:44.087 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:56:44.087 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:55:10.355515+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24593,24544]},"id":1}]} 2024-03-16T20:56:44.087 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2024-03-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.084+0000 7f4931800640 1 -- 172.21.15.8:0/3427386148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f49100a1ab0 msgr2=0x7f49100a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.084+0000 7f4931800640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f49100a1ab0 0x7f49100a3f70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f492c19efe0 tx=0x7f491400b480 comp rx=0 tx=0).stop 2024-03-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.084+0000 7f4931800640 1 -- 172.21.15.8:0/3427386148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c107950 msgr2=0x7f492c19dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.084+0000 7f4931800640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c107950 0x7f492c19dad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f491c009230 tx=0x7f491c004040 comp rx=0 tx=0).stop 2024-03-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.085+0000 7f4931800640 1 -- 172.21.15.8:0/3427386148 shutdown_connections 2024-03-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.085+0000 7f4931800640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f49100a1ab0 0x7f49100a3f70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.085+0000 7f4931800640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f492c109500 0x7f492c1a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.085+0000 7f4931800640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f492c108b40 0x7f492c19e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.085+0000 7f4931800640 1 --2- 172.21.15.8:0/3427386148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c107950 0x7f492c19dad0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.085+0000 7f4931800640 1 -- 172.21.15.8:0/3427386148 >> 172.21.15.8:0/3427386148 conn(0x7f492c076900 msgr2=0x7f492c10bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:44.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.085+0000 7f4931800640 1 -- 172.21.15.8:0/3427386148 shutdown_connections 2024-03-16T20:56:44.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.085+0000 7f4931800640 1 -- 172.21.15.8:0/3427386148 wait complete. 2024-03-16T20:56:44.108 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:56:44.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:43 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3932291812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:56:44.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:43 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1280680442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:56:44.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:43 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3932291812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:56:44.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:43 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1280680442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:56:44.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.326+0000 7fa9a3e00640 1 -- 172.21.15.8:0/408149618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c1048b0 msgr2=0x7fa99c106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:44.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.326+0000 7fa9a3e00640 1 --2- 172.21.15.8:0/408149618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c1048b0 0x7fa99c106ca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa988009900 tx=0x7fa98802bc30 comp rx=0 tx=0).stop 2024-03-16T20:56:44.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.326+0000 7fa9a3e00640 1 -- 172.21.15.8:0/408149618 shutdown_connections 2024-03-16T20:56:44.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.326+0000 7fa9a3e00640 1 --2- 172.21.15.8:0/408149618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa99c1071e0 0x7fa99c109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.326+0000 7fa9a3e00640 1 --2- 172.21.15.8:0/408149618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c1048b0 0x7fa99c106ca0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.326+0000 7fa9a3e00640 1 --2- 172.21.15.8:0/408149618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa99c101f80 0x7fa99c104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.326+0000 7fa9a3e00640 1 -- 172.21.15.8:0/408149618 >> 172.21.15.8:0/408149618 conn(0x7fa99c0fb970 msgr2=0x7fa99c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:44.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.326+0000 7fa9a3e00640 1 -- 172.21.15.8:0/408149618 shutdown_connections 2024-03-16T20:56:44.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.326+0000 7fa9a3e00640 1 -- 172.21.15.8:0/408149618 wait complete. 2024-03-16T20:56:44.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.327+0000 7fa9a3e00640 1 Processor -- start 2024-03-16T20:56:44.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.327+0000 7fa9a3e00640 1 -- start start 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.327+0000 7fa9a3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c101f80 0x7fa99c1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.327+0000 7fa9a3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa99c1048b0 0x7fa99c199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.327+0000 7fa9a3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa99c1071e0 0x7fa99c1a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.327+0000 7fa9a3e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c1a13c0 con 0x7fa99c1071e0 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.327+0000 7fa9a3e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c1a1530 con 0x7fa99c1048b0 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.327+0000 7fa9a3e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c1a16f0 con 0x7fa99c101f80 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.328+0000 7fa9a1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c101f80 0x7fa99c1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.328+0000 7fa9a1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c101f80 0x7fa99c1998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55150/0 (socket says 172.21.15.8:55150) 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.328+0000 7fa9a1400640 1 -- 172.21.15.8:0/1792382471 learned_addr learned my addr 172.21.15.8:0/1792382471 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.328+0000 7fa9a0a00640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa99c1048b0 0x7fa99c199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.328+0000 7fa9a1e00640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa99c1071e0 0x7fa99c1a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:44.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.328+0000 7fa9a1400640 1 -- 172.21.15.8:0/1792382471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa99c1048b0 msgr2=0x7fa99c199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:44.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.328+0000 7fa9a1400640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa99c1048b0 0x7fa99c199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.328+0000 7fa9a1400640 1 -- 172.21.15.8:0/1792382471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa99c1071e0 msgr2=0x7fa99c1a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:44.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.328+0000 7fa9a1400640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa99c1071e0 0x7fa99c1a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.328+0000 7fa9a1400640 1 -- 172.21.15.8:0/1792382471 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa988009560 con 0x7fa99c101f80 2024-03-16T20:56:44.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.328+0000 7fa9a1400640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c101f80 0x7fa99c1998d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa99000e9f0 tx=0x7fa99000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:44.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.329+0000 7fa99a000640 1 -- 172.21.15.8:0/1792382471 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990009700 con 0x7fa99c101f80 2024-03-16T20:56:44.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.329+0000 7fa99a000640 1 -- 172.21.15.8:0/1792382471 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa99000cd80 con 0x7fa99c101f80 2024-03-16T20:56:44.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.329+0000 7fa9a3e00640 1 -- 172.21.15.8:0/1792382471 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c1a19d0 con 0x7fa99c101f80 2024-03-16T20:56:44.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.329+0000 7fa99a000640 1 -- 172.21.15.8:0/1792382471 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9900189c0 con 0x7fa99c101f80 2024-03-16T20:56:44.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.329+0000 7fa9a3e00640 1 -- 172.21.15.8:0/1792382471 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c1a1eb0 con 0x7fa99c101f80 2024-03-16T20:56:44.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.330+0000 7fa9a3e00640 1 -- 172.21.15.8:0/1792382471 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c108cd0 con 0x7fa99c101f80 2024-03-16T20:56:44.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.332+0000 7fa99a000640 1 -- 172.21.15.8:0/1792382471 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fa990018b20 con 0x7fa99c101f80 2024-03-16T20:56:44.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.333+0000 7fa99a000640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa9840a1a30 0x7fa9840a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:44.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.333+0000 7fa99a000640 1 -- 172.21.15.8:0/1792382471 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa990014070 con 0x7fa99c101f80 2024-03-16T20:56:44.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.334+0000 7fa9a0a00640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa9840a1a30 0x7fa9840a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:44.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.334+0000 7fa9a0a00640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa9840a1a30 0x7fa9840a3ef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa98802c170 tx=0x7fa988000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:44.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.337+0000 7fa99a000640 1 -- 172.21.15.8:0/1792382471 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa990053280 con 0x7fa99c101f80 2024-03-16T20:56:44.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.541+0000 7fa9a3e00640 1 -- 172.21.15.8:0/1792382471 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa99c10d060 con 0x7fa99c101f80 2024-03-16T20:56:44.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.543+0000 7fa99a000640 1 -- 172.21.15.8:0/1792382471 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22581 (secure 0 0 0) 0x7fa9900969c0 con 0x7fa99c101f80 2024-03-16T20:56:44.548 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:56:44.549 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:56:04.502777+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:56:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 -- 172.21.15.8:0/1792382471 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa9840a1a30 msgr2=0x7fa9840a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa9840a1a30 0x7fa9840a3ef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa98802c170 tx=0x7fa988000bc0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 -- 172.21.15.8:0/1792382471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c101f80 msgr2=0x7fa99c1998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c101f80 0x7fa99c1998d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa99000e9f0 tx=0x7fa99000eeb0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 -- 172.21.15.8:0/1792382471 shutdown_connections 2024-03-16T20:56:44.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa9840a1a30 0x7fa9840a3ef0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa99c1071e0 0x7fa99c1a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa99c1048b0 0x7fa99c199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 --2- 172.21.15.8:0/1792382471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c101f80 0x7fa99c1998d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 -- 172.21.15.8:0/1792382471 >> 172.21.15.8:0/1792382471 conn(0x7fa99c0fb970 msgr2=0x7fa99c101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 -- 172.21.15.8:0/1792382471 shutdown_connections 2024-03-16T20:56:44.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.546+0000 7fa9a3e00640 1 -- 172.21.15.8:0/1792382471 wait complete. 2024-03-16T20:56:44.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T20:55:02.896774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T20:55:04.228958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T20:56:44.572 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T20:56:44.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.798+0000 7f5513200640 1 -- 172.21.15.8:0/1635514418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55141051c0 msgr2=0x7f551410ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.798+0000 7f5513200640 1 --2- 172.21.15.8:0/1635514418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55141051c0 0x7f551410ba50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f550c009ca0 tx=0x7f550c02c100 comp rx=0 tx=0).stop 2024-03-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.798+0000 7f5513200640 1 -- 172.21.15.8:0/1635514418 shutdown_connections 2024-03-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.798+0000 7f5513200640 1 --2- 172.21.15.8:0/1635514418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55141051c0 0x7f551410ba50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.798+0000 7f5513200640 1 --2- 172.21.15.8:0/1635514418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5514104800 0x7f5514104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.798+0000 7f5513200640 1 --2- 172.21.15.8:0/1635514418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5514103610 0x7f5514103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.798+0000 7f5513200640 1 -- 172.21.15.8:0/1635514418 >> 172.21.15.8:0/1635514418 conn(0x7f55140feba0 msgr2=0x7f5514100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.798+0000 7f5513200640 1 -- 172.21.15.8:0/1635514418 shutdown_connections 2024-03-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.798+0000 7f5513200640 1 -- 172.21.15.8:0/1635514418 wait complete. 2024-03-16T20:56:44.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.800+0000 7f5513200640 1 Processor -- start 2024-03-16T20:56:44.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.800+0000 7f5513200640 1 -- start start 2024-03-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.800+0000 7f5513200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5514103610 0x7f55141996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.800+0000 7f5513200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5514104800 0x7f5514199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.800+0000 7f5513200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55141051c0 0x7f55141a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.800+0000 7f5513200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55141a11a0 con 0x7f5514103610 2024-03-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.800+0000 7f5513200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55141a1310 con 0x7f55141051c0 2024-03-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.800+0000 7f5513200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55141a14d0 con 0x7f5514104800 2024-03-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5511e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5514103610 0x7f55141996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:44.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5509400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5514104800 0x7f5514199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5512800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55141051c0 0x7f55141a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5512800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55141051c0 0x7f55141a0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58836/0 (socket says 172.21.15.8:58836) 2024-03-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5509400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5514104800 0x7f5514199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55162/0 (socket says 172.21.15.8:55162) 2024-03-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5512800640 1 -- 172.21.15.8:0/454104813 learned_addr learned my addr 172.21.15.8:0/454104813 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5512800640 1 -- 172.21.15.8:0/454104813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5514104800 msgr2=0x7f5514199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5512800640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5514104800 0x7f5514199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5512800640 1 -- 172.21.15.8:0/454104813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5514103610 msgr2=0x7f55141996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5512800640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5514103610 0x7f55141996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5512800640 1 -- 172.21.15.8:0/454104813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c009900 con 0x7f55141051c0 2024-03-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5509400640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5514104800 0x7f5514199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:44.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.801+0000 7f5512800640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55141051c0 0x7f55141a0c60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f550c02c640 tx=0x7f550c032a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.802+0000 7f550b400640 1 -- 172.21.15.8:0/454104813 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c034850 con 0x7f55141051c0 2024-03-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.802+0000 7f550b400640 1 -- 172.21.15.8:0/454104813 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f550c003e70 con 0x7f55141051c0 2024-03-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.802+0000 7f550b400640 1 -- 172.21.15.8:0/454104813 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c03f440 con 0x7f55141051c0 2024-03-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.802+0000 7f5513200640 1 -- 172.21.15.8:0/454104813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55141a1750 con 0x7f55141051c0 2024-03-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.802+0000 7f5513200640 1 -- 172.21.15.8:0/454104813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55141a1bb0 con 0x7f55141051c0 2024-03-16T20:56:44.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.803+0000 7f5513200640 1 -- 172.21.15.8:0/454104813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551410a860 con 0x7f55141051c0 2024-03-16T20:56:44.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.805+0000 7f550b400640 1 -- 172.21.15.8:0/454104813 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f550c03b040 con 0x7f55141051c0 2024-03-16T20:56:44.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.806+0000 7f550b400640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54f80a1ab0 0x7f54f80a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:44.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.807+0000 7f550b400640 1 -- 172.21.15.8:0/454104813 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f550c0efe60 con 0x7f55141051c0 2024-03-16T20:56:44.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.807+0000 7f5511e00640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54f80a1ab0 0x7f54f80a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:44.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.807+0000 7f5511e00640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54f80a1ab0 0x7f54f80a3f70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5514104660 tx=0x7f5504005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:44.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:44.810+0000 7f550b400640 1 -- 172.21.15.8:0/454104813 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f550c0b9020 con 0x7f55141051c0 2024-03-16T20:56:44.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:44 smithi008 ceph-mon[31434]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:44.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:44 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3427386148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:56:44.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:44 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1792382471' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:56:45.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.012+0000 7f5513200640 1 -- 172.21.15.8:0/454104813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f551402d000 con 0x7f55141051c0 2024-03-16T20:56:45.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.013+0000 7f550b400640 1 -- 172.21.15.8:0/454104813 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f550c0bc6e0 con 0x7f55141051c0 2024-03-16T20:56:45.018 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T20:56:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 -- 172.21.15.8:0/454104813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54f80a1ab0 msgr2=0x7f54f80a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54f80a1ab0 0x7f54f80a3f70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5514104660 tx=0x7f5504005f90 comp rx=0 tx=0).stop 2024-03-16T20:56:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 -- 172.21.15.8:0/454104813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55141051c0 msgr2=0x7f55141a0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55141051c0 0x7f55141a0c60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f550c02c640 tx=0x7f550c032a70 comp rx=0 tx=0).stop 2024-03-16T20:56:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 -- 172.21.15.8:0/454104813 shutdown_connections 2024-03-16T20:56:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f54f80a1ab0 0x7f54f80a3f70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55141051c0 0x7f55141a0c60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5514104800 0x7f5514199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 --2- 172.21.15.8:0/454104813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5514103610 0x7f55141996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 -- 172.21.15.8:0/454104813 >> 172.21.15.8:0/454104813 conn(0x7f55140feba0 msgr2=0x7f5514107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:45.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 -- 172.21.15.8:0/454104813 shutdown_connections 2024-03-16T20:56:45.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.016+0000 7f5513200640 1 -- 172.21.15.8:0/454104813 wait complete. 2024-03-16T20:56:45.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T20:56:45.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:44 smithi170 ceph-mon[35947]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:45.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:44 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3427386148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:56:45.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:44 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1792382471' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:56:45.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:44 smithi186 ceph-mon[36391]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:45.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:44 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3427386148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:56:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:44 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1792382471' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:56:45.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.265+0000 7fb672a00640 1 -- 172.21.15.8:0/2453770778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c101e50 msgr2=0x7fb66c104240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.265+0000 7fb672a00640 1 --2- 172.21.15.8:0/2453770778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c101e50 0x7fb66c104240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009900 tx=0x7fb65c02bc30 comp rx=0 tx=0).stop 2024-03-16T20:56:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.265+0000 7fb672a00640 1 -- 172.21.15.8:0/2453770778 shutdown_connections 2024-03-16T20:56:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.265+0000 7fb672a00640 1 --2- 172.21.15.8:0/2453770778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb66c1070b0 0x7fb66c109500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.265+0000 7fb672a00640 1 --2- 172.21.15.8:0/2453770778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb66c104780 0x7fb66c106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.265+0000 7fb672a00640 1 --2- 172.21.15.8:0/2453770778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c101e50 0x7fb66c104240 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.265+0000 7fb672a00640 1 -- 172.21.15.8:0/2453770778 >> 172.21.15.8:0/2453770778 conn(0x7fb66c0fb860 msgr2=0x7fb66c0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.265+0000 7fb672a00640 1 -- 172.21.15.8:0/2453770778 shutdown_connections 2024-03-16T20:56:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.266+0000 7fb672a00640 1 -- 172.21.15.8:0/2453770778 wait complete. 2024-03-16T20:56:45.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.267+0000 7fb672a00640 1 Processor -- start 2024-03-16T20:56:45.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.267+0000 7fb672a00640 1 -- start start 2024-03-16T20:56:45.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.267+0000 7fb672a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb66c101e50 0x7fb66c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:45.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.267+0000 7fb672a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c104780 0x7fb66c199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:45.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb672a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb66c1070b0 0x7fb66c1a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:45.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb672a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c1a12a0 con 0x7fb66c101e50 2024-03-16T20:56:45.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb672a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c1a1410 con 0x7fb66c104780 2024-03-16T20:56:45.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb672a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c1a15d0 con 0x7fb66c1070b0 2024-03-16T20:56:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb670c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c104780 0x7fb66c199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb671600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb66c101e50 0x7fb66c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb670c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c104780 0x7fb66c199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58848/0 (socket says 172.21.15.8:58848) 2024-03-16T20:56:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb670c00640 1 -- 172.21.15.8:0/1669302528 learned_addr learned my addr 172.21.15.8:0/1669302528 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb672000640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb66c1070b0 0x7fb66c1a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb670c00640 1 -- 172.21.15.8:0/1669302528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb66c1070b0 msgr2=0x7fb66c1a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb670c00640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb66c1070b0 0x7fb66c1a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb670c00640 1 -- 172.21.15.8:0/1669302528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb66c101e50 msgr2=0x7fb66c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb670c00640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb66c101e50 0x7fb66c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.268+0000 7fb670c00640 1 -- 172.21.15.8:0/1669302528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664009490 con 0x7fb66c104780 2024-03-16T20:56:45.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.269+0000 7fb670c00640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c104780 0x7fb66c199d60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb65800eb90 tx=0x7fb65800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:45.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.269+0000 7fb66a000640 1 -- 172.21.15.8:0/1669302528 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6580099b0 con 0x7fb66c104780 2024-03-16T20:56:45.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.269+0000 7fb66a000640 1 -- 172.21.15.8:0/1669302528 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb65800ee90 con 0x7fb66c104780 2024-03-16T20:56:45.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.269+0000 7fb66a000640 1 -- 172.21.15.8:0/1669302528 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658018bd0 con 0x7fb66c104780 2024-03-16T20:56:45.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.269+0000 7fb672a00640 1 -- 172.21.15.8:0/1669302528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65c009560 con 0x7fb66c104780 2024-03-16T20:56:45.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.269+0000 7fb672a00640 1 -- 172.21.15.8:0/1669302528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c1a1c30 con 0x7fb66c104780 2024-03-16T20:56:45.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.270+0000 7fb672a00640 1 -- 172.21.15.8:0/1669302528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c108c00 con 0x7fb66c104780 2024-03-16T20:56:45.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.273+0000 7fb66a000640 1 -- 172.21.15.8:0/1669302528 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fb658018d30 con 0x7fb66c104780 2024-03-16T20:56:45.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.274+0000 7fb66a000640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6500a1a30 0x7fb6500a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:45.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.274+0000 7fb66a000640 1 -- 172.21.15.8:0/1669302528 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb658014070 con 0x7fb66c104780 2024-03-16T20:56:45.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.274+0000 7fb671600640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6500a1a30 0x7fb6500a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:45.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.275+0000 7fb671600640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6500a1a30 0x7fb6500a3ef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb65c02c240 tx=0x7fb65c02c8b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:45.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.282+0000 7fb66a000640 1 -- 172.21.15.8:0/1669302528 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb658053280 con 0x7fb66c104780 2024-03-16T20:56:45.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.485+0000 7fb672a00640 1 -- 172.21.15.8:0/1669302528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb66c02cf60 con 0x7fb66c104780 2024-03-16T20:56:45.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.486+0000 7fb66a000640 1 -- 172.21.15.8:0/1669302528 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb658096cd0 con 0x7fb66c104780 2024-03-16T20:56:45.491 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-16T20:56:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.488+0000 7fb672a00640 1 -- 172.21.15.8:0/1669302528 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6500a1a30 msgr2=0x7fb6500a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.488+0000 7fb672a00640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6500a1a30 0x7fb6500a3ef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb65c02c240 tx=0x7fb65c02c8b0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.488+0000 7fb672a00640 1 -- 172.21.15.8:0/1669302528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c104780 msgr2=0x7fb66c199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.488+0000 7fb672a00640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c104780 0x7fb66c199d60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb65800eb90 tx=0x7fb65800c6a0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.489+0000 7fb672a00640 1 -- 172.21.15.8:0/1669302528 shutdown_connections 2024-03-16T20:56:45.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.489+0000 7fb672a00640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6500a1a30 0x7fb6500a3ef0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.489+0000 7fb672a00640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb66c1070b0 0x7fb66c1a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.489+0000 7fb672a00640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c104780 0x7fb66c199d60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.489+0000 7fb672a00640 1 --2- 172.21.15.8:0/1669302528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb66c101e50 0x7fb66c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.489+0000 7fb672a00640 1 -- 172.21.15.8:0/1669302528 >> 172.21.15.8:0/1669302528 conn(0x7fb66c0fb860 msgr2=0x7fb66c101540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:45.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.489+0000 7fb672a00640 1 -- 172.21.15.8:0/1669302528 shutdown_connections 2024-03-16T20:56:45.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.489+0000 7fb672a00640 1 -- 172.21.15.8:0/1669302528 wait complete. 2024-03-16T20:56:45.515 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T20:56:45.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.737+0000 7f6eafe00640 1 -- 172.21.15.8:0/4088241749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6eb01047e0 msgr2=0x7f6eb0104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.737+0000 7f6eafe00640 1 --2- 172.21.15.8:0/4088241749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6eb01047e0 0x7f6eb0104c60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009900 tx=0x7f6e9c02bc40 comp rx=0 tx=0).stop 2024-03-16T20:56:45.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.737+0000 7f6eafe00640 1 -- 172.21.15.8:0/4088241749 shutdown_connections 2024-03-16T20:56:45.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.737+0000 7f6eafe00640 1 --2- 172.21.15.8:0/4088241749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6eb01051a0 0x7f6eb010ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.737+0000 7f6eafe00640 1 --2- 172.21.15.8:0/4088241749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6eb01047e0 0x7f6eb0104c60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.737+0000 7f6eafe00640 1 --2- 172.21.15.8:0/4088241749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6eb01035f0 0x7f6eb0103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.737+0000 7f6eafe00640 1 -- 172.21.15.8:0/4088241749 >> 172.21.15.8:0/4088241749 conn(0x7f6eb00feb60 msgr2=0x7f6eb0100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:45.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.737+0000 7f6eafe00640 1 -- 172.21.15.8:0/4088241749 shutdown_connections 2024-03-16T20:56:45.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.737+0000 7f6eafe00640 1 -- 172.21.15.8:0/4088241749 wait complete. 2024-03-16T20:56:45.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.738+0000 7f6eafe00640 1 Processor -- start 2024-03-16T20:56:45.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eafe00640 1 -- start start 2024-03-16T20:56:45.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eafe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6eb01035f0 0x7f6eb0199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:45.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eafe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6eb01047e0 0x7f6eb0199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:45.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eafe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6eb01051a0 0x7f6eb01a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:45.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eafe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb01a1210 con 0x7f6eb01051a0 2024-03-16T20:56:45.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eafe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb01a1380 con 0x7f6eb01047e0 2024-03-16T20:56:45.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eafe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb01a1540 con 0x7f6eb01035f0 2024-03-16T20:56:45.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eaea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6eb01035f0 0x7f6eb0199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:45.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eaea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6eb01035f0 0x7f6eb0199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55214/0 (socket says 172.21.15.8:55214) 2024-03-16T20:56:45.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eaea00640 1 -- 172.21.15.8:0/1353454432 learned_addr learned my addr 172.21.15.8:0/1353454432 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:45.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eae000640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6eb01047e0 0x7f6eb0199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:45.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.739+0000 7f6eaf400640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6eb01051a0 0x7f6eb01a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:45.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6eae000640 1 -- 172.21.15.8:0/1353454432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6eb01035f0 msgr2=0x7f6eb0199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6eae000640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6eb01035f0 0x7f6eb0199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6eae000640 1 -- 172.21.15.8:0/1353454432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6eb01051a0 msgr2=0x7f6eb01a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6eae000640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6eb01051a0 0x7f6eb01a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6eae000640 1 -- 172.21.15.8:0/1353454432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c009560 con 0x7f6eb01047e0 2024-03-16T20:56:45.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6eaea00640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6eb01035f0 0x7f6eb0199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:45.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6eaf400640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6eb01051a0 0x7f6eb01a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:56:45.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6eae000640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6eb01047e0 0x7f6eb0199c60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c036040 tx=0x7f6e9c005e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:45.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6ea7400640 1 -- 172.21.15.8:0/1353454432 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c004490 con 0x7f6eb01047e0 2024-03-16T20:56:45.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6ea7400640 1 -- 172.21.15.8:0/1353454432 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6e9c005310 con 0x7f6eb01047e0 2024-03-16T20:56:45.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6ea7400640 1 -- 172.21.15.8:0/1353454432 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c003d60 con 0x7f6eb01047e0 2024-03-16T20:56:45.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6eafe00640 1 -- 172.21.15.8:0/1353454432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb01a17c0 con 0x7f6eb01047e0 2024-03-16T20:56:45.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.740+0000 7f6eafe00640 1 -- 172.21.15.8:0/1353454432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb01a1c50 con 0x7f6eb01047e0 2024-03-16T20:56:45.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.742+0000 7f6eafe00640 1 -- 172.21.15.8:0/1353454432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb010a840 con 0x7f6eb01047e0 2024-03-16T20:56:45.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.743+0000 7f6ea7400640 1 -- 172.21.15.8:0/1353454432 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f6e9c0035f0 con 0x7f6eb01047e0 2024-03-16T20:56:45.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.745+0000 7f6ea7400640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6e940a1a30 0x7f6e940a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:45.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.745+0000 7f6ea7400640 1 -- 172.21.15.8:0/1353454432 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6e9c0efba0 con 0x7f6eb01047e0 2024-03-16T20:56:45.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.745+0000 7f6eaea00640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6e940a1a30 0x7f6e940a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:45.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.746+0000 7f6eaea00640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6e940a1a30 0x7f6e940a3ef0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00104e0 tx=0x7f6ea000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:45.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.749+0000 7f6ea7400640 1 -- 172.21.15.8:0/1353454432 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6e9c0b8d60 con 0x7f6eb01047e0 2024-03-16T20:56:45.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.951+0000 7f6eafe00640 1 -- 172.21.15.8:0/1353454432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6eb002cf90 con 0x7f6eb01047e0 2024-03-16T20:56:45.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.951+0000 7f6ea7400640 1 -- 172.21.15.8:0/1353454432 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6e9c0430a0 con 0x7f6eb01047e0 2024-03-16T20:56:45.957 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-16T20:56:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 -- 172.21.15.8:0/1353454432 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6e940a1a30 msgr2=0x7f6e940a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6e940a1a30 0x7f6e940a3ef0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00104e0 tx=0x7f6ea000b410 comp rx=0 tx=0).stop 2024-03-16T20:56:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 -- 172.21.15.8:0/1353454432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6eb01047e0 msgr2=0x7f6eb0199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6eb01047e0 0x7f6eb0199c60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c036040 tx=0x7f6e9c005e40 comp rx=0 tx=0).stop 2024-03-16T20:56:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 -- 172.21.15.8:0/1353454432 shutdown_connections 2024-03-16T20:56:45.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6e940a1a30 0x7f6e940a3ef0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6eb01051a0 0x7f6eb01a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6eb01047e0 0x7f6eb0199c60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 --2- 172.21.15.8:0/1353454432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6eb01035f0 0x7f6eb0199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:45.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 -- 172.21.15.8:0/1353454432 >> 172.21.15.8:0/1353454432 conn(0x7f6eb00feb60 msgr2=0x7f6eb0107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:45.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 -- 172.21.15.8:0/1353454432 shutdown_connections 2024-03-16T20:56:45.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:45.954+0000 7f6eafe00640 1 -- 172.21.15.8:0/1353454432 wait complete. 2024-03-16T20:56:45.975 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:45 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/454104813' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:56:45.975 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:45 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1669302528' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:56:45.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:56:46.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:45 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/454104813' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:56:46.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:45 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1669302528' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:56:46.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:45 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/454104813' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:56:46.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:45 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1669302528' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:56:46.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.188+0000 7f0023c00640 1 -- 172.21.15.8:0/2672946347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f001c105b70 msgr2=0x7f001c107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:46.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.188+0000 7f0023c00640 1 --2- 172.21.15.8:0/2672946347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f001c105b70 0x7f001c107f60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0014009ca0 tx=0x7f001402c0f0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.188+0000 7f0023c00640 1 -- 172.21.15.8:0/2672946347 shutdown_connections 2024-03-16T20:56:46.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.188+0000 7f0023c00640 1 --2- 172.21.15.8:0/2672946347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f001c105b70 0x7f001c107f60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.188+0000 7f0023c00640 1 --2- 172.21.15.8:0/2672946347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f001c100e70 0x7f001c1012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.188+0000 7f0023c00640 1 --2- 172.21.15.8:0/2672946347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001c067a50 0x7f001c100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.188+0000 7f0023c00640 1 -- 172.21.15.8:0/2672946347 >> 172.21.15.8:0/2672946347 conn(0x7f001c0facf0 msgr2=0x7f001c0fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:46.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.188+0000 7f0023c00640 1 -- 172.21.15.8:0/2672946347 shutdown_connections 2024-03-16T20:56:46.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.188+0000 7f0023c00640 1 -- 172.21.15.8:0/2672946347 wait complete. 2024-03-16T20:56:46.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.189+0000 7f0023c00640 1 Processor -- start 2024-03-16T20:56:46.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.189+0000 7f0023c00640 1 -- start start 2024-03-16T20:56:46.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f0023c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f001c067a50 0x7f001c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:46.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f0023c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001c100e70 0x7f001c199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:46.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f0023c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f001c105b70 0x7f001c1a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:46.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f0023c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c1a1370 con 0x7f001c067a50 2024-03-16T20:56:46.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f0023c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c1a14e0 con 0x7f001c100e70 2024-03-16T20:56:46.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f0023c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c1a16a0 con 0x7f001c105b70 2024-03-16T20:56:46.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f001be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001c100e70 0x7f001c199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:46.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f001be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001c100e70 0x7f001c199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58876/0 (socket says 172.21.15.8:58876) 2024-03-16T20:56:46.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f001be00640 1 -- 172.21.15.8:0/432374688 learned_addr learned my addr 172.21.15.8:0/432374688 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:46.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f0021200640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f001c067a50 0x7f001c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:46.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f0021c00640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f001c105b70 0x7f001c1a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:46.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f001be00640 1 -- 172.21.15.8:0/432374688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f001c105b70 msgr2=0x7f001c1a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:46.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.190+0000 7f001be00640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f001c105b70 0x7f001c1a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.191+0000 7f001be00640 1 -- 172.21.15.8:0/432374688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f001c067a50 msgr2=0x7f001c199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:46.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.191+0000 7f001be00640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f001c067a50 0x7f001c199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.191+0000 7f001be00640 1 -- 172.21.15.8:0/432374688 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0014009900 con 0x7f001c100e70 2024-03-16T20:56:46.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.191+0000 7f001be00640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001c100e70 0x7f001c199dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f000800e9c0 tx=0x7f000800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:46.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.191+0000 7f0019600640 1 -- 172.21.15.8:0/432374688 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008009700 con 0x7f001c100e70 2024-03-16T20:56:46.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.191+0000 7f0023c00640 1 -- 172.21.15.8:0/432374688 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c1a1980 con 0x7f001c100e70 2024-03-16T20:56:46.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.191+0000 7f0019600640 1 -- 172.21.15.8:0/432374688 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f000800cd80 con 0x7f001c100e70 2024-03-16T20:56:46.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.191+0000 7f0019600640 1 -- 172.21.15.8:0/432374688 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008010690 con 0x7f001c100e70 2024-03-16T20:56:46.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.191+0000 7f0023c00640 1 -- 172.21.15.8:0/432374688 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c1a1e90 con 0x7f001c100e70 2024-03-16T20:56:46.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.192+0000 7f0023c00640 1 -- 172.21.15.8:0/432374688 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c10d080 con 0x7f001c100e70 2024-03-16T20:56:46.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.195+0000 7f0019600640 1 -- 172.21.15.8:0/432374688 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f0008003710 con 0x7f001c100e70 2024-03-16T20:56:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.197+0000 7f0019600640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f00040a1a30 0x7f00040a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.197+0000 7f0019600640 1 -- 172.21.15.8:0/432374688 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0008014070 con 0x7f001c100e70 2024-03-16T20:56:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.197+0000 7f0021200640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f00040a1a30 0x7f00040a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.198+0000 7f0021200640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f00040a1a30 0x7f00040a3ef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f001c100790 tx=0x7f0010005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:46.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.202+0000 7f0019600640 1 -- 172.21.15.8:0/432374688 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0008096bb0 con 0x7f001c100e70 2024-03-16T20:56:46.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.446+0000 7f0023c00640 1 -- 172.21.15.8:0/432374688 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f001c1a20e0 con 0x7f001c100e70 2024-03-16T20:56:46.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.448+0000 7f0019600640 1 -- 172.21.15.8:0/432374688 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f000809a270 con 0x7f001c100e70 2024-03-16T20:56:46.453 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:56:46.453 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:55:10.355515+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24593,24544]},"id":1}]} 2024-03-16T20:56:46.453 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.450+0000 7f0023c00640 1 -- 172.21.15.8:0/432374688 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f00040a1a30 msgr2=0x7f00040a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.450+0000 7f0023c00640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f00040a1a30 0x7f00040a3ef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f001c100790 tx=0x7f0010005f90 comp rx=0 tx=0).stop 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.450+0000 7f0023c00640 1 -- 172.21.15.8:0/432374688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001c100e70 msgr2=0x7f001c199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.450+0000 7f0023c00640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001c100e70 0x7f001c199dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f000800e9c0 tx=0x7f000800ee80 comp rx=0 tx=0).stop 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.451+0000 7f0023c00640 1 -- 172.21.15.8:0/432374688 shutdown_connections 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.451+0000 7f0023c00640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f00040a1a30 0x7f00040a3ef0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.451+0000 7f0023c00640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f001c105b70 0x7f001c1a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.451+0000 7f0023c00640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001c100e70 0x7f001c199dc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.451+0000 7f0023c00640 1 --2- 172.21.15.8:0/432374688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f001c067a50 0x7f001c199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.451+0000 7f0023c00640 1 -- 172.21.15.8:0/432374688 >> 172.21.15.8:0/432374688 conn(0x7f001c0facf0 msgr2=0x7f001c0fb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.451+0000 7f0023c00640 1 -- 172.21.15.8:0/432374688 shutdown_connections 2024-03-16T20:56:46.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.451+0000 7f0023c00640 1 -- 172.21.15.8:0/432374688 wait complete. 2024-03-16T20:56:46.475 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:56:46.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.681+0000 7ff679a00640 1 -- 172.21.15.8:0/1950072644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6740770f0 msgr2=0x7ff674077550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:46.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.681+0000 7ff679a00640 1 --2- 172.21.15.8:0/1950072644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6740770f0 0x7ff674077550 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff660009900 tx=0x7ff66002bc30 comp rx=0 tx=0).stop 2024-03-16T20:56:46.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.682+0000 7ff679a00640 1 -- 172.21.15.8:0/1950072644 shutdown_connections 2024-03-16T20:56:46.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.682+0000 7ff679a00640 1 --2- 172.21.15.8:0/1950072644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff674077a90 0x7ff674078330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.682+0000 7ff679a00640 1 --2- 172.21.15.8:0/1950072644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6740770f0 0x7ff674077550 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.682+0000 7ff679a00640 1 --2- 172.21.15.8:0/1950072644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff674075eb0 0x7ff6740762d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.682+0000 7ff679a00640 1 -- 172.21.15.8:0/1950072644 >> 172.21.15.8:0/1950072644 conn(0x7ff6740fece0 msgr2=0x7ff674101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:46.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.682+0000 7ff679a00640 1 -- 172.21.15.8:0/1950072644 shutdown_connections 2024-03-16T20:56:46.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.682+0000 7ff679a00640 1 -- 172.21.15.8:0/1950072644 wait complete. 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff679a00640 1 Processor -- start 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff679a00640 1 -- start start 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff679a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff674075eb0 0x7ff67419dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff679a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6740770f0 0x7ff67419e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff679a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff674077a90 0x7ff6741a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff679a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6741a5780 con 0x7ff674077a90 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff679a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6741a58f0 con 0x7ff6740770f0 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff679a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6741a5ab0 con 0x7ff674075eb0 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff672a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff674075eb0 0x7ff67419dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff672000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6740770f0 0x7ff67419e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff672a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff674075eb0 0x7ff67419dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55244/0 (socket says 172.21.15.8:55244) 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff672000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6740770f0 0x7ff67419e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58900/0 (socket says 172.21.15.8:58900) 2024-03-16T20:56:46.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff672a00640 1 -- 172.21.15.8:0/4069193372 learned_addr learned my addr 172.21.15.8:0/4069193372 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:46.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.683+0000 7ff673400640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff674077a90 0x7ff6741a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:46.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.684+0000 7ff672a00640 1 -- 172.21.15.8:0/4069193372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6740770f0 msgr2=0x7ff67419e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:46.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.684+0000 7ff672a00640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6740770f0 0x7ff67419e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.684+0000 7ff672a00640 1 -- 172.21.15.8:0/4069193372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff674077a90 msgr2=0x7ff6741a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:46.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.684+0000 7ff672a00640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff674077a90 0x7ff6741a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.684+0000 7ff672a00640 1 -- 172.21.15.8:0/4069193372 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff660009560 con 0x7ff674075eb0 2024-03-16T20:56:46.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.684+0000 7ff672000640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6740770f0 0x7ff67419e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:46.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.684+0000 7ff672a00640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff674075eb0 0x7ff67419dc70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff66400e9f0 tx=0x7ff66400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:46.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.684+0000 7ff66b400640 1 -- 172.21.15.8:0/4069193372 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664009700 con 0x7ff674075eb0 2024-03-16T20:56:46.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.684+0000 7ff66b400640 1 -- 172.21.15.8:0/4069193372 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff66400cd80 con 0x7ff674075eb0 2024-03-16T20:56:46.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.684+0000 7ff679a00640 1 -- 172.21.15.8:0/4069193372 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6741a5d90 con 0x7ff674075eb0 2024-03-16T20:56:46.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.684+0000 7ff66b400640 1 -- 172.21.15.8:0/4069193372 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6640189c0 con 0x7ff674075eb0 2024-03-16T20:56:46.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.685+0000 7ff679a00640 1 -- 172.21.15.8:0/4069193372 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6741a6200 con 0x7ff674075eb0 2024-03-16T20:56:46.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.686+0000 7ff679a00640 1 -- 172.21.15.8:0/4069193372 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6741101e0 con 0x7ff674075eb0 2024-03-16T20:56:46.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.688+0000 7ff66b400640 1 -- 172.21.15.8:0/4069193372 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7ff664018b20 con 0x7ff674075eb0 2024-03-16T20:56:46.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.689+0000 7ff66b400640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff6580a1ab0 0x7ff6580a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:46.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.689+0000 7ff66b400640 1 -- 172.21.15.8:0/4069193372 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff664014070 con 0x7ff674075eb0 2024-03-16T20:56:46.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.689+0000 7ff672000640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff6580a1ab0 0x7ff6580a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:46.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.690+0000 7ff672000640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff6580a1ab0 0x7ff6580a3f70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff660006010 tx=0x7ff660000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:46.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.695+0000 7ff66b400640 1 -- 172.21.15.8:0/4069193372 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff664053280 con 0x7ff674075eb0 2024-03-16T20:56:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:46 smithi008 ceph-mon[31434]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:46 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1353454432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:56:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:46 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/432374688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:56:46.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.897+0000 7ff679a00640 1 -- 172.21.15.8:0/4069193372 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff67402d0e0 con 0x7ff674075eb0 2024-03-16T20:56:46.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.899+0000 7ff66b400640 1 -- 172.21.15.8:0/4069193372 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22581 (secure 0 0 0) 0x7ff664096960 con 0x7ff674075eb0 2024-03-16T20:56:46.904 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:56:46.904 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:56:04.502777+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:56:46.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 -- 172.21.15.8:0/4069193372 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff6580a1ab0 msgr2=0x7ff6580a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:46.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff6580a1ab0 0x7ff6580a3f70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff660006010 tx=0x7ff660000bc0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 -- 172.21.15.8:0/4069193372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff674075eb0 msgr2=0x7ff67419dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:46.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff674075eb0 0x7ff67419dc70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff66400e9f0 tx=0x7ff66400eeb0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 -- 172.21.15.8:0/4069193372 shutdown_connections 2024-03-16T20:56:46.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff6580a1ab0 0x7ff6580a3f70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff674077a90 0x7ff6741a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6740770f0 0x7ff67419e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 --2- 172.21.15.8:0/4069193372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff674075eb0 0x7ff67419dc70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:46.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 -- 172.21.15.8:0/4069193372 >> 172.21.15.8:0/4069193372 conn(0x7ff6740fece0 msgr2=0x7ff674100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:46.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 -- 172.21.15.8:0/4069193372 shutdown_connections 2024-03-16T20:56:46.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:46.902+0000 7ff679a00640 1 -- 172.21.15.8:0/4069193372 wait complete. 2024-03-16T20:56:46.925 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:56:47.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:46 smithi170 ceph-mon[35947]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:47.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:46 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1353454432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:56:47.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:46 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/432374688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:56:47.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.135+0000 7f9fe6400640 1 -- 172.21.15.8:0/568339029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fe01052e0 msgr2=0x7f9fe010bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.135+0000 7f9fe6400640 1 --2- 172.21.15.8:0/568339029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fe01052e0 0x7f9fe010bb70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009ca0 tx=0x7f9fd802c100 comp rx=0 tx=0).stop 2024-03-16T20:56:47.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.135+0000 7f9fe6400640 1 -- 172.21.15.8:0/568339029 shutdown_connections 2024-03-16T20:56:47.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.135+0000 7f9fe6400640 1 --2- 172.21.15.8:0/568339029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fe01052e0 0x7f9fe010bb70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.135+0000 7f9fe6400640 1 --2- 172.21.15.8:0/568339029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fe0104920 0x7f9fe0104da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.135+0000 7f9fe6400640 1 --2- 172.21.15.8:0/568339029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fe0103730 0x7f9fe0103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.135+0000 7f9fe6400640 1 -- 172.21.15.8:0/568339029 >> 172.21.15.8:0/568339029 conn(0x7f9fe00feca0 msgr2=0x7f9fe01010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.136+0000 7f9fe6400640 1 -- 172.21.15.8:0/568339029 shutdown_connections 2024-03-16T20:56:47.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.136+0000 7f9fe6400640 1 -- 172.21.15.8:0/568339029 wait complete. 2024-03-16T20:56:47.219 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:46 smithi186 ceph-mon[36391]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:56:47.219 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:46 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1353454432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:56:47.219 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:46 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/432374688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:56:47.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.136+0000 7f9fe6400640 1 Processor -- start 2024-03-16T20:56:47.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fe6400640 1 -- start start 2024-03-16T20:56:47.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fe6400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fe0103730 0x7f9fe0199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fe6400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fe0104920 0x7f9fe0199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fe6400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fe01052e0 0x7f9fe01a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fe6400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe01a1330 con 0x7f9fe01052e0 2024-03-16T20:56:47.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fe6400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe01a14a0 con 0x7f9fe0104920 2024-03-16T20:56:47.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fe6400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe01a1660 con 0x7f9fe0103730 2024-03-16T20:56:47.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fdf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fe0103730 0x7f9fe0199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fdf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fe0103730 0x7f9fe0199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55266/0 (socket says 172.21.15.8:55266) 2024-03-16T20:56:47.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fdf400640 1 -- 172.21.15.8:0/1218705813 learned_addr learned my addr 172.21.15.8:0/1218705813 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fdea00640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fe0104920 0x7f9fe0199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.137+0000 7f9fdfe00640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fe01052e0 0x7f9fe01a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.138+0000 7f9fdf400640 1 -- 172.21.15.8:0/1218705813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fe0104920 msgr2=0x7f9fe0199d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.138+0000 7f9fdf400640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fe0104920 0x7f9fe0199d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.138+0000 7f9fdf400640 1 -- 172.21.15.8:0/1218705813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fe01052e0 msgr2=0x7f9fe01a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.138+0000 7f9fdf400640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fe01052e0 0x7f9fe01a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.138+0000 7f9fdf400640 1 -- 172.21.15.8:0/1218705813 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8009900 con 0x7f9fe0103730 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.138+0000 7f9fdf400640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fe0103730 0x7f9fe0199840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000d770 tx=0x7f9fd000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.138+0000 7f9fd7e00640 1 -- 172.21.15.8:0/1218705813 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0009c30 con 0x7f9fe0103730 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.138+0000 7f9fd7e00640 1 -- 172.21.15.8:0/1218705813 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9fd000de80 con 0x7f9fe0103730 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.138+0000 7f9fd7e00640 1 -- 172.21.15.8:0/1218705813 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0010460 con 0x7f9fe0103730 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.138+0000 7f9fe6400640 1 -- 172.21.15.8:0/1218705813 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe01a1940 con 0x7f9fe0103730 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.138+0000 7f9fe6400640 1 -- 172.21.15.8:0/1218705813 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe01a1e00 con 0x7f9fe0103730 2024-03-16T20:56:47.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.139+0000 7f9fe6400640 1 -- 172.21.15.8:0/1218705813 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe010a980 con 0x7f9fe0103730 2024-03-16T20:56:47.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.141+0000 7f9fd7e00640 1 -- 172.21.15.8:0/1218705813 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f9fd0004000 con 0x7f9fe0103730 2024-03-16T20:56:47.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.143+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9fc40a1ab0 0x7f9fc40a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.143+0000 7f9fd7e00640 1 -- 172.21.15.8:0/1218705813 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9fd00cd050 con 0x7f9fe0103730 2024-03-16T20:56:47.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.143+0000 7f9fdea00640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9fc40a1ab0 0x7f9fc40a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.143+0000 7f9fdea00640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9fc40a1ab0 0x7f9fc40a3f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9fe019ad50 tx=0x7f9fcc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.145+0000 7f9fd7e00640 1 -- 172.21.15.8:0/1218705813 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9fd00963a0 con 0x7f9fe0103730 2024-03-16T20:56:47.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.387+0000 7f9fe6400640 1 -- 172.21.15.8:0/1218705813 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fe010f410 con 0x7f9fe0103730 2024-03-16T20:56:47.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.387+0000 7f9fd7e00640 1 -- 172.21.15.8:0/1218705813 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f9fe010f410 con 0x7f9fe0103730 2024-03-16T20:56:47.393 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:56:47.393 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:55:10.355515+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24593,24544]},"id":1}]} 2024-03-16T20:56:47.393 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2024-03-16T20:56:47.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.390+0000 7f9fe6400640 1 -- 172.21.15.8:0/1218705813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9fc40a1ab0 msgr2=0x7f9fc40a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.390+0000 7f9fe6400640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9fc40a1ab0 0x7f9fc40a3f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9fe019ad50 tx=0x7f9fcc00b410 comp rx=0 tx=0).stop 2024-03-16T20:56:47.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.390+0000 7f9fe6400640 1 -- 172.21.15.8:0/1218705813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fe0103730 msgr2=0x7f9fe0199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.390+0000 7f9fe6400640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fe0103730 0x7f9fe0199840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000d770 tx=0x7f9fd000dc30 comp rx=0 tx=0).stop 2024-03-16T20:56:47.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.390+0000 7f9fe6400640 1 -- 172.21.15.8:0/1218705813 shutdown_connections 2024-03-16T20:56:47.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.390+0000 7f9fe6400640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f9fc40a1ab0 0x7f9fc40a3f70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.390+0000 7f9fe6400640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fe01052e0 0x7f9fe01a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.390+0000 7f9fe6400640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fe0104920 0x7f9fe0199d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.390+0000 7f9fe6400640 1 --2- 172.21.15.8:0/1218705813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fe0103730 0x7f9fe0199840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.390+0000 7f9fe6400640 1 -- 172.21.15.8:0/1218705813 >> 172.21.15.8:0/1218705813 conn(0x7f9fe00feca0 msgr2=0x7f9fe0107b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.391+0000 7f9fe6400640 1 -- 172.21.15.8:0/1218705813 shutdown_connections 2024-03-16T20:56:47.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.391+0000 7f9fe6400640 1 -- 172.21.15.8:0/1218705813 wait complete. 2024-03-16T20:56:47.415 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-16T20:55:04.725491+0000', 'modified': '2024-03-16T20:55:10.355515+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24593, 'mds_1': 24544, 'mds_2': 24536}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24509': {'gid': 24509, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.170:6835/335822502', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6834', 'nonce': 335822502}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 335822502}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24511': {'gid': 24511, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6835/3505833451', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6834', 'nonce': 3505833451}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 3505833451}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24523': {'gid': 24523, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6837/1748602428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6836', 'nonce': 1748602428}, {'type': 'v1', 'addr': '172.21.15.186:6837', 'nonce': 1748602428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24536': {'gid': 24536, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.170:6837/3144558039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6836', 'nonce': 3144558039}, {'type': 'v1', 'addr': '172.21.15.170:6837', 'nonce': 3144558039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24544': {'gid': 24544, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.186:6839/1721589022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6838', 'nonce': 1721589022}, {'type': 'v1', 'addr': '172.21.15.186:6839', 'nonce': 1721589022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24593': {'gid': 24593, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6839/600336743', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6838', 'nonce': 600336743}, {'type': 'v1', 'addr': '172.21.15.170:6839', 'nonce': 600336743}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24593, 'qdb_cluster': [24536, 24593, 24544]} 2024-03-16T20:56:47.415 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-03-16T20:56:47.415 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.633+0000 7fa73e600640 1 -- 172.21.15.8:0/2397664939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738075530 msgr2=0x7fa738073980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.633+0000 7fa73e600640 1 --2- 172.21.15.8:0/2397664939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738075530 0x7fa738073980 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009860 tx=0x7fa72c02bb70 comp rx=0 tx=0).stop 2024-03-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.633+0000 7fa73e600640 1 -- 172.21.15.8:0/2397664939 shutdown_connections 2024-03-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.633+0000 7fa73e600640 1 --2- 172.21.15.8:0/2397664939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa738109290 0x7fa73810b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.633+0000 7fa73e600640 1 --2- 172.21.15.8:0/2397664939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738073f50 0x7fa7380743d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.633+0000 7fa73e600640 1 --2- 172.21.15.8:0/2397664939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738075530 0x7fa738073980 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.633+0000 7fa73e600640 1 -- 172.21.15.8:0/2397664939 >> 172.21.15.8:0/2397664939 conn(0x7fa7380fc960 msgr2=0x7fa7380fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.634+0000 7fa73e600640 1 -- 172.21.15.8:0/2397664939 shutdown_connections 2024-03-16T20:56:47.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.634+0000 7fa73e600640 1 -- 172.21.15.8:0/2397664939 wait complete. 2024-03-16T20:56:47.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.635+0000 7fa73e600640 1 Processor -- start 2024-03-16T20:56:47.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.635+0000 7fa73e600640 1 -- start start 2024-03-16T20:56:47.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.635+0000 7fa73e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738073f50 0x7fa738199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.635+0000 7fa73e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738075530 0x7fa738199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.635+0000 7fa73e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa738109290 0x7fa7381a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.635+0000 7fa73e600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381a1210 con 0x7fa738073f50 2024-03-16T20:56:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.635+0000 7fa73e600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381a1380 con 0x7fa738109290 2024-03-16T20:56:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.635+0000 7fa73e600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381a1540 con 0x7fa738075530 2024-03-16T20:56:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.636+0000 7fa73dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa738109290 0x7fa7381a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.636+0000 7fa73d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738073f50 0x7fa738199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.636+0000 7fa737e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738075530 0x7fa738199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.636+0000 7fa73dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa738109290 0x7fa7381a0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58934/0 (socket says 172.21.15.8:58934) 2024-03-16T20:56:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.636+0000 7fa73dc00640 1 -- 172.21.15.8:0/2513318621 learned_addr learned my addr 172.21.15.8:0/2513318621 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.636+0000 7fa73dc00640 1 -- 172.21.15.8:0/2513318621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738075530 msgr2=0x7fa738199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.636+0000 7fa73dc00640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738075530 0x7fa738199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.636+0000 7fa73dc00640 1 -- 172.21.15.8:0/2513318621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738073f50 msgr2=0x7fa738199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.636+0000 7fa73dc00640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738073f50 0x7fa738199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.636+0000 7fa73dc00640 1 -- 172.21.15.8:0/2513318621 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa730009840 con 0x7fa738109290 2024-03-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.636+0000 7fa73dc00640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa738109290 0x7fa7381a0cd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa73000efd0 tx=0x7fa73000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.637+0000 7fa735600640 1 -- 172.21.15.8:0/2513318621 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730009b40 con 0x7fa738109290 2024-03-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.637+0000 7fa735600640 1 -- 172.21.15.8:0/2513318621 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa730003b70 con 0x7fa738109290 2024-03-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.637+0000 7fa73e600640 1 -- 172.21.15.8:0/2513318621 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72c009490 con 0x7fa738109290 2024-03-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.637+0000 7fa735600640 1 -- 172.21.15.8:0/2513318621 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300108a0 con 0x7fa738109290 2024-03-16T20:56:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.637+0000 7fa73e600640 1 -- 172.21.15.8:0/2513318621 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7381a1ba0 con 0x7fa738109290 2024-03-16T20:56:47.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.640+0000 7fa7429d6740 1 Processor -- start 2024-03-16T20:56:47.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.640+0000 7fa735600640 1 -- 172.21.15.8:0/2513318621 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fa730003ce0 con 0x7fa738109290 2024-03-16T20:56:47.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.640+0000 7fa7429d6740 1 -- start start 2024-03-16T20:56:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e71b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e72150 0x55f8c3e76c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e772c0 0x55f8c3e79750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa7429d6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3de0b30 con 0x55f8c3e72150 2024-03-16T20:56:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa7429d6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3dde060 con 0x55f8c3e71760 2024-03-16T20:56:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa7429d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3dd9840 con 0x55f8c3e772c0 2024-03-16T20:56:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa737e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e71b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa737e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e71b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58946/0 (socket says 172.21.15.8:58946) 2024-03-16T20:56:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa737e00640 1 -- 172.21.15.8:0/884465237 learned_addr learned my addr 172.21.15.8:0/884465237 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa737e00640 1 --2- 172.21.15.8:0/884465237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e772c0 0x55f8c3e79750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa73d200640 1 --2- 172.21.15.8:0/884465237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e72150 0x55f8c3e76c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa737e00640 1 -- 172.21.15.8:0/884465237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e772c0 msgr2=0x55f8c3e79750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa737e00640 1 --2- 172.21.15.8:0/884465237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e772c0 0x55f8c3e79750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa737e00640 1 -- 172.21.15.8:0/884465237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e72150 msgr2=0x55f8c3e76c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa737e00640 1 --2- 172.21.15.8:0/884465237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e72150 0x55f8c3e76c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.641+0000 7fa737e00640 1 -- 172.21.15.8:0/884465237 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8c3da14c0 con 0x55f8c3e71760 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.642+0000 7fa737e00640 1 --2- 172.21.15.8:0/884465237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e71b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa7240058c0 tx=0x7fa724005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27ba5c2dd90a99b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.642+0000 7fa735600640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa7200a1ab0 0x7fa7200a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.642+0000 7fa72a000640 1 -- 172.21.15.8:0/884465237 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724004050 con 0x55f8c3e71760 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.642+0000 7fa72a000640 1 -- 172.21.15.8:0/884465237 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa724005520 con 0x55f8c3e71760 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.642+0000 7fa72a000640 1 -- 172.21.15.8:0/884465237 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724004c40 con 0x55f8c3e71760 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.642+0000 7fa735600640 1 -- 172.21.15.8:0/2513318621 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa730014070 con 0x7fa738109290 2024-03-16T20:56:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.642+0000 7fa73d200640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa7200a1ab0 0x7fa7200a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.643+0000 7fa7429d6740 1 -- 172.21.15.8:0/884465237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 msgr2=0x55f8c3e71b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.643+0000 7fa7429d6740 1 --2- 172.21.15.8:0/884465237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e71b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa7240058c0 tx=0x7fa724005850 comp rx=0 tx=0).stop 2024-03-16T20:56:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.643+0000 7fa7429d6740 1 -- 172.21.15.8:0/884465237 shutdown_connections 2024-03-16T20:56:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.643+0000 7fa7429d6740 1 --2- 172.21.15.8:0/884465237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e772c0 0x55f8c3e79750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.643+0000 7fa7429d6740 1 --2- 172.21.15.8:0/884465237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e72150 0x55f8c3e76c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.643+0000 7fa7429d6740 1 --2- 172.21.15.8:0/884465237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e71b80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.643+0000 7fa7429d6740 1 -- 172.21.15.8:0/884465237 >> 172.21.15.8:0/884465237 conn(0x55f8c3e6ccd0 msgr2=0x55f8c3e6d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.643+0000 7fa7429d6740 1 -- 172.21.15.8:0/884465237 shutdown_connections 2024-03-16T20:56:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.643+0000 7fa73d200640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa7200a1ab0 0x7fa7200a3f70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa72c02c180 tx=0x7fa72c034c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.643+0000 7fa7429d6740 1 -- 172.21.15.8:0/884465237 wait complete. 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.643+0000 7fa7429d6740 1 -- start start 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa7429d6740 1 Processor -- start 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e7b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e72150 0x55f8c3e7bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e772c0 0x55f8c3e82e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa7429d6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3d7eea0 con 0x55f8c3e72150 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa7429d6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3d7eb40 con 0x55f8c3e71760 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa7429d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3b21f20 con 0x55f8c3e772c0 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa7429d6740 10 client.0 _ll_register_callbacks cb 0x55f8c3d92950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa737e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e72150 0x55f8c3e7bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa73d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e7b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa737e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e72150 0x55f8c3e7bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52052/0 (socket says 172.21.15.8:52052) 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa737e00640 1 -- 172.21.15.8:0/1707715318 learned_addr learned my addr 172.21.15.8:0/1707715318 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa73dc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e772c0 0x55f8c3e82e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.644+0000 7fa73d200640 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e7b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58958/0 (socket says 172.21.15.8:58958) 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.645+0000 7fa73dc00640 1 -- 172.21.15.8:0/1707715318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 msgr2=0x55f8c3e7b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.645+0000 7fa73dc00640 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e7b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.645+0000 7fa73dc00640 1 -- 172.21.15.8:0/1707715318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e72150 msgr2=0x55f8c3e7bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.645+0000 7fa73dc00640 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e72150 0x55f8c3e7bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.645+0000 7fa73dc00640 1 -- 172.21.15.8:0/1707715318 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa724019040 con 0x55f8c3e772c0 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.645+0000 7fa73dc00640 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e772c0 0x55f8c3e82e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7300cb450 tx=0x7fa73009a220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3f601c968096688 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.645+0000 7fa71ea00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.645+0000 7fa71ea00640 1 -- 172.21.15.8:0/1707715318 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300b2070 con 0x55f8c3e772c0 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.645+0000 7fa71ea00640 1 -- 172.21.15.8:0/1707715318 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa73009ea10 con 0x55f8c3e772c0 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.645+0000 7fa7429d6740 1 -- 172.21.15.8:0/1707715318 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8c3dfdc40 con 0x55f8c3e772c0 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.646+0000 7fa71ea00640 1 -- 172.21.15.8:0/1707715318 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7300a3060 con 0x55f8c3e772c0 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.646+0000 7fa7429d6740 10 client.24997 fetch_fsmap learned FSMap version 23 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.646+0000 7fa7429d6740 1 -- 172.21.15.8:0/1707715318 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55f8c3dd7ec0 con 0x55f8c3e772c0 2024-03-16T20:56:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.646+0000 7fa71ea00640 1 -- 172.21.15.8:0/1707715318 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55f8c3dfdc40 con 0x55f8c3e772c0 2024-03-16T20:56:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.646+0000 7fa71ea00640 1 -- 172.21.15.8:0/1707715318 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fa730099da0 con 0x55f8c3e772c0 2024-03-16T20:56:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.646+0000 7fa7429d6740 10 client.24997 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:56:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.646+0000 7fa7429d6740 10 client.24997 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-16T20:56:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.646+0000 7fa7429d6740 20 client.24997 populate_metadata read hostname 'smithi008' 2024-03-16T20:56:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.646+0000 7fa7429d6740 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55f8c3e87e30 0x55f8c3e8c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.646+0000 7fa7429d6740 4 client.24997 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:56:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.646+0000 7fa7429d6740 1 -- 172.21.15.8:0/1707715318 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8c3ad96c0 con 0x55f8c3e87e30 2024-03-16T20:56:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.647+0000 7fa73d200640 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55f8c3e87e30 0x55f8c3e8c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.647+0000 7fa73d200640 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55f8c3e87e30 0x55f8c3e8c2b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=19a2e99946a16ed2 server_cookie=70bea52d25a381e6 in_seq=0 out_seq=0 2024-03-16T20:56:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.647+0000 7fa71ea00640 10 client.24997 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:56:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa71ea00640 1 -- 172.21.15.8:0/1707715318 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55f8c3ad96c0 con 0x55f8c3e87e30 2024-03-16T20:56:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa71ea00640 10 client.24997 handle_command_reply: tid=0 2024-03-16T20:56:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa7429d6740 1 client.24997 shutdown 2024-03-16T20:56:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa7429d6740 1 -- 172.21.15.8:0/1707715318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e772c0 msgr2=0x55f8c3e82e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa7429d6740 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e772c0 0x55f8c3e82e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7300cb450 tx=0x7fa73009a220 comp rx=0 tx=0).stop 2024-03-16T20:56:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa7429d6740 1 -- 172.21.15.8:0/1707715318 shutdown_connections 2024-03-16T20:56:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa7429d6740 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55f8c3e87e30 0x55f8c3e8c2b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa7429d6740 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e772c0 0x55f8c3e82e00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa7429d6740 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e72150 0x55f8c3e7bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa7429d6740 1 --2- 172.21.15.8:0/1707715318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e7b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa71ea00640 0 client.24997 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:56:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa7429d6740 1 -- 172.21.15.8:0/1707715318 >> 172.21.15.8:0/1707715318 conn(0x55f8c3e6ccd0 msgr2=0x55f8c3e6be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa7429d6740 1 -- 172.21.15.8:0/1707715318 shutdown_connections 2024-03-16T20:56:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.648+0000 7fa7429d6740 1 -- 172.21.15.8:0/1707715318 wait complete. 2024-03-16T20:56:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.649+0000 7fa7429d6740 20 client.24997 trim_cache size 0 max 16384 2024-03-16T20:56:47.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.667+0000 7fa7429d6740 1 Processor -- start 2024-03-16T20:56:47.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.667+0000 7fa7429d6740 1 -- start start 2024-03-16T20:56:47.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.667+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e796b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.667+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e72150 0x55f8c3e82dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.667+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e772c0 0x55f8c3e7b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.667+0000 7fa7429d6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3e83df0 con 0x55f8c3e772c0 2024-03-16T20:56:47.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.667+0000 7fa7429d6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3e6d720 con 0x55f8c3e71760 2024-03-16T20:56:47.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.667+0000 7fa7429d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3e7ad20 con 0x55f8c3e72150 2024-03-16T20:56:47.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.667+0000 7fa73d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e796b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.667+0000 7fa73d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e796b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:58960/0 (socket says 172.21.15.8:58960) 2024-03-16T20:56:47.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa73d200640 1 -- 172.21.15.8:0/3357747424 learned_addr learned my addr 172.21.15.8:0/3357747424 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:47.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa737e00640 1 --2- 172.21.15.8:0/3357747424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e72150 0x55f8c3e82dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa73dc00640 1 --2- 172.21.15.8:0/3357747424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e772c0 0x55f8c3e7b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa73d200640 1 -- 172.21.15.8:0/3357747424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e72150 msgr2=0x55f8c3e82dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa73d200640 1 --2- 172.21.15.8:0/3357747424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e72150 0x55f8c3e82dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa73d200640 1 -- 172.21.15.8:0/3357747424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e772c0 msgr2=0x55f8c3e7b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa73d200640 1 --2- 172.21.15.8:0/3357747424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e772c0 0x55f8c3e7b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa73d200640 1 -- 172.21.15.8:0/3357747424 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8c3d748b0 con 0x55f8c3e71760 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa73d200640 1 --2- 172.21.15.8:0/3357747424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e796b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009860 tx=0x7fa72c043000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee03852e9a2f1138 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa729600640 1 -- 172.21.15.8:0/3357747424 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c052040 con 0x55f8c3e71760 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa729600640 1 -- 172.21.15.8:0/3357747424 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa72c0044e0 con 0x55f8c3e71760 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.668+0000 7fa729600640 1 -- 172.21.15.8:0/3357747424 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c056dd0 con 0x55f8c3e71760 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.669+0000 7fa7429d6740 1 -- 172.21.15.8:0/3357747424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 msgr2=0x55f8c3e796b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.669+0000 7fa7429d6740 1 --2- 172.21.15.8:0/3357747424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e796b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009860 tx=0x7fa72c043000 comp rx=0 tx=0).stop 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.669+0000 7fa7429d6740 1 -- 172.21.15.8:0/3357747424 shutdown_connections 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.669+0000 7fa7429d6740 1 --2- 172.21.15.8:0/3357747424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e772c0 0x55f8c3e7b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.669+0000 7fa7429d6740 1 --2- 172.21.15.8:0/3357747424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e72150 0x55f8c3e82dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.669+0000 7fa7429d6740 1 --2- 172.21.15.8:0/3357747424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e71760 0x55f8c3e796b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.669+0000 7fa7429d6740 1 -- 172.21.15.8:0/3357747424 >> 172.21.15.8:0/3357747424 conn(0x55f8c3e6ccd0 msgr2=0x55f8c3e73550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.669+0000 7fa7429d6740 1 -- 172.21.15.8:0/3357747424 shutdown_connections 2024-03-16T20:56:47.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.669+0000 7fa7429d6740 1 -- 172.21.15.8:0/3357747424 wait complete. 2024-03-16T20:56:47.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.670+0000 7fa7429d6740 1 -- start start 2024-03-16T20:56:47.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.670+0000 7fa7429d6740 1 Processor -- start 2024-03-16T20:56:47.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.670+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e71760 0x55f8c3e7ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.670+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e72150 0x55f8c3e7f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.670+0000 7fa7429d6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e772c0 0x55f8c3e823c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.670+0000 7fa7429d6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3e82900 con 0x55f8c3e772c0 2024-03-16T20:56:47.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.670+0000 7fa7429d6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3e82a70 con 0x55f8c3e72150 2024-03-16T20:56:47.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.670+0000 7fa7429d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8c3e82c30 con 0x55f8c3e71760 2024-03-16T20:56:47.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.670+0000 7fa7429d6740 10 client.0 _ll_register_callbacks cb 0x7fa73009a690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:56:47.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa73d200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e71760 0x55f8c3e7ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa73d200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e71760 0x55f8c3e7ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55308/0 (socket says 172.21.15.8:55308) 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa73d200640 1 -- 172.21.15.8:0/153282421 learned_addr learned my addr 172.21.15.8:0/153282421 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa737e00640 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e72150 0x55f8c3e7f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa73dc00640 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e772c0 0x55f8c3e823c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa73d200640 1 -- 172.21.15.8:0/153282421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e72150 msgr2=0x55f8c3e7f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa73d200640 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e72150 0x55f8c3e7f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa73d200640 1 -- 172.21.15.8:0/153282421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e772c0 msgr2=0x55f8c3e823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa73d200640 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e772c0 0x55f8c3e823c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa73d200640 1 -- 172.21.15.8:0/153282421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73810c2d0 con 0x55f8c3e71760 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa73d200640 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e71760 0x55f8c3e7ee60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa72c005f80 tx=0x7fa72c005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f583dcb8721404ce server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa71ea00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa71ea00640 1 -- 172.21.15.8:0/153282421 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c056d50 con 0x55f8c3e71760 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa71ea00640 1 -- 172.21.15.8:0/153282421 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa72c02c510 con 0x55f8c3e71760 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.671+0000 7fa7429d6740 1 -- 172.21.15.8:0/153282421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8c3e88e60 con 0x55f8c3e71760 2024-03-16T20:56:47.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.672+0000 7fa71ea00640 1 -- 172.21.15.8:0/153282421 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa72c02c6d0 con 0x55f8c3e71760 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.672+0000 7fa7429d6740 10 client.25003 fetch_fsmap learned FSMap version 23 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.672+0000 7fa7429d6740 1 -- 172.21.15.8:0/153282421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55f8c3d9a510 con 0x55f8c3e71760 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.672+0000 7fa71ea00640 1 -- 172.21.15.8:0/153282421 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa72c06f020 con 0x55f8c3e71760 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.672+0000 7fa71ea00640 1 -- 172.21.15.8:0/153282421 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fa72c055070 con 0x55f8c3e71760 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.672+0000 7fa7429d6740 10 client.25003 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.672+0000 7fa7429d6740 10 client.25003 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.672+0000 7fa7429d6740 20 client.25003 populate_metadata read hostname 'smithi008' 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.672+0000 7fa7429d6740 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55f8c3ee7ec0 0x55f8c3ee4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.672+0000 7fa7429d6740 4 client.25003 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.672+0000 7fa7429d6740 1 -- 172.21.15.8:0/153282421 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fa724005520 con 0x55f8c3ee7ec0 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.673+0000 7fa737e00640 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55f8c3ee7ec0 0x55f8c3ee4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.673+0000 7fa737e00640 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55f8c3ee7ec0 0x55f8c3ee4380 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a0454c40ca0fbdbb server_cookie=e2bb33f055b48e14 in_seq=0 out_seq=0 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.673+0000 7fa71ea00640 10 client.25003 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.673+0000 7fa71ea00640 1 -- 172.21.15.8:0/153282421 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x7fa724005520 con 0x55f8c3ee7ec0 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.673+0000 7fa71ea00640 10 client.25003 handle_command_reply: tid=0 2024-03-16T20:56:47.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.673+0000 7fa7429d6740 1 client.25003 shutdown 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.673+0000 7fa7429d6740 1 -- 172.21.15.8:0/153282421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e71760 msgr2=0x55f8c3e7ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.673+0000 7fa7429d6740 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e71760 0x55f8c3e7ee60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa72c005f80 tx=0x7fa72c005fb0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.673+0000 7fa7429d6740 1 -- 172.21.15.8:0/153282421 shutdown_connections 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.673+0000 7fa7429d6740 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55f8c3ee7ec0 0x55f8c3ee4380 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa7429d6740 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8c3e772c0 0x55f8c3e823c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa7429d6740 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8c3e72150 0x55f8c3e7f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa71ea00640 0 client.25003 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa7429d6740 1 --2- 172.21.15.8:0/153282421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8c3e71760 0x55f8c3e7ee60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa7429d6740 1 -- 172.21.15.8:0/153282421 >> 172.21.15.8:0/153282421 conn(0x55f8c3e6ccd0 msgr2=0x55f8c3e7b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa7429d6740 1 -- 172.21.15.8:0/153282421 shutdown_connections 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa7429d6740 1 -- 172.21.15.8:0/153282421 wait complete. 2024-03-16T20:56:47.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa7429d6740 20 client.25003 trim_cache size 0 max 16384 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "05d64692-e3d6-11ee-95c9-87774f69a715", 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 2, 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24536, 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 98.328515886000005, 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 123.89739323800001 2024-03-16T20:56:47.683 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:56:47.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa73e600640 1 -- 172.21.15.8:0/2513318621 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa7200a1ab0 msgr2=0x7fa7200a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa73e600640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa7200a1ab0 0x7fa7200a3f70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa72c02c180 tx=0x7fa72c034c40 comp rx=0 tx=0).stop 2024-03-16T20:56:47.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa73e600640 1 -- 172.21.15.8:0/2513318621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa738109290 msgr2=0x7fa7381a0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.674+0000 7fa73e600640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa738109290 0x7fa7381a0cd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa73000efd0 tx=0x7fa73000c6a0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.675+0000 7fa73e600640 1 -- 172.21.15.8:0/2513318621 shutdown_connections 2024-03-16T20:56:47.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.675+0000 7fa73e600640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa7200a1ab0 0x7fa7200a3f70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.675+0000 7fa73e600640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa738109290 0x7fa7381a0cd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.675+0000 7fa73e600640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738075530 0x7fa738199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.675+0000 7fa73e600640 1 --2- 172.21.15.8:0/2513318621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738073f50 0x7fa738199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.675+0000 7fa73e600640 1 -- 172.21.15.8:0/2513318621 >> 172.21.15.8:0/2513318621 conn(0x7fa7380fc960 msgr2=0x7fa738105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.675+0000 7fa73e600640 1 -- 172.21.15.8:0/2513318621 shutdown_connections 2024-03-16T20:56:47.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.675+0000 7fa73e600640 1 -- 172.21.15.8:0/2513318621 wait complete. 2024-03-16T20:56:47.703 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-03-16T20:56:47.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.917+0000 7f32eb200640 1 -- 172.21.15.8:0/2289432752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32ec073f50 msgr2=0x7f32ec0743d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.917+0000 7f32eb200640 1 --2- 172.21.15.8:0/2289432752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32ec073f50 0x7f32ec0743d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009900 tx=0x7f32d402bc50 comp rx=0 tx=0).stop 2024-03-16T20:56:47.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.917+0000 7f32eb200640 1 -- 172.21.15.8:0/2289432752 shutdown_connections 2024-03-16T20:56:47.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.917+0000 7f32eb200640 1 --2- 172.21.15.8:0/2289432752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec1092b0 0x7f32ec10b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.917+0000 7f32eb200640 1 --2- 172.21.15.8:0/2289432752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32ec073f50 0x7f32ec0743d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.917+0000 7f32eb200640 1 --2- 172.21.15.8:0/2289432752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32ec075530 0x7f32ec073980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.917+0000 7f32eb200640 1 -- 172.21.15.8:0/2289432752 >> 172.21.15.8:0/2289432752 conn(0x7f32ec0fc960 msgr2=0x7f32ec0feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.917+0000 7f32eb200640 1 -- 172.21.15.8:0/2289432752 shutdown_connections 2024-03-16T20:56:47.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.917+0000 7f32eb200640 1 -- 172.21.15.8:0/2289432752 wait complete. 2024-03-16T20:56:47.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.918+0000 7f32eb200640 1 Processor -- start 2024-03-16T20:56:47.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.918+0000 7f32eb200640 1 -- start start 2024-03-16T20:56:47.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32eb200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32ec073f50 0x7f32ec199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32eb200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32ec075530 0x7f32ec199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32eb200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec1092b0 0x7f32ec1a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32eb200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec1a1240 con 0x7f32ec073f50 2024-03-16T20:56:47.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32eb200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec1a13b0 con 0x7f32ec1092b0 2024-03-16T20:56:47.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32eb200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec1a1570 con 0x7f32ec075530 2024-03-16T20:56:47.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32e1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32ec075530 0x7f32ec199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32e1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32ec075530 0x7f32ec199c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44508/0 (socket says 172.21.15.8:44508) 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32e1400640 1 -- 172.21.15.8:0/2850519361 learned_addr learned my addr 172.21.15.8:0/2850519361 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32e9e00640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32ec073f50 0x7f32ec199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32ea800640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec1092b0 0x7f32ec1a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32e1400640 1 -- 172.21.15.8:0/2850519361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec1092b0 msgr2=0x7f32ec1a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32e1400640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec1092b0 0x7f32ec1a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32e1400640 1 -- 172.21.15.8:0/2850519361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32ec073f50 msgr2=0x7f32ec199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32e1400640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32ec073f50 0x7f32ec199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.919+0000 7f32e1400640 1 -- 172.21.15.8:0/2850519361 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d4009560 con 0x7f32ec075530 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.920+0000 7f32e1400640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32ec075530 0x7f32ec199c90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009230 tx=0x7f32d4005e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.920+0000 7f32e3400640 1 -- 172.21.15.8:0/2850519361 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4004e10 con 0x7f32ec075530 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.920+0000 7f32e3400640 1 -- 172.21.15.8:0/2850519361 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f32d4005470 con 0x7f32ec075530 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.920+0000 7f32eb200640 1 -- 172.21.15.8:0/2850519361 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ec1a17f0 con 0x7f32ec075530 2024-03-16T20:56:47.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.920+0000 7f32e3400640 1 -- 172.21.15.8:0/2850519361 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4034440 con 0x7f32ec075530 2024-03-16T20:56:47.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.920+0000 7f32eb200640 1 -- 172.21.15.8:0/2850519361 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ec1a1cf0 con 0x7f32ec075530 2024-03-16T20:56:47.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.923+0000 7f32e3400640 1 -- 172.21.15.8:0/2850519361 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f32d40036f0 con 0x7f32ec075530 2024-03-16T20:56:47.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.923+0000 7f32f3e2f740 1 Processor -- start 2024-03-16T20:56:47.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32f3e2f740 1 -- start start 2024-03-16T20:56:47.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a9990b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a9995c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a99962c0 0x5591a9998750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a98ffb30 con 0x5591a9991150 2024-03-16T20:56:47.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a98fd060 con 0x5591a99962c0 2024-03-16T20:56:47.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a98f8840 con 0x5591a9990760 2024-03-16T20:56:47.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32ea800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a9990b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32ea800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a9990b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44522/0 (socket says 172.21.15.8:44522) 2024-03-16T20:56:47.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32ea800640 1 -- 172.21.15.8:0/3665524917 learned_addr learned my addr 172.21.15.8:0/3665524917 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:47.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32e9e00640 1 --2- 172.21.15.8:0/3665524917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a9995c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32e1400640 1 --2- 172.21.15.8:0/3665524917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a99962c0 0x5591a9998750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32ea800640 1 -- 172.21.15.8:0/3665524917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a99962c0 msgr2=0x5591a9998750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32ea800640 1 --2- 172.21.15.8:0/3665524917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a99962c0 0x5591a9998750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32ea800640 1 -- 172.21.15.8:0/3665524917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 msgr2=0x5591a9995c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32ea800640 1 --2- 172.21.15.8:0/3665524917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a9995c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.924+0000 7f32ea800640 1 -- 172.21.15.8:0/3665524917 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591a98c04c0 con 0x5591a9990760 2024-03-16T20:56:47.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.925+0000 7f32ea800640 1 --2- 172.21.15.8:0/3665524917 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a9990b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009fd0 tx=0x7f32e40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3128dbe01e53e479 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.925+0000 7f32db400640 1 -- 172.21.15.8:0/3665524917 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e4004d20 con 0x5591a9990760 2024-03-16T20:56:47.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.925+0000 7f32db400640 1 -- 172.21.15.8:0/3665524917 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f32e4004e80 con 0x5591a9990760 2024-03-16T20:56:47.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.925+0000 7f32db400640 1 -- 172.21.15.8:0/3665524917 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e4005240 con 0x5591a9990760 2024-03-16T20:56:47.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3665524917 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 msgr2=0x5591a9990b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/3665524917 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a9990b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009fd0 tx=0x7f32e40118d0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32e3400640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f32d00a1ab0 0x7f32d00a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3665524917 shutdown_connections 2024-03-16T20:56:47.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/3665524917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a99962c0 0x5591a9998750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/3665524917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a9995c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/3665524917 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a9990b80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3665524917 >> 172.21.15.8:0/3665524917 conn(0x5591a998bcd0 msgr2=0x5591a998c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32ea800640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f32d00a1ab0 0x7f32d00a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32e3400640 1 -- 172.21.15.8:0/2850519361 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f32d40ef4c0 con 0x7f32ec075530 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3665524917 shutdown_connections 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3665524917 wait complete. 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.926+0000 7f32f3e2f740 1 -- start start 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.927+0000 7f32f3e2f740 1 Processor -- start 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.927+0000 7f32ea800640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f32d00a1ab0 0x7f32d00a3f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009fa0 tx=0x7f32e4005bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.927+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a999a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.927+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a999ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.927+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a99962c0 0x5591a99a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.927+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a989dea0 con 0x5591a9991150 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.927+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a989db40 con 0x5591a9990760 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.927+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a9640f20 con 0x5591a99962c0 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.927+0000 7f32f3e2f740 10 client.0 _ll_register_callbacks cb 0x5591a98b1950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.927+0000 7f32e9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a999a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32e9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a999a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40272/0 (socket says 172.21.15.8:40272) 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32e9e00640 1 -- 172.21.15.8:0/3033313751 learned_addr learned my addr 172.21.15.8:0/3033313751 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32ea800640 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a99962c0 0x5591a99a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32e1400640 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a999ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32e9e00640 1 -- 172.21.15.8:0/3033313751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a99962c0 msgr2=0x5591a99a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32e9e00640 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a99962c0 0x5591a99a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32e9e00640 1 -- 172.21.15.8:0/3033313751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 msgr2=0x5591a999ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32e9e00640 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a999ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32e9e00640 1 -- 172.21.15.8:0/3033313751 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e4009c80 con 0x5591a9990760 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32e9e00640 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a999a8e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f32dc012700 tx=0x7f32dc012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e9177b1c64f1da6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32cfe00640 1 -- 172.21.15.8:0/3033313751 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc017070 con 0x5591a9990760 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32cfe00640 1 -- 172.21.15.8:0/3033313751 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f32dc00f920 con 0x5591a9990760 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.928+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3033313751 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591a95f86c0 con 0x5591a9990760 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.929+0000 7f32cfe00640 1 -- 172.21.15.8:0/3033313751 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32dc00fae0 con 0x5591a9990760 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.929+0000 7f32f3e2f740 10 client.25007 fetch_fsmap learned FSMap version 23 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.929+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3033313751 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5591a98f6ec0 con 0x5591a9990760 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.929+0000 7f32cfe00640 1 -- 172.21.15.8:0/3033313751 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5591a95f86c0 con 0x5591a9990760 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.929+0000 7f32cfe00640 1 -- 172.21.15.8:0/3033313751 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f32dc01c420 con 0x5591a9990760 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.929+0000 7f32f3e2f740 10 client.25007 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.929+0000 7f32f3e2f740 10 client.25007 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.929+0000 7f32f3e2f740 20 client.25007 populate_metadata read hostname 'smithi008' 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.929+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5591a99a6140 0x5591a99ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.929+0000 7f32f3e2f740 4 client.25007 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:56:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.929+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3033313751 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591a9649270 con 0x5591a99a6140 2024-03-16T20:56:47.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.930+0000 7f32e1400640 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5591a99a6140 0x5591a99ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.930+0000 7f32e1400640 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5591a99a6140 0x5591a99ab200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c2b477d8218184a5 server_cookie=fd0dc54eb1f64b8b in_seq=0 out_seq=0 2024-03-16T20:56:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.930+0000 7f32cfe00640 10 client.25007 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:56:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32cfe00640 1 -- 172.21.15.8:0/3033313751 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5591a9649270 con 0x5591a99a6140 2024-03-16T20:56:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32cfe00640 10 client.25007 handle_command_reply: tid=0 2024-03-16T20:56:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32f3e2f740 1 client.25007 shutdown 2024-03-16T20:56:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3033313751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 msgr2=0x5591a999a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a999a8e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f32dc012700 tx=0x7f32dc012bc0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3033313751 shutdown_connections 2024-03-16T20:56:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5591a99a6140 0x5591a99ab200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a99962c0 0x5591a99a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a999ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/3033313751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a999a8e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32cfe00640 0 client.25007 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:56:47.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3033313751 >> 172.21.15.8:0/3033313751 conn(0x5591a998bcd0 msgr2=0x5591a998ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3033313751 shutdown_connections 2024-03-16T20:56:47.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.931+0000 7f32f3e2f740 1 -- 172.21.15.8:0/3033313751 wait complete. 2024-03-16T20:56:47.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.932+0000 7f32f3e2f740 20 client.25007 trim_cache size 0 max 16384 2024-03-16T20:56:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.950+0000 7f32f3e2f740 1 Processor -- start 2024-03-16T20:56:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.950+0000 7f32f3e2f740 1 -- start start 2024-03-16T20:56:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.950+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a99986b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.950+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9991150 0x5591a99a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.950+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a99962c0 0x5591a99925b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.950+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a95f86c0 con 0x5591a99962c0 2024-03-16T20:56:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.950+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a98f1540 con 0x5591a9990760 2024-03-16T20:56:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.950+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a98f54a0 con 0x5591a9991150 2024-03-16T20:56:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a99986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9991150 0x5591a99a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9991150 0x5591a99a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44530/0 (socket says 172.21.15.8:44530) 2024-03-16T20:56:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a99986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40274/0 (socket says 172.21.15.8:40274) 2024-03-16T20:56:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e1400640 1 -- 172.21.15.8:0/1833398147 learned_addr learned my addr 172.21.15.8:0/1833398147 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32ea800640 1 --2- 172.21.15.8:0/1833398147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a99962c0 0x5591a99925b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e1400640 1 -- 172.21.15.8:0/1833398147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 msgr2=0x5591a99986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e1400640 1 --2- 172.21.15.8:0/1833398147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a99986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e1400640 1 -- 172.21.15.8:0/1833398147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a99962c0 msgr2=0x5591a99925b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e1400640 1 --2- 172.21.15.8:0/1833398147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a99962c0 0x5591a99925b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e1400640 1 -- 172.21.15.8:0/1833398147 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591a98938b0 con 0x5591a9991150 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e9e00640 1 --2- 172.21.15.8:0/1833398147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a99986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.951+0000 7f32e1400640 1 --2- 172.21.15.8:0/1833398147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9991150 0x5591a99a1d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f32d40bc420 tx=0x7f32d40ece40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0dfbe1a9ef84c5f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32daa00640 1 -- 172.21.15.8:0/1833398147 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40bc260 con 0x5591a9991150 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32daa00640 1 -- 172.21.15.8:0/1833398147 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f32d40bbfd0 con 0x5591a9991150 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32daa00640 1 -- 172.21.15.8:0/1833398147 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40055e0 con 0x5591a9991150 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32f3e2f740 1 -- 172.21.15.8:0/1833398147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9991150 msgr2=0x5591a99a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/1833398147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9991150 0x5591a99a1d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f32d40bc420 tx=0x7f32d40ece40 comp rx=0 tx=0).stop 2024-03-16T20:56:47.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32f3e2f740 1 -- 172.21.15.8:0/1833398147 shutdown_connections 2024-03-16T20:56:47.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/1833398147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a99962c0 0x5591a99925b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/1833398147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9991150 0x5591a99a1d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/1833398147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a9990760 0x5591a99986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32f3e2f740 1 -- 172.21.15.8:0/1833398147 >> 172.21.15.8:0/1833398147 conn(0x5591a998bcd0 msgr2=0x5591a998c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32f3e2f740 1 -- 172.21.15.8:0/1833398147 shutdown_connections 2024-03-16T20:56:47.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.952+0000 7f32f3e2f740 1 -- 172.21.15.8:0/1833398147 wait complete. 2024-03-16T20:56:47.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.953+0000 7f32f3e2f740 1 -- start start 2024-03-16T20:56:47.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.953+0000 7f32f3e2f740 1 Processor -- start 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.953+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a999dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.953+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a999e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.953+0000 7f32f3e2f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a99962c0 0x5591a99a1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.953+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a99a15a0 con 0x5591a9991150 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.953+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a99a1710 con 0x5591a99962c0 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.953+0000 7f32f3e2f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a99a18d0 con 0x5591a9990760 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32f3e2f740 10 client.0 _ll_register_callbacks cb 0x7f32dc009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32e9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a999dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32e1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a999e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32e9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a999dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44534/0 (socket says 172.21.15.8:44534) 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32e9e00640 1 -- 172.21.15.8:0/2714533908 learned_addr learned my addr 172.21.15.8:0/2714533908 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32ea800640 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a99962c0 0x5591a99a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32e9e00640 1 -- 172.21.15.8:0/2714533908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a99962c0 msgr2=0x5591a99a1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32e9e00640 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a99962c0 0x5591a99a1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32e9e00640 1 -- 172.21.15.8:0/2714533908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 msgr2=0x5591a999e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32e9e00640 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a999e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32e9e00640 1 -- 172.21.15.8:0/2714533908 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591a98f6ec0 con 0x5591a9990760 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32e1400640 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a999e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32e9e00640 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a999dfb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0059f0 tx=0x7f32dc00f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=895b859d09d64ed2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.954+0000 7f32cfe00640 1 -- 172.21.15.8:0/2714533908 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc017070 con 0x5591a9990760 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32f3e2f740 1 -- 172.21.15.8:0/2714533908 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591a99a6a90 con 0x5591a9990760 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32cfe00640 1 -- 172.21.15.8:0/2714533908 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f32dc000e40 con 0x5591a9990760 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32cfe00640 1 -- 172.21.15.8:0/2714533908 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32dc0050b0 con 0x5591a9990760 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32f3e2f740 10 client.25021 fetch_fsmap learned FSMap version 23 2024-03-16T20:56:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32f3e2f740 1 -- 172.21.15.8:0/2714533908 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f32ec1a1cf0 con 0x5591a9990760 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32cfe00640 1 -- 172.21.15.8:0/2714533908 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f32dc036080 con 0x5591a9990760 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32cfe00640 1 -- 172.21.15.8:0/2714533908 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f32dc02e030 con 0x5591a9990760 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32f3e2f740 10 client.25021 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32f3e2f740 10 client.25021 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32f3e2f740 20 client.25021 populate_metadata read hostname 'smithi008' 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5591a9a06b40 0x5591a9a02fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32f3e2f740 4 client.25021 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.955+0000 7f32f3e2f740 1 -- 172.21.15.8:0/2714533908 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5591a991cc40 con 0x5591a9a06b40 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32e1400640 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5591a9a06b40 0x5591a9a02fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32e1400640 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5591a9a06b40 0x5591a9a02fa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e031a0c2b39fb7d3 server_cookie=170bb74e2830817c in_seq=0 out_seq=0 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32cfe00640 10 client.25021 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32cfe00640 1 -- 172.21.15.8:0/2714533908 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5591a991cc40 con 0x5591a9a06b40 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32cfe00640 10 client.25021 handle_command_reply: tid=0 2024-03-16T20:56:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32f3e2f740 1 client.25021 shutdown 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32f3e2f740 1 -- 172.21.15.8:0/2714533908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 msgr2=0x5591a999dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a999dfb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0059f0 tx=0x7f32dc00f820 comp rx=0 tx=0).stop 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32f3e2f740 1 -- 172.21.15.8:0/2714533908 shutdown_connections 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5591a9a06b40 0x5591a9a02fa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591a99962c0 0x5591a99a1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5591a9991150 0x5591a999e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32f3e2f740 1 --2- 172.21.15.8:0/2714533908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5591a9990760 0x5591a999dfb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32cfe00640 0 client.25021 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.956+0000 7f32f3e2f740 1 -- 172.21.15.8:0/2714533908 >> 172.21.15.8:0/2714533908 conn(0x5591a998bcd0 msgr2=0x5591a99925b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32f3e2f740 1 -- 172.21.15.8:0/2714533908 shutdown_connections 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32f3e2f740 1 -- 172.21.15.8:0/2714533908 wait complete. 2024-03-16T20:56:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32f3e2f740 20 client.25021 trim_cache size 0 max 16384 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "05d64692-e3d6-11ee-95c9-87774f69a715", 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 1, 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24544, 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 99.622963306000003, 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2024-03-16T20:56:47.967 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 121.13774557799999 2024-03-16T20:56:47.968 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:56:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32eb200640 1 -- 172.21.15.8:0/2850519361 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f32d00a1ab0 msgr2=0x7f32d00a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32eb200640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f32d00a1ab0 0x7f32d00a3f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009fa0 tx=0x7f32e4005bd0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32eb200640 1 -- 172.21.15.8:0/2850519361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32ec075530 msgr2=0x7f32ec199c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32eb200640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32ec075530 0x7f32ec199c90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009230 tx=0x7f32d4005e40 comp rx=0 tx=0).stop 2024-03-16T20:56:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32eb200640 1 -- 172.21.15.8:0/2850519361 shutdown_connections 2024-03-16T20:56:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32eb200640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f32d00a1ab0 0x7f32d00a3f70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32eb200640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec1092b0 0x7f32ec1a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32eb200640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32ec075530 0x7f32ec199c90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32eb200640 1 --2- 172.21.15.8:0/2850519361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32ec073f50 0x7f32ec199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.957+0000 7f32eb200640 1 -- 172.21.15.8:0/2850519361 >> 172.21.15.8:0/2850519361 conn(0x7f32ec0fc960 msgr2=0x7f32ec1051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.958+0000 7f32eb200640 1 -- 172.21.15.8:0/2850519361 shutdown_connections 2024-03-16T20:56:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:47.958+0000 7f32eb200640 1 -- 172.21.15.8:0/2850519361 wait complete. 2024-03-16T20:56:47.979 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:47 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/4069193372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:56:47.979 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:47 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1218705813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:56:47.983 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-16T20:56:48.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:47 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/4069193372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:56:48.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:47 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1218705813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:56:48.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:47 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/4069193372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:56:48.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:47 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1218705813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:56:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.199+0000 7f8c2fe00640 1 -- 172.21.15.8:0/950341547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c301025d0 msgr2=0x7f8c30104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.199+0000 7f8c2fe00640 1 --2- 172.21.15.8:0/950341547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c301025d0 0x7f8c30104a40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009ca0 tx=0x7f8c1802c100 comp rx=0 tx=0).stop 2024-03-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.199+0000 7f8c2fe00640 1 -- 172.21.15.8:0/950341547 shutdown_connections 2024-03-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.199+0000 7f8c2fe00640 1 --2- 172.21.15.8:0/950341547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c30104f80 0x7f8c30105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.199+0000 7f8c2fe00640 1 --2- 172.21.15.8:0/950341547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c301025d0 0x7f8c30104a40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.199+0000 7f8c2fe00640 1 --2- 172.21.15.8:0/950341547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c300ffc60 0x7f8c30102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.199+0000 7f8c2fe00640 1 -- 172.21.15.8:0/950341547 >> 172.21.15.8:0/950341547 conn(0x7f8c300fb860 msgr2=0x7f8c300fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.199+0000 7f8c2fe00640 1 -- 172.21.15.8:0/950341547 shutdown_connections 2024-03-16T20:56:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.199+0000 7f8c2fe00640 1 -- 172.21.15.8:0/950341547 wait complete. 2024-03-16T20:56:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.200+0000 7f8c2fe00640 1 Processor -- start 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.200+0000 7f8c2fe00640 1 -- start start 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.201+0000 7f8c2fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c300ffc60 0x7f8c3019db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.201+0000 7f8c2fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c301025d0 0x7f8c3019e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.201+0000 7f8c2fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c30104f80 0x7f8c301a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.201+0000 7f8c2fe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301a55b0 con 0x7f8c301025d0 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.201+0000 7f8c2fe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301a5720 con 0x7f8c300ffc60 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.201+0000 7f8c2fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301a58e0 con 0x7f8c30104f80 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.201+0000 7f8c2f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c30104f80 0x7f8c301a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.201+0000 7f8c2ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c300ffc60 0x7f8c3019db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.201+0000 7f8c2f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c30104f80 0x7f8c301a5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44562/0 (socket says 172.21.15.8:44562) 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.201+0000 7f8c2f400640 1 -- 172.21.15.8:0/2133293345 learned_addr learned my addr 172.21.15.8:0/2133293345 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.201+0000 7f8c2e000640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c301025d0 0x7f8c3019e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c2f400640 1 -- 172.21.15.8:0/2133293345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c300ffc60 msgr2=0x7f8c3019db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c2f400640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c300ffc60 0x7f8c3019db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c2f400640 1 -- 172.21.15.8:0/2133293345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c301025d0 msgr2=0x7f8c3019e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c2f400640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c301025d0 0x7f8c3019e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c2f400640 1 -- 172.21.15.8:0/2133293345 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c18009900 con 0x7f8c30104f80 2024-03-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c300ffc60 0x7f8c3019db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c2f400640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c30104f80 0x7f8c301a5070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c970 tx=0x7f8c2800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c34a00640 1 -- 172.21.15.8:0/2133293345 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28007bb0 con 0x7f8c30104f80 2024-03-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c34a00640 1 -- 172.21.15.8:0/2133293345 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8c28007d10 con 0x7f8c30104f80 2024-03-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c34a00640 1 -- 172.21.15.8:0/2133293345 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28018810 con 0x7f8c30104f80 2024-03-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c2fe00640 1 -- 172.21.15.8:0/2133293345 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c301a5bc0 con 0x7f8c30104f80 2024-03-16T20:56:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.202+0000 7f8c2fe00640 1 -- 172.21.15.8:0/2133293345 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c301a6050 con 0x7f8c30104f80 2024-03-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.205+0000 7f8c34a00640 1 -- 172.21.15.8:0/2133293345 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f8c2800f450 con 0x7f8c30104f80 2024-03-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c38bed740 1 Processor -- start 2024-03-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c38bed740 1 -- start start 2024-03-16T20:56:48.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8cd760 0x564b0b8cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8ce150 0x564b0b8d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 0x564b0b8d5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c38bed740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b83cb30 con 0x564b0b8ce150 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c38bed740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b83a060 con 0x564b0b8cd760 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c38bed740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b835840 con 0x564b0b8d32c0 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c2ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8ce150 0x564b0b8d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c2e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8cd760 0x564b0b8cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c2ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8ce150 0x564b0b8d2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56402/0 (socket says 172.21.15.8:56402) 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.206+0000 7f8c2ea00640 1 -- 172.21.15.8:0/4023173547 learned_addr learned my addr 172.21.15.8:0/4023173547 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c2e000640 1 --2- 172.21.15.8:0/4023173547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 0x564b0b8d5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c2ea00640 1 -- 172.21.15.8:0/4023173547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 msgr2=0x564b0b8d5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/4023173547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 0x564b0b8d5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c2ea00640 1 -- 172.21.15.8:0/4023173547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8cd760 msgr2=0x564b0b8cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/4023173547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8cd760 0x564b0b8cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c2ea00640 1 -- 172.21.15.8:0/4023173547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b0b7fd4c0 con 0x564b0b8ce150 2024-03-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c2e000640 1 --2- 172.21.15.8:0/4023173547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 0x564b0b8d5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/4023173547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8ce150 0x564b0b8d2c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c200115f0 tx=0x7f8c20011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e12a5d39c408051 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c34a00640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8c100a1a30 0x7f8c100a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c1fe00640 1 -- 172.21.15.8:0/4023173547 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2000f640 con 0x564b0b8ce150 2024-03-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c1fe00640 1 -- 172.21.15.8:0/4023173547 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8c2000fca0 con 0x564b0b8ce150 2024-03-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c1fe00640 1 -- 172.21.15.8:0/4023173547 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20019dd0 con 0x564b0b8ce150 2024-03-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.207+0000 7f8c34a00640 1 -- 172.21.15.8:0/2133293345 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8c280cd480 con 0x7f8c30104f80 2024-03-16T20:56:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.208+0000 7f8c2e000640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8c100a1a30 0x7f8c100a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.208+0000 7f8c38bed740 1 -- 172.21.15.8:0/4023173547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8ce150 msgr2=0x564b0b8d2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.208+0000 7f8c38bed740 1 --2- 172.21.15.8:0/4023173547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8ce150 0x564b0b8d2c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c200115f0 tx=0x7f8c20011ab0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.208+0000 7f8c38bed740 1 -- 172.21.15.8:0/4023173547 shutdown_connections 2024-03-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.208+0000 7f8c38bed740 1 --2- 172.21.15.8:0/4023173547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 0x564b0b8d5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.208+0000 7f8c38bed740 1 --2- 172.21.15.8:0/4023173547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8ce150 0x564b0b8d2c50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.208+0000 7f8c38bed740 1 --2- 172.21.15.8:0/4023173547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8cd760 0x564b0b8cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.208+0000 7f8c38bed740 1 -- 172.21.15.8:0/4023173547 >> 172.21.15.8:0/4023173547 conn(0x564b0b8c8cd0 msgr2=0x564b0b8c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.208+0000 7f8c2e000640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8c100a1a30 0x7f8c100a3ef0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8c1802c710 tx=0x7f8c1802e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.208+0000 7f8c38bed740 1 -- 172.21.15.8:0/4023173547 shutdown_connections 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.208+0000 7f8c38bed740 1 -- 172.21.15.8:0/4023173547 wait complete. 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.209+0000 7f8c38bed740 1 -- start start 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.209+0000 7f8c38bed740 1 Processor -- start 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.209+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8cd760 0x564b0b8d7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.209+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 0x564b0b8d7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.209+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 0x564b0b8dede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.209+0000 7f8c38bed740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b7daea0 con 0x564b0b8cd760 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.209+0000 7f8c38bed740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b7dab40 con 0x564b0b8ce150 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.209+0000 7f8c38bed740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b57df20 con 0x564b0b8d32c0 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.209+0000 7f8c38bed740 10 client.0 _ll_register_callbacks cb 0x564b0b7ee950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 0x564b0b8d7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 0x564b0b8d7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40326/0 (socket says 172.21.15.8:40326) 2024-03-16T20:56:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2e000640 1 -- 172.21.15.8:0/2062988088 learned_addr learned my addr 172.21.15.8:0/2062988088 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2f400640 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 0x564b0b8dede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8cd760 0x564b0b8d7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2e000640 1 -- 172.21.15.8:0/2062988088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 msgr2=0x564b0b8dede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2e000640 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 0x564b0b8dede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2e000640 1 -- 172.21.15.8:0/2062988088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8cd760 msgr2=0x564b0b8d7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2e000640 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8cd760 0x564b0b8d7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2e000640 1 -- 172.21.15.8:0/2062988088 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c20009d40 con 0x564b0b8ce150 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2f400640 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 0x564b0b8dede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c2e000640 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 0x564b0b8d7da0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000f80 tx=0x7f8c1802c100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77bc055253148469 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.210+0000 7f8c1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.211+0000 7f8c1cc00640 1 -- 172.21.15.8:0/2062988088 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18004240 con 0x564b0b8ce150 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.211+0000 7f8c1cc00640 1 -- 172.21.15.8:0/2062988088 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8c18046070 con 0x564b0b8ce150 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.211+0000 7f8c38bed740 1 -- 172.21.15.8:0/2062988088 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b0b859c40 con 0x564b0b8ce150 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.211+0000 7f8c1cc00640 1 -- 172.21.15.8:0/2062988088 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c180043a0 con 0x564b0b8ce150 2024-03-16T20:56:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.211+0000 7f8c38bed740 10 client.25025 fetch_fsmap learned FSMap version 23 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.211+0000 7f8c38bed740 1 -- 172.21.15.8:0/2062988088 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564b0b833ec0 con 0x564b0b8ce150 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.211+0000 7f8c1cc00640 1 -- 172.21.15.8:0/2062988088 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x564b0b859c40 con 0x564b0b8ce150 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.211+0000 7f8c1cc00640 1 -- 172.21.15.8:0/2062988088 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f8c1804dca0 con 0x564b0b8ce150 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.211+0000 7f8c38bed740 10 client.25025 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.212+0000 7f8c38bed740 10 client.25025 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.212+0000 7f8c38bed740 20 client.25025 populate_metadata read hostname 'smithi008' 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.212+0000 7f8c38bed740 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x564b0b8e3dd0 0x564b0b8e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.212+0000 7f8c38bed740 4 client.25025 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.212+0000 7f8c38bed740 1 -- 172.21.15.8:0/2062988088 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b0b5356c0 con 0x564b0b8e3dd0 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.212+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x564b0b8e3dd0 0x564b0b8e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.212+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x564b0b8e3dd0 0x564b0b8e2fe0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca7297e228dbed7a server_cookie=9e8bae49ce92ad90 in_seq=0 out_seq=0 2024-03-16T20:56:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.212+0000 7f8c1cc00640 10 client.25025 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c1cc00640 1 -- 172.21.15.8:0/2062988088 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x564b0b5356c0 con 0x564b0b8e3dd0 2024-03-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c1cc00640 10 client.25025 handle_command_reply: tid=0 2024-03-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 1 client.25025 shutdown 2024-03-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 1 -- 172.21.15.8:0/2062988088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 msgr2=0x564b0b8d7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 0x564b0b8d7da0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000f80 tx=0x7f8c1802c100 comp rx=0 tx=0).stop 2024-03-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 1 -- 172.21.15.8:0/2062988088 shutdown_connections 2024-03-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8d32c0 0x564b0b8dede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 0x564b0b8d7da0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x564b0b8e3dd0 0x564b0b8e2fe0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 1 --2- 172.21.15.8:0/2062988088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8cd760 0x564b0b8d7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 1 -- 172.21.15.8:0/2062988088 >> 172.21.15.8:0/2062988088 conn(0x564b0b8c8cd0 msgr2=0x564b0b8c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c1cc00640 0 client.25025 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 1 -- 172.21.15.8:0/2062988088 shutdown_connections 2024-03-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 1 -- 172.21.15.8:0/2062988088 wait complete. 2024-03-16T20:56:48.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.214+0000 7f8c38bed740 20 client.25025 trim_cache size 0 max 16384 2024-03-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.233+0000 7f8c38bed740 1 Processor -- start 2024-03-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.233+0000 7f8c38bed740 1 -- start start 2024-03-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.233+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8cd760 0x564b0b8d56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 0x564b0b8deda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8d32c0 0x564b0b8d7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c38bed740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b8d5e10 con 0x564b0b8d32c0 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c38bed740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b5356c0 con 0x564b0b8ce150 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c38bed740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b859c40 con 0x564b0b8cd760 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c2ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8cd760 0x564b0b8d56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c2ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8cd760 0x564b0b8d56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44586/0 (socket says 172.21.15.8:44586) 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c2ea00640 1 -- 172.21.15.8:0/3545365787 learned_addr learned my addr 172.21.15.8:0/3545365787 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c2e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 0x564b0b8deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c2f400640 1 --2- 172.21.15.8:0/3545365787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8d32c0 0x564b0b8d7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c2ea00640 1 -- 172.21.15.8:0/3545365787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 msgr2=0x564b0b8deda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/3545365787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 0x564b0b8deda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c2ea00640 1 -- 172.21.15.8:0/3545365787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8d32c0 msgr2=0x564b0b8d7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:48.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/3545365787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8d32c0 0x564b0b8d7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c2ea00640 1 -- 172.21.15.8:0/3545365787 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b0b7d08b0 con 0x564b0b8cd760 2024-03-16T20:56:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.234+0000 7f8c2f400640 1 --2- 172.21.15.8:0/3545365787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8d32c0 0x564b0b8d7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:56:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.235+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/3545365787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8cd760 0x564b0b8d56b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c200058c0 tx=0x7f8c20013fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e9f4b159d79c07d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.235+0000 7f8c1f400640 1 -- 172.21.15.8:0/3545365787 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2000f640 con 0x564b0b8cd760 2024-03-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.235+0000 7f8c1f400640 1 -- 172.21.15.8:0/3545365787 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8c200050b0 con 0x564b0b8cd760 2024-03-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.235+0000 7f8c1f400640 1 -- 172.21.15.8:0/3545365787 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20003cd0 con 0x564b0b8cd760 2024-03-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.235+0000 7f8c38bed740 1 -- 172.21.15.8:0/3545365787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8cd760 msgr2=0x564b0b8d56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.236+0000 7f8c38bed740 1 --2- 172.21.15.8:0/3545365787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8cd760 0x564b0b8d56b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c200058c0 tx=0x7f8c20013fd0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.236+0000 7f8c38bed740 1 -- 172.21.15.8:0/3545365787 shutdown_connections 2024-03-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.236+0000 7f8c38bed740 1 --2- 172.21.15.8:0/3545365787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8d32c0 0x564b0b8d7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.236+0000 7f8c38bed740 1 --2- 172.21.15.8:0/3545365787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8ce150 0x564b0b8deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.236+0000 7f8c38bed740 1 --2- 172.21.15.8:0/3545365787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8cd760 0x564b0b8d56b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.236+0000 7f8c38bed740 1 -- 172.21.15.8:0/3545365787 >> 172.21.15.8:0/3545365787 conn(0x564b0b8c8cd0 msgr2=0x564b0b8c90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.236+0000 7f8c38bed740 1 -- 172.21.15.8:0/3545365787 shutdown_connections 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.236+0000 7f8c38bed740 1 -- 172.21.15.8:0/3545365787 wait complete. 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.236+0000 7f8c38bed740 1 -- start start 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.236+0000 7f8c38bed740 1 Processor -- start 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8cd760 0x564b0b8daf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8ce150 0x564b0b8db490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c38bed740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8d32c0 0x564b0b8de460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c38bed740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b8de9a0 con 0x564b0b8cd760 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c38bed740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b8deb10 con 0x564b0b8d32c0 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c38bed740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0b8decd0 con 0x564b0b8ce150 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c38bed740 10 client.0 _ll_register_callbacks cb 0x7f8c18032340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8d32c0 0x564b0b8de460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2e000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8ce150 0x564b0b8db490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8cd760 0x564b0b8daf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8d32c0 0x564b0b8de460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40356/0 (socket says 172.21.15.8:40356) 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2f400640 1 -- 172.21.15.8:0/3212947554 learned_addr learned my addr 172.21.15.8:0/3212947554 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2e000640 1 -- 172.21.15.8:0/3212947554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8d32c0 msgr2=0x564b0b8de460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2e000640 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8d32c0 0x564b0b8de460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2e000640 1 -- 172.21.15.8:0/3212947554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8cd760 msgr2=0x564b0b8daf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2e000640 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8cd760 0x564b0b8daf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2e000640 1 -- 172.21.15.8:0/3212947554 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b0b7fd4c0 con 0x564b0b8ce150 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2f400640 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8d32c0 0x564b0b8de460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.237+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8cd760 0x564b0b8daf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.238+0000 7f8c2e000640 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8ce150 0x564b0b8db490 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009ca0 tx=0x7f8c18040750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a34cef9f92f14fb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.238+0000 7f8c1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.238+0000 7f8c1cc00640 1 -- 172.21.15.8:0/3212947554 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18040d30 con 0x564b0b8ce150 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.238+0000 7f8c1cc00640 1 -- 172.21.15.8:0/3212947554 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8c18046040 con 0x564b0b8ce150 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.238+0000 7f8c38bed740 1 -- 172.21.15.8:0/3212947554 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b0b8e47a0 con 0x564b0b8ce150 2024-03-16T20:56:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.238+0000 7f8c1cc00640 1 -- 172.21.15.8:0/3212947554 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c18070030 con 0x564b0b8ce150 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.238+0000 7f8c38bed740 10 client.25036 fetch_fsmap learned FSMap version 23 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.238+0000 7f8c38bed740 1 -- 172.21.15.8:0/3212947554 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564b0b7f6510 con 0x564b0b8ce150 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.239+0000 7f8c1cc00640 1 -- 172.21.15.8:0/3212947554 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x564b0b8e47a0 con 0x564b0b8ce150 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.239+0000 7f8c1cc00640 1 -- 172.21.15.8:0/3212947554 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f8c1804d450 con 0x564b0b8ce150 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.239+0000 7f8c38bed740 10 client.25036 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.239+0000 7f8c38bed740 10 client.25036 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.239+0000 7f8c38bed740 20 client.25036 populate_metadata read hostname 'smithi008' 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.239+0000 7f8c38bed740 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x564b0b9437a0 0x564b0b93fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.239+0000 7f8c38bed740 4 client.25036 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.239+0000 7f8c38bed740 1 -- 172.21.15.8:0/3212947554 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f8c2000fca0 con 0x564b0b9437a0 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.239+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x564b0b9437a0 0x564b0b93fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c2ea00640 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x564b0b9437a0 0x564b0b93fc00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eb228730a34339f server_cookie=1eb596374c5c33b2 in_seq=0 out_seq=0 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c1cc00640 10 client.25036 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c1cc00640 1 -- 172.21.15.8:0/3212947554 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f8c2000fca0 con 0x564b0b9437a0 2024-03-16T20:56:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c1cc00640 10 client.25036 handle_command_reply: tid=0 2024-03-16T20:56:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c38bed740 1 client.25036 shutdown 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c38bed740 1 -- 172.21.15.8:0/3212947554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8ce150 msgr2=0x564b0b8db490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c38bed740 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8ce150 0x564b0b8db490 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009ca0 tx=0x7f8c18040750 comp rx=0 tx=0).stop 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c38bed740 1 -- 172.21.15.8:0/3212947554 shutdown_connections 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c38bed740 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b0b8d32c0 0x564b0b8de460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c38bed740 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564b0b8ce150 0x564b0b8db490 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c38bed740 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x564b0b9437a0 0x564b0b93fc00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c38bed740 1 --2- 172.21.15.8:0/3212947554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b0b8cd760 0x564b0b8daf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c1cc00640 0 client.25036 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.240+0000 7f8c38bed740 1 -- 172.21.15.8:0/3212947554 >> 172.21.15.8:0/3212947554 conn(0x564b0b8c8cd0 msgr2=0x564b0b8c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.241+0000 7f8c38bed740 1 -- 172.21.15.8:0/3212947554 shutdown_connections 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.241+0000 7f8c38bed740 1 -- 172.21.15.8:0/3212947554 wait complete. 2024-03-16T20:56:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.241+0000 7f8c38bed740 20 client.25036 trim_cache size 0 max 16384 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "05d64692-e3d6-11ee-95c9-87774f69a715", 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24593, 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 102.94861649400001, 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2024-03-16T20:56:48.251 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 110.375463392 2024-03-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.241+0000 7f8c2fe00640 1 -- 172.21.15.8:0/2133293345 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8c100a1a30 msgr2=0x7f8c100a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.241+0000 7f8c2fe00640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8c100a1a30 0x7f8c100a3ef0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8c1802c710 tx=0x7f8c1802e040 comp rx=0 tx=0).stop 2024-03-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.241+0000 7f8c2fe00640 1 -- 172.21.15.8:0/2133293345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c30104f80 msgr2=0x7f8c301a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.241+0000 7f8c2fe00640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c30104f80 0x7f8c301a5070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c970 tx=0x7f8c2800ce30 comp rx=0 tx=0).stop 2024-03-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.242+0000 7f8c2fe00640 1 -- 172.21.15.8:0/2133293345 shutdown_connections 2024-03-16T20:56:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.242+0000 7f8c2fe00640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8c100a1a30 0x7f8c100a3ef0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.242+0000 7f8c2fe00640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c30104f80 0x7f8c301a5070 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.242+0000 7f8c2fe00640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8c301025d0 0x7f8c3019e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.242+0000 7f8c2fe00640 1 --2- 172.21.15.8:0/2133293345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c300ffc60 0x7f8c3019db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.242+0000 7f8c2fe00640 1 -- 172.21.15.8:0/2133293345 >> 172.21.15.8:0/2133293345 conn(0x7f8c300fb860 msgr2=0x7f8c30100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.242+0000 7f8c2fe00640 1 -- 172.21.15.8:0/2133293345 shutdown_connections 2024-03-16T20:56:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:48.242+0000 7f8c2fe00640 1 -- 172.21.15.8:0/2133293345 wait complete. 2024-03-16T20:56:48.264 INFO:tasks.cephadm:Setup complete, yielding 2024-03-16T20:56:48.264 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-16T20:56:48.273 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2024-03-16T20:56:48.274 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- bash -c 'ceph orch status' 2024-03-16T20:56:48.740 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:48.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:48 smithi008 ceph-mon[31434]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-16T20:56:49.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:48 smithi170 ceph-mon[35947]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-16T20:56:49.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:48 smithi186 ceph-mon[36391]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-16T20:56:50.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:50 smithi008 ceph-mon[31434]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T20:56:51.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.057+0000 7f6cecc00700 1 -- 172.21.15.8:0/2888416627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ce810a200 msgr2=0x7f6ce8110ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:51.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.057+0000 7f6cecc00700 1 --2- 172.21.15.8:0/2888416627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ce810a200 0x7f6ce8110ab0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000b0d0 tx=0x7f6ce000b3e0 comp rx=0 tx=0).stop 2024-03-16T20:56:51.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.057+0000 7f6cecc00700 1 -- 172.21.15.8:0/2888416627 shutdown_connections 2024-03-16T20:56:51.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.057+0000 7f6cecc00700 1 --2- 172.21.15.8:0/2888416627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ce810a200 0x7f6ce8110ab0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:51.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.057+0000 7f6cecc00700 1 --2- 172.21.15.8:0/2888416627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce8108660 0x7f6ce8108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:51.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.057+0000 7f6cecc00700 1 --2- 172.21.15.8:0/2888416627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ce8109860 0x7f6ce8109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:51.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.057+0000 7f6cecc00700 1 -- 172.21.15.8:0/2888416627 >> 172.21.15.8:0/2888416627 conn(0x7f6ce8077630 msgr2=0x7f6ce8079a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:51.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.057+0000 7f6cecc00700 1 -- 172.21.15.8:0/2888416627 shutdown_connections 2024-03-16T20:56:51.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.057+0000 7f6cecc00700 1 -- 172.21.15.8:0/2888416627 wait complete. 2024-03-16T20:56:51.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.059+0000 7f6cecc00700 1 Processor -- start 2024-03-16T20:56:51.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.059+0000 7f6cecc00700 1 -- start start 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6cecc00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ce8108660 0x7f6ce819e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6cecc00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce8109860 0x7f6ce819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6cecc00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ce810a200 0x7f6ce81a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6cecc00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce81a6340 con 0x7f6ce810a200 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6cecc00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce81a6480 con 0x7f6ce8109860 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6cecc00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce81a6610 con 0x7f6ce8108660 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce5400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce8109860 0x7f6ce819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce5e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ce8108660 0x7f6ce819e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce5400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce8109860 0x7f6ce819ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40376/0 (socket says 172.21.15.8:40376) 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce5400700 1 -- 172.21.15.8:0/3364281101 learned_addr learned my addr 172.21.15.8:0/3364281101 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce5e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ce8108660 0x7f6ce819e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:44602/0 (socket says 172.21.15.8:44602) 2024-03-16T20:56:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce6800700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ce810a200 0x7f6ce81a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:51.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce5400700 1 -- 172.21.15.8:0/3364281101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ce8108660 msgr2=0x7f6ce819e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:51.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce5400700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ce8108660 0x7f6ce819e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:51.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce5400700 1 -- 172.21.15.8:0/3364281101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ce810a200 msgr2=0x7f6ce81a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:51.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce5400700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ce810a200 0x7f6ce81a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:51.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce5400700 1 -- 172.21.15.8:0/3364281101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce0009d00 con 0x7f6ce8109860 2024-03-16T20:56:51.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce6800700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ce810a200 0x7f6ce81a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:56:51.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.060+0000 7f6ce5e00700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ce8108660 0x7f6ce819e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:51.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.061+0000 7f6ce5400700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce8109860 0x7f6ce819ecf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400e9a0 tx=0x7f6cd400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:51.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.061+0000 7f6cdea00700 1 -- 172.21.15.8:0/3364281101 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4009790 con 0x7f6ce8109860 2024-03-16T20:56:51.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.061+0000 7f6cdea00700 1 -- 172.21.15.8:0/3364281101 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6cd400cbd0 con 0x7f6ce8109860 2024-03-16T20:56:51.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.061+0000 7f6cdea00700 1 -- 172.21.15.8:0/3364281101 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd40187a0 con 0x7f6ce8109860 2024-03-16T20:56:51.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.061+0000 7f6cecc00700 1 -- 172.21.15.8:0/3364281101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce81a68f0 con 0x7f6ce8109860 2024-03-16T20:56:51.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.061+0000 7f6cecc00700 1 -- 172.21.15.8:0/3364281101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce81a6da0 con 0x7f6ce8109860 2024-03-16T20:56:51.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.062+0000 7f6cecc00700 1 -- 172.21.15.8:0/3364281101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce810f950 con 0x7f6ce8109860 2024-03-16T20:56:51.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.064+0000 7f6cdea00700 1 -- 172.21.15.8:0/3364281101 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f6cd40109c0 con 0x7f6ce8109860 2024-03-16T20:56:51.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.066+0000 7f6cdea00700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ccc0a1ac0 0x7f6ccc0a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:51.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.066+0000 7f6cdea00700 1 -- 172.21.15.8:0/3364281101 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6cd4014070 con 0x7f6ce8109860 2024-03-16T20:56:51.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.066+0000 7f6ce5e00700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ccc0a1ac0 0x7f6ccc0a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:51.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.067+0000 7f6ce5e00700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ccc0a1ac0 0x7f6ccc0a3f80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6ce81096c0 tx=0x7f6cd8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:51.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.070+0000 7f6cdea00700 1 -- 172.21.15.8:0/3364281101 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6cd4053280 con 0x7f6ce8109860 2024-03-16T20:56:51.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:50 smithi170 ceph-mon[35947]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T20:56:51.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:50 smithi186 ceph-mon[36391]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T20:56:51.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.315+0000 7f6cecc00700 1 -- 172.21.15.8:0/3364281101 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ce802daa0 con 0x7f6ccc0a1ac0 2024-03-16T20:56:51.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.317+0000 7f6cdea00700 1 -- 172.21.15.8:0/3364281101 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6ce802daa0 con 0x7f6ccc0a1ac0 2024-03-16T20:56:51.322 INFO:teuthology.orchestra.run.smithi008.stdout:Backend: cephadm 2024-03-16T20:56:51.322 INFO:teuthology.orchestra.run.smithi008.stdout:Available: Yes 2024-03-16T20:56:51.322 INFO:teuthology.orchestra.run.smithi008.stdout:Paused: No 2024-03-16T20:56:51.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 -- 172.21.15.8:0/3364281101 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ccc0a1ac0 msgr2=0x7f6ccc0a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:51.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ccc0a1ac0 0x7f6ccc0a3f80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6ce81096c0 tx=0x7f6cd8009260 comp rx=0 tx=0).stop 2024-03-16T20:56:51.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 -- 172.21.15.8:0/3364281101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce8109860 msgr2=0x7f6ce819ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce8109860 0x7f6ce819ecf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400e9a0 tx=0x7f6cd400ecb0 comp rx=0 tx=0).stop 2024-03-16T20:56:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 -- 172.21.15.8:0/3364281101 shutdown_connections 2024-03-16T20:56:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f6ccc0a1ac0 0x7f6ccc0a3f80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ce810a200 0x7f6ce81a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ce8108660 0x7f6ce819e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 --2- 172.21.15.8:0/3364281101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce8109860 0x7f6ce819ecf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 -- 172.21.15.8:0/3364281101 >> 172.21.15.8:0/3364281101 conn(0x7f6ce8077630 msgr2=0x7f6ce810ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 -- 172.21.15.8:0/3364281101 shutdown_connections 2024-03-16T20:56:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:51.320+0000 7f6cecc00700 1 -- 172.21.15.8:0/3364281101 wait complete. 2024-03-16T20:56:52.250 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-16T20:56:52.721 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:52.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:52 smithi008 ceph-mon[31434]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:52.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:52 smithi008 ceph-mon[31434]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:56:53.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:52 smithi170 ceph-mon[35947]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:53.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:52 smithi170 ceph-mon[35947]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:56:53.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:52 smithi186 ceph-mon[36391]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:53.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:52 smithi186 ceph-mon[36391]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:56:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.903+0000 7febb2600700 1 -- 172.21.15.8:0/599200741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac103210 msgr2=0x7febac103670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.903+0000 7febb2600700 1 --2- 172.21.15.8:0/599200741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac103210 0x7febac103670 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feb980099c0 tx=0x7feb98009cd0 comp rx=0 tx=0).stop 2024-03-16T20:56:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.903+0000 7febb2600700 1 -- 172.21.15.8:0/599200741 shutdown_connections 2024-03-16T20:56:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.903+0000 7febb2600700 1 --2- 172.21.15.8:0/599200741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febac103bb0 0x7febac10a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.903+0000 7febb2600700 1 --2- 172.21.15.8:0/599200741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febac102010 0x7febac102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.903+0000 7febb2600700 1 --2- 172.21.15.8:0/599200741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac103210 0x7febac103670 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.903+0000 7febb2600700 1 -- 172.21.15.8:0/599200741 >> 172.21.15.8:0/599200741 conn(0x7febac0fd5f0 msgr2=0x7febac0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.903+0000 7febb2600700 1 -- 172.21.15.8:0/599200741 shutdown_connections 2024-03-16T20:56:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.903+0000 7febb2600700 1 -- 172.21.15.8:0/599200741 wait complete. 2024-03-16T20:56:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.904+0000 7febb2600700 1 Processor -- start 2024-03-16T20:56:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.904+0000 7febb2600700 1 -- start start 2024-03-16T20:56:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febb2600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febac102010 0x7febac19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febb2600700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac103210 0x7febac19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febb2600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febac103bb0 0x7febac1a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febb2600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac1a1e70 con 0x7febac103bb0 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febb2600700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac1a1fb0 con 0x7febac103210 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febb2600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac1a2140 con 0x7febac102010 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febaaa00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac103210 0x7febac19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febab400700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febac102010 0x7febac19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febaaa00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac103210 0x7febac19a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40386/0 (socket says 172.21.15.8:40386) 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febaaa00700 1 -- 172.21.15.8:0/3117280859 learned_addr learned my addr 172.21.15.8:0/3117280859 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febabe00700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febac103bb0 0x7febac1a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febab400700 1 -- 172.21.15.8:0/3117280859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac103210 msgr2=0x7febac19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febab400700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac103210 0x7febac19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febab400700 1 -- 172.21.15.8:0/3117280859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febac103bb0 msgr2=0x7febac1a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.905+0000 7febab400700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febac103bb0 0x7febac1a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.906+0000 7febab400700 1 -- 172.21.15.8:0/3117280859 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb980095f0 con 0x7febac102010 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.906+0000 7febabe00700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febac103bb0 0x7febac1a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:56:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.906+0000 7febaaa00700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac103210 0x7febac19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:56:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.906+0000 7febab400700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febac102010 0x7febac19a2e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e9f0 tx=0x7feb9c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.906+0000 7feba3e00700 1 -- 172.21.15.8:0/3117280859 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00eee0 con 0x7febac102010 2024-03-16T20:56:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.906+0000 7feba3e00700 1 -- 172.21.15.8:0/3117280859 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7feb9c004520 con 0x7febac102010 2024-03-16T20:56:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.906+0000 7febb2600700 1 -- 172.21.15.8:0/3117280859 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac1a2420 con 0x7febac102010 2024-03-16T20:56:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.906+0000 7feba3e00700 1 -- 172.21.15.8:0/3117280859 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c003df0 con 0x7febac102010 2024-03-16T20:56:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.906+0000 7febb2600700 1 -- 172.21.15.8:0/3117280859 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac1a2970 con 0x7febac102010 2024-03-16T20:56:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.907+0000 7febb2600700 1 -- 172.21.15.8:0/3117280859 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac068ca0 con 0x7febac102010 2024-03-16T20:56:54.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.909+0000 7feba3e00700 1 -- 172.21.15.8:0/3117280859 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7feb9c004000 con 0x7febac102010 2024-03-16T20:56:54.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.910+0000 7feba3e00700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb900a1b40 0x7feb900a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:54.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.911+0000 7feba3e00700 1 -- 172.21.15.8:0/3117280859 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feb9c014070 con 0x7febac102010 2024-03-16T20:56:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.911+0000 7febaaa00700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb900a1b40 0x7feb900a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.911+0000 7febaaa00700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb900a1b40 0x7feb900a4000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feb98003950 tx=0x7feb98005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:54.915+0000 7feba3e00700 1 -- 172.21.15.8:0/3117280859 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7feb9c096860 con 0x7febac102010 2024-03-16T20:56:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:54 smithi008 ceph-mon[31434]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:55.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:54 smithi170 ceph-mon[35947]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:55.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:54 smithi186 ceph-mon[36391]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:56:55.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.150+0000 7febb2600700 1 -- 172.21.15.8:0/3117280859 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7febac075930 con 0x7feb900a1b40 2024-03-16T20:56:55.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.168+0000 7feba3e00700 1 -- 172.21.15.8:0/3117280859 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7febac075930 con 0x7feb900a1b40 2024-03-16T20:56:55.174 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-16T20:56:55.174 INFO:teuthology.orchestra.run.smithi008.stdout:mds.a smithi008 running (2m) 22s ago 2m 12.3M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba 32c086b5946c 2024-03-16T20:56:55.174 INFO:teuthology.orchestra.run.smithi008.stdout:mds.b smithi170 running (117s) 48s ago 117s 25.8M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba 693a35867200 2024-03-16T20:56:55.174 INFO:teuthology.orchestra.run.smithi008.stdout:mds.c smithi186 running (2m) 48s ago 2m 19.2M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba 54671af5a324 2024-03-16T20:56:55.174 INFO:teuthology.orchestra.run.smithi008.stdout:mds.d smithi008 running (2m) 22s ago 2m 12.4M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba e439fb0ee714 2024-03-16T20:56:55.174 INFO:teuthology.orchestra.run.smithi008.stdout:mds.e smithi170 running (2m) 48s ago 2m 16.9M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba 5df377e9316f 2024-03-16T20:56:55.174 INFO:teuthology.orchestra.run.smithi008.stdout:mds.f smithi186 running (2m) 48s ago 2m 15.9M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba e33f94b835df 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mds.g smithi008 running (2m) 22s ago 2m 12.3M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba 5bf90d69e465 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mds.h smithi170 running (2m) 48s ago 2m 19.6M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba d4ad7e0332a2 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mds.i smithi186 running (2m) 48s ago 2m 17.3M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba d621d4c7b200 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mds.j smithi008 running (2m) 22s ago 2m 12.4M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba b241a9c722e5 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mds.k smithi170 running (2m) 48s ago 2m 16.3M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba 07752b1516c4 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mds.l smithi186 running (2m) 48s ago 2m 13.6M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba a8ffc766bf6f 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.x smithi008 *:9283,8765 running (10m) 22s ago 10m 513M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba 679081db66a6 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.y smithi170 *:8443,8765 running (8m) 48s ago 8m 450M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba f659b6a51d81 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.z smithi186 *:8443,8765 running (8m) 48s ago 8m 451M - 19.0.0-1681-gaba3c1d2 80ec0d3daaba de40adc41fd0 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mon.a smithi008 running (10m) 22s ago 11m 48.2M 2048M 19.0.0-1681-gaba3c1d2 80ec0d3daaba a5a6050aac3f 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mon.b smithi170 running (8m) 48s ago 8m 43.3M 2048M 19.0.0-1681-gaba3c1d2 80ec0d3daaba 233ed24b031b 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:mon.c smithi186 running (8m) 48s ago 8m 43.7M 2048M 19.0.0-1681-gaba3c1d2 80ec0d3daaba b5ace1e80431 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (8m) 22s ago 8m 46.1M 4273M 19.0.0-1681-gaba3c1d2 80ec0d3daaba 04593d1a72bf 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi170 running (7m) 48s ago 7m 56.2M 4270M 19.0.0-1681-gaba3c1d2 80ec0d3daaba 78ebb06dee68 2024-03-16T20:56:55.175 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi186 running (7m) 48s ago 7m 58.0M 4270M 19.0.0-1681-gaba3c1d2 80ec0d3daaba f8e81faa3e39 2024-03-16T20:56:55.176 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi008 running (6m) 22s ago 6m 42.3M 4273M 19.0.0-1681-gaba3c1d2 80ec0d3daaba 145b13ba78ec 2024-03-16T20:56:55.176 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi170 running (6m) 48s ago 6m 41.9M 4270M 19.0.0-1681-gaba3c1d2 80ec0d3daaba 5fb7a0258a40 2024-03-16T20:56:55.176 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi186 running (5m) 48s ago 5m 43.6M 4270M 19.0.0-1681-gaba3c1d2 80ec0d3daaba 36da19455887 2024-03-16T20:56:55.176 INFO:teuthology.orchestra.run.smithi008.stdout:osd.6 smithi008 running (5m) 22s ago 5m 41.4M 4273M 19.0.0-1681-gaba3c1d2 80ec0d3daaba e7830618fb93 2024-03-16T20:56:55.176 INFO:teuthology.orchestra.run.smithi008.stdout:osd.7 smithi170 running (4m) 48s ago 4m 52.7M 4270M 19.0.0-1681-gaba3c1d2 80ec0d3daaba 7e664bf77c93 2024-03-16T20:56:55.176 INFO:teuthology.orchestra.run.smithi008.stdout:osd.8 smithi186 running (4m) 48s ago 4m 55.9M 4270M 19.0.0-1681-gaba3c1d2 80ec0d3daaba de4d7cce7dd6 2024-03-16T20:56:55.176 INFO:teuthology.orchestra.run.smithi008.stdout:osd.9 smithi008 running (3m) 22s ago 3m 52.5M 4273M 19.0.0-1681-gaba3c1d2 80ec0d3daaba 7d789410520b 2024-03-16T20:56:55.176 INFO:teuthology.orchestra.run.smithi008.stdout:osd.10 smithi170 running (3m) 48s ago 3m 44.7M 4270M 19.0.0-1681-gaba3c1d2 80ec0d3daaba a5cd0efa6250 2024-03-16T20:56:55.176 INFO:teuthology.orchestra.run.smithi008.stdout:osd.11 smithi186 running (2m) 48s ago 2m 40.8M 4270M 19.0.0-1681-gaba3c1d2 80ec0d3daaba 4403b6346617 2024-03-16T20:56:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.171+0000 7febb2600700 1 -- 172.21.15.8:0/3117280859 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb900a1b40 msgr2=0x7feb900a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.171+0000 7febb2600700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb900a1b40 0x7feb900a4000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feb98003950 tx=0x7feb98005fb0 comp rx=0 tx=0).stop 2024-03-16T20:56:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.171+0000 7febb2600700 1 -- 172.21.15.8:0/3117280859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febac102010 msgr2=0x7febac19a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.171+0000 7febb2600700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febac102010 0x7febac19a2e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e9f0 tx=0x7feb9c00ed00 comp rx=0 tx=0).stop 2024-03-16T20:56:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.171+0000 7febb2600700 1 -- 172.21.15.8:0/3117280859 shutdown_connections 2024-03-16T20:56:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.171+0000 7febb2600700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7feb900a1b40 0x7feb900a4000 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.171+0000 7febb2600700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febac103bb0 0x7febac1a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.171+0000 7febb2600700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febac102010 0x7febac19a2e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:55.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.171+0000 7febb2600700 1 --2- 172.21.15.8:0/3117280859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febac103210 0x7febac19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:55.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.171+0000 7febb2600700 1 -- 172.21.15.8:0/3117280859 >> 172.21.15.8:0/3117280859 conn(0x7febac0fd5f0 msgr2=0x7febac074210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:55.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.172+0000 7febb2600700 1 -- 172.21.15.8:0/3117280859 shutdown_connections 2024-03-16T20:56:55.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:55.172+0000 7febb2600700 1 -- 172.21.15.8:0/3117280859 wait complete. 2024-03-16T20:56:56.033 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- bash -c 'ceph orch ls' 2024-03-16T20:56:56.520 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:56:56.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:56 smithi008 ceph-mon[31434]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:56:56.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:56 smithi008 ceph-mon[31434]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:56:57.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:56 smithi170 ceph-mon[35947]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:56:57.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:56 smithi170 ceph-mon[35947]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:56:57.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:56 smithi186 ceph-mon[36391]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:56:57.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:56 smithi186 ceph-mon[36391]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.796+0000 7fe0f8e00700 1 -- 172.21.15.8:0/156501890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f4100890 msgr2=0x7fe0f4100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.796+0000 7fe0f8e00700 1 --2- 172.21.15.8:0/156501890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f4100890 0x7fe0f4100cb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009990 tx=0x7fe0e4009ca0 comp rx=0 tx=0).stop 2024-03-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.796+0000 7fe0f8e00700 1 -- 172.21.15.8:0/156501890 shutdown_connections 2024-03-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.796+0000 7fe0f8e00700 1 --2- 172.21.15.8:0/156501890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0f4101bb0 0x7fe0f4102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.796+0000 7fe0f8e00700 1 --2- 172.21.15.8:0/156501890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f4100890 0x7fe0f4100cb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.796+0000 7fe0f8e00700 1 --2- 172.21.15.8:0/156501890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f41011f0 0x7fe0f4101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:58.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.796+0000 7fe0f8e00700 1 -- 172.21.15.8:0/156501890 >> 172.21.15.8:0/156501890 conn(0x7fe0f40fc4b0 msgr2=0x7fe0f40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:58.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.796+0000 7fe0f8e00700 1 -- 172.21.15.8:0/156501890 shutdown_connections 2024-03-16T20:56:58.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.796+0000 7fe0f8e00700 1 -- 172.21.15.8:0/156501890 wait complete. 2024-03-16T20:56:58.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:56:58 smithi008 ceph-mon[31434]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.798+0000 7fe0f8e00700 1 Processor -- start 2024-03-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.798+0000 7fe0f8e00700 1 -- start start 2024-03-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f8e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f4100890 0x7fe0f419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f8e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f41011f0 0x7fe0f419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f8e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0f4101bb0 0x7fe0f41a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f8e00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41a1f00 con 0x7fe0f4101bb0 2024-03-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f8e00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41a2040 con 0x7fe0f41011f0 2024-03-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f8e00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41a21d0 con 0x7fe0f4100890 2024-03-16T20:56:58.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f1400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f41011f0 0x7fe0f419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f1e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f4100890 0x7fe0f419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f1e00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f4100890 0x7fe0f419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56032/0 (socket says 172.21.15.8:56032) 2024-03-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f1e00700 1 -- 172.21.15.8:0/4125846536 learned_addr learned my addr 172.21.15.8:0/4125846536 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f1400700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f41011f0 0x7fe0f419a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:53222/0 (socket says 172.21.15.8:53222) 2024-03-16T20:56:58.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f2800700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0f4101bb0 0x7fe0f41a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f1400700 1 -- 172.21.15.8:0/4125846536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f4100890 msgr2=0x7fe0f419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f1400700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f4100890 0x7fe0f419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f1400700 1 -- 172.21.15.8:0/4125846536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0f4101bb0 msgr2=0x7fe0f41a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f1400700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0f4101bb0 0x7fe0f41a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.799+0000 7fe0f1400700 1 -- 172.21.15.8:0/4125846536 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e40095f0 con 0x7fe0f41011f0 2024-03-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.800+0000 7fe0f1400700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f41011f0 0x7fe0f419a8b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000e9f0 tx=0x7fe0e000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.800+0000 7fe0eaa00700 1 -- 172.21.15.8:0/4125846536 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000c9c0 con 0x7fe0f41011f0 2024-03-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.800+0000 7fe0eaa00700 1 -- 172.21.15.8:0/4125846536 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe0e000cb20 con 0x7fe0f41011f0 2024-03-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.800+0000 7fe0f8e00700 1 -- 172.21.15.8:0/4125846536 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f41a24b0 con 0x7fe0f41011f0 2024-03-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.800+0000 7fe0eaa00700 1 -- 172.21.15.8:0/4125846536 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0018680 con 0x7fe0f41011f0 2024-03-16T20:56:58.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.800+0000 7fe0f8e00700 1 -- 172.21.15.8:0/4125846536 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f41a29b0 con 0x7fe0f41011f0 2024-03-16T20:56:58.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.801+0000 7fe0f8e00700 1 -- 172.21.15.8:0/4125846536 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f410b670 con 0x7fe0f41011f0 2024-03-16T20:56:58.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.803+0000 7fe0eaa00700 1 -- 172.21.15.8:0/4125846536 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fe0e00187e0 con 0x7fe0f41011f0 2024-03-16T20:56:58.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.805+0000 7fe0eaa00700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0d80a1ac0 0x7fe0d80a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:56:58.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.805+0000 7fe0eaa00700 1 -- 172.21.15.8:0/4125846536 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe0e0014070 con 0x7fe0f41011f0 2024-03-16T20:56:58.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.805+0000 7fe0f1e00700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0d80a1ac0 0x7fe0d80a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:56:58.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.806+0000 7fe0f1e00700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0d80a1ac0 0x7fe0d80a3f80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40098e0 tx=0x7fe0e4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:56:58.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:58.809+0000 7fe0eaa00700 1 -- 172.21.15.8:0/4125846536 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe0e0053280 con 0x7fe0f41011f0 2024-03-16T20:56:59.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.043+0000 7fe0f8e00700 1 -- 172.21.15.8:0/4125846536 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0f402da30 con 0x7fe0d80a1ac0 2024-03-16T20:56:59.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.051+0000 7fe0eaa00700 1 -- 172.21.15.8:0/4125846536 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fe0f402da30 con 0x7fe0d80a1ac0 2024-03-16T20:56:59.056 INFO:teuthology.orchestra.run.smithi008.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-16T20:56:59.056 INFO:teuthology.orchestra.run.smithi008.stdout:mds.all 12/12 52s ago 2m smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi170=b;smithi170=e;smithi170=h;smithi170=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2024-03-16T20:56:59.056 INFO:teuthology.orchestra.run.smithi008.stdout:mgr 3/3 52s ago 8m smithi008=x;smithi170=y;smithi186=z;count:3 2024-03-16T20:56:59.056 INFO:teuthology.orchestra.run.smithi008.stdout:mon 3/3 52s ago 9m smithi008:172.21.15.8=a;smithi170:172.21.15.170=b;smithi186:172.21.15.186=c;count:3 2024-03-16T20:56:59.057 INFO:teuthology.orchestra.run.smithi008.stdout:osd 12 52s ago - 2024-03-16T20:56:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 -- 172.21.15.8:0/4125846536 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0d80a1ac0 msgr2=0x7fe0d80a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0d80a1ac0 0x7fe0d80a3f80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40098e0 tx=0x7fe0e4005960 comp rx=0 tx=0).stop 2024-03-16T20:56:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 -- 172.21.15.8:0/4125846536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f41011f0 msgr2=0x7fe0f419a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:56:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f41011f0 0x7fe0f419a8b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000e9f0 tx=0x7fe0e000ed00 comp rx=0 tx=0).stop 2024-03-16T20:56:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 -- 172.21.15.8:0/4125846536 shutdown_connections 2024-03-16T20:56:59.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0d80a1ac0 0x7fe0d80a3f80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0f4101bb0 0x7fe0f41a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0f4100890 0x7fe0f419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 --2- 172.21.15.8:0/4125846536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0f41011f0 0x7fe0f419a8b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:56:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 -- 172.21.15.8:0/4125846536 >> 172.21.15.8:0/4125846536 conn(0x7fe0f40fc4b0 msgr2=0x7fe0f40fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:56:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 -- 172.21.15.8:0/4125846536 shutdown_connections 2024-03-16T20:56:59.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:56:59.055+0000 7fe0f8e00700 1 -- 172.21.15.8:0/4125846536 wait complete. 2024-03-16T20:56:59.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:56:58 smithi170 ceph-mon[35947]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:59.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:56:58 smithi186 ceph-mon[36391]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:56:59.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-16T20:57:00.400 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:57:00.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:00 smithi008 ceph-mon[31434]: from='client.25049 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:00.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:00 smithi008 ceph-mon[31434]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:57:01.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:00 smithi170 ceph-mon[35947]: from='client.25049 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:01.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:00 smithi170 ceph-mon[35947]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:57:01.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:00 smithi186 ceph-mon[36391]: from='client.25049 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:01.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:00 smithi186 ceph-mon[36391]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:57:02.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.654+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1051703934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c0103210 msgr2=0x7ff9c0103670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:02.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.654+0000 7ff9c6c00700 1 --2- 172.21.15.8:0/1051703934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c0103210 0x7ff9c0103670 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009920 tx=0x7ff9ac009c30 comp rx=0 tx=0).stop 2024-03-16T20:57:02.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.654+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1051703934 shutdown_connections 2024-03-16T20:57:02.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.654+0000 7ff9c6c00700 1 --2- 172.21.15.8:0/1051703934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c0103bb0 0x7ff9c010a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:02.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.654+0000 7ff9c6c00700 1 --2- 172.21.15.8:0/1051703934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9c0102010 0x7ff9c0102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:02.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.654+0000 7ff9c6c00700 1 --2- 172.21.15.8:0/1051703934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c0103210 0x7ff9c0103670 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:02.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.654+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1051703934 >> 172.21.15.8:0/1051703934 conn(0x7ff9c00fd5f0 msgr2=0x7ff9c00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:02.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.654+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1051703934 shutdown_connections 2024-03-16T20:57:02.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.655+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1051703934 wait complete. 2024-03-16T20:57:02.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.656+0000 7ff9c6c00700 1 Processor -- start 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.656+0000 7ff9c6c00700 1 -- start start 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.656+0000 7ff9c6c00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c0102010 0x7ff9c0075d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.656+0000 7ff9c6c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c0103210 0x7ff9c00743d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.656+0000 7ff9c6c00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9c0103bb0 0x7ff9c0074910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.656+0000 7ff9c6c00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c00750b0 con 0x7ff9c0103210 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.656+0000 7ff9c6c00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0075220 con 0x7ff9c0102010 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.656+0000 7ff9c6c00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c01a21e0 con 0x7ff9c0103bb0 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.657+0000 7ff9bfe00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c0102010 0x7ff9c0075d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.657+0000 7ff9bf400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c0103210 0x7ff9c00743d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.657+0000 7ff9bfe00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c0102010 0x7ff9c0075d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:53244/0 (socket says 172.21.15.8:53244) 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.657+0000 7ff9bfe00700 1 -- 172.21.15.8:0/1076279707 learned_addr learned my addr 172.21.15.8:0/1076279707 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.657+0000 7ff9c4c00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9c0103bb0 0x7ff9c0074910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:02.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.657+0000 7ff9bfe00700 1 -- 172.21.15.8:0/1076279707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9c0103bb0 msgr2=0x7ff9c0074910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:02.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.657+0000 7ff9bfe00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9c0103bb0 0x7ff9c0074910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:02.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.657+0000 7ff9bfe00700 1 -- 172.21.15.8:0/1076279707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c0103210 msgr2=0x7ff9c00743d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.657+0000 7ff9bfe00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c0103210 0x7ff9c00743d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.657+0000 7ff9bfe00700 1 -- 172.21.15.8:0/1076279707 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac009520 con 0x7ff9c0102010 2024-03-16T20:57:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.657+0000 7ff9c4c00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9c0103bb0 0x7ff9c0074910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.658+0000 7ff9bfe00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c0102010 0x7ff9c0075d30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000e9f0 tx=0x7ff9b000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.658+0000 7ff9bcc00700 1 -- 172.21.15.8:0/1076279707 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0004220 con 0x7ff9c0102010 2024-03-16T20:57:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.658+0000 7ff9bcc00700 1 -- 172.21.15.8:0/1076279707 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff9b000ccc0 con 0x7ff9c0102010 2024-03-16T20:57:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.658+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1076279707 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c01a2470 con 0x7ff9c0102010 2024-03-16T20:57:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.658+0000 7ff9bcc00700 1 -- 172.21.15.8:0/1076279707 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0003d00 con 0x7ff9c0102010 2024-03-16T20:57:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.658+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1076279707 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c01a29c0 con 0x7ff9c0102010 2024-03-16T20:57:02.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.659+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1076279707 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c0109450 con 0x7ff9c0102010 2024-03-16T20:57:02.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.661+0000 7ff9bcc00700 1 -- 172.21.15.8:0/1076279707 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7ff9b000c7c0 con 0x7ff9c0102010 2024-03-16T20:57:02.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.662+0000 7ff9bcc00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9a40a1b40 0x7ff9a40a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:02.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.663+0000 7ff9bcc00700 1 -- 172.21.15.8:0/1076279707 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff9b0014070 con 0x7ff9c0102010 2024-03-16T20:57:02.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.663+0000 7ff9bf400700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9a40a1b40 0x7ff9a40a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:02.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.663+0000 7ff9bf400700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9a40a1b40 0x7ff9a40a4000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00fc20 tx=0x7ff9ac019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:02.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.666+0000 7ff9bcc00700 1 -- 172.21.15.8:0/1076279707 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff9b00966d0 con 0x7ff9c0102010 2024-03-16T20:57:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.900+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1076279707 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9c002da90 con 0x7ff9a40a1b40 2024-03-16T20:57:02.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.904+0000 7ff9bcc00700 1 -- 172.21.15.8:0/1076279707 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7ff9c002da90 con 0x7ff9a40a1b40 2024-03-16T20:57:02.909 INFO:teuthology.orchestra.run.smithi008.stdout:HOST ADDR LABELS STATUS 2024-03-16T20:57:02.909 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 172.21.15.8 2024-03-16T20:57:02.909 INFO:teuthology.orchestra.run.smithi008.stdout:smithi170 172.21.15.170 2024-03-16T20:57:02.909 INFO:teuthology.orchestra.run.smithi008.stdout:smithi186 172.21.15.186 2024-03-16T20:57:02.909 INFO:teuthology.orchestra.run.smithi008.stdout:3 hosts in cluster 2024-03-16T20:57:02.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.906+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1076279707 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9a40a1b40 msgr2=0x7ff9a40a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:02.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.906+0000 7ff9c6c00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9a40a1b40 0x7ff9a40a4000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00fc20 tx=0x7ff9ac019040 comp rx=0 tx=0).stop 2024-03-16T20:57:02.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.907+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1076279707 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c0102010 msgr2=0x7ff9c0075d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:02.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.907+0000 7ff9c6c00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c0102010 0x7ff9c0075d30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000e9f0 tx=0x7ff9b000ed00 comp rx=0 tx=0).stop 2024-03-16T20:57:02.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.907+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1076279707 shutdown_connections 2024-03-16T20:57:02.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.907+0000 7ff9c6c00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9a40a1b40 0x7ff9a40a4000 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:02.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.907+0000 7ff9c6c00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9c0103bb0 0x7ff9c0074910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:02.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.907+0000 7ff9c6c00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c0102010 0x7ff9c0075d30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:02.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.907+0000 7ff9c6c00700 1 --2- 172.21.15.8:0/1076279707 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9c0103210 0x7ff9c00743d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:02.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.907+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1076279707 >> 172.21.15.8:0/1076279707 conn(0x7ff9c00fd5f0 msgr2=0x7ff9c0106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:02.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.907+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1076279707 shutdown_connections 2024-03-16T20:57:02.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:02.907+0000 7ff9c6c00700 1 -- 172.21.15.8:0/1076279707 wait complete. 2024-03-16T20:57:03.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:02 smithi170 ceph-mon[35947]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:03.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:02 smithi186 ceph-mon[36391]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:03.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:02 smithi008 ceph-mon[31434]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:03.791 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-16T20:57:03.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:03 smithi008 ceph-mon[31434]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:04.018 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:03 smithi170 ceph-mon[35947]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:04.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:03 smithi186 ceph-mon[36391]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:04.259 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:57:04.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:04 smithi008 ceph-mon[31434]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:57:05.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:04 smithi170 ceph-mon[35947]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:57:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:04 smithi186 ceph-mon[36391]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:57:06.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.330+0000 7f3f68800700 1 -- 172.21.15.8:0/1604397904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f60075f90 msgr2=0x7f3f600743f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:06.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.330+0000 7f3f68800700 1 --2- 172.21.15.8:0/1604397904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f60075f90 0x7f3f600743f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009990 tx=0x7f3f54009ca0 comp rx=0 tx=0).stop 2024-03-16T20:57:06.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.330+0000 7f3f68800700 1 -- 172.21.15.8:0/1604397904 shutdown_connections 2024-03-16T20:57:06.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.330+0000 7f3f68800700 1 --2- 172.21.15.8:0/1604397904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f60109f60 0x7f3f6010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:06.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.330+0000 7f3f68800700 1 --2- 172.21.15.8:0/1604397904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f60075f90 0x7f3f600743f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:06.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.330+0000 7f3f68800700 1 --2- 172.21.15.8:0/1604397904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f600749c0 0x7f3f60074e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:06.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.330+0000 7f3f68800700 1 -- 172.21.15.8:0/1604397904 >> 172.21.15.8:0/1604397904 conn(0x7f3f600fd600 msgr2=0x7f3f600ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:06.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.331+0000 7f3f68800700 1 -- 172.21.15.8:0/1604397904 shutdown_connections 2024-03-16T20:57:06.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.331+0000 7f3f68800700 1 -- 172.21.15.8:0/1604397904 wait complete. 2024-03-16T20:57:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f68800700 1 Processor -- start 2024-03-16T20:57:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f68800700 1 -- start start 2024-03-16T20:57:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f68800700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f600749c0 0x7f3f6019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f68800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f60075f90 0x7f3f6019a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f68800700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f60109f60 0x7f3f601a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f68800700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f601a1e00 con 0x7f3f60075f90 2024-03-16T20:57:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f68800700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f601a1f40 con 0x7f3f600749c0 2024-03-16T20:57:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f68800700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f601a20d0 con 0x7f3f60109f60 2024-03-16T20:57:06.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f65e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f600749c0 0x7f3f6019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f65e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f600749c0 0x7f3f6019a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:53256/0 (socket says 172.21.15.8:53256) 2024-03-16T20:57:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f65e00700 1 -- 172.21.15.8:0/3012767909 learned_addr learned my addr 172.21.15.8:0/3012767909 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f65400700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f60075f90 0x7f3f6019a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.332+0000 7f3f66800700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f60109f60 0x7f3f601a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.333+0000 7f3f66800700 1 -- 172.21.15.8:0/3012767909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f600749c0 msgr2=0x7f3f6019a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.333+0000 7f3f66800700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f600749c0 0x7f3f6019a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.333+0000 7f3f66800700 1 -- 172.21.15.8:0/3012767909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f60075f90 msgr2=0x7f3f6019a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.333+0000 7f3f66800700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f60075f90 0x7f3f6019a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.333+0000 7f3f66800700 1 -- 172.21.15.8:0/3012767909 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f540095f0 con 0x7f3f60109f60 2024-03-16T20:57:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.333+0000 7f3f65e00700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f600749c0 0x7f3f6019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:06.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.333+0000 7f3f66800700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f60109f60 0x7f3f601a1830 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009f60 tx=0x7f3f5c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:06.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.333+0000 7f3f5aa00700 1 -- 172.21.15.8:0/3012767909 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c018070 con 0x7f3f60109f60 2024-03-16T20:57:06.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.333+0000 7f3f5aa00700 1 -- 172.21.15.8:0/3012767909 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3f5c00f040 con 0x7f3f60109f60 2024-03-16T20:57:06.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.333+0000 7f3f5aa00700 1 -- 172.21.15.8:0/3012767909 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00ce20 con 0x7f3f60109f60 2024-03-16T20:57:06.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.333+0000 7f3f68800700 1 -- 172.21.15.8:0/3012767909 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f601a2350 con 0x7f3f60109f60 2024-03-16T20:57:06.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.334+0000 7f3f68800700 1 -- 172.21.15.8:0/3012767909 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f601a2800 con 0x7f3f60109f60 2024-03-16T20:57:06.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.335+0000 7f3f68800700 1 -- 172.21.15.8:0/3012767909 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f60108d70 con 0x7f3f60109f60 2024-03-16T20:57:06.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.337+0000 7f3f5aa00700 1 -- 172.21.15.8:0/3012767909 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f3f5c004ad0 con 0x7f3f60109f60 2024-03-16T20:57:06.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.338+0000 7f3f5aa00700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f3f480a1ac0 0x7f3f480a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:06.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.338+0000 7f3f5aa00700 1 -- 172.21.15.8:0/3012767909 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3f5c0ccf10 con 0x7f3f60109f60 2024-03-16T20:57:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.339+0000 7f3f65e00700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f3f480a1ac0 0x7f3f480a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:06.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.339+0000 7f3f65e00700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f3f480a1ac0 0x7f3f480a3f80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400b800 tx=0x7f3f5400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:06.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.342+0000 7f3f5aa00700 1 -- 172.21.15.8:0/3012767909 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3f5c096160 con 0x7f3f60109f60 2024-03-16T20:57:06.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.576+0000 7f3f68800700 1 -- 172.21.15.8:0/3012767909 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f6002da30 con 0x7f3f480a1ac0 2024-03-16T20:57:06.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.580+0000 7f3f5aa00700 1 -- 172.21.15.8:0/3012767909 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f3f6002da30 con 0x7f3f480a1ac0 2024-03-16T20:57:06.586 INFO:teuthology.orchestra.run.smithi008.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-16T20:57:06.586 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476004A480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-03-16T20:57:06.586 INFO:teuthology.orchestra.run.smithi008.stdout:smithi170 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002R480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-03-16T20:57:06.586 INFO:teuthology.orchestra.run.smithi008.stdout:smithi186 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CB400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-03-16T20:57:06.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 -- 172.21.15.8:0/3012767909 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f3f480a1ac0 msgr2=0x7f3f480a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:06.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f3f480a1ac0 0x7f3f480a3f80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400b800 tx=0x7f3f5400b260 comp rx=0 tx=0).stop 2024-03-16T20:57:06.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 -- 172.21.15.8:0/3012767909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f60109f60 msgr2=0x7f3f601a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:06.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f60109f60 0x7f3f601a1830 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009f60 tx=0x7f3f5c009f90 comp rx=0 tx=0).stop 2024-03-16T20:57:06.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 -- 172.21.15.8:0/3012767909 shutdown_connections 2024-03-16T20:57:06.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f3f480a1ac0 0x7f3f480a3f80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:06.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f60109f60 0x7f3f601a1830 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:06.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f600749c0 0x7f3f6019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:06.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 --2- 172.21.15.8:0/3012767909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f60075f90 0x7f3f6019a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:06.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 -- 172.21.15.8:0/3012767909 >> 172.21.15.8:0/3012767909 conn(0x7f3f600fd600 msgr2=0x7f3f60105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:06.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 -- 172.21.15.8:0/3012767909 shutdown_connections 2024-03-16T20:57:06.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:06.583+0000 7f3f68800700 1 -- 172.21.15.8:0/3012767909 wait complete. 2024-03-16T20:57:06.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:06 smithi008 ceph-mon[31434]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:57:07.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:06 smithi170 ceph-mon[35947]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:57:07.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:06 smithi186 ceph-mon[36391]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:57:07.590 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-16T20:57:07.600 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2024-03-16T20:57:07.601 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-16T20:57:08.043 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:07 smithi186 ceph-mon[36391]: from='client.25066 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:08.092 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:57:08.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:07 smithi170 ceph-mon[35947]: from='client.25066 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:08.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:07 smithi008 ceph-mon[31434]: from='client.25066 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:08.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:08 smithi008 ceph-mon[31434]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:09.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:08 smithi170 ceph-mon[35947]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:09.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:08 smithi186 ceph-mon[36391]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:10.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.297+0000 7f16e5600700 1 -- 172.21.15.8:0/1963582045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e0104160 msgr2=0x7f16e0104580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:10.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.297+0000 7f16e5600700 1 --2- 172.21.15.8:0/1963582045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e0104160 0x7f16e0104580 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f16d00099c0 tx=0x7f16d0009cd0 comp rx=0 tx=0).stop 2024-03-16T20:57:10.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.297+0000 7f16e5600700 1 -- 172.21.15.8:0/1963582045 shutdown_connections 2024-03-16T20:57:10.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.297+0000 7f16e5600700 1 --2- 172.21.15.8:0/1963582045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e0105d00 0x7f16e010c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:10.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.297+0000 7f16e5600700 1 --2- 172.21.15.8:0/1963582045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e0104160 0x7f16e0104580 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:10.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.297+0000 7f16e5600700 1 --2- 172.21.15.8:0/1963582045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16e0105360 0x7f16e01057c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:10.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.297+0000 7f16e5600700 1 -- 172.21.15.8:0/1963582045 >> 172.21.15.8:0/1963582045 conn(0x7f16e00ff700 msgr2=0x7f16e0101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:10.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.297+0000 7f16e5600700 1 -- 172.21.15.8:0/1963582045 shutdown_connections 2024-03-16T20:57:10.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.297+0000 7f16e5600700 1 -- 172.21.15.8:0/1963582045 wait complete. 2024-03-16T20:57:10.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.298+0000 7f16e5600700 1 Processor -- start 2024-03-16T20:57:10.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.298+0000 7f16e5600700 1 -- start start 2024-03-16T20:57:10.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16e5600700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e0104160 0x7f16e019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16e5600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16e0105360 0x7f16e019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16e5600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e0105d00 0x7f16e01a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16e5600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e01a1d40 con 0x7f16e0105d00 2024-03-16T20:57:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16e5600700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e01a1e80 con 0x7f16e0104160 2024-03-16T20:57:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16e5600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e01a2010 con 0x7f16e0105360 2024-03-16T20:57:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16dfe00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e0104160 0x7f16e019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16dfe00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e0104160 0x7f16e019a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48460/0 (socket says 172.21.15.8:48460) 2024-03-16T20:57:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16dfe00700 1 -- 172.21.15.8:0/2618030331 learned_addr learned my addr 172.21.15.8:0/2618030331 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16df400700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16e0105360 0x7f16e019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:10.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16e4c00700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e0105d00 0x7f16e01a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16dfe00700 1 -- 172.21.15.8:0/2618030331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16e0105360 msgr2=0x7f16e019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16dfe00700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16e0105360 0x7f16e019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16dfe00700 1 -- 172.21.15.8:0/2618030331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e0105d00 msgr2=0x7f16e01a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16dfe00700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e0105d00 0x7f16e01a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16dfe00700 1 -- 172.21.15.8:0/2618030331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00095f0 con 0x7f16e0104160 2024-03-16T20:57:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.299+0000 7f16e4c00700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e0105d00 0x7f16e01a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.300+0000 7f16dfe00700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e0104160 0x7f16e019a1b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f16d00098e0 tx=0x7f16d000bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.300+0000 7f16dcc00700 1 -- 172.21.15.8:0/2618030331 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d001d070 con 0x7f16e0104160 2024-03-16T20:57:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.300+0000 7f16dcc00700 1 -- 172.21.15.8:0/2618030331 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f16d0005050 con 0x7f16e0104160 2024-03-16T20:57:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.300+0000 7f16e5600700 1 -- 172.21.15.8:0/2618030331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e01a2290 con 0x7f16e0104160 2024-03-16T20:57:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.300+0000 7f16dcc00700 1 -- 172.21.15.8:0/2618030331 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0004a70 con 0x7f16e0104160 2024-03-16T20:57:10.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.300+0000 7f16e5600700 1 -- 172.21.15.8:0/2618030331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e01a2700 con 0x7f16e0104160 2024-03-16T20:57:10.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.301+0000 7f16e5600700 1 -- 172.21.15.8:0/2618030331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e010b450 con 0x7f16e0104160 2024-03-16T20:57:10.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.303+0000 7f16dcc00700 1 -- 172.21.15.8:0/2618030331 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f16d00051c0 con 0x7f16e0104160 2024-03-16T20:57:10.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.304+0000 7f16dcc00700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f16c40a1b40 0x7f16c40a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:10.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.305+0000 7f16dcc00700 1 -- 172.21.15.8:0/2618030331 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f16d00ce2b0 con 0x7f16e0104160 2024-03-16T20:57:10.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.305+0000 7f16df400700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f16c40a1b40 0x7f16c40a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:10.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.305+0000 7f16df400700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f16c40a1b40 0x7f16c40a4000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009c60 tx=0x7f16cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:10.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.309+0000 7f16dcc00700 1 -- 172.21.15.8:0/2618030331 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f16d0097500 con 0x7f16e0104160 2024-03-16T20:57:10.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.583+0000 7f16e5600700 1 -- 172.21.15.8:0/2618030331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f16e0068ca0 con 0x7f16e0104160 2024-03-16T20:57:10.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.583+0000 7f16dcc00700 1 -- 172.21.15.8:0/2618030331 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+2988 (secure 0 0 0) 0x7f16d009abc0 con 0x7f16e0104160 2024-03-16T20:57:10.589 INFO:teuthology.orchestra.run.smithi008.stdout:e23 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 23 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:created 2024-03-16T20:55:04.725491+0000 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2024-03-16T20:55:10.355515+0000 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2024-03-16T20:57:10.590 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 300 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:max_xattr_size 65536 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 3 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1,2 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=24593,1=24544,2=24536} 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2024-03-16T20:57:10.591 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:bal_rank_mask -1 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 0 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:qdb_cluster leader: 24593 members: 24536,24593,24544 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b{0:24593} state up:active seq 3 addr [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c{0:24523} state up:standby-replay seq 1 addr [v2:172.21.15.186:6836/1748602428,v1:172.21.15.186:6837/1748602428] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.i{1:24544} state up:active seq 7 addr [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.f{1:24511} state up:standby-replay seq 1 addr [v2:172.21.15.186:6834/3505833451,v1:172.21.15.186:6835/3505833451] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.h{2:24536} state up:active seq 8 addr [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.e{2:24509} state up:standby-replay seq 1 addr [v2:172.21.15.170:6834/335822502,v1:172.21.15.170:6835/335822502] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.592 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:10.593 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:10.593 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2024-03-16T20:57:10.593 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:10.593 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d{-1:14394} state up:standby seq 1 addr [v2:172.21.15.8:6836/3869749427,v1:172.21.15.8:6837/3869749427] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.593 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.g{-1:14448} state up:standby seq 1 addr [v2:172.21.15.8:6838/4078077734,v1:172.21.15.8:6839/4078077734] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.593 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a{-1:14460} state up:standby seq 1 addr [v2:172.21.15.8:6840/1961952474,v1:172.21.15.8:6841/1961952474] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.593 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.l{-1:24448} state up:standby seq 1 addr [v2:172.21.15.186:6832/1283670519,v1:172.21.15.186:6833/1283670519] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.593 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.k{-1:24461} state up:standby seq 1 addr [v2:172.21.15.170:6832/636279364,v1:172.21.15.170:6833/636279364] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.593 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.j{-1:24479} state up:standby seq 1 addr [v2:172.21.15.8:6834/1887028715,v1:172.21.15.8:6835/1887028715] compat {c=[1],r=[1],i=[fff]}] 2024-03-16T20:57:10.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 -- 172.21.15.8:0/2618030331 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f16c40a1b40 msgr2=0x7f16c40a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:10.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f16c40a1b40 0x7f16c40a4000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009c60 tx=0x7f16cc009260 comp rx=0 tx=0).stop 2024-03-16T20:57:10.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 -- 172.21.15.8:0/2618030331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e0104160 msgr2=0x7f16e019a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:10.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e0104160 0x7f16e019a1b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f16d00098e0 tx=0x7f16d000bfd0 comp rx=0 tx=0).stop 2024-03-16T20:57:10.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 -- 172.21.15.8:0/2618030331 shutdown_connections 2024-03-16T20:57:10.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f16c40a1b40 0x7f16c40a4000 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:10.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16e0105d00 0x7f16e01a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:10.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e0104160 0x7f16e019a1b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:10.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 --2- 172.21.15.8:0/2618030331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16e0105360 0x7f16e019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:10.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 -- 172.21.15.8:0/2618030331 >> 172.21.15.8:0/2618030331 conn(0x7f16e00ff700 msgr2=0x7f16e0108590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:10.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 -- 172.21.15.8:0/2618030331 shutdown_connections 2024-03-16T20:57:10.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:10.587+0000 7f16e5600700 1 -- 172.21.15.8:0/2618030331 wait complete. 2024-03-16T20:57:10.595 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2024-03-16T20:57:10.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:10 smithi008 ceph-mon[31434]: pgmap v381: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:57:10.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:10 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2618030331' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-16T20:57:11.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:10 smithi170 ceph-mon[35947]: pgmap v381: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:57:11.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:10 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2618030331' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-16T20:57:11.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:10 smithi186 ceph-mon[36391]: pgmap v381: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:57:11.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:10 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2618030331' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-16T20:57:11.357 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- bash -c 'ceph osd dump' 2024-03-16T20:57:11.835 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:57:13.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:12 smithi170 ceph-mon[35947]: pgmap v382: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:13.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:12 smithi186 ceph-mon[36391]: pgmap v382: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:13.190 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:12 smithi008 ceph-mon[31434]: pgmap v382: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.021+0000 7f959ea00700 1 -- 172.21.15.8:0/3030178164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95981053d0 msgr2=0x7f95981077c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.021+0000 7f959ea00700 1 --2- 172.21.15.8:0/3030178164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95981053d0 0x7f95981077c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9584009990 tx=0x7f9584009ca0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.021+0000 7f959ea00700 1 -- 172.21.15.8:0/3030178164 shutdown_connections 2024-03-16T20:57:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.021+0000 7f959ea00700 1 --2- 172.21.15.8:0/3030178164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9598102aa0 0x7f9598104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.021+0000 7f959ea00700 1 --2- 172.21.15.8:0/3030178164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9598107d00 0x7f959810a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.021+0000 7f959ea00700 1 --2- 172.21.15.8:0/3030178164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95981053d0 0x7f95981077c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.021+0000 7f959ea00700 1 -- 172.21.15.8:0/3030178164 >> 172.21.15.8:0/3030178164 conn(0x7f95980fc4b0 msgr2=0x7f95980fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.021+0000 7f959ea00700 1 -- 172.21.15.8:0/3030178164 shutdown_connections 2024-03-16T20:57:14.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.021+0000 7f959ea00700 1 -- 172.21.15.8:0/3030178164 wait complete. 2024-03-16T20:57:14.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.023+0000 7f959ea00700 1 Processor -- start 2024-03-16T20:57:14.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.023+0000 7f959ea00700 1 -- start start 2024-03-16T20:57:14.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f959ea00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9598102aa0 0x7f959819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:14.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f959ea00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95981053d0 0x7f959819a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:14.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f959ea00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9598107d00 0x7f95981a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:14.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f959ea00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95981a1f00 con 0x7f95981053d0 2024-03-16T20:57:14.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f959ea00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95981a2040 con 0x7f9598102aa0 2024-03-16T20:57:14.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f959ea00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95981a21d0 con 0x7f9598107d00 2024-03-16T20:57:14.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f9597e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9598102aa0 0x7f959819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:14.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f9597e00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9598102aa0 0x7f959819a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48468/0 (socket says 172.21.15.8:48468) 2024-03-16T20:57:14.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f9597e00700 1 -- 172.21.15.8:0/1253044690 learned_addr learned my addr 172.21.15.8:0/1253044690 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:14.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f9597400700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95981053d0 0x7f959819a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:14.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f959ca00700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9598107d00 0x7f95981a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:14.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f9597e00700 1 -- 172.21.15.8:0/1253044690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9598107d00 msgr2=0x7f95981a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:14.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f9597e00700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9598107d00 0x7f95981a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f9597e00700 1 -- 172.21.15.8:0/1253044690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95981053d0 msgr2=0x7f959819a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f9597e00700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95981053d0 0x7f959819a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.024+0000 7f9597e00700 1 -- 172.21.15.8:0/1253044690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95840095f0 con 0x7f9598102aa0 2024-03-16T20:57:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.025+0000 7f9597e00700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9598102aa0 0x7f959819a370 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f958800e9a0 tx=0x7f958800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.025+0000 7f9594c00700 1 -- 172.21.15.8:0/1253044690 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588009790 con 0x7f9598102aa0 2024-03-16T20:57:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.025+0000 7f9594c00700 1 -- 172.21.15.8:0/1253044690 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9588010430 con 0x7f9598102aa0 2024-03-16T20:57:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.025+0000 7f959ea00700 1 -- 172.21.15.8:0/1253044690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95981a24b0 con 0x7f9598102aa0 2024-03-16T20:57:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.025+0000 7f9594c00700 1 -- 172.21.15.8:0/1253044690 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588018710 con 0x7f9598102aa0 2024-03-16T20:57:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.025+0000 7f959ea00700 1 -- 172.21.15.8:0/1253044690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95981a2a00 con 0x7f9598102aa0 2024-03-16T20:57:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.026+0000 7f959ea00700 1 -- 172.21.15.8:0/1253044690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95981098e0 con 0x7f9598102aa0 2024-03-16T20:57:14.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.028+0000 7f9594c00700 1 -- 172.21.15.8:0/1253044690 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f95880109a0 con 0x7f9598102aa0 2024-03-16T20:57:14.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.029+0000 7f9594c00700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f957c0a1b40 0x7f957c0a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:14.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.030+0000 7f9594c00700 1 -- 172.21.15.8:0/1253044690 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9588014070 con 0x7f9598102aa0 2024-03-16T20:57:14.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.030+0000 7f9597400700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f957c0a1b40 0x7f957c0a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:14.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.030+0000 7f9597400700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f957c0a1b40 0x7f957c0a4000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f958400b2e0 tx=0x7f9584005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.037+0000 7f9594c00700 1 -- 172.21.15.8:0/1253044690 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9588053280 con 0x7f9598102aa0 2024-03-16T20:57:14.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.265+0000 7f959ea00700 1 -- 172.21.15.8:0/1253044690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f9598068ca0 con 0x7f9598102aa0 2024-03-16T20:57:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.267+0000 7f9594c00700 1 -- 172.21.15.8:0/1253044690 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) v1 ==== 56+0+5252 (secure 0 0 0) 0x7f95880966e0 con 0x7f9598102aa0 2024-03-16T20:57:14.273 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 88 2024-03-16T20:57:14.273 INFO:teuthology.orchestra.run.smithi008.stdout:fsid 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T20:57:14.273 INFO:teuthology.orchestra.run.smithi008.stdout:created 2024-03-16T20:45:54.335480+0000 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2024-03-16T20:56:04.502777+0000 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:crush_version 26 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:full_ratio 0.95 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:backfillfull_ratio 0.9 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:nearfull_ratio 0.85 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:require_min_compat_client luminous 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:min_compat_client luminous 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:require_osd_release squid 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:stretch_mode_enabled false 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-03-16T20:57:14.274 INFO:teuthology.orchestra.run.smithi008.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:max_osd 12 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6802/3522564859,v1:172.21.15.8:6803/3522564859] [v2:172.21.15.8:6804/3522564859,v1:172.21.15.8:6805/3522564859] exists,up 14eef491-9b9d-4dc1-8779-a2f28a5dbdc2 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6800/1357795520,v1:172.21.15.170:6801/1357795520] [v2:172.21.15.170:6802/1357795520,v1:172.21.15.170:6803/1357795520] exists,up 5827deaa-3a3a-46d6-93c8-f03d6d586e16 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6800/1176857805,v1:172.21.15.186:6801/1176857805] [v2:172.21.15.186:6802/1176857805,v1:172.21.15.186:6803/1176857805] exists,up b803123f-d2da-4341-97ed-4b13fb96b49c 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6810/3279202487,v1:172.21.15.8:6811/3279202487] [v2:172.21.15.8:6812/3279202487,v1:172.21.15.8:6813/3279202487] exists,up 1a9ec3bc-a405-4fae-a263-63f34412c469 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 up in weight 1 up_from 34 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6808/1263992677,v1:172.21.15.170:6809/1263992677] [v2:172.21.15.170:6810/1263992677,v1:172.21.15.170:6811/1263992677] exists,up a59cbe06-70e2-4289-99c5-6ac77a7e5998 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 up in weight 1 up_from 39 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6808/1795818577,v1:172.21.15.186:6809/1795818577] [v2:172.21.15.186:6810/1795818577,v1:172.21.15.186:6811/1795818577] exists,up 94656aa4-e7a0-41c4-b17d-b05fbd63e4e1 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.6 up in weight 1 up_from 47 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6818/53202181,v1:172.21.15.8:6819/53202181] [v2:172.21.15.8:6820/53202181,v1:172.21.15.8:6821/53202181] exists,up da2851d1-b95b-4035-9555-f159a9fcc4e4 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.7 up in weight 1 up_from 52 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6816/1049528716,v1:172.21.15.170:6817/1049528716] [v2:172.21.15.170:6818/1049528716,v1:172.21.15.170:6819/1049528716] exists,up d9718fcd-5f0e-47da-8821-547c22b2de7d 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.8 up in weight 1 up_from 60 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6816/1658595318,v1:172.21.15.186:6817/1658595318] [v2:172.21.15.186:6818/1658595318,v1:172.21.15.186:6819/1658595318] exists,up f98927f9-bb43-4c80-af77-f319bc786d89 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.9 up in weight 1 up_from 68 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6826/882658660,v1:172.21.15.8:6827/882658660] [v2:172.21.15.8:6828/882658660,v1:172.21.15.8:6829/882658660] exists,up 35ed0aeb-5dd5-4354-bf28-f5043871c2ec 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.10 up in weight 1 up_from 73 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6824/1955752152,v1:172.21.15.170:6825/1955752152] [v2:172.21.15.170:6826/1955752152,v1:172.21.15.170:6827/1955752152] exists,up 7b004246-9f25-40a6-b58b-7dec13df8703 2024-03-16T20:57:14.275 INFO:teuthology.orchestra.run.smithi008.stdout:osd.11 up in weight 1 up_from 81 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6824/367869423,v1:172.21.15.186:6825/367869423] [v2:172.21.15.186:6826/367869423,v1:172.21.15.186:6827/367869423] exists,up 9d7c8c33-46e9-4e59-baef-f28b12a298b5 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 2.a [2,11] 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 2.10 [8,11] 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.1 [4,9] 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.5 [3,9] 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.21 [4,7] 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.23 [4,8] 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.28 [5,6] 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.33 [5,9] 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/1600768944 expires 2024-03-17T20:47:02.935893+0000 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6801/1972090527 expires 2024-03-17T20:47:02.935893+0000 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6800/1972090527 expires 2024-03-17T20:47:02.935893+0000 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6800/2888433195 expires 2024-03-17T20:46:27.714707+0000 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/834453818 expires 2024-03-17T20:46:27.714707+0000 2024-03-16T20:57:14.276 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2989623051 expires 2024-03-17T20:46:27.714707+0000 2024-03-16T20:57:14.277 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/3139410089 expires 2024-03-17T20:47:02.935893+0000 2024-03-16T20:57:14.277 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6801/2888433195 expires 2024-03-17T20:46:27.714707+0000 2024-03-16T20:57:14.277 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/304832415 expires 2024-03-17T20:46:27.714707+0000 2024-03-16T20:57:14.277 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/695532571 expires 2024-03-17T20:47:02.935893+0000 2024-03-16T20:57:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 -- 172.21.15.8:0/1253044690 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f957c0a1b40 msgr2=0x7f957c0a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f957c0a1b40 0x7f957c0a4000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f958400b2e0 tx=0x7f9584005fb0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 -- 172.21.15.8:0/1253044690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9598102aa0 msgr2=0x7f959819a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9598102aa0 0x7f959819a370 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f958800e9a0 tx=0x7f958800ecb0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 -- 172.21.15.8:0/1253044690 shutdown_connections 2024-03-16T20:57:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f957c0a1b40 0x7f957c0a4000 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9598107d00 0x7f95981a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9598102aa0 0x7f959819a370 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 --2- 172.21.15.8:0/1253044690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95981053d0 0x7f959819a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 -- 172.21.15.8:0/1253044690 >> 172.21.15.8:0/1253044690 conn(0x7f95980fc4b0 msgr2=0x7f9598102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 -- 172.21.15.8:0/1253044690 shutdown_connections 2024-03-16T20:57:14.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:14.270+0000 7f959ea00700 1 -- 172.21.15.8:0/1253044690 wait complete. 2024-03-16T20:57:14.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:14 smithi008 ceph-mon[31434]: pgmap v383: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:57:14.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:14 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1253044690' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-16T20:57:15.104 INFO:teuthology.run_tasks:Running task fs.ready... 2024-03-16T20:57:15.115 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:57:15.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:14 smithi170 ceph-mon[35947]: pgmap v383: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:57:15.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:14 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1253044690' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-16T20:57:15.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:14 smithi186 ceph-mon[36391]: pgmap v383: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:57:15.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:14 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1253044690' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-16T20:57:15.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.339+0000 7ff399800640 1 -- 172.21.15.8:0/1133404220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3940ff610 msgr2=0x7ff3940ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:15.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.339+0000 7ff399800640 1 --2- 172.21.15.8:0/1133404220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3940ff610 0x7ff3940ffa30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff384009900 tx=0x7ff38402bc30 comp rx=0 tx=0).stop 2024-03-16T20:57:15.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.339+0000 7ff399800640 1 -- 172.21.15.8:0/1133404220 shutdown_connections 2024-03-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.339+0000 7ff399800640 1 --2- 172.21.15.8:0/1133404220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102fa0 0x7ff394109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.339+0000 7ff399800640 1 --2- 172.21.15.8:0/1133404220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3941025e0 0x7ff394102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.339+0000 7ff399800640 1 --2- 172.21.15.8:0/1133404220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3940ff610 0x7ff3940ffa30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.339+0000 7ff399800640 1 -- 172.21.15.8:0/1133404220 >> 172.21.15.8:0/1133404220 conn(0x7ff3940faf40 msgr2=0x7ff3940fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.339+0000 7ff399800640 1 -- 172.21.15.8:0/1133404220 shutdown_connections 2024-03-16T20:57:15.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.339+0000 7ff399800640 1 -- 172.21.15.8:0/1133404220 wait complete. 2024-03-16T20:57:15.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.340+0000 7ff399800640 1 Processor -- start 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.340+0000 7ff399800640 1 -- start start 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.341+0000 7ff399800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3940ff610 0x7ff394197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.341+0000 7ff399800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3941025e0 0x7ff394197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.341+0000 7ff399800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102fa0 0x7ff39419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.341+0000 7ff399800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39419f000 con 0x7ff394102fa0 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.341+0000 7ff399800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39419f170 con 0x7ff3940ff610 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.341+0000 7ff399800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39419f330 con 0x7ff3941025e0 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.341+0000 7ff393400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3941025e0 0x7ff394197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.341+0000 7ff393e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3940ff610 0x7ff394197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.341+0000 7ff393400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3941025e0 0x7ff394197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46928/0 (socket says 172.21.15.8:46928) 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.341+0000 7ff393400640 1 -- 172.21.15.8:0/1207729269 learned_addr learned my addr 172.21.15.8:0/1207729269 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.341+0000 7ff398e00640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102fa0 0x7ff39419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:15.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff393e00640 1 -- 172.21.15.8:0/1207729269 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3941025e0 msgr2=0x7ff394197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff393e00640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3941025e0 0x7ff394197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff393e00640 1 -- 172.21.15.8:0/1207729269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102fa0 msgr2=0x7ff39419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff393e00640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102fa0 0x7ff39419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff393e00640 1 -- 172.21.15.8:0/1207729269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff384009560 con 0x7ff3940ff610 2024-03-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff398e00640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102fa0 0x7ff39419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:15.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff393e00640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3940ff610 0x7ff394197510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff38402c170 tx=0x7ff384005e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff390c00640 1 -- 172.21.15.8:0/1207729269 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3840043d0 con 0x7ff3940ff610 2024-03-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff390c00640 1 -- 172.21.15.8:0/1207729269 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff384005310 con 0x7ff3940ff610 2024-03-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff399800640 1 -- 172.21.15.8:0/1207729269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39419f5b0 con 0x7ff3940ff610 2024-03-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff390c00640 1 -- 172.21.15.8:0/1207729269 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff384003e50 con 0x7ff3940ff610 2024-03-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.342+0000 7ff399800640 1 -- 172.21.15.8:0/1207729269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39419fa90 con 0x7ff3940ff610 2024-03-16T20:57:15.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.344+0000 7ff399800640 1 -- 172.21.15.8:0/1207729269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff394108710 con 0x7ff3940ff610 2024-03-16T20:57:15.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.345+0000 7ff390c00640 1 -- 172.21.15.8:0/1207729269 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7ff3840035f0 con 0x7ff3940ff610 2024-03-16T20:57:15.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.346+0000 7ff390c00640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3780a1a30 0x7ff3780a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:15.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.347+0000 7ff390c00640 1 -- 172.21.15.8:0/1207729269 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff3840ef550 con 0x7ff3940ff610 2024-03-16T20:57:15.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.347+0000 7ff393400640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3780a1a30 0x7ff3780a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:15.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.347+0000 7ff393400640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3780a1a30 0x7ff3780a3ef0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff394198a20 tx=0x7ff380005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:15.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.350+0000 7ff390c00640 1 -- 172.21.15.8:0/1207729269 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff3840b8710 con 0x7ff3940ff610 2024-03-16T20:57:15.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.551+0000 7ff399800640 1 -- 172.21.15.8:0/1207729269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff39410d010 con 0x7ff3940ff610 2024-03-16T20:57:15.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.553+0000 7ff390c00640 1 -- 172.21.15.8:0/1207729269 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22581 (secure 0 0 0) 0x7ff3840bbdd0 con 0x7ff3940ff610 2024-03-16T20:57:15.558 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:56:04.502777+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.555+0000 7ff399800640 1 -- 172.21.15.8:0/1207729269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3780a1a30 msgr2=0x7ff3780a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.555+0000 7ff399800640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3780a1a30 0x7ff3780a3ef0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff394198a20 tx=0x7ff380005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.555+0000 7ff399800640 1 -- 172.21.15.8:0/1207729269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3940ff610 msgr2=0x7ff394197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.555+0000 7ff399800640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3940ff610 0x7ff394197510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff38402c170 tx=0x7ff384005e40 comp rx=0 tx=0).stop 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.555+0000 7ff399800640 1 -- 172.21.15.8:0/1207729269 shutdown_connections 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.556+0000 7ff399800640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff3780a1a30 0x7ff3780a3ef0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.556+0000 7ff399800640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102fa0 0x7ff39419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.556+0000 7ff399800640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3941025e0 0x7ff394197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.556+0000 7ff399800640 1 --2- 172.21.15.8:0/1207729269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3940ff610 0x7ff394197510 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.556+0000 7ff399800640 1 -- 172.21.15.8:0/1207729269 >> 172.21.15.8:0/1207729269 conn(0x7ff3940faf40 msgr2=0x7ff3941058e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.556+0000 7ff399800640 1 -- 172.21.15.8:0/1207729269 shutdown_connections 2024-03-16T20:57:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.556+0000 7ff399800640 1 -- 172.21.15.8:0/1207729269 wait complete. 2024-03-16T20:57:15.582 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T20:55:02.896774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T20:55:04.228958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T20:57:15.583 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T20:57:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.812+0000 7f8f66000640 1 -- 172.21.15.8:0/2501569342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f601051a0 msgr2=0x7f8f6010ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:15.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.812+0000 7f8f66000640 1 --2- 172.21.15.8:0/2501569342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f601051a0 0x7f8f6010ba30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009ca0 tx=0x7f8f5802c100 comp rx=0 tx=0).stop 2024-03-16T20:57:15.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.812+0000 7f8f66000640 1 -- 172.21.15.8:0/2501569342 shutdown_connections 2024-03-16T20:57:15.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.812+0000 7f8f66000640 1 --2- 172.21.15.8:0/2501569342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f601051a0 0x7f8f6010ba30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.812+0000 7f8f66000640 1 --2- 172.21.15.8:0/2501569342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f601047e0 0x7f8f60104c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.812+0000 7f8f66000640 1 --2- 172.21.15.8:0/2501569342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f601035f0 0x7f8f60103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.812+0000 7f8f66000640 1 -- 172.21.15.8:0/2501569342 >> 172.21.15.8:0/2501569342 conn(0x7f8f600feb60 msgr2=0x7f8f60100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:15.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.812+0000 7f8f66000640 1 -- 172.21.15.8:0/2501569342 shutdown_connections 2024-03-16T20:57:15.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.812+0000 7f8f66000640 1 -- 172.21.15.8:0/2501569342 wait complete. 2024-03-16T20:57:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.813+0000 7f8f66000640 1 Processor -- start 2024-03-16T20:57:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.813+0000 7f8f66000640 1 -- start start 2024-03-16T20:57:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f66000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f601035f0 0x7f8f601996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f66000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f601047e0 0x7f8f60199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f66000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f601051a0 0x7f8f601a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f66000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f601a11e0 con 0x7f8f601047e0 2024-03-16T20:57:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f66000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f601a1350 con 0x7f8f601051a0 2024-03-16T20:57:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f66000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f601a1510 con 0x7f8f601035f0 2024-03-16T20:57:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f65600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f601051a0 0x7f8f601a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f5fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f601047e0 0x7f8f60199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f64c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f601035f0 0x7f8f601996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f65600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f601051a0 0x7f8f601a0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48500/0 (socket says 172.21.15.8:48500) 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f65600640 1 -- 172.21.15.8:0/2933226469 learned_addr learned my addr 172.21.15.8:0/2933226469 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f65600640 1 -- 172.21.15.8:0/2933226469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f601035f0 msgr2=0x7f8f601996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f65600640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f601035f0 0x7f8f601996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f65600640 1 -- 172.21.15.8:0/2933226469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f601047e0 msgr2=0x7f8f60199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f65600640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f601047e0 0x7f8f60199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f65600640 1 -- 172.21.15.8:0/2933226469 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f58009900 con 0x7f8f601051a0 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.814+0000 7f8f64c00640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f601035f0 0x7f8f601996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.815+0000 7f8f65600640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f601051a0 0x7f8f601a0ca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8f58037040 tx=0x7f8f58032860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.815+0000 7f8f5d600640 1 -- 172.21.15.8:0/2933226469 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58034640 con 0x7f8f601051a0 2024-03-16T20:57:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.815+0000 7f8f5d600640 1 -- 172.21.15.8:0/2933226469 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8f58003e70 con 0x7f8f601051a0 2024-03-16T20:57:15.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.815+0000 7f8f5d600640 1 -- 172.21.15.8:0/2933226469 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5803f440 con 0x7f8f601051a0 2024-03-16T20:57:15.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.815+0000 7f8f66000640 1 -- 172.21.15.8:0/2933226469 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f601a1790 con 0x7f8f601051a0 2024-03-16T20:57:15.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.815+0000 7f8f66000640 1 -- 172.21.15.8:0/2933226469 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f601a1bf0 con 0x7f8f601051a0 2024-03-16T20:57:15.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.816+0000 7f8f66000640 1 -- 172.21.15.8:0/2933226469 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6010a8b0 con 0x7f8f601051a0 2024-03-16T20:57:15.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.818+0000 7f8f5d600640 1 -- 172.21.15.8:0/2933226469 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f8f5803b040 con 0x7f8f601051a0 2024-03-16T20:57:15.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.819+0000 7f8f5d600640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8f480a1ab0 0x7f8f480a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:15.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.820+0000 7f8f5d600640 1 -- 172.21.15.8:0/2933226469 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8f580efec0 con 0x7f8f601051a0 2024-03-16T20:57:15.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.820+0000 7f8f64c00640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8f480a1ab0 0x7f8f480a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:15.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.820+0000 7f8f64c00640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8f480a1ab0 0x7f8f480a3f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f60104640 tx=0x7f8f54005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:15.823+0000 7f8f5d600640 1 -- 172.21.15.8:0/2933226469 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8f580b9080 con 0x7f8f601051a0 2024-03-16T20:57:15.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:15 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1207729269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:16.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.024+0000 7f8f66000640 1 -- 172.21.15.8:0/2933226469 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f6002cf60 con 0x7f8f601051a0 2024-03-16T20:57:16.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.025+0000 7f8f5d600640 1 -- 172.21.15.8:0/2933226469 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f580bc740 con 0x7f8f601051a0 2024-03-16T20:57:16.030 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T20:57:16.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.027+0000 7f8f66000640 1 -- 172.21.15.8:0/2933226469 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8f480a1ab0 msgr2=0x7f8f480a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.027+0000 7f8f66000640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8f480a1ab0 0x7f8f480a3f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f60104640 tx=0x7f8f54005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:16.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.027+0000 7f8f66000640 1 -- 172.21.15.8:0/2933226469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f601051a0 msgr2=0x7f8f601a0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.027+0000 7f8f66000640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f601051a0 0x7f8f601a0ca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8f58037040 tx=0x7f8f58032860 comp rx=0 tx=0).stop 2024-03-16T20:57:16.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.028+0000 7f8f66000640 1 -- 172.21.15.8:0/2933226469 shutdown_connections 2024-03-16T20:57:16.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.028+0000 7f8f66000640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f8f480a1ab0 0x7f8f480a3f70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.028+0000 7f8f66000640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f601051a0 0x7f8f601a0ca0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.028+0000 7f8f66000640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f601047e0 0x7f8f60199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.028+0000 7f8f66000640 1 --2- 172.21.15.8:0/2933226469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f601035f0 0x7f8f601996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.028+0000 7f8f66000640 1 -- 172.21.15.8:0/2933226469 >> 172.21.15.8:0/2933226469 conn(0x7f8f600feb60 msgr2=0x7f8f60107a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:16.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.028+0000 7f8f66000640 1 -- 172.21.15.8:0/2933226469 shutdown_connections 2024-03-16T20:57:16.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.028+0000 7f8f66000640 1 -- 172.21.15.8:0/2933226469 wait complete. 2024-03-16T20:57:16.051 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T20:57:16.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:15 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1207729269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:16.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:15 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1207729269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.263+0000 7f1a75e00640 1 -- 172.21.15.8:0/3722430701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a700ffc40 msgr2=0x7f1a70100060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.263+0000 7f1a75e00640 1 --2- 172.21.15.8:0/3722430701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a700ffc40 0x7f1a70100060 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009900 tx=0x7f1a6002bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.263+0000 7f1a75e00640 1 -- 172.21.15.8:0/3722430701 shutdown_connections 2024-03-16T20:57:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.263+0000 7f1a75e00640 1 --2- 172.21.15.8:0/3722430701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a70100f40 0x7f1a701013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.264+0000 7f1a75e00640 1 --2- 172.21.15.8:0/3722430701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a701005a0 0x7f1a70100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.264+0000 7f1a75e00640 1 --2- 172.21.15.8:0/3722430701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a700ffc40 0x7f1a70100060 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.264+0000 7f1a75e00640 1 -- 172.21.15.8:0/3722430701 >> 172.21.15.8:0/3722430701 conn(0x7f1a700fb860 msgr2=0x7f1a700fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.264+0000 7f1a75e00640 1 -- 172.21.15.8:0/3722430701 shutdown_connections 2024-03-16T20:57:16.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.264+0000 7f1a75e00640 1 -- 172.21.15.8:0/3722430701 wait complete. 2024-03-16T20:57:16.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a75e00640 1 Processor -- start 2024-03-16T20:57:16.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a75e00640 1 -- start start 2024-03-16T20:57:16.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a75e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a700ffc40 0x7f1a70199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:16.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a75e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a701005a0 0x7f1a70199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:16.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a75e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a70100f40 0x7f1a701a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:16.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a75e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a701a1220 con 0x7f1a701005a0 2024-03-16T20:57:16.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a75e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a701a1390 con 0x7f1a70100f40 2024-03-16T20:57:16.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a75e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a701a1550 con 0x7f1a700ffc40 2024-03-16T20:57:16.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a74a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a700ffc40 0x7f1a70199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:16.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a67e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a701005a0 0x7f1a70199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:16.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a74a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a700ffc40 0x7f1a70199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46970/0 (socket says 172.21.15.8:46970) 2024-03-16T20:57:16.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a74a00640 1 -- 172.21.15.8:0/1859999697 learned_addr learned my addr 172.21.15.8:0/1859999697 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:16.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.265+0000 7f1a75400640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a70100f40 0x7f1a701a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:16.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.266+0000 7f1a74a00640 1 -- 172.21.15.8:0/1859999697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a70100f40 msgr2=0x7f1a701a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.266+0000 7f1a74a00640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a70100f40 0x7f1a701a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.266+0000 7f1a74a00640 1 -- 172.21.15.8:0/1859999697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a701005a0 msgr2=0x7f1a70199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.266+0000 7f1a74a00640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a701005a0 0x7f1a70199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.266+0000 7f1a74a00640 1 -- 172.21.15.8:0/1859999697 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a58009490 con 0x7f1a700ffc40 2024-03-16T20:57:16.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.266+0000 7f1a75400640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a70100f40 0x7f1a701a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:16.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.266+0000 7f1a74a00640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a700ffc40 0x7f1a70199730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a60000c00 tx=0x7f1a60005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:16.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.266+0000 7f1a6e000640 1 -- 172.21.15.8:0/1859999697 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60004350 con 0x7f1a700ffc40 2024-03-16T20:57:16.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.266+0000 7f1a75e00640 1 -- 172.21.15.8:0/1859999697 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a68009840 con 0x7f1a700ffc40 2024-03-16T20:57:16.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.266+0000 7f1a6e000640 1 -- 172.21.15.8:0/1859999697 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1a600044b0 con 0x7f1a700ffc40 2024-03-16T20:57:16.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.267+0000 7f1a6e000640 1 -- 172.21.15.8:0/1859999697 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60003d70 con 0x7f1a700ffc40 2024-03-16T20:57:16.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.267+0000 7f1a75e00640 1 -- 172.21.15.8:0/1859999697 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a60009560 con 0x7f1a700ffc40 2024-03-16T20:57:16.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.268+0000 7f1a75e00640 1 -- 172.21.15.8:0/1859999697 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7010a990 con 0x7f1a700ffc40 2024-03-16T20:57:16.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.270+0000 7f1a6e000640 1 -- 172.21.15.8:0/1859999697 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f1a60004e10 con 0x7f1a700ffc40 2024-03-16T20:57:16.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.271+0000 7f1a6e000640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1a540a1ab0 0x7f1a540a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:16.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.271+0000 7f1a6e000640 1 -- 172.21.15.8:0/1859999697 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1a600efa20 con 0x7f1a700ffc40 2024-03-16T20:57:16.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.271+0000 7f1a67e00640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1a540a1ab0 0x7f1a540a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:16.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.272+0000 7f1a67e00640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1a540a1ab0 0x7f1a540a3f70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a7019ac40 tx=0x7f1a58005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:16.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.275+0000 7f1a6e000640 1 -- 172.21.15.8:0/1859999697 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1a600b8be0 con 0x7f1a700ffc40 2024-03-16T20:57:16.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.480+0000 7f1a75e00640 1 -- 172.21.15.8:0/1859999697 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a7002cf60 con 0x7f1a700ffc40 2024-03-16T20:57:16.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.481+0000 7f1a6e000640 1 -- 172.21.15.8:0/1859999697 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a60043020 con 0x7f1a700ffc40 2024-03-16T20:57:16.486 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-16T20:57:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 -- 172.21.15.8:0/1859999697 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1a540a1ab0 msgr2=0x7f1a540a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1a540a1ab0 0x7f1a540a3f70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a7019ac40 tx=0x7f1a58005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 -- 172.21.15.8:0/1859999697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a700ffc40 msgr2=0x7f1a70199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a700ffc40 0x7f1a70199730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a60000c00 tx=0x7f1a60005dd0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 -- 172.21.15.8:0/1859999697 shutdown_connections 2024-03-16T20:57:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f1a540a1ab0 0x7f1a540a3f70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a70100f40 0x7f1a701a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a701005a0 0x7f1a70199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 --2- 172.21.15.8:0/1859999697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a700ffc40 0x7f1a70199730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 -- 172.21.15.8:0/1859999697 >> 172.21.15.8:0/1859999697 conn(0x7f1a700fb860 msgr2=0x7f1a700fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 -- 172.21.15.8:0/1859999697 shutdown_connections 2024-03-16T20:57:16.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.484+0000 7f1a75e00640 1 -- 172.21.15.8:0/1859999697 wait complete. 2024-03-16T20:57:16.510 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T20:57:16.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.731+0000 7fda26a00640 1 -- 172.21.15.8:0/862178697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda20103710 msgr2=0x7fda20103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.731+0000 7fda26a00640 1 --2- 172.21.15.8:0/862178697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda20103710 0x7fda20103b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fda10009900 tx=0x7fda1002bc50 comp rx=0 tx=0).stop 2024-03-16T20:57:16.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.731+0000 7fda26a00640 1 -- 172.21.15.8:0/862178697 shutdown_connections 2024-03-16T20:57:16.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.731+0000 7fda26a00640 1 --2- 172.21.15.8:0/862178697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda201052c0 0x7fda2010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.731+0000 7fda26a00640 1 --2- 172.21.15.8:0/862178697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda20104900 0x7fda20104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.731+0000 7fda26a00640 1 --2- 172.21.15.8:0/862178697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda20103710 0x7fda20103b30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.731+0000 7fda26a00640 1 -- 172.21.15.8:0/862178697 >> 172.21.15.8:0/862178697 conn(0x7fda200feca0 msgr2=0x7fda201010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:16.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.731+0000 7fda26a00640 1 -- 172.21.15.8:0/862178697 shutdown_connections 2024-03-16T20:57:16.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.731+0000 7fda26a00640 1 -- 172.21.15.8:0/862178697 wait complete. 2024-03-16T20:57:16.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.732+0000 7fda26a00640 1 Processor -- start 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.732+0000 7fda26a00640 1 -- start start 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda26a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda20103710 0x7fda201998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda26a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda20104900 0x7fda20199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda26a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda201052c0 0x7fda201a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda26a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda201a13a0 con 0x7fda20104900 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda26a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda201a1510 con 0x7fda201052c0 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda26a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda201a16d0 con 0x7fda20103710 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda1fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda20103710 0x7fda201998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda1fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda20103710 0x7fda201998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46996/0 (socket says 172.21.15.8:46996) 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda1fe00640 1 -- 172.21.15.8:0/1867372241 learned_addr learned my addr 172.21.15.8:0/1867372241 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda24a00640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda201052c0 0x7fda201a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda1f400640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda20104900 0x7fda20199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:16.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda1fe00640 1 -- 172.21.15.8:0/1867372241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda201052c0 msgr2=0x7fda201a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda1fe00640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda201052c0 0x7fda201a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda1fe00640 1 -- 172.21.15.8:0/1867372241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda20104900 msgr2=0x7fda20199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda1fe00640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda20104900 0x7fda20199df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.733+0000 7fda1fe00640 1 -- 172.21.15.8:0/1867372241 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda18009840 con 0x7fda20103710 2024-03-16T20:57:16.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.734+0000 7fda1fe00640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda20103710 0x7fda201998b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda1002efd0 tx=0x7fda10005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:16.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.734+0000 7fda1cc00640 1 -- 172.21.15.8:0/1867372241 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10004e10 con 0x7fda20103710 2024-03-16T20:57:16.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.734+0000 7fda1cc00640 1 -- 172.21.15.8:0/1867372241 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fda10005470 con 0x7fda20103710 2024-03-16T20:57:16.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.734+0000 7fda26a00640 1 -- 172.21.15.8:0/1867372241 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda10009560 con 0x7fda20103710 2024-03-16T20:57:16.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.734+0000 7fda1cc00640 1 -- 172.21.15.8:0/1867372241 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10003e20 con 0x7fda20103710 2024-03-16T20:57:16.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.734+0000 7fda26a00640 1 -- 172.21.15.8:0/1867372241 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda201a1c90 con 0x7fda20103710 2024-03-16T20:57:16.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.735+0000 7fda26a00640 1 -- 172.21.15.8:0/1867372241 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2010aa30 con 0x7fda20103710 2024-03-16T20:57:16.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.737+0000 7fda1cc00640 1 -- 172.21.15.8:0/1867372241 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fda100035f0 con 0x7fda20103710 2024-03-16T20:57:16.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.738+0000 7fda1cc00640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fda040a1ab0 0x7fda040a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:16.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.739+0000 7fda1cc00640 1 -- 172.21.15.8:0/1867372241 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fda100ef7d0 con 0x7fda20103710 2024-03-16T20:57:16.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.739+0000 7fda1f400640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fda040a1ab0 0x7fda040a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:16.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.740+0000 7fda1f400640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fda040a1ab0 0x7fda040a3f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fda2019adc0 tx=0x7fda0c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:16.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.743+0000 7fda1cc00640 1 -- 172.21.15.8:0/1867372241 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fda100b8990 con 0x7fda20103710 2024-03-16T20:57:16.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.947+0000 7fda26a00640 1 -- 172.21.15.8:0/1867372241 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda2002cf90 con 0x7fda20103710 2024-03-16T20:57:16.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.947+0000 7fda1cc00640 1 -- 172.21.15.8:0/1867372241 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda100dae60 con 0x7fda20103710 2024-03-16T20:57:16.953 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-16T20:57:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 -- 172.21.15.8:0/1867372241 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fda040a1ab0 msgr2=0x7fda040a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fda040a1ab0 0x7fda040a3f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fda2019adc0 tx=0x7fda0c005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 -- 172.21.15.8:0/1867372241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda20103710 msgr2=0x7fda201998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda20103710 0x7fda201998b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda1002efd0 tx=0x7fda10005dd0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 -- 172.21.15.8:0/1867372241 shutdown_connections 2024-03-16T20:57:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fda040a1ab0 0x7fda040a3f70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda201052c0 0x7fda201a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda20104900 0x7fda20199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 --2- 172.21.15.8:0/1867372241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda20103710 0x7fda201998b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:16.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 -- 172.21.15.8:0/1867372241 >> 172.21.15.8:0/1867372241 conn(0x7fda200feca0 msgr2=0x7fda20107c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:16.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 -- 172.21.15.8:0/1867372241 shutdown_connections 2024-03-16T20:57:16.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:16.951+0000 7fda26a00640 1 -- 172.21.15.8:0/1867372241 wait complete. 2024-03-16T20:57:16.977 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:57:17.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:16 smithi008 ceph-mon[31434]: pgmap v384: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:57:17.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:16 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2933226469' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:17.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:16 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1859999697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:17.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:16 smithi170 ceph-mon[35947]: pgmap v384: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:57:17.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:16 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2933226469' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:17.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:16 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1859999697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:17.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:16 smithi186 ceph-mon[36391]: pgmap v384: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:57:17.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:16 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2933226469' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:17.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:16 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1859999697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:17.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.195+0000 7fdcefa00640 1 -- 172.21.15.8:0/1192784109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce81096e0 msgr2=0x7fdce810ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:17.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.195+0000 7fdcefa00640 1 --2- 172.21.15.8:0/1192784109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce81096e0 0x7fdce810ff70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009be0 tx=0x7fdce002bef0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.196+0000 7fdcefa00640 1 -- 172.21.15.8:0/1192784109 shutdown_connections 2024-03-16T20:57:17.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.196+0000 7fdcefa00640 1 --2- 172.21.15.8:0/1192784109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce81096e0 0x7fdce810ff70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.196+0000 7fdcefa00640 1 --2- 172.21.15.8:0/1192784109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdce8108d20 0x7fdce81091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.196+0000 7fdcefa00640 1 --2- 172.21.15.8:0/1192784109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce8107b30 0x7fdce8107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.196+0000 7fdcefa00640 1 -- 172.21.15.8:0/1192784109 >> 172.21.15.8:0/1192784109 conn(0x7fdce8076b00 msgr2=0x7fdce8078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:17.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.196+0000 7fdcefa00640 1 -- 172.21.15.8:0/1192784109 shutdown_connections 2024-03-16T20:57:17.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.196+0000 7fdcefa00640 1 -- 172.21.15.8:0/1192784109 wait complete. 2024-03-16T20:57:17.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.197+0000 7fdcefa00640 1 Processor -- start 2024-03-16T20:57:17.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.197+0000 7fdcefa00640 1 -- start start 2024-03-16T20:57:17.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.197+0000 7fdcefa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdce8107b30 0x7fdce819dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:17.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.197+0000 7fdcefa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce8108d20 0x7fdce819e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:17.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdcefa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce81096e0 0x7fdce81a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:17.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdcefa00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce81a57c0 con 0x7fdce8107b30 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdcefa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce81a5930 con 0x7fdce81096e0 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdcefa00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce81a5af0 con 0x7fdce8108d20 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdceda00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce81096e0 0x7fdce81a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdce7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce8108d20 0x7fdce819e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdceda00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce81096e0 0x7fdce81a5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48564/0 (socket says 172.21.15.8:48564) 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdceda00640 1 -- 172.21.15.8:0/1028322533 learned_addr learned my addr 172.21.15.8:0/1028322533 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdced000640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdce8107b30 0x7fdce819dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdceda00640 1 -- 172.21.15.8:0/1028322533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce8108d20 msgr2=0x7fdce819e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdceda00640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce8108d20 0x7fdce819e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdceda00640 1 -- 172.21.15.8:0/1028322533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdce8107b30 msgr2=0x7fdce819dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdceda00640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdce8107b30 0x7fdce819dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdceda00640 1 -- 172.21.15.8:0/1028322533 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce0009840 con 0x7fdce81096e0 2024-03-16T20:57:17.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.198+0000 7fdceda00640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce81096e0 0x7fdce81a5250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdce00096f0 tx=0x7fdce0033820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:17.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.199+0000 7fdce5600640 1 -- 172.21.15.8:0/1028322533 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0003b80 con 0x7fdce81096e0 2024-03-16T20:57:17.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.199+0000 7fdce5600640 1 -- 172.21.15.8:0/1028322533 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fdce0003ce0 con 0x7fdce81096e0 2024-03-16T20:57:17.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.199+0000 7fdcefa00640 1 -- 172.21.15.8:0/1028322533 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce81a5d70 con 0x7fdce81096e0 2024-03-16T20:57:17.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.199+0000 7fdce5600640 1 -- 172.21.15.8:0/1028322533 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0034a40 con 0x7fdce81096e0 2024-03-16T20:57:17.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.199+0000 7fdcefa00640 1 -- 172.21.15.8:0/1028322533 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce81a6220 con 0x7fdce81096e0 2024-03-16T20:57:17.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.200+0000 7fdcefa00640 1 -- 172.21.15.8:0/1028322533 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce810ed80 con 0x7fdce81096e0 2024-03-16T20:57:17.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.202+0000 7fdce5600640 1 -- 172.21.15.8:0/1028322533 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fdce00046d0 con 0x7fdce81096e0 2024-03-16T20:57:17.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.203+0000 7fdce5600640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdcd00a1a30 0x7fdcd00a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:17.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.203+0000 7fdce5600640 1 -- 172.21.15.8:0/1028322533 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdce00f0070 con 0x7fdce81096e0 2024-03-16T20:57:17.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.204+0000 7fdced000640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdcd00a1a30 0x7fdcd00a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:17.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.204+0000 7fdced000640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdcd00a1a30 0x7fdcd00a3ef0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdce819eb80 tx=0x7fdcdc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:17.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.207+0000 7fdce5600640 1 -- 172.21.15.8:0/1028322533 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fdce00b9230 con 0x7fdce81096e0 2024-03-16T20:57:17.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.452+0000 7fdcefa00640 1 -- 172.21.15.8:0/1028322533 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdce802d120 con 0x7fdce81096e0 2024-03-16T20:57:17.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.453+0000 7fdce5600640 1 -- 172.21.15.8:0/1028322533 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11387 (secure 0 0 0) 0x7fdce00bc8f0 con 0x7fdce81096e0 2024-03-16T20:57:17.458 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:17.459 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:55:10.355515+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24593,24544]},"id":1}]} 2024-03-16T20:57:17.459 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2024-03-16T20:57:17.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 -- 172.21.15.8:0/1028322533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdcd00a1a30 msgr2=0x7fdcd00a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:17.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdcd00a1a30 0x7fdcd00a3ef0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdce819eb80 tx=0x7fdcdc009260 comp rx=0 tx=0).stop 2024-03-16T20:57:17.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 -- 172.21.15.8:0/1028322533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce81096e0 msgr2=0x7fdce81a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:17.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce81096e0 0x7fdce81a5250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdce00096f0 tx=0x7fdce0033820 comp rx=0 tx=0).stop 2024-03-16T20:57:17.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 -- 172.21.15.8:0/1028322533 shutdown_connections 2024-03-16T20:57:17.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fdcd00a1a30 0x7fdcd00a3ef0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce81096e0 0x7fdce81a5250 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce8108d20 0x7fdce819e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 --2- 172.21.15.8:0/1028322533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdce8107b30 0x7fdce819dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 -- 172.21.15.8:0/1028322533 >> 172.21.15.8:0/1028322533 conn(0x7fdce8076b00 msgr2=0x7fdce810bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 -- 172.21.15.8:0/1028322533 shutdown_connections 2024-03-16T20:57:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.456+0000 7fdcefa00640 1 -- 172.21.15.8:0/1028322533 wait complete. 2024-03-16T20:57:17.483 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:57:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.705+0000 7f7196200640 1 -- 172.21.15.8:0/2878939970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7190103160 msgr2=0x7f71901099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.705+0000 7f7196200640 1 --2- 172.21.15.8:0/2878939970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7190103160 0x7f71901099f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7188009ca0 tx=0x7f718802c100 comp rx=0 tx=0).stop 2024-03-16T20:57:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.705+0000 7f7196200640 1 -- 172.21.15.8:0/2878939970 shutdown_connections 2024-03-16T20:57:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.705+0000 7f7196200640 1 --2- 172.21.15.8:0/2878939970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7190103160 0x7f71901099f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.705+0000 7f7196200640 1 --2- 172.21.15.8:0/2878939970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71901027a0 0x7f7190102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.705+0000 7f7196200640 1 --2- 172.21.15.8:0/2878939970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71900ff7d0 0x7f71900ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.705+0000 7f7196200640 1 -- 172.21.15.8:0/2878939970 >> 172.21.15.8:0/2878939970 conn(0x7f71900fb120 msgr2=0x7f71900fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.706+0000 7f7196200640 1 -- 172.21.15.8:0/2878939970 shutdown_connections 2024-03-16T20:57:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.706+0000 7f7196200640 1 -- 172.21.15.8:0/2878939970 wait complete. 2024-03-16T20:57:17.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.707+0000 7f7196200640 1 Processor -- start 2024-03-16T20:57:17.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.707+0000 7f7196200640 1 -- start start 2024-03-16T20:57:17.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.707+0000 7f7196200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900ff7d0 0x7f7190199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:17.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.707+0000 7f7196200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71901027a0 0x7f7190199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:17.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.707+0000 7f7196200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7190103160 0x7f71901a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.707+0000 7f7196200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71901a12f0 con 0x7f71900ff7d0 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.707+0000 7f7196200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71901a1460 con 0x7f7190103160 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.707+0000 7f7196200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71901a1620 con 0x7f71901027a0 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.708+0000 7f7187e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71901027a0 0x7f7190199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.708+0000 7f7187e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71901027a0 0x7f7190199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47028/0 (socket says 172.21.15.8:47028) 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.708+0000 7f7187e00640 1 -- 172.21.15.8:0/1121682548 learned_addr learned my addr 172.21.15.8:0/1121682548 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.708+0000 7f718fe00640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7190103160 0x7f71901a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.708+0000 7f718f400640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900ff7d0 0x7f7190199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.708+0000 7f7187e00640 1 -- 172.21.15.8:0/1121682548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7190103160 msgr2=0x7f71901a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.708+0000 7f7187e00640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7190103160 0x7f71901a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.708+0000 7f7187e00640 1 -- 172.21.15.8:0/1121682548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900ff7d0 msgr2=0x7f7190199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.708+0000 7f7187e00640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900ff7d0 0x7f7190199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.708+0000 7f7187e00640 1 -- 172.21.15.8:0/1121682548 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188009900 con 0x7f71901027a0 2024-03-16T20:57:17.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.709+0000 7f7187e00640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71901027a0 0x7f7190199d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f717800e9f0 tx=0x7f717800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:17.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.709+0000 7f718cc00640 1 -- 172.21.15.8:0/1121682548 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178009700 con 0x7f71901027a0 2024-03-16T20:57:17.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.709+0000 7f718cc00640 1 -- 172.21.15.8:0/1121682548 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f717800cd80 con 0x7f71901027a0 2024-03-16T20:57:17.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.709+0000 7f718cc00640 1 -- 172.21.15.8:0/1121682548 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71780189c0 con 0x7f71901027a0 2024-03-16T20:57:17.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.709+0000 7f7196200640 1 -- 172.21.15.8:0/1121682548 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71901a1900 con 0x7f71901027a0 2024-03-16T20:57:17.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.709+0000 7f7196200640 1 -- 172.21.15.8:0/1121682548 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71901a1e60 con 0x7f71901027a0 2024-03-16T20:57:17.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.710+0000 7f7196200640 1 -- 172.21.15.8:0/1121682548 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719010d030 con 0x7f71901027a0 2024-03-16T20:57:17.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.712+0000 7f718cc00640 1 -- 172.21.15.8:0/1121682548 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f7178018b20 con 0x7f71901027a0 2024-03-16T20:57:17.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.713+0000 7f718cc00640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f71740a1ab0 0x7f71740a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:17.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.714+0000 7f718cc00640 1 -- 172.21.15.8:0/1121682548 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7178014070 con 0x7f71901027a0 2024-03-16T20:57:17.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.714+0000 7f718f400640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f71740a1ab0 0x7f71740a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:17.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.714+0000 7f718f400640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f71740a1ab0 0x7f71740a3f70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f71900699c0 tx=0x7f7180005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:17.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.717+0000 7f718cc00640 1 -- 172.21.15.8:0/1121682548 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7178053280 con 0x7f71901027a0 2024-03-16T20:57:17.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.923+0000 7f7196200640 1 -- 172.21.15.8:0/1121682548 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f719010d1c0 con 0x7f71901027a0 2024-03-16T20:57:17.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.925+0000 7f718cc00640 1 -- 172.21.15.8:0/1121682548 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22581 (secure 0 0 0) 0x7f7178096990 con 0x7f71901027a0 2024-03-16T20:57:17.933 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:17.933 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:56:04.502777+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 -- 172.21.15.8:0/1121682548 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f71740a1ab0 msgr2=0x7f71740a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f71740a1ab0 0x7f71740a3f70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f71900699c0 tx=0x7f7180005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 -- 172.21.15.8:0/1121682548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71901027a0 msgr2=0x7f7190199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71901027a0 0x7f7190199d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f717800e9f0 tx=0x7f717800eeb0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 -- 172.21.15.8:0/1121682548 shutdown_connections 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f71740a1ab0 0x7f71740a3f70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7190103160 0x7f71901a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71901027a0 0x7f7190199d40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 --2- 172.21.15.8:0/1121682548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71900ff7d0 0x7f7190199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 -- 172.21.15.8:0/1121682548 >> 172.21.15.8:0/1121682548 conn(0x7f71900fb120 msgr2=0x7f7190100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 -- 172.21.15.8:0/1121682548 shutdown_connections 2024-03-16T20:57:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:17.928+0000 7f7196200640 1 -- 172.21.15.8:0/1121682548 wait complete. 2024-03-16T20:57:17.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T20:55:02.896774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T20:55:04.228958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T20:57:17.953 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T20:57:18.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:17 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1867372241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:18.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:17 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1028322533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:18.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:17 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1867372241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:18.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:17 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1028322533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:18.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.173+0000 7fe0d5400640 1 -- 172.21.15.8:0/911579854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0d00ffc40 msgr2=0x7fe0d0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.173+0000 7fe0d5400640 1 --2- 172.21.15.8:0/911579854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0d00ffc40 0x7fe0d0102070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009900 tx=0x7fe0c002bc30 comp rx=0 tx=0).stop 2024-03-16T20:57:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.173+0000 7fe0d5400640 1 -- 172.21.15.8:0/911579854 shutdown_connections 2024-03-16T20:57:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.173+0000 7fe0d5400640 1 --2- 172.21.15.8:0/911579854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0d0104f60 0x7fe0d01053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.173+0000 7fe0d5400640 1 --2- 172.21.15.8:0/911579854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d01025b0 0x7fe0d0104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.173+0000 7fe0d5400640 1 --2- 172.21.15.8:0/911579854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0d00ffc40 0x7fe0d0102070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.173+0000 7fe0d5400640 1 -- 172.21.15.8:0/911579854 >> 172.21.15.8:0/911579854 conn(0x7fe0d00fb860 msgr2=0x7fe0d00fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.173+0000 7fe0d5400640 1 -- 172.21.15.8:0/911579854 shutdown_connections 2024-03-16T20:57:18.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.173+0000 7fe0d5400640 1 -- 172.21.15.8:0/911579854 wait complete. 2024-03-16T20:57:18.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.175+0000 7fe0d5400640 1 Processor -- start 2024-03-16T20:57:18.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.175+0000 7fe0d5400640 1 -- start start 2024-03-16T20:57:18.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.175+0000 7fe0d5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0d00ffc40 0x7fe0d019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:18.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.175+0000 7fe0d5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d01025b0 0x7fe0d019e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:18.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.175+0000 7fe0d5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0d0104f60 0x7fe0d01a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:18.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.175+0000 7fe0d5400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d01a5630 con 0x7fe0d01025b0 2024-03-16T20:57:18.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.175+0000 7fe0d5400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d01a57a0 con 0x7fe0d0104f60 2024-03-16T20:57:18.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.175+0000 7fe0d5400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d01a5960 con 0x7fe0d00ffc40 2024-03-16T20:57:18.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.175+0000 7fe0cfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0d00ffc40 0x7fe0d019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:18.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.175+0000 7fe0c7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d01025b0 0x7fe0d019e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:18.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.176+0000 7fe0cfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0d00ffc40 0x7fe0d019db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55466/0 (socket says 172.21.15.8:55466) 2024-03-16T20:57:18.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.176+0000 7fe0cfe00640 1 -- 172.21.15.8:0/1047378141 learned_addr learned my addr 172.21.15.8:0/1047378141 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:18.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.176+0000 7fe0d4a00640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0d0104f60 0x7fe0d01a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.176+0000 7fe0cfe00640 1 -- 172.21.15.8:0/1047378141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0d0104f60 msgr2=0x7fe0d01a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.176+0000 7fe0cfe00640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0d0104f60 0x7fe0d01a50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.176+0000 7fe0cfe00640 1 -- 172.21.15.8:0/1047378141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d01025b0 msgr2=0x7fe0d019e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.176+0000 7fe0cfe00640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d01025b0 0x7fe0d019e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.176+0000 7fe0cfe00640 1 -- 172.21.15.8:0/1047378141 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0009560 con 0x7fe0d00ffc40 2024-03-16T20:57:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.176+0000 7fe0c7400640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d01025b0 0x7fe0d019e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.176+0000 7fe0cfe00640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0d00ffc40 0x7fe0d019db40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0005ab0 tx=0x7fe0c0005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.176+0000 7fe0cd600640 1 -- 172.21.15.8:0/1047378141 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0004e10 con 0x7fe0d00ffc40 2024-03-16T20:57:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.177+0000 7fe0cd600640 1 -- 172.21.15.8:0/1047378141 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe0c0005470 con 0x7fe0d00ffc40 2024-03-16T20:57:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.177+0000 7fe0cd600640 1 -- 172.21.15.8:0/1047378141 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0034440 con 0x7fe0d00ffc40 2024-03-16T20:57:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.177+0000 7fe0d5400640 1 -- 172.21.15.8:0/1047378141 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d01a5be0 con 0x7fe0d00ffc40 2024-03-16T20:57:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.177+0000 7fe0d5400640 1 -- 172.21.15.8:0/1047378141 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d01a6090 con 0x7fe0d00ffc40 2024-03-16T20:57:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.178+0000 7fe0d5400640 1 -- 172.21.15.8:0/1047378141 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d00fd350 con 0x7fe0d00ffc40 2024-03-16T20:57:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.180+0000 7fe0cd600640 1 -- 172.21.15.8:0/1047378141 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fe0c0003710 con 0x7fe0d00ffc40 2024-03-16T20:57:18.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.181+0000 7fe0cd600640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0b40a1a30 0x7fe0b40a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:18.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.181+0000 7fe0cd600640 1 -- 172.21.15.8:0/1047378141 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe0c00ef450 con 0x7fe0d00ffc40 2024-03-16T20:57:18.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.181+0000 7fe0c7400640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0b40a1a30 0x7fe0b40a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:18.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.182+0000 7fe0c7400640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0b40a1a30 0x7fe0b40a3ef0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe0d019f050 tx=0x7fe0b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:18.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.185+0000 7fe0cd600640 1 -- 172.21.15.8:0/1047378141 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe0c00b8720 con 0x7fe0d00ffc40 2024-03-16T20:57:18.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:17 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1867372241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:18.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:17 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1028322533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.388+0000 7fe0d5400640 1 -- 172.21.15.8:0/1047378141 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0d002d000 con 0x7fe0d00ffc40 2024-03-16T20:57:18.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.389+0000 7fe0cd600640 1 -- 172.21.15.8:0/1047378141 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0c00bbde0 con 0x7fe0d00ffc40 2024-03-16T20:57:18.394 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T20:57:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.391+0000 7fe0d5400640 1 -- 172.21.15.8:0/1047378141 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0b40a1a30 msgr2=0x7fe0b40a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.391+0000 7fe0d5400640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0b40a1a30 0x7fe0b40a3ef0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe0d019f050 tx=0x7fe0b8005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.391+0000 7fe0d5400640 1 -- 172.21.15.8:0/1047378141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0d00ffc40 msgr2=0x7fe0d019db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.391+0000 7fe0d5400640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0d00ffc40 0x7fe0d019db40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0005ab0 tx=0x7fe0c0005de0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.391+0000 7fe0d5400640 1 -- 172.21.15.8:0/1047378141 shutdown_connections 2024-03-16T20:57:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.391+0000 7fe0d5400640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe0b40a1a30 0x7fe0b40a3ef0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.391+0000 7fe0d5400640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0d0104f60 0x7fe0d01a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.391+0000 7fe0d5400640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d01025b0 0x7fe0d019e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.391+0000 7fe0d5400640 1 --2- 172.21.15.8:0/1047378141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0d00ffc40 0x7fe0d019db40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.391+0000 7fe0d5400640 1 -- 172.21.15.8:0/1047378141 >> 172.21.15.8:0/1047378141 conn(0x7fe0d00fb860 msgr2=0x7fe0d0103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.392+0000 7fe0d5400640 1 -- 172.21.15.8:0/1047378141 shutdown_connections 2024-03-16T20:57:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.392+0000 7fe0d5400640 1 -- 172.21.15.8:0/1047378141 wait complete. 2024-03-16T20:57:18.414 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T20:57:18.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.630+0000 7fee61c00640 1 -- 172.21.15.8:0/529915532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5c1035f0 msgr2=0x7fee5c103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:18.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.630+0000 7fee61c00640 1 --2- 172.21.15.8:0/529915532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5c1035f0 0x7fee5c103a10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009900 tx=0x7fee4c02bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:18.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.630+0000 7fee61c00640 1 -- 172.21.15.8:0/529915532 shutdown_connections 2024-03-16T20:57:18.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.630+0000 7fee61c00640 1 --2- 172.21.15.8:0/529915532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c1051a0 0x7fee5c10ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.630+0000 7fee61c00640 1 --2- 172.21.15.8:0/529915532 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c1047e0 0x7fee5c104c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.630+0000 7fee61c00640 1 --2- 172.21.15.8:0/529915532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5c1035f0 0x7fee5c103a10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.630+0000 7fee61c00640 1 -- 172.21.15.8:0/529915532 >> 172.21.15.8:0/529915532 conn(0x7fee5c0feb60 msgr2=0x7fee5c100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:18.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.631+0000 7fee61c00640 1 -- 172.21.15.8:0/529915532 shutdown_connections 2024-03-16T20:57:18.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.631+0000 7fee61c00640 1 -- 172.21.15.8:0/529915532 wait complete. 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee61c00640 1 Processor -- start 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee61c00640 1 -- start start 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee61c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c1035f0 0x7fee5c199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee61c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5c1047e0 0x7fee5c199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee61c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c1051a0 0x7fee5c1a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee61c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1a1270 con 0x7fee5c1035f0 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee61c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1a13e0 con 0x7fee5c1047e0 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee61c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1a15a0 con 0x7fee5c1051a0 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee53e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5c1047e0 0x7fee5c199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee5be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c1035f0 0x7fee5c199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee61200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c1051a0 0x7fee5c1a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee53e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5c1047e0 0x7fee5c199cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:56416/0 (socket says 172.21.15.8:56416) 2024-03-16T20:57:18.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.632+0000 7fee53e00640 1 -- 172.21.15.8:0/1678906586 learned_addr learned my addr 172.21.15.8:0/1678906586 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.633+0000 7fee53e00640 1 -- 172.21.15.8:0/1678906586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c1051a0 msgr2=0x7fee5c1a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.633+0000 7fee53e00640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c1051a0 0x7fee5c1a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.633+0000 7fee53e00640 1 -- 172.21.15.8:0/1678906586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c1035f0 msgr2=0x7fee5c199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.633+0000 7fee53e00640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c1035f0 0x7fee5c199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.633+0000 7fee53e00640 1 -- 172.21.15.8:0/1678906586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c009560 con 0x7fee5c1047e0 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.633+0000 7fee61200640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c1051a0 0x7fee5c1a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.633+0000 7fee53e00640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5c1047e0 0x7fee5c199cc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee4400e9f0 tx=0x7fee4400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.633+0000 7fee59600640 1 -- 172.21.15.8:0/1678906586 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44009720 con 0x7fee5c1047e0 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.633+0000 7fee59600640 1 -- 172.21.15.8:0/1678906586 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fee4400cd80 con 0x7fee5c1047e0 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.633+0000 7fee59600640 1 -- 172.21.15.8:0/1678906586 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44010690 con 0x7fee5c1047e0 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.633+0000 7fee61c00640 1 -- 172.21.15.8:0/1678906586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c1a1880 con 0x7fee5c1047e0 2024-03-16T20:57:18.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.634+0000 7fee61c00640 1 -- 172.21.15.8:0/1678906586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c1a1d40 con 0x7fee5c1047e0 2024-03-16T20:57:18.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.635+0000 7fee61c00640 1 -- 172.21.15.8:0/1678906586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c10a8b0 con 0x7fee5c1047e0 2024-03-16T20:57:18.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.637+0000 7fee59600640 1 -- 172.21.15.8:0/1678906586 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fee440046c0 con 0x7fee5c1047e0 2024-03-16T20:57:18.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.639+0000 7fee59600640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fee3c0a1a30 0x7fee3c0a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:18.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.639+0000 7fee59600640 1 -- 172.21.15.8:0/1678906586 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fee44014070 con 0x7fee5c1047e0 2024-03-16T20:57:18.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.639+0000 7fee5be00640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fee3c0a1a30 0x7fee3c0a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:18.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.640+0000 7fee5be00640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fee3c0a1a30 0x7fee3c0a3ef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fee4c02c180 tx=0x7fee4c02df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:18.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.643+0000 7fee59600640 1 -- 172.21.15.8:0/1678906586 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fee44096980 con 0x7fee5c1047e0 2024-03-16T20:57:18.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.843+0000 7fee61c00640 1 -- 172.21.15.8:0/1678906586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee5c02cf60 con 0x7fee5c1047e0 2024-03-16T20:57:18.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.844+0000 7fee59600640 1 -- 172.21.15.8:0/1678906586 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee4409a040 con 0x7fee5c1047e0 2024-03-16T20:57:18.849 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-16T20:57:18.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 -- 172.21.15.8:0/1678906586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fee3c0a1a30 msgr2=0x7fee3c0a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:18.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fee3c0a1a30 0x7fee3c0a3ef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fee4c02c180 tx=0x7fee4c02df90 comp rx=0 tx=0).stop 2024-03-16T20:57:18.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 -- 172.21.15.8:0/1678906586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5c1047e0 msgr2=0x7fee5c199cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:18.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5c1047e0 0x7fee5c199cc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee4400e9f0 tx=0x7fee4400edf0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 -- 172.21.15.8:0/1678906586 shutdown_connections 2024-03-16T20:57:18.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fee3c0a1a30 0x7fee3c0a3ef0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee5c1051a0 0x7fee5c1a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee5c1047e0 0x7fee5c199cc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 --2- 172.21.15.8:0/1678906586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee5c1035f0 0x7fee5c199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:18.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 -- 172.21.15.8:0/1678906586 >> 172.21.15.8:0/1678906586 conn(0x7fee5c0feb60 msgr2=0x7fee5c107a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:18.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 -- 172.21.15.8:0/1678906586 shutdown_connections 2024-03-16T20:57:18.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:18.847+0000 7fee61c00640 1 -- 172.21.15.8:0/1678906586 wait complete. 2024-03-16T20:57:18.870 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T20:57:19.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.090+0000 7f2228400640 1 -- 172.21.15.8:0/1747619259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2220107b10 msgr2=0x7f2220107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:19.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.090+0000 7f2228400640 1 --2- 172.21.15.8:0/1747619259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2220107b10 0x7f2220107f30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2214009be0 tx=0x7f221402bef0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.090+0000 7f2228400640 1 -- 172.21.15.8:0/1747619259 shutdown_connections 2024-03-16T20:57:19.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.090+0000 7f2228400640 1 --2- 172.21.15.8:0/1747619259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22201096c0 0x7f222010ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.090+0000 7f2228400640 1 --2- 172.21.15.8:0/1747619259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2220108d00 0x7f2220109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.090+0000 7f2228400640 1 --2- 172.21.15.8:0/1747619259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2220107b10 0x7f2220107f30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.090+0000 7f2228400640 1 -- 172.21.15.8:0/1747619259 >> 172.21.15.8:0/1747619259 conn(0x7f2220076ab0 msgr2=0x7f2220078ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:19.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.090+0000 7f2228400640 1 -- 172.21.15.8:0/1747619259 shutdown_connections 2024-03-16T20:57:19.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.090+0000 7f2228400640 1 -- 172.21.15.8:0/1747619259 wait complete. 2024-03-16T20:57:19.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.092+0000 7f2228400640 1 Processor -- start 2024-03-16T20:57:19.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.092+0000 7f2228400640 1 -- start start 2024-03-16T20:57:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.092+0000 7f2228400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2220107b10 0x7f222019dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.092+0000 7f2228400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2220108d00 0x7f222019e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.092+0000 7f2228400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22201096c0 0x7f22201a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.092+0000 7f2228400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22201a57d0 con 0x7f2220108d00 2024-03-16T20:57:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.092+0000 7f2228400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22201a5940 con 0x7f22201096c0 2024-03-16T20:57:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.092+0000 7f2228400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22201a5b00 con 0x7f2220107b10 2024-03-16T20:57:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.092+0000 7f2225a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2220107b10 0x7f222019dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:19.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.092+0000 7f2226400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22201096c0 0x7f22201a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.093+0000 7f2225000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2220108d00 0x7f222019e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.093+0000 7f2226400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22201096c0 0x7f22201a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:56440/0 (socket says 172.21.15.8:56440) 2024-03-16T20:57:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.093+0000 7f2225a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2220107b10 0x7f222019dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55506/0 (socket says 172.21.15.8:55506) 2024-03-16T20:57:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.093+0000 7f2226400640 1 -- 172.21.15.8:0/3730841148 learned_addr learned my addr 172.21.15.8:0/3730841148 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.093+0000 7f2226400640 1 -- 172.21.15.8:0/3730841148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2220107b10 msgr2=0x7f222019dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.093+0000 7f2226400640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2220107b10 0x7f222019dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.093+0000 7f2226400640 1 -- 172.21.15.8:0/3730841148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2220108d00 msgr2=0x7f222019e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.093+0000 7f2226400640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2220108d00 0x7f222019e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.093+0000 7f2226400640 1 -- 172.21.15.8:0/3730841148 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c009560 con 0x7f22201096c0 2024-03-16T20:57:19.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.093+0000 7f2226400640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22201096c0 0x7f22201a5260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f221800e9b0 tx=0x7f221800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:19.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.093+0000 7f221e000640 1 -- 172.21.15.8:0/3730841148 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221800cd80 con 0x7f22201096c0 2024-03-16T20:57:19.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.094+0000 7f221e000640 1 -- 172.21.15.8:0/3730841148 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f22180035f0 con 0x7f22201096c0 2024-03-16T20:57:19.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.094+0000 7f2228400640 1 -- 172.21.15.8:0/3730841148 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2218009490 con 0x7f22201096c0 2024-03-16T20:57:19.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.094+0000 7f221e000640 1 -- 172.21.15.8:0/3730841148 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218010690 con 0x7f22201096c0 2024-03-16T20:57:19.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.094+0000 7f2228400640 1 -- 172.21.15.8:0/3730841148 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2214009840 con 0x7f22201096c0 2024-03-16T20:57:19.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.095+0000 7f2228400640 1 -- 172.21.15.8:0/3730841148 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222010ee30 con 0x7f22201096c0 2024-03-16T20:57:19.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.096+0000 7f221e000640 1 -- 172.21.15.8:0/3730841148 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f2218003b60 con 0x7f22201096c0 2024-03-16T20:57:19.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.098+0000 7f221e000640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f22080a1ab0 0x7f22080a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:19.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.098+0000 7f221e000640 1 -- 172.21.15.8:0/3730841148 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2218014070 con 0x7f22201096c0 2024-03-16T20:57:19.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.098+0000 7f2225a00640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f22080a1ab0 0x7f22080a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:19.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.099+0000 7f2225a00640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f22080a1ab0 0x7f22080a3f70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f222019f1c0 tx=0x7f2214005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:19.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.102+0000 7f221e000640 1 -- 172.21.15.8:0/3730841148 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2218096a00 con 0x7f22201096c0 2024-03-16T20:57:19.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:18 smithi170 ceph-mon[35947]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:19.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:18 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1121682548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:19.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:18 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1047378141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:19.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:18 smithi186 ceph-mon[36391]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:19.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:18 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1121682548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:19.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:18 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1047378141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:19.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:18 smithi008 ceph-mon[31434]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:19.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:18 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1121682548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:19.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:18 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1047378141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:19.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.294+0000 7f2228400640 1 -- 172.21.15.8:0/3730841148 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f222002d000 con 0x7f22201096c0 2024-03-16T20:57:19.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.294+0000 7f221e000640 1 -- 172.21.15.8:0/3730841148 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2218098930 con 0x7f22201096c0 2024-03-16T20:57:19.300 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-16T20:57:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.297+0000 7f2228400640 1 -- 172.21.15.8:0/3730841148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f22080a1ab0 msgr2=0x7f22080a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.297+0000 7f2228400640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f22080a1ab0 0x7f22080a3f70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f222019f1c0 tx=0x7f2214005fd0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.297+0000 7f2228400640 1 -- 172.21.15.8:0/3730841148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22201096c0 msgr2=0x7f22201a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.297+0000 7f2228400640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22201096c0 0x7f22201a5260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f221800e9b0 tx=0x7f221800ee70 comp rx=0 tx=0).stop 2024-03-16T20:57:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.297+0000 7f2228400640 1 -- 172.21.15.8:0/3730841148 shutdown_connections 2024-03-16T20:57:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.297+0000 7f2228400640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f22080a1ab0 0x7f22080a3f70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.297+0000 7f2228400640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22201096c0 0x7f22201a5260 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.297+0000 7f2228400640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2220108d00 0x7f222019e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.297+0000 7f2228400640 1 --2- 172.21.15.8:0/3730841148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2220107b10 0x7f222019dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.297+0000 7f2228400640 1 -- 172.21.15.8:0/3730841148 >> 172.21.15.8:0/3730841148 conn(0x7f2220076ab0 msgr2=0x7f222010c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.298+0000 7f2228400640 1 -- 172.21.15.8:0/3730841148 shutdown_connections 2024-03-16T20:57:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.298+0000 7f2228400640 1 -- 172.21.15.8:0/3730841148 wait complete. 2024-03-16T20:57:19.320 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:57:19.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.528+0000 7f58c7e00640 1 -- 172.21.15.8:0/3040838241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c8108b40 msgr2=0x7f58c8108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:19.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.528+0000 7f58c7e00640 1 --2- 172.21.15.8:0/3040838241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c8108b40 0x7f58c8108fc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009900 tx=0x7f58b402bc30 comp rx=0 tx=0).stop 2024-03-16T20:57:19.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.528+0000 7f58c7e00640 1 -- 172.21.15.8:0/3040838241 shutdown_connections 2024-03-16T20:57:19.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.528+0000 7f58c7e00640 1 --2- 172.21.15.8:0/3040838241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c8109500 0x7f58c810fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.528+0000 7f58c7e00640 1 --2- 172.21.15.8:0/3040838241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c8108b40 0x7f58c8108fc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.528+0000 7f58c7e00640 1 --2- 172.21.15.8:0/3040838241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58c8107950 0x7f58c8107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.528+0000 7f58c7e00640 1 -- 172.21.15.8:0/3040838241 >> 172.21.15.8:0/3040838241 conn(0x7f58c8076900 msgr2=0x7f58c8078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:19.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.528+0000 7f58c7e00640 1 -- 172.21.15.8:0/3040838241 shutdown_connections 2024-03-16T20:57:19.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.528+0000 7f58c7e00640 1 -- 172.21.15.8:0/3040838241 wait complete. 2024-03-16T20:57:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.529+0000 7f58c7e00640 1 Processor -- start 2024-03-16T20:57:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.529+0000 7f58c7e00640 1 -- start start 2024-03-16T20:57:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c8107950 0x7f58c819db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c8108b40 0x7f58c819e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58c8109500 0x7f58c81a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c7e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c81a5620 con 0x7f58c8108b40 2024-03-16T20:57:19.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c81a5790 con 0x7f58c8107950 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c7e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c81a5950 con 0x7f58c8109500 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c6000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c8108b40 0x7f58c819e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c8107950 0x7f58c819db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c8107950 0x7f58c819db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:56448/0 (socket says 172.21.15.8:56448) 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c6a00640 1 -- 172.21.15.8:0/3841720520 learned_addr learned my addr 172.21.15.8:0/3841720520 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c7400640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58c8109500 0x7f58c81a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c6a00640 1 -- 172.21.15.8:0/3841720520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58c8109500 msgr2=0x7f58c81a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c6a00640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58c8109500 0x7f58c81a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c6a00640 1 -- 172.21.15.8:0/3841720520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c8108b40 msgr2=0x7f58c819e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c6a00640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c8108b40 0x7f58c819e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.530+0000 7f58c6a00640 1 -- 172.21.15.8:0/3841720520 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b4009560 con 0x7f58c8107950 2024-03-16T20:57:19.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.531+0000 7f58c6a00640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c8107950 0x7f58c819db30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f58b800e9c0 tx=0x7f58b800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:19.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.531+0000 7f58bf400640 1 -- 172.21.15.8:0/3841720520 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8009700 con 0x7f58c8107950 2024-03-16T20:57:19.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.531+0000 7f58bf400640 1 -- 172.21.15.8:0/3841720520 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f58b800cd80 con 0x7f58c8107950 2024-03-16T20:57:19.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.531+0000 7f58c7e00640 1 -- 172.21.15.8:0/3841720520 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c81a5c30 con 0x7f58c8107950 2024-03-16T20:57:19.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.531+0000 7f58bf400640 1 -- 172.21.15.8:0/3841720520 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8010690 con 0x7f58c8107950 2024-03-16T20:57:19.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.531+0000 7f58c7e00640 1 -- 172.21.15.8:0/3841720520 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c81a6160 con 0x7f58c8107950 2024-03-16T20:57:19.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.532+0000 7f58c7e00640 1 -- 172.21.15.8:0/3841720520 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c810eba0 con 0x7f58c8107950 2024-03-16T20:57:19.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.534+0000 7f58bf400640 1 -- 172.21.15.8:0/3841720520 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f58b8003710 con 0x7f58c8107950 2024-03-16T20:57:19.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.535+0000 7f58bf400640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f58ac0a1ab0 0x7f58ac0a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:19.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.536+0000 7f58bf400640 1 -- 172.21.15.8:0/3841720520 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f58b8014070 con 0x7f58c8107950 2024-03-16T20:57:19.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.536+0000 7f58c6000640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f58ac0a1ab0 0x7f58ac0a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:19.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.537+0000 7f58c6000640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f58ac0a1ab0 0x7f58ac0a3f70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f58b402c240 tx=0x7f58b402c8b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:19.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.544+0000 7f58bf400640 1 -- 172.21.15.8:0/3841720520 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f58b80969a0 con 0x7f58c8107950 2024-03-16T20:57:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.784+0000 7f58c7e00640 1 -- 172.21.15.8:0/3841720520 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58c81134d0 con 0x7f58c8107950 2024-03-16T20:57:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.787+0000 7f58bf400640 1 -- 172.21.15.8:0/3841720520 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f58b809a060 con 0x7f58c8107950 2024-03-16T20:57:19.791 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:19.791 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:55:10.355515+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24593,24544]},"id":1}]} 2024-03-16T20:57:19.792 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2024-03-16T20:57:19.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 -- 172.21.15.8:0/3841720520 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f58ac0a1ab0 msgr2=0x7f58ac0a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:19.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f58ac0a1ab0 0x7f58ac0a3f70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f58b402c240 tx=0x7f58b402c8b0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 -- 172.21.15.8:0/3841720520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c8107950 msgr2=0x7f58c819db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:19.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c8107950 0x7f58c819db30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f58b800e9c0 tx=0x7f58b800ee80 comp rx=0 tx=0).stop 2024-03-16T20:57:19.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 -- 172.21.15.8:0/3841720520 shutdown_connections 2024-03-16T20:57:19.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f58ac0a1ab0 0x7f58ac0a3f70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58c8109500 0x7f58c81a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c8108b40 0x7f58c819e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 --2- 172.21.15.8:0/3841720520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c8107950 0x7f58c819db30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:19.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 -- 172.21.15.8:0/3841720520 >> 172.21.15.8:0/3841720520 conn(0x7f58c8076900 msgr2=0x7f58c810bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:19.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 -- 172.21.15.8:0/3841720520 shutdown_connections 2024-03-16T20:57:19.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:19.789+0000 7f58c7e00640 1 -- 172.21.15.8:0/3841720520 wait complete. 2024-03-16T20:57:19.813 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:57:20.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.033+0000 7f664a800640 1 -- 172.21.15.8:0/495701576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6644108b40 msgr2=0x7f6644108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.033+0000 7f664a800640 1 --2- 172.21.15.8:0/495701576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6644108b40 0x7f6644108fc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6634009900 tx=0x7f663402bc50 comp rx=0 tx=0).stop 2024-03-16T20:57:20.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.033+0000 7f664a800640 1 -- 172.21.15.8:0/495701576 shutdown_connections 2024-03-16T20:57:20.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.033+0000 7f664a800640 1 --2- 172.21.15.8:0/495701576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6644109500 0x7f664410fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.033+0000 7f664a800640 1 --2- 172.21.15.8:0/495701576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6644108b40 0x7f6644108fc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.033+0000 7f664a800640 1 --2- 172.21.15.8:0/495701576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6644107950 0x7f6644107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.033+0000 7f664a800640 1 -- 172.21.15.8:0/495701576 >> 172.21.15.8:0/495701576 conn(0x7f6644076900 msgr2=0x7f6644078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.033+0000 7f664a800640 1 -- 172.21.15.8:0/495701576 shutdown_connections 2024-03-16T20:57:20.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.033+0000 7f664a800640 1 -- 172.21.15.8:0/495701576 wait complete. 2024-03-16T20:57:20.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.034+0000 7f664a800640 1 Processor -- start 2024-03-16T20:57:20.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.034+0000 7f664a800640 1 -- start start 2024-03-16T20:57:20.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f664a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6644107950 0x7f664419da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f664a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6644108b40 0x7f664419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f664a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6644109500 0x7f66441a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f664a800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66441a5580 con 0x7f6644107950 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f664a800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66441a56f0 con 0x7f6644109500 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f664a800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66441a58b0 con 0x7f6644108b40 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f6649400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6644107950 0x7f664419da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f6649400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6644107950 0x7f664419da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42850/0 (socket says 172.21.15.8:42850) 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f6649400640 1 -- 172.21.15.8:0/3074065529 learned_addr learned my addr 172.21.15.8:0/3074065529 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f6648a00640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6644108b40 0x7f664419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f6649e00640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6644109500 0x7f66441a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f6648a00640 1 -- 172.21.15.8:0/3074065529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6644109500 msgr2=0x7f66441a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.035+0000 7f6648a00640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6644109500 0x7f66441a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.036+0000 7f6648a00640 1 -- 172.21.15.8:0/3074065529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6644107950 msgr2=0x7f664419da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.036+0000 7f6648a00640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6644107950 0x7f664419da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.036+0000 7f6648a00640 1 -- 172.21.15.8:0/3074065529 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c009840 con 0x7f6644108b40 2024-03-16T20:57:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.036+0000 7f6649e00640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6644109500 0x7f66441a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.036+0000 7f6649400640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6644107950 0x7f664419da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.036+0000 7f6648a00640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6644108b40 0x7f664419dfd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6634009230 tx=0x7f6634005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.036+0000 7f6642000640 1 -- 172.21.15.8:0/3074065529 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634004e10 con 0x7f6644108b40 2024-03-16T20:57:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.036+0000 7f6642000640 1 -- 172.21.15.8:0/3074065529 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6634005470 con 0x7f6644108b40 2024-03-16T20:57:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.036+0000 7f6642000640 1 -- 172.21.15.8:0/3074065529 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634034440 con 0x7f6644108b40 2024-03-16T20:57:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.036+0000 7f664a800640 1 -- 172.21.15.8:0/3074065529 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6634009560 con 0x7f6644108b40 2024-03-16T20:57:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.036+0000 7f664a800640 1 -- 172.21.15.8:0/3074065529 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66441a5dd0 con 0x7f6644108b40 2024-03-16T20:57:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.038+0000 7f664a800640 1 -- 172.21.15.8:0/3074065529 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6644068650 con 0x7f6644108b40 2024-03-16T20:57:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.039+0000 7f6642000640 1 -- 172.21.15.8:0/3074065529 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f66340035f0 con 0x7f6644108b40 2024-03-16T20:57:20.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.040+0000 7f6642000640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f662c0a1ab0 0x7f662c0a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.041+0000 7f6642000640 1 -- 172.21.15.8:0/3074065529 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f66340ef770 con 0x7f6644108b40 2024-03-16T20:57:20.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.041+0000 7f6649400640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f662c0a1ab0 0x7f662c0a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.041+0000 7f6649400640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f662c0a1ab0 0x7f662c0a3f70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f66380058c0 tx=0x7f6638005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.044+0000 7f6642000640 1 -- 172.21.15.8:0/3074065529 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f66340b8a50 con 0x7f6644108b40 2024-03-16T20:57:20.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:19 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1678906586' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:20.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:19 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3730841148' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:20.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:19 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3841720520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:20.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:19 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1678906586' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:20.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:19 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3730841148' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:20.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:19 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3841720520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:20.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:19 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1678906586' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:20.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:19 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3730841148' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:20.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:19 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3841720520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.247+0000 7f664a800640 1 -- 172.21.15.8:0/3074065529 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f664410ec70 con 0x7f6644108b40 2024-03-16T20:57:20.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.250+0000 7f6642000640 1 -- 172.21.15.8:0/3074065529 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22581 (secure 0 0 0) 0x7f6634041090 con 0x7f6644108b40 2024-03-16T20:57:20.255 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:20.255 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:56:04.502777+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:57:20.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.252+0000 7f664a800640 1 -- 172.21.15.8:0/3074065529 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f662c0a1ab0 msgr2=0x7f662c0a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.252+0000 7f664a800640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f662c0a1ab0 0x7f662c0a3f70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f66380058c0 tx=0x7f6638005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.252+0000 7f664a800640 1 -- 172.21.15.8:0/3074065529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6644108b40 msgr2=0x7f664419dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.252+0000 7f664a800640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6644108b40 0x7f664419dfd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6634009230 tx=0x7f6634005dd0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.252+0000 7f664a800640 1 -- 172.21.15.8:0/3074065529 shutdown_connections 2024-03-16T20:57:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.252+0000 7f664a800640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f662c0a1ab0 0x7f662c0a3f70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.252+0000 7f664a800640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6644109500 0x7f66441a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.252+0000 7f664a800640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6644108b40 0x7f664419dfd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.252+0000 7f664a800640 1 --2- 172.21.15.8:0/3074065529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6644107950 0x7f664419da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.252+0000 7f664a800640 1 -- 172.21.15.8:0/3074065529 >> 172.21.15.8:0/3074065529 conn(0x7f6644076900 msgr2=0x7f664410be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.252+0000 7f664a800640 1 -- 172.21.15.8:0/3074065529 shutdown_connections 2024-03-16T20:57:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.253+0000 7f664a800640 1 -- 172.21.15.8:0/3074065529 wait complete. 2024-03-16T20:57:20.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-16T20:55:04.725491+0000', 'modified': '2024-03-16T20:55:10.355515+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24593, 'mds_1': 24544, 'mds_2': 24536}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24509': {'gid': 24509, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.170:6835/335822502', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6834', 'nonce': 335822502}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 335822502}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24511': {'gid': 24511, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6835/3505833451', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6834', 'nonce': 3505833451}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 3505833451}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24523': {'gid': 24523, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6837/1748602428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6836', 'nonce': 1748602428}, {'type': 'v1', 'addr': '172.21.15.186:6837', 'nonce': 1748602428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24536': {'gid': 24536, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.170:6837/3144558039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6836', 'nonce': 3144558039}, {'type': 'v1', 'addr': '172.21.15.170:6837', 'nonce': 3144558039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24544': {'gid': 24544, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.186:6839/1721589022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6838', 'nonce': 1721589022}, {'type': 'v1', 'addr': '172.21.15.186:6839', 'nonce': 1721589022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24593': {'gid': 24593, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6839/600336743', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6838', 'nonce': 600336743}, {'type': 'v1', 'addr': '172.21.15.170:6839', 'nonce': 600336743}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24593, 'qdb_cluster': [24536, 24593, 24544]} 2024-03-16T20:57:20.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-03-16T20:57:20.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-16T20:57:20.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.492+0000 7fd288600640 1 -- 172.21.15.8:0/3013722226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd280100410 msgr2=0x7fd280100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.492+0000 7fd288600640 1 --2- 172.21.15.8:0/3013722226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd280100410 0x7fd280100830 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd274009900 tx=0x7fd27402bc30 comp rx=0 tx=0).stop 2024-03-16T20:57:20.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.492+0000 7fd288600640 1 -- 172.21.15.8:0/3013722226 shutdown_connections 2024-03-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.492+0000 7fd288600640 1 --2- 172.21.15.8:0/3013722226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd280101fc0 0x7fd280108850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.492+0000 7fd288600640 1 --2- 172.21.15.8:0/3013722226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd280101600 0x7fd280101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.492+0000 7fd288600640 1 --2- 172.21.15.8:0/3013722226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd280100410 0x7fd280100830 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.492+0000 7fd288600640 1 -- 172.21.15.8:0/3013722226 >> 172.21.15.8:0/3013722226 conn(0x7fd2800fb9a0 msgr2=0x7fd2800fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.492+0000 7fd288600640 1 -- 172.21.15.8:0/3013722226 shutdown_connections 2024-03-16T20:57:20.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.492+0000 7fd288600640 1 -- 172.21.15.8:0/3013722226 wait complete. 2024-03-16T20:57:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.493+0000 7fd288600640 1 Processor -- start 2024-03-16T20:57:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.494+0000 7fd288600640 1 -- start start 2024-03-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.494+0000 7fd288600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd280100410 0x7fd280195140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.494+0000 7fd288600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd280101600 0x7fd280195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.494+0000 7fd288600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd280101fc0 0x7fd280191cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.494+0000 7fd288600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd280192440 con 0x7fd280101fc0 2024-03-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.494+0000 7fd288600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2801925b0 con 0x7fd280100410 2024-03-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.494+0000 7fd288600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd280192770 con 0x7fd280101600 2024-03-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.494+0000 7fd285c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd280100410 0x7fd280195140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.494+0000 7fd285c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd280100410 0x7fd280195140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:56482/0 (socket says 172.21.15.8:56482) 2024-03-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.494+0000 7fd285c00640 1 -- 172.21.15.8:0/679134787 learned_addr learned my addr 172.21.15.8:0/679134787 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.494+0000 7fd285200640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd280101600 0x7fd280195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.495+0000 7fd286600640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd280101fc0 0x7fd280191cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.495+0000 7fd285c00640 1 -- 172.21.15.8:0/679134787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd280101600 msgr2=0x7fd280195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.495+0000 7fd285c00640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd280101600 0x7fd280195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.495+0000 7fd285c00640 1 -- 172.21.15.8:0/679134787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd280101fc0 msgr2=0x7fd280191cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.495+0000 7fd285c00640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd280101fc0 0x7fd280191cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.495+0000 7fd285c00640 1 -- 172.21.15.8:0/679134787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274009560 con 0x7fd280100410 2024-03-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.495+0000 7fd285c00640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd280100410 0x7fd280195140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd274000c00 tx=0x7fd274005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.495+0000 7fd27e000640 1 -- 172.21.15.8:0/679134787 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274004350 con 0x7fd280100410 2024-03-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.495+0000 7fd27e000640 1 -- 172.21.15.8:0/679134787 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd2740044b0 con 0x7fd280100410 2024-03-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.495+0000 7fd27e000640 1 -- 172.21.15.8:0/679134787 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274003de0 con 0x7fd280100410 2024-03-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.495+0000 7fd288600640 1 -- 172.21.15.8:0/679134787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2801a5db0 con 0x7fd280100410 2024-03-16T20:57:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.496+0000 7fd288600640 1 -- 172.21.15.8:0/679134787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2801a6220 con 0x7fd280100410 2024-03-16T20:57:20.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.499+0000 7fd28b20d740 1 Processor -- start 2024-03-16T20:57:20.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.499+0000 7fd27e000640 1 -- 172.21.15.8:0/679134787 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fd274004e10 con 0x7fd280100410 2024-03-16T20:57:20.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.499+0000 7fd28b20d740 1 -- start start 2024-03-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.499+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 0x556da7f729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.499+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 0x556da7f77a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.499+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f780e0 0x556da7f7a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.499+0000 7fd28b20d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7ee1b30 con 0x556da7f72f70 2024-03-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.499+0000 7fd28b20d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7edf060 con 0x556da7f72580 2024-03-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.499+0000 7fd28b20d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7eda840 con 0x556da7f780e0 2024-03-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.499+0000 7fd286600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 0x556da7f729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd286600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 0x556da7f729a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:56484/0 (socket says 172.21.15.8:56484) 2024-03-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd286600640 1 -- 172.21.15.8:0/3489649995 learned_addr learned my addr 172.21.15.8:0/3489649995 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd285c00640 1 --2- 172.21.15.8:0/3489649995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 0x556da7f77a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd285200640 1 --2- 172.21.15.8:0/3489649995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f780e0 0x556da7f7a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd286600640 1 -- 172.21.15.8:0/3489649995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f780e0 msgr2=0x556da7f7a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd286600640 1 --2- 172.21.15.8:0/3489649995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f780e0 0x556da7f7a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd286600640 1 -- 172.21.15.8:0/3489649995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 msgr2=0x556da7f77a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd286600640 1 --2- 172.21.15.8:0/3489649995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 0x556da7f77a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd286600640 1 -- 172.21.15.8:0/3489649995 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556da7ea24c0 con 0x556da7f72580 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd285c00640 1 --2- 172.21.15.8:0/3489649995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 0x556da7f77a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd286600640 1 --2- 172.21.15.8:0/3489649995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 0x556da7f729a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd278009fc0 tx=0x7fd278010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f27d076c92f475bb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd272a00640 1 -- 172.21.15.8:0/3489649995 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278003b70 con 0x556da7f72580 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd272a00640 1 -- 172.21.15.8:0/3489649995 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd278015070 con 0x556da7f72580 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.500+0000 7fd272a00640 1 -- 172.21.15.8:0/3489649995 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278011960 con 0x556da7f72580 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd27e000640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd2680a1ab0 0x7fd2680a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd27e000640 1 -- 172.21.15.8:0/679134787 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd2740efaa0 con 0x7fd280100410 2024-03-16T20:57:20.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd285c00640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd2680a1ab0 0x7fd2680a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd28b20d740 1 -- 172.21.15.8:0/3489649995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 msgr2=0x556da7f729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd28b20d740 1 --2- 172.21.15.8:0/3489649995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 0x556da7f729a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd278009fc0 tx=0x7fd278010860 comp rx=0 tx=0).stop 2024-03-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd28b20d740 1 -- 172.21.15.8:0/3489649995 shutdown_connections 2024-03-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd28b20d740 1 --2- 172.21.15.8:0/3489649995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f780e0 0x556da7f7a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd28b20d740 1 --2- 172.21.15.8:0/3489649995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 0x556da7f77a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd28b20d740 1 --2- 172.21.15.8:0/3489649995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 0x556da7f729a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd28b20d740 1 -- 172.21.15.8:0/3489649995 >> 172.21.15.8:0/3489649995 conn(0x556da7f6daf0 msgr2=0x556da7f6def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd28b20d740 1 -- 172.21.15.8:0/3489649995 shutdown_connections 2024-03-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.501+0000 7fd28b20d740 1 -- 172.21.15.8:0/3489649995 wait complete. 2024-03-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.502+0000 7fd285c00640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd2680a1ab0 0x7fd2680a3f70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x556da7f73370 tx=0x7fd274009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.502+0000 7fd28b20d740 1 -- start start 2024-03-16T20:57:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.502+0000 7fd28b20d740 1 Processor -- start 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.502+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72580 0x556da7f7c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.502+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72f70 0x556da7f7cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f780e0 0x556da7f83cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd28b20d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7e7fea0 con 0x556da7f72580 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd28b20d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7e7fb40 con 0x556da7f72f70 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd28b20d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7c22f20 con 0x556da7f780e0 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd28b20d740 10 client.0 _ll_register_callbacks cb 0x556da7e93950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd285200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72f70 0x556da7f7cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd285200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72f70 0x556da7f7cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:56488/0 (socket says 172.21.15.8:56488) 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd285200640 1 -- 172.21.15.8:0/566544572 learned_addr learned my addr 172.21.15.8:0/566544572 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd286600640 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72580 0x556da7f7c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd286600640 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f780e0 0x556da7f83cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd285200640 1 -- 172.21.15.8:0/566544572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f780e0 msgr2=0x556da7f83cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd285200640 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f780e0 0x556da7f83cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd285200640 1 -- 172.21.15.8:0/566544572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72580 msgr2=0x556da7f7c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd285200640 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72580 0x556da7f7c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd285200640 1 -- 172.21.15.8:0/566544572 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd278009c70 con 0x556da7f72f70 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd286600640 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f780e0 0x556da7f83cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd285200640 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72f70 0x556da7f7cc70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd26c012700 tx=0x7fd26c012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f9204077846bb5b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.503+0000 7fd267400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.504+0000 7fd267400640 1 -- 172.21.15.8:0/566544572 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c017070 con 0x556da7f72f70 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.504+0000 7fd267400640 1 -- 172.21.15.8:0/566544572 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd26c00f8c0 con 0x556da7f72f70 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.504+0000 7fd28b20d740 1 -- 172.21.15.8:0/566544572 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556da7efec40 con 0x556da7f72f70 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.504+0000 7fd267400640 1 -- 172.21.15.8:0/566544572 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd26c022030 con 0x556da7f72f70 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.504+0000 7fd28b20d740 10 client.25151 fetch_fsmap learned FSMap version 23 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.504+0000 7fd28b20d740 1 -- 172.21.15.8:0/566544572 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x556da7ed8ec0 con 0x556da7f72f70 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.504+0000 7fd267400640 1 -- 172.21.15.8:0/566544572 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x556da7efec40 con 0x556da7f72f70 2024-03-16T20:57:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.504+0000 7fd267400640 1 -- 172.21.15.8:0/566544572 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fd26c01cd20 con 0x556da7f72f70 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.505+0000 7fd28b20d740 10 client.25151 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.505+0000 7fd28b20d740 10 client.25151 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.505+0000 7fd28b20d740 20 client.25151 populate_metadata read hostname 'smithi008' 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.505+0000 7fd28b20d740 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556da7f88710 0x556da7f87fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.505+0000 7fd28b20d740 4 client.25151 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.505+0000 7fd28b20d740 1 -- 172.21.15.8:0/566544572 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556da7bda6c0 con 0x556da7f88710 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.505+0000 7fd286600640 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556da7f88710 0x556da7f87fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.505+0000 7fd286600640 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556da7f88710 0x556da7f87fe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=56b3a369fc8dda2c server_cookie=17683de29bcd24a2 in_seq=0 out_seq=0 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.505+0000 7fd267400640 10 client.25151 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd267400640 1 -- 172.21.15.8:0/566544572 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556da7bda6c0 con 0x556da7f88710 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd267400640 10 client.25151 handle_command_reply: tid=0 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd28b20d740 1 client.25151 shutdown 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd28b20d740 1 -- 172.21.15.8:0/566544572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72f70 msgr2=0x556da7f7cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd28b20d740 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72f70 0x556da7f7cc70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd26c012700 tx=0x7fd26c012bc0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd28b20d740 1 -- 172.21.15.8:0/566544572 shutdown_connections 2024-03-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd28b20d740 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556da7f88710 0x556da7f87fe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd28b20d740 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f780e0 0x556da7f83cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd28b20d740 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72f70 0x556da7f7cc70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd267400640 0 client.25151 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd28b20d740 1 --2- 172.21.15.8:0/566544572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72580 0x556da7f7c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.506+0000 7fd28b20d740 1 -- 172.21.15.8:0/566544572 >> 172.21.15.8:0/566544572 conn(0x556da7f6daf0 msgr2=0x556da7f6ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.507+0000 7fd28b20d740 1 -- 172.21.15.8:0/566544572 shutdown_connections 2024-03-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.507+0000 7fd28b20d740 1 -- 172.21.15.8:0/566544572 wait complete. 2024-03-16T20:57:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.507+0000 7fd28b20d740 20 client.25151 trim_cache size 0 max 16384 2024-03-16T20:57:20.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.525+0000 7fd28b20d740 1 Processor -- start 2024-03-16T20:57:20.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.525+0000 7fd28b20d740 1 -- start start 2024-03-16T20:57:20.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.525+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72580 0x556da7f7ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.525+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 0x556da7f83c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.525+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f780e0 0x556da7f6c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.525+0000 7fd28b20d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7f88210 con 0x556da7f72f70 2024-03-16T20:57:20.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.525+0000 7fd28b20d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7f84570 con 0x556da7f780e0 2024-03-16T20:57:20.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.525+0000 7fd28b20d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7efec40 con 0x556da7f72580 2024-03-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.526+0000 7fd285200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 0x556da7f83c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.526+0000 7fd285200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 0x556da7f83c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42894/0 (socket says 172.21.15.8:42894) 2024-03-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.526+0000 7fd286600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72580 0x556da7f7ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.526+0000 7fd285200640 1 -- 172.21.15.8:0/612962042 learned_addr learned my addr 172.21.15.8:0/612962042 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.526+0000 7fd286600640 1 --2- 172.21.15.8:0/612962042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f780e0 0x556da7f6c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.526+0000 7fd285200640 1 -- 172.21.15.8:0/612962042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72580 msgr2=0x556da7f7ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.526+0000 7fd285200640 1 --2- 172.21.15.8:0/612962042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72580 0x556da7f7ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.526+0000 7fd285200640 1 -- 172.21.15.8:0/612962042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f780e0 msgr2=0x556da7f6c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.526+0000 7fd285200640 1 --2- 172.21.15.8:0/612962042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f780e0 0x556da7f6c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.526+0000 7fd285200640 1 -- 172.21.15.8:0/612962042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556da7e758b0 con 0x556da7f72f70 2024-03-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.527+0000 7fd285200640 1 --2- 172.21.15.8:0/612962042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 0x556da7f83c70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd26c000c00 tx=0x7fd26c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2d9637450ef0c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.527+0000 7fd272000640 1 -- 172.21.15.8:0/612962042 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c017020 con 0x556da7f72f70 2024-03-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.527+0000 7fd272000640 1 -- 172.21.15.8:0/612962042 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd26c0055b0 con 0x556da7f72f70 2024-03-16T20:57:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.527+0000 7fd272000640 1 -- 172.21.15.8:0/612962042 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c022070 con 0x556da7f72f70 2024-03-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.527+0000 7fd28b20d740 1 -- 172.21.15.8:0/612962042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 msgr2=0x556da7f83c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.527+0000 7fd28b20d740 1 --2- 172.21.15.8:0/612962042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 0x556da7f83c70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd26c000c00 tx=0x7fd26c001e70 comp rx=0 tx=0).stop 2024-03-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.527+0000 7fd28b20d740 1 -- 172.21.15.8:0/612962042 shutdown_connections 2024-03-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.527+0000 7fd28b20d740 1 --2- 172.21.15.8:0/612962042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f780e0 0x556da7f6c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.527+0000 7fd28b20d740 1 --2- 172.21.15.8:0/612962042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f72f70 0x556da7f83c70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.527+0000 7fd28b20d740 1 --2- 172.21.15.8:0/612962042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72580 0x556da7f7ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.528+0000 7fd28b20d740 1 -- 172.21.15.8:0/612962042 >> 172.21.15.8:0/612962042 conn(0x556da7f6daf0 msgr2=0x556da7f7c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.528+0000 7fd28b20d740 1 -- 172.21.15.8:0/612962042 shutdown_connections 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.528+0000 7fd28b20d740 1 -- 172.21.15.8:0/612962042 wait complete. 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.528+0000 7fd28b20d740 1 -- start start 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.528+0000 7fd28b20d740 1 Processor -- start 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 0x556da7f83a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72f70 0x556da7f804e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd28b20d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f780e0 0x556da7f80a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd28b20d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7f80fb0 con 0x556da7f780e0 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd28b20d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7f81120 con 0x556da7f72580 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd28b20d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da7fe3e00 con 0x556da7f72f70 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd28b20d740 10 client.0 _ll_register_callbacks cb 0x7fd26c009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd285200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72f70 0x556da7f804e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd286600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 0x556da7f83a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd285200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72f70 0x556da7f804e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55590/0 (socket says 172.21.15.8:55590) 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd285200640 1 -- 172.21.15.8:0/941215442 learned_addr learned my addr 172.21.15.8:0/941215442 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd286600640 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f780e0 0x556da7f80a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd285200640 1 -- 172.21.15.8:0/941215442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 msgr2=0x556da7f83a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd285200640 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 0x556da7f83a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd285200640 1 -- 172.21.15.8:0/941215442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f780e0 msgr2=0x556da7f80a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd285200640 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f780e0 0x556da7f80a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.529+0000 7fd285200640 1 -- 172.21.15.8:0/941215442 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556da7ed8ec0 con 0x556da7f72f70 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.530+0000 7fd285200640 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72f70 0x556da7f804e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd26c010500 tx=0x7fd26c0052e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8739436d6410dc67 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.530+0000 7fd267400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.530+0000 7fd267400640 1 -- 172.21.15.8:0/941215442 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c022040 con 0x556da7f72f70 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.530+0000 7fd267400640 1 -- 172.21.15.8:0/941215442 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd26c023070 con 0x556da7f72f70 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.530+0000 7fd28b20d740 1 -- 172.21.15.8:0/941215442 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd278015070 con 0x556da7f72f70 2024-03-16T20:57:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.530+0000 7fd267400640 1 -- 172.21.15.8:0/941215442 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd26c036030 con 0x556da7f72f70 2024-03-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.530+0000 7fd28b20d740 10 client.25159 fetch_fsmap learned FSMap version 23 2024-03-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.530+0000 7fd28b20d740 1 -- 172.21.15.8:0/941215442 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x556da7e9b510 con 0x556da7f72f70 2024-03-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.531+0000 7fd267400640 1 -- 172.21.15.8:0/941215442 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd278015070 con 0x556da7f72f70 2024-03-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.531+0000 7fd267400640 1 -- 172.21.15.8:0/941215442 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fd26c01c470 con 0x556da7f72f70 2024-03-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.531+0000 7fd28b20d740 10 client.25159 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.531+0000 7fd28b20d740 10 client.25159 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.531+0000 7fd28b20d740 20 client.25159 populate_metadata read hostname 'smithi008' 2024-03-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.531+0000 7fd28b20d740 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556da7fe8e70 0x556da7fe5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.531+0000 7fd28b20d740 4 client.25159 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.531+0000 7fd28b20d740 1 -- 172.21.15.8:0/941215442 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556da7c2b270 con 0x556da7fe8e70 2024-03-16T20:57:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.531+0000 7fd286600640 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556da7fe8e70 0x556da7fe5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd286600640 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556da7fe8e70 0x556da7fe5330 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6b5c7bf8dc2df759 server_cookie=4fe5be7728e14bf3 in_seq=0 out_seq=0 2024-03-16T20:57:20.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd267400640 10 client.25159 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:57:20.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd267400640 1 -- 172.21.15.8:0/941215442 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x556da7c2b270 con 0x556da7fe8e70 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd267400640 10 client.25159 handle_command_reply: tid=0 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd28b20d740 1 client.25159 shutdown 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd28b20d740 1 -- 172.21.15.8:0/941215442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72f70 msgr2=0x556da7f804e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd28b20d740 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72f70 0x556da7f804e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd26c010500 tx=0x7fd26c0052e0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd28b20d740 1 -- 172.21.15.8:0/941215442 shutdown_connections 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd28b20d740 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556da7fe8e70 0x556da7fe5330 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd28b20d740 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556da7f780e0 0x556da7f80a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd28b20d740 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556da7f72f70 0x556da7f804e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd28b20d740 1 --2- 172.21.15.8:0/941215442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556da7f72580 0x556da7f83a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd267400640 0 client.25159 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd28b20d740 1 -- 172.21.15.8:0/941215442 >> 172.21.15.8:0/941215442 conn(0x556da7f6daf0 msgr2=0x556da7f70d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd28b20d740 1 -- 172.21.15.8:0/941215442 shutdown_connections 2024-03-16T20:57:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.532+0000 7fd28b20d740 1 -- 172.21.15.8:0/941215442 wait complete. 2024-03-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd28b20d740 20 client.25159 trim_cache size 0 max 16384 2024-03-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "05d64692-e3d6-11ee-95c9-87774f69a715", 2024-03-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 2, 2024-03-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24536, 2024-03-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-03-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-03-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-03-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 131.187227713, 2024-03-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2024-03-16T20:57:20.542 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2024-03-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2024-03-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 156.756104292 2024-03-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 -- 172.21.15.8:0/679134787 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd2680a1ab0 msgr2=0x7fd2680a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd2680a1ab0 0x7fd2680a3f70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x556da7f73370 tx=0x7fd274009260 comp rx=0 tx=0).stop 2024-03-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 -- 172.21.15.8:0/679134787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd280100410 msgr2=0x7fd280195140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd280100410 0x7fd280195140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd274000c00 tx=0x7fd274005dc0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 -- 172.21.15.8:0/679134787 shutdown_connections 2024-03-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd2680a1ab0 0x7fd2680a3f70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd280101fc0 0x7fd280191cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd280101600 0x7fd280195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 --2- 172.21.15.8:0/679134787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd280100410 0x7fd280195140 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 -- 172.21.15.8:0/679134787 >> 172.21.15.8:0/679134787 conn(0x7fd2800fb9a0 msgr2=0x7fd2800fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 -- 172.21.15.8:0/679134787 shutdown_connections 2024-03-16T20:57:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.533+0000 7fd288600640 1 -- 172.21.15.8:0/679134787 wait complete. 2024-03-16T20:57:20.557 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-03-16T20:57:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.774+0000 7fe86a800640 1 -- 172.21.15.8:0/3257098732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe864073f50 msgr2=0x7fe8640743d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.774+0000 7fe86a800640 1 --2- 172.21.15.8:0/3257098732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe864073f50 0x7fe8640743d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe850009900 tx=0x7fe85002bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.775+0000 7fe86a800640 1 -- 172.21.15.8:0/3257098732 shutdown_connections 2024-03-16T20:57:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.775+0000 7fe86a800640 1 --2- 172.21.15.8:0/3257098732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86410d9a0 0x7fe86410fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.775+0000 7fe86a800640 1 --2- 172.21.15.8:0/3257098732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe864073f50 0x7fe8640743d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.775+0000 7fe86a800640 1 --2- 172.21.15.8:0/3257098732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe864075530 0x7fe864073980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.775+0000 7fe86a800640 1 -- 172.21.15.8:0/3257098732 >> 172.21.15.8:0/3257098732 conn(0x7fe8640fc960 msgr2=0x7fe8640fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.775+0000 7fe86a800640 1 -- 172.21.15.8:0/3257098732 shutdown_connections 2024-03-16T20:57:20.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.775+0000 7fe86a800640 1 -- 172.21.15.8:0/3257098732 wait complete. 2024-03-16T20:57:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.776+0000 7fe86a800640 1 Processor -- start 2024-03-16T20:57:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.776+0000 7fe86a800640 1 -- start start 2024-03-16T20:57:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.776+0000 7fe86a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe864073f50 0x7fe86419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe86a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe864075530 0x7fe86419e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe86a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86410d9a0 0x7fe8641a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe86a800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641a5610 con 0x7fe86410d9a0 2024-03-16T20:57:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe86a800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641a5780 con 0x7fe864073f50 2024-03-16T20:57:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe86a800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641a5940 con 0x7fe864075530 2024-03-16T20:57:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe869400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe864073f50 0x7fe86419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe869400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe864073f50 0x7fe86419db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:56534/0 (socket says 172.21.15.8:56534) 2024-03-16T20:57:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe869400640 1 -- 172.21.15.8:0/1126692179 learned_addr learned my addr 172.21.15.8:0/1126692179 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe869e00640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86410d9a0 0x7fe8641a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe868a00640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe864075530 0x7fe86419e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe869400640 1 -- 172.21.15.8:0/1126692179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe864075530 msgr2=0x7fe86419e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe869400640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe864075530 0x7fe86419e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe869400640 1 -- 172.21.15.8:0/1126692179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86410d9a0 msgr2=0x7fe8641a50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe869400640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86410d9a0 0x7fe8641a50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe869400640 1 -- 172.21.15.8:0/1126692179 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe858009490 con 0x7fe864073f50 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe869e00640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86410d9a0 0x7fe8641a50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.777+0000 7fe869400640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe864073f50 0x7fe86419db20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe85800ea60 tx=0x7fe85800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.778+0000 7fe862000640 1 -- 172.21.15.8:0/1126692179 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85800cde0 con 0x7fe864073f50 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.778+0000 7fe862000640 1 -- 172.21.15.8:0/1126692179 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe8580035f0 con 0x7fe864073f50 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.778+0000 7fe86a800640 1 -- 172.21.15.8:0/1126692179 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe850009560 con 0x7fe864073f50 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.778+0000 7fe862000640 1 -- 172.21.15.8:0/1126692179 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858010690 con 0x7fe864073f50 2024-03-16T20:57:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.778+0000 7fe86a800640 1 -- 172.21.15.8:0/1126692179 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8641a5fc0 con 0x7fe864073f50 2024-03-16T20:57:20.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.781+0000 7fe862000640 1 -- 172.21.15.8:0/1126692179 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fe858003b80 con 0x7fe864073f50 2024-03-16T20:57:20.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.781+0000 7fe86ea48740 1 Processor -- start 2024-03-16T20:57:20.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.781+0000 7fe86ea48740 1 -- start start 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33b760 0x55a98f33bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33c150 0x55a98f340c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f3412c0 0x55a98f343750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe86ea48740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98f2aab30 con 0x55a98f33c150 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe86ea48740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98f2a8060 con 0x55a98f3412c0 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe86ea48740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98f2a3840 con 0x55a98f33b760 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe869e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33b760 0x55a98f33bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe869e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33b760 0x55a98f33bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55608/0 (socket says 172.21.15.8:55608) 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe869400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33c150 0x55a98f340c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe869e00640 1 -- 172.21.15.8:0/3102733639 learned_addr learned my addr 172.21.15.8:0/3102733639 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe868a00640 1 --2- 172.21.15.8:0/3102733639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f3412c0 0x55a98f343750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe869e00640 1 -- 172.21.15.8:0/3102733639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f3412c0 msgr2=0x55a98f343750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe869e00640 1 --2- 172.21.15.8:0/3102733639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f3412c0 0x55a98f343750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe869e00640 1 -- 172.21.15.8:0/3102733639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33c150 msgr2=0x55a98f340c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe869e00640 1 --2- 172.21.15.8:0/3102733639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33c150 0x55a98f340c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.782+0000 7fe869e00640 1 -- 172.21.15.8:0/3102733639 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a98f26b4c0 con 0x55a98f33b760 2024-03-16T20:57:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.783+0000 7fe869e00640 1 --2- 172.21.15.8:0/3102733639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33b760 0x55a98f33bb80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009fd0 tx=0x7fe85c0108e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=669d42d522aa0212 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.783+0000 7fe856600640 1 -- 172.21.15.8:0/3102733639 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c011760 con 0x55a98f33b760 2024-03-16T20:57:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.783+0000 7fe856600640 1 -- 172.21.15.8:0/3102733639 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe85c015070 con 0x55a98f33b760 2024-03-16T20:57:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.783+0000 7fe856600640 1 -- 172.21.15.8:0/3102733639 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c00e3c0 con 0x55a98f33b760 2024-03-16T20:57:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.783+0000 7fe862000640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe84c0a1ab0 0x7fe84c0a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.783+0000 7fe862000640 1 -- 172.21.15.8:0/1126692179 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe858014070 con 0x7fe864073f50 2024-03-16T20:57:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.783+0000 7fe869400640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe84c0a1ab0 0x7fe84c0a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.784+0000 7fe86ea48740 1 -- 172.21.15.8:0/3102733639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33b760 msgr2=0x55a98f33bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.784+0000 7fe86ea48740 1 --2- 172.21.15.8:0/3102733639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33b760 0x55a98f33bb80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009fd0 tx=0x7fe85c0108e0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.784+0000 7fe86ea48740 1 -- 172.21.15.8:0/3102733639 shutdown_connections 2024-03-16T20:57:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.784+0000 7fe86ea48740 1 --2- 172.21.15.8:0/3102733639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f3412c0 0x55a98f343750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.784+0000 7fe86ea48740 1 --2- 172.21.15.8:0/3102733639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33c150 0x55a98f340c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.784+0000 7fe86ea48740 1 --2- 172.21.15.8:0/3102733639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33b760 0x55a98f33bb80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.784+0000 7fe86ea48740 1 -- 172.21.15.8:0/3102733639 >> 172.21.15.8:0/3102733639 conn(0x55a98f336cd0 msgr2=0x55a98f3370d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.784+0000 7fe86ea48740 1 -- 172.21.15.8:0/3102733639 shutdown_connections 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.784+0000 7fe86ea48740 1 -- 172.21.15.8:0/3102733639 wait complete. 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.784+0000 7fe869400640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe84c0a1ab0 0x7fe84c0a3f70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe85809a7a0 tx=0x7fe8580d3530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.784+0000 7fe86ea48740 1 -- start start 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe86ea48740 1 Processor -- start 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33b760 0x55a98f3458f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33c150 0x55a98f345e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f3412c0 0x55a98f34ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe86ea48740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98f248ea0 con 0x55a98f33b760 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe86ea48740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98f248b40 con 0x55a98f33c150 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe86ea48740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98efebf20 con 0x55a98f3412c0 2024-03-16T20:57:20.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe86ea48740 10 client.0 _ll_register_callbacks cb 0x55a98f25c950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe869e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33b760 0x55a98f3458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe868a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33c150 0x55a98f345e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe869e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33b760 0x55a98f3458f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42952/0 (socket says 172.21.15.8:42952) 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe869e00640 1 -- 172.21.15.8:0/3683250034 learned_addr learned my addr 172.21.15.8:0/3683250034 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.785+0000 7fe869e00640 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f3412c0 0x55a98f34ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.786+0000 7fe868a00640 1 -- 172.21.15.8:0/3683250034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f3412c0 msgr2=0x55a98f34ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.786+0000 7fe868a00640 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f3412c0 0x55a98f34ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.786+0000 7fe868a00640 1 -- 172.21.15.8:0/3683250034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33b760 msgr2=0x55a98f3458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.786+0000 7fe868a00640 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33b760 0x55a98f3458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.786+0000 7fe868a00640 1 -- 172.21.15.8:0/3683250034 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c009cb0 con 0x55a98f33c150 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.786+0000 7fe868a00640 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33c150 0x55a98f345e30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe850036040 tx=0x7fe8500048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be1956c6eabdbab5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.786+0000 7fe84aa00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.786+0000 7fe84aa00640 1 -- 172.21.15.8:0/3683250034 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850004040 con 0x55a98f33c150 2024-03-16T20:57:20.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.786+0000 7fe84aa00640 1 -- 172.21.15.8:0/3683250034 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe850046070 con 0x55a98f33c150 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.786+0000 7fe86ea48740 1 -- 172.21.15.8:0/3683250034 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a98f2c7c40 con 0x55a98f33c150 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.787+0000 7fe84aa00640 1 -- 172.21.15.8:0/3683250034 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8500041a0 con 0x55a98f33c150 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.787+0000 7fe86ea48740 10 client.25169 fetch_fsmap learned FSMap version 23 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.787+0000 7fe86ea48740 1 -- 172.21.15.8:0/3683250034 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a98f2a1ec0 con 0x55a98f33c150 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.787+0000 7fe84aa00640 1 -- 172.21.15.8:0/3683250034 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a98f2c7c40 con 0x55a98f33c150 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.787+0000 7fe84aa00640 1 -- 172.21.15.8:0/3683250034 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe850054070 con 0x55a98f33c150 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.787+0000 7fe86ea48740 10 client.25169 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.787+0000 7fe86ea48740 10 client.25169 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.787+0000 7fe86ea48740 20 client.25169 populate_metadata read hostname 'smithi008' 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.787+0000 7fe86ea48740 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a98f351e20 0x55a98f3562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.787+0000 7fe86ea48740 4 client.25169 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.787+0000 7fe86ea48740 1 -- 172.21.15.8:0/3683250034 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a98efa36c0 con 0x55a98f351e20 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.788+0000 7fe869e00640 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a98f351e20 0x55a98f3562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.788+0000 7fe869e00640 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a98f351e20 0x55a98f3562a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57b12c3d82dba2d3 server_cookie=22fa515033f8184d in_seq=0 out_seq=0 2024-03-16T20:57:20.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.788+0000 7fe84aa00640 10 client.25169 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe84aa00640 1 -- 172.21.15.8:0/3683250034 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a98efa36c0 con 0x55a98f351e20 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe84aa00640 10 client.25169 handle_command_reply: tid=0 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 1 client.25169 shutdown 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 1 -- 172.21.15.8:0/3683250034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33c150 msgr2=0x55a98f345e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33c150 0x55a98f345e30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe850036040 tx=0x7fe8500048f0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 1 -- 172.21.15.8:0/3683250034 shutdown_connections 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a98f351e20 0x55a98f3562a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f3412c0 0x55a98f34ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33c150 0x55a98f345e30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe84aa00640 0 client.25169 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 1 --2- 172.21.15.8:0/3683250034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33b760 0x55a98f3458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 1 -- 172.21.15.8:0/3683250034 >> 172.21.15.8:0/3683250034 conn(0x55a98f336cd0 msgr2=0x55a98f335e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 1 -- 172.21.15.8:0/3683250034 shutdown_connections 2024-03-16T20:57:20.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 1 -- 172.21.15.8:0/3683250034 wait complete. 2024-03-16T20:57:20.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.789+0000 7fe86ea48740 20 client.25169 trim_cache size 0 max 16384 2024-03-16T20:57:20.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.808+0000 7fe86ea48740 1 Processor -- start 2024-03-16T20:57:20.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.808+0000 7fe86ea48740 1 -- start start 2024-03-16T20:57:20.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33b760 0x55a98f345c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33c150 0x55a98f34ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f3412c0 0x55a98f335580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe86ea48740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98f34fd60 con 0x55a98f33c150 2024-03-16T20:57:20.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe86ea48740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98efa36c0 con 0x55a98f33b760 2024-03-16T20:57:20.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe86ea48740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98f2c7c40 con 0x55a98f3412c0 2024-03-16T20:57:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe869e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33b760 0x55a98f345c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe868a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33c150 0x55a98f34ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe869e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33b760 0x55a98f345c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:56558/0 (socket says 172.21.15.8:56558) 2024-03-16T20:57:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe869e00640 1 -- 172.21.15.8:0/2859067938 learned_addr learned my addr 172.21.15.8:0/2859067938 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe869e00640 1 --2- 172.21.15.8:0/2859067938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f3412c0 0x55a98f335580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe868a00640 1 -- 172.21.15.8:0/2859067938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f3412c0 msgr2=0x55a98f335580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe868a00640 1 --2- 172.21.15.8:0/2859067938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f3412c0 0x55a98f335580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe868a00640 1 -- 172.21.15.8:0/2859067938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33b760 msgr2=0x55a98f345c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe868a00640 1 --2- 172.21.15.8:0/2859067938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33b760 0x55a98f345c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe868a00640 1 -- 172.21.15.8:0/2859067938 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a98f23e8b0 con 0x55a98f33c150 2024-03-16T20:57:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.809+0000 7fe869e00640 1 --2- 172.21.15.8:0/2859067938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33b760 0x55a98f345c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.810+0000 7fe868a00640 1 --2- 172.21.15.8:0/2859067938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33c150 0x55a98f34ce30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe850009900 tx=0x7fe850005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1665ad6882f63b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.810+0000 7fe855c00640 1 -- 172.21.15.8:0/2859067938 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850003ad0 con 0x55a98f33c150 2024-03-16T20:57:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.810+0000 7fe855c00640 1 -- 172.21.15.8:0/2859067938 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe850051070 con 0x55a98f33c150 2024-03-16T20:57:20.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.810+0000 7fe855c00640 1 -- 172.21.15.8:0/2859067938 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850005420 con 0x55a98f33c150 2024-03-16T20:57:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.811+0000 7fe86ea48740 1 -- 172.21.15.8:0/2859067938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33c150 msgr2=0x55a98f34ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.811+0000 7fe86ea48740 1 --2- 172.21.15.8:0/2859067938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33c150 0x55a98f34ce30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe850009900 tx=0x7fe850005e80 comp rx=0 tx=0).stop 2024-03-16T20:57:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.811+0000 7fe86ea48740 1 -- 172.21.15.8:0/2859067938 shutdown_connections 2024-03-16T20:57:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.811+0000 7fe86ea48740 1 --2- 172.21.15.8:0/2859067938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f3412c0 0x55a98f335580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.811+0000 7fe86ea48740 1 --2- 172.21.15.8:0/2859067938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33c150 0x55a98f34ce30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.811+0000 7fe86ea48740 1 --2- 172.21.15.8:0/2859067938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f33b760 0x55a98f345c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.811+0000 7fe86ea48740 1 -- 172.21.15.8:0/2859067938 >> 172.21.15.8:0/2859067938 conn(0x55a98f336cd0 msgr2=0x55a98f345500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.811+0000 7fe86ea48740 1 -- 172.21.15.8:0/2859067938 shutdown_connections 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.811+0000 7fe86ea48740 1 -- 172.21.15.8:0/2859067938 wait complete. 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.811+0000 7fe86ea48740 1 -- start start 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.811+0000 7fe86ea48740 1 Processor -- start 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33b760 0x55a98f34cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33c150 0x55a98f349810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe86ea48740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f3412c0 0x55a98f349d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe86ea48740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98f34a360 con 0x55a98f33b760 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe86ea48740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98f3ad3c0 con 0x55a98f3412c0 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe86ea48740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98f3ad500 con 0x55a98f33c150 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe86ea48740 10 client.0 _ll_register_callbacks cb 0x7fe85002cd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe868a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33c150 0x55a98f349810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe869e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33b760 0x55a98f34cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe868a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33c150 0x55a98f349810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55638/0 (socket says 172.21.15.8:55638) 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe868a00640 1 -- 172.21.15.8:0/2583773556 learned_addr learned my addr 172.21.15.8:0/2583773556 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe869e00640 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f3412c0 0x55a98f349d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe868a00640 1 -- 172.21.15.8:0/2583773556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f3412c0 msgr2=0x55a98f349d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe868a00640 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f3412c0 0x55a98f349d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe868a00640 1 -- 172.21.15.8:0/2583773556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33b760 msgr2=0x55a98f34cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe868a00640 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33b760 0x55a98f34cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe868a00640 1 -- 172.21.15.8:0/2583773556 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c022040 con 0x55a98f33c150 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.812+0000 7fe869e00640 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f3412c0 0x55a98f349d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.813+0000 7fe868a00640 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33c150 0x55a98f349810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe850004c70 tx=0x7fe85002bc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11d2f84e1c0c047b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.813+0000 7fe84aa00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.813+0000 7fe84aa00640 1 -- 172.21.15.8:0/2583773556 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850005530 con 0x55a98f33c150 2024-03-16T20:57:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.813+0000 7fe86ea48740 1 -- 172.21.15.8:0/2583773556 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe85c015070 con 0x55a98f33c150 2024-03-16T20:57:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.813+0000 7fe84aa00640 1 -- 172.21.15.8:0/2583773556 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe850046040 con 0x55a98f33c150 2024-03-16T20:57:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.813+0000 7fe84aa00640 1 -- 172.21.15.8:0/2583773556 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe850005690 con 0x55a98f33c150 2024-03-16T20:57:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.813+0000 7fe86ea48740 10 client.25177 fetch_fsmap learned FSMap version 23 2024-03-16T20:57:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.813+0000 7fe86ea48740 1 -- 172.21.15.8:0/2583773556 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a98f2a1ec0 con 0x55a98f33c150 2024-03-16T20:57:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.814+0000 7fe84aa00640 1 -- 172.21.15.8:0/2583773556 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe85c015070 con 0x55a98f33c150 2024-03-16T20:57:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.814+0000 7fe84aa00640 1 -- 172.21.15.8:0/2583773556 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe850054040 con 0x55a98f33c150 2024-03-16T20:57:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.814+0000 7fe86ea48740 10 client.25177 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:57:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.814+0000 7fe86ea48740 10 client.25177 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-16T20:57:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.814+0000 7fe86ea48740 20 client.25177 populate_metadata read hostname 'smithi008' 2024-03-16T20:57:20.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.814+0000 7fe86ea48740 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a98f3b2280 0x55a98f3ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.814+0000 7fe86ea48740 4 client.25177 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T20:57:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.814+0000 7fe86ea48740 1 -- 172.21.15.8:0/2583773556 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a98eff4270 con 0x55a98f3b2280 2024-03-16T20:57:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.814+0000 7fe869e00640 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a98f3b2280 0x55a98f3ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.814+0000 7fe869e00640 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a98f3b2280 0x55a98f3ae750 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6715800f4cc06351 server_cookie=f02647ba81c8f3e1 in_seq=0 out_seq=0 2024-03-16T20:57:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.814+0000 7fe84aa00640 10 client.25177 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:57:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe84aa00640 1 -- 172.21.15.8:0/2583773556 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a98eff4270 con 0x55a98f3b2280 2024-03-16T20:57:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe84aa00640 10 client.25177 handle_command_reply: tid=0 2024-03-16T20:57:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 1 client.25177 shutdown 2024-03-16T20:57:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 1 -- 172.21.15.8:0/2583773556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33c150 msgr2=0x55a98f349810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33c150 0x55a98f349810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe850004c70 tx=0x7fe85002bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 1 -- 172.21.15.8:0/2583773556 shutdown_connections 2024-03-16T20:57:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a98f3b2280 0x55a98f3ae750 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a98f3412c0 0x55a98f349d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a98f33c150 0x55a98f349810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 1 --2- 172.21.15.8:0/2583773556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a98f33b760 0x55a98f34cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 1 -- 172.21.15.8:0/2583773556 >> 172.21.15.8:0/2583773556 conn(0x55a98f336cd0 msgr2=0x55a98f335580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe84aa00640 0 client.25177 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:57:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 1 -- 172.21.15.8:0/2583773556 shutdown_connections 2024-03-16T20:57:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 1 -- 172.21.15.8:0/2583773556 wait complete. 2024-03-16T20:57:20.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.815+0000 7fe86ea48740 20 client.25177 trim_cache size 0 max 16384 2024-03-16T20:57:20.825 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "05d64692-e3d6-11ee-95c9-87774f69a715", 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 1, 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24544, 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 132.481474765, 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 153.99625622900001 2024-03-16T20:57:20.826 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:57:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 -- 172.21.15.8:0/1126692179 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe84c0a1ab0 msgr2=0x7fe84c0a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe84c0a1ab0 0x7fe84c0a3f70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe85809a7a0 tx=0x7fe8580d3530 comp rx=0 tx=0).stop 2024-03-16T20:57:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 -- 172.21.15.8:0/1126692179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe864073f50 msgr2=0x7fe86419db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe864073f50 0x7fe86419db20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe85800ea60 tx=0x7fe85800ef20 comp rx=0 tx=0).stop 2024-03-16T20:57:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 -- 172.21.15.8:0/1126692179 shutdown_connections 2024-03-16T20:57:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe84c0a1ab0 0x7fe84c0a3f70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86410d9a0 0x7fe8641a50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe864075530 0x7fe86419e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 --2- 172.21.15.8:0/1126692179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe864073f50 0x7fe86419db20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 -- 172.21.15.8:0/1126692179 >> 172.21.15.8:0/1126692179 conn(0x7fe8640fc960 msgr2=0x7fe864100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 -- 172.21.15.8:0/1126692179 shutdown_connections 2024-03-16T20:57:20.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:20.816+0000 7fe86a800640 1 -- 172.21.15.8:0/1126692179 wait complete. 2024-03-16T20:57:20.840 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-16T20:57:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.053+0000 7f8615c00640 1 -- 172.21.15.8:0/3353758198 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8610102f80 msgr2=0x7f8610109810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.053+0000 7f8615c00640 1 --2- 172.21.15.8:0/3353758198 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8610102f80 0x7f8610109810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8608009ca0 tx=0x7f860802c0f0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.053+0000 7f8615c00640 1 -- 172.21.15.8:0/3353758198 shutdown_connections 2024-03-16T20:57:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.053+0000 7f8615c00640 1 --2- 172.21.15.8:0/3353758198 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8610102f80 0x7f8610109810 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.053+0000 7f8615c00640 1 --2- 172.21.15.8:0/3353758198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86101025c0 0x7f8610102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.053+0000 7f8615c00640 1 --2- 172.21.15.8:0/3353758198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86101013d0 0x7f86101017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.053+0000 7f8615c00640 1 -- 172.21.15.8:0/3353758198 >> 172.21.15.8:0/3353758198 conn(0x7f86100fc960 msgr2=0x7f86100fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.054+0000 7f8615c00640 1 -- 172.21.15.8:0/3353758198 shutdown_connections 2024-03-16T20:57:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.054+0000 7f8615c00640 1 -- 172.21.15.8:0/3353758198 wait complete. 2024-03-16T20:57:21.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.054+0000 7f8615c00640 1 Processor -- start 2024-03-16T20:57:21.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f8615c00640 1 -- start start 2024-03-16T20:57:21.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f8615c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86101013d0 0x7f86101996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f8615c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86101025c0 0x7f8610199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f8615c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8610102f80 0x7f86101a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f8615c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86101a11e0 con 0x7f8610102f80 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f8615c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86101a1350 con 0x7f86101025c0 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f8615c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86101a1510 con 0x7f86101013d0 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f860fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86101013d0 0x7f86101996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f8615200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8610102f80 0x7f86101a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f860fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86101013d0 0x7f86101996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55666/0 (socket says 172.21.15.8:55666) 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f860fe00640 1 -- 172.21.15.8:0/446613945 learned_addr learned my addr 172.21.15.8:0/446613945 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.055+0000 7f860f400640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86101025c0 0x7f8610199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.056+0000 7f860fe00640 1 -- 172.21.15.8:0/446613945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86101025c0 msgr2=0x7f8610199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.056+0000 7f860fe00640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86101025c0 0x7f8610199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.056+0000 7f860fe00640 1 -- 172.21.15.8:0/446613945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8610102f80 msgr2=0x7f86101a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.056+0000 7f860fe00640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8610102f80 0x7f86101a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.056+0000 7f860fe00640 1 -- 172.21.15.8:0/446613945 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc009490 con 0x7f86101013d0 2024-03-16T20:57:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.056+0000 7f860fe00640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86101013d0 0x7f86101996f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f860000e9c0 tx=0x7f860000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.056+0000 7f860cc00640 1 -- 172.21.15.8:0/446613945 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600009700 con 0x7f86101013d0 2024-03-16T20:57:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.056+0000 7f860cc00640 1 -- 172.21.15.8:0/446613945 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f860000cd80 con 0x7f86101013d0 2024-03-16T20:57:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.056+0000 7f860cc00640 1 -- 172.21.15.8:0/446613945 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600010690 con 0x7f86101013d0 2024-03-16T20:57:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.056+0000 7f8615c00640 1 -- 172.21.15.8:0/446613945 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8608009900 con 0x7f86101013d0 2024-03-16T20:57:21.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.056+0000 7f8615c00640 1 -- 172.21.15.8:0/446613945 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86101a1b20 con 0x7f86101013d0 2024-03-16T20:57:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f8619fa1740 1 Processor -- start 2024-03-16T20:57:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f8619fa1740 1 -- start start 2024-03-16T20:57:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f860cc00640 1 -- 172.21.15.8:0/446613945 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f8600003710 con 0x7f86101013d0 2024-03-16T20:57:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8df760 0x55b3ef8dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8e7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f8619fa1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef84eb30 con 0x55b3ef8df760 2024-03-16T20:57:21.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f8619fa1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef84c060 con 0x55b3ef8e0150 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f8619fa1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef847840 con 0x55b3ef8e52c0 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f860fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f8615200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8df760 0x55b3ef8dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f860f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.061+0000 7f860fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:56594/0 (socket says 172.21.15.8:56594) 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.062+0000 7f860fe00640 1 -- 172.21.15.8:0/1931711811 learned_addr learned my addr 172.21.15.8:0/1931711811 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.062+0000 7f860fe00640 1 -- 172.21.15.8:0/1931711811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 msgr2=0x55b3ef8e7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.062+0000 7f860fe00640 1 --2- 172.21.15.8:0/1931711811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8e7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.062+0000 7f860fe00640 1 -- 172.21.15.8:0/1931711811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8df760 msgr2=0x55b3ef8dfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.062+0000 7f860fe00640 1 --2- 172.21.15.8:0/1931711811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8df760 0x55b3ef8dfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.062+0000 7f860fe00640 1 -- 172.21.15.8:0/1931711811 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3ef80f4c0 con 0x55b3ef8e0150 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.062+0000 7f860f400640 1 --2- 172.21.15.8:0/1931711811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:21.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.062+0000 7f860fe00640 1 --2- 172.21.15.8:0/1931711811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e4c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f86000d35c0 tx=0x7f86000d3a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69bf8f0f1795bc0d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.062+0000 7f8605600640 1 -- 172.21.15.8:0/1931711811 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000cdea0 con 0x55b3ef8e0150 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f8605600640 1 -- 172.21.15.8:0/1931711811 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f86000cf570 con 0x55b3ef8e0150 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f8605600640 1 -- 172.21.15.8:0/1931711811 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000dbcd0 con 0x55b3ef8e0150 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f860cc00640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f85f40a1a30 0x7f85f40a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f860cc00640 1 -- 172.21.15.8:0/446613945 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8600014070 con 0x7f86101013d0 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f8615200640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f85f40a1a30 0x7f85f40a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f8619fa1740 1 -- 172.21.15.8:0/1931711811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 msgr2=0x55b3ef8e4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f8619fa1740 1 --2- 172.21.15.8:0/1931711811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e4c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f86000d35c0 tx=0x7f86000d3a80 comp rx=0 tx=0).stop 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f8619fa1740 1 -- 172.21.15.8:0/1931711811 shutdown_connections 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f8619fa1740 1 --2- 172.21.15.8:0/1931711811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f8619fa1740 1 --2- 172.21.15.8:0/1931711811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e4c50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f8619fa1740 1 --2- 172.21.15.8:0/1931711811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8df760 0x55b3ef8dfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.063+0000 7f8619fa1740 1 -- 172.21.15.8:0/1931711811 >> 172.21.15.8:0/1931711811 conn(0x55b3ef8dacd0 msgr2=0x55b3ef8db0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.064+0000 7f8619fa1740 1 -- 172.21.15.8:0/1931711811 shutdown_connections 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.064+0000 7f8619fa1740 1 -- 172.21.15.8:0/1931711811 wait complete. 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.064+0000 7f8615200640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f85f40a1a30 0x7f85f40a3ef0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f860802c630 tx=0x7f86080327b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.064+0000 7f8619fa1740 1 -- start start 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.064+0000 7f8619fa1740 1 Processor -- start 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8df760 0x55b3ef8e9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f8619fa1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef7ecea0 con 0x55b3ef8df760 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f8619fa1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef7ecb40 con 0x55b3ef8e52c0 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f8619fa1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef58ff20 con 0x55b3ef8e0150 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f8619fa1740 10 client.0 _ll_register_callbacks cb 0x55b3ef800950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:57:21.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f860f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f860f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55682/0 (socket says 172.21.15.8:55682) 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f8615200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f860f400640 1 -- 172.21.15.8:0/3640534515 learned_addr learned my addr 172.21.15.8:0/3640534515 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f860fe00640 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8df760 0x55b3ef8e9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f860f400640 1 -- 172.21.15.8:0/3640534515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e52c0 msgr2=0x55b3ef8f0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f860f400640 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8f0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f860f400640 1 -- 172.21.15.8:0/3640534515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8df760 msgr2=0x55b3ef8e9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f860f400640 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8df760 0x55b3ef8e9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.065+0000 7f860f400640 1 -- 172.21.15.8:0/3640534515 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86101a1b20 con 0x55b3ef8e0150 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.066+0000 7f860f400640 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e9f40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0128b0 tx=0x7f85fc012d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f16441d094ac8183 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.066+0000 7f85fa000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:57:21.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.066+0000 7f85fa000640 1 -- 172.21.15.8:0/3640534515 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc017070 con 0x55b3ef8e0150 2024-03-16T20:57:21.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.066+0000 7f85fa000640 1 -- 172.21.15.8:0/3640534515 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f85fc004050 con 0x55b3ef8e0150 2024-03-16T20:57:21.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.066+0000 7f8619fa1740 1 -- 172.21.15.8:0/3640534515 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b3ef86bc40 con 0x55b3ef8e0150 2024-03-16T20:57:21.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.066+0000 7f85fa000640 1 -- 172.21.15.8:0/3640534515 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85fc022030 con 0x55b3ef8e0150 2024-03-16T20:57:21.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.066+0000 7f8619fa1740 10 client.25189 fetch_fsmap learned FSMap version 23 2024-03-16T20:57:21.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.066+0000 7f8619fa1740 1 -- 172.21.15.8:0/3640534515 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55b3ef845ec0 con 0x55b3ef8e0150 2024-03-16T20:57:21.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.067+0000 7f85fa000640 1 -- 172.21.15.8:0/3640534515 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55b3ef86bc40 con 0x55b3ef8e0150 2024-03-16T20:57:21.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.067+0000 7f85fa000640 1 -- 172.21.15.8:0/3640534515 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f85fc0039c0 con 0x55b3ef8e0150 2024-03-16T20:57:21.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.067+0000 7f8619fa1740 10 client.25189 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:57:21.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.067+0000 7f8619fa1740 10 client.25189 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-16T20:57:21.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.067+0000 7f8619fa1740 20 client.25189 populate_metadata read hostname 'smithi008' 2024-03-16T20:57:21.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.067+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b3ef8f59b0 0x55b3ef8f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.067+0000 7f8619fa1740 4 client.25189 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:57:21.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.067+0000 7f8619fa1740 1 -- 172.21.15.8:0/3640534515 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b3ef5476c0 con 0x55b3ef8f59b0 2024-03-16T20:57:21.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.067+0000 7f860fe00640 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b3ef8f59b0 0x55b3ef8f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.068+0000 7f860fe00640 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b3ef8f59b0 0x55b3ef8f52b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=990d3dad84660530 server_cookie=8216373278ad1d14 in_seq=0 out_seq=0 2024-03-16T20:57:21.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.068+0000 7f85fa000640 10 client.25189 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:21.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.068+0000 7f85fa000640 1 -- 172.21.15.8:0/3640534515 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55b3ef5476c0 con 0x55b3ef8f59b0 2024-03-16T20:57:21.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.068+0000 7f85fa000640 10 client.25189 handle_command_reply: tid=0 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.068+0000 7f8619fa1740 1 client.25189 shutdown 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f8619fa1740 1 -- 172.21.15.8:0/3640534515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e0150 msgr2=0x55b3ef8e9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e9f40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0128b0 tx=0x7f85fc012d70 comp rx=0 tx=0).stop 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f8619fa1740 1 -- 172.21.15.8:0/3640534515 shutdown_connections 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e0150 0x55b3ef8e9f40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b3ef8f59b0 0x55b3ef8f52b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3640534515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8df760 0x55b3ef8e9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f8619fa1740 1 -- 172.21.15.8:0/3640534515 >> 172.21.15.8:0/3640534515 conn(0x55b3ef8dacd0 msgr2=0x55b3ef8d9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f85fa000640 0 client.25189 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f8619fa1740 1 -- 172.21.15.8:0/3640534515 shutdown_connections 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f8619fa1740 1 -- 172.21.15.8:0/3640534515 wait complete. 2024-03-16T20:57:21.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.069+0000 7f8619fa1740 20 client.25189 trim_cache size 0 max 16384 2024-03-16T20:57:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.087+0000 7f8619fa1740 1 Processor -- start 2024-03-16T20:57:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.087+0000 7f8619fa1740 1 -- start start 2024-03-16T20:57:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8df760 0x55b3ef8e9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 0x55b3ef8f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f8619fa1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef5476c0 con 0x55b3ef8e52c0 2024-03-16T20:57:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f8619fa1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef86bc40 con 0x55b3ef8e0150 2024-03-16T20:57:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f8619fa1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef8f1a00 con 0x55b3ef8df760 2024-03-16T20:57:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f860fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8df760 0x55b3ef8e9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f860fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8df760 0x55b3ef8e9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55692/0 (socket says 172.21.15.8:55692) 2024-03-16T20:57:21.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f860fe00640 1 -- 172.21.15.8:0/3987996285 learned_addr learned my addr 172.21.15.8:0/3987996285 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:21.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f860f400640 1 --2- 172.21.15.8:0/3987996285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 0x55b3ef8f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f8615200640 1 --2- 172.21.15.8:0/3987996285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f860fe00640 1 -- 172.21.15.8:0/3987996285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 msgr2=0x55b3ef8f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:21.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f860fe00640 1 --2- 172.21.15.8:0/3987996285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 0x55b3ef8f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f860fe00640 1 -- 172.21.15.8:0/3987996285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e52c0 msgr2=0x55b3ef8e9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:21.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f860fe00640 1 --2- 172.21.15.8:0/3987996285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8e9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f860fe00640 1 -- 172.21.15.8:0/3987996285 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3ef7e28b0 con 0x55b3ef8df760 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f860f400640 1 --2- 172.21.15.8:0/3987996285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 0x55b3ef8f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.088+0000 7f8615200640 1 --2- 172.21.15.8:0/3987996285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8e9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.089+0000 7f860fe00640 1 --2- 172.21.15.8:0/3987996285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8df760 0x55b3ef8e9610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f860009a460 tx=0x7f86000d0f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=488a03fd17f0ef23 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.089+0000 7f8604c00640 1 -- 172.21.15.8:0/3987996285 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000d0bd0 con 0x55b3ef8df760 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.089+0000 7f8604c00640 1 -- 172.21.15.8:0/3987996285 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f86000db400 con 0x55b3ef8df760 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.089+0000 7f8604c00640 1 -- 172.21.15.8:0/3987996285 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860009a0c0 con 0x55b3ef8df760 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.089+0000 7f8619fa1740 1 -- 172.21.15.8:0/3987996285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8df760 msgr2=0x55b3ef8e9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.089+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3987996285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8df760 0x55b3ef8e9610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f860009a460 tx=0x7f86000d0f90 comp rx=0 tx=0).stop 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.090+0000 7f8619fa1740 1 -- 172.21.15.8:0/3987996285 shutdown_connections 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.090+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3987996285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8e9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.090+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3987996285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8e0150 0x55b3ef8f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.090+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3987996285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8df760 0x55b3ef8e9610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.090+0000 7f8619fa1740 1 -- 172.21.15.8:0/3987996285 >> 172.21.15.8:0/3987996285 conn(0x55b3ef8dacd0 msgr2=0x55b3ef8db0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.090+0000 7f8619fa1740 1 -- 172.21.15.8:0/3987996285 shutdown_connections 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.090+0000 7f8619fa1740 1 -- 172.21.15.8:0/3987996285 wait complete. 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.090+0000 7f8619fa1740 1 -- start start 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.090+0000 7f8619fa1740 1 Processor -- start 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8df760 0x55b3ef8ece90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e0150 0x55b3ef8ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8619fa1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8619fa1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef8f0930 con 0x55b3ef8e0150 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8619fa1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef8f0aa0 con 0x55b3ef8df760 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8619fa1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ef8f0c60 con 0x55b3ef8e52c0 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8619fa1740 10 client.0 _ll_register_callbacks cb 0x7f85fc0124c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f860f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e0150 0x55b3ef8ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f860f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e0150 0x55b3ef8ed3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43010/0 (socket says 172.21.15.8:43010) 2024-03-16T20:57:21.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8615200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f860f400640 1 -- 172.21.15.8:0/3855115358 learned_addr learned my addr 172.21.15.8:0/3855115358 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f860fe00640 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8df760 0x55b3ef8ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8615200640 1 -- 172.21.15.8:0/3855115358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8df760 msgr2=0x55b3ef8ece90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8615200640 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8df760 0x55b3ef8ece90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8615200640 1 -- 172.21.15.8:0/3855115358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e0150 msgr2=0x55b3ef8ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8615200640 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e0150 0x55b3ef8ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f8615200640 1 -- 172.21.15.8:0/3855115358 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3ef80f4c0 con 0x55b3ef8e52c0 2024-03-16T20:57:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.091+0000 7f860f400640 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e0150 0x55b3ef8ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:21.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.092+0000 7f8615200640 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8f03f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8608037040 tx=0x7f86080095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=667da65bec74dbf8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:21.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.092+0000 7f85fa000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:57:21.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.092+0000 7f85fa000640 1 -- 172.21.15.8:0/3855115358 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608056640 con 0x55b3ef8e52c0 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.092+0000 7f85fa000640 1 -- 172.21.15.8:0/3855115358 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f860804c420 con 0x55b3ef8e52c0 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.092+0000 7f8619fa1740 1 -- 172.21.15.8:0/3855115358 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b3ef8f69c0 con 0x55b3ef8e52c0 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.092+0000 7f85fa000640 1 -- 172.21.15.8:0/3855115358 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86080567a0 con 0x55b3ef8e52c0 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.092+0000 7f8619fa1740 10 client.25195 fetch_fsmap learned FSMap version 23 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.092+0000 7f8619fa1740 1 -- 172.21.15.8:0/3855115358 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55b3ef808510 con 0x55b3ef8e52c0 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.092+0000 7f85fa000640 1 -- 172.21.15.8:0/3855115358 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55b3ef8f69c0 con 0x55b3ef8e52c0 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.093+0000 7f85fa000640 1 -- 172.21.15.8:0/3855115358 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f8608048050 con 0x55b3ef8e52c0 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.093+0000 7f8619fa1740 10 client.25195 fetch_fsmap finished waiting for FSMap version 23 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.093+0000 7f8619fa1740 10 client.25195 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.093+0000 7f8619fa1740 20 client.25195 populate_metadata read hostname 'smithi008' 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.093+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b3ef95e350 0x55b3ef95a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.093+0000 7f8619fa1740 4 client.25195 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.093+0000 7f8619fa1740 1 -- 172.21.15.8:0/3855115358 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f86000cf570 con 0x55b3ef95e350 2024-03-16T20:57:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.093+0000 7f860fe00640 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b3ef95e350 0x55b3ef95a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.093+0000 7f85fa000640 10 client.25195 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.093+0000 7f860fe00640 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b3ef95e350 0x55b3ef95a7d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf165886abc57d39 server_cookie=4bd2699a16dda8e3 in_seq=0 out_seq=0 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f85fa000640 1 -- 172.21.15.8:0/3855115358 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x7f86000cf570 con 0x55b3ef95e350 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f85fa000640 10 client.25195 handle_command_reply: tid=0 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 1 client.25195 shutdown 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 1 -- 172.21.15.8:0/3855115358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 msgr2=0x55b3ef8f03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8f03f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8608037040 tx=0x7f86080095c0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 1 -- 172.21.15.8:0/3855115358 shutdown_connections 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3ef8e52c0 0x55b3ef8f03f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b3ef95e350 0x55b3ef95a7d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b3ef8e0150 0x55b3ef8ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 1 --2- 172.21.15.8:0/3855115358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3ef8df760 0x55b3ef8ece90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 1 -- 172.21.15.8:0/3855115358 >> 172.21.15.8:0/3855115358 conn(0x55b3ef8dacd0 msgr2=0x55b3ef8d9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:21.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f85fa000640 0 client.25195 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:21.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 1 -- 172.21.15.8:0/3855115358 shutdown_connections 2024-03-16T20:57:21.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 1 -- 172.21.15.8:0/3855115358 wait complete. 2024-03-16T20:57:21.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.094+0000 7f8619fa1740 20 client.25195 trim_cache size 0 max 16384 2024-03-16T20:57:21.104 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:57:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "05d64692-e3d6-11ee-95c9-87774f69a715", 2024-03-16T20:57:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2024-03-16T20:57:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24593, 2024-03-16T20:57:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-03-16T20:57:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-03-16T20:57:21.104 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-03-16T20:57:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 135.80220490100001, 2024-03-16T20:57:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2024-03-16T20:57:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2024-03-16T20:57:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2024-03-16T20:57:21.105 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 143.22905160900001 2024-03-16T20:57:21.105 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 -- 172.21.15.8:0/446613945 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f85f40a1a30 msgr2=0x7f85f40a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f85f40a1a30 0x7f85f40a3ef0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f860802c630 tx=0x7f86080327b0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 -- 172.21.15.8:0/446613945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86101013d0 msgr2=0x7f86101996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86101013d0 0x7f86101996f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f860000e9c0 tx=0x7f860000ee80 comp rx=0 tx=0).stop 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 -- 172.21.15.8:0/446613945 shutdown_connections 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f85f40a1a30 0x7f85f40a3ef0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8610102f80 0x7f86101a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86101025c0 0x7f8610199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 --2- 172.21.15.8:0/446613945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86101013d0 0x7f86101996f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 -- 172.21.15.8:0/446613945 >> 172.21.15.8:0/446613945 conn(0x7f86100fc960 msgr2=0x7f8610073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 -- 172.21.15.8:0/446613945 shutdown_connections 2024-03-16T20:57:21.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:21.095+0000 7f8615c00640 1 -- 172.21.15.8:0/446613945 wait complete. 2024-03-16T20:57:21.114 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:20 smithi008 ceph-mon[31434]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:57:21.115 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:20 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3074065529' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:21.117 INFO:teuthology.run_tasks:Running task kclient... 2024-03-16T20:57:21.140 INFO:tasks.kclient:Mounting kernel clients... 2024-03-16T20:57:21.140 INFO:tasks.kclient:config is {'client.0': {}} 2024-03-16T20:57:21.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:21.140 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-03-16T20:57:21.141 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:20 smithi170 ceph-mon[35947]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:57:21.141 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:20 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3074065529' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:21.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:20 smithi186 ceph-mon[36391]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-16T20:57:21.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:20 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3074065529' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:21.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:21.198 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2024-03-16T20:57:21.308 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2024-03-16T20:57:21.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T20:57:21.314 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-03-16T20:57:21.314 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-16T20:57:21.314 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T20:57:21.314 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph fs ls 2024-03-16T20:57:21.798 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T20:57:23.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:22 smithi170 ceph-mon[35947]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:23.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:22 smithi186 ceph-mon[36391]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:23.206 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:22 smithi008 ceph-mon[31434]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:24.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.996+0000 7f0231600700 1 -- 172.21.15.8:0/425544008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022c06a630 msgr2=0x7f022c10ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:24.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.996+0000 7f0231600700 1 --2- 172.21.15.8:0/425544008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022c06a630 0x7f022c10ee70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f022400b0a0 tx=0x7f022400b3b0 comp rx=0 tx=0).stop 2024-03-16T20:57:24.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.997+0000 7f0231600700 1 -- 172.21.15.8:0/425544008 shutdown_connections 2024-03-16T20:57:24.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.997+0000 7f0231600700 1 --2- 172.21.15.8:0/425544008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f022c108030 0x7f022c108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:24.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.997+0000 7f0231600700 1 --2- 172.21.15.8:0/425544008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022c06a630 0x7f022c10ee70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:24.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.997+0000 7f0231600700 1 --2- 172.21.15.8:0/425544008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f022c069c90 0x7f022c06a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:24.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.997+0000 7f0231600700 1 -- 172.21.15.8:0/425544008 >> 172.21.15.8:0/425544008 conn(0x7f022c077e10 msgr2=0x7f022c078220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:24.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.997+0000 7f0231600700 1 -- 172.21.15.8:0/425544008 shutdown_connections 2024-03-16T20:57:24.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.997+0000 7f0231600700 1 -- 172.21.15.8:0/425544008 wait complete. 2024-03-16T20:57:24.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.998+0000 7f0231600700 1 Processor -- start 2024-03-16T20:57:24.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.998+0000 7f0231600700 1 -- start start 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f0231600700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f022c069c90 0x7f022c1a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f0231600700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f022c06a630 0x7f022c1a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f0231600700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022c108030 0x7f022c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f0231600700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c19ac20 con 0x7f022c06a630 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f0231600700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c19ad60 con 0x7f022c108030 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f0231600700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c19af20 con 0x7f022c069c90 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f022aa00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f022c069c90 0x7f022c1a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f022aa00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f022c069c90 0x7f022c1a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55728/0 (socket says 172.21.15.8:55728) 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f022aa00700 1 -- 172.21.15.8:0/1014810364 learned_addr learned my addr 172.21.15.8:0/1014810364 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f022b400700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022c108030 0x7f022c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f022a000700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f022c06a630 0x7f022c1a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f022aa00700 1 -- 172.21.15.8:0/1014810364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022c108030 msgr2=0x7f022c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:24.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f022aa00700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022c108030 0x7f022c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f022aa00700 1 -- 172.21.15.8:0/1014810364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f022c06a630 msgr2=0x7f022c1a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f022aa00700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f022c06a630 0x7f022c1a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f022aa00700 1 -- 172.21.15.8:0/1014810364 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0224009d00 con 0x7f022c069c90 2024-03-16T20:57:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:23.999+0000 7f022a000700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f022c06a630 0x7f022c1a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.000+0000 7f022aa00700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f022c069c90 0x7f022c1a0400 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f021c00d950 tx=0x7f021c00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.000+0000 7f0223400700 1 -- 172.21.15.8:0/1014810364 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c009940 con 0x7f022c069c90 2024-03-16T20:57:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.000+0000 7f0231600700 1 -- 172.21.15.8:0/1014810364 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c19b200 con 0x7f022c069c90 2024-03-16T20:57:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.000+0000 7f0223400700 1 -- 172.21.15.8:0/1014810364 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f021c010460 con 0x7f022c069c90 2024-03-16T20:57:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.000+0000 7f0223400700 1 -- 172.21.15.8:0/1014810364 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c00f6b0 con 0x7f022c069c90 2024-03-16T20:57:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.000+0000 7f0231600700 1 -- 172.21.15.8:0/1014810364 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c1a74a0 con 0x7f022c069c90 2024-03-16T20:57:24.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.001+0000 7f0231600700 1 -- 172.21.15.8:0/1014810364 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c068ca0 con 0x7f022c069c90 2024-03-16T20:57:24.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.003+0000 7f0223400700 1 -- 172.21.15.8:0/1014810364 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f021c0105d0 con 0x7f022c069c90 2024-03-16T20:57:24.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.004+0000 7f0223400700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f02100a1b40 0x7f02100a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:24.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.004+0000 7f0223400700 1 -- 172.21.15.8:0/1014810364 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f021c0cd200 con 0x7f022c069c90 2024-03-16T20:57:24.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.005+0000 7f022a000700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f02100a1b40 0x7f02100a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:24.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.005+0000 7f022a000700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f02100a1b40 0x7f02100a4000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f022c102fd0 tx=0x7f0218009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:24.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.013+0000 7f0223400700 1 -- 172.21.15.8:0/1014810364 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f021c0963c0 con 0x7f022c069c90 2024-03-16T20:57:24.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.297+0000 7f0231600700 1 -- 172.21.15.8:0/1014810364 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f022c112140 con 0x7f022c069c90 2024-03-16T20:57:24.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.297+0000 7f0223400700 1 -- 172.21.15.8:0/1014810364 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f021c099a80 con 0x7f022c069c90 2024-03-16T20:57:24.302 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T20:57:24.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 -- 172.21.15.8:0/1014810364 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f02100a1b40 msgr2=0x7f02100a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:24.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f02100a1b40 0x7f02100a4000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f022c102fd0 tx=0x7f0218009260 comp rx=0 tx=0).stop 2024-03-16T20:57:24.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 -- 172.21.15.8:0/1014810364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f022c069c90 msgr2=0x7f022c1a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:24.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f022c069c90 0x7f022c1a0400 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f021c00d950 tx=0x7f021c00dc60 comp rx=0 tx=0).stop 2024-03-16T20:57:24.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 -- 172.21.15.8:0/1014810364 shutdown_connections 2024-03-16T20:57:24.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f02100a1b40 0x7f02100a4000 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:24.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022c108030 0x7f022c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:24.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f022c069c90 0x7f022c1a0400 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:24.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 --2- 172.21.15.8:0/1014810364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f022c06a630 0x7f022c1a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:24.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 -- 172.21.15.8:0/1014810364 >> 172.21.15.8:0/1014810364 conn(0x7f022c077e10 msgr2=0x7f022c0ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:24.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 -- 172.21.15.8:0/1014810364 shutdown_connections 2024-03-16T20:57:24.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:24.300+0000 7f0231600700 1 -- 172.21.15.8:0/1014810364 wait complete. 2024-03-16T20:57:24.977 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:24 smithi008 ceph-mon[31434]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:57:24.977 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:24 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1014810364' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-16T20:57:25.046 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T20:57:25.047 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T20:57:25.047 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2024-03-16T20:57:25.047 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T20:57:25.047 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T20:57:25.047 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T20:57:25.047 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T20:57:25.047 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T20:57:25.047 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T20:57:25.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:25.047 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2024-03-16T20:57:25.100 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T20:57:25.100 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T20:57:25.100 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T20:57:25.101 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 41940sec preferred_lft 41940sec 2024-03-16T20:57:25.102 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link noprefixroute 2024-03-16T20:57:25.102 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-03-16T20:57:25.102 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T20:57:25.102 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2024-03-16T20:57:25.102 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2024-03-16T20:57:25.103 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-16T20:57:25.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:25.103 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-03-16T20:57:25.103 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-03-16T20:57:25.103 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2024-03-16T20:57:25.104 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2024-03-16T20:57:25.104 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2024-03-16T20:57:25.104 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-16T20:57:25.104 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-03-16T20:57:25.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:24 smithi170 ceph-mon[35947]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:57:25.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:24 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1014810364' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-16T20:57:25.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:24 smithi186 ceph-mon[36391]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T20:57:25.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:24 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1014810364' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-16T20:57:25.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:25.571 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T20:57:25.648 INFO:teuthology.orchestra.run.smithi008.stdout:1 2024-03-16T20:57:25.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:25.651 DEBUG:teuthology.orchestra.run.smithi008:> route 2024-03-16T20:57:25.706 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2024-03-16T20:57:25.706 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T20:57:25.706 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T20:57:25.706 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T20:57:25.706 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T20:57:25.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:25.707 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-03-16T20:57:25.707 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-03-16T20:57:25.707 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T20:57:25.707 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T20:57:25.707 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T20:57:25.707 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-03-16T20:57:26.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:26.417 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-03-16T20:57:26.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:26.476 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2024-03-16T20:57:26.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:26.532 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-03-16T20:57:26.532 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-03-16T20:57:26.532 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T20:57:26.532 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-16T20:57:26.532 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-03-16T20:57:26.686 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-16T20:57:26.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:26.686 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-03-16T20:57:26.686 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-03-16T20:57:26.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-16T20:57:26.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-16T20:57:26.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-16T20:57:26.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-16T20:57:26.687 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-16T20:57:26.687 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-03-16T20:57:26.925 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:26 smithi008 ceph-mon[31434]: pgmap v389: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:57:26.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:26.979 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-03-16T20:57:26.979 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-03-16T20:57:26.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2024-03-16T20:57:26.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2024-03-16T20:57:26.979 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-03-16T20:57:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:26 smithi170 ceph-mon[35947]: pgmap v389: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:57:27.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:26 smithi186 ceph-mon[36391]: pgmap v389: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T20:57:27.151 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T20:57:27.151 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T20:57:27.200 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T20:57:27.201 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T20:57:27.201 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T20:57:27.254 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-03-16T20:57:27.254 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-03-16T20:57:27.254 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/bff7f1a0-a01a-4a4a-8f6c-b8e31af3fad7 2024-03-16T20:57:27.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:27.254 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/bff7f1a0-a01a-4a4a-8f6c-b8e31af3fad7 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-03-16T20:57:27.404 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-03-16T20:57:27.404 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-03-16T20:57:27.404 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-03-16T20:57:28.101 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-03-16T20:57:28.101 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-03-16T20:57:28.101 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-03-16T20:57:28.101 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.170:3300,172.21.15.186:3300" 2024-03-16T20:57:28.101 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:3300,172.21.15.170:3300,172.21.15.186:3300:/volumes/qa/sv_1/bff7f1a0-a01a-4a4a-8f6c-b8e31af3fad7 2024-03-16T20:57:28.101 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=05d64692-e3d6-11ee-95c9-87774f69a715" will pass to kernel 2024-03-16T20:57:28.105 INFO:teuthology.orchestra.run.smithi008.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-16T20:57:28.105 INFO:teuthology.orchestra.run.smithi008.stdout: You just mounted a file system that supports labels which does not 2024-03-16T20:57:28.105 INFO:teuthology.orchestra.run.smithi008.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-16T20:57:28.105 INFO:teuthology.orchestra.run.smithi008.stdout: applications will generate AVC messages and not be allowed access to 2024-03-16T20:57:28.105 INFO:teuthology.orchestra.run.smithi008.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-16T20:57:28.111 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-16T20:57:28.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:28.112 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T20:57:28.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:28.209 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T20:57:28.262 INFO:teuthology.orchestra.run.smithi008.stdout:client15081 2024-03-16T20:57:28.263 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:57:28.263 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T20:57:28.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:28.312 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T20:57:28.416 INFO:teuthology.orchestra.run.smithi008.stdout:client15081 2024-03-16T20:57:28.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:28.416 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T20:57:28.475 INFO:teuthology.orchestra.run.smithi008.stdout:client15081 2024-03-16T20:57:28.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:28.476 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/05d64692-e3d6-11ee-95c9-87774f69a715.client15081/status') 2024-03-16T20:57:28.574 INFO:teuthology.orchestra.run.smithi008.stdout:instance: client.15081 (3)192.168.0.1:0/3980760309 2024-03-16T20:57:28.574 INFO:teuthology.orchestra.run.smithi008.stdout:blocklisted: false 2024-03-16T20:57:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records in 2024-03-16T20:57:28.575 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records out 2024-03-16T20:57:28.575 INFO:teuthology.orchestra.run.smithi008.stderr:70 bytes copied, 8.4413e-05 s, 829 kB/s 2024-03-16T20:57:28.579 INFO:teuthology.run_tasks:Running task exec... 2024-03-16T20:57:28.589 INFO:teuthology.task.exec:Executing custom commands... 2024-03-16T20:57:28.589 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2024-03-16T20:57:28.589 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-03-16T20:57:28.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.810+0000 7efcf0400640 1 -- 172.21.15.8:0/3014373591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce81030d0 msgr2=0x7efce8109960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:28.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.810+0000 7efcf0400640 1 --2- 172.21.15.8:0/3014373591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce81030d0 0x7efce8109960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efce0009ca0 tx=0x7efce002c100 comp rx=0 tx=0).stop 2024-03-16T20:57:28.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.811+0000 7efcf0400640 1 -- 172.21.15.8:0/3014373591 shutdown_connections 2024-03-16T20:57:28.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.811+0000 7efcf0400640 1 --2- 172.21.15.8:0/3014373591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce81030d0 0x7efce8109960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:28.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.811+0000 7efcf0400640 1 --2- 172.21.15.8:0/3014373591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce8102710 0x7efce8102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:28.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.811+0000 7efcf0400640 1 --2- 172.21.15.8:0/3014373591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce8101520 0x7efce8101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:28.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.811+0000 7efcf0400640 1 -- 172.21.15.8:0/3014373591 >> 172.21.15.8:0/3014373591 conn(0x7efce80fcab0 msgr2=0x7efce80feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:28.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.811+0000 7efcf0400640 1 -- 172.21.15.8:0/3014373591 shutdown_connections 2024-03-16T20:57:28.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.811+0000 7efcf0400640 1 -- 172.21.15.8:0/3014373591 wait complete. 2024-03-16T20:57:28.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.812+0000 7efcf0400640 1 Processor -- start 2024-03-16T20:57:28.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.812+0000 7efcf0400640 1 -- start start 2024-03-16T20:57:28.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efcf0400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce8101520 0x7efce81996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:28.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efcf0400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce8102710 0x7efce8199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:28.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efcf0400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce81030d0 0x7efce81a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:28.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efcf0400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce81a11e0 con 0x7efce8102710 2024-03-16T20:57:28.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efcf0400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce81a1350 con 0x7efce8101520 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efcf0400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce81a1510 con 0x7efce81030d0 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efceda00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce8101520 0x7efce81996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efceda00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce8101520 0x7efce81996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40612/0 (socket says 172.21.15.8:40612) 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efceda00640 1 -- 172.21.15.8:0/331822864 learned_addr learned my addr 172.21.15.8:0/331822864 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efced000640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce8102710 0x7efce8199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efcee400640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce81030d0 0x7efce81a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efceda00640 1 -- 172.21.15.8:0/331822864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce81030d0 msgr2=0x7efce81a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efceda00640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce81030d0 0x7efce81a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efceda00640 1 -- 172.21.15.8:0/331822864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce8102710 msgr2=0x7efce8199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efceda00640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce8102710 0x7efce8199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.813+0000 7efceda00640 1 -- 172.21.15.8:0/331822864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc009490 con 0x7efce8101520 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.814+0000 7efceda00640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce8101520 0x7efce81996f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00e9c0 tx=0x7efcdc00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:28.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.814+0000 7efce6000640 1 -- 172.21.15.8:0/331822864 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00cd80 con 0x7efce8101520 2024-03-16T20:57:28.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.814+0000 7efcf0400640 1 -- 172.21.15.8:0/331822864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce0009900 con 0x7efce8101520 2024-03-16T20:57:28.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.814+0000 7efce6000640 1 -- 172.21.15.8:0/331822864 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7efcdc010930 con 0x7efce8101520 2024-03-16T20:57:28.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.814+0000 7efce6000640 1 -- 172.21.15.8:0/331822864 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0189e0 con 0x7efce8101520 2024-03-16T20:57:28.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.814+0000 7efcf0400640 1 -- 172.21.15.8:0/331822864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce81a1bc0 con 0x7efce8101520 2024-03-16T20:57:28.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.815+0000 7efcf0400640 1 -- 172.21.15.8:0/331822864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce810d050 con 0x7efce8101520 2024-03-16T20:57:28.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.817+0000 7efce6000640 1 -- 172.21.15.8:0/331822864 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7efcdc010aa0 con 0x7efce8101520 2024-03-16T20:57:28.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.819+0000 7efce6000640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efcd00a1ad0 0x7efcd00a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:28.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.819+0000 7efce6000640 1 -- 172.21.15.8:0/331822864 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efcdc014070 con 0x7efce8101520 2024-03-16T20:57:28.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.819+0000 7efced000640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efcd00a1ad0 0x7efcd00a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:28.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.820+0000 7efced000640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efcd00a1ad0 0x7efcd00a3f90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efce819ac00 tx=0x7efcd400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:28.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:28.826+0000 7efce6000640 1 -- 172.21.15.8:0/331822864 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7efcdc096d00 con 0x7efce8101520 2024-03-16T20:57:29.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.075+0000 7efcf0400640 1 -- 172.21.15.8:0/331822864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) v1 -- 0x7efce810d1e0 con 0x7efce8101520 2024-03-16T20:57:29.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:28 smithi170 ceph-mon[35947]: pgmap v390: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:29.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:28 smithi186 ceph-mon[36391]: pgmap v390: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:29.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:28 smithi008 ceph-mon[31434]: pgmap v390: 97 pgs: 97 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T20:57:29.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.838+0000 7efce6000640 1 -- 172.21.15.8:0/331822864 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v24) v1 ==== 117+0+0 (secure 0 0 0) 0x7efcdc09a3c0 con 0x7efce8101520 2024-03-16T20:57:29.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.842+0000 7efcf0400640 1 -- 172.21.15.8:0/331822864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efcd00a1ad0 msgr2=0x7efcd00a3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:29.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.842+0000 7efcf0400640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efcd00a1ad0 0x7efcd00a3f90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efce819ac00 tx=0x7efcd400a2d0 comp rx=0 tx=0).stop 2024-03-16T20:57:29.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.842+0000 7efcf0400640 1 -- 172.21.15.8:0/331822864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce8101520 msgr2=0x7efce81996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:29.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.842+0000 7efcf0400640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce8101520 0x7efce81996f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00e9c0 tx=0x7efcdc00edc0 comp rx=0 tx=0).stop 2024-03-16T20:57:29.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.842+0000 7efcf0400640 1 -- 172.21.15.8:0/331822864 shutdown_connections 2024-03-16T20:57:29.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.842+0000 7efcf0400640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7efcd00a1ad0 0x7efcd00a3f90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:29.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.843+0000 7efcf0400640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce81030d0 0x7efce81a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:29.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.843+0000 7efcf0400640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce8102710 0x7efce8199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:29.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.843+0000 7efcf0400640 1 --2- 172.21.15.8:0/331822864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce8101520 0x7efce81996f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:29.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.843+0000 7efcf0400640 1 -- 172.21.15.8:0/331822864 >> 172.21.15.8:0/331822864 conn(0x7efce80fcab0 msgr2=0x7efce8073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:29.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.843+0000 7efcf0400640 1 -- 172.21.15.8:0/331822864 shutdown_connections 2024-03-16T20:57:29.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:29.843+0000 7efcf0400640 1 -- 172.21.15.8:0/331822864 wait complete. 2024-03-16T20:57:29.872 INFO:teuthology.run_tasks:Running task check-counter... 2024-03-16T20:57:29.883 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-03-16T20:57:29.937 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:57:30.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:29 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/331822864' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-16T20:57:30.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:29 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-16T20:57:30.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:29 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/331822864' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-16T20:57:30.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:29 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-16T20:57:30.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.165+0000 7f4c79a00640 1 -- 172.21.15.8:0/3100127879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c74100500 msgr2=0x7f4c74100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:30.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.165+0000 7f4c79a00640 1 --2- 172.21.15.8:0/3100127879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c74100500 0x7f4c74100980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009900 tx=0x7f4c5c02bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:30.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.166+0000 7f4c79a00640 1 -- 172.21.15.8:0/3100127879 shutdown_connections 2024-03-16T20:57:30.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.166+0000 7f4c79a00640 1 --2- 172.21.15.8:0/3100127879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c74100ec0 0x7f4c74101740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.166+0000 7f4c79a00640 1 --2- 172.21.15.8:0/3100127879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c74100500 0x7f4c74100980 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.166+0000 7f4c79a00640 1 --2- 172.21.15.8:0/3100127879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c740ff3d0 0x7f4c740ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.166+0000 7f4c79a00640 1 -- 172.21.15.8:0/3100127879 >> 172.21.15.8:0/3100127879 conn(0x7f4c740facf0 msgr2=0x7f4c740fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:30.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.166+0000 7f4c79a00640 1 -- 172.21.15.8:0/3100127879 shutdown_connections 2024-03-16T20:57:30.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.166+0000 7f4c79a00640 1 -- 172.21.15.8:0/3100127879 wait complete. 2024-03-16T20:57:30.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.167+0000 7f4c79a00640 1 Processor -- start 2024-03-16T20:57:30.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.167+0000 7f4c79a00640 1 -- start start 2024-03-16T20:57:30.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.167+0000 7f4c79a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c740ff3d0 0x7f4c741998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:30.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.167+0000 7f4c79a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c74100500 0x7f4c74199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:30.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.167+0000 7f4c79a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c74100ec0 0x7f4c741a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:30.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.167+0000 7f4c79a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c741a1390 con 0x7f4c740ff3d0 2024-03-16T20:57:30.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.167+0000 7f4c79a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c741a1500 con 0x7f4c74100500 2024-03-16T20:57:30.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.167+0000 7f4c79a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c741a16c0 con 0x7f4c74100ec0 2024-03-16T20:57:30.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c72000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c74100500 0x7f4c74199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:30.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c72a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c740ff3d0 0x7f4c741998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:30.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c72000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c74100500 0x7f4c74199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40618/0 (socket says 172.21.15.8:40618) 2024-03-16T20:57:30.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c72000640 1 -- 172.21.15.8:0/3796568185 learned_addr learned my addr 172.21.15.8:0/3796568185 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:30.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c73400640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c74100ec0 0x7f4c741a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:30.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c72000640 1 -- 172.21.15.8:0/3796568185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c74100ec0 msgr2=0x7f4c741a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:30.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c72000640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c74100ec0 0x7f4c741a0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c72000640 1 -- 172.21.15.8:0/3796568185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c740ff3d0 msgr2=0x7f4c741998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:30.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c72000640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c740ff3d0 0x7f4c741998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c72000640 1 -- 172.21.15.8:0/3796568185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c009560 con 0x7f4c74100500 2024-03-16T20:57:30.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c73400640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c74100ec0 0x7f4c741a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:30.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.168+0000 7f4c72000640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c74100500 0x7f4c74199de0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c000c00 tx=0x7f4c5c005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:30.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.169+0000 7f4c6b400640 1 -- 172.21.15.8:0/3796568185 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c004350 con 0x7f4c74100500 2024-03-16T20:57:30.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.169+0000 7f4c6b400640 1 -- 172.21.15.8:0/3796568185 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4c5c0044b0 con 0x7f4c74100500 2024-03-16T20:57:30.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.169+0000 7f4c6b400640 1 -- 172.21.15.8:0/3796568185 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c003de0 con 0x7f4c74100500 2024-03-16T20:57:30.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.169+0000 7f4c79a00640 1 -- 172.21.15.8:0/3796568185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c741a1940 con 0x7f4c74100500 2024-03-16T20:57:30.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.169+0000 7f4c79a00640 1 -- 172.21.15.8:0/3796568185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c741a1e00 con 0x7f4c74100500 2024-03-16T20:57:30.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.170+0000 7f4c79a00640 1 -- 172.21.15.8:0/3796568185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7410b860 con 0x7f4c74100500 2024-03-16T20:57:30.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.172+0000 7f4c6b400640 1 -- 172.21.15.8:0/3796568185 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f4c5c004e10 con 0x7f4c74100500 2024-03-16T20:57:30.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.173+0000 7f4c6b400640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c580a1a30 0x7f4c580a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:30.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.173+0000 7f4c6b400640 1 -- 172.21.15.8:0/3796568185 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4c5c0efaf0 con 0x7f4c74100500 2024-03-16T20:57:30.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.173+0000 7f4c72a00640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c580a1a30 0x7f4c580a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:30.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.174+0000 7f4c72a00640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c580a1a30 0x7f4c580a3ef0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009bd0 tx=0x7f4c64005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:30.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.177+0000 7f4c6b400640 1 -- 172.21.15.8:0/3796568185 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4c5c0b8cb0 con 0x7f4c74100500 2024-03-16T20:57:30.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:29 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/331822864' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-16T20:57:30.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:29 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-16T20:57:30.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.381+0000 7f4c79a00640 1 -- 172.21.15.8:0/3796568185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c7402d000 con 0x7f4c74100500 2024-03-16T20:57:30.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.383+0000 7f4c6b400640 1 -- 172.21.15.8:0/3796568185 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22581 (secure 0 0 0) 0x7f4c5c043090 con 0x7f4c74100500 2024-03-16T20:57:30.388 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:30.388 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:56:04.502777+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:57:30.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 -- 172.21.15.8:0/3796568185 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c580a1a30 msgr2=0x7f4c580a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:30.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c580a1a30 0x7f4c580a3ef0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009bd0 tx=0x7f4c64005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:30.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 -- 172.21.15.8:0/3796568185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c74100500 msgr2=0x7f4c74199de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:30.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c74100500 0x7f4c74199de0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c000c00 tx=0x7f4c5c005dd0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 -- 172.21.15.8:0/3796568185 shutdown_connections 2024-03-16T20:57:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f4c580a1a30 0x7f4c580a3ef0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c74100ec0 0x7f4c741a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c74100500 0x7f4c74199de0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 --2- 172.21.15.8:0/3796568185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c740ff3d0 0x7f4c741998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 -- 172.21.15.8:0/3796568185 >> 172.21.15.8:0/3796568185 conn(0x7f4c740facf0 msgr2=0x7f4c740fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 -- 172.21.15.8:0/3796568185 shutdown_connections 2024-03-16T20:57:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.386+0000 7f4c79a00640 1 -- 172.21.15.8:0/3796568185 wait complete. 2024-03-16T20:57:30.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T20:55:02.896774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T20:55:04.228958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T20:57:30.410 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T20:57:30.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.637+0000 7f1183200640 1 -- 172.21.15.8:0/3785422819 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1184100600 msgr2=0x7f1184100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:30.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.637+0000 7f1183200640 1 --2- 172.21.15.8:0/3785422819 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1184100600 0x7f1184100a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f116c009900 tx=0x7f116c02bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:30.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.637+0000 7f1183200640 1 -- 172.21.15.8:0/3785422819 shutdown_connections 2024-03-16T20:57:30.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.637+0000 7f1183200640 1 --2- 172.21.15.8:0/3785422819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1184100fa0 0x7f1184101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.637+0000 7f1183200640 1 --2- 172.21.15.8:0/3785422819 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1184100600 0x7f1184100a60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.637+0000 7f1183200640 1 --2- 172.21.15.8:0/3785422819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11840ffca0 0x7f11841000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.637+0000 7f1183200640 1 -- 172.21.15.8:0/3785422819 >> 172.21.15.8:0/3785422819 conn(0x7f11840fb860 msgr2=0x7f11840fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:30.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.637+0000 7f1183200640 1 -- 172.21.15.8:0/3785422819 shutdown_connections 2024-03-16T20:57:30.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.638+0000 7f1183200640 1 -- 172.21.15.8:0/3785422819 wait complete. 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.638+0000 7f1183200640 1 Processor -- start 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1183200640 1 -- start start 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1183200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11840ffca0 0x7f1184199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1183200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1184100600 0x7f1184199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1183200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1184100fa0 0x7f11841a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1183200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11841a11f0 con 0x7f1184100fa0 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1183200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11841a1360 con 0x7f11840ffca0 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1183200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11841a1520 con 0x7f1184100600 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1181e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11840ffca0 0x7f1184199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1181e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11840ffca0 0x7f1184199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40636/0 (socket says 172.21.15.8:40636) 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1181e00640 1 -- 172.21.15.8:0/1514493080 learned_addr learned my addr 172.21.15.8:0/1514493080 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:30.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1182800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1184100fa0 0x7f11841a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:30.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.639+0000 7f1181400640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1184100600 0x7f1184199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:30.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.640+0000 7f1181e00640 1 -- 172.21.15.8:0/1514493080 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1184100600 msgr2=0x7f1184199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:30.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.640+0000 7f1181e00640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1184100600 0x7f1184199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.640+0000 7f1181e00640 1 -- 172.21.15.8:0/1514493080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1184100fa0 msgr2=0x7f11841a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:30.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.640+0000 7f1181e00640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1184100fa0 0x7f11841a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.640+0000 7f1181e00640 1 -- 172.21.15.8:0/1514493080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c009560 con 0x7f11840ffca0 2024-03-16T20:57:30.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.640+0000 7f1181e00640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11840ffca0 0x7f1184199700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f117400e9f0 tx=0x7f117400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:30.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.640+0000 7f117aa00640 1 -- 172.21.15.8:0/1514493080 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174009700 con 0x7f11840ffca0 2024-03-16T20:57:30.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.640+0000 7f117aa00640 1 -- 172.21.15.8:0/1514493080 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f117400cd80 con 0x7f11840ffca0 2024-03-16T20:57:30.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.640+0000 7f1183200640 1 -- 172.21.15.8:0/1514493080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11841a1800 con 0x7f11840ffca0 2024-03-16T20:57:30.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.640+0000 7f117aa00640 1 -- 172.21.15.8:0/1514493080 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740189c0 con 0x7f11840ffca0 2024-03-16T20:57:30.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.640+0000 7f1183200640 1 -- 172.21.15.8:0/1514493080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11841a1d30 con 0x7f11840ffca0 2024-03-16T20:57:30.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.642+0000 7f1183200640 1 -- 172.21.15.8:0/1514493080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118410ab30 con 0x7f11840ffca0 2024-03-16T20:57:30.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.643+0000 7f117aa00640 1 -- 172.21.15.8:0/1514493080 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f1174018b20 con 0x7f11840ffca0 2024-03-16T20:57:30.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.645+0000 7f117aa00640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f11680a1ab0 0x7f11680a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:30.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.645+0000 7f117aa00640 1 -- 172.21.15.8:0/1514493080 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1174014070 con 0x7f11840ffca0 2024-03-16T20:57:30.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.645+0000 7f1181400640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f11680a1ab0 0x7f11680a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:30.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.646+0000 7f1181400640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f11680a1ab0 0x7f11680a3f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f116c02c7f0 tx=0x7f116c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:30.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.653+0000 7f117aa00640 1 -- 172.21.15.8:0/1514493080 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1174053280 con 0x7f11840ffca0 2024-03-16T20:57:30.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.859+0000 7f1183200640 1 -- 172.21.15.8:0/1514493080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f118402cf90 con 0x7f11840ffca0 2024-03-16T20:57:30.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.860+0000 7f117aa00640 1 -- 172.21.15.8:0/1514493080 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1174096990 con 0x7f11840ffca0 2024-03-16T20:57:30.864 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T20:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 -- 172.21.15.8:0/1514493080 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f11680a1ab0 msgr2=0x7f11680a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f11680a1ab0 0x7f11680a3f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f116c02c7f0 tx=0x7f116c005fd0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 -- 172.21.15.8:0/1514493080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11840ffca0 msgr2=0x7f1184199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11840ffca0 0x7f1184199700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f117400e9f0 tx=0x7f117400eeb0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 -- 172.21.15.8:0/1514493080 shutdown_connections 2024-03-16T20:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f11680a1ab0 0x7f11680a3f70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1184100fa0 0x7f11841a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1184100600 0x7f1184199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 --2- 172.21.15.8:0/1514493080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11840ffca0 0x7f1184199700 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:30.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 -- 172.21.15.8:0/1514493080 >> 172.21.15.8:0/1514493080 conn(0x7f11840fb860 msgr2=0x7f11840fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:30.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 -- 172.21.15.8:0/1514493080 shutdown_connections 2024-03-16T20:57:30.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:30.863+0000 7f1183200640 1 -- 172.21.15.8:0/1514493080 wait complete. 2024-03-16T20:57:30.885 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T20:57:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.108+0000 7ff921400640 1 -- 172.21.15.8:0/2849469354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff91c104780 msgr2=0x7ff91c106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.108+0000 7ff921400640 1 --2- 172.21.15.8:0/2849469354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff91c104780 0x7ff91c106b70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff904009900 tx=0x7ff90402bc50 comp rx=0 tx=0).stop 2024-03-16T20:57:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.109+0000 7ff921400640 1 -- 172.21.15.8:0/2849469354 shutdown_connections 2024-03-16T20:57:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.109+0000 7ff921400640 1 --2- 172.21.15.8:0/2849469354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91c1070b0 0x7ff91c109500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.109+0000 7ff921400640 1 --2- 172.21.15.8:0/2849469354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff91c104780 0x7ff91c106b70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.109+0000 7ff921400640 1 --2- 172.21.15.8:0/2849469354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff91c101e50 0x7ff91c104240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.109+0000 7ff921400640 1 -- 172.21.15.8:0/2849469354 >> 172.21.15.8:0/2849469354 conn(0x7ff91c0fb860 msgr2=0x7ff91c0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.109+0000 7ff921400640 1 -- 172.21.15.8:0/2849469354 shutdown_connections 2024-03-16T20:57:31.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.109+0000 7ff921400640 1 -- 172.21.15.8:0/2849469354 wait complete. 2024-03-16T20:57:31.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.110+0000 7ff921400640 1 Processor -- start 2024-03-16T20:57:31.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.110+0000 7ff921400640 1 -- start start 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.111+0000 7ff921400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff91c101e50 0x7ff91c197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.111+0000 7ff921400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91c104780 0x7ff91c197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.111+0000 7ff921400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff91c1070b0 0x7ff91c19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.111+0000 7ff921400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c19f050 con 0x7ff91c101e50 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.111+0000 7ff921400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c19f1c0 con 0x7ff91c104780 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.111+0000 7ff921400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c19f380 con 0x7ff91c1070b0 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.111+0000 7ff91be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff91c101e50 0x7ff91c197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.111+0000 7ff913400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91c104780 0x7ff91c197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.111+0000 7ff920a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff91c1070b0 0x7ff91c19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.111+0000 7ff91be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff91c101e50 0x7ff91c197560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55946/0 (socket says 172.21.15.8:55946) 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.111+0000 7ff91be00640 1 -- 172.21.15.8:0/3871553422 learned_addr learned my addr 172.21.15.8:0/3871553422 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:31.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.112+0000 7ff913400640 1 -- 172.21.15.8:0/3871553422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff91c1070b0 msgr2=0x7ff91c19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:31.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.112+0000 7ff913400640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff91c1070b0 0x7ff91c19eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.112+0000 7ff913400640 1 -- 172.21.15.8:0/3871553422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff91c101e50 msgr2=0x7ff91c197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:31.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.112+0000 7ff913400640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff91c101e50 0x7ff91c197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.112+0000 7ff913400640 1 -- 172.21.15.8:0/3871553422 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff904009560 con 0x7ff91c104780 2024-03-16T20:57:31.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.112+0000 7ff920a00640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff91c1070b0 0x7ff91c19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:31.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.112+0000 7ff913400640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91c104780 0x7ff91c197aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff904009230 tx=0x7ff904004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:30 smithi170 ceph-mon[35947]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T20:57:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:30 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-16T20:57:31.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:30 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:57:31.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:30 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3796568185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:31.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.112+0000 7ff919600640 1 -- 172.21.15.8:0/3871553422 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff904005010 con 0x7ff91c104780 2024-03-16T20:57:31.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.112+0000 7ff919600640 1 -- 172.21.15.8:0/3871553422 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff904004500 con 0x7ff91c104780 2024-03-16T20:57:31.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.112+0000 7ff919600640 1 -- 172.21.15.8:0/3871553422 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff904034440 con 0x7ff91c104780 2024-03-16T20:57:31.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.112+0000 7ff921400640 1 -- 172.21.15.8:0/3871553422 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91c19f600 con 0x7ff91c104780 2024-03-16T20:57:31.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.113+0000 7ff921400640 1 -- 172.21.15.8:0/3871553422 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91c19fad0 con 0x7ff91c104780 2024-03-16T20:57:31.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.114+0000 7ff921400640 1 -- 172.21.15.8:0/3871553422 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91c0fd350 con 0x7ff91c104780 2024-03-16T20:57:31.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.116+0000 7ff919600640 1 -- 172.21.15.8:0/3871553422 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7ff904003780 con 0x7ff91c104780 2024-03-16T20:57:31.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.117+0000 7ff919600640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9000a1ab0 0x7ff9000a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:31.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.118+0000 7ff919600640 1 -- 172.21.15.8:0/3871553422 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff9040ef4e0 con 0x7ff91c104780 2024-03-16T20:57:31.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.118+0000 7ff91be00640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9000a1ab0 0x7ff9000a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:31.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.119+0000 7ff91be00640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9000a1ab0 0x7ff9000a3f70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009c90 tx=0x7ff90c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:31.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.119+0000 7ff919600640 1 -- 172.21.15.8:0/3871553422 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff9040b8750 con 0x7ff91c104780 2024-03-16T20:57:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:30 smithi186 ceph-mon[36391]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T20:57:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:30 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-16T20:57:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:30 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:57:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:30 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3796568185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:31.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:30 smithi008 ceph-mon[31434]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T20:57:31.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:30 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-16T20:57:31.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:30 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:57:31.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:30 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3796568185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:31.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.328+0000 7ff921400640 1 -- 172.21.15.8:0/3871553422 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff91c10d1a0 con 0x7ff91c104780 2024-03-16T20:57:31.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.329+0000 7ff919600640 1 -- 172.21.15.8:0/3871553422 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff904041020 con 0x7ff91c104780 2024-03-16T20:57:31.333 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-16T20:57:31.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 -- 172.21.15.8:0/3871553422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9000a1ab0 msgr2=0x7ff9000a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:31.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9000a1ab0 0x7ff9000a3f70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009c90 tx=0x7ff90c005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:31.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 -- 172.21.15.8:0/3871553422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91c104780 msgr2=0x7ff91c197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:31.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91c104780 0x7ff91c197aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff904009230 tx=0x7ff904004040 comp rx=0 tx=0).stop 2024-03-16T20:57:31.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 -- 172.21.15.8:0/3871553422 shutdown_connections 2024-03-16T20:57:31.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff9000a1ab0 0x7ff9000a3f70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff91c1070b0 0x7ff91c19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff91c104780 0x7ff91c197aa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 --2- 172.21.15.8:0/3871553422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff91c101e50 0x7ff91c197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 -- 172.21.15.8:0/3871553422 >> 172.21.15.8:0/3871553422 conn(0x7ff91c0fb860 msgr2=0x7ff91c102750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:31.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 -- 172.21.15.8:0/3871553422 shutdown_connections 2024-03-16T20:57:31.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.332+0000 7ff921400640 1 -- 172.21.15.8:0/3871553422 wait complete. 2024-03-16T20:57:31.357 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T20:57:31.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.586+0000 7f840e400640 1 -- 172.21.15.8:0/929797651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84080ffc50 msgr2=0x7f8408102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:31.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.586+0000 7f840e400640 1 --2- 172.21.15.8:0/929797651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84080ffc50 0x7f8408102080 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009ca0 tx=0x7f83f802c0f0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.587+0000 7f840e400640 1 -- 172.21.15.8:0/929797651 shutdown_connections 2024-03-16T20:57:31.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.587+0000 7f840e400640 1 --2- 172.21.15.8:0/929797651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8408104f70 0x7f84081053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.587+0000 7f840e400640 1 --2- 172.21.15.8:0/929797651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84081025c0 0x7f8408104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.587+0000 7f840e400640 1 --2- 172.21.15.8:0/929797651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84080ffc50 0x7f8408102080 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.587+0000 7f840e400640 1 -- 172.21.15.8:0/929797651 >> 172.21.15.8:0/929797651 conn(0x7f84080fb870 msgr2=0x7f84080fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:31.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.587+0000 7f840e400640 1 -- 172.21.15.8:0/929797651 shutdown_connections 2024-03-16T20:57:31.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.587+0000 7f840e400640 1 -- 172.21.15.8:0/929797651 wait complete. 2024-03-16T20:57:31.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.588+0000 7f840e400640 1 Processor -- start 2024-03-16T20:57:31.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.588+0000 7f840e400640 1 -- start start 2024-03-16T20:57:31.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.588+0000 7f840e400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84080ffc50 0x7f840819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:31.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.588+0000 7f840e400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84081025c0 0x7f840819e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:31.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.588+0000 7f840e400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8408104f70 0x7f84081a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:31.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.588+0000 7f840e400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84081a5630 con 0x7f84081025c0 2024-03-16T20:57:31.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.588+0000 7f840e400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84081a57a0 con 0x7f84080ffc50 2024-03-16T20:57:31.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.588+0000 7f840e400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84081a5960 con 0x7f8408104f70 2024-03-16T20:57:31.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.588+0000 7f840d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84080ffc50 0x7f840819db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:31.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.589+0000 7f840d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84080ffc50 0x7f840819db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40670/0 (socket says 172.21.15.8:40670) 2024-03-16T20:57:31.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.589+0000 7f840d000640 1 -- 172.21.15.8:0/699994269 learned_addr learned my addr 172.21.15.8:0/699994269 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.589+0000 7f840da00640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8408104f70 0x7f84081a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.589+0000 7f840d000640 1 -- 172.21.15.8:0/699994269 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8408104f70 msgr2=0x7f84081a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.589+0000 7f840d000640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8408104f70 0x7f84081a50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.589+0000 7f840d000640 1 -- 172.21.15.8:0/699994269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84081025c0 msgr2=0x7f840819e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.589+0000 7f8407e00640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84081025c0 0x7f840819e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.589+0000 7f840d000640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84081025c0 0x7f840819e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.589+0000 7f840d000640 1 -- 172.21.15.8:0/699994269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8009900 con 0x7f84080ffc50 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.589+0000 7f8407e00640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84081025c0 0x7f840819e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.589+0000 7f840d000640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84080ffc50 0x7f840819db40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009dc0 tx=0x7f83f80346f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.590+0000 7f8405600640 1 -- 172.21.15.8:0/699994269 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8003970 con 0x7f84080ffc50 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.590+0000 7f8405600640 1 -- 172.21.15.8:0/699994269 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f83f8004040 con 0x7f84080ffc50 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.590+0000 7f840e400640 1 -- 172.21.15.8:0/699994269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84081a5be0 con 0x7f84080ffc50 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.590+0000 7f8405600640 1 -- 172.21.15.8:0/699994269 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80406b0 con 0x7f84080ffc50 2024-03-16T20:57:31.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.590+0000 7f840e400640 1 -- 172.21.15.8:0/699994269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84081a6090 con 0x7f84080ffc50 2024-03-16T20:57:31.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.591+0000 7f840e400640 1 -- 172.21.15.8:0/699994269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84080fd360 con 0x7f84080ffc50 2024-03-16T20:57:31.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.593+0000 7f8405600640 1 -- 172.21.15.8:0/699994269 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f83f800a040 con 0x7f84080ffc50 2024-03-16T20:57:31.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.594+0000 7f8405600640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83ec0a1a30 0x7f83ec0a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:31.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.594+0000 7f8405600640 1 -- 172.21.15.8:0/699994269 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f83f80effe0 con 0x7f84080ffc50 2024-03-16T20:57:31.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.595+0000 7f8407e00640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83ec0a1a30 0x7f83ec0a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:31.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.595+0000 7f8407e00640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83ec0a1a30 0x7f83ec0a3ef0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f840819f050 tx=0x7f83f0005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:31.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.598+0000 7f8405600640 1 -- 172.21.15.8:0/699994269 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f83f80b9200 con 0x7f84080ffc50 2024-03-16T20:57:31.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.800+0000 7f840e400640 1 -- 172.21.15.8:0/699994269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f840802cf90 con 0x7f84080ffc50 2024-03-16T20:57:31.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.800+0000 7f8405600640 1 -- 172.21.15.8:0/699994269 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83f80041b0 con 0x7f84080ffc50 2024-03-16T20:57:31.805 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-16T20:57:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 -- 172.21.15.8:0/699994269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83ec0a1a30 msgr2=0x7f83ec0a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83ec0a1a30 0x7f83ec0a3ef0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f840819f050 tx=0x7f83f0005e50 comp rx=0 tx=0).stop 2024-03-16T20:57:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 -- 172.21.15.8:0/699994269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84080ffc50 msgr2=0x7f840819db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84080ffc50 0x7f840819db40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009dc0 tx=0x7f83f80346f0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 -- 172.21.15.8:0/699994269 shutdown_connections 2024-03-16T20:57:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f83ec0a1a30 0x7f83ec0a3ef0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8408104f70 0x7f84081a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84081025c0 0x7f840819e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 --2- 172.21.15.8:0/699994269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84080ffc50 0x7f840819db40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 -- 172.21.15.8:0/699994269 >> 172.21.15.8:0/699994269 conn(0x7f84080fb870 msgr2=0x7f8408102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 -- 172.21.15.8:0/699994269 shutdown_connections 2024-03-16T20:57:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:31.803+0000 7f840e400640 1 -- 172.21.15.8:0/699994269 wait complete. 2024-03-16T20:57:31.826 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:57:32.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.029+0000 7f4242000640 1 -- 172.21.15.8:0/2125377626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c0ffbf0 msgr2=0x7f423c100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.029+0000 7f4242000640 1 --2- 172.21.15.8:0/2125377626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c0ffbf0 0x7f423c100010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4224009900 tx=0x7f422402bc80 comp rx=0 tx=0).stop 2024-03-16T20:57:32.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.029+0000 7f4242000640 1 -- 172.21.15.8:0/2125377626 shutdown_connections 2024-03-16T20:57:32.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.029+0000 7f4242000640 1 --2- 172.21.15.8:0/2125377626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f423c100ef0 0x7f423c101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.029+0000 7f4242000640 1 --2- 172.21.15.8:0/2125377626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f423c100550 0x7f423c1009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.029+0000 7f4242000640 1 --2- 172.21.15.8:0/2125377626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c0ffbf0 0x7f423c100010 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.029+0000 7f4242000640 1 -- 172.21.15.8:0/2125377626 >> 172.21.15.8:0/2125377626 conn(0x7f423c0fb7d0 msgr2=0x7f423c0fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:32.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.029+0000 7f4242000640 1 -- 172.21.15.8:0/2125377626 shutdown_connections 2024-03-16T20:57:32.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.030+0000 7f4242000640 1 -- 172.21.15.8:0/2125377626 wait complete. 2024-03-16T20:57:32.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.030+0000 7f4242000640 1 Processor -- start 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f4242000640 1 -- start start 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f4242000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f423c0ffbf0 0x7f423c199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f4242000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c100550 0x7f423c199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f4242000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f423c100ef0 0x7f423c1a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f4242000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1a1180 con 0x7f423c100550 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f4242000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1a12f0 con 0x7f423c0ffbf0 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f4242000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1a14b0 con 0x7f423c100ef0 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f4240c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f423c0ffbf0 0x7f423c199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f423be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c100550 0x7f423c199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f4240c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f423c0ffbf0 0x7f423c199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40684/0 (socket says 172.21.15.8:40684) 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f4240c00640 1 -- 172.21.15.8:0/3319505062 learned_addr learned my addr 172.21.15.8:0/3319505062 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.031+0000 7f4241600640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f423c100ef0 0x7f423c1a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.032+0000 7f4240c00640 1 -- 172.21.15.8:0/3319505062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f423c100ef0 msgr2=0x7f423c1a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.032+0000 7f4240c00640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f423c100ef0 0x7f423c1a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.032+0000 7f4240c00640 1 -- 172.21.15.8:0/3319505062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c100550 msgr2=0x7f423c199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.032+0000 7f4240c00640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c100550 0x7f423c199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.032+0000 7f4240c00640 1 -- 172.21.15.8:0/3319505062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009490 con 0x7f423c0ffbf0 2024-03-16T20:57:32.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.032+0000 7f423be00640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c100550 0x7f423c199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:32.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.032+0000 7f4240c00640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f423c0ffbf0 0x7f423c199690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4224000c00 tx=0x7f4224005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:32.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.032+0000 7f4239600640 1 -- 172.21.15.8:0/3319505062 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224004390 con 0x7f423c0ffbf0 2024-03-16T20:57:32.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.032+0000 7f4239600640 1 -- 172.21.15.8:0/3319505062 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f42240044f0 con 0x7f423c0ffbf0 2024-03-16T20:57:32.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.032+0000 7f4239600640 1 -- 172.21.15.8:0/3319505062 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224003cd0 con 0x7f423c0ffbf0 2024-03-16T20:57:32.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.032+0000 7f4242000640 1 -- 172.21.15.8:0/3319505062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4224009560 con 0x7f423c0ffbf0 2024-03-16T20:57:32.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.033+0000 7f4242000640 1 -- 172.21.15.8:0/3319505062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c1a1ab0 con 0x7f423c0ffbf0 2024-03-16T20:57:32.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.034+0000 7f4242000640 1 -- 172.21.15.8:0/3319505062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c10a940 con 0x7f423c0ffbf0 2024-03-16T20:57:32.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.035+0000 7f4239600640 1 -- 172.21.15.8:0/3319505062 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f4224004e10 con 0x7f423c0ffbf0 2024-03-16T20:57:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.037+0000 7f4239600640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42200a1a30 0x7f42200a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.037+0000 7f4239600640 1 -- 172.21.15.8:0/3319505062 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f42240efb30 con 0x7f423c0ffbf0 2024-03-16T20:57:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.037+0000 7f423be00640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42200a1a30 0x7f42200a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.038+0000 7f423be00640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42200a1a30 0x7f42200a3ef0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f423c19aba0 tx=0x7f422c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.041+0000 7f4239600640 1 -- 172.21.15.8:0/3319505062 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f42240b8cf0 con 0x7f423c0ffbf0 2024-03-16T20:57:32.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:31 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1514493080' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:32.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:31 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3871553422' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:32.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:31 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/699994269' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:32.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:31 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1514493080' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:32.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:31 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3871553422' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:32.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:31 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/699994269' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:32.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:31 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1514493080' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:32.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:31 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3871553422' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:32.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:31 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/699994269' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:32.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.243+0000 7f4242000640 1 -- 172.21.15.8:0/3319505062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f423c02d000 con 0x7f423c0ffbf0 2024-03-16T20:57:32.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.246+0000 7f4239600640 1 -- 172.21.15.8:0/3319505062 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22581 (secure 0 0 0) 0x7f4224043090 con 0x7f423c0ffbf0 2024-03-16T20:57:32.250 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:32.251 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:56:04.502777+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.248+0000 7f4242000640 1 -- 172.21.15.8:0/3319505062 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42200a1a30 msgr2=0x7f42200a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.248+0000 7f4242000640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42200a1a30 0x7f42200a3ef0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f423c19aba0 tx=0x7f422c005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.248+0000 7f4242000640 1 -- 172.21.15.8:0/3319505062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f423c0ffbf0 msgr2=0x7f423c199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.248+0000 7f4242000640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f423c0ffbf0 0x7f423c199690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4224000c00 tx=0x7f4224005d50 comp rx=0 tx=0).stop 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.249+0000 7f4242000640 1 -- 172.21.15.8:0/3319505062 shutdown_connections 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.249+0000 7f4242000640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42200a1a30 0x7f42200a3ef0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.249+0000 7f4242000640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f423c100ef0 0x7f423c1a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.249+0000 7f4242000640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c100550 0x7f423c199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.249+0000 7f4242000640 1 --2- 172.21.15.8:0/3319505062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f423c0ffbf0 0x7f423c199690 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.249+0000 7f4242000640 1 -- 172.21.15.8:0/3319505062 >> 172.21.15.8:0/3319505062 conn(0x7f423c0fb7d0 msgr2=0x7f423c0fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.249+0000 7f4242000640 1 -- 172.21.15.8:0/3319505062 shutdown_connections 2024-03-16T20:57:32.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.249+0000 7f4242000640 1 -- 172.21.15.8:0/3319505062 wait complete. 2024-03-16T20:57:32.272 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T20:55:02.896774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T20:55:04.228958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T20:57:32.272 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T20:57:32.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.490+0000 7fd56ca00640 1 -- 172.21.15.8:0/110547347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd568103710 msgr2=0x7fd568103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.490+0000 7fd56ca00640 1 --2- 172.21.15.8:0/110547347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd568103710 0x7fd568103b30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd558009900 tx=0x7fd55802bc30 comp rx=0 tx=0).stop 2024-03-16T20:57:32.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.490+0000 7fd56ca00640 1 -- 172.21.15.8:0/110547347 shutdown_connections 2024-03-16T20:57:32.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.490+0000 7fd56ca00640 1 --2- 172.21.15.8:0/110547347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5681052c0 0x7fd56810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.490+0000 7fd56ca00640 1 --2- 172.21.15.8:0/110547347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd568104900 0x7fd568104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.490+0000 7fd56ca00640 1 --2- 172.21.15.8:0/110547347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd568103710 0x7fd568103b30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.490+0000 7fd56ca00640 1 -- 172.21.15.8:0/110547347 >> 172.21.15.8:0/110547347 conn(0x7fd5680feca0 msgr2=0x7fd5681010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.490+0000 7fd56ca00640 1 -- 172.21.15.8:0/110547347 shutdown_connections 2024-03-16T20:57:32.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.490+0000 7fd56ca00640 1 -- 172.21.15.8:0/110547347 wait complete. 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.491+0000 7fd56ca00640 1 Processor -- start 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.491+0000 7fd56ca00640 1 -- start start 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.491+0000 7fd56ca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd568104900 0x7fd568199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.491+0000 7fd56ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5681052c0 0x7fd568199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.491+0000 7fd56ca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd56819f040 0x7fd5681a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.491+0000 7fd56ca00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5681a1970 con 0x7fd5681052c0 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.491+0000 7fd56ca00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5681a1ae0 con 0x7fd56819f040 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.491+0000 7fd56ca00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5681a1ca0 con 0x7fd568104900 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd565400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5681052c0 0x7fd568199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd565e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd568104900 0x7fd568199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd566800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd56819f040 0x7fd5681a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd565400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5681052c0 0x7fd568199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55988/0 (socket says 172.21.15.8:55988) 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd565400640 1 -- 172.21.15.8:0/2082446100 learned_addr learned my addr 172.21.15.8:0/2082446100 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:32.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd566800640 1 -- 172.21.15.8:0/2082446100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd568104900 msgr2=0x7fd568199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd566800640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd568104900 0x7fd568199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd566800640 1 -- 172.21.15.8:0/2082446100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5681052c0 msgr2=0x7fd568199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd566800640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5681052c0 0x7fd568199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd566800640 1 -- 172.21.15.8:0/2082446100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd558009560 con 0x7fd56819f040 2024-03-16T20:57:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd565e00640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd568104900 0x7fd568199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.492+0000 7fd566800640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd56819f040 0x7fd5681a1430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd560009fd0 tx=0x7fd56000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.493+0000 7fd55ea00640 1 -- 172.21.15.8:0/2082446100 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56000ce20 con 0x7fd56819f040 2024-03-16T20:57:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.493+0000 7fd55ea00640 1 -- 172.21.15.8:0/2082446100 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd560004b20 con 0x7fd56819f040 2024-03-16T20:57:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.493+0000 7fd56ca00640 1 -- 172.21.15.8:0/2082446100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5681a1f80 con 0x7fd56819f040 2024-03-16T20:57:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.493+0000 7fd55ea00640 1 -- 172.21.15.8:0/2082446100 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560010710 con 0x7fd56819f040 2024-03-16T20:57:32.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.493+0000 7fd56ca00640 1 -- 172.21.15.8:0/2082446100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5681a2450 con 0x7fd56819f040 2024-03-16T20:57:32.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.494+0000 7fd56ca00640 1 -- 172.21.15.8:0/2082446100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56810ab00 con 0x7fd56819f040 2024-03-16T20:57:32.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.496+0000 7fd55ea00640 1 -- 172.21.15.8:0/2082446100 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fd560004c90 con 0x7fd56819f040 2024-03-16T20:57:32.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.497+0000 7fd55ea00640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd54c0a1ab0 0x7fd54c0a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.497+0000 7fd55ea00640 1 -- 172.21.15.8:0/2082446100 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd560014070 con 0x7fd56819f040 2024-03-16T20:57:32.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.498+0000 7fd565e00640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd54c0a1ab0 0x7fd54c0a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.498+0000 7fd565e00640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd54c0a1ab0 0x7fd54c0a3f70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd55802c7e0 tx=0x7fd55802c8b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:32.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.499+0000 7fd55ea00640 1 -- 172.21.15.8:0/2082446100 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd560096be0 con 0x7fd56819f040 2024-03-16T20:57:32.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.703+0000 7fd56ca00640 1 -- 172.21.15.8:0/2082446100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd56810f4e0 con 0x7fd56819f040 2024-03-16T20:57:32.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.703+0000 7fd55ea00640 1 -- 172.21.15.8:0/2082446100 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd56009a2a0 con 0x7fd56819f040 2024-03-16T20:57:32.708 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T20:57:32.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.706+0000 7fd56ca00640 1 -- 172.21.15.8:0/2082446100 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd54c0a1ab0 msgr2=0x7fd54c0a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.706+0000 7fd56ca00640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd54c0a1ab0 0x7fd54c0a3f70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd55802c7e0 tx=0x7fd55802c8b0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.706+0000 7fd56ca00640 1 -- 172.21.15.8:0/2082446100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd56819f040 msgr2=0x7fd5681a1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.706+0000 7fd56ca00640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd56819f040 0x7fd5681a1430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd560009fd0 tx=0x7fd56000ef10 comp rx=0 tx=0).stop 2024-03-16T20:57:32.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.706+0000 7fd56ca00640 1 -- 172.21.15.8:0/2082446100 shutdown_connections 2024-03-16T20:57:32.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.706+0000 7fd56ca00640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd54c0a1ab0 0x7fd54c0a3f70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.706+0000 7fd56ca00640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd56819f040 0x7fd5681a1430 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.706+0000 7fd56ca00640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5681052c0 0x7fd568199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.706+0000 7fd56ca00640 1 --2- 172.21.15.8:0/2082446100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd568104900 0x7fd568199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.706+0000 7fd56ca00640 1 -- 172.21.15.8:0/2082446100 >> 172.21.15.8:0/2082446100 conn(0x7fd5680feca0 msgr2=0x7fd568107cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:32.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.707+0000 7fd56ca00640 1 -- 172.21.15.8:0/2082446100 shutdown_connections 2024-03-16T20:57:32.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.707+0000 7fd56ca00640 1 -- 172.21.15.8:0/2082446100 wait complete. 2024-03-16T20:57:32.730 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T20:57:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.948+0000 7f1459400640 1 -- 172.21.15.8:0/3277365552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14541047e0 msgr2=0x7f1454104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.948+0000 7f1459400640 1 --2- 172.21.15.8:0/3277365552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14541047e0 0x7f1454104c60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f143c009900 tx=0x7f143c02bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.948+0000 7f1459400640 1 -- 172.21.15.8:0/3277365552 shutdown_connections 2024-03-16T20:57:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.948+0000 7f1459400640 1 --2- 172.21.15.8:0/3277365552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14541051a0 0x7f145410ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.948+0000 7f1459400640 1 --2- 172.21.15.8:0/3277365552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14541047e0 0x7f1454104c60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.948+0000 7f1459400640 1 --2- 172.21.15.8:0/3277365552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14541035f0 0x7f1454103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.948+0000 7f1459400640 1 -- 172.21.15.8:0/3277365552 >> 172.21.15.8:0/3277365552 conn(0x7f14540feb60 msgr2=0x7f1454100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.948+0000 7f1459400640 1 -- 172.21.15.8:0/3277365552 shutdown_connections 2024-03-16T20:57:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.949+0000 7f1459400640 1 -- 172.21.15.8:0/3277365552 wait complete. 2024-03-16T20:57:32.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.950+0000 7f1459400640 1 Processor -- start 2024-03-16T20:57:32.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.950+0000 7f1459400640 1 -- start start 2024-03-16T20:57:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.950+0000 7f1459400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14541035f0 0x7f1454199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1459400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14541047e0 0x7f1454199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1459400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14541051a0 0x7f14541a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1459400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14541a1230 con 0x7f14541051a0 2024-03-16T20:57:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1459400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14541a13a0 con 0x7f14541047e0 2024-03-16T20:57:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1459400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14541a1560 con 0x7f14541035f0 2024-03-16T20:57:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1453e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14541035f0 0x7f1454199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1453e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14541035f0 0x7f1454199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:42166/0 (socket says 172.21.15.8:42166) 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f144b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14541047e0 0x7f1454199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1453e00640 1 -- 172.21.15.8:0/3871052011 learned_addr learned my addr 172.21.15.8:0/3871052011 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1458a00640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14541051a0 0x7f14541a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1453e00640 1 -- 172.21.15.8:0/3871052011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14541047e0 msgr2=0x7f1454199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1453e00640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14541047e0 0x7f1454199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1453e00640 1 -- 172.21.15.8:0/3871052011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14541051a0 msgr2=0x7f14541a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1453e00640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14541051a0 0x7f14541a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.951+0000 7f1453e00640 1 -- 172.21.15.8:0/3871052011 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c009560 con 0x7f14541035f0 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.952+0000 7f1453e00640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14541035f0 0x7f1454199740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f144400eb70 tx=0x7f144400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.952+0000 7f1451600640 1 -- 172.21.15.8:0/3871052011 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444003b70 con 0x7f14541035f0 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.952+0000 7f1451600640 1 -- 172.21.15.8:0/3871052011 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f144400ee70 con 0x7f14541035f0 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.952+0000 7f1459400640 1 -- 172.21.15.8:0/3871052011 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14541a1840 con 0x7f14541035f0 2024-03-16T20:57:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.952+0000 7f1451600640 1 -- 172.21.15.8:0/3871052011 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14440107f0 con 0x7f14541035f0 2024-03-16T20:57:32.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.952+0000 7f1459400640 1 -- 172.21.15.8:0/3871052011 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14541a1cd0 con 0x7f14541035f0 2024-03-16T20:57:32.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.953+0000 7f1459400640 1 -- 172.21.15.8:0/3871052011 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145410a8b0 con 0x7f14541035f0 2024-03-16T20:57:32.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.955+0000 7f1451600640 1 -- 172.21.15.8:0/3871052011 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f1444004020 con 0x7f14541035f0 2024-03-16T20:57:32.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.956+0000 7f1451600640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f14380a1a30 0x7f14380a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:32.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.956+0000 7f1451600640 1 -- 172.21.15.8:0/3871052011 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1444014070 con 0x7f14541035f0 2024-03-16T20:57:32.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.957+0000 7f144b400640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f14380a1a30 0x7f14380a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:32.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.957+0000 7f144b400640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f14380a1a30 0x7f14380a3ef0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f143c02c250 tx=0x7f143c02df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:32.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:32.960+0000 7f1451600640 1 -- 172.21.15.8:0/3871052011 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1444096c40 con 0x7f14541035f0 2024-03-16T20:57:32.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:32 smithi008 ceph-mon[31434]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:57:32.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:32 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3319505062' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:32.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:32 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2082446100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:33.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:32 smithi170 ceph-mon[35947]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:57:33.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:32 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3319505062' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:33.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:32 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2082446100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:33.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:32 smithi186 ceph-mon[36391]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-16T20:57:33.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:32 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3319505062' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:33.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:32 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2082446100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:33.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.163+0000 7f1459400640 1 -- 172.21.15.8:0/3871052011 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f145402cf90 con 0x7f14541035f0 2024-03-16T20:57:33.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.163+0000 7f1451600640 1 -- 172.21.15.8:0/3871052011 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14440850a0 con 0x7f14541035f0 2024-03-16T20:57:33.168 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-16T20:57:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 -- 172.21.15.8:0/3871052011 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f14380a1a30 msgr2=0x7f14380a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f14380a1a30 0x7f14380a3ef0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f143c02c250 tx=0x7f143c02df90 comp rx=0 tx=0).stop 2024-03-16T20:57:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 -- 172.21.15.8:0/3871052011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14541035f0 msgr2=0x7f1454199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14541035f0 0x7f1454199740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f144400eb70 tx=0x7f144400c6a0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 -- 172.21.15.8:0/3871052011 shutdown_connections 2024-03-16T20:57:33.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f14380a1a30 0x7f14380a3ef0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14541051a0 0x7f14541a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14541047e0 0x7f1454199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 --2- 172.21.15.8:0/3871052011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14541035f0 0x7f1454199740 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 -- 172.21.15.8:0/3871052011 >> 172.21.15.8:0/3871052011 conn(0x7f14540feb60 msgr2=0x7f1454107a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:33.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 -- 172.21.15.8:0/3871052011 shutdown_connections 2024-03-16T20:57:33.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.166+0000 7f1459400640 1 -- 172.21.15.8:0/3871052011 wait complete. 2024-03-16T20:57:33.191 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T20:57:33.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.417+0000 7fe1e1e00640 1 -- 172.21.15.8:0/1489995268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1dc1096c0 msgr2=0x7fe1dc10ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:33.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.417+0000 7fe1e1e00640 1 --2- 172.21.15.8:0/1489995268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1dc1096c0 0x7fe1dc10ff50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009ca0 tx=0x7fe1d402c0f0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.417+0000 7fe1e1e00640 1 -- 172.21.15.8:0/1489995268 shutdown_connections 2024-03-16T20:57:33.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.417+0000 7fe1e1e00640 1 --2- 172.21.15.8:0/1489995268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1dc1096c0 0x7fe1dc10ff50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.417+0000 7fe1e1e00640 1 --2- 172.21.15.8:0/1489995268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1dc108d00 0x7fe1dc109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.417+0000 7fe1e1e00640 1 --2- 172.21.15.8:0/1489995268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc107b10 0x7fe1dc107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.417+0000 7fe1e1e00640 1 -- 172.21.15.8:0/1489995268 >> 172.21.15.8:0/1489995268 conn(0x7fe1dc076ab0 msgr2=0x7fe1dc078ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:33.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.417+0000 7fe1e1e00640 1 -- 172.21.15.8:0/1489995268 shutdown_connections 2024-03-16T20:57:33.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.417+0000 7fe1e1e00640 1 -- 172.21.15.8:0/1489995268 wait complete. 2024-03-16T20:57:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.418+0000 7fe1e1e00640 1 Processor -- start 2024-03-16T20:57:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1e1e00640 1 -- start start 2024-03-16T20:57:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1e1e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1dc107b10 0x7fe1dc19dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1e1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1dc108d00 0x7fe1dc19e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1e1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc1096c0 0x7fe1dc1a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1e1e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc1a5710 con 0x7fe1dc1096c0 2024-03-16T20:57:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1e1e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc1a5880 con 0x7fe1dc108d00 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1e1e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc1a5a40 con 0x7fe1dc107b10 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1daa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1dc107b10 0x7fe1dc19dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1da000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1dc108d00 0x7fe1dc19e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1daa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1dc107b10 0x7fe1dc19dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:42174/0 (socket says 172.21.15.8:42174) 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1da000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1dc108d00 0x7fe1dc19e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40740/0 (socket says 172.21.15.8:40740) 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1daa00640 1 -- 172.21.15.8:0/2222654677 learned_addr learned my addr 172.21.15.8:0/2222654677 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.419+0000 7fe1db400640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc1096c0 0x7fe1dc1a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.420+0000 7fe1da000640 1 -- 172.21.15.8:0/2222654677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1dc107b10 msgr2=0x7fe1dc19dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.420+0000 7fe1da000640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1dc107b10 0x7fe1dc19dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.420+0000 7fe1da000640 1 -- 172.21.15.8:0/2222654677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc1096c0 msgr2=0x7fe1dc1a51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.420+0000 7fe1da000640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc1096c0 0x7fe1dc1a51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.420+0000 7fe1da000640 1 -- 172.21.15.8:0/2222654677 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d4009900 con 0x7fe1dc108d00 2024-03-16T20:57:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.420+0000 7fe1daa00640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1dc107b10 0x7fe1dc19dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:33.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.420+0000 7fe1da000640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1dc108d00 0x7fe1dc19e170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800e9f0 tx=0x7fe1c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:33.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.420+0000 7fe1e0a00640 1 -- 172.21.15.8:0/2222654677 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800ccc0 con 0x7fe1dc108d00 2024-03-16T20:57:33.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.420+0000 7fe1e1e00640 1 -- 172.21.15.8:0/2222654677 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1dc1a5d20 con 0x7fe1dc108d00 2024-03-16T20:57:33.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.420+0000 7fe1e0a00640 1 -- 172.21.15.8:0/2222654677 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe1c800ce20 con 0x7fe1dc108d00 2024-03-16T20:57:33.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.420+0000 7fe1e0a00640 1 -- 172.21.15.8:0/2222654677 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8004ad0 con 0x7fe1dc108d00 2024-03-16T20:57:33.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.421+0000 7fe1e1e00640 1 -- 172.21.15.8:0/2222654677 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1dc1a6180 con 0x7fe1dc108d00 2024-03-16T20:57:33.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.422+0000 7fe1e1e00640 1 -- 172.21.15.8:0/2222654677 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1dc10edd0 con 0x7fe1dc108d00 2024-03-16T20:57:33.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.424+0000 7fe1e0a00640 1 -- 172.21.15.8:0/2222654677 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fe1c80051b0 con 0x7fe1dc108d00 2024-03-16T20:57:33.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.425+0000 7fe1e0a00640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe1c00a1a30 0x7fe1c00a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:33.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.426+0000 7fe1e0a00640 1 -- 172.21.15.8:0/2222654677 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe1c8014070 con 0x7fe1dc108d00 2024-03-16T20:57:33.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.426+0000 7fe1daa00640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe1c00a1a30 0x7fe1c00a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:33.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.426+0000 7fe1daa00640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe1c00a1a30 0x7fe1c00a3ef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc19f100 tx=0x7fe1cc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:33.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.429+0000 7fe1e0a00640 1 -- 172.21.15.8:0/2222654677 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe1c8096500 con 0x7fe1dc108d00 2024-03-16T20:57:33.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.636+0000 7fe1e1e00640 1 -- 172.21.15.8:0/2222654677 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1dc02d1d0 con 0x7fe1dc108d00 2024-03-16T20:57:33.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.636+0000 7fe1e0a00640 1 -- 172.21.15.8:0/2222654677 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1c8098430 con 0x7fe1dc108d00 2024-03-16T20:57:33.641 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-16T20:57:33.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.639+0000 7fe1e1e00640 1 -- 172.21.15.8:0/2222654677 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe1c00a1a30 msgr2=0x7fe1c00a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:33.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.639+0000 7fe1e1e00640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe1c00a1a30 0x7fe1c00a3ef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc19f100 tx=0x7fe1cc005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:33.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.639+0000 7fe1e1e00640 1 -- 172.21.15.8:0/2222654677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1dc108d00 msgr2=0x7fe1dc19e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:33.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.639+0000 7fe1e1e00640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1dc108d00 0x7fe1dc19e170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800e9f0 tx=0x7fe1c800eeb0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.639+0000 7fe1e1e00640 1 -- 172.21.15.8:0/2222654677 shutdown_connections 2024-03-16T20:57:33.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.639+0000 7fe1e1e00640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fe1c00a1a30 0x7fe1c00a3ef0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.639+0000 7fe1e1e00640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1dc1096c0 0x7fe1dc1a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.639+0000 7fe1e1e00640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1dc108d00 0x7fe1dc19e170 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.639+0000 7fe1e1e00640 1 --2- 172.21.15.8:0/2222654677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1dc107b10 0x7fe1dc19dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.639+0000 7fe1e1e00640 1 -- 172.21.15.8:0/2222654677 >> 172.21.15.8:0/2222654677 conn(0x7fe1dc076ab0 msgr2=0x7fe1dc10bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:33.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.640+0000 7fe1e1e00640 1 -- 172.21.15.8:0/2222654677 shutdown_connections 2024-03-16T20:57:33.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.640+0000 7fe1e1e00640 1 -- 172.21.15.8:0/2222654677 wait complete. 2024-03-16T20:57:33.662 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-03-16T20:57:33.666 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:57:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.881+0000 7f07a6200640 1 -- 172.21.15.8:0/4137760302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a0103540 msgr2=0x7f07a0103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.881+0000 7f07a6200640 1 --2- 172.21.15.8:0/4137760302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a0103540 0x7f07a0103960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0794009900 tx=0x7f079402bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.881+0000 7f07a6200640 1 -- 172.21.15.8:0/4137760302 shutdown_connections 2024-03-16T20:57:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.881+0000 7f07a6200640 1 --2- 172.21.15.8:0/4137760302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07a01050f0 0x7f07a010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.881+0000 7f07a6200640 1 --2- 172.21.15.8:0/4137760302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07a0104730 0x7f07a0104bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.881+0000 7f07a6200640 1 --2- 172.21.15.8:0/4137760302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a0103540 0x7f07a0103960 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.881+0000 7f07a6200640 1 -- 172.21.15.8:0/4137760302 >> 172.21.15.8:0/4137760302 conn(0x7f07a00fead0 msgr2=0x7f07a0100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.881+0000 7f07a6200640 1 -- 172.21.15.8:0/4137760302 shutdown_connections 2024-03-16T20:57:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.881+0000 7f07a6200640 1 -- 172.21.15.8:0/4137760302 wait complete. 2024-03-16T20:57:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.882+0000 7f07a6200640 1 Processor -- start 2024-03-16T20:57:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.882+0000 7f07a6200640 1 -- start start 2024-03-16T20:57:33.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f07a6200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07a0103540 0x7f07a01996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f07a6200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07a0104730 0x7f07a0199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f07a6200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a01050f0 0x7f07a01a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f07a6200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01a11b0 con 0x7f07a0103540 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f07a6200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01a1320 con 0x7f07a01050f0 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f07a6200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01a14e0 con 0x7f07a0104730 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f07a4e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07a0103540 0x7f07a01996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f079fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07a0104730 0x7f07a0199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f079fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07a0104730 0x7f07a0199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:42206/0 (socket says 172.21.15.8:42206) 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f07a4e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07a0103540 0x7f07a01996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56050/0 (socket says 172.21.15.8:56050) 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f079fe00640 1 -- 172.21.15.8:0/3537587071 learned_addr learned my addr 172.21.15.8:0/3537587071 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f07a5800640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a01050f0 0x7f07a01a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f079fe00640 1 -- 172.21.15.8:0/3537587071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a01050f0 msgr2=0x7f07a01a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f079fe00640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a01050f0 0x7f07a01a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f079fe00640 1 -- 172.21.15.8:0/3537587071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07a0103540 msgr2=0x7f07a01996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f079fe00640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07a0103540 0x7f07a01996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.883+0000 7f079fe00640 1 -- 172.21.15.8:0/3537587071 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0794009560 con 0x7f07a0104730 2024-03-16T20:57:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.884+0000 7f07a5800640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a01050f0 0x7f07a01a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.884+0000 7f079fe00640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07a0104730 0x7f07a0199c00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f078c00d950 tx=0x7f078c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.884+0000 7f079d600640 1 -- 172.21.15.8:0/3537587071 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c009a30 con 0x7f07a0104730 2024-03-16T20:57:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.884+0000 7f079d600640 1 -- 172.21.15.8:0/3537587071 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f078c009b90 con 0x7f07a0104730 2024-03-16T20:57:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.884+0000 7f079d600640 1 -- 172.21.15.8:0/3537587071 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c004a00 con 0x7f07a0104730 2024-03-16T20:57:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.884+0000 7f07a6200640 1 -- 172.21.15.8:0/3537587071 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a01a17c0 con 0x7f07a0104730 2024-03-16T20:57:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.884+0000 7f07a6200640 1 -- 172.21.15.8:0/3537587071 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a01a1d20 con 0x7f07a0104730 2024-03-16T20:57:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.885+0000 7f07a6200640 1 -- 172.21.15.8:0/3537587071 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a010a800 con 0x7f07a0104730 2024-03-16T20:57:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.887+0000 7f079d600640 1 -- 172.21.15.8:0/3537587071 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f078c009d00 con 0x7f07a0104730 2024-03-16T20:57:33.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.889+0000 7f079d600640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f07880a1ab0 0x7f07880a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:33.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.889+0000 7f079d600640 1 -- 172.21.15.8:0/3537587071 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f078c0ccdc0 con 0x7f07a0104730 2024-03-16T20:57:33.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.889+0000 7f07a4e00640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f07880a1ab0 0x7f07880a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:33.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.890+0000 7f07a4e00640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f07880a1ab0 0x7f07880a3f70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f079402c180 tx=0x7f079402df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:33.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:33.893+0000 7f079d600640 1 -- 172.21.15.8:0/3537587071 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f078c095f80 con 0x7f07a0104730 2024-03-16T20:57:33.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:33 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3871052011' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:33.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:33 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2222654677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:34.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.137+0000 7f07a6200640 1 -- 172.21.15.8:0/3537587071 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07a002cf60 con 0x7f07a0104730 2024-03-16T20:57:34.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.138+0000 7f079d600640 1 -- 172.21.15.8:0/3537587071 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f078c017090 con 0x7f07a0104730 2024-03-16T20:57:34.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:33 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3871052011' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:34.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:33 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2222654677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:34.143 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:34.143 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:57:29.077799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T20:57:34.143 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 24 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.141+0000 7f07a6200640 1 -- 172.21.15.8:0/3537587071 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f07880a1ab0 msgr2=0x7f07880a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.141+0000 7f07a6200640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f07880a1ab0 0x7f07880a3f70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f079402c180 tx=0x7f079402df90 comp rx=0 tx=0).stop 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.141+0000 7f07a6200640 1 -- 172.21.15.8:0/3537587071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07a0104730 msgr2=0x7f07a0199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.141+0000 7f07a6200640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07a0104730 0x7f07a0199c00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f078c00d950 tx=0x7f078c00de10 comp rx=0 tx=0).stop 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.142+0000 7f07a6200640 1 -- 172.21.15.8:0/3537587071 shutdown_connections 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.142+0000 7f07a6200640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f07880a1ab0 0x7f07880a3f70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.142+0000 7f07a6200640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a01050f0 0x7f07a01a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.142+0000 7f07a6200640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07a0104730 0x7f07a0199c00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.142+0000 7f07a6200640 1 --2- 172.21.15.8:0/3537587071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07a0103540 0x7f07a01996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.142+0000 7f07a6200640 1 -- 172.21.15.8:0/3537587071 >> 172.21.15.8:0/3537587071 conn(0x7f07a00fead0 msgr2=0x7f07a01079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.142+0000 7f07a6200640 1 -- 172.21.15.8:0/3537587071 shutdown_connections 2024-03-16T20:57:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.142+0000 7f07a6200640 1 -- 172.21.15.8:0/3537587071 wait complete. 2024-03-16T20:57:34.165 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-03-16T20:57:34.165 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-03-16T20:57:34.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T20:57:34.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:33 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3871052011' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:34.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:33 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2222654677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.388+0000 7f98ba600640 1 -- 172.21.15.8:0/376484153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98b4101350 msgr2=0x7f98b4101770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.388+0000 7f98ba600640 1 --2- 172.21.15.8:0/376484153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98b4101350 0x7f98b4101770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009860 tx=0x7f98a802bb90 comp rx=0 tx=0).stop 2024-03-16T20:57:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.388+0000 7f98ba600640 1 -- 172.21.15.8:0/376484153 shutdown_connections 2024-03-16T20:57:34.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.388+0000 7f98ba600640 1 --2- 172.21.15.8:0/376484153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98b4102f00 0x7f98b4109790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.388+0000 7f98ba600640 1 --2- 172.21.15.8:0/376484153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b4102540 0x7f98b41029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.388+0000 7f98ba600640 1 --2- 172.21.15.8:0/376484153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98b4101350 0x7f98b4101770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.388+0000 7f98ba600640 1 -- 172.21.15.8:0/376484153 >> 172.21.15.8:0/376484153 conn(0x7f98b40fc8c0 msgr2=0x7f98b40fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.388+0000 7f98ba600640 1 -- 172.21.15.8:0/376484153 shutdown_connections 2024-03-16T20:57:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.388+0000 7f98ba600640 1 -- 172.21.15.8:0/376484153 wait complete. 2024-03-16T20:57:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.389+0000 7f98ba600640 1 Processor -- start 2024-03-16T20:57:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.389+0000 7f98ba600640 1 -- start start 2024-03-16T20:57:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.389+0000 7f98ba600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98b4101350 0x7f98b419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:34.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.389+0000 7f98ba600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b4102540 0x7f98b419dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.389+0000 7f98ba600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98b4102f00 0x7f98b41a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.389+0000 7f98ba600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b41a5570 con 0x7f98b4102540 2024-03-16T20:57:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.389+0000 7f98ba600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b41a56e0 con 0x7f98b4102f00 2024-03-16T20:57:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.389+0000 7f98ba600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b41a58a0 con 0x7f98b4101350 2024-03-16T20:57:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.390+0000 7f98b9200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98b4101350 0x7f98b419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.390+0000 7f98b3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b4102540 0x7f98b419dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.390+0000 7f98b9200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98b4101350 0x7f98b419da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:42218/0 (socket says 172.21.15.8:42218) 2024-03-16T20:57:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.390+0000 7f98b9200640 1 -- 172.21.15.8:0/2614944757 learned_addr learned my addr 172.21.15.8:0/2614944757 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.390+0000 7f98b9c00640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98b4102f00 0x7f98b41a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.390+0000 7f98b9200640 1 -- 172.21.15.8:0/2614944757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98b4102f00 msgr2=0x7f98b41a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:34.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.390+0000 7f98b9200640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98b4102f00 0x7f98b41a5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.390+0000 7f98b9200640 1 -- 172.21.15.8:0/2614944757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b4102540 msgr2=0x7f98b419dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.390+0000 7f98b9200640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b4102540 0x7f98b419dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.390+0000 7f98b9200640 1 -- 172.21.15.8:0/2614944757 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8009490 con 0x7f98b4101350 2024-03-16T20:57:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.390+0000 7f98b3e00640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b4102540 0x7f98b419dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.391+0000 7f98b9200640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98b4101350 0x7f98b419da80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f98a8034b70 tx=0x7f98a8005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.391+0000 7f98b1600640 1 -- 172.21.15.8:0/2614944757 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8034950 con 0x7f98b4101350 2024-03-16T20:57:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.391+0000 7f98b1600640 1 -- 172.21.15.8:0/2614944757 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f98a802ca30 con 0x7f98b4101350 2024-03-16T20:57:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.391+0000 7f98b1600640 1 -- 172.21.15.8:0/2614944757 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8003850 con 0x7f98b4101350 2024-03-16T20:57:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.391+0000 7f98ba600640 1 -- 172.21.15.8:0/2614944757 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b41a5b20 con 0x7f98b4101350 2024-03-16T20:57:34.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.391+0000 7f98ba600640 1 -- 172.21.15.8:0/2614944757 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b41a5fd0 con 0x7f98b4101350 2024-03-16T20:57:34.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.393+0000 7f98ba600640 1 -- 172.21.15.8:0/2614944757 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b40749f0 con 0x7f98b4101350 2024-03-16T20:57:34.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.395+0000 7f98b1600640 1 -- 172.21.15.8:0/2614944757 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f98a803b040 con 0x7f98b4101350 2024-03-16T20:57:34.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.396+0000 7f98b1600640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f989c0a1a30 0x7f989c0a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:34.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.397+0000 7f98b1600640 1 -- 172.21.15.8:0/2614944757 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f98a80ef350 con 0x7f98b4101350 2024-03-16T20:57:34.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.397+0000 7f98b3e00640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f989c0a1a30 0x7f989c0a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:34.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.398+0000 7f98b3e00640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f989c0a1a30 0x7f989c0a3ef0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f98b419ef90 tx=0x7f98a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:34.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.399+0000 7f98b1600640 1 -- 172.21.15.8:0/2614944757 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f98a80b8510 con 0x7f98b4101350 2024-03-16T20:57:34.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.603+0000 7f98ba600640 1 -- 172.21.15.8:0/2614944757 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98b41a6160 con 0x7f989c0a1a30 2024-03-16T20:57:34.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.617+0000 7f98b1600640 1 -- 172.21.15.8:0/2614944757 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259024 (secure 0 0 0) 0x7f98b41a6160 con 0x7f989c0a1a30 2024-03-16T20:57:34.626 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:34.628 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-16T20:57:34.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 -- 172.21.15.8:0/2614944757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f989c0a1a30 msgr2=0x7f989c0a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:34.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f989c0a1a30 0x7f989c0a3ef0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f98b419ef90 tx=0x7f98a0009260 comp rx=0 tx=0).stop 2024-03-16T20:57:34.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 -- 172.21.15.8:0/2614944757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98b4101350 msgr2=0x7f98b419da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:34.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98b4101350 0x7f98b419da80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f98a8034b70 tx=0x7f98a8005dc0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 -- 172.21.15.8:0/2614944757 shutdown_connections 2024-03-16T20:57:34.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f989c0a1a30 0x7f989c0a3ef0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98b4102f00 0x7f98b41a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98b4102540 0x7f98b419dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 --2- 172.21.15.8:0/2614944757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98b4101350 0x7f98b419da80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 -- 172.21.15.8:0/2614944757 >> 172.21.15.8:0/2614944757 conn(0x7f98b40fc8c0 msgr2=0x7f98b40ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 -- 172.21.15.8:0/2614944757 shutdown_connections 2024-03-16T20:57:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.624+0000 7f98ba600640 1 -- 172.21.15.8:0/2614944757 wait complete. 2024-03-16T20:57:34.646 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2024-03-16T20:57:33.146598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659530,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1005,"num_read_kb":628,"num_write":360,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1180965,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364976,"kb_used_data":11664,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576848,"statfs":{"total":1151940427776,"available":1151566692352,"internally_reserved":0,"allocated":11943936,"data_stored":7482272,"data_compressed":113112,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":620,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":36,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004917"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126450+0000","last_change":"2024-03-16T20:55:05.301473+0000","last_active":"2024-03-16T20:56:33.126450+0000","last_peered":"2024-03-16T20:56:33.126450+0000","last_clean":"2024-03-16T20:56:33.126450+0000","last_became_active":"2024-03-16T20:55:05.301166+0000","last_became_peered":"2024-03-16T20:55:05.301166+0000","last_unstale":"2024-03-16T20:56:33.126450+0000","last_undegraded":"2024-03-16T20:56:33.126450+0000","last_fullsized":"2024-03-16T20:56:33.126450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:06:51.838382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126555+0000","last_change":"2024-03-16T20:55:05.295895+0000","last_active":"2024-03-16T20:56:33.126555+0000","last_peered":"2024-03-16T20:56:33.126555+0000","last_clean":"2024-03-16T20:56:33.126555+0000","last_became_active":"2024-03-16T20:55:05.295365+0000","last_became_peered":"2024-03-16T20:55:05.295365+0000","last_unstale":"2024-03-16T20:56:33.126555+0000","last_undegraded":"2024-03-16T20:56:33.126555+0000","last_fullsized":"2024-03-16T20:56:33.126555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:28:20.342348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.125136+0000","last_change":"2024-03-16T20:55:05.299049+0000","last_active":"2024-03-16T20:56:33.125136+0000","last_peered":"2024-03-16T20:56:33.125136+0000","last_clean":"2024-03-16T20:56:33.125136+0000","last_became_active":"2024-03-16T20:55:05.292758+0000","last_became_peered":"2024-03-16T20:55:05.292758+0000","last_unstale":"2024-03-16T20:56:33.125136+0000","last_undegraded":"2024-03-16T20:56:33.125136+0000","last_fullsized":"2024-03-16T20:56:33.125136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:20:36.276639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.074294+0000","last_change":"2024-03-16T20:55:05.274453+0000","last_active":"2024-03-16T20:56:33.074294+0000","last_peered":"2024-03-16T20:56:33.074294+0000","last_clean":"2024-03-16T20:56:33.074294+0000","last_became_active":"2024-03-16T20:55:05.273648+0000","last_became_peered":"2024-03-16T20:55:05.273648+0000","last_unstale":"2024-03-16T20:56:33.074294+0000","last_undegraded":"2024-03-16T20:56:33.074294+0000","last_fullsized":"2024-03-16T20:56:33.074294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:08:37.297906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.102846+0000","last_change":"2024-03-16T20:55:05.291272+0000","last_active":"2024-03-16T20:56:33.102846+0000","last_peered":"2024-03-16T20:56:33.102846+0000","last_clean":"2024-03-16T20:56:33.102846+0000","last_became_active":"2024-03-16T20:55:05.290788+0000","last_became_peered":"2024-03-16T20:55:05.290788+0000","last_unstale":"2024-03-16T20:56:33.102846+0000","last_undegraded":"2024-03-16T20:56:33.102846+0000","last_fullsized":"2024-03-16T20:56:33.102846+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:36:42.842797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.089110+0000","last_change":"2024-03-16T20:55:05.289977+0000","last_active":"2024-03-16T20:56:33.089110+0000","last_peered":"2024-03-16T20:56:33.089110+0000","last_clean":"2024-03-16T20:56:33.089110+0000","last_became_active":"2024-03-16T20:55:05.289520+0000","last_became_peered":"2024-03-16T20:55:05.289520+0000","last_unstale":"2024-03-16T20:56:33.089110+0000","last_undegraded":"2024-03-16T20:56:33.089110+0000","last_fullsized":"2024-03-16T20:56:33.089110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:25:49.270854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092814+0000","last_change":"2024-03-16T20:55:05.286244+0000","last_active":"2024-03-16T20:56:33.092814+0000","last_peered":"2024-03-16T20:56:33.092814+0000","last_clean":"2024-03-16T20:56:33.092814+0000","last_became_active":"2024-03-16T20:55:05.285871+0000","last_became_peered":"2024-03-16T20:55:05.285871+0000","last_unstale":"2024-03-16T20:56:33.092814+0000","last_undegraded":"2024-03-16T20:56:33.092814+0000","last_fullsized":"2024-03-16T20:56:33.092814+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:24:47.334046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.116224+0000","last_change":"2024-03-16T20:55:05.293902+0000","last_active":"2024-03-16T20:56:33.116224+0000","last_peered":"2024-03-16T20:56:33.116224+0000","last_clean":"2024-03-16T20:56:33.116224+0000","last_became_active":"2024-03-16T20:55:05.284424+0000","last_became_peered":"2024-03-16T20:55:05.284424+0000","last_unstale":"2024-03-16T20:56:33.116224+0000","last_undegraded":"2024-03-16T20:56:33.116224+0000","last_fullsized":"2024-03-16T20:56:33.116224+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:09:15.024337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.096400+0000","last_change":"2024-03-16T20:55:05.271434+0000","last_active":"2024-03-16T20:56:33.096400+0000","last_peered":"2024-03-16T20:56:33.096400+0000","last_clean":"2024-03-16T20:56:33.096400+0000","last_became_active":"2024-03-16T20:55:05.271014+0000","last_became_peered":"2024-03-16T20:55:05.271014+0000","last_unstale":"2024-03-16T20:56:33.096400+0000","last_undegraded":"2024-03-16T20:56:33.096400+0000","last_fullsized":"2024-03-16T20:56:33.096400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:09:47.133987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092078+0000","last_change":"2024-03-16T20:55:05.275108+0000","last_active":"2024-03-16T20:56:33.092078+0000","last_peered":"2024-03-16T20:56:33.092078+0000","last_clean":"2024-03-16T20:56:33.092078+0000","last_became_active":"2024-03-16T20:55:05.274659+0000","last_became_peered":"2024-03-16T20:55:05.274659+0000","last_unstale":"2024-03-16T20:56:33.092078+0000","last_undegraded":"2024-03-16T20:56:33.092078+0000","last_fullsized":"2024-03-16T20:56:33.092078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:10:16.801309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092679+0000","last_change":"2024-03-16T20:55:05.273322+0000","last_active":"2024-03-16T20:56:33.092679+0000","last_peered":"2024-03-16T20:56:33.092679+0000","last_clean":"2024-03-16T20:56:33.092679+0000","last_became_active":"2024-03-16T20:55:05.272999+0000","last_became_peered":"2024-03-16T20:55:05.272999+0000","last_unstale":"2024-03-16T20:56:33.092679+0000","last_undegraded":"2024-03-16T20:56:33.092679+0000","last_fullsized":"2024-03-16T20:56:33.092679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:49:43.426765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.082928+0000","last_change":"2024-03-16T20:55:05.274729+0000","last_active":"2024-03-16T20:56:33.082928+0000","last_peered":"2024-03-16T20:56:33.082928+0000","last_clean":"2024-03-16T20:56:33.082928+0000","last_became_active":"2024-03-16T20:55:05.274131+0000","last_became_peered":"2024-03-16T20:55:05.274131+0000","last_unstale":"2024-03-16T20:56:33.082928+0000","last_undegraded":"2024-03-16T20:56:33.082928+0000","last_fullsized":"2024-03-16T20:56:33.082928+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:59:43.413956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123499+0000","last_change":"2024-03-16T20:56:04.522061+0000","last_active":"2024-03-16T20:56:33.123499+0000","last_peered":"2024-03-16T20:56:33.123499+0000","last_clean":"2024-03-16T20:56:33.123499+0000","last_became_active":"2024-03-16T20:56:04.521622+0000","last_became_peered":"2024-03-16T20:56:04.521622+0000","last_unstale":"2024-03-16T20:56:33.123499+0000","last_undegraded":"2024-03-16T20:56:33.123499+0000","last_fullsized":"2024-03-16T20:56:33.123499+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:00:52.309217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.122771+0000","last_change":"2024-03-16T20:55:05.282707+0000","last_active":"2024-03-16T20:56:33.122771+0000","last_peered":"2024-03-16T20:56:33.122771+0000","last_clean":"2024-03-16T20:56:33.122771+0000","last_became_active":"2024-03-16T20:55:05.282168+0000","last_became_peered":"2024-03-16T20:55:05.282168+0000","last_unstale":"2024-03-16T20:56:33.122771+0000","last_undegraded":"2024-03-16T20:56:33.122771+0000","last_fullsized":"2024-03-16T20:56:33.122771+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:33:59.464303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.120399+0000","last_change":"2024-03-16T20:55:05.290291+0000","last_active":"2024-03-16T20:56:33.120399+0000","last_peered":"2024-03-16T20:56:33.120399+0000","last_clean":"2024-03-16T20:56:33.120399+0000","last_became_active":"2024-03-16T20:55:05.289952+0000","last_became_peered":"2024-03-16T20:55:05.289952+0000","last_unstale":"2024-03-16T20:56:33.120399+0000","last_undegraded":"2024-03-16T20:56:33.120399+0000","last_fullsized":"2024-03-16T20:56:33.120399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:05.334408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123069+0000","last_change":"2024-03-16T20:55:05.284252+0000","last_active":"2024-03-16T20:56:33.123069+0000","last_peered":"2024-03-16T20:56:33.123069+0000","last_clean":"2024-03-16T20:56:33.123069+0000","last_became_active":"2024-03-16T20:55:05.283804+0000","last_became_peered":"2024-03-16T20:55:05.283804+0000","last_unstale":"2024-03-16T20:56:33.123069+0000","last_undegraded":"2024-03-16T20:56:33.123069+0000","last_fullsized":"2024-03-16T20:56:33.123069+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:03:17.942719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126588+0000","last_change":"2024-03-16T20:55:05.296118+0000","last_active":"2024-03-16T20:56:33.126588+0000","last_peered":"2024-03-16T20:56:33.126588+0000","last_clean":"2024-03-16T20:56:33.126588+0000","last_became_active":"2024-03-16T20:55:05.295783+0000","last_became_peered":"2024-03-16T20:55:05.295783+0000","last_unstale":"2024-03-16T20:56:33.126588+0000","last_undegraded":"2024-03-16T20:56:33.126588+0000","last_fullsized":"2024-03-16T20:56:33.126588+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:36:15.463748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.103440+0000","last_change":"2024-03-16T20:55:05.287221+0000","last_active":"2024-03-16T20:56:33.103440+0000","last_peered":"2024-03-16T20:56:33.103440+0000","last_clean":"2024-03-16T20:56:33.103440+0000","last_became_active":"2024-03-16T20:55:05.286553+0000","last_became_peered":"2024-03-16T20:55:05.286553+0000","last_unstale":"2024-03-16T20:56:33.103440+0000","last_undegraded":"2024-03-16T20:56:33.103440+0000","last_fullsized":"2024-03-16T20:56:33.103440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:33:25.688231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.108663+0000","last_change":"2024-03-16T20:55:05.280111+0000","last_active":"2024-03-16T20:56:33.108663+0000","last_peered":"2024-03-16T20:56:33.108663+0000","last_clean":"2024-03-16T20:56:33.108663+0000","last_became_active":"2024-03-16T20:55:05.279857+0000","last_became_peered":"2024-03-16T20:55:05.279857+0000","last_unstale":"2024-03-16T20:56:33.108663+0000","last_undegraded":"2024-03-16T20:56:33.108663+0000","last_fullsized":"2024-03-16T20:56:33.108663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:57:18.205253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516330+0000","last_change":"2024-03-16T20:55:04.268836+0000","last_active":"2024-03-16T20:56:04.516330+0000","last_peered":"2024-03-16T20:56:04.516330+0000","last_clean":"2024-03-16T20:56:04.516330+0000","last_became_active":"2024-03-16T20:55:04.266502+0000","last_became_peered":"2024-03-16T20:55:04.266502+0000","last_unstale":"2024-03-16T20:56:04.516330+0000","last_undegraded":"2024-03-16T20:56:04.516330+0000","last_fullsized":"2024-03-16T20:56:04.516330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:12:33.717454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.103940+0000","last_change":"2024-03-16T20:55:05.280158+0000","last_active":"2024-03-16T20:56:33.103940+0000","last_peered":"2024-03-16T20:56:33.103940+0000","last_clean":"2024-03-16T20:56:33.103940+0000","last_became_active":"2024-03-16T20:55:05.278918+0000","last_became_peered":"2024-03-16T20:55:05.278918+0000","last_unstale":"2024-03-16T20:56:33.103940+0000","last_undegraded":"2024-03-16T20:56:33.103940+0000","last_fullsized":"2024-03-16T20:56:33.103940+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:27:34.158596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513417+0000","last_change":"2024-03-16T20:55:04.283366+0000","last_active":"2024-03-16T20:56:04.513417+0000","last_peered":"2024-03-16T20:56:04.513417+0000","last_clean":"2024-03-16T20:56:04.513417+0000","last_became_active":"2024-03-16T20:55:04.283016+0000","last_became_peered":"2024-03-16T20:55:04.283016+0000","last_unstale":"2024-03-16T20:56:04.513417+0000","last_undegraded":"2024-03-16T20:56:04.513417+0000","last_fullsized":"2024-03-16T20:56:04.513417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:41.163294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.127403+0000","last_change":"2024-03-16T20:55:05.299005+0000","last_active":"2024-03-16T20:56:33.127403+0000","last_peered":"2024-03-16T20:56:33.127403+0000","last_clean":"2024-03-16T20:56:33.127403+0000","last_became_active":"2024-03-16T20:55:05.296527+0000","last_became_peered":"2024-03-16T20:55:05.296527+0000","last_unstale":"2024-03-16T20:56:33.127403+0000","last_undegraded":"2024-03-16T20:56:33.127403+0000","last_fullsized":"2024-03-16T20:56:33.127403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:56:51.451900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515248+0000","last_change":"2024-03-16T20:55:04.259210+0000","last_active":"2024-03-16T20:56:04.515248+0000","last_peered":"2024-03-16T20:56:04.515248+0000","last_clean":"2024-03-16T20:56:04.515248+0000","last_became_active":"2024-03-16T20:55:04.258828+0000","last_became_peered":"2024-03-16T20:55:04.258828+0000","last_unstale":"2024-03-16T20:56:04.515248+0000","last_undegraded":"2024-03-16T20:56:04.515248+0000","last_fullsized":"2024-03-16T20:56:04.515248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:21:14.497086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.117791+0000","last_change":"2024-03-16T20:55:05.272053+0000","last_active":"2024-03-16T20:56:33.117791+0000","last_peered":"2024-03-16T20:56:33.117791+0000","last_clean":"2024-03-16T20:56:33.117791+0000","last_became_active":"2024-03-16T20:55:05.271435+0000","last_became_peered":"2024-03-16T20:55:05.271435+0000","last_unstale":"2024-03-16T20:56:33.117791+0000","last_undegraded":"2024-03-16T20:56:33.117791+0000","last_fullsized":"2024-03-16T20:56:33.117791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:08:47.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514977+0000","last_change":"2024-03-16T20:55:04.261051+0000","last_active":"2024-03-16T20:56:04.514977+0000","last_peered":"2024-03-16T20:56:04.514977+0000","last_clean":"2024-03-16T20:56:04.514977+0000","last_became_active":"2024-03-16T20:55:04.260701+0000","last_became_peered":"2024-03-16T20:55:04.260701+0000","last_unstale":"2024-03-16T20:56:04.514977+0000","last_undegraded":"2024-03-16T20:56:04.514977+0000","last_fullsized":"2024-03-16T20:56:04.514977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:30:05.233891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.099430+0000","last_change":"2024-03-16T20:55:05.270047+0000","last_active":"2024-03-16T20:56:33.099430+0000","last_peered":"2024-03-16T20:56:33.099430+0000","last_clean":"2024-03-16T20:56:33.099430+0000","last_became_active":"2024-03-16T20:55:05.269045+0000","last_became_peered":"2024-03-16T20:55:05.269045+0000","last_unstale":"2024-03-16T20:56:33.099430+0000","last_undegraded":"2024-03-16T20:56:33.099430+0000","last_fullsized":"2024-03-16T20:56:33.099430+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:54:19.289648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":165,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:27.505419+0000","last_change":"2024-03-16T20:55:04.258871+0000","last_active":"2024-03-16T20:57:27.505419+0000","last_peered":"2024-03-16T20:57:27.505419+0000","last_clean":"2024-03-16T20:57:27.505419+0000","last_became_active":"2024-03-16T20:55:04.258462+0000","last_became_peered":"2024-03-16T20:55:04.258462+0000","last_unstale":"2024-03-16T20:57:27.505419+0000","last_undegraded":"2024-03-16T20:57:27.505419+0000","last_fullsized":"2024-03-16T20:57:27.505419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:16:29.832814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.086810+0000","last_change":"2024-03-16T20:55:05.290789+0000","last_active":"2024-03-16T20:56:33.086810+0000","last_peered":"2024-03-16T20:56:33.086810+0000","last_clean":"2024-03-16T20:56:33.086810+0000","last_became_active":"2024-03-16T20:55:05.290367+0000","last_became_peered":"2024-03-16T20:55:05.290367+0000","last_unstale":"2024-03-16T20:56:33.086810+0000","last_undegraded":"2024-03-16T20:56:33.086810+0000","last_fullsized":"2024-03-16T20:56:33.086810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:23:38.509837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513422+0000","last_change":"2024-03-16T20:55:04.264980+0000","last_active":"2024-03-16T20:56:04.513422+0000","last_peered":"2024-03-16T20:56:04.513422+0000","last_clean":"2024-03-16T20:56:04.513422+0000","last_became_active":"2024-03-16T20:55:04.264634+0000","last_became_peered":"2024-03-16T20:55:04.264634+0000","last_unstale":"2024-03-16T20:56:04.513422+0000","last_undegraded":"2024-03-16T20:56:04.513422+0000","last_fullsized":"2024-03-16T20:56:04.513422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:16:52.713847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.111066+0000","last_change":"2024-03-16T20:55:05.286139+0000","last_active":"2024-03-16T20:56:33.111066+0000","last_peered":"2024-03-16T20:56:33.111066+0000","last_clean":"2024-03-16T20:56:33.111066+0000","last_became_active":"2024-03-16T20:55:05.285751+0000","last_became_peered":"2024-03-16T20:55:05.285751+0000","last_unstale":"2024-03-16T20:56:33.111066+0000","last_undegraded":"2024-03-16T20:56:33.111066+0000","last_fullsized":"2024-03-16T20:56:33.111066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:01:02.448785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.517750+0000","last_change":"2024-03-16T20:55:04.282416+0000","last_active":"2024-03-16T20:56:04.517750+0000","last_peered":"2024-03-16T20:56:04.517750+0000","last_clean":"2024-03-16T20:56:04.517750+0000","last_became_active":"2024-03-16T20:55:04.280504+0000","last_became_peered":"2024-03-16T20:55:04.280504+0000","last_unstale":"2024-03-16T20:56:04.517750+0000","last_undegraded":"2024-03-16T20:56:04.517750+0000","last_fullsized":"2024-03-16T20:56:04.517750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:23.940976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123969+0000","last_change":"2024-03-16T20:55:05.289210+0000","last_active":"2024-03-16T20:56:33.123969+0000","last_peered":"2024-03-16T20:56:33.123969+0000","last_clean":"2024-03-16T20:56:33.123969+0000","last_became_active":"2024-03-16T20:55:05.286738+0000","last_became_peered":"2024-03-16T20:55:05.286738+0000","last_unstale":"2024-03-16T20:56:33.123969+0000","last_undegraded":"2024-03-16T20:56:33.123969+0000","last_fullsized":"2024-03-16T20:56:33.123969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:43:45.266727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605273+0000","last_change":"2024-03-16T20:55:04.258925+0000","last_active":"2024-03-16T20:56:04.605273+0000","last_peered":"2024-03-16T20:56:04.605273+0000","last_clean":"2024-03-16T20:56:04.605273+0000","last_became_active":"2024-03-16T20:55:04.258578+0000","last_became_peered":"2024-03-16T20:55:04.258578+0000","last_unstale":"2024-03-16T20:56:04.605273+0000","last_undegraded":"2024-03-16T20:56:04.605273+0000","last_fullsized":"2024-03-16T20:56:04.605273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:52.812547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.121075+0000","last_change":"2024-03-16T20:55:05.302122+0000","last_active":"2024-03-16T20:56:33.121075+0000","last_peered":"2024-03-16T20:56:33.121075+0000","last_clean":"2024-03-16T20:56:33.121075+0000","last_became_active":"2024-03-16T20:55:05.301743+0000","last_became_peered":"2024-03-16T20:55:05.301743+0000","last_unstale":"2024-03-16T20:56:33.121075+0000","last_undegraded":"2024-03-16T20:56:33.121075+0000","last_fullsized":"2024-03-16T20:56:33.121075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:32:51.691780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":164,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:29.507171+0000","last_change":"2024-03-16T20:55:04.270015+0000","last_active":"2024-03-16T20:57:29.507171+0000","last_peered":"2024-03-16T20:57:29.507171+0000","last_clean":"2024-03-16T20:57:29.507171+0000","last_became_active":"2024-03-16T20:55:04.269563+0000","last_became_peered":"2024-03-16T20:55:04.269563+0000","last_unstale":"2024-03-16T20:57:29.507171+0000","last_undegraded":"2024-03-16T20:57:29.507171+0000","last_fullsized":"2024-03-16T20:57:29.507171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:39:21.768540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.096449+0000","last_change":"2024-03-16T20:55:05.290639+0000","last_active":"2024-03-16T20:56:33.096449+0000","last_peered":"2024-03-16T20:56:33.096449+0000","last_clean":"2024-03-16T20:56:33.096449+0000","last_became_active":"2024-03-16T20:55:05.290255+0000","last_became_peered":"2024-03-16T20:55:05.290255+0000","last_unstale":"2024-03-16T20:56:33.096449+0000","last_undegraded":"2024-03-16T20:56:33.096449+0000","last_fullsized":"2024-03-16T20:56:33.096449+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:36:13.303557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930573+0000","last_change":"2024-03-16T20:55:04.260407+0000","last_active":"2024-03-16T20:56:04.930573+0000","last_peered":"2024-03-16T20:56:04.930573+0000","last_clean":"2024-03-16T20:56:04.930573+0000","last_became_active":"2024-03-16T20:55:04.259817+0000","last_became_peered":"2024-03-16T20:55:04.259817+0000","last_unstale":"2024-03-16T20:56:04.930573+0000","last_undegraded":"2024-03-16T20:56:04.930573+0000","last_fullsized":"2024-03-16T20:56:04.930573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:07.995508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126099+0000","last_change":"2024-03-16T20:55:05.295327+0000","last_active":"2024-03-16T20:56:33.126099+0000","last_peered":"2024-03-16T20:56:33.126099+0000","last_clean":"2024-03-16T20:56:33.126099+0000","last_became_active":"2024-03-16T20:55:05.294948+0000","last_became_peered":"2024-03-16T20:55:05.294948+0000","last_unstale":"2024-03-16T20:56:33.126099+0000","last_undegraded":"2024-03-16T20:56:33.126099+0000","last_fullsized":"2024-03-16T20:56:33.126099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:29.305366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605638+0000","last_change":"2024-03-16T20:55:04.264571+0000","last_active":"2024-03-16T20:56:04.605638+0000","last_peered":"2024-03-16T20:56:04.605638+0000","last_clean":"2024-03-16T20:56:04.605638+0000","last_became_active":"2024-03-16T20:55:04.264200+0000","last_became_peered":"2024-03-16T20:55:04.264200+0000","last_unstale":"2024-03-16T20:56:04.605638+0000","last_undegraded":"2024-03-16T20:56:04.605638+0000","last_fullsized":"2024-03-16T20:56:04.605638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:38:58.457250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.100869+0000","last_change":"2024-03-16T20:55:05.272855+0000","last_active":"2024-03-16T20:56:33.100869+0000","last_peered":"2024-03-16T20:56:33.100869+0000","last_clean":"2024-03-16T20:56:33.100869+0000","last_became_active":"2024-03-16T20:55:05.272500+0000","last_became_peered":"2024-03-16T20:55:05.272500+0000","last_unstale":"2024-03-16T20:56:33.100869+0000","last_undegraded":"2024-03-16T20:56:33.100869+0000","last_fullsized":"2024-03-16T20:56:33.100869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:50:17.121966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'37","reported_seq":348,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:29.507010+0000","last_change":"2024-03-16T20:55:04.260050+0000","last_active":"2024-03-16T20:57:29.507010+0000","last_peered":"2024-03-16T20:57:29.507010+0000","last_clean":"2024-03-16T20:57:29.507010+0000","last_became_active":"2024-03-16T20:55:04.259662+0000","last_became_peered":"2024-03-16T20:55:04.259662+0000","last_unstale":"2024-03-16T20:57:29.507010+0000","last_undegraded":"2024-03-16T20:57:29.507010+0000","last_fullsized":"2024-03-16T20:57:29.507010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:45:46.999980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64476,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":291,"num_read_kb":208,"num_write":38,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.090644+0000","last_change":"2024-03-16T20:55:05.272337+0000","last_active":"2024-03-16T20:56:33.090644+0000","last_peered":"2024-03-16T20:56:33.090644+0000","last_clean":"2024-03-16T20:56:33.090644+0000","last_became_active":"2024-03-16T20:55:05.271761+0000","last_became_peered":"2024-03-16T20:55:05.271761+0000","last_unstale":"2024-03-16T20:56:33.090644+0000","last_undegraded":"2024-03-16T20:56:33.090644+0000","last_fullsized":"2024-03-16T20:56:33.090644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:50:22.079709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513415+0000","last_change":"2024-03-16T20:55:04.275606+0000","last_active":"2024-03-16T20:56:04.513415+0000","last_peered":"2024-03-16T20:56:04.513415+0000","last_clean":"2024-03-16T20:56:04.513415+0000","last_became_active":"2024-03-16T20:55:04.275268+0000","last_became_peered":"2024-03-16T20:55:04.275268+0000","last_unstale":"2024-03-16T20:56:04.513415+0000","last_undegraded":"2024-03-16T20:56:04.513415+0000","last_fullsized":"2024-03-16T20:56:04.513415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:27:34.248831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.122124+0000","last_change":"2024-03-16T20:55:05.290619+0000","last_active":"2024-03-16T20:56:33.122124+0000","last_peered":"2024-03-16T20:56:33.122124+0000","last_clean":"2024-03-16T20:56:33.122124+0000","last_became_active":"2024-03-16T20:55:05.289943+0000","last_became_peered":"2024-03-16T20:55:05.289943+0000","last_unstale":"2024-03-16T20:56:33.122124+0000","last_undegraded":"2024-03-16T20:56:33.122124+0000","last_fullsized":"2024-03-16T20:56:33.122124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:30.569777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605298+0000","last_change":"2024-03-16T20:55:04.274206+0000","last_active":"2024-03-16T20:56:04.605298+0000","last_peered":"2024-03-16T20:56:04.605298+0000","last_clean":"2024-03-16T20:56:04.605298+0000","last_became_active":"2024-03-16T20:55:04.273834+0000","last_became_peered":"2024-03-16T20:55:04.273834+0000","last_unstale":"2024-03-16T20:56:04.605298+0000","last_undegraded":"2024-03-16T20:56:04.605298+0000","last_fullsized":"2024-03-16T20:56:04.605298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:36:04.720463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.125056+0000","last_change":"2024-03-16T20:55:05.280265+0000","last_active":"2024-03-16T20:56:33.125056+0000","last_peered":"2024-03-16T20:56:33.125056+0000","last_clean":"2024-03-16T20:56:33.125056+0000","last_became_active":"2024-03-16T20:55:05.279774+0000","last_became_peered":"2024-03-16T20:55:05.279774+0000","last_unstale":"2024-03-16T20:56:33.125056+0000","last_undegraded":"2024-03-16T20:56:33.125056+0000","last_fullsized":"2024-03-16T20:56:33.125056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:34:52.855290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":168,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:27.594571+0000","last_change":"2024-03-16T20:55:04.256314+0000","last_active":"2024-03-16T20:57:27.594571+0000","last_peered":"2024-03-16T20:57:27.594571+0000","last_clean":"2024-03-16T20:57:27.594571+0000","last_became_active":"2024-03-16T20:55:04.255940+0000","last_became_peered":"2024-03-16T20:55:04.255940+0000","last_unstale":"2024-03-16T20:57:27.594571+0000","last_undegraded":"2024-03-16T20:57:27.594571+0000","last_fullsized":"2024-03-16T20:57:27.594571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:27:09.660107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.097303+0000","last_change":"2024-03-16T20:55:05.271562+0000","last_active":"2024-03-16T20:56:33.097303+0000","last_peered":"2024-03-16T20:56:33.097303+0000","last_clean":"2024-03-16T20:56:33.097303+0000","last_became_active":"2024-03-16T20:55:05.271214+0000","last_became_peered":"2024-03-16T20:55:05.271214+0000","last_unstale":"2024-03-16T20:56:33.097303+0000","last_undegraded":"2024-03-16T20:56:33.097303+0000","last_fullsized":"2024-03-16T20:56:33.097303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:42:35.104345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.537648+0000","last_change":"2024-03-16T20:56:04.537276+0000","last_active":"2024-03-16T20:56:04.537648+0000","last_peered":"2024-03-16T20:56:04.537648+0000","last_clean":"2024-03-16T20:56:04.537648+0000","last_became_active":"2024-03-16T20:56:04.526059+0000","last_became_peered":"2024-03-16T20:56:04.526059+0000","last_unstale":"2024-03-16T20:56:04.537648+0000","last_undegraded":"2024-03-16T20:56:04.537648+0000","last_fullsized":"2024-03-16T20:56:04.537648+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:17:50.898269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.098918+0000","last_change":"2024-03-16T20:55:05.269751+0000","last_active":"2024-03-16T20:56:33.098918+0000","last_peered":"2024-03-16T20:56:33.098918+0000","last_clean":"2024-03-16T20:56:33.098918+0000","last_became_active":"2024-03-16T20:55:05.269375+0000","last_became_peered":"2024-03-16T20:55:05.269375+0000","last_unstale":"2024-03-16T20:56:33.098918+0000","last_undegraded":"2024-03-16T20:56:33.098918+0000","last_fullsized":"2024-03-16T20:56:33.098918+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:57:00.751155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515295+0000","last_change":"2024-03-16T20:55:04.254352+0000","last_active":"2024-03-16T20:56:04.515295+0000","last_peered":"2024-03-16T20:56:04.515295+0000","last_clean":"2024-03-16T20:56:04.515295+0000","last_became_active":"2024-03-16T20:55:04.253895+0000","last_became_peered":"2024-03-16T20:55:04.253895+0000","last_unstale":"2024-03-16T20:56:04.515295+0000","last_undegraded":"2024-03-16T20:56:04.515295+0000","last_fullsized":"2024-03-16T20:56:04.515295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:35:15.796341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.083605+0000","last_change":"2024-03-16T20:55:05.271148+0000","last_active":"2024-03-16T20:56:33.083605+0000","last_peered":"2024-03-16T20:56:33.083605+0000","last_clean":"2024-03-16T20:56:33.083605+0000","last_became_active":"2024-03-16T20:55:05.270836+0000","last_became_peered":"2024-03-16T20:55:05.270836+0000","last_unstale":"2024-03-16T20:56:33.083605+0000","last_undegraded":"2024-03-16T20:56:33.083605+0000","last_fullsized":"2024-03-16T20:56:33.083605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:12:49.526828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516195+0000","last_change":"2024-03-16T20:55:04.277152+0000","last_active":"2024-03-16T20:56:04.516195+0000","last_peered":"2024-03-16T20:56:04.516195+0000","last_clean":"2024-03-16T20:56:04.516195+0000","last_became_active":"2024-03-16T20:55:04.276666+0000","last_became_peered":"2024-03-16T20:55:04.276666+0000","last_unstale":"2024-03-16T20:56:04.516195+0000","last_undegraded":"2024-03-16T20:56:04.516195+0000","last_fullsized":"2024-03-16T20:56:04.516195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:39:04.919957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.097762+0000","last_change":"2024-03-16T20:56:04.529323+0000","last_active":"2024-03-16T20:56:33.097762+0000","last_peered":"2024-03-16T20:56:33.097762+0000","last_clean":"2024-03-16T20:56:33.097762+0000","last_became_active":"2024-03-16T20:56:04.521484+0000","last_became_peered":"2024-03-16T20:56:04.521484+0000","last_unstale":"2024-03-16T20:56:33.097762+0000","last_undegraded":"2024-03-16T20:56:33.097762+0000","last_fullsized":"2024-03-16T20:56:33.097762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:00:31.203774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930141+0000","last_change":"2024-03-16T20:55:04.270960+0000","last_active":"2024-03-16T20:56:04.930141+0000","last_peered":"2024-03-16T20:56:04.930141+0000","last_clean":"2024-03-16T20:56:04.930141+0000","last_became_active":"2024-03-16T20:55:04.270605+0000","last_became_peered":"2024-03-16T20:55:04.270605+0000","last_unstale":"2024-03-16T20:56:04.930141+0000","last_undegraded":"2024-03-16T20:56:04.930141+0000","last_fullsized":"2024-03-16T20:56:04.930141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:06:53.529116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.120497+0000","last_change":"2024-03-16T20:55:05.303690+0000","last_active":"2024-03-16T20:56:33.120497+0000","last_peered":"2024-03-16T20:56:33.120497+0000","last_clean":"2024-03-16T20:56:33.120497+0000","last_became_active":"2024-03-16T20:55:05.303096+0000","last_became_peered":"2024-03-16T20:55:05.303096+0000","last_unstale":"2024-03-16T20:56:33.120497+0000","last_undegraded":"2024-03-16T20:56:33.120497+0000","last_fullsized":"2024-03-16T20:56:33.120497+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:03:25.139693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.082999+0000","last_change":"2024-03-16T20:55:05.268277+0000","last_active":"2024-03-16T20:56:33.082999+0000","last_peered":"2024-03-16T20:56:33.082999+0000","last_clean":"2024-03-16T20:56:33.082999+0000","last_became_active":"2024-03-16T20:55:05.267955+0000","last_became_peered":"2024-03-16T20:55:05.267955+0000","last_unstale":"2024-03-16T20:56:33.082999+0000","last_undegraded":"2024-03-16T20:56:33.082999+0000","last_fullsized":"2024-03-16T20:56:33.082999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:20:21.633055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":167,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:30.600026+0000","last_change":"2024-03-16T20:55:04.277286+0000","last_active":"2024-03-16T20:57:30.600026+0000","last_peered":"2024-03-16T20:57:30.600026+0000","last_clean":"2024-03-16T20:57:30.600026+0000","last_became_active":"2024-03-16T20:55:04.276855+0000","last_became_peered":"2024-03-16T20:55:04.276855+0000","last_unstale":"2024-03-16T20:57:30.600026+0000","last_undegraded":"2024-03-16T20:57:30.600026+0000","last_fullsized":"2024-03-16T20:57:30.600026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:22:19.590782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.113733+0000","last_change":"2024-03-16T20:55:05.280255+0000","last_active":"2024-03-16T20:56:33.113733+0000","last_peered":"2024-03-16T20:56:33.113733+0000","last_clean":"2024-03-16T20:56:33.113733+0000","last_became_active":"2024-03-16T20:55:05.279762+0000","last_became_peered":"2024-03-16T20:55:05.279762+0000","last_unstale":"2024-03-16T20:56:33.113733+0000","last_undegraded":"2024-03-16T20:56:33.113733+0000","last_fullsized":"2024-03-16T20:56:33.113733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:31.687047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903922+0000","last_change":"2024-03-16T20:55:04.263605+0000","last_active":"2024-03-16T20:56:04.903922+0000","last_peered":"2024-03-16T20:56:04.903922+0000","last_clean":"2024-03-16T20:56:04.903922+0000","last_became_active":"2024-03-16T20:55:04.263189+0000","last_became_peered":"2024-03-16T20:55:04.263189+0000","last_unstale":"2024-03-16T20:56:04.903922+0000","last_undegraded":"2024-03-16T20:56:04.903922+0000","last_fullsized":"2024-03-16T20:56:04.903922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:28:11.377134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":352,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930006+0000","last_change":"2024-03-16T20:53:44.281432+0000","last_active":"2024-03-16T20:56:04.930006+0000","last_peered":"2024-03-16T20:56:04.930006+0000","last_clean":"2024-03-16T20:56:04.930006+0000","last_became_active":"2024-03-16T20:53:44.280927+0000","last_became_peered":"2024-03-16T20:53:44.280927+0000","last_unstale":"2024-03-16T20:56:04.930006+0000","last_undegraded":"2024-03-16T20:56:04.930006+0000","last_fullsized":"2024-03-16T20:56:04.930006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_clean_scrub_stamp":"2024-03-16T20:49:51.705234+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:01:00.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123405+0000","last_change":"2024-03-16T20:56:04.525541+0000","last_active":"2024-03-16T20:56:33.123405+0000","last_peered":"2024-03-16T20:56:33.123405+0000","last_clean":"2024-03-16T20:56:33.123405+0000","last_became_active":"2024-03-16T20:56:04.522548+0000","last_became_peered":"2024-03-16T20:56:04.522548+0000","last_unstale":"2024-03-16T20:56:33.123405+0000","last_undegraded":"2024-03-16T20:56:33.123405+0000","last_fullsized":"2024-03-16T20:56:33.123405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:35:54.115845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930116+0000","last_change":"2024-03-16T20:55:04.256842+0000","last_active":"2024-03-16T20:56:04.930116+0000","last_peered":"2024-03-16T20:56:04.930116+0000","last_clean":"2024-03-16T20:56:04.930116+0000","last_became_active":"2024-03-16T20:55:04.256493+0000","last_became_peered":"2024-03-16T20:55:04.256493+0000","last_unstale":"2024-03-16T20:56:04.930116+0000","last_undegraded":"2024-03-16T20:56:04.930116+0000","last_fullsized":"2024-03-16T20:56:04.930116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:08.836034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515149+0000","last_change":"2024-03-16T20:55:04.265503+0000","last_active":"2024-03-16T20:56:04.515149+0000","last_peered":"2024-03-16T20:56:04.515149+0000","last_clean":"2024-03-16T20:56:04.515149+0000","last_became_active":"2024-03-16T20:55:04.265017+0000","last_became_peered":"2024-03-16T20:55:04.265017+0000","last_unstale":"2024-03-16T20:56:04.515149+0000","last_undegraded":"2024-03-16T20:56:04.515149+0000","last_fullsized":"2024-03-16T20:56:04.515149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:28.485079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.115525+0000","last_change":"2024-03-16T20:55:05.289100+0000","last_active":"2024-03-16T20:56:33.115525+0000","last_peered":"2024-03-16T20:56:33.115525+0000","last_clean":"2024-03-16T20:56:33.115525+0000","last_became_active":"2024-03-16T20:55:05.288122+0000","last_became_peered":"2024-03-16T20:55:05.288122+0000","last_unstale":"2024-03-16T20:56:33.115525+0000","last_undegraded":"2024-03-16T20:56:33.115525+0000","last_fullsized":"2024-03-16T20:56:33.115525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:03.222038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:14.360616+0000","last_change":"2024-03-16T20:55:04.282230+0000","last_active":"2024-03-16T20:57:14.360616+0000","last_peered":"2024-03-16T20:57:14.360616+0000","last_clean":"2024-03-16T20:57:14.360616+0000","last_became_active":"2024-03-16T20:55:04.281917+0000","last_became_peered":"2024-03-16T20:55:04.281917+0000","last_unstale":"2024-03-16T20:57:14.360616+0000","last_undegraded":"2024-03-16T20:57:14.360616+0000","last_fullsized":"2024-03-16T20:57:14.360616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:18:36.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.117621+0000","last_change":"2024-03-16T20:55:05.293378+0000","last_active":"2024-03-16T20:56:33.117621+0000","last_peered":"2024-03-16T20:56:33.117621+0000","last_clean":"2024-03-16T20:56:33.117621+0000","last_became_active":"2024-03-16T20:55:05.288648+0000","last_became_peered":"2024-03-16T20:55:05.288648+0000","last_unstale":"2024-03-16T20:56:33.117621+0000","last_undegraded":"2024-03-16T20:56:33.117621+0000","last_fullsized":"2024-03-16T20:56:33.117621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:37:58.270760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903998+0000","last_change":"2024-03-16T20:55:04.268766+0000","last_active":"2024-03-16T20:56:04.903998+0000","last_peered":"2024-03-16T20:56:04.903998+0000","last_clean":"2024-03-16T20:56:04.903998+0000","last_became_active":"2024-03-16T20:55:04.268429+0000","last_became_peered":"2024-03-16T20:55:04.268429+0000","last_unstale":"2024-03-16T20:56:04.903998+0000","last_undegraded":"2024-03-16T20:56:04.903998+0000","last_fullsized":"2024-03-16T20:56:04.903998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:43.872155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.127101+0000","last_change":"2024-03-16T20:55:05.310349+0000","last_active":"2024-03-16T20:56:33.127101+0000","last_peered":"2024-03-16T20:56:33.127101+0000","last_clean":"2024-03-16T20:56:33.127101+0000","last_became_active":"2024-03-16T20:55:05.307987+0000","last_became_peered":"2024-03-16T20:55:05.307987+0000","last_unstale":"2024-03-16T20:56:33.127101+0000","last_undegraded":"2024-03-16T20:56:33.127101+0000","last_fullsized":"2024-03-16T20:56:33.127101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:19:38.142783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929413+0000","last_change":"2024-03-16T20:55:04.269683+0000","last_active":"2024-03-16T20:56:04.929413+0000","last_peered":"2024-03-16T20:56:04.929413+0000","last_clean":"2024-03-16T20:56:04.929413+0000","last_became_active":"2024-03-16T20:55:04.269258+0000","last_became_peered":"2024-03-16T20:55:04.269258+0000","last_unstale":"2024-03-16T20:56:04.929413+0000","last_undegraded":"2024-03-16T20:56:04.929413+0000","last_fullsized":"2024-03-16T20:56:04.929413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:24:10.417179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.073581+0000","last_change":"2024-03-16T20:55:05.272238+0000","last_active":"2024-03-16T20:56:33.073581+0000","last_peered":"2024-03-16T20:56:33.073581+0000","last_clean":"2024-03-16T20:56:33.073581+0000","last_became_active":"2024-03-16T20:55:05.270379+0000","last_became_peered":"2024-03-16T20:55:05.270379+0000","last_unstale":"2024-03-16T20:56:33.073581+0000","last_undegraded":"2024-03-16T20:56:33.073581+0000","last_fullsized":"2024-03-16T20:56:33.073581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:16:11.348601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512181+0000","last_change":"2024-03-16T20:55:04.280008+0000","last_active":"2024-03-16T20:56:04.512181+0000","last_peered":"2024-03-16T20:56:04.512181+0000","last_clean":"2024-03-16T20:56:04.512181+0000","last_became_active":"2024-03-16T20:55:04.279683+0000","last_became_peered":"2024-03-16T20:55:04.279683+0000","last_unstale":"2024-03-16T20:56:04.512181+0000","last_undegraded":"2024-03-16T20:56:04.512181+0000","last_fullsized":"2024-03-16T20:56:04.512181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:15.734826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.121869+0000","last_change":"2024-03-16T20:55:05.287219+0000","last_active":"2024-03-16T20:56:33.121869+0000","last_peered":"2024-03-16T20:56:33.121869+0000","last_clean":"2024-03-16T20:56:33.121869+0000","last_became_active":"2024-03-16T20:55:05.286899+0000","last_became_peered":"2024-03-16T20:55:05.286899+0000","last_unstale":"2024-03-16T20:56:33.121869+0000","last_undegraded":"2024-03-16T20:56:33.121869+0000","last_fullsized":"2024-03-16T20:56:33.121869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:33:01.483415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:06.416690+0000","last_change":"2024-03-16T20:56:04.520433+0000","last_active":"2024-03-16T20:56:06.416690+0000","last_peered":"2024-03-16T20:56:06.416690+0000","last_clean":"2024-03-16T20:56:06.416690+0000","last_became_active":"2024-03-16T20:56:04.516521+0000","last_became_peered":"2024-03-16T20:56:04.516521+0000","last_unstale":"2024-03-16T20:56:06.416690+0000","last_undegraded":"2024-03-16T20:56:06.416690+0000","last_fullsized":"2024-03-16T20:56:06.416690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:44:38.094213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126424+0000","last_change":"2024-03-16T20:55:05.311463+0000","last_active":"2024-03-16T20:56:33.126424+0000","last_peered":"2024-03-16T20:56:33.126424+0000","last_clean":"2024-03-16T20:56:33.126424+0000","last_became_active":"2024-03-16T20:55:05.310852+0000","last_became_peered":"2024-03-16T20:55:05.310852+0000","last_unstale":"2024-03-16T20:56:33.126424+0000","last_undegraded":"2024-03-16T20:56:33.126424+0000","last_fullsized":"2024-03-16T20:56:33.126424+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:51:52.980193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514650+0000","last_change":"2024-03-16T20:55:04.260372+0000","last_active":"2024-03-16T20:56:04.514650+0000","last_peered":"2024-03-16T20:56:04.514650+0000","last_clean":"2024-03-16T20:56:04.514650+0000","last_became_active":"2024-03-16T20:55:04.259273+0000","last_became_peered":"2024-03-16T20:55:04.259273+0000","last_unstale":"2024-03-16T20:56:04.514650+0000","last_undegraded":"2024-03-16T20:56:04.514650+0000","last_fullsized":"2024-03-16T20:56:04.514650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:21:25.212520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123563+0000","last_change":"2024-03-16T20:55:05.280088+0000","last_active":"2024-03-16T20:56:33.123563+0000","last_peered":"2024-03-16T20:56:33.123563+0000","last_clean":"2024-03-16T20:56:33.123563+0000","last_became_active":"2024-03-16T20:55:05.279745+0000","last_became_peered":"2024-03-16T20:55:05.279745+0000","last_unstale":"2024-03-16T20:56:33.123563+0000","last_undegraded":"2024-03-16T20:56:33.123563+0000","last_fullsized":"2024-03-16T20:56:33.123563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:02:08.797287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513571+0000","last_change":"2024-03-16T20:55:04.275221+0000","last_active":"2024-03-16T20:56:04.513571+0000","last_peered":"2024-03-16T20:56:04.513571+0000","last_clean":"2024-03-16T20:56:04.513571+0000","last_became_active":"2024-03-16T20:55:04.274887+0000","last_became_peered":"2024-03-16T20:55:04.274887+0000","last_unstale":"2024-03-16T20:56:04.513571+0000","last_undegraded":"2024-03-16T20:56:04.513571+0000","last_fullsized":"2024-03-16T20:56:04.513571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:35.333864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.100949+0000","last_change":"2024-03-16T20:55:05.272444+0000","last_active":"2024-03-16T20:56:33.100949+0000","last_peered":"2024-03-16T20:56:33.100949+0000","last_clean":"2024-03-16T20:56:33.100949+0000","last_became_active":"2024-03-16T20:55:05.272104+0000","last_became_peered":"2024-03-16T20:55:05.272104+0000","last_unstale":"2024-03-16T20:56:33.100949+0000","last_undegraded":"2024-03-16T20:56:33.100949+0000","last_fullsized":"2024-03-16T20:56:33.100949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:35.480408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605424+0000","last_change":"2024-03-16T20:55:04.274212+0000","last_active":"2024-03-16T20:56:04.605424+0000","last_peered":"2024-03-16T20:56:04.605424+0000","last_clean":"2024-03-16T20:56:04.605424+0000","last_became_active":"2024-03-16T20:55:04.273785+0000","last_became_peered":"2024-03-16T20:55:04.273785+0000","last_unstale":"2024-03-16T20:56:04.605424+0000","last_undegraded":"2024-03-16T20:56:04.605424+0000","last_fullsized":"2024-03-16T20:56:04.605424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:29:00.924789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.108284+0000","last_change":"2024-03-16T20:55:05.278590+0000","last_active":"2024-03-16T20:56:33.108284+0000","last_peered":"2024-03-16T20:56:33.108284+0000","last_clean":"2024-03-16T20:56:33.108284+0000","last_became_active":"2024-03-16T20:55:05.278183+0000","last_became_peered":"2024-03-16T20:55:05.278183+0000","last_unstale":"2024-03-16T20:56:33.108284+0000","last_undegraded":"2024-03-16T20:56:33.108284+0000","last_fullsized":"2024-03-16T20:56:33.108284+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:52:18.918653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515951+0000","last_change":"2024-03-16T20:55:04.279568+0000","last_active":"2024-03-16T20:56:04.515951+0000","last_peered":"2024-03-16T20:56:04.515951+0000","last_clean":"2024-03-16T20:56:04.515951+0000","last_became_active":"2024-03-16T20:55:04.278125+0000","last_became_peered":"2024-03-16T20:55:04.278125+0000","last_unstale":"2024-03-16T20:56:04.515951+0000","last_undegraded":"2024-03-16T20:56:04.515951+0000","last_fullsized":"2024-03-16T20:56:04.515951+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:13:20.417216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092744+0000","last_change":"2024-03-16T20:55:05.269732+0000","last_active":"2024-03-16T20:56:33.092744+0000","last_peered":"2024-03-16T20:56:33.092744+0000","last_clean":"2024-03-16T20:56:33.092744+0000","last_became_active":"2024-03-16T20:55:05.269260+0000","last_became_peered":"2024-03-16T20:55:05.269260+0000","last_unstale":"2024-03-16T20:56:33.092744+0000","last_undegraded":"2024-03-16T20:56:33.092744+0000","last_fullsized":"2024-03-16T20:56:33.092744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:10:03.312009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.081302+0000","last_change":"2024-03-16T20:55:05.272321+0000","last_active":"2024-03-16T20:56:33.081302+0000","last_peered":"2024-03-16T20:56:33.081302+0000","last_clean":"2024-03-16T20:56:33.081302+0000","last_became_active":"2024-03-16T20:55:05.272000+0000","last_became_peered":"2024-03-16T20:55:05.272000+0000","last_unstale":"2024-03-16T20:56:33.081302+0000","last_undegraded":"2024-03-16T20:56:33.081302+0000","last_fullsized":"2024-03-16T20:56:33.081302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:04:44.773709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.093650+0000","last_change":"2024-03-16T20:56:04.931594+0000","last_active":"2024-03-16T20:56:33.093650+0000","last_peered":"2024-03-16T20:56:33.093650+0000","last_clean":"2024-03-16T20:56:33.093650+0000","last_became_active":"2024-03-16T20:56:04.931169+0000","last_became_peered":"2024-03-16T20:56:04.931169+0000","last_unstale":"2024-03-16T20:56:33.093650+0000","last_undegraded":"2024-03-16T20:56:33.093650+0000","last_fullsized":"2024-03-16T20:56:33.093650+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:32:34.858387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.121535+0000","last_change":"2024-03-16T20:55:05.287329+0000","last_active":"2024-03-16T20:56:33.121535+0000","last_peered":"2024-03-16T20:56:33.121535+0000","last_clean":"2024-03-16T20:56:33.121535+0000","last_became_active":"2024-03-16T20:55:05.286893+0000","last_became_peered":"2024-03-16T20:55:05.286893+0000","last_unstale":"2024-03-16T20:56:33.121535+0000","last_undegraded":"2024-03-16T20:56:33.121535+0000","last_fullsized":"2024-03-16T20:56:33.121535+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:43:29.560525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.127233+0000","last_change":"2024-03-16T20:56:04.528956+0000","last_active":"2024-03-16T20:56:33.127233+0000","last_peered":"2024-03-16T20:56:33.127233+0000","last_clean":"2024-03-16T20:56:33.127233+0000","last_became_active":"2024-03-16T20:56:04.528503+0000","last_became_peered":"2024-03-16T20:56:04.528503+0000","last_unstale":"2024-03-16T20:56:33.127233+0000","last_undegraded":"2024-03-16T20:56:33.127233+0000","last_fullsized":"2024-03-16T20:56:33.127233+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:48:36.267693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126512+0000","last_change":"2024-03-16T20:55:05.300207+0000","last_active":"2024-03-16T20:56:33.126512+0000","last_peered":"2024-03-16T20:56:33.126512+0000","last_clean":"2024-03-16T20:56:33.126512+0000","last_became_active":"2024-03-16T20:55:05.298892+0000","last_became_peered":"2024-03-16T20:55:05.298892+0000","last_unstale":"2024-03-16T20:56:33.126512+0000","last_undegraded":"2024-03-16T20:56:33.126512+0000","last_fullsized":"2024-03-16T20:56:33.126512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:29.158690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.076742+0000","last_change":"2024-03-16T20:55:05.272135+0000","last_active":"2024-03-16T20:56:33.076742+0000","last_peered":"2024-03-16T20:56:33.076742+0000","last_clean":"2024-03-16T20:56:33.076742+0000","last_became_active":"2024-03-16T20:55:05.271779+0000","last_became_peered":"2024-03-16T20:55:05.271779+0000","last_unstale":"2024-03-16T20:56:33.076742+0000","last_undegraded":"2024-03-16T20:56:33.076742+0000","last_fullsized":"2024-03-16T20:56:33.076742+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:42:58.085726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.091576+0000","last_change":"2024-03-16T20:55:05.268810+0000","last_active":"2024-03-16T20:56:33.091576+0000","last_peered":"2024-03-16T20:56:33.091576+0000","last_clean":"2024-03-16T20:56:33.091576+0000","last_became_active":"2024-03-16T20:55:05.268473+0000","last_became_peered":"2024-03-16T20:55:05.268473+0000","last_unstale":"2024-03-16T20:56:33.091576+0000","last_undegraded":"2024-03-16T20:56:33.091576+0000","last_fullsized":"2024-03-16T20:56:33.091576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:48:00.990207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.105929+0000","last_change":"2024-03-16T20:55:05.284121+0000","last_active":"2024-03-16T20:56:33.105929+0000","last_peered":"2024-03-16T20:56:33.105929+0000","last_clean":"2024-03-16T20:56:33.105929+0000","last_became_active":"2024-03-16T20:55:05.283588+0000","last_became_peered":"2024-03-16T20:55:05.283588+0000","last_unstale":"2024-03-16T20:56:33.105929+0000","last_undegraded":"2024-03-16T20:56:33.105929+0000","last_fullsized":"2024-03-16T20:56:33.105929+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:05:56.679346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.118595+0000","last_change":"2024-03-16T20:56:04.525435+0000","last_active":"2024-03-16T20:56:33.118595+0000","last_peered":"2024-03-16T20:56:33.118595+0000","last_clean":"2024-03-16T20:56:33.118595+0000","last_became_active":"2024-03-16T20:56:04.524924+0000","last_became_peered":"2024-03-16T20:56:04.524924+0000","last_unstale":"2024-03-16T20:56:33.118595+0000","last_undegraded":"2024-03-16T20:56:33.118595+0000","last_fullsized":"2024-03-16T20:56:33.118595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:36:49.367824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.107415+0000","last_change":"2024-03-16T20:55:05.277957+0000","last_active":"2024-03-16T20:56:33.107415+0000","last_peered":"2024-03-16T20:56:33.107415+0000","last_clean":"2024-03-16T20:56:33.107415+0000","last_became_active":"2024-03-16T20:55:05.277610+0000","last_became_peered":"2024-03-16T20:55:05.277610+0000","last_unstale":"2024-03-16T20:56:33.107415+0000","last_undegraded":"2024-03-16T20:56:33.107415+0000","last_fullsized":"2024-03-16T20:56:33.107415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:54:29.010945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.111826+0000","last_change":"2024-03-16T20:55:05.288112+0000","last_active":"2024-03-16T20:56:33.111826+0000","last_peered":"2024-03-16T20:56:33.111826+0000","last_clean":"2024-03-16T20:56:33.111826+0000","last_became_active":"2024-03-16T20:55:05.287791+0000","last_became_peered":"2024-03-16T20:55:05.287791+0000","last_unstale":"2024-03-16T20:56:33.111826+0000","last_undegraded":"2024-03-16T20:56:33.111826+0000","last_fullsized":"2024-03-16T20:56:33.111826+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:55:57.625981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126740+0000","last_change":"2024-03-16T20:55:05.311327+0000","last_active":"2024-03-16T20:56:33.126740+0000","last_peered":"2024-03-16T20:56:33.126740+0000","last_clean":"2024-03-16T20:56:33.126740+0000","last_became_active":"2024-03-16T20:55:05.310820+0000","last_became_peered":"2024-03-16T20:55:05.310820+0000","last_unstale":"2024-03-16T20:56:33.126740+0000","last_undegraded":"2024-03-16T20:56:33.126740+0000","last_fullsized":"2024-03-16T20:56:33.126740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:38:26.081078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.083750+0000","last_change":"2024-03-16T20:55:05.277942+0000","last_active":"2024-03-16T20:56:33.083750+0000","last_peered":"2024-03-16T20:56:33.083750+0000","last_clean":"2024-03-16T20:56:33.083750+0000","last_became_active":"2024-03-16T20:55:05.277588+0000","last_became_peered":"2024-03-16T20:55:05.277588+0000","last_unstale":"2024-03-16T20:56:33.083750+0000","last_undegraded":"2024-03-16T20:56:33.083750+0000","last_fullsized":"2024-03-16T20:56:33.083750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:32:38.464939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":211842,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68928,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":869,"num_read_kb":509,"num_write":177,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":206784,"data_compressed":5547,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351019,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":459360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612656,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":1115737,"data_compressed":37704,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776181,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":970752,"data_stored":459601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037821,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":958464,"data_stored":459292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":1051785,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462983,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":458873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":523142,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":460144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411424,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1040384,"data_stored":524802,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149784,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":459067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888147,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":459842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724621,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1050627,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":64476,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66136,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66586,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T20:57:34.650 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T20:57:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.905+0000 7f7846800640 1 -- 172.21.15.8:0/2740261548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78400ffde0 msgr2=0x7f7840100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.905+0000 7f7846800640 1 --2- 172.21.15.8:0/2740261548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78400ffde0 0x7f7840100200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7830009900 tx=0x7f783002bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.905+0000 7f7846800640 1 -- 172.21.15.8:0/2740261548 shutdown_connections 2024-03-16T20:57:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.905+0000 7f7846800640 1 --2- 172.21.15.8:0/2740261548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78401010e0 0x7f7840101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.905+0000 7f7846800640 1 --2- 172.21.15.8:0/2740261548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7840100740 0x7f7840100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.905+0000 7f7846800640 1 --2- 172.21.15.8:0/2740261548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78400ffde0 0x7f7840100200 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.905+0000 7f7846800640 1 -- 172.21.15.8:0/2740261548 >> 172.21.15.8:0/2740261548 conn(0x7f78400fb980 msgr2=0x7f78400fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.905+0000 7f7846800640 1 -- 172.21.15.8:0/2740261548 shutdown_connections 2024-03-16T20:57:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.905+0000 7f7846800640 1 -- 172.21.15.8:0/2740261548 wait complete. 2024-03-16T20:57:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.906+0000 7f7846800640 1 Processor -- start 2024-03-16T20:57:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.906+0000 7f7846800640 1 -- start start 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.906+0000 7f7846800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78400ffde0 0x7f7840199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.906+0000 7f7846800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7840100740 0x7f7840199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.906+0000 7f7846800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78401010e0 0x7f78401a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.906+0000 7f7846800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78401a1310 con 0x7f78401010e0 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.906+0000 7f7846800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78401a1480 con 0x7f7840100740 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.906+0000 7f7846800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78401a1640 con 0x7f78400ffde0 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7840100740 0x7f7840199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78400ffde0 0x7f7840199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7840100740 0x7f7840199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40808/0 (socket says 172.21.15.8:40808) 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783ea00640 1 -- 172.21.15.8:0/3357680805 learned_addr learned my addr 172.21.15.8:0/3357680805 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783fe00640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78401010e0 0x7f78401a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783f400640 1 -- 172.21.15.8:0/3357680805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7840100740 msgr2=0x7f7840199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783f400640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7840100740 0x7f7840199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783f400640 1 -- 172.21.15.8:0/3357680805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78401010e0 msgr2=0x7f78401a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783f400640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78401010e0 0x7f78401a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783f400640 1 -- 172.21.15.8:0/3357680805 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7830009560 con 0x7f78400ffde0 2024-03-16T20:57:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783fe00640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78401010e0 0x7f78401a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.907+0000 7f783ea00640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7840100740 0x7f7840199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.908+0000 7f783f400640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78400ffde0 0x7f7840199820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7830036040 tx=0x7f7830005e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.908+0000 7f7837e00640 1 -- 172.21.15.8:0/3357680805 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830004490 con 0x7f78400ffde0 2024-03-16T20:57:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.908+0000 7f7837e00640 1 -- 172.21.15.8:0/3357680805 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7830005310 con 0x7f78400ffde0 2024-03-16T20:57:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.908+0000 7f7837e00640 1 -- 172.21.15.8:0/3357680805 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830003d90 con 0x7f78400ffde0 2024-03-16T20:57:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.908+0000 7f7846800640 1 -- 172.21.15.8:0/3357680805 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78401a18c0 con 0x7f78400ffde0 2024-03-16T20:57:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.908+0000 7f7846800640 1 -- 172.21.15.8:0/3357680805 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78401a1df0 con 0x7f78400ffde0 2024-03-16T20:57:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.909+0000 7f7846800640 1 -- 172.21.15.8:0/3357680805 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784010ac80 con 0x7f78400ffde0 2024-03-16T20:57:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.911+0000 7f7837e00640 1 -- 172.21.15.8:0/3357680805 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f7830005480 con 0x7f78400ffde0 2024-03-16T20:57:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.912+0000 7f7837e00640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f78240a1ab0 0x7f78240a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.912+0000 7f7837e00640 1 -- 172.21.15.8:0/3357680805 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f78300efae0 con 0x7f78400ffde0 2024-03-16T20:57:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.913+0000 7f783ea00640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f78240a1ab0 0x7f78240a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.913+0000 7f783ea00640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f78240a1ab0 0x7f78240a3f70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f784019ad30 tx=0x7f782c00b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:34.919+0000 7f7837e00640 1 -- 172.21.15.8:0/3357680805 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f78300b8ca0 con 0x7f78400ffde0 2024-03-16T20:57:34.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:34 smithi008 ceph-mon[31434]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:57:34.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:34 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3537587071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:34.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:34 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.136+0000 7f7846800640 1 -- 172.21.15.8:0/3357680805 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f784002d070 con 0x7f78240a1ab0 2024-03-16T20:57:35.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:34 smithi186 ceph-mon[36391]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:57:35.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:34 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3537587071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:35.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:34 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.144+0000 7f7837e00640 1 -- 172.21.15.8:0/3357680805 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259024 (secure 0 0 0) 0x7f784002d070 con 0x7f78240a1ab0 2024-03-16T20:57:35.151 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:35.152 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-16T20:57:35.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 -- 172.21.15.8:0/3357680805 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f78240a1ab0 msgr2=0x7f78240a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:35.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f78240a1ab0 0x7f78240a3f70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f784019ad30 tx=0x7f782c00b4a0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 -- 172.21.15.8:0/3357680805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78400ffde0 msgr2=0x7f7840199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:35.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78400ffde0 0x7f7840199820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7830036040 tx=0x7f7830005e40 comp rx=0 tx=0).stop 2024-03-16T20:57:35.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 -- 172.21.15.8:0/3357680805 shutdown_connections 2024-03-16T20:57:35.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f78240a1ab0 0x7f78240a3f70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78401010e0 0x7f78401a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7840100740 0x7f7840199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 --2- 172.21.15.8:0/3357680805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78400ffde0 0x7f7840199820 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 -- 172.21.15.8:0/3357680805 >> 172.21.15.8:0/3357680805 conn(0x7f78400fb980 msgr2=0x7f78400fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:35.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 -- 172.21.15.8:0/3357680805 shutdown_connections 2024-03-16T20:57:35.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.149+0000 7f7846800640 1 -- 172.21.15.8:0/3357680805 wait complete. 2024-03-16T20:57:35.174 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2024-03-16T20:57:33.146598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659530,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1005,"num_read_kb":628,"num_write":360,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1180965,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364976,"kb_used_data":11664,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576848,"statfs":{"total":1151940427776,"available":1151566692352,"internally_reserved":0,"allocated":11943936,"data_stored":7482272,"data_compressed":113112,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":620,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":36,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004917"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126450+0000","last_change":"2024-03-16T20:55:05.301473+0000","last_active":"2024-03-16T20:56:33.126450+0000","last_peered":"2024-03-16T20:56:33.126450+0000","last_clean":"2024-03-16T20:56:33.126450+0000","last_became_active":"2024-03-16T20:55:05.301166+0000","last_became_peered":"2024-03-16T20:55:05.301166+0000","last_unstale":"2024-03-16T20:56:33.126450+0000","last_undegraded":"2024-03-16T20:56:33.126450+0000","last_fullsized":"2024-03-16T20:56:33.126450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:06:51.838382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126555+0000","last_change":"2024-03-16T20:55:05.295895+0000","last_active":"2024-03-16T20:56:33.126555+0000","last_peered":"2024-03-16T20:56:33.126555+0000","last_clean":"2024-03-16T20:56:33.126555+0000","last_became_active":"2024-03-16T20:55:05.295365+0000","last_became_peered":"2024-03-16T20:55:05.295365+0000","last_unstale":"2024-03-16T20:56:33.126555+0000","last_undegraded":"2024-03-16T20:56:33.126555+0000","last_fullsized":"2024-03-16T20:56:33.126555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:28:20.342348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.125136+0000","last_change":"2024-03-16T20:55:05.299049+0000","last_active":"2024-03-16T20:56:33.125136+0000","last_peered":"2024-03-16T20:56:33.125136+0000","last_clean":"2024-03-16T20:56:33.125136+0000","last_became_active":"2024-03-16T20:55:05.292758+0000","last_became_peered":"2024-03-16T20:55:05.292758+0000","last_unstale":"2024-03-16T20:56:33.125136+0000","last_undegraded":"2024-03-16T20:56:33.125136+0000","last_fullsized":"2024-03-16T20:56:33.125136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:20:36.276639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.074294+0000","last_change":"2024-03-16T20:55:05.274453+0000","last_active":"2024-03-16T20:56:33.074294+0000","last_peered":"2024-03-16T20:56:33.074294+0000","last_clean":"2024-03-16T20:56:33.074294+0000","last_became_active":"2024-03-16T20:55:05.273648+0000","last_became_peered":"2024-03-16T20:55:05.273648+0000","last_unstale":"2024-03-16T20:56:33.074294+0000","last_undegraded":"2024-03-16T20:56:33.074294+0000","last_fullsized":"2024-03-16T20:56:33.074294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:08:37.297906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.102846+0000","last_change":"2024-03-16T20:55:05.291272+0000","last_active":"2024-03-16T20:56:33.102846+0000","last_peered":"2024-03-16T20:56:33.102846+0000","last_clean":"2024-03-16T20:56:33.102846+0000","last_became_active":"2024-03-16T20:55:05.290788+0000","last_became_peered":"2024-03-16T20:55:05.290788+0000","last_unstale":"2024-03-16T20:56:33.102846+0000","last_undegraded":"2024-03-16T20:56:33.102846+0000","last_fullsized":"2024-03-16T20:56:33.102846+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:36:42.842797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.089110+0000","last_change":"2024-03-16T20:55:05.289977+0000","last_active":"2024-03-16T20:56:33.089110+0000","last_peered":"2024-03-16T20:56:33.089110+0000","last_clean":"2024-03-16T20:56:33.089110+0000","last_became_active":"2024-03-16T20:55:05.289520+0000","last_became_peered":"2024-03-16T20:55:05.289520+0000","last_unstale":"2024-03-16T20:56:33.089110+0000","last_undegraded":"2024-03-16T20:56:33.089110+0000","last_fullsized":"2024-03-16T20:56:33.089110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:25:49.270854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092814+0000","last_change":"2024-03-16T20:55:05.286244+0000","last_active":"2024-03-16T20:56:33.092814+0000","last_peered":"2024-03-16T20:56:33.092814+0000","last_clean":"2024-03-16T20:56:33.092814+0000","last_became_active":"2024-03-16T20:55:05.285871+0000","last_became_peered":"2024-03-16T20:55:05.285871+0000","last_unstale":"2024-03-16T20:56:33.092814+0000","last_undegraded":"2024-03-16T20:56:33.092814+0000","last_fullsized":"2024-03-16T20:56:33.092814+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:24:47.334046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.116224+0000","last_change":"2024-03-16T20:55:05.293902+0000","last_active":"2024-03-16T20:56:33.116224+0000","last_peered":"2024-03-16T20:56:33.116224+0000","last_clean":"2024-03-16T20:56:33.116224+0000","last_became_active":"2024-03-16T20:55:05.284424+0000","last_became_peered":"2024-03-16T20:55:05.284424+0000","last_unstale":"2024-03-16T20:56:33.116224+0000","last_undegraded":"2024-03-16T20:56:33.116224+0000","last_fullsized":"2024-03-16T20:56:33.116224+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:09:15.024337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.096400+0000","last_change":"2024-03-16T20:55:05.271434+0000","last_active":"2024-03-16T20:56:33.096400+0000","last_peered":"2024-03-16T20:56:33.096400+0000","last_clean":"2024-03-16T20:56:33.096400+0000","last_became_active":"2024-03-16T20:55:05.271014+0000","last_became_peered":"2024-03-16T20:55:05.271014+0000","last_unstale":"2024-03-16T20:56:33.096400+0000","last_undegraded":"2024-03-16T20:56:33.096400+0000","last_fullsized":"2024-03-16T20:56:33.096400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:09:47.133987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092078+0000","last_change":"2024-03-16T20:55:05.275108+0000","last_active":"2024-03-16T20:56:33.092078+0000","last_peered":"2024-03-16T20:56:33.092078+0000","last_clean":"2024-03-16T20:56:33.092078+0000","last_became_active":"2024-03-16T20:55:05.274659+0000","last_became_peered":"2024-03-16T20:55:05.274659+0000","last_unstale":"2024-03-16T20:56:33.092078+0000","last_undegraded":"2024-03-16T20:56:33.092078+0000","last_fullsized":"2024-03-16T20:56:33.092078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:10:16.801309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092679+0000","last_change":"2024-03-16T20:55:05.273322+0000","last_active":"2024-03-16T20:56:33.092679+0000","last_peered":"2024-03-16T20:56:33.092679+0000","last_clean":"2024-03-16T20:56:33.092679+0000","last_became_active":"2024-03-16T20:55:05.272999+0000","last_became_peered":"2024-03-16T20:55:05.272999+0000","last_unstale":"2024-03-16T20:56:33.092679+0000","last_undegraded":"2024-03-16T20:56:33.092679+0000","last_fullsized":"2024-03-16T20:56:33.092679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:49:43.426765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.082928+0000","last_change":"2024-03-16T20:55:05.274729+0000","last_active":"2024-03-16T20:56:33.082928+0000","last_peered":"2024-03-16T20:56:33.082928+0000","last_clean":"2024-03-16T20:56:33.082928+0000","last_became_active":"2024-03-16T20:55:05.274131+0000","last_became_peered":"2024-03-16T20:55:05.274131+0000","last_unstale":"2024-03-16T20:56:33.082928+0000","last_undegraded":"2024-03-16T20:56:33.082928+0000","last_fullsized":"2024-03-16T20:56:33.082928+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:59:43.413956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123499+0000","last_change":"2024-03-16T20:56:04.522061+0000","last_active":"2024-03-16T20:56:33.123499+0000","last_peered":"2024-03-16T20:56:33.123499+0000","last_clean":"2024-03-16T20:56:33.123499+0000","last_became_active":"2024-03-16T20:56:04.521622+0000","last_became_peered":"2024-03-16T20:56:04.521622+0000","last_unstale":"2024-03-16T20:56:33.123499+0000","last_undegraded":"2024-03-16T20:56:33.123499+0000","last_fullsized":"2024-03-16T20:56:33.123499+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:00:52.309217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.122771+0000","last_change":"2024-03-16T20:55:05.282707+0000","last_active":"2024-03-16T20:56:33.122771+0000","last_peered":"2024-03-16T20:56:33.122771+0000","last_clean":"2024-03-16T20:56:33.122771+0000","last_became_active":"2024-03-16T20:55:05.282168+0000","last_became_peered":"2024-03-16T20:55:05.282168+0000","last_unstale":"2024-03-16T20:56:33.122771+0000","last_undegraded":"2024-03-16T20:56:33.122771+0000","last_fullsized":"2024-03-16T20:56:33.122771+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:33:59.464303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.120399+0000","last_change":"2024-03-16T20:55:05.290291+0000","last_active":"2024-03-16T20:56:33.120399+0000","last_peered":"2024-03-16T20:56:33.120399+0000","last_clean":"2024-03-16T20:56:33.120399+0000","last_became_active":"2024-03-16T20:55:05.289952+0000","last_became_peered":"2024-03-16T20:55:05.289952+0000","last_unstale":"2024-03-16T20:56:33.120399+0000","last_undegraded":"2024-03-16T20:56:33.120399+0000","last_fullsized":"2024-03-16T20:56:33.120399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:05.334408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123069+0000","last_change":"2024-03-16T20:55:05.284252+0000","last_active":"2024-03-16T20:56:33.123069+0000","last_peered":"2024-03-16T20:56:33.123069+0000","last_clean":"2024-03-16T20:56:33.123069+0000","last_became_active":"2024-03-16T20:55:05.283804+0000","last_became_peered":"2024-03-16T20:55:05.283804+0000","last_unstale":"2024-03-16T20:56:33.123069+0000","last_undegraded":"2024-03-16T20:56:33.123069+0000","last_fullsized":"2024-03-16T20:56:33.123069+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:03:17.942719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126588+0000","last_change":"2024-03-16T20:55:05.296118+0000","last_active":"2024-03-16T20:56:33.126588+0000","last_peered":"2024-03-16T20:56:33.126588+0000","last_clean":"2024-03-16T20:56:33.126588+0000","last_became_active":"2024-03-16T20:55:05.295783+0000","last_became_peered":"2024-03-16T20:55:05.295783+0000","last_unstale":"2024-03-16T20:56:33.126588+0000","last_undegraded":"2024-03-16T20:56:33.126588+0000","last_fullsized":"2024-03-16T20:56:33.126588+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:36:15.463748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.103440+0000","last_change":"2024-03-16T20:55:05.287221+0000","last_active":"2024-03-16T20:56:33.103440+0000","last_peered":"2024-03-16T20:56:33.103440+0000","last_clean":"2024-03-16T20:56:33.103440+0000","last_became_active":"2024-03-16T20:55:05.286553+0000","last_became_peered":"2024-03-16T20:55:05.286553+0000","last_unstale":"2024-03-16T20:56:33.103440+0000","last_undegraded":"2024-03-16T20:56:33.103440+0000","last_fullsized":"2024-03-16T20:56:33.103440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:33:25.688231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.108663+0000","last_change":"2024-03-16T20:55:05.280111+0000","last_active":"2024-03-16T20:56:33.108663+0000","last_peered":"2024-03-16T20:56:33.108663+0000","last_clean":"2024-03-16T20:56:33.108663+0000","last_became_active":"2024-03-16T20:55:05.279857+0000","last_became_peered":"2024-03-16T20:55:05.279857+0000","last_unstale":"2024-03-16T20:56:33.108663+0000","last_undegraded":"2024-03-16T20:56:33.108663+0000","last_fullsized":"2024-03-16T20:56:33.108663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:57:18.205253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516330+0000","last_change":"2024-03-16T20:55:04.268836+0000","last_active":"2024-03-16T20:56:04.516330+0000","last_peered":"2024-03-16T20:56:04.516330+0000","last_clean":"2024-03-16T20:56:04.516330+0000","last_became_active":"2024-03-16T20:55:04.266502+0000","last_became_peered":"2024-03-16T20:55:04.266502+0000","last_unstale":"2024-03-16T20:56:04.516330+0000","last_undegraded":"2024-03-16T20:56:04.516330+0000","last_fullsized":"2024-03-16T20:56:04.516330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:12:33.717454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.103940+0000","last_change":"2024-03-16T20:55:05.280158+0000","last_active":"2024-03-16T20:56:33.103940+0000","last_peered":"2024-03-16T20:56:33.103940+0000","last_clean":"2024-03-16T20:56:33.103940+0000","last_became_active":"2024-03-16T20:55:05.278918+0000","last_became_peered":"2024-03-16T20:55:05.278918+0000","last_unstale":"2024-03-16T20:56:33.103940+0000","last_undegraded":"2024-03-16T20:56:33.103940+0000","last_fullsized":"2024-03-16T20:56:33.103940+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:27:34.158596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513417+0000","last_change":"2024-03-16T20:55:04.283366+0000","last_active":"2024-03-16T20:56:04.513417+0000","last_peered":"2024-03-16T20:56:04.513417+0000","last_clean":"2024-03-16T20:56:04.513417+0000","last_became_active":"2024-03-16T20:55:04.283016+0000","last_became_peered":"2024-03-16T20:55:04.283016+0000","last_unstale":"2024-03-16T20:56:04.513417+0000","last_undegraded":"2024-03-16T20:56:04.513417+0000","last_fullsized":"2024-03-16T20:56:04.513417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:41.163294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.127403+0000","last_change":"2024-03-16T20:55:05.299005+0000","last_active":"2024-03-16T20:56:33.127403+0000","last_peered":"2024-03-16T20:56:33.127403+0000","last_clean":"2024-03-16T20:56:33.127403+0000","last_became_active":"2024-03-16T20:55:05.296527+0000","last_became_peered":"2024-03-16T20:55:05.296527+0000","last_unstale":"2024-03-16T20:56:33.127403+0000","last_undegraded":"2024-03-16T20:56:33.127403+0000","last_fullsized":"2024-03-16T20:56:33.127403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:56:51.451900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515248+0000","last_change":"2024-03-16T20:55:04.259210+0000","last_active":"2024-03-16T20:56:04.515248+0000","last_peered":"2024-03-16T20:56:04.515248+0000","last_clean":"2024-03-16T20:56:04.515248+0000","last_became_active":"2024-03-16T20:55:04.258828+0000","last_became_peered":"2024-03-16T20:55:04.258828+0000","last_unstale":"2024-03-16T20:56:04.515248+0000","last_undegraded":"2024-03-16T20:56:04.515248+0000","last_fullsized":"2024-03-16T20:56:04.515248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:21:14.497086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.117791+0000","last_change":"2024-03-16T20:55:05.272053+0000","last_active":"2024-03-16T20:56:33.117791+0000","last_peered":"2024-03-16T20:56:33.117791+0000","last_clean":"2024-03-16T20:56:33.117791+0000","last_became_active":"2024-03-16T20:55:05.271435+0000","last_became_peered":"2024-03-16T20:55:05.271435+0000","last_unstale":"2024-03-16T20:56:33.117791+0000","last_undegraded":"2024-03-16T20:56:33.117791+0000","last_fullsized":"2024-03-16T20:56:33.117791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:08:47.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514977+0000","last_change":"2024-03-16T20:55:04.261051+0000","last_active":"2024-03-16T20:56:04.514977+0000","last_peered":"2024-03-16T20:56:04.514977+0000","last_clean":"2024-03-16T20:56:04.514977+0000","last_became_active":"2024-03-16T20:55:04.260701+0000","last_became_peered":"2024-03-16T20:55:04.260701+0000","last_unstale":"2024-03-16T20:56:04.514977+0000","last_undegraded":"2024-03-16T20:56:04.514977+0000","last_fullsized":"2024-03-16T20:56:04.514977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:30:05.233891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.099430+0000","last_change":"2024-03-16T20:55:05.270047+0000","last_active":"2024-03-16T20:56:33.099430+0000","last_peered":"2024-03-16T20:56:33.099430+0000","last_clean":"2024-03-16T20:56:33.099430+0000","last_became_active":"2024-03-16T20:55:05.269045+0000","last_became_peered":"2024-03-16T20:55:05.269045+0000","last_unstale":"2024-03-16T20:56:33.099430+0000","last_undegraded":"2024-03-16T20:56:33.099430+0000","last_fullsized":"2024-03-16T20:56:33.099430+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:54:19.289648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":165,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:27.505419+0000","last_change":"2024-03-16T20:55:04.258871+0000","last_active":"2024-03-16T20:57:27.505419+0000","last_peered":"2024-03-16T20:57:27.505419+0000","last_clean":"2024-03-16T20:57:27.505419+0000","last_became_active":"2024-03-16T20:55:04.258462+0000","last_became_peered":"2024-03-16T20:55:04.258462+0000","last_unstale":"2024-03-16T20:57:27.505419+0000","last_undegraded":"2024-03-16T20:57:27.505419+0000","last_fullsized":"2024-03-16T20:57:27.505419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:16:29.832814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.086810+0000","last_change":"2024-03-16T20:55:05.290789+0000","last_active":"2024-03-16T20:56:33.086810+0000","last_peered":"2024-03-16T20:56:33.086810+0000","last_clean":"2024-03-16T20:56:33.086810+0000","last_became_active":"2024-03-16T20:55:05.290367+0000","last_became_peered":"2024-03-16T20:55:05.290367+0000","last_unstale":"2024-03-16T20:56:33.086810+0000","last_undegraded":"2024-03-16T20:56:33.086810+0000","last_fullsized":"2024-03-16T20:56:33.086810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:23:38.509837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513422+0000","last_change":"2024-03-16T20:55:04.264980+0000","last_active":"2024-03-16T20:56:04.513422+0000","last_peered":"2024-03-16T20:56:04.513422+0000","last_clean":"2024-03-16T20:56:04.513422+0000","last_became_active":"2024-03-16T20:55:04.264634+0000","last_became_peered":"2024-03-16T20:55:04.264634+0000","last_unstale":"2024-03-16T20:56:04.513422+0000","last_undegraded":"2024-03-16T20:56:04.513422+0000","last_fullsized":"2024-03-16T20:56:04.513422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:16:52.713847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.111066+0000","last_change":"2024-03-16T20:55:05.286139+0000","last_active":"2024-03-16T20:56:33.111066+0000","last_peered":"2024-03-16T20:56:33.111066+0000","last_clean":"2024-03-16T20:56:33.111066+0000","last_became_active":"2024-03-16T20:55:05.285751+0000","last_became_peered":"2024-03-16T20:55:05.285751+0000","last_unstale":"2024-03-16T20:56:33.111066+0000","last_undegraded":"2024-03-16T20:56:33.111066+0000","last_fullsized":"2024-03-16T20:56:33.111066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:01:02.448785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.517750+0000","last_change":"2024-03-16T20:55:04.282416+0000","last_active":"2024-03-16T20:56:04.517750+0000","last_peered":"2024-03-16T20:56:04.517750+0000","last_clean":"2024-03-16T20:56:04.517750+0000","last_became_active":"2024-03-16T20:55:04.280504+0000","last_became_peered":"2024-03-16T20:55:04.280504+0000","last_unstale":"2024-03-16T20:56:04.517750+0000","last_undegraded":"2024-03-16T20:56:04.517750+0000","last_fullsized":"2024-03-16T20:56:04.517750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:23.940976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123969+0000","last_change":"2024-03-16T20:55:05.289210+0000","last_active":"2024-03-16T20:56:33.123969+0000","last_peered":"2024-03-16T20:56:33.123969+0000","last_clean":"2024-03-16T20:56:33.123969+0000","last_became_active":"2024-03-16T20:55:05.286738+0000","last_became_peered":"2024-03-16T20:55:05.286738+0000","last_unstale":"2024-03-16T20:56:33.123969+0000","last_undegraded":"2024-03-16T20:56:33.123969+0000","last_fullsized":"2024-03-16T20:56:33.123969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:43:45.266727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605273+0000","last_change":"2024-03-16T20:55:04.258925+0000","last_active":"2024-03-16T20:56:04.605273+0000","last_peered":"2024-03-16T20:56:04.605273+0000","last_clean":"2024-03-16T20:56:04.605273+0000","last_became_active":"2024-03-16T20:55:04.258578+0000","last_became_peered":"2024-03-16T20:55:04.258578+0000","last_unstale":"2024-03-16T20:56:04.605273+0000","last_undegraded":"2024-03-16T20:56:04.605273+0000","last_fullsized":"2024-03-16T20:56:04.605273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:52.812547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.121075+0000","last_change":"2024-03-16T20:55:05.302122+0000","last_active":"2024-03-16T20:56:33.121075+0000","last_peered":"2024-03-16T20:56:33.121075+0000","last_clean":"2024-03-16T20:56:33.121075+0000","last_became_active":"2024-03-16T20:55:05.301743+0000","last_became_peered":"2024-03-16T20:55:05.301743+0000","last_unstale":"2024-03-16T20:56:33.121075+0000","last_undegraded":"2024-03-16T20:56:33.121075+0000","last_fullsized":"2024-03-16T20:56:33.121075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:32:51.691780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":164,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:29.507171+0000","last_change":"2024-03-16T20:55:04.270015+0000","last_active":"2024-03-16T20:57:29.507171+0000","last_peered":"2024-03-16T20:57:29.507171+0000","last_clean":"2024-03-16T20:57:29.507171+0000","last_became_active":"2024-03-16T20:55:04.269563+0000","last_became_peered":"2024-03-16T20:55:04.269563+0000","last_unstale":"2024-03-16T20:57:29.507171+0000","last_undegraded":"2024-03-16T20:57:29.507171+0000","last_fullsized":"2024-03-16T20:57:29.507171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:39:21.768540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.096449+0000","last_change":"2024-03-16T20:55:05.290639+0000","last_active":"2024-03-16T20:56:33.096449+0000","last_peered":"2024-03-16T20:56:33.096449+0000","last_clean":"2024-03-16T20:56:33.096449+0000","last_became_active":"2024-03-16T20:55:05.290255+0000","last_became_peered":"2024-03-16T20:55:05.290255+0000","last_unstale":"2024-03-16T20:56:33.096449+0000","last_undegraded":"2024-03-16T20:56:33.096449+0000","last_fullsized":"2024-03-16T20:56:33.096449+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:36:13.303557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930573+0000","last_change":"2024-03-16T20:55:04.260407+0000","last_active":"2024-03-16T20:56:04.930573+0000","last_peered":"2024-03-16T20:56:04.930573+0000","last_clean":"2024-03-16T20:56:04.930573+0000","last_became_active":"2024-03-16T20:55:04.259817+0000","last_became_peered":"2024-03-16T20:55:04.259817+0000","last_unstale":"2024-03-16T20:56:04.930573+0000","last_undegraded":"2024-03-16T20:56:04.930573+0000","last_fullsized":"2024-03-16T20:56:04.930573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:07.995508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126099+0000","last_change":"2024-03-16T20:55:05.295327+0000","last_active":"2024-03-16T20:56:33.126099+0000","last_peered":"2024-03-16T20:56:33.126099+0000","last_clean":"2024-03-16T20:56:33.126099+0000","last_became_active":"2024-03-16T20:55:05.294948+0000","last_became_peered":"2024-03-16T20:55:05.294948+0000","last_unstale":"2024-03-16T20:56:33.126099+0000","last_undegraded":"2024-03-16T20:56:33.126099+0000","last_fullsized":"2024-03-16T20:56:33.126099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:29.305366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605638+0000","last_change":"2024-03-16T20:55:04.264571+0000","last_active":"2024-03-16T20:56:04.605638+0000","last_peered":"2024-03-16T20:56:04.605638+0000","last_clean":"2024-03-16T20:56:04.605638+0000","last_became_active":"2024-03-16T20:55:04.264200+0000","last_became_peered":"2024-03-16T20:55:04.264200+0000","last_unstale":"2024-03-16T20:56:04.605638+0000","last_undegraded":"2024-03-16T20:56:04.605638+0000","last_fullsized":"2024-03-16T20:56:04.605638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:38:58.457250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.100869+0000","last_change":"2024-03-16T20:55:05.272855+0000","last_active":"2024-03-16T20:56:33.100869+0000","last_peered":"2024-03-16T20:56:33.100869+0000","last_clean":"2024-03-16T20:56:33.100869+0000","last_became_active":"2024-03-16T20:55:05.272500+0000","last_became_peered":"2024-03-16T20:55:05.272500+0000","last_unstale":"2024-03-16T20:56:33.100869+0000","last_undegraded":"2024-03-16T20:56:33.100869+0000","last_fullsized":"2024-03-16T20:56:33.100869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:50:17.121966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'37","reported_seq":348,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:29.507010+0000","last_change":"2024-03-16T20:55:04.260050+0000","last_active":"2024-03-16T20:57:29.507010+0000","last_peered":"2024-03-16T20:57:29.507010+0000","last_clean":"2024-03-16T20:57:29.507010+0000","last_became_active":"2024-03-16T20:55:04.259662+0000","last_became_peered":"2024-03-16T20:55:04.259662+0000","last_unstale":"2024-03-16T20:57:29.507010+0000","last_undegraded":"2024-03-16T20:57:29.507010+0000","last_fullsized":"2024-03-16T20:57:29.507010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:45:46.999980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64476,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":291,"num_read_kb":208,"num_write":38,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.090644+0000","last_change":"2024-03-16T20:55:05.272337+0000","last_active":"2024-03-16T20:56:33.090644+0000","last_peered":"2024-03-16T20:56:33.090644+0000","last_clean":"2024-03-16T20:56:33.090644+0000","last_became_active":"2024-03-16T20:55:05.271761+0000","last_became_peered":"2024-03-16T20:55:05.271761+0000","last_unstale":"2024-03-16T20:56:33.090644+0000","last_undegraded":"2024-03-16T20:56:33.090644+0000","last_fullsized":"2024-03-16T20:56:33.090644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:50:22.079709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513415+0000","last_change":"2024-03-16T20:55:04.275606+0000","last_active":"2024-03-16T20:56:04.513415+0000","last_peered":"2024-03-16T20:56:04.513415+0000","last_clean":"2024-03-16T20:56:04.513415+0000","last_became_active":"2024-03-16T20:55:04.275268+0000","last_became_peered":"2024-03-16T20:55:04.275268+0000","last_unstale":"2024-03-16T20:56:04.513415+0000","last_undegraded":"2024-03-16T20:56:04.513415+0000","last_fullsized":"2024-03-16T20:56:04.513415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:27:34.248831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.122124+0000","last_change":"2024-03-16T20:55:05.290619+0000","last_active":"2024-03-16T20:56:33.122124+0000","last_peered":"2024-03-16T20:56:33.122124+0000","last_clean":"2024-03-16T20:56:33.122124+0000","last_became_active":"2024-03-16T20:55:05.289943+0000","last_became_peered":"2024-03-16T20:55:05.289943+0000","last_unstale":"2024-03-16T20:56:33.122124+0000","last_undegraded":"2024-03-16T20:56:33.122124+0000","last_fullsized":"2024-03-16T20:56:33.122124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:30.569777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605298+0000","last_change":"2024-03-16T20:55:04.274206+0000","last_active":"2024-03-16T20:56:04.605298+0000","last_peered":"2024-03-16T20:56:04.605298+0000","last_clean":"2024-03-16T20:56:04.605298+0000","last_became_active":"2024-03-16T20:55:04.273834+0000","last_became_peered":"2024-03-16T20:55:04.273834+0000","last_unstale":"2024-03-16T20:56:04.605298+0000","last_undegraded":"2024-03-16T20:56:04.605298+0000","last_fullsized":"2024-03-16T20:56:04.605298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:36:04.720463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.125056+0000","last_change":"2024-03-16T20:55:05.280265+0000","last_active":"2024-03-16T20:56:33.125056+0000","last_peered":"2024-03-16T20:56:33.125056+0000","last_clean":"2024-03-16T20:56:33.125056+0000","last_became_active":"2024-03-16T20:55:05.279774+0000","last_became_peered":"2024-03-16T20:55:05.279774+0000","last_unstale":"2024-03-16T20:56:33.125056+0000","last_undegraded":"2024-03-16T20:56:33.125056+0000","last_fullsized":"2024-03-16T20:56:33.125056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:34:52.855290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":168,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:27.594571+0000","last_change":"2024-03-16T20:55:04.256314+0000","last_active":"2024-03-16T20:57:27.594571+0000","last_peered":"2024-03-16T20:57:27.594571+0000","last_clean":"2024-03-16T20:57:27.594571+0000","last_became_active":"2024-03-16T20:55:04.255940+0000","last_became_peered":"2024-03-16T20:55:04.255940+0000","last_unstale":"2024-03-16T20:57:27.594571+0000","last_undegraded":"2024-03-16T20:57:27.594571+0000","last_fullsized":"2024-03-16T20:57:27.594571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:27:09.660107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.097303+0000","last_change":"2024-03-16T20:55:05.271562+0000","last_active":"2024-03-16T20:56:33.097303+0000","last_peered":"2024-03-16T20:56:33.097303+0000","last_clean":"2024-03-16T20:56:33.097303+0000","last_became_active":"2024-03-16T20:55:05.271214+0000","last_became_peered":"2024-03-16T20:55:05.271214+0000","last_unstale":"2024-03-16T20:56:33.097303+0000","last_undegraded":"2024-03-16T20:56:33.097303+0000","last_fullsized":"2024-03-16T20:56:33.097303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:42:35.104345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.537648+0000","last_change":"2024-03-16T20:56:04.537276+0000","last_active":"2024-03-16T20:56:04.537648+0000","last_peered":"2024-03-16T20:56:04.537648+0000","last_clean":"2024-03-16T20:56:04.537648+0000","last_became_active":"2024-03-16T20:56:04.526059+0000","last_became_peered":"2024-03-16T20:56:04.526059+0000","last_unstale":"2024-03-16T20:56:04.537648+0000","last_undegraded":"2024-03-16T20:56:04.537648+0000","last_fullsized":"2024-03-16T20:56:04.537648+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:17:50.898269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.098918+0000","last_change":"2024-03-16T20:55:05.269751+0000","last_active":"2024-03-16T20:56:33.098918+0000","last_peered":"2024-03-16T20:56:33.098918+0000","last_clean":"2024-03-16T20:56:33.098918+0000","last_became_active":"2024-03-16T20:55:05.269375+0000","last_became_peered":"2024-03-16T20:55:05.269375+0000","last_unstale":"2024-03-16T20:56:33.098918+0000","last_undegraded":"2024-03-16T20:56:33.098918+0000","last_fullsized":"2024-03-16T20:56:33.098918+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:57:00.751155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515295+0000","last_change":"2024-03-16T20:55:04.254352+0000","last_active":"2024-03-16T20:56:04.515295+0000","last_peered":"2024-03-16T20:56:04.515295+0000","last_clean":"2024-03-16T20:56:04.515295+0000","last_became_active":"2024-03-16T20:55:04.253895+0000","last_became_peered":"2024-03-16T20:55:04.253895+0000","last_unstale":"2024-03-16T20:56:04.515295+0000","last_undegraded":"2024-03-16T20:56:04.515295+0000","last_fullsized":"2024-03-16T20:56:04.515295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:35:15.796341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.083605+0000","last_change":"2024-03-16T20:55:05.271148+0000","last_active":"2024-03-16T20:56:33.083605+0000","last_peered":"2024-03-16T20:56:33.083605+0000","last_clean":"2024-03-16T20:56:33.083605+0000","last_became_active":"2024-03-16T20:55:05.270836+0000","last_became_peered":"2024-03-16T20:55:05.270836+0000","last_unstale":"2024-03-16T20:56:33.083605+0000","last_undegraded":"2024-03-16T20:56:33.083605+0000","last_fullsized":"2024-03-16T20:56:33.083605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:12:49.526828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516195+0000","last_change":"2024-03-16T20:55:04.277152+0000","last_active":"2024-03-16T20:56:04.516195+0000","last_peered":"2024-03-16T20:56:04.516195+0000","last_clean":"2024-03-16T20:56:04.516195+0000","last_became_active":"2024-03-16T20:55:04.276666+0000","last_became_peered":"2024-03-16T20:55:04.276666+0000","last_unstale":"2024-03-16T20:56:04.516195+0000","last_undegraded":"2024-03-16T20:56:04.516195+0000","last_fullsized":"2024-03-16T20:56:04.516195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:39:04.919957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.097762+0000","last_change":"2024-03-16T20:56:04.529323+0000","last_active":"2024-03-16T20:56:33.097762+0000","last_peered":"2024-03-16T20:56:33.097762+0000","last_clean":"2024-03-16T20:56:33.097762+0000","last_became_active":"2024-03-16T20:56:04.521484+0000","last_became_peered":"2024-03-16T20:56:04.521484+0000","last_unstale":"2024-03-16T20:56:33.097762+0000","last_undegraded":"2024-03-16T20:56:33.097762+0000","last_fullsized":"2024-03-16T20:56:33.097762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:00:31.203774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930141+0000","last_change":"2024-03-16T20:55:04.270960+0000","last_active":"2024-03-16T20:56:04.930141+0000","last_peered":"2024-03-16T20:56:04.930141+0000","last_clean":"2024-03-16T20:56:04.930141+0000","last_became_active":"2024-03-16T20:55:04.270605+0000","last_became_peered":"2024-03-16T20:55:04.270605+0000","last_unstale":"2024-03-16T20:56:04.930141+0000","last_undegraded":"2024-03-16T20:56:04.930141+0000","last_fullsized":"2024-03-16T20:56:04.930141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:06:53.529116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.120497+0000","last_change":"2024-03-16T20:55:05.303690+0000","last_active":"2024-03-16T20:56:33.120497+0000","last_peered":"2024-03-16T20:56:33.120497+0000","last_clean":"2024-03-16T20:56:33.120497+0000","last_became_active":"2024-03-16T20:55:05.303096+0000","last_became_peered":"2024-03-16T20:55:05.303096+0000","last_unstale":"2024-03-16T20:56:33.120497+0000","last_undegraded":"2024-03-16T20:56:33.120497+0000","last_fullsized":"2024-03-16T20:56:33.120497+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:03:25.139693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.082999+0000","last_change":"2024-03-16T20:55:05.268277+0000","last_active":"2024-03-16T20:56:33.082999+0000","last_peered":"2024-03-16T20:56:33.082999+0000","last_clean":"2024-03-16T20:56:33.082999+0000","last_became_active":"2024-03-16T20:55:05.267955+0000","last_became_peered":"2024-03-16T20:55:05.267955+0000","last_unstale":"2024-03-16T20:56:33.082999+0000","last_undegraded":"2024-03-16T20:56:33.082999+0000","last_fullsized":"2024-03-16T20:56:33.082999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:20:21.633055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":167,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:30.600026+0000","last_change":"2024-03-16T20:55:04.277286+0000","last_active":"2024-03-16T20:57:30.600026+0000","last_peered":"2024-03-16T20:57:30.600026+0000","last_clean":"2024-03-16T20:57:30.600026+0000","last_became_active":"2024-03-16T20:55:04.276855+0000","last_became_peered":"2024-03-16T20:55:04.276855+0000","last_unstale":"2024-03-16T20:57:30.600026+0000","last_undegraded":"2024-03-16T20:57:30.600026+0000","last_fullsized":"2024-03-16T20:57:30.600026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:22:19.590782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.113733+0000","last_change":"2024-03-16T20:55:05.280255+0000","last_active":"2024-03-16T20:56:33.113733+0000","last_peered":"2024-03-16T20:56:33.113733+0000","last_clean":"2024-03-16T20:56:33.113733+0000","last_became_active":"2024-03-16T20:55:05.279762+0000","last_became_peered":"2024-03-16T20:55:05.279762+0000","last_unstale":"2024-03-16T20:56:33.113733+0000","last_undegraded":"2024-03-16T20:56:33.113733+0000","last_fullsized":"2024-03-16T20:56:33.113733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:31.687047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903922+0000","last_change":"2024-03-16T20:55:04.263605+0000","last_active":"2024-03-16T20:56:04.903922+0000","last_peered":"2024-03-16T20:56:04.903922+0000","last_clean":"2024-03-16T20:56:04.903922+0000","last_became_active":"2024-03-16T20:55:04.263189+0000","last_became_peered":"2024-03-16T20:55:04.263189+0000","last_unstale":"2024-03-16T20:56:04.903922+0000","last_undegraded":"2024-03-16T20:56:04.903922+0000","last_fullsized":"2024-03-16T20:56:04.903922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:28:11.377134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":352,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930006+0000","last_change":"2024-03-16T20:53:44.281432+0000","last_active":"2024-03-16T20:56:04.930006+0000","last_peered":"2024-03-16T20:56:04.930006+0000","last_clean":"2024-03-16T20:56:04.930006+0000","last_became_active":"2024-03-16T20:53:44.280927+0000","last_became_peered":"2024-03-16T20:53:44.280927+0000","last_unstale":"2024-03-16T20:56:04.930006+0000","last_undegraded":"2024-03-16T20:56:04.930006+0000","last_fullsized":"2024-03-16T20:56:04.930006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_clean_scrub_stamp":"2024-03-16T20:49:51.705234+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:01:00.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123405+0000","last_change":"2024-03-16T20:56:04.525541+0000","last_active":"2024-03-16T20:56:33.123405+0000","last_peered":"2024-03-16T20:56:33.123405+0000","last_clean":"2024-03-16T20:56:33.123405+0000","last_became_active":"2024-03-16T20:56:04.522548+0000","last_became_peered":"2024-03-16T20:56:04.522548+0000","last_unstale":"2024-03-16T20:56:33.123405+0000","last_undegraded":"2024-03-16T20:56:33.123405+0000","last_fullsized":"2024-03-16T20:56:33.123405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:35:54.115845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930116+0000","last_change":"2024-03-16T20:55:04.256842+0000","last_active":"2024-03-16T20:56:04.930116+0000","last_peered":"2024-03-16T20:56:04.930116+0000","last_clean":"2024-03-16T20:56:04.930116+0000","last_became_active":"2024-03-16T20:55:04.256493+0000","last_became_peered":"2024-03-16T20:55:04.256493+0000","last_unstale":"2024-03-16T20:56:04.930116+0000","last_undegraded":"2024-03-16T20:56:04.930116+0000","last_fullsized":"2024-03-16T20:56:04.930116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:08.836034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515149+0000","last_change":"2024-03-16T20:55:04.265503+0000","last_active":"2024-03-16T20:56:04.515149+0000","last_peered":"2024-03-16T20:56:04.515149+0000","last_clean":"2024-03-16T20:56:04.515149+0000","last_became_active":"2024-03-16T20:55:04.265017+0000","last_became_peered":"2024-03-16T20:55:04.265017+0000","last_unstale":"2024-03-16T20:56:04.515149+0000","last_undegraded":"2024-03-16T20:56:04.515149+0000","last_fullsized":"2024-03-16T20:56:04.515149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:28.485079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.115525+0000","last_change":"2024-03-16T20:55:05.289100+0000","last_active":"2024-03-16T20:56:33.115525+0000","last_peered":"2024-03-16T20:56:33.115525+0000","last_clean":"2024-03-16T20:56:33.115525+0000","last_became_active":"2024-03-16T20:55:05.288122+0000","last_became_peered":"2024-03-16T20:55:05.288122+0000","last_unstale":"2024-03-16T20:56:33.115525+0000","last_undegraded":"2024-03-16T20:56:33.115525+0000","last_fullsized":"2024-03-16T20:56:33.115525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:03.222038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:14.360616+0000","last_change":"2024-03-16T20:55:04.282230+0000","last_active":"2024-03-16T20:57:14.360616+0000","last_peered":"2024-03-16T20:57:14.360616+0000","last_clean":"2024-03-16T20:57:14.360616+0000","last_became_active":"2024-03-16T20:55:04.281917+0000","last_became_peered":"2024-03-16T20:55:04.281917+0000","last_unstale":"2024-03-16T20:57:14.360616+0000","last_undegraded":"2024-03-16T20:57:14.360616+0000","last_fullsized":"2024-03-16T20:57:14.360616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:18:36.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.117621+0000","last_change":"2024-03-16T20:55:05.293378+0000","last_active":"2024-03-16T20:56:33.117621+0000","last_peered":"2024-03-16T20:56:33.117621+0000","last_clean":"2024-03-16T20:56:33.117621+0000","last_became_active":"2024-03-16T20:55:05.288648+0000","last_became_peered":"2024-03-16T20:55:05.288648+0000","last_unstale":"2024-03-16T20:56:33.117621+0000","last_undegraded":"2024-03-16T20:56:33.117621+0000","last_fullsized":"2024-03-16T20:56:33.117621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:37:58.270760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903998+0000","last_change":"2024-03-16T20:55:04.268766+0000","last_active":"2024-03-16T20:56:04.903998+0000","last_peered":"2024-03-16T20:56:04.903998+0000","last_clean":"2024-03-16T20:56:04.903998+0000","last_became_active":"2024-03-16T20:55:04.268429+0000","last_became_peered":"2024-03-16T20:55:04.268429+0000","last_unstale":"2024-03-16T20:56:04.903998+0000","last_undegraded":"2024-03-16T20:56:04.903998+0000","last_fullsized":"2024-03-16T20:56:04.903998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:43.872155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.127101+0000","last_change":"2024-03-16T20:55:05.310349+0000","last_active":"2024-03-16T20:56:33.127101+0000","last_peered":"2024-03-16T20:56:33.127101+0000","last_clean":"2024-03-16T20:56:33.127101+0000","last_became_active":"2024-03-16T20:55:05.307987+0000","last_became_peered":"2024-03-16T20:55:05.307987+0000","last_unstale":"2024-03-16T20:56:33.127101+0000","last_undegraded":"2024-03-16T20:56:33.127101+0000","last_fullsized":"2024-03-16T20:56:33.127101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:19:38.142783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929413+0000","last_change":"2024-03-16T20:55:04.269683+0000","last_active":"2024-03-16T20:56:04.929413+0000","last_peered":"2024-03-16T20:56:04.929413+0000","last_clean":"2024-03-16T20:56:04.929413+0000","last_became_active":"2024-03-16T20:55:04.269258+0000","last_became_peered":"2024-03-16T20:55:04.269258+0000","last_unstale":"2024-03-16T20:56:04.929413+0000","last_undegraded":"2024-03-16T20:56:04.929413+0000","last_fullsized":"2024-03-16T20:56:04.929413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:24:10.417179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.073581+0000","last_change":"2024-03-16T20:55:05.272238+0000","last_active":"2024-03-16T20:56:33.073581+0000","last_peered":"2024-03-16T20:56:33.073581+0000","last_clean":"2024-03-16T20:56:33.073581+0000","last_became_active":"2024-03-16T20:55:05.270379+0000","last_became_peered":"2024-03-16T20:55:05.270379+0000","last_unstale":"2024-03-16T20:56:33.073581+0000","last_undegraded":"2024-03-16T20:56:33.073581+0000","last_fullsized":"2024-03-16T20:56:33.073581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:16:11.348601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512181+0000","last_change":"2024-03-16T20:55:04.280008+0000","last_active":"2024-03-16T20:56:04.512181+0000","last_peered":"2024-03-16T20:56:04.512181+0000","last_clean":"2024-03-16T20:56:04.512181+0000","last_became_active":"2024-03-16T20:55:04.279683+0000","last_became_peered":"2024-03-16T20:55:04.279683+0000","last_unstale":"2024-03-16T20:56:04.512181+0000","last_undegraded":"2024-03-16T20:56:04.512181+0000","last_fullsized":"2024-03-16T20:56:04.512181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:15.734826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.121869+0000","last_change":"2024-03-16T20:55:05.287219+0000","last_active":"2024-03-16T20:56:33.121869+0000","last_peered":"2024-03-16T20:56:33.121869+0000","last_clean":"2024-03-16T20:56:33.121869+0000","last_became_active":"2024-03-16T20:55:05.286899+0000","last_became_peered":"2024-03-16T20:55:05.286899+0000","last_unstale":"2024-03-16T20:56:33.121869+0000","last_undegraded":"2024-03-16T20:56:33.121869+0000","last_fullsized":"2024-03-16T20:56:33.121869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:33:01.483415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:06.416690+0000","last_change":"2024-03-16T20:56:04.520433+0000","last_active":"2024-03-16T20:56:06.416690+0000","last_peered":"2024-03-16T20:56:06.416690+0000","last_clean":"2024-03-16T20:56:06.416690+0000","last_became_active":"2024-03-16T20:56:04.516521+0000","last_became_peered":"2024-03-16T20:56:04.516521+0000","last_unstale":"2024-03-16T20:56:06.416690+0000","last_undegraded":"2024-03-16T20:56:06.416690+0000","last_fullsized":"2024-03-16T20:56:06.416690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:44:38.094213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126424+0000","last_change":"2024-03-16T20:55:05.311463+0000","last_active":"2024-03-16T20:56:33.126424+0000","last_peered":"2024-03-16T20:56:33.126424+0000","last_clean":"2024-03-16T20:56:33.126424+0000","last_became_active":"2024-03-16T20:55:05.310852+0000","last_became_peered":"2024-03-16T20:55:05.310852+0000","last_unstale":"2024-03-16T20:56:33.126424+0000","last_undegraded":"2024-03-16T20:56:33.126424+0000","last_fullsized":"2024-03-16T20:56:33.126424+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:51:52.980193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514650+0000","last_change":"2024-03-16T20:55:04.260372+0000","last_active":"2024-03-16T20:56:04.514650+0000","last_peered":"2024-03-16T20:56:04.514650+0000","last_clean":"2024-03-16T20:56:04.514650+0000","last_became_active":"2024-03-16T20:55:04.259273+0000","last_became_peered":"2024-03-16T20:55:04.259273+0000","last_unstale":"2024-03-16T20:56:04.514650+0000","last_undegraded":"2024-03-16T20:56:04.514650+0000","last_fullsized":"2024-03-16T20:56:04.514650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:21:25.212520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123563+0000","last_change":"2024-03-16T20:55:05.280088+0000","last_active":"2024-03-16T20:56:33.123563+0000","last_peered":"2024-03-16T20:56:33.123563+0000","last_clean":"2024-03-16T20:56:33.123563+0000","last_became_active":"2024-03-16T20:55:05.279745+0000","last_became_peered":"2024-03-16T20:55:05.279745+0000","last_unstale":"2024-03-16T20:56:33.123563+0000","last_undegraded":"2024-03-16T20:56:33.123563+0000","last_fullsized":"2024-03-16T20:56:33.123563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:02:08.797287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513571+0000","last_change":"2024-03-16T20:55:04.275221+0000","last_active":"2024-03-16T20:56:04.513571+0000","last_peered":"2024-03-16T20:56:04.513571+0000","last_clean":"2024-03-16T20:56:04.513571+0000","last_became_active":"2024-03-16T20:55:04.274887+0000","last_became_peered":"2024-03-16T20:55:04.274887+0000","last_unstale":"2024-03-16T20:56:04.513571+0000","last_undegraded":"2024-03-16T20:56:04.513571+0000","last_fullsized":"2024-03-16T20:56:04.513571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:35.333864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.100949+0000","last_change":"2024-03-16T20:55:05.272444+0000","last_active":"2024-03-16T20:56:33.100949+0000","last_peered":"2024-03-16T20:56:33.100949+0000","last_clean":"2024-03-16T20:56:33.100949+0000","last_became_active":"2024-03-16T20:55:05.272104+0000","last_became_peered":"2024-03-16T20:55:05.272104+0000","last_unstale":"2024-03-16T20:56:33.100949+0000","last_undegraded":"2024-03-16T20:56:33.100949+0000","last_fullsized":"2024-03-16T20:56:33.100949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:35.480408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605424+0000","last_change":"2024-03-16T20:55:04.274212+0000","last_active":"2024-03-16T20:56:04.605424+0000","last_peered":"2024-03-16T20:56:04.605424+0000","last_clean":"2024-03-16T20:56:04.605424+0000","last_became_active":"2024-03-16T20:55:04.273785+0000","last_became_peered":"2024-03-16T20:55:04.273785+0000","last_unstale":"2024-03-16T20:56:04.605424+0000","last_undegraded":"2024-03-16T20:56:04.605424+0000","last_fullsized":"2024-03-16T20:56:04.605424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:29:00.924789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.108284+0000","last_change":"2024-03-16T20:55:05.278590+0000","last_active":"2024-03-16T20:56:33.108284+0000","last_peered":"2024-03-16T20:56:33.108284+0000","last_clean":"2024-03-16T20:56:33.108284+0000","last_became_active":"2024-03-16T20:55:05.278183+0000","last_became_peered":"2024-03-16T20:55:05.278183+0000","last_unstale":"2024-03-16T20:56:33.108284+0000","last_undegraded":"2024-03-16T20:56:33.108284+0000","last_fullsized":"2024-03-16T20:56:33.108284+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:52:18.918653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515951+0000","last_change":"2024-03-16T20:55:04.279568+0000","last_active":"2024-03-16T20:56:04.515951+0000","last_peered":"2024-03-16T20:56:04.515951+0000","last_clean":"2024-03-16T20:56:04.515951+0000","last_became_active":"2024-03-16T20:55:04.278125+0000","last_became_peered":"2024-03-16T20:55:04.278125+0000","last_unstale":"2024-03-16T20:56:04.515951+0000","last_undegraded":"2024-03-16T20:56:04.515951+0000","last_fullsized":"2024-03-16T20:56:04.515951+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:13:20.417216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092744+0000","last_change":"2024-03-16T20:55:05.269732+0000","last_active":"2024-03-16T20:56:33.092744+0000","last_peered":"2024-03-16T20:56:33.092744+0000","last_clean":"2024-03-16T20:56:33.092744+0000","last_became_active":"2024-03-16T20:55:05.269260+0000","last_became_peered":"2024-03-16T20:55:05.269260+0000","last_unstale":"2024-03-16T20:56:33.092744+0000","last_undegraded":"2024-03-16T20:56:33.092744+0000","last_fullsized":"2024-03-16T20:56:33.092744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:10:03.312009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.081302+0000","last_change":"2024-03-16T20:55:05.272321+0000","last_active":"2024-03-16T20:56:33.081302+0000","last_peered":"2024-03-16T20:56:33.081302+0000","last_clean":"2024-03-16T20:56:33.081302+0000","last_became_active":"2024-03-16T20:55:05.272000+0000","last_became_peered":"2024-03-16T20:55:05.272000+0000","last_unstale":"2024-03-16T20:56:33.081302+0000","last_undegraded":"2024-03-16T20:56:33.081302+0000","last_fullsized":"2024-03-16T20:56:33.081302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:04:44.773709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.093650+0000","last_change":"2024-03-16T20:56:04.931594+0000","last_active":"2024-03-16T20:56:33.093650+0000","last_peered":"2024-03-16T20:56:33.093650+0000","last_clean":"2024-03-16T20:56:33.093650+0000","last_became_active":"2024-03-16T20:56:04.931169+0000","last_became_peered":"2024-03-16T20:56:04.931169+0000","last_unstale":"2024-03-16T20:56:33.093650+0000","last_undegraded":"2024-03-16T20:56:33.093650+0000","last_fullsized":"2024-03-16T20:56:33.093650+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:32:34.858387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.121535+0000","last_change":"2024-03-16T20:55:05.287329+0000","last_active":"2024-03-16T20:56:33.121535+0000","last_peered":"2024-03-16T20:56:33.121535+0000","last_clean":"2024-03-16T20:56:33.121535+0000","last_became_active":"2024-03-16T20:55:05.286893+0000","last_became_peered":"2024-03-16T20:55:05.286893+0000","last_unstale":"2024-03-16T20:56:33.121535+0000","last_undegraded":"2024-03-16T20:56:33.121535+0000","last_fullsized":"2024-03-16T20:56:33.121535+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:43:29.560525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.127233+0000","last_change":"2024-03-16T20:56:04.528956+0000","last_active":"2024-03-16T20:56:33.127233+0000","last_peered":"2024-03-16T20:56:33.127233+0000","last_clean":"2024-03-16T20:56:33.127233+0000","last_became_active":"2024-03-16T20:56:04.528503+0000","last_became_peered":"2024-03-16T20:56:04.528503+0000","last_unstale":"2024-03-16T20:56:33.127233+0000","last_undegraded":"2024-03-16T20:56:33.127233+0000","last_fullsized":"2024-03-16T20:56:33.127233+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:48:36.267693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126512+0000","last_change":"2024-03-16T20:55:05.300207+0000","last_active":"2024-03-16T20:56:33.126512+0000","last_peered":"2024-03-16T20:56:33.126512+0000","last_clean":"2024-03-16T20:56:33.126512+0000","last_became_active":"2024-03-16T20:55:05.298892+0000","last_became_peered":"2024-03-16T20:55:05.298892+0000","last_unstale":"2024-03-16T20:56:33.126512+0000","last_undegraded":"2024-03-16T20:56:33.126512+0000","last_fullsized":"2024-03-16T20:56:33.126512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:29.158690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.076742+0000","last_change":"2024-03-16T20:55:05.272135+0000","last_active":"2024-03-16T20:56:33.076742+0000","last_peered":"2024-03-16T20:56:33.076742+0000","last_clean":"2024-03-16T20:56:33.076742+0000","last_became_active":"2024-03-16T20:55:05.271779+0000","last_became_peered":"2024-03-16T20:55:05.271779+0000","last_unstale":"2024-03-16T20:56:33.076742+0000","last_undegraded":"2024-03-16T20:56:33.076742+0000","last_fullsized":"2024-03-16T20:56:33.076742+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:42:58.085726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.091576+0000","last_change":"2024-03-16T20:55:05.268810+0000","last_active":"2024-03-16T20:56:33.091576+0000","last_peered":"2024-03-16T20:56:33.091576+0000","last_clean":"2024-03-16T20:56:33.091576+0000","last_became_active":"2024-03-16T20:55:05.268473+0000","last_became_peered":"2024-03-16T20:55:05.268473+0000","last_unstale":"2024-03-16T20:56:33.091576+0000","last_undegraded":"2024-03-16T20:56:33.091576+0000","last_fullsized":"2024-03-16T20:56:33.091576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:48:00.990207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.105929+0000","last_change":"2024-03-16T20:55:05.284121+0000","last_active":"2024-03-16T20:56:33.105929+0000","last_peered":"2024-03-16T20:56:33.105929+0000","last_clean":"2024-03-16T20:56:33.105929+0000","last_became_active":"2024-03-16T20:55:05.283588+0000","last_became_peered":"2024-03-16T20:55:05.283588+0000","last_unstale":"2024-03-16T20:56:33.105929+0000","last_undegraded":"2024-03-16T20:56:33.105929+0000","last_fullsized":"2024-03-16T20:56:33.105929+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:05:56.679346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.118595+0000","last_change":"2024-03-16T20:56:04.525435+0000","last_active":"2024-03-16T20:56:33.118595+0000","last_peered":"2024-03-16T20:56:33.118595+0000","last_clean":"2024-03-16T20:56:33.118595+0000","last_became_active":"2024-03-16T20:56:04.524924+0000","last_became_peered":"2024-03-16T20:56:04.524924+0000","last_unstale":"2024-03-16T20:56:33.118595+0000","last_undegraded":"2024-03-16T20:56:33.118595+0000","last_fullsized":"2024-03-16T20:56:33.118595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:36:49.367824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.107415+0000","last_change":"2024-03-16T20:55:05.277957+0000","last_active":"2024-03-16T20:56:33.107415+0000","last_peered":"2024-03-16T20:56:33.107415+0000","last_clean":"2024-03-16T20:56:33.107415+0000","last_became_active":"2024-03-16T20:55:05.277610+0000","last_became_peered":"2024-03-16T20:55:05.277610+0000","last_unstale":"2024-03-16T20:56:33.107415+0000","last_undegraded":"2024-03-16T20:56:33.107415+0000","last_fullsized":"2024-03-16T20:56:33.107415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:54:29.010945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.111826+0000","last_change":"2024-03-16T20:55:05.288112+0000","last_active":"2024-03-16T20:56:33.111826+0000","last_peered":"2024-03-16T20:56:33.111826+0000","last_clean":"2024-03-16T20:56:33.111826+0000","last_became_active":"2024-03-16T20:55:05.287791+0000","last_became_peered":"2024-03-16T20:55:05.287791+0000","last_unstale":"2024-03-16T20:56:33.111826+0000","last_undegraded":"2024-03-16T20:56:33.111826+0000","last_fullsized":"2024-03-16T20:56:33.111826+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:55:57.625981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126740+0000","last_change":"2024-03-16T20:55:05.311327+0000","last_active":"2024-03-16T20:56:33.126740+0000","last_peered":"2024-03-16T20:56:33.126740+0000","last_clean":"2024-03-16T20:56:33.126740+0000","last_became_active":"2024-03-16T20:55:05.310820+0000","last_became_peered":"2024-03-16T20:55:05.310820+0000","last_unstale":"2024-03-16T20:56:33.126740+0000","last_undegraded":"2024-03-16T20:56:33.126740+0000","last_fullsized":"2024-03-16T20:56:33.126740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:38:26.081078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.083750+0000","last_change":"2024-03-16T20:55:05.277942+0000","last_active":"2024-03-16T20:56:33.083750+0000","last_peered":"2024-03-16T20:56:33.083750+0000","last_clean":"2024-03-16T20:56:33.083750+0000","last_became_active":"2024-03-16T20:55:05.277588+0000","last_became_peered":"2024-03-16T20:55:05.277588+0000","last_unstale":"2024-03-16T20:56:33.083750+0000","last_undegraded":"2024-03-16T20:56:33.083750+0000","last_fullsized":"2024-03-16T20:56:33.083750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:32:38.464939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":211842,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68928,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":869,"num_read_kb":509,"num_write":177,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":206784,"data_compressed":5547,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351019,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":459360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612656,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":1115737,"data_compressed":37704,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776181,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":970752,"data_stored":459601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037821,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":958464,"data_stored":459292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":1051785,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462983,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":458873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":523142,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":460144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411424,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1040384,"data_stored":524802,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149784,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":459067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888147,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":459842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724621,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1050627,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":64476,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66136,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66586,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T20:57:35.178 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-03-16T20:57:35.178 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T20:57:35.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:34 smithi170 ceph-mon[35947]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:57:35.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:34 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3537587071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:35.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:34 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:35.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.428+0000 7f42dca00640 1 -- 172.21.15.8:0/2256057648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42d8107210 msgr2=0x7f42d8109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:35.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.428+0000 7f42dca00640 1 --2- 172.21.15.8:0/2256057648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42d8107210 0x7f42d8109660 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009ca0 tx=0x7f42d002c0f0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.428+0000 7f42dca00640 1 -- 172.21.15.8:0/2256057648 shutdown_connections 2024-03-16T20:57:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.428+0000 7f42dca00640 1 --2- 172.21.15.8:0/2256057648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42d8107210 0x7f42d8109660 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.428+0000 7f42dca00640 1 --2- 172.21.15.8:0/2256057648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d81048e0 0x7f42d8106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.428+0000 7f42dca00640 1 --2- 172.21.15.8:0/2256057648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42d8101fb0 0x7f42d81043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.428+0000 7f42dca00640 1 -- 172.21.15.8:0/2256057648 >> 172.21.15.8:0/2256057648 conn(0x7f42d80fb9a0 msgr2=0x7f42d80fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.428+0000 7f42dca00640 1 -- 172.21.15.8:0/2256057648 shutdown_connections 2024-03-16T20:57:35.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.428+0000 7f42dca00640 1 -- 172.21.15.8:0/2256057648 wait complete. 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.429+0000 7f42dca00640 1 Processor -- start 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.429+0000 7f42dca00640 1 -- start start 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42dca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42d8101fb0 0x7f42d8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42dca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42d81048e0 0x7f42d8199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42dca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d8107210 0x7f42d81a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42dca00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d81a1330 con 0x7f42d81048e0 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42dca00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d81a14a0 con 0x7f42d8107210 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42dca00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d81a1660 con 0x7f42d8101fb0 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42d5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42d8101fb0 0x7f42d8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42d5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42d8101fb0 0x7f42d8199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:42258/0 (socket says 172.21.15.8:42258) 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42d5e00640 1 -- 172.21.15.8:0/3690174927 learned_addr learned my addr 172.21.15.8:0/3690174927 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42d6800640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d8107210 0x7f42d81a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42d5400640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42d81048e0 0x7f42d8199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42d5e00640 1 -- 172.21.15.8:0/3690174927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d8107210 msgr2=0x7f42d81a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42d5e00640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d8107210 0x7f42d81a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42d5e00640 1 -- 172.21.15.8:0/3690174927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42d81048e0 msgr2=0x7f42d8199d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42d5e00640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42d81048e0 0x7f42d8199d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42d5e00640 1 -- 172.21.15.8:0/3690174927 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d0009900 con 0x7f42d8101fb0 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.430+0000 7f42d5400640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42d81048e0 0x7f42d8199d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.431+0000 7f42d5e00640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42d8101fb0 0x7f42d8199840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f42c800e9f0 tx=0x7f42c800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.431+0000 7f42cea00640 1 -- 172.21.15.8:0/3690174927 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8009700 con 0x7f42d8101fb0 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.431+0000 7f42cea00640 1 -- 172.21.15.8:0/3690174927 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f42c800cd80 con 0x7f42d8101fb0 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.431+0000 7f42cea00640 1 -- 172.21.15.8:0/3690174927 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c80189c0 con 0x7f42d8101fb0 2024-03-16T20:57:35.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.431+0000 7f42dca00640 1 -- 172.21.15.8:0/3690174927 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d81a1940 con 0x7f42d8101fb0 2024-03-16T20:57:35.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.431+0000 7f42dca00640 1 -- 172.21.15.8:0/3690174927 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d81a1ea0 con 0x7f42d8101fb0 2024-03-16T20:57:35.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.432+0000 7f42dca00640 1 -- 172.21.15.8:0/3690174927 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d8068760 con 0x7f42d8101fb0 2024-03-16T20:57:35.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.434+0000 7f42cea00640 1 -- 172.21.15.8:0/3690174927 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f42c8018b20 con 0x7f42d8101fb0 2024-03-16T20:57:35.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.436+0000 7f42cea00640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42bc0a1ab0 0x7f42bc0a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:35.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.436+0000 7f42cea00640 1 -- 172.21.15.8:0/3690174927 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f42c8014070 con 0x7f42d8101fb0 2024-03-16T20:57:35.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.436+0000 7f42d5400640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42bc0a1ab0 0x7f42bc0a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:35.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.437+0000 7f42d5400640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42bc0a1ab0 0x7f42bc0a3f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f42d819ad50 tx=0x7f42c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:35.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.438+0000 7f42cea00640 1 -- 172.21.15.8:0/3690174927 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f42c8096960 con 0x7f42d8101fb0 2024-03-16T20:57:35.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.639+0000 7f42dca00640 1 -- 172.21.15.8:0/3690174927 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42d802d0d0 con 0x7f42bc0a1ab0 2024-03-16T20:57:35.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.656+0000 7f42cea00640 1 -- 172.21.15.8:0/3690174927 <== mgr.14152 v2:172.21.15.8:6800/1064583862 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259024 (secure 0 0 0) 0x7f42d802d0d0 con 0x7f42bc0a1ab0 2024-03-16T20:57:35.663 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:35.664 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 -- 172.21.15.8:0/3690174927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42bc0a1ab0 msgr2=0x7f42bc0a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42bc0a1ab0 0x7f42bc0a3f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f42d819ad50 tx=0x7f42c4005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 -- 172.21.15.8:0/3690174927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42d8101fb0 msgr2=0x7f42d8199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42d8101fb0 0x7f42d8199840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f42c800e9f0 tx=0x7f42c800eeb0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 -- 172.21.15.8:0/3690174927 shutdown_connections 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f42bc0a1ab0 0x7f42bc0a3f70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d8107210 0x7f42d81a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42d81048e0 0x7f42d8199d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 --2- 172.21.15.8:0/3690174927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42d8101fb0 0x7f42d8199840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 -- 172.21.15.8:0/3690174927 >> 172.21.15.8:0/3690174927 conn(0x7f42d80fb9a0 msgr2=0x7f42d8101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 -- 172.21.15.8:0/3690174927 shutdown_connections 2024-03-16T20:57:35.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.661+0000 7f42dca00640 1 -- 172.21.15.8:0/3690174927 wait complete. 2024-03-16T20:57:35.685 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2024-03-16T20:57:35.147361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659530,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1016,"num_read_kb":629,"num_write":360,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1180965,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364976,"kb_used_data":11664,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576848,"statfs":{"total":1151940427776,"available":1151566692352,"internally_reserved":0,"allocated":11943936,"data_stored":7482582,"data_compressed":113112,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":620,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":32,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004827"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126450+0000","last_change":"2024-03-16T20:55:05.301473+0000","last_active":"2024-03-16T20:56:33.126450+0000","last_peered":"2024-03-16T20:56:33.126450+0000","last_clean":"2024-03-16T20:56:33.126450+0000","last_became_active":"2024-03-16T20:55:05.301166+0000","last_became_peered":"2024-03-16T20:55:05.301166+0000","last_unstale":"2024-03-16T20:56:33.126450+0000","last_undegraded":"2024-03-16T20:56:33.126450+0000","last_fullsized":"2024-03-16T20:56:33.126450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:06:51.838382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126555+0000","last_change":"2024-03-16T20:55:05.295895+0000","last_active":"2024-03-16T20:56:33.126555+0000","last_peered":"2024-03-16T20:56:33.126555+0000","last_clean":"2024-03-16T20:56:33.126555+0000","last_became_active":"2024-03-16T20:55:05.295365+0000","last_became_peered":"2024-03-16T20:55:05.295365+0000","last_unstale":"2024-03-16T20:56:33.126555+0000","last_undegraded":"2024-03-16T20:56:33.126555+0000","last_fullsized":"2024-03-16T20:56:33.126555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:28:20.342348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.125136+0000","last_change":"2024-03-16T20:55:05.299049+0000","last_active":"2024-03-16T20:56:33.125136+0000","last_peered":"2024-03-16T20:56:33.125136+0000","last_clean":"2024-03-16T20:56:33.125136+0000","last_became_active":"2024-03-16T20:55:05.292758+0000","last_became_peered":"2024-03-16T20:55:05.292758+0000","last_unstale":"2024-03-16T20:56:33.125136+0000","last_undegraded":"2024-03-16T20:56:33.125136+0000","last_fullsized":"2024-03-16T20:56:33.125136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:20:36.276639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.074294+0000","last_change":"2024-03-16T20:55:05.274453+0000","last_active":"2024-03-16T20:56:33.074294+0000","last_peered":"2024-03-16T20:56:33.074294+0000","last_clean":"2024-03-16T20:56:33.074294+0000","last_became_active":"2024-03-16T20:55:05.273648+0000","last_became_peered":"2024-03-16T20:55:05.273648+0000","last_unstale":"2024-03-16T20:56:33.074294+0000","last_undegraded":"2024-03-16T20:56:33.074294+0000","last_fullsized":"2024-03-16T20:56:33.074294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:08:37.297906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.102846+0000","last_change":"2024-03-16T20:55:05.291272+0000","last_active":"2024-03-16T20:56:33.102846+0000","last_peered":"2024-03-16T20:56:33.102846+0000","last_clean":"2024-03-16T20:56:33.102846+0000","last_became_active":"2024-03-16T20:55:05.290788+0000","last_became_peered":"2024-03-16T20:55:05.290788+0000","last_unstale":"2024-03-16T20:56:33.102846+0000","last_undegraded":"2024-03-16T20:56:33.102846+0000","last_fullsized":"2024-03-16T20:56:33.102846+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:36:42.842797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.089110+0000","last_change":"2024-03-16T20:55:05.289977+0000","last_active":"2024-03-16T20:56:33.089110+0000","last_peered":"2024-03-16T20:56:33.089110+0000","last_clean":"2024-03-16T20:56:33.089110+0000","last_became_active":"2024-03-16T20:55:05.289520+0000","last_became_peered":"2024-03-16T20:55:05.289520+0000","last_unstale":"2024-03-16T20:56:33.089110+0000","last_undegraded":"2024-03-16T20:56:33.089110+0000","last_fullsized":"2024-03-16T20:56:33.089110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:25:49.270854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092814+0000","last_change":"2024-03-16T20:55:05.286244+0000","last_active":"2024-03-16T20:56:33.092814+0000","last_peered":"2024-03-16T20:56:33.092814+0000","last_clean":"2024-03-16T20:56:33.092814+0000","last_became_active":"2024-03-16T20:55:05.285871+0000","last_became_peered":"2024-03-16T20:55:05.285871+0000","last_unstale":"2024-03-16T20:56:33.092814+0000","last_undegraded":"2024-03-16T20:56:33.092814+0000","last_fullsized":"2024-03-16T20:56:33.092814+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:24:47.334046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.116224+0000","last_change":"2024-03-16T20:55:05.293902+0000","last_active":"2024-03-16T20:56:33.116224+0000","last_peered":"2024-03-16T20:56:33.116224+0000","last_clean":"2024-03-16T20:56:33.116224+0000","last_became_active":"2024-03-16T20:55:05.284424+0000","last_became_peered":"2024-03-16T20:55:05.284424+0000","last_unstale":"2024-03-16T20:56:33.116224+0000","last_undegraded":"2024-03-16T20:56:33.116224+0000","last_fullsized":"2024-03-16T20:56:33.116224+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:09:15.024337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.096400+0000","last_change":"2024-03-16T20:55:05.271434+0000","last_active":"2024-03-16T20:56:33.096400+0000","last_peered":"2024-03-16T20:56:33.096400+0000","last_clean":"2024-03-16T20:56:33.096400+0000","last_became_active":"2024-03-16T20:55:05.271014+0000","last_became_peered":"2024-03-16T20:55:05.271014+0000","last_unstale":"2024-03-16T20:56:33.096400+0000","last_undegraded":"2024-03-16T20:56:33.096400+0000","last_fullsized":"2024-03-16T20:56:33.096400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:09:47.133987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092078+0000","last_change":"2024-03-16T20:55:05.275108+0000","last_active":"2024-03-16T20:56:33.092078+0000","last_peered":"2024-03-16T20:56:33.092078+0000","last_clean":"2024-03-16T20:56:33.092078+0000","last_became_active":"2024-03-16T20:55:05.274659+0000","last_became_peered":"2024-03-16T20:55:05.274659+0000","last_unstale":"2024-03-16T20:56:33.092078+0000","last_undegraded":"2024-03-16T20:56:33.092078+0000","last_fullsized":"2024-03-16T20:56:33.092078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:10:16.801309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.093334+0000","last_change":"2024-03-16T20:55:05.273322+0000","last_active":"2024-03-16T20:56:33.093334+0000","last_peered":"2024-03-16T20:56:33.093334+0000","last_clean":"2024-03-16T20:56:33.093334+0000","last_became_active":"2024-03-16T20:55:05.272999+0000","last_became_peered":"2024-03-16T20:55:05.272999+0000","last_unstale":"2024-03-16T20:56:33.093334+0000","last_undegraded":"2024-03-16T20:56:33.093334+0000","last_fullsized":"2024-03-16T20:56:33.093334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:49:43.426765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.083039+0000","last_change":"2024-03-16T20:55:05.274729+0000","last_active":"2024-03-16T20:56:33.083039+0000","last_peered":"2024-03-16T20:56:33.083039+0000","last_clean":"2024-03-16T20:56:33.083039+0000","last_became_active":"2024-03-16T20:55:05.274131+0000","last_became_peered":"2024-03-16T20:55:05.274131+0000","last_unstale":"2024-03-16T20:56:33.083039+0000","last_undegraded":"2024-03-16T20:56:33.083039+0000","last_fullsized":"2024-03-16T20:56:33.083039+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:59:43.413956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123499+0000","last_change":"2024-03-16T20:56:04.522061+0000","last_active":"2024-03-16T20:56:33.123499+0000","last_peered":"2024-03-16T20:56:33.123499+0000","last_clean":"2024-03-16T20:56:33.123499+0000","last_became_active":"2024-03-16T20:56:04.521622+0000","last_became_peered":"2024-03-16T20:56:04.521622+0000","last_unstale":"2024-03-16T20:56:33.123499+0000","last_undegraded":"2024-03-16T20:56:33.123499+0000","last_fullsized":"2024-03-16T20:56:33.123499+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:00:52.309217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.122771+0000","last_change":"2024-03-16T20:55:05.282707+0000","last_active":"2024-03-16T20:56:33.122771+0000","last_peered":"2024-03-16T20:56:33.122771+0000","last_clean":"2024-03-16T20:56:33.122771+0000","last_became_active":"2024-03-16T20:55:05.282168+0000","last_became_peered":"2024-03-16T20:55:05.282168+0000","last_unstale":"2024-03-16T20:56:33.122771+0000","last_undegraded":"2024-03-16T20:56:33.122771+0000","last_fullsized":"2024-03-16T20:56:33.122771+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:33:59.464303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.120399+0000","last_change":"2024-03-16T20:55:05.290291+0000","last_active":"2024-03-16T20:56:33.120399+0000","last_peered":"2024-03-16T20:56:33.120399+0000","last_clean":"2024-03-16T20:56:33.120399+0000","last_became_active":"2024-03-16T20:55:05.289952+0000","last_became_peered":"2024-03-16T20:55:05.289952+0000","last_unstale":"2024-03-16T20:56:33.120399+0000","last_undegraded":"2024-03-16T20:56:33.120399+0000","last_fullsized":"2024-03-16T20:56:33.120399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:05.334408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123069+0000","last_change":"2024-03-16T20:55:05.284252+0000","last_active":"2024-03-16T20:56:33.123069+0000","last_peered":"2024-03-16T20:56:33.123069+0000","last_clean":"2024-03-16T20:56:33.123069+0000","last_became_active":"2024-03-16T20:55:05.283804+0000","last_became_peered":"2024-03-16T20:55:05.283804+0000","last_unstale":"2024-03-16T20:56:33.123069+0000","last_undegraded":"2024-03-16T20:56:33.123069+0000","last_fullsized":"2024-03-16T20:56:33.123069+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:03:17.942719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126588+0000","last_change":"2024-03-16T20:55:05.296118+0000","last_active":"2024-03-16T20:56:33.126588+0000","last_peered":"2024-03-16T20:56:33.126588+0000","last_clean":"2024-03-16T20:56:33.126588+0000","last_became_active":"2024-03-16T20:55:05.295783+0000","last_became_peered":"2024-03-16T20:55:05.295783+0000","last_unstale":"2024-03-16T20:56:33.126588+0000","last_undegraded":"2024-03-16T20:56:33.126588+0000","last_fullsized":"2024-03-16T20:56:33.126588+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:36:15.463748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.103440+0000","last_change":"2024-03-16T20:55:05.287221+0000","last_active":"2024-03-16T20:56:33.103440+0000","last_peered":"2024-03-16T20:56:33.103440+0000","last_clean":"2024-03-16T20:56:33.103440+0000","last_became_active":"2024-03-16T20:55:05.286553+0000","last_became_peered":"2024-03-16T20:55:05.286553+0000","last_unstale":"2024-03-16T20:56:33.103440+0000","last_undegraded":"2024-03-16T20:56:33.103440+0000","last_fullsized":"2024-03-16T20:56:33.103440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:33:25.688231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.108663+0000","last_change":"2024-03-16T20:55:05.280111+0000","last_active":"2024-03-16T20:56:33.108663+0000","last_peered":"2024-03-16T20:56:33.108663+0000","last_clean":"2024-03-16T20:56:33.108663+0000","last_became_active":"2024-03-16T20:55:05.279857+0000","last_became_peered":"2024-03-16T20:55:05.279857+0000","last_unstale":"2024-03-16T20:56:33.108663+0000","last_undegraded":"2024-03-16T20:56:33.108663+0000","last_fullsized":"2024-03-16T20:56:33.108663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:57:18.205253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516330+0000","last_change":"2024-03-16T20:55:04.268836+0000","last_active":"2024-03-16T20:56:04.516330+0000","last_peered":"2024-03-16T20:56:04.516330+0000","last_clean":"2024-03-16T20:56:04.516330+0000","last_became_active":"2024-03-16T20:55:04.266502+0000","last_became_peered":"2024-03-16T20:55:04.266502+0000","last_unstale":"2024-03-16T20:56:04.516330+0000","last_undegraded":"2024-03-16T20:56:04.516330+0000","last_fullsized":"2024-03-16T20:56:04.516330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:12:33.717454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.103940+0000","last_change":"2024-03-16T20:55:05.280158+0000","last_active":"2024-03-16T20:56:33.103940+0000","last_peered":"2024-03-16T20:56:33.103940+0000","last_clean":"2024-03-16T20:56:33.103940+0000","last_became_active":"2024-03-16T20:55:05.278918+0000","last_became_peered":"2024-03-16T20:55:05.278918+0000","last_unstale":"2024-03-16T20:56:33.103940+0000","last_undegraded":"2024-03-16T20:56:33.103940+0000","last_fullsized":"2024-03-16T20:56:33.103940+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:27:34.158596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513417+0000","last_change":"2024-03-16T20:55:04.283366+0000","last_active":"2024-03-16T20:56:04.513417+0000","last_peered":"2024-03-16T20:56:04.513417+0000","last_clean":"2024-03-16T20:56:04.513417+0000","last_became_active":"2024-03-16T20:55:04.283016+0000","last_became_peered":"2024-03-16T20:55:04.283016+0000","last_unstale":"2024-03-16T20:56:04.513417+0000","last_undegraded":"2024-03-16T20:56:04.513417+0000","last_fullsized":"2024-03-16T20:56:04.513417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:41.163294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.127403+0000","last_change":"2024-03-16T20:55:05.299005+0000","last_active":"2024-03-16T20:56:33.127403+0000","last_peered":"2024-03-16T20:56:33.127403+0000","last_clean":"2024-03-16T20:56:33.127403+0000","last_became_active":"2024-03-16T20:55:05.296527+0000","last_became_peered":"2024-03-16T20:55:05.296527+0000","last_unstale":"2024-03-16T20:56:33.127403+0000","last_undegraded":"2024-03-16T20:56:33.127403+0000","last_fullsized":"2024-03-16T20:56:33.127403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:56:51.451900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515275+0000","last_change":"2024-03-16T20:55:04.259210+0000","last_active":"2024-03-16T20:56:04.515275+0000","last_peered":"2024-03-16T20:56:04.515275+0000","last_clean":"2024-03-16T20:56:04.515275+0000","last_became_active":"2024-03-16T20:55:04.258828+0000","last_became_peered":"2024-03-16T20:55:04.258828+0000","last_unstale":"2024-03-16T20:56:04.515275+0000","last_undegraded":"2024-03-16T20:56:04.515275+0000","last_fullsized":"2024-03-16T20:56:04.515275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:21:14.497086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.117791+0000","last_change":"2024-03-16T20:55:05.272053+0000","last_active":"2024-03-16T20:56:33.117791+0000","last_peered":"2024-03-16T20:56:33.117791+0000","last_clean":"2024-03-16T20:56:33.117791+0000","last_became_active":"2024-03-16T20:55:05.271435+0000","last_became_peered":"2024-03-16T20:55:05.271435+0000","last_unstale":"2024-03-16T20:56:33.117791+0000","last_undegraded":"2024-03-16T20:56:33.117791+0000","last_fullsized":"2024-03-16T20:56:33.117791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:08:47.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515025+0000","last_change":"2024-03-16T20:55:04.261051+0000","last_active":"2024-03-16T20:56:04.515025+0000","last_peered":"2024-03-16T20:56:04.515025+0000","last_clean":"2024-03-16T20:56:04.515025+0000","last_became_active":"2024-03-16T20:55:04.260701+0000","last_became_peered":"2024-03-16T20:55:04.260701+0000","last_unstale":"2024-03-16T20:56:04.515025+0000","last_undegraded":"2024-03-16T20:56:04.515025+0000","last_fullsized":"2024-03-16T20:56:04.515025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:30:05.233891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.099430+0000","last_change":"2024-03-16T20:55:05.270047+0000","last_active":"2024-03-16T20:56:33.099430+0000","last_peered":"2024-03-16T20:56:33.099430+0000","last_clean":"2024-03-16T20:56:33.099430+0000","last_became_active":"2024-03-16T20:55:05.269045+0000","last_became_peered":"2024-03-16T20:55:05.269045+0000","last_unstale":"2024-03-16T20:56:33.099430+0000","last_undegraded":"2024-03-16T20:56:33.099430+0000","last_fullsized":"2024-03-16T20:56:33.099430+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:54:19.289648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":172,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:32.510677+0000","last_change":"2024-03-16T20:55:04.258871+0000","last_active":"2024-03-16T20:57:32.510677+0000","last_peered":"2024-03-16T20:57:32.510677+0000","last_clean":"2024-03-16T20:57:32.510677+0000","last_became_active":"2024-03-16T20:55:04.258462+0000","last_became_peered":"2024-03-16T20:55:04.258462+0000","last_unstale":"2024-03-16T20:57:32.510677+0000","last_undegraded":"2024-03-16T20:57:32.510677+0000","last_fullsized":"2024-03-16T20:57:32.510677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:16:29.832814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.086810+0000","last_change":"2024-03-16T20:55:05.290789+0000","last_active":"2024-03-16T20:56:33.086810+0000","last_peered":"2024-03-16T20:56:33.086810+0000","last_clean":"2024-03-16T20:56:33.086810+0000","last_became_active":"2024-03-16T20:55:05.290367+0000","last_became_peered":"2024-03-16T20:55:05.290367+0000","last_unstale":"2024-03-16T20:56:33.086810+0000","last_undegraded":"2024-03-16T20:56:33.086810+0000","last_fullsized":"2024-03-16T20:56:33.086810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:23:38.509837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513422+0000","last_change":"2024-03-16T20:55:04.264980+0000","last_active":"2024-03-16T20:56:04.513422+0000","last_peered":"2024-03-16T20:56:04.513422+0000","last_clean":"2024-03-16T20:56:04.513422+0000","last_became_active":"2024-03-16T20:55:04.264634+0000","last_became_peered":"2024-03-16T20:55:04.264634+0000","last_unstale":"2024-03-16T20:56:04.513422+0000","last_undegraded":"2024-03-16T20:56:04.513422+0000","last_fullsized":"2024-03-16T20:56:04.513422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:16:52.713847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.111066+0000","last_change":"2024-03-16T20:55:05.286139+0000","last_active":"2024-03-16T20:56:33.111066+0000","last_peered":"2024-03-16T20:56:33.111066+0000","last_clean":"2024-03-16T20:56:33.111066+0000","last_became_active":"2024-03-16T20:55:05.285751+0000","last_became_peered":"2024-03-16T20:55:05.285751+0000","last_unstale":"2024-03-16T20:56:33.111066+0000","last_undegraded":"2024-03-16T20:56:33.111066+0000","last_fullsized":"2024-03-16T20:56:33.111066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:01:02.448785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.517750+0000","last_change":"2024-03-16T20:55:04.282416+0000","last_active":"2024-03-16T20:56:04.517750+0000","last_peered":"2024-03-16T20:56:04.517750+0000","last_clean":"2024-03-16T20:56:04.517750+0000","last_became_active":"2024-03-16T20:55:04.280504+0000","last_became_peered":"2024-03-16T20:55:04.280504+0000","last_unstale":"2024-03-16T20:56:04.517750+0000","last_undegraded":"2024-03-16T20:56:04.517750+0000","last_fullsized":"2024-03-16T20:56:04.517750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:23.940976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123969+0000","last_change":"2024-03-16T20:55:05.289210+0000","last_active":"2024-03-16T20:56:33.123969+0000","last_peered":"2024-03-16T20:56:33.123969+0000","last_clean":"2024-03-16T20:56:33.123969+0000","last_became_active":"2024-03-16T20:55:05.286738+0000","last_became_peered":"2024-03-16T20:55:05.286738+0000","last_unstale":"2024-03-16T20:56:33.123969+0000","last_undegraded":"2024-03-16T20:56:33.123969+0000","last_fullsized":"2024-03-16T20:56:33.123969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:43:45.266727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605273+0000","last_change":"2024-03-16T20:55:04.258925+0000","last_active":"2024-03-16T20:56:04.605273+0000","last_peered":"2024-03-16T20:56:04.605273+0000","last_clean":"2024-03-16T20:56:04.605273+0000","last_became_active":"2024-03-16T20:55:04.258578+0000","last_became_peered":"2024-03-16T20:55:04.258578+0000","last_unstale":"2024-03-16T20:56:04.605273+0000","last_undegraded":"2024-03-16T20:56:04.605273+0000","last_fullsized":"2024-03-16T20:56:04.605273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:52.812547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.121075+0000","last_change":"2024-03-16T20:55:05.302122+0000","last_active":"2024-03-16T20:56:33.121075+0000","last_peered":"2024-03-16T20:56:33.121075+0000","last_clean":"2024-03-16T20:56:33.121075+0000","last_became_active":"2024-03-16T20:55:05.301743+0000","last_became_peered":"2024-03-16T20:55:05.301743+0000","last_unstale":"2024-03-16T20:56:33.121075+0000","last_undegraded":"2024-03-16T20:56:33.121075+0000","last_fullsized":"2024-03-16T20:56:33.121075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:32:51.691780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":164,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:29.507171+0000","last_change":"2024-03-16T20:55:04.270015+0000","last_active":"2024-03-16T20:57:29.507171+0000","last_peered":"2024-03-16T20:57:29.507171+0000","last_clean":"2024-03-16T20:57:29.507171+0000","last_became_active":"2024-03-16T20:55:04.269563+0000","last_became_peered":"2024-03-16T20:55:04.269563+0000","last_unstale":"2024-03-16T20:57:29.507171+0000","last_undegraded":"2024-03-16T20:57:29.507171+0000","last_fullsized":"2024-03-16T20:57:29.507171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:39:21.768540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.096449+0000","last_change":"2024-03-16T20:55:05.290639+0000","last_active":"2024-03-16T20:56:33.096449+0000","last_peered":"2024-03-16T20:56:33.096449+0000","last_clean":"2024-03-16T20:56:33.096449+0000","last_became_active":"2024-03-16T20:55:05.290255+0000","last_became_peered":"2024-03-16T20:55:05.290255+0000","last_unstale":"2024-03-16T20:56:33.096449+0000","last_undegraded":"2024-03-16T20:56:33.096449+0000","last_fullsized":"2024-03-16T20:56:33.096449+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:36:13.303557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930573+0000","last_change":"2024-03-16T20:55:04.260407+0000","last_active":"2024-03-16T20:56:04.930573+0000","last_peered":"2024-03-16T20:56:04.930573+0000","last_clean":"2024-03-16T20:56:04.930573+0000","last_became_active":"2024-03-16T20:55:04.259817+0000","last_became_peered":"2024-03-16T20:55:04.259817+0000","last_unstale":"2024-03-16T20:56:04.930573+0000","last_undegraded":"2024-03-16T20:56:04.930573+0000","last_fullsized":"2024-03-16T20:56:04.930573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:07.995508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126099+0000","last_change":"2024-03-16T20:55:05.295327+0000","last_active":"2024-03-16T20:56:33.126099+0000","last_peered":"2024-03-16T20:56:33.126099+0000","last_clean":"2024-03-16T20:56:33.126099+0000","last_became_active":"2024-03-16T20:55:05.294948+0000","last_became_peered":"2024-03-16T20:55:05.294948+0000","last_unstale":"2024-03-16T20:56:33.126099+0000","last_undegraded":"2024-03-16T20:56:33.126099+0000","last_fullsized":"2024-03-16T20:56:33.126099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:29.305366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605638+0000","last_change":"2024-03-16T20:55:04.264571+0000","last_active":"2024-03-16T20:56:04.605638+0000","last_peered":"2024-03-16T20:56:04.605638+0000","last_clean":"2024-03-16T20:56:04.605638+0000","last_became_active":"2024-03-16T20:55:04.264200+0000","last_became_peered":"2024-03-16T20:55:04.264200+0000","last_unstale":"2024-03-16T20:56:04.605638+0000","last_undegraded":"2024-03-16T20:56:04.605638+0000","last_fullsized":"2024-03-16T20:56:04.605638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:38:58.457250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.100869+0000","last_change":"2024-03-16T20:55:05.272855+0000","last_active":"2024-03-16T20:56:33.100869+0000","last_peered":"2024-03-16T20:56:33.100869+0000","last_clean":"2024-03-16T20:56:33.100869+0000","last_became_active":"2024-03-16T20:55:05.272500+0000","last_became_peered":"2024-03-16T20:55:05.272500+0000","last_unstale":"2024-03-16T20:56:33.100869+0000","last_undegraded":"2024-03-16T20:56:33.100869+0000","last_fullsized":"2024-03-16T20:56:33.100869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:50:17.121966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'37","reported_seq":348,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:29.507010+0000","last_change":"2024-03-16T20:55:04.260050+0000","last_active":"2024-03-16T20:57:29.507010+0000","last_peered":"2024-03-16T20:57:29.507010+0000","last_clean":"2024-03-16T20:57:29.507010+0000","last_became_active":"2024-03-16T20:55:04.259662+0000","last_became_peered":"2024-03-16T20:55:04.259662+0000","last_unstale":"2024-03-16T20:57:29.507010+0000","last_undegraded":"2024-03-16T20:57:29.507010+0000","last_fullsized":"2024-03-16T20:57:29.507010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:45:46.999980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64476,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":291,"num_read_kb":208,"num_write":38,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.090736+0000","last_change":"2024-03-16T20:55:05.272337+0000","last_active":"2024-03-16T20:56:33.090736+0000","last_peered":"2024-03-16T20:56:33.090736+0000","last_clean":"2024-03-16T20:56:33.090736+0000","last_became_active":"2024-03-16T20:55:05.271761+0000","last_became_peered":"2024-03-16T20:55:05.271761+0000","last_unstale":"2024-03-16T20:56:33.090736+0000","last_undegraded":"2024-03-16T20:56:33.090736+0000","last_fullsized":"2024-03-16T20:56:33.090736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:50:22.079709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513415+0000","last_change":"2024-03-16T20:55:04.275606+0000","last_active":"2024-03-16T20:56:04.513415+0000","last_peered":"2024-03-16T20:56:04.513415+0000","last_clean":"2024-03-16T20:56:04.513415+0000","last_became_active":"2024-03-16T20:55:04.275268+0000","last_became_peered":"2024-03-16T20:55:04.275268+0000","last_unstale":"2024-03-16T20:56:04.513415+0000","last_undegraded":"2024-03-16T20:56:04.513415+0000","last_fullsized":"2024-03-16T20:56:04.513415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:27:34.248831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.122124+0000","last_change":"2024-03-16T20:55:05.290619+0000","last_active":"2024-03-16T20:56:33.122124+0000","last_peered":"2024-03-16T20:56:33.122124+0000","last_clean":"2024-03-16T20:56:33.122124+0000","last_became_active":"2024-03-16T20:55:05.289943+0000","last_became_peered":"2024-03-16T20:55:05.289943+0000","last_unstale":"2024-03-16T20:56:33.122124+0000","last_undegraded":"2024-03-16T20:56:33.122124+0000","last_fullsized":"2024-03-16T20:56:33.122124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:17:30.569777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605298+0000","last_change":"2024-03-16T20:55:04.274206+0000","last_active":"2024-03-16T20:56:04.605298+0000","last_peered":"2024-03-16T20:56:04.605298+0000","last_clean":"2024-03-16T20:56:04.605298+0000","last_became_active":"2024-03-16T20:55:04.273834+0000","last_became_peered":"2024-03-16T20:55:04.273834+0000","last_unstale":"2024-03-16T20:56:04.605298+0000","last_undegraded":"2024-03-16T20:56:04.605298+0000","last_fullsized":"2024-03-16T20:56:04.605298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:36:04.720463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.125056+0000","last_change":"2024-03-16T20:55:05.280265+0000","last_active":"2024-03-16T20:56:33.125056+0000","last_peered":"2024-03-16T20:56:33.125056+0000","last_clean":"2024-03-16T20:56:33.125056+0000","last_became_active":"2024-03-16T20:55:05.279774+0000","last_became_peered":"2024-03-16T20:55:05.279774+0000","last_unstale":"2024-03-16T20:56:33.125056+0000","last_undegraded":"2024-03-16T20:56:33.125056+0000","last_fullsized":"2024-03-16T20:56:33.125056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:34:52.855290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":173,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:32.603443+0000","last_change":"2024-03-16T20:55:04.256314+0000","last_active":"2024-03-16T20:57:32.603443+0000","last_peered":"2024-03-16T20:57:32.603443+0000","last_clean":"2024-03-16T20:57:32.603443+0000","last_became_active":"2024-03-16T20:55:04.255940+0000","last_became_peered":"2024-03-16T20:55:04.255940+0000","last_unstale":"2024-03-16T20:57:32.603443+0000","last_undegraded":"2024-03-16T20:57:32.603443+0000","last_fullsized":"2024-03-16T20:57:32.603443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:27:09.660107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":149,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.097303+0000","last_change":"2024-03-16T20:55:05.271562+0000","last_active":"2024-03-16T20:56:33.097303+0000","last_peered":"2024-03-16T20:56:33.097303+0000","last_clean":"2024-03-16T20:56:33.097303+0000","last_became_active":"2024-03-16T20:55:05.271214+0000","last_became_peered":"2024-03-16T20:55:05.271214+0000","last_unstale":"2024-03-16T20:56:33.097303+0000","last_undegraded":"2024-03-16T20:56:33.097303+0000","last_fullsized":"2024-03-16T20:56:33.097303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:42:35.104345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.537648+0000","last_change":"2024-03-16T20:56:04.537276+0000","last_active":"2024-03-16T20:56:04.537648+0000","last_peered":"2024-03-16T20:56:04.537648+0000","last_clean":"2024-03-16T20:56:04.537648+0000","last_became_active":"2024-03-16T20:56:04.526059+0000","last_became_peered":"2024-03-16T20:56:04.526059+0000","last_unstale":"2024-03-16T20:56:04.537648+0000","last_undegraded":"2024-03-16T20:56:04.537648+0000","last_fullsized":"2024-03-16T20:56:04.537648+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:17:50.898269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.098918+0000","last_change":"2024-03-16T20:55:05.269751+0000","last_active":"2024-03-16T20:56:33.098918+0000","last_peered":"2024-03-16T20:56:33.098918+0000","last_clean":"2024-03-16T20:56:33.098918+0000","last_became_active":"2024-03-16T20:55:05.269375+0000","last_became_peered":"2024-03-16T20:55:05.269375+0000","last_unstale":"2024-03-16T20:56:33.098918+0000","last_undegraded":"2024-03-16T20:56:33.098918+0000","last_fullsized":"2024-03-16T20:56:33.098918+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:57:00.751155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515295+0000","last_change":"2024-03-16T20:55:04.254352+0000","last_active":"2024-03-16T20:56:04.515295+0000","last_peered":"2024-03-16T20:56:04.515295+0000","last_clean":"2024-03-16T20:56:04.515295+0000","last_became_active":"2024-03-16T20:55:04.253895+0000","last_became_peered":"2024-03-16T20:55:04.253895+0000","last_unstale":"2024-03-16T20:56:04.515295+0000","last_undegraded":"2024-03-16T20:56:04.515295+0000","last_fullsized":"2024-03-16T20:56:04.515295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:35:15.796341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.083605+0000","last_change":"2024-03-16T20:55:05.271148+0000","last_active":"2024-03-16T20:56:33.083605+0000","last_peered":"2024-03-16T20:56:33.083605+0000","last_clean":"2024-03-16T20:56:33.083605+0000","last_became_active":"2024-03-16T20:55:05.270836+0000","last_became_peered":"2024-03-16T20:55:05.270836+0000","last_unstale":"2024-03-16T20:56:33.083605+0000","last_undegraded":"2024-03-16T20:56:33.083605+0000","last_fullsized":"2024-03-16T20:56:33.083605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:12:49.526828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.516195+0000","last_change":"2024-03-16T20:55:04.277152+0000","last_active":"2024-03-16T20:56:04.516195+0000","last_peered":"2024-03-16T20:56:04.516195+0000","last_clean":"2024-03-16T20:56:04.516195+0000","last_became_active":"2024-03-16T20:55:04.276666+0000","last_became_peered":"2024-03-16T20:55:04.276666+0000","last_unstale":"2024-03-16T20:56:04.516195+0000","last_undegraded":"2024-03-16T20:56:04.516195+0000","last_fullsized":"2024-03-16T20:56:04.516195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:39:04.919957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.097762+0000","last_change":"2024-03-16T20:56:04.529323+0000","last_active":"2024-03-16T20:56:33.097762+0000","last_peered":"2024-03-16T20:56:33.097762+0000","last_clean":"2024-03-16T20:56:33.097762+0000","last_became_active":"2024-03-16T20:56:04.521484+0000","last_became_peered":"2024-03-16T20:56:04.521484+0000","last_unstale":"2024-03-16T20:56:33.097762+0000","last_undegraded":"2024-03-16T20:56:33.097762+0000","last_fullsized":"2024-03-16T20:56:33.097762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:00:31.203774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930141+0000","last_change":"2024-03-16T20:55:04.270960+0000","last_active":"2024-03-16T20:56:04.930141+0000","last_peered":"2024-03-16T20:56:04.930141+0000","last_clean":"2024-03-16T20:56:04.930141+0000","last_became_active":"2024-03-16T20:55:04.270605+0000","last_became_peered":"2024-03-16T20:55:04.270605+0000","last_unstale":"2024-03-16T20:56:04.930141+0000","last_undegraded":"2024-03-16T20:56:04.930141+0000","last_fullsized":"2024-03-16T20:56:04.930141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:06:53.529116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.120497+0000","last_change":"2024-03-16T20:55:05.303690+0000","last_active":"2024-03-16T20:56:33.120497+0000","last_peered":"2024-03-16T20:56:33.120497+0000","last_clean":"2024-03-16T20:56:33.120497+0000","last_became_active":"2024-03-16T20:55:05.303096+0000","last_became_peered":"2024-03-16T20:55:05.303096+0000","last_unstale":"2024-03-16T20:56:33.120497+0000","last_undegraded":"2024-03-16T20:56:33.120497+0000","last_fullsized":"2024-03-16T20:56:33.120497+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:03:25.139693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.082999+0000","last_change":"2024-03-16T20:55:05.268277+0000","last_active":"2024-03-16T20:56:33.082999+0000","last_peered":"2024-03-16T20:56:33.082999+0000","last_clean":"2024-03-16T20:56:33.082999+0000","last_became_active":"2024-03-16T20:55:05.267955+0000","last_became_peered":"2024-03-16T20:55:05.267955+0000","last_unstale":"2024-03-16T20:56:33.082999+0000","last_undegraded":"2024-03-16T20:56:33.082999+0000","last_fullsized":"2024-03-16T20:56:33.082999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:20:21.633055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":167,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:30.600026+0000","last_change":"2024-03-16T20:55:04.277286+0000","last_active":"2024-03-16T20:57:30.600026+0000","last_peered":"2024-03-16T20:57:30.600026+0000","last_clean":"2024-03-16T20:57:30.600026+0000","last_became_active":"2024-03-16T20:55:04.276855+0000","last_became_peered":"2024-03-16T20:55:04.276855+0000","last_unstale":"2024-03-16T20:57:30.600026+0000","last_undegraded":"2024-03-16T20:57:30.600026+0000","last_fullsized":"2024-03-16T20:57:30.600026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:22:19.590782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.113733+0000","last_change":"2024-03-16T20:55:05.280255+0000","last_active":"2024-03-16T20:56:33.113733+0000","last_peered":"2024-03-16T20:56:33.113733+0000","last_clean":"2024-03-16T20:56:33.113733+0000","last_became_active":"2024-03-16T20:55:05.279762+0000","last_became_peered":"2024-03-16T20:55:05.279762+0000","last_unstale":"2024-03-16T20:56:33.113733+0000","last_undegraded":"2024-03-16T20:56:33.113733+0000","last_fullsized":"2024-03-16T20:56:33.113733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:31.687047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903922+0000","last_change":"2024-03-16T20:55:04.263605+0000","last_active":"2024-03-16T20:56:04.903922+0000","last_peered":"2024-03-16T20:56:04.903922+0000","last_clean":"2024-03-16T20:56:04.903922+0000","last_became_active":"2024-03-16T20:55:04.263189+0000","last_became_peered":"2024-03-16T20:55:04.263189+0000","last_unstale":"2024-03-16T20:56:04.903922+0000","last_undegraded":"2024-03-16T20:56:04.903922+0000","last_fullsized":"2024-03-16T20:56:04.903922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:28:11.377134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":352,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930006+0000","last_change":"2024-03-16T20:53:44.281432+0000","last_active":"2024-03-16T20:56:04.930006+0000","last_peered":"2024-03-16T20:56:04.930006+0000","last_clean":"2024-03-16T20:56:04.930006+0000","last_became_active":"2024-03-16T20:53:44.280927+0000","last_became_peered":"2024-03-16T20:53:44.280927+0000","last_unstale":"2024-03-16T20:56:04.930006+0000","last_undegraded":"2024-03-16T20:56:04.930006+0000","last_fullsized":"2024-03-16T20:56:04.930006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:49:51.705234+0000","last_clean_scrub_stamp":"2024-03-16T20:49:51.705234+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:01:00.727073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123405+0000","last_change":"2024-03-16T20:56:04.525541+0000","last_active":"2024-03-16T20:56:33.123405+0000","last_peered":"2024-03-16T20:56:33.123405+0000","last_clean":"2024-03-16T20:56:33.123405+0000","last_became_active":"2024-03-16T20:56:04.522548+0000","last_became_peered":"2024-03-16T20:56:04.522548+0000","last_unstale":"2024-03-16T20:56:33.123405+0000","last_undegraded":"2024-03-16T20:56:33.123405+0000","last_fullsized":"2024-03-16T20:56:33.123405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:35:54.115845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.930116+0000","last_change":"2024-03-16T20:55:04.256842+0000","last_active":"2024-03-16T20:56:04.930116+0000","last_peered":"2024-03-16T20:56:04.930116+0000","last_clean":"2024-03-16T20:56:04.930116+0000","last_became_active":"2024-03-16T20:55:04.256493+0000","last_became_peered":"2024-03-16T20:55:04.256493+0000","last_unstale":"2024-03-16T20:56:04.930116+0000","last_undegraded":"2024-03-16T20:56:04.930116+0000","last_fullsized":"2024-03-16T20:56:04.930116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:14:08.836034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515149+0000","last_change":"2024-03-16T20:55:04.265503+0000","last_active":"2024-03-16T20:56:04.515149+0000","last_peered":"2024-03-16T20:56:04.515149+0000","last_clean":"2024-03-16T20:56:04.515149+0000","last_became_active":"2024-03-16T20:55:04.265017+0000","last_became_peered":"2024-03-16T20:55:04.265017+0000","last_unstale":"2024-03-16T20:56:04.515149+0000","last_undegraded":"2024-03-16T20:56:04.515149+0000","last_fullsized":"2024-03-16T20:56:04.515149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:25:28.485079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.115525+0000","last_change":"2024-03-16T20:55:05.289100+0000","last_active":"2024-03-16T20:56:33.115525+0000","last_peered":"2024-03-16T20:56:33.115525+0000","last_clean":"2024-03-16T20:56:33.115525+0000","last_became_active":"2024-03-16T20:55:05.288122+0000","last_became_peered":"2024-03-16T20:55:05.288122+0000","last_unstale":"2024-03-16T20:56:33.115525+0000","last_undegraded":"2024-03-16T20:56:33.115525+0000","last_fullsized":"2024-03-16T20:56:33.115525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:03.222038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:57:14.360616+0000","last_change":"2024-03-16T20:55:04.282230+0000","last_active":"2024-03-16T20:57:14.360616+0000","last_peered":"2024-03-16T20:57:14.360616+0000","last_clean":"2024-03-16T20:57:14.360616+0000","last_became_active":"2024-03-16T20:55:04.281917+0000","last_became_peered":"2024-03-16T20:55:04.281917+0000","last_unstale":"2024-03-16T20:57:14.360616+0000","last_undegraded":"2024-03-16T20:57:14.360616+0000","last_fullsized":"2024-03-16T20:57:14.360616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:18:36.370408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.117621+0000","last_change":"2024-03-16T20:55:05.293378+0000","last_active":"2024-03-16T20:56:33.117621+0000","last_peered":"2024-03-16T20:56:33.117621+0000","last_clean":"2024-03-16T20:56:33.117621+0000","last_became_active":"2024-03-16T20:55:05.288648+0000","last_became_peered":"2024-03-16T20:55:05.288648+0000","last_unstale":"2024-03-16T20:56:33.117621+0000","last_undegraded":"2024-03-16T20:56:33.117621+0000","last_fullsized":"2024-03-16T20:56:33.117621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:37:58.270760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.903998+0000","last_change":"2024-03-16T20:55:04.268766+0000","last_active":"2024-03-16T20:56:04.903998+0000","last_peered":"2024-03-16T20:56:04.903998+0000","last_clean":"2024-03-16T20:56:04.903998+0000","last_became_active":"2024-03-16T20:55:04.268429+0000","last_became_peered":"2024-03-16T20:55:04.268429+0000","last_unstale":"2024-03-16T20:56:04.903998+0000","last_undegraded":"2024-03-16T20:56:04.903998+0000","last_fullsized":"2024-03-16T20:56:04.903998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:43.872155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.127101+0000","last_change":"2024-03-16T20:55:05.310349+0000","last_active":"2024-03-16T20:56:33.127101+0000","last_peered":"2024-03-16T20:56:33.127101+0000","last_clean":"2024-03-16T20:56:33.127101+0000","last_became_active":"2024-03-16T20:55:05.307987+0000","last_became_peered":"2024-03-16T20:55:05.307987+0000","last_unstale":"2024-03-16T20:56:33.127101+0000","last_undegraded":"2024-03-16T20:56:33.127101+0000","last_fullsized":"2024-03-16T20:56:33.127101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:19:38.142783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.929413+0000","last_change":"2024-03-16T20:55:04.269683+0000","last_active":"2024-03-16T20:56:04.929413+0000","last_peered":"2024-03-16T20:56:04.929413+0000","last_clean":"2024-03-16T20:56:04.929413+0000","last_became_active":"2024-03-16T20:55:04.269258+0000","last_became_peered":"2024-03-16T20:55:04.269258+0000","last_unstale":"2024-03-16T20:56:04.929413+0000","last_undegraded":"2024-03-16T20:56:04.929413+0000","last_fullsized":"2024-03-16T20:56:04.929413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:24:10.417179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.073581+0000","last_change":"2024-03-16T20:55:05.272238+0000","last_active":"2024-03-16T20:56:33.073581+0000","last_peered":"2024-03-16T20:56:33.073581+0000","last_clean":"2024-03-16T20:56:33.073581+0000","last_became_active":"2024-03-16T20:55:05.270379+0000","last_became_peered":"2024-03-16T20:55:05.270379+0000","last_unstale":"2024-03-16T20:56:33.073581+0000","last_undegraded":"2024-03-16T20:56:33.073581+0000","last_fullsized":"2024-03-16T20:56:33.073581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:16:11.348601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.512181+0000","last_change":"2024-03-16T20:55:04.280008+0000","last_active":"2024-03-16T20:56:04.512181+0000","last_peered":"2024-03-16T20:56:04.512181+0000","last_clean":"2024-03-16T20:56:04.512181+0000","last_became_active":"2024-03-16T20:55:04.279683+0000","last_became_peered":"2024-03-16T20:55:04.279683+0000","last_unstale":"2024-03-16T20:56:04.512181+0000","last_undegraded":"2024-03-16T20:56:04.512181+0000","last_fullsized":"2024-03-16T20:56:04.512181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:27:15.734826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.121869+0000","last_change":"2024-03-16T20:55:05.287219+0000","last_active":"2024-03-16T20:56:33.121869+0000","last_peered":"2024-03-16T20:56:33.121869+0000","last_clean":"2024-03-16T20:56:33.121869+0000","last_became_active":"2024-03-16T20:55:05.286899+0000","last_became_peered":"2024-03-16T20:55:05.286899+0000","last_unstale":"2024-03-16T20:56:33.121869+0000","last_undegraded":"2024-03-16T20:56:33.121869+0000","last_fullsized":"2024-03-16T20:56:33.121869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T08:33:01.483415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:06.416690+0000","last_change":"2024-03-16T20:56:04.520433+0000","last_active":"2024-03-16T20:56:06.416690+0000","last_peered":"2024-03-16T20:56:06.416690+0000","last_clean":"2024-03-16T20:56:06.416690+0000","last_became_active":"2024-03-16T20:56:04.516521+0000","last_became_peered":"2024-03-16T20:56:04.516521+0000","last_unstale":"2024-03-16T20:56:06.416690+0000","last_undegraded":"2024-03-16T20:56:06.416690+0000","last_fullsized":"2024-03-16T20:56:06.416690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T07:44:38.094213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126424+0000","last_change":"2024-03-16T20:55:05.311463+0000","last_active":"2024-03-16T20:56:33.126424+0000","last_peered":"2024-03-16T20:56:33.126424+0000","last_clean":"2024-03-16T20:56:33.126424+0000","last_became_active":"2024-03-16T20:55:05.310852+0000","last_became_peered":"2024-03-16T20:55:05.310852+0000","last_unstale":"2024-03-16T20:56:33.126424+0000","last_undegraded":"2024-03-16T20:56:33.126424+0000","last_fullsized":"2024-03-16T20:56:33.126424+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:51:52.980193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.514650+0000","last_change":"2024-03-16T20:55:04.260372+0000","last_active":"2024-03-16T20:56:04.514650+0000","last_peered":"2024-03-16T20:56:04.514650+0000","last_clean":"2024-03-16T20:56:04.514650+0000","last_became_active":"2024-03-16T20:55:04.259273+0000","last_became_peered":"2024-03-16T20:55:04.259273+0000","last_unstale":"2024-03-16T20:56:04.514650+0000","last_undegraded":"2024-03-16T20:56:04.514650+0000","last_fullsized":"2024-03-16T20:56:04.514650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:21:25.212520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.123563+0000","last_change":"2024-03-16T20:55:05.280088+0000","last_active":"2024-03-16T20:56:33.123563+0000","last_peered":"2024-03-16T20:56:33.123563+0000","last_clean":"2024-03-16T20:56:33.123563+0000","last_became_active":"2024-03-16T20:55:05.279745+0000","last_became_peered":"2024-03-16T20:55:05.279745+0000","last_unstale":"2024-03-16T20:56:33.123563+0000","last_undegraded":"2024-03-16T20:56:33.123563+0000","last_fullsized":"2024-03-16T20:56:33.123563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:02:08.797287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.513571+0000","last_change":"2024-03-16T20:55:04.275221+0000","last_active":"2024-03-16T20:56:04.513571+0000","last_peered":"2024-03-16T20:56:04.513571+0000","last_clean":"2024-03-16T20:56:04.513571+0000","last_became_active":"2024-03-16T20:55:04.274887+0000","last_became_peered":"2024-03-16T20:55:04.274887+0000","last_unstale":"2024-03-16T20:56:04.513571+0000","last_undegraded":"2024-03-16T20:56:04.513571+0000","last_fullsized":"2024-03-16T20:56:04.513571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:15:35.333864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.100949+0000","last_change":"2024-03-16T20:55:05.272444+0000","last_active":"2024-03-16T20:56:33.100949+0000","last_peered":"2024-03-16T20:56:33.100949+0000","last_clean":"2024-03-16T20:56:33.100949+0000","last_became_active":"2024-03-16T20:55:05.272104+0000","last_became_peered":"2024-03-16T20:55:05.272104+0000","last_unstale":"2024-03-16T20:56:33.100949+0000","last_undegraded":"2024-03-16T20:56:33.100949+0000","last_fullsized":"2024-03-16T20:56:33.100949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:13:35.480408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.605424+0000","last_change":"2024-03-16T20:55:04.274212+0000","last_active":"2024-03-16T20:56:04.605424+0000","last_peered":"2024-03-16T20:56:04.605424+0000","last_clean":"2024-03-16T20:56:04.605424+0000","last_became_active":"2024-03-16T20:55:04.273785+0000","last_became_peered":"2024-03-16T20:55:04.273785+0000","last_unstale":"2024-03-16T20:56:04.605424+0000","last_undegraded":"2024-03-16T20:56:04.605424+0000","last_fullsized":"2024-03-16T20:56:04.605424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:29:00.924789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.108284+0000","last_change":"2024-03-16T20:55:05.278590+0000","last_active":"2024-03-16T20:56:33.108284+0000","last_peered":"2024-03-16T20:56:33.108284+0000","last_clean":"2024-03-16T20:56:33.108284+0000","last_became_active":"2024-03-16T20:55:05.278183+0000","last_became_peered":"2024-03-16T20:55:05.278183+0000","last_unstale":"2024-03-16T20:56:33.108284+0000","last_undegraded":"2024-03-16T20:56:33.108284+0000","last_fullsized":"2024-03-16T20:56:33.108284+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:52:18.918653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:04.515951+0000","last_change":"2024-03-16T20:55:04.279568+0000","last_active":"2024-03-16T20:56:04.515951+0000","last_peered":"2024-03-16T20:56:04.515951+0000","last_clean":"2024-03-16T20:56:04.515951+0000","last_became_active":"2024-03-16T20:55:04.278125+0000","last_became_peered":"2024-03-16T20:55:04.278125+0000","last_unstale":"2024-03-16T20:56:04.515951+0000","last_undegraded":"2024-03-16T20:56:04.515951+0000","last_fullsized":"2024-03-16T20:56:04.515951+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:03.228328+0000","last_clean_scrub_stamp":"2024-03-16T20:55:03.228328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:13:20.417216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.092744+0000","last_change":"2024-03-16T20:55:05.269732+0000","last_active":"2024-03-16T20:56:33.092744+0000","last_peered":"2024-03-16T20:56:33.092744+0000","last_clean":"2024-03-16T20:56:33.092744+0000","last_became_active":"2024-03-16T20:55:05.269260+0000","last_became_peered":"2024-03-16T20:55:05.269260+0000","last_unstale":"2024-03-16T20:56:33.092744+0000","last_undegraded":"2024-03-16T20:56:33.092744+0000","last_fullsized":"2024-03-16T20:56:33.092744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:10:03.312009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.081302+0000","last_change":"2024-03-16T20:55:05.272321+0000","last_active":"2024-03-16T20:56:33.081302+0000","last_peered":"2024-03-16T20:56:33.081302+0000","last_clean":"2024-03-16T20:56:33.081302+0000","last_became_active":"2024-03-16T20:55:05.272000+0000","last_became_peered":"2024-03-16T20:55:05.272000+0000","last_unstale":"2024-03-16T20:56:33.081302+0000","last_undegraded":"2024-03-16T20:56:33.081302+0000","last_fullsized":"2024-03-16T20:56:33.081302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:04:44.773709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.093650+0000","last_change":"2024-03-16T20:56:04.931594+0000","last_active":"2024-03-16T20:56:33.093650+0000","last_peered":"2024-03-16T20:56:33.093650+0000","last_clean":"2024-03-16T20:56:33.093650+0000","last_became_active":"2024-03-16T20:56:04.931169+0000","last_became_peered":"2024-03-16T20:56:04.931169+0000","last_unstale":"2024-03-16T20:56:33.093650+0000","last_undegraded":"2024-03-16T20:56:33.093650+0000","last_fullsized":"2024-03-16T20:56:33.093650+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:32:34.858387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.121535+0000","last_change":"2024-03-16T20:55:05.287329+0000","last_active":"2024-03-16T20:56:33.121535+0000","last_peered":"2024-03-16T20:56:33.121535+0000","last_clean":"2024-03-16T20:56:33.121535+0000","last_became_active":"2024-03-16T20:55:05.286893+0000","last_became_peered":"2024-03-16T20:55:05.286893+0000","last_unstale":"2024-03-16T20:56:33.121535+0000","last_undegraded":"2024-03-16T20:56:33.121535+0000","last_fullsized":"2024-03-16T20:56:33.121535+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:43:29.560525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.127233+0000","last_change":"2024-03-16T20:56:04.528956+0000","last_active":"2024-03-16T20:56:33.127233+0000","last_peered":"2024-03-16T20:56:33.127233+0000","last_clean":"2024-03-16T20:56:33.127233+0000","last_became_active":"2024-03-16T20:56:04.528503+0000","last_became_peered":"2024-03-16T20:56:04.528503+0000","last_unstale":"2024-03-16T20:56:33.127233+0000","last_undegraded":"2024-03-16T20:56:33.127233+0000","last_fullsized":"2024-03-16T20:56:33.127233+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:48:36.267693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126512+0000","last_change":"2024-03-16T20:55:05.300207+0000","last_active":"2024-03-16T20:56:33.126512+0000","last_peered":"2024-03-16T20:56:33.126512+0000","last_clean":"2024-03-16T20:56:33.126512+0000","last_became_active":"2024-03-16T20:55:05.298892+0000","last_became_peered":"2024-03-16T20:55:05.298892+0000","last_unstale":"2024-03-16T20:56:33.126512+0000","last_undegraded":"2024-03-16T20:56:33.126512+0000","last_fullsized":"2024-03-16T20:56:33.126512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:43:29.158690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.076742+0000","last_change":"2024-03-16T20:55:05.272135+0000","last_active":"2024-03-16T20:56:33.076742+0000","last_peered":"2024-03-16T20:56:33.076742+0000","last_clean":"2024-03-16T20:56:33.076742+0000","last_became_active":"2024-03-16T20:55:05.271779+0000","last_became_peered":"2024-03-16T20:55:05.271779+0000","last_unstale":"2024-03-16T20:56:33.076742+0000","last_undegraded":"2024-03-16T20:56:33.076742+0000","last_fullsized":"2024-03-16T20:56:33.076742+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:42:58.085726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.091576+0000","last_change":"2024-03-16T20:55:05.268810+0000","last_active":"2024-03-16T20:56:33.091576+0000","last_peered":"2024-03-16T20:56:33.091576+0000","last_clean":"2024-03-16T20:56:33.091576+0000","last_became_active":"2024-03-16T20:55:05.268473+0000","last_became_peered":"2024-03-16T20:55:05.268473+0000","last_unstale":"2024-03-16T20:56:33.091576+0000","last_undegraded":"2024-03-16T20:56:33.091576+0000","last_fullsized":"2024-03-16T20:56:33.091576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T06:48:00.990207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.105929+0000","last_change":"2024-03-16T20:55:05.284121+0000","last_active":"2024-03-16T20:56:33.105929+0000","last_peered":"2024-03-16T20:56:33.105929+0000","last_clean":"2024-03-16T20:56:33.105929+0000","last_became_active":"2024-03-16T20:55:05.283588+0000","last_became_peered":"2024-03-16T20:55:05.283588+0000","last_unstale":"2024-03-16T20:56:33.105929+0000","last_undegraded":"2024-03-16T20:56:33.105929+0000","last_fullsized":"2024-03-16T20:56:33.105929+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:05:56.679346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.118595+0000","last_change":"2024-03-16T20:56:04.525435+0000","last_active":"2024-03-16T20:56:33.118595+0000","last_peered":"2024-03-16T20:56:33.118595+0000","last_clean":"2024-03-16T20:56:33.118595+0000","last_became_active":"2024-03-16T20:56:04.524924+0000","last_became_peered":"2024-03-16T20:56:04.524924+0000","last_unstale":"2024-03-16T20:56:33.118595+0000","last_undegraded":"2024-03-16T20:56:33.118595+0000","last_fullsized":"2024-03-16T20:56:33.118595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:36:49.367824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.107415+0000","last_change":"2024-03-16T20:55:05.277957+0000","last_active":"2024-03-16T20:56:33.107415+0000","last_peered":"2024-03-16T20:56:33.107415+0000","last_clean":"2024-03-16T20:56:33.107415+0000","last_became_active":"2024-03-16T20:55:05.277610+0000","last_became_peered":"2024-03-16T20:55:05.277610+0000","last_unstale":"2024-03-16T20:56:33.107415+0000","last_undegraded":"2024-03-16T20:56:33.107415+0000","last_fullsized":"2024-03-16T20:56:33.107415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:54:29.010945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.111826+0000","last_change":"2024-03-16T20:55:05.288112+0000","last_active":"2024-03-16T20:56:33.111826+0000","last_peered":"2024-03-16T20:56:33.111826+0000","last_clean":"2024-03-16T20:56:33.111826+0000","last_became_active":"2024-03-16T20:55:05.287791+0000","last_became_peered":"2024-03-16T20:55:05.287791+0000","last_unstale":"2024-03-16T20:56:33.111826+0000","last_undegraded":"2024-03-16T20:56:33.111826+0000","last_fullsized":"2024-03-16T20:56:33.111826+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:55:57.625981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.126740+0000","last_change":"2024-03-16T20:55:05.311327+0000","last_active":"2024-03-16T20:56:33.126740+0000","last_peered":"2024-03-16T20:56:33.126740+0000","last_clean":"2024-03-16T20:56:33.126740+0000","last_became_active":"2024-03-16T20:55:05.310820+0000","last_became_peered":"2024-03-16T20:55:05.310820+0000","last_unstale":"2024-03-16T20:56:33.126740+0000","last_undegraded":"2024-03-16T20:56:33.126740+0000","last_fullsized":"2024-03-16T20:56:33.126740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:38:26.081078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-16T20:56:33.083750+0000","last_change":"2024-03-16T20:55:05.277942+0000","last_active":"2024-03-16T20:56:33.083750+0000","last_peered":"2024-03-16T20:56:33.083750+0000","last_clean":"2024-03-16T20:56:33.083750+0000","last_became_active":"2024-03-16T20:55:05.277588+0000","last_became_peered":"2024-03-16T20:55:05.277588+0000","last_unstale":"2024-03-16T20:56:33.083750+0000","last_undegraded":"2024-03-16T20:56:33.083750+0000","last_fullsized":"2024-03-16T20:56:33.083750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T20:55:04.236973+0000","last_clean_scrub_stamp":"2024-03-16T20:55:04.236973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:32:38.464939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":211842,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68928,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":880,"num_read_kb":510,"num_write":177,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":206784,"data_compressed":5547,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351019,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":459360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612656,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":1115737,"data_compressed":37704,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776182,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":970752,"data_stored":459601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037822,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":958464,"data_stored":459292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":1051785,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462983,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":458873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":523142,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":460144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411424,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1040384,"data_stored":524802,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149784,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":459067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888148,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":459842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724622,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1050937,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34211,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35855,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":64476,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66136,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66586,"data_compressed":1849,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T20:57:35.689 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:57:35.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.943+0000 7fb676600640 1 -- 172.21.15.8:0/1066587192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb670073f50 msgr2=0x7fb6700743d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:35.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.943+0000 7fb676600640 1 --2- 172.21.15.8:0/1066587192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb670073f50 0x7fb6700743d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb658009900 tx=0x7fb65802bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:35.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.944+0000 7fb676600640 1 -- 172.21.15.8:0/1066587192 shutdown_connections 2024-03-16T20:57:35.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.944+0000 7fb676600640 1 --2- 172.21.15.8:0/1066587192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb67010dad0 0x7fb67010fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.944+0000 7fb676600640 1 --2- 172.21.15.8:0/1066587192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb670073f50 0x7fb6700743d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.944+0000 7fb676600640 1 --2- 172.21.15.8:0/1066587192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb670075530 0x7fb670073980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.944+0000 7fb676600640 1 -- 172.21.15.8:0/1066587192 >> 172.21.15.8:0/1066587192 conn(0x7fb6700fcad0 msgr2=0x7fb6700feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:35.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.944+0000 7fb676600640 1 -- 172.21.15.8:0/1066587192 shutdown_connections 2024-03-16T20:57:35.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.944+0000 7fb676600640 1 -- 172.21.15.8:0/1066587192 wait complete. 2024-03-16T20:57:35.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.945+0000 7fb676600640 1 Processor -- start 2024-03-16T20:57:35.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.945+0000 7fb676600640 1 -- start start 2024-03-16T20:57:35.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.945+0000 7fb676600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb670073f50 0x7fb67019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:35.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.945+0000 7fb676600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670075530 0x7fb67019e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:35.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.945+0000 7fb676600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb67010dad0 0x7fb6701a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.945+0000 7fb676600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6701a5740 con 0x7fb670075530 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.945+0000 7fb676600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6701a58b0 con 0x7fb670073f50 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.945+0000 7fb676600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6701a5a70 con 0x7fb67010dad0 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb66f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb670073f50 0x7fb67019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb66fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb67010dad0 0x7fb6701a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb66fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb67010dad0 0x7fb6701a51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:42280/0 (socket says 172.21.15.8:42280) 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb66fe00640 1 -- 172.21.15.8:0/653269994 learned_addr learned my addr 172.21.15.8:0/653269994 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb66f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb670073f50 0x7fb67019dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40848/0 (socket says 172.21.15.8:40848) 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb667e00640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670075530 0x7fb67019e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb66f400640 1 -- 172.21.15.8:0/653269994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb67010dad0 msgr2=0x7fb6701a51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb66f400640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb67010dad0 0x7fb6701a51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb66f400640 1 -- 172.21.15.8:0/653269994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670075530 msgr2=0x7fb67019e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb66f400640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670075530 0x7fb67019e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:35.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb66f400640 1 -- 172.21.15.8:0/653269994 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb660009490 con 0x7fb670073f50 2024-03-16T20:57:35.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.946+0000 7fb667e00640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670075530 0x7fb67019e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:35.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.947+0000 7fb66f400640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb670073f50 0x7fb67019dc60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb66000e9f0 tx=0x7fb66000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:35.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.947+0000 7fb66cc00640 1 -- 172.21.15.8:0/653269994 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66000cd80 con 0x7fb670073f50 2024-03-16T20:57:35.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.947+0000 7fb66cc00640 1 -- 172.21.15.8:0/653269994 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb6600035f0 con 0x7fb670073f50 2024-03-16T20:57:35.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.947+0000 7fb66cc00640 1 -- 172.21.15.8:0/653269994 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb660010690 con 0x7fb670073f50 2024-03-16T20:57:35.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.947+0000 7fb676600640 1 -- 172.21.15.8:0/653269994 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb658009560 con 0x7fb670073f50 2024-03-16T20:57:35.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.947+0000 7fb676600640 1 -- 172.21.15.8:0/653269994 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6701a6120 con 0x7fb670073f50 2024-03-16T20:57:35.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.948+0000 7fb676600640 1 -- 172.21.15.8:0/653269994 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb670103ca0 con 0x7fb670073f50 2024-03-16T20:57:35.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.950+0000 7fb66cc00640 1 -- 172.21.15.8:0/653269994 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fb660003b80 con 0x7fb670073f50 2024-03-16T20:57:35.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.952+0000 7fb66cc00640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6540a1ab0 0x7fb6540a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:35.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.952+0000 7fb66cc00640 1 -- 172.21.15.8:0/653269994 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb660014070 con 0x7fb670073f50 2024-03-16T20:57:35.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.952+0000 7fb667e00640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6540a1ab0 0x7fb6540a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:35.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.953+0000 7fb667e00640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6540a1ab0 0x7fb6540a3f70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb65802c250 tx=0x7fb65802df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:35.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:35.954+0000 7fb66cc00640 1 -- 172.21.15.8:0/653269994 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb66009a680 con 0x7fb670073f50 2024-03-16T20:57:35.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:35 smithi008 ceph-mon[31434]: from='client.25267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:57:35.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:35 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:35.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:35 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:35.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:35 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:35.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:35 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:36.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:35 smithi170 ceph-mon[35947]: from='client.25267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:57:36.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:35 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:36.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:35 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:36.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:35 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:36.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:35 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.198+0000 7fb676600640 1 -- 172.21.15.8:0/653269994 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb670113800 con 0x7fb670073f50 2024-03-16T20:57:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.200+0000 7fb66cc00640 1 -- 172.21.15.8:0/653269994 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22581 (secure 0 0 0) 0x7fb670113800 con 0x7fb670073f50 2024-03-16T20:57:36.204 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:36.204 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:56:04.502777+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:57:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 -- 172.21.15.8:0/653269994 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6540a1ab0 msgr2=0x7fb6540a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6540a1ab0 0x7fb6540a3f70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb65802c250 tx=0x7fb65802df90 comp rx=0 tx=0).stop 2024-03-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 -- 172.21.15.8:0/653269994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb670073f50 msgr2=0x7fb67019dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb670073f50 0x7fb67019dc60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb66000e9f0 tx=0x7fb66000eeb0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 -- 172.21.15.8:0/653269994 shutdown_connections 2024-03-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb6540a1ab0 0x7fb6540a3f70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb67010dad0 0x7fb6701a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670075530 0x7fb67019e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 --2- 172.21.15.8:0/653269994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb670073f50 0x7fb67019dc60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 -- 172.21.15.8:0/653269994 >> 172.21.15.8:0/653269994 conn(0x7fb6700fcad0 msgr2=0x7fb670100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 -- 172.21.15.8:0/653269994 shutdown_connections 2024-03-16T20:57:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.202+0000 7fb676600640 1 -- 172.21.15.8:0/653269994 wait complete. 2024-03-16T20:57:36.224 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T20:55:02.896774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T20:55:04.228958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T20:57:36.225 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T20:57:36.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:35 smithi186 ceph-mon[36391]: from='client.25267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:57:36.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:35 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:36.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:35 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:36.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:35 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:36.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:35 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:36.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.417+0000 7f8675600640 1 -- 172.21.15.8:0/1366941282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8670104920 msgr2=0x7f8670104da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:36.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.417+0000 7f8675600640 1 --2- 172.21.15.8:0/1366941282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8670104920 0x7f8670104da0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8658009900 tx=0x7f865802bc30 comp rx=0 tx=0).stop 2024-03-16T20:57:36.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.417+0000 7f8675600640 1 -- 172.21.15.8:0/1366941282 shutdown_connections 2024-03-16T20:57:36.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.417+0000 7f8675600640 1 --2- 172.21.15.8:0/1366941282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86701052e0 0x7f867010bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.417+0000 7f8675600640 1 --2- 172.21.15.8:0/1366941282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8670104920 0x7f8670104da0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.417+0000 7f8675600640 1 --2- 172.21.15.8:0/1366941282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8670103730 0x7f8670103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.417+0000 7f8675600640 1 -- 172.21.15.8:0/1366941282 >> 172.21.15.8:0/1366941282 conn(0x7f86700feca0 msgr2=0x7f86701010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:36.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.417+0000 7f8675600640 1 -- 172.21.15.8:0/1366941282 shutdown_connections 2024-03-16T20:57:36.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.417+0000 7f8675600640 1 -- 172.21.15.8:0/1366941282 wait complete. 2024-03-16T20:57:36.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.418+0000 7f8675600640 1 Processor -- start 2024-03-16T20:57:36.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.418+0000 7f8675600640 1 -- start start 2024-03-16T20:57:36.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f8675600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8670103730 0x7f86701998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:36.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f8675600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8670104920 0x7f8670199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:36.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f8675600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86701052e0 0x7f86701a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:36.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f8675600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86701a13c0 con 0x7f8670104920 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f8675600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86701a1530 con 0x7f86701052e0 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f8675600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86701a16f0 con 0x7f8670103730 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f866ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8670103730 0x7f86701998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f8666000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8670104920 0x7f8670199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f866ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8670103730 0x7f86701998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:42304/0 (socket says 172.21.15.8:42304) 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f866ea00640 1 -- 172.21.15.8:0/2735185169 learned_addr learned my addr 172.21.15.8:0/2735185169 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f866f400640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86701052e0 0x7f86701a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f866ea00640 1 -- 172.21.15.8:0/2735185169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86701052e0 msgr2=0x7f86701a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f866ea00640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86701052e0 0x7f86701a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f866ea00640 1 -- 172.21.15.8:0/2735185169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8670104920 msgr2=0x7f8670199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f866ea00640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8670104920 0x7f8670199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.419+0000 7f866ea00640 1 -- 172.21.15.8:0/2735185169 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658009560 con 0x7f8670103730 2024-03-16T20:57:36.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.420+0000 7f866ea00640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8670103730 0x7f86701998d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f866000e9c0 tx=0x7f866000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:36.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.420+0000 7f8667e00640 1 -- 172.21.15.8:0/2735185169 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660009700 con 0x7f8670103730 2024-03-16T20:57:36.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.420+0000 7f8667e00640 1 -- 172.21.15.8:0/2735185169 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f866000cd80 con 0x7f8670103730 2024-03-16T20:57:36.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.420+0000 7f8667e00640 1 -- 172.21.15.8:0/2735185169 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660010690 con 0x7f8670103730 2024-03-16T20:57:36.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.420+0000 7f8675600640 1 -- 172.21.15.8:0/2735185169 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86701a19d0 con 0x7f8670103730 2024-03-16T20:57:36.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.420+0000 7f8675600640 1 -- 172.21.15.8:0/2735185169 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86701a1e60 con 0x7f8670103730 2024-03-16T20:57:36.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.421+0000 7f8675600640 1 -- 172.21.15.8:0/2735185169 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867010a9f0 con 0x7f8670103730 2024-03-16T20:57:36.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.424+0000 7f8667e00640 1 -- 172.21.15.8:0/2735185169 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f8660003710 con 0x7f8670103730 2024-03-16T20:57:36.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.425+0000 7f8667e00640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f86540a1ab0 0x7f86540a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:36.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.425+0000 7f8667e00640 1 -- 172.21.15.8:0/2735185169 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8660014070 con 0x7f8670103730 2024-03-16T20:57:36.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.425+0000 7f8666000640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f86540a1ab0 0x7f86540a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:36.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.426+0000 7f8666000640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f86540a1ab0 0x7f86540a3f70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8658006010 tx=0x7f8658000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:36.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.429+0000 7f8667e00640 1 -- 172.21.15.8:0/2735185169 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f86600969b0 con 0x7f8670103730 2024-03-16T20:57:36.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.638+0000 7f8675600640 1 -- 172.21.15.8:0/2735185169 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f867002d0e0 con 0x7f8670103730 2024-03-16T20:57:36.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.638+0000 7f8667e00640 1 -- 172.21.15.8:0/2735185169 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f866009a070 con 0x7f8670103730 2024-03-16T20:57:36.643 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T20:57:36.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.642+0000 7f8675600640 1 -- 172.21.15.8:0/2735185169 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f86540a1ab0 msgr2=0x7f86540a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.642+0000 7f8675600640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f86540a1ab0 0x7f86540a3f70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8658006010 tx=0x7f8658000bc0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.642+0000 7f8675600640 1 -- 172.21.15.8:0/2735185169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8670103730 msgr2=0x7f86701998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.642+0000 7f8675600640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8670103730 0x7f86701998d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f866000e9c0 tx=0x7f866000ee80 comp rx=0 tx=0).stop 2024-03-16T20:57:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.642+0000 7f8675600640 1 -- 172.21.15.8:0/2735185169 shutdown_connections 2024-03-16T20:57:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.642+0000 7f8675600640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f86540a1ab0 0x7f86540a3f70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.642+0000 7f8675600640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86701052e0 0x7f86701a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.642+0000 7f8675600640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8670104920 0x7f8670199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.642+0000 7f8675600640 1 --2- 172.21.15.8:0/2735185169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8670103730 0x7f86701998d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.642+0000 7f8675600640 1 -- 172.21.15.8:0/2735185169 >> 172.21.15.8:0/2735185169 conn(0x7f86700feca0 msgr2=0x7f8670107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.643+0000 7f8675600640 1 -- 172.21.15.8:0/2735185169 shutdown_connections 2024-03-16T20:57:36.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.643+0000 7f8675600640 1 -- 172.21.15.8:0/2735185169 wait complete. 2024-03-16T20:57:36.668 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.874+0000 7fb4a7200640 1 -- 172.21.15.8:0/1064949119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a81035f0 msgr2=0x7fb4a8103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.874+0000 7fb4a7200640 1 --2- 172.21.15.8:0/1064949119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a81035f0 0x7fb4a8103a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb498009900 tx=0x7fb49802bc30 comp rx=0 tx=0).stop 2024-03-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.874+0000 7fb4a7200640 1 -- 172.21.15.8:0/1064949119 shutdown_connections 2024-03-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.874+0000 7fb4a7200640 1 --2- 172.21.15.8:0/1064949119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a81051a0 0x7fb4a810ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.874+0000 7fb4a7200640 1 --2- 172.21.15.8:0/1064949119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a81047e0 0x7fb4a8104c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.874+0000 7fb4a7200640 1 --2- 172.21.15.8:0/1064949119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a81035f0 0x7fb4a8103a10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.874+0000 7fb4a7200640 1 -- 172.21.15.8:0/1064949119 >> 172.21.15.8:0/1064949119 conn(0x7fb4a80feb60 msgr2=0x7fb4a8100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.875+0000 7fb4a7200640 1 -- 172.21.15.8:0/1064949119 shutdown_connections 2024-03-16T20:57:36.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.875+0000 7fb4a7200640 1 -- 172.21.15.8:0/1064949119 wait complete. 2024-03-16T20:57:36.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.875+0000 7fb4a7200640 1 Processor -- start 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb4a7200640 1 -- start start 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb4a7200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a81035f0 0x7fb4a81997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb4a7200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a81047e0 0x7fb4a8199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb4a7200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a81051a0 0x7fb4a81a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb4a7200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81a12d0 con 0x7fb4a81051a0 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb4a7200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81a1440 con 0x7fb4a81035f0 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb4a7200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81a1600 con 0x7fb4a81047e0 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb4a5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a81035f0 0x7fb4a81997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb4a5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a81035f0 0x7fb4a81997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40882/0 (socket says 172.21.15.8:40882) 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb49d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a81047e0 0x7fb4a8199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb4a5e00640 1 -- 172.21.15.8:0/1347027509 learned_addr learned my addr 172.21.15.8:0/1347027509 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:36.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.876+0000 7fb4a6800640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a81051a0 0x7fb4a81a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.877+0000 7fb4a5e00640 1 -- 172.21.15.8:0/1347027509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a81047e0 msgr2=0x7fb4a8199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.877+0000 7fb4a5e00640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a81047e0 0x7fb4a8199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.877+0000 7fb4a5e00640 1 -- 172.21.15.8:0/1347027509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a81051a0 msgr2=0x7fb4a81a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.877+0000 7fb4a5e00640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a81051a0 0x7fb4a81a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.877+0000 7fb4a5e00640 1 -- 172.21.15.8:0/1347027509 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb498009560 con 0x7fb4a81035f0 2024-03-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.877+0000 7fb4a5e00640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a81035f0 0x7fb4a81997e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb498000c00 tx=0x7fb49802c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.877+0000 7fb49f400640 1 -- 172.21.15.8:0/1347027509 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4980043d0 con 0x7fb4a81035f0 2024-03-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.877+0000 7fb49f400640 1 -- 172.21.15.8:0/1347027509 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb498005310 con 0x7fb4a81035f0 2024-03-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.878+0000 7fb49f400640 1 -- 172.21.15.8:0/1347027509 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498003e50 con 0x7fb4a81035f0 2024-03-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.878+0000 7fb4a7200640 1 -- 172.21.15.8:0/1347027509 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a81a1880 con 0x7fb4a81035f0 2024-03-16T20:57:36.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.878+0000 7fb4a7200640 1 -- 172.21.15.8:0/1347027509 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a81a1d40 con 0x7fb4a81035f0 2024-03-16T20:57:36.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.879+0000 7fb4a7200640 1 -- 172.21.15.8:0/1347027509 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a810a840 con 0x7fb4a81035f0 2024-03-16T20:57:36.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.881+0000 7fb49f400640 1 -- 172.21.15.8:0/1347027509 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fb4980035f0 con 0x7fb4a81035f0 2024-03-16T20:57:36.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.882+0000 7fb49f400640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb48c0a1ab0 0x7fb48c0a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:36.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.882+0000 7fb49f400640 1 -- 172.21.15.8:0/1347027509 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb4980efac0 con 0x7fb4a81035f0 2024-03-16T20:57:36.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.882+0000 7fb49d400640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb48c0a1ab0 0x7fb48c0a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:36.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.883+0000 7fb49d400640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb48c0a1ab0 0x7fb48c0a3f70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb4a819acf0 tx=0x7fb490005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:36.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:36.886+0000 7fb49f400640 1 -- 172.21.15.8:0/1347027509 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb4980b8ce0 con 0x7fb4a81035f0 2024-03-16T20:57:37.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.090+0000 7fb4a7200640 1 -- 172.21.15.8:0/1347027509 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4a810f3f0 con 0x7fb4a81035f0 2024-03-16T20:57:37.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.091+0000 7fb49f400640 1 -- 172.21.15.8:0/1347027509 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4980bc3a0 con 0x7fb4a81035f0 2024-03-16T20:57:37.095 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-16T20:57:37.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 -- 172.21.15.8:0/1347027509 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb48c0a1ab0 msgr2=0x7fb48c0a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:37.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb48c0a1ab0 0x7fb48c0a3f70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb4a819acf0 tx=0x7fb490005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:37.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 -- 172.21.15.8:0/1347027509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a81035f0 msgr2=0x7fb4a81997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:37.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a81035f0 0x7fb4a81997e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb498000c00 tx=0x7fb49802c6f0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 -- 172.21.15.8:0/1347027509 shutdown_connections 2024-03-16T20:57:37.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb48c0a1ab0 0x7fb48c0a3f70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4a81051a0 0x7fb4a81a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4a81047e0 0x7fb4a8199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 --2- 172.21.15.8:0/1347027509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4a81035f0 0x7fb4a81997e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 -- 172.21.15.8:0/1347027509 >> 172.21.15.8:0/1347027509 conn(0x7fb4a80feb60 msgr2=0x7fb4a8107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:37.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 -- 172.21.15.8:0/1347027509 shutdown_connections 2024-03-16T20:57:37.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.094+0000 7fb4a7200640 1 -- 172.21.15.8:0/1347027509 wait complete. 2024-03-16T20:57:37.119 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T20:57:37.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:36 smithi008 ceph-mon[31434]: from='client.25273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:57:37.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:36 smithi008 ceph-mon[31434]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:57:37.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:36 smithi008 ceph-mon[31434]: from='client.25279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:57:37.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:36 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/653269994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:37.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:36 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2735185169' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:37.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:36 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.323+0000 7fb33f000640 1 -- 172.21.15.8:0/1725884902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb338103730 msgr2=0x7fb338103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:37.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.323+0000 7fb33f000640 1 --2- 172.21.15.8:0/1725884902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb338103730 0x7fb338103b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb328009900 tx=0x7fb32802bc30 comp rx=0 tx=0).stop 2024-03-16T20:57:37.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.323+0000 7fb33f000640 1 -- 172.21.15.8:0/1725884902 shutdown_connections 2024-03-16T20:57:37.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.323+0000 7fb33f000640 1 --2- 172.21.15.8:0/1725884902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3381052e0 0x7fb33810bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.323+0000 7fb33f000640 1 --2- 172.21.15.8:0/1725884902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb338104920 0x7fb338104da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.323+0000 7fb33f000640 1 --2- 172.21.15.8:0/1725884902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb338103730 0x7fb338103b50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.323+0000 7fb33f000640 1 -- 172.21.15.8:0/1725884902 >> 172.21.15.8:0/1725884902 conn(0x7fb3380feca0 msgr2=0x7fb3381010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:37.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.323+0000 7fb33f000640 1 -- 172.21.15.8:0/1725884902 shutdown_connections 2024-03-16T20:57:37.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.323+0000 7fb33f000640 1 -- 172.21.15.8:0/1725884902 wait complete. 2024-03-16T20:57:37.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.324+0000 7fb33f000640 1 Processor -- start 2024-03-16T20:57:37.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.324+0000 7fb33f000640 1 -- start start 2024-03-16T20:57:37.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.324+0000 7fb33f000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb338103730 0x7fb338199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:37.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.324+0000 7fb33f000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb338104920 0x7fb338199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.324+0000 7fb33f000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3381052e0 0x7fb3381a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.324+0000 7fb33f000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3381a1410 con 0x7fb338103730 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.324+0000 7fb33f000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3381a1580 con 0x7fb338104920 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb33f000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3381a1740 con 0x7fb3381052e0 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb32fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb338104920 0x7fb338199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb32fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb338104920 0x7fb338199e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40898/0 (socket says 172.21.15.8:40898) 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb32fe00640 1 -- 172.21.15.8:0/2438671282 learned_addr learned my addr 172.21.15.8:0/2438671282 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb337e00640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb338103730 0x7fb338199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb33d000640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3381052e0 0x7fb3381a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb32fe00640 1 -- 172.21.15.8:0/2438671282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3381052e0 msgr2=0x7fb3381a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb32fe00640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3381052e0 0x7fb3381a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb32fe00640 1 -- 172.21.15.8:0/2438671282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb338103730 msgr2=0x7fb338199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:37.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb32fe00640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb338103730 0x7fb338199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb32fe00640 1 -- 172.21.15.8:0/2438671282 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb320009490 con 0x7fb338104920 2024-03-16T20:57:37.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.325+0000 7fb33d000640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3381052e0 0x7fb3381a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:37.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.326+0000 7fb32fe00640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb338104920 0x7fb338199e60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb32000ea60 tx=0x7fb32000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:37.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.326+0000 7fb335600640 1 -- 172.21.15.8:0/2438671282 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32000cde0 con 0x7fb338104920 2024-03-16T20:57:37.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.326+0000 7fb335600640 1 -- 172.21.15.8:0/2438671282 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb3200035f0 con 0x7fb338104920 2024-03-16T20:57:37.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.326+0000 7fb33f000640 1 -- 172.21.15.8:0/2438671282 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb328009560 con 0x7fb338104920 2024-03-16T20:57:37.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.326+0000 7fb335600640 1 -- 172.21.15.8:0/2438671282 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320010690 con 0x7fb338104920 2024-03-16T20:57:37.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.326+0000 7fb33f000640 1 -- 172.21.15.8:0/2438671282 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3381a1da0 con 0x7fb338104920 2024-03-16T20:57:37.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.327+0000 7fb33f000640 1 -- 172.21.15.8:0/2438671282 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33810a9f0 con 0x7fb338104920 2024-03-16T20:57:37.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.329+0000 7fb335600640 1 -- 172.21.15.8:0/2438671282 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fb320003b80 con 0x7fb338104920 2024-03-16T20:57:37.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.331+0000 7fb335600640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb31c0a1a30 0x7fb31c0a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:37.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.331+0000 7fb335600640 1 -- 172.21.15.8:0/2438671282 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb320014070 con 0x7fb338104920 2024-03-16T20:57:37.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.331+0000 7fb337e00640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb31c0a1a30 0x7fb31c0a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:37.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.332+0000 7fb337e00640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb31c0a1a30 0x7fb31c0a3ef0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb328009230 tx=0x7fb328005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:37.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.334+0000 7fb335600640 1 -- 172.21.15.8:0/2438671282 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb320096ab0 con 0x7fb338104920 2024-03-16T20:57:37.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:36 smithi170 ceph-mon[35947]: from='client.25273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:57:37.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:36 smithi170 ceph-mon[35947]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:57:37.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:36 smithi170 ceph-mon[35947]: from='client.25279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:57:37.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:36 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/653269994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:37.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:36 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2735185169' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:37.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:36 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:36 smithi186 ceph-mon[36391]: from='client.25273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:57:37.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:36 smithi186 ceph-mon[36391]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:57:37.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:36 smithi186 ceph-mon[36391]: from='client.25279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T20:57:37.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:36 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/653269994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:37.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:36 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2735185169' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T20:57:37.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:36 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.542+0000 7fb33f000640 1 -- 172.21.15.8:0/2438671282 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb33802cf90 con 0x7fb338104920 2024-03-16T20:57:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.542+0000 7fb335600640 1 -- 172.21.15.8:0/2438671282 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb32009a170 con 0x7fb338104920 2024-03-16T20:57:37.547 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-16T20:57:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 -- 172.21.15.8:0/2438671282 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb31c0a1a30 msgr2=0x7fb31c0a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb31c0a1a30 0x7fb31c0a3ef0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb328009230 tx=0x7fb328005fd0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 -- 172.21.15.8:0/2438671282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb338104920 msgr2=0x7fb338199e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb338104920 0x7fb338199e60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb32000ea60 tx=0x7fb32000ef20 comp rx=0 tx=0).stop 2024-03-16T20:57:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 -- 172.21.15.8:0/2438671282 shutdown_connections 2024-03-16T20:57:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fb31c0a1a30 0x7fb31c0a3ef0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3381052e0 0x7fb3381a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb338104920 0x7fb338199e60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 --2- 172.21.15.8:0/2438671282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb338103730 0x7fb338199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 -- 172.21.15.8:0/2438671282 >> 172.21.15.8:0/2438671282 conn(0x7fb3380feca0 msgr2=0x7fb338107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 -- 172.21.15.8:0/2438671282 shutdown_connections 2024-03-16T20:57:37.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.545+0000 7fb33f000640 1 -- 172.21.15.8:0/2438671282 wait complete. 2024-03-16T20:57:37.568 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:57:37.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.763+0000 7fa89d000640 1 -- 172.21.15.8:0/532522434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8981048b0 msgr2=0x7fa898106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:37.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.763+0000 7fa89d000640 1 --2- 172.21.15.8:0/532522434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8981048b0 0x7fa898106ca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa884009900 tx=0x7fa88402bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:37.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.763+0000 7fa89d000640 1 -- 172.21.15.8:0/532522434 shutdown_connections 2024-03-16T20:57:37.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.763+0000 7fa89d000640 1 --2- 172.21.15.8:0/532522434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8981071e0 0x7fa898109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.763+0000 7fa89d000640 1 --2- 172.21.15.8:0/532522434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8981048b0 0x7fa898106ca0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.763+0000 7fa89d000640 1 --2- 172.21.15.8:0/532522434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa898101f80 0x7fa898104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.763+0000 7fa89d000640 1 -- 172.21.15.8:0/532522434 >> 172.21.15.8:0/532522434 conn(0x7fa8980fb970 msgr2=0x7fa8980fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:37.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.763+0000 7fa89d000640 1 -- 172.21.15.8:0/532522434 shutdown_connections 2024-03-16T20:57:37.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.763+0000 7fa89d000640 1 -- 172.21.15.8:0/532522434 wait complete. 2024-03-16T20:57:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.764+0000 7fa89d000640 1 Processor -- start 2024-03-16T20:57:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.764+0000 7fa89d000640 1 -- start start 2024-03-16T20:57:37.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.764+0000 7fa89d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa898101f80 0x7fa898197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.764+0000 7fa89d000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8981048b0 0x7fa898197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.764+0000 7fa89d000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8981071e0 0x7fa89819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.764+0000 7fa89d000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89819f140 con 0x7fa8981048b0 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.764+0000 7fa89d000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89819f2b0 con 0x7fa898101f80 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.764+0000 7fa89d000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89819f470 con 0x7fa8981071e0 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.765+0000 7fa895e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa898101f80 0x7fa898197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.765+0000 7fa895e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa898101f80 0x7fa898197650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40916/0 (socket says 172.21.15.8:40916) 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.765+0000 7fa895e00640 1 -- 172.21.15.8:0/3308470660 learned_addr learned my addr 172.21.15.8:0/3308470660 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.765+0000 7fa896800640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8981071e0 0x7fa89819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.765+0000 7fa895400640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8981048b0 0x7fa898197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.765+0000 7fa895e00640 1 -- 172.21.15.8:0/3308470660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8981071e0 msgr2=0x7fa89819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.765+0000 7fa895e00640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8981071e0 0x7fa89819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.765+0000 7fa895e00640 1 -- 172.21.15.8:0/3308470660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8981048b0 msgr2=0x7fa898197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.765+0000 7fa895e00640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8981048b0 0x7fa898197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.765+0000 7fa895e00640 1 -- 172.21.15.8:0/3308470660 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa884009560 con 0x7fa898101f80 2024-03-16T20:57:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.765+0000 7fa896800640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8981071e0 0x7fa89819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:37.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.766+0000 7fa895e00640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa898101f80 0x7fa898197650 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa88800d950 tx=0x7fa88800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:37.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.766+0000 7fa88ea00640 1 -- 172.21.15.8:0/3308470660 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888009c30 con 0x7fa898101f80 2024-03-16T20:57:37.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.766+0000 7fa88ea00640 1 -- 172.21.15.8:0/3308470660 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa888009d90 con 0x7fa898101f80 2024-03-16T20:57:37.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.766+0000 7fa88ea00640 1 -- 172.21.15.8:0/3308470660 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88800f880 con 0x7fa898101f80 2024-03-16T20:57:37.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.766+0000 7fa89d000640 1 -- 172.21.15.8:0/3308470660 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89819f750 con 0x7fa898101f80 2024-03-16T20:57:37.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.767+0000 7fa89d000640 1 -- 172.21.15.8:0/3308470660 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89819fbe0 con 0x7fa898101f80 2024-03-16T20:57:37.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.768+0000 7fa89d000640 1 -- 172.21.15.8:0/3308470660 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa898068730 con 0x7fa898101f80 2024-03-16T20:57:37.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.770+0000 7fa88ea00640 1 -- 172.21.15.8:0/3308470660 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fa888010b80 con 0x7fa898101f80 2024-03-16T20:57:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.771+0000 7fa88ea00640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa87c0a1c00 0x7fa87c0a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.771+0000 7fa88ea00640 1 -- 172.21.15.8:0/3308470660 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa8880ccf30 con 0x7fa898101f80 2024-03-16T20:57:37.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.771+0000 7fa895400640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa87c0a1c00 0x7fa87c0a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:37.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.772+0000 7fa895400640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa87c0a1c00 0x7fa87c0a40c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa88402c180 tx=0x7fa88402df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:37.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:37.775+0000 7fa88ea00640 1 -- 172.21.15.8:0/3308470660 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa8880961a0 con 0x7fa898101f80 2024-03-16T20:57:38.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.048+0000 7fa89d000640 1 -- 172.21.15.8:0/3308470660 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8980fd460 con 0x7fa898101f80 2024-03-16T20:57:38.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.049+0000 7fa88ea00640 1 -- 172.21.15.8:0/3308470660 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11387 (secure 0 0 0) 0x7fa888020020 con 0x7fa898101f80 2024-03-16T20:57:38.054 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:38.054 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:57:29.077799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T20:57:38.054 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 24 2024-03-16T20:57:38.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 -- 172.21.15.8:0/3308470660 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa87c0a1c00 msgr2=0x7fa87c0a40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa87c0a1c00 0x7fa87c0a40c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa88402c180 tx=0x7fa88402df90 comp rx=0 tx=0).stop 2024-03-16T20:57:38.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 -- 172.21.15.8:0/3308470660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa898101f80 msgr2=0x7fa898197650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa898101f80 0x7fa898197650 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa88800d950 tx=0x7fa88800de10 comp rx=0 tx=0).stop 2024-03-16T20:57:38.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 -- 172.21.15.8:0/3308470660 shutdown_connections 2024-03-16T20:57:38.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa87c0a1c00 0x7fa87c0a40c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8981071e0 0x7fa89819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8981048b0 0x7fa898197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 --2- 172.21.15.8:0/3308470660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa898101f80 0x7fa898197650 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 -- 172.21.15.8:0/3308470660 >> 172.21.15.8:0/3308470660 conn(0x7fa8980fb970 msgr2=0x7fa898102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:38.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 -- 172.21.15.8:0/3308470660 shutdown_connections 2024-03-16T20:57:38.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.053+0000 7fa89d000640 1 -- 172.21.15.8:0/3308470660 wait complete. 2024-03-16T20:57:38.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T20:57:38.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:37 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1347027509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:38.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:37 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2438671282' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.267+0000 7fd1f5800640 1 -- 172.21.15.8:0/4025646766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0102550 msgr2=0x7fd1f01029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.267+0000 7fd1f5800640 1 --2- 172.21.15.8:0/4025646766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0102550 0x7fd1f01029d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009900 tx=0x7fd1dc02bc30 comp rx=0 tx=0).stop 2024-03-16T20:57:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.268+0000 7fd1f5800640 1 -- 172.21.15.8:0/4025646766 shutdown_connections 2024-03-16T20:57:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.268+0000 7fd1f5800640 1 --2- 172.21.15.8:0/4025646766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f0102f10 0x7fd1f01097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.268+0000 7fd1f5800640 1 --2- 172.21.15.8:0/4025646766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0102550 0x7fd1f01029d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.268+0000 7fd1f5800640 1 --2- 172.21.15.8:0/4025646766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f0101360 0x7fd1f0101780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.268+0000 7fd1f5800640 1 -- 172.21.15.8:0/4025646766 >> 172.21.15.8:0/4025646766 conn(0x7fd1f00fc8d0 msgr2=0x7fd1f00fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.268+0000 7fd1f5800640 1 -- 172.21.15.8:0/4025646766 shutdown_connections 2024-03-16T20:57:38.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.268+0000 7fd1f5800640 1 -- 172.21.15.8:0/4025646766 wait complete. 2024-03-16T20:57:38.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.269+0000 7fd1f5800640 1 Processor -- start 2024-03-16T20:57:38.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.269+0000 7fd1f5800640 1 -- start start 2024-03-16T20:57:38.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.270+0000 7fd1f5800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0101360 0x7fd1f0199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.270+0000 7fd1f5800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f0102550 0x7fd1f0199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.270+0000 7fd1f5800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f0102f10 0x7fd1f01a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.270+0000 7fd1f5800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f01a1270 con 0x7fd1f0102550 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.270+0000 7fd1f5800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f01a13e0 con 0x7fd1f0101360 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.270+0000 7fd1f5800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f01a15a0 con 0x7fd1f0102f10 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.270+0000 7fd1efe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0101360 0x7fd1f0199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.270+0000 7fd1efe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0101360 0x7fd1f0199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:57032/0 (socket says 172.21.15.8:57032) 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.270+0000 7fd1efe00640 1 -- 172.21.15.8:0/3040596323 learned_addr learned my addr 172.21.15.8:0/3040596323 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.270+0000 7fd1f4e00640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f0102f10 0x7fd1f01a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.270+0000 7fd1ef400640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f0102550 0x7fd1f0199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.271+0000 7fd1efe00640 1 -- 172.21.15.8:0/3040596323 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f0102f10 msgr2=0x7fd1f01a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.271+0000 7fd1efe00640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f0102f10 0x7fd1f01a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.271+0000 7fd1efe00640 1 -- 172.21.15.8:0/3040596323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f0102550 msgr2=0x7fd1f0199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.271+0000 7fd1efe00640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f0102550 0x7fd1f0199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.271+0000 7fd1efe00640 1 -- 172.21.15.8:0/3040596323 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e0009490 con 0x7fd1f0101360 2024-03-16T20:57:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.271+0000 7fd1efe00640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0101360 0x7fd1f0199780 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000e9c0 tx=0x7fd1e000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.271+0000 7fd1ecc00640 1 -- 172.21.15.8:0/3040596323 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e000cde0 con 0x7fd1f0101360 2024-03-16T20:57:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.271+0000 7fd1ecc00640 1 -- 172.21.15.8:0/3040596323 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd1e0010930 con 0x7fd1f0101360 2024-03-16T20:57:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.271+0000 7fd1f5800640 1 -- 172.21.15.8:0/3040596323 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc009560 con 0x7fd1f0101360 2024-03-16T20:57:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.271+0000 7fd1ecc00640 1 -- 172.21.15.8:0/3040596323 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0018a80 con 0x7fd1f0101360 2024-03-16T20:57:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.271+0000 7fd1f5800640 1 -- 172.21.15.8:0/3040596323 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f01a1c20 con 0x7fd1f0101360 2024-03-16T20:57:38.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.273+0000 7fd1f5800640 1 -- 172.21.15.8:0/3040596323 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f0068200 con 0x7fd1f0101360 2024-03-16T20:57:38.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.276+0000 7fd1ecc00640 1 -- 172.21.15.8:0/3040596323 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fd1e0018be0 con 0x7fd1f0101360 2024-03-16T20:57:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.277+0000 7fd1ecc00640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd1d40a1ab0 0x7fd1d40a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.277+0000 7fd1ecc00640 1 -- 172.21.15.8:0/3040596323 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd1e0014070 con 0x7fd1f0101360 2024-03-16T20:57:38.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.278+0000 7fd1ef400640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd1d40a1ab0 0x7fd1d40a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.279+0000 7fd1ef400640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd1d40a1ab0 0x7fd1d40a3f70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc02c240 tx=0x7fd1dc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:38.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.281+0000 7fd1ecc00640 1 -- 172.21.15.8:0/3040596323 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd1e0096c00 con 0x7fd1f0101360 2024-03-16T20:57:38.294 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:37 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1347027509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:38.294 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:37 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2438671282' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:38.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:37 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1347027509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T20:57:38.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:37 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2438671282' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T20:57:38.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.505+0000 7fd1f5800640 1 -- 172.21.15.8:0/3040596323 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1f01a2020 con 0x7fd1f0101360 2024-03-16T20:57:38.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.506+0000 7fd1ecc00640 1 -- 172.21.15.8:0/3040596323 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22581 (secure 0 0 0) 0x7fd1e009a2c0 con 0x7fd1f0101360 2024-03-16T20:57:38.511 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:57:38.511 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T20:56:04.502777+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T20:57:38.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.509+0000 7fd1f5800640 1 -- 172.21.15.8:0/3040596323 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd1d40a1ab0 msgr2=0x7fd1d40a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.509+0000 7fd1f5800640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd1d40a1ab0 0x7fd1d40a3f70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc02c240 tx=0x7fd1dc005fd0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.510+0000 7fd1f5800640 1 -- 172.21.15.8:0/3040596323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0101360 msgr2=0x7fd1f0199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.510+0000 7fd1f5800640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0101360 0x7fd1f0199780 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000e9c0 tx=0x7fd1e000ee80 comp rx=0 tx=0).stop 2024-03-16T20:57:38.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.510+0000 7fd1f5800640 1 -- 172.21.15.8:0/3040596323 shutdown_connections 2024-03-16T20:57:38.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.510+0000 7fd1f5800640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fd1d40a1ab0 0x7fd1d40a3f70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.510+0000 7fd1f5800640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f0102f10 0x7fd1f01a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.510+0000 7fd1f5800640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1f0102550 0x7fd1f0199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.510+0000 7fd1f5800640 1 --2- 172.21.15.8:0/3040596323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0101360 0x7fd1f0199780 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.510+0000 7fd1f5800640 1 -- 172.21.15.8:0/3040596323 >> 172.21.15.8:0/3040596323 conn(0x7fd1f00fc8d0 msgr2=0x7fd1f0073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:38.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.510+0000 7fd1f5800640 1 -- 172.21.15.8:0/3040596323 shutdown_connections 2024-03-16T20:57:38.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.510+0000 7fd1f5800640 1 -- 172.21.15.8:0/3040596323 wait complete. 2024-03-16T20:57:38.534 DEBUG:tasks.fwd_scrub:Yielding 2024-03-16T20:57:38.535 INFO:teuthology.run_tasks:Running task exec... 2024-03-16T20:57:38.544 INFO:teuthology.task.exec:Executing custom commands... 2024-03-16T20:57:38.544 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2024-03-16T20:57:38.544 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-03-16T20:57:38.544 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-03-16T20:57:38.544 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T20:57:38.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:57:38.545 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T20:57:38.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.731+0000 7ff0e9000640 1 -- 172.21.15.8:0/3455144197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e4101610 msgr2=0x7ff0e4101a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.731+0000 7ff0e9000640 1 --2- 172.21.15.8:0/3455144197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e4101610 0x7ff0e4101a90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009860 tx=0x7ff0cc02bb70 comp rx=0 tx=0).stop 2024-03-16T20:57:38.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.731+0000 7ff0e9000640 1 -- 172.21.15.8:0/3455144197 shutdown_connections 2024-03-16T20:57:38.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.731+0000 7ff0e9000640 1 --2- 172.21.15.8:0/3455144197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0e4101fd0 0x7ff0e4108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.731+0000 7ff0e9000640 1 --2- 172.21.15.8:0/3455144197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e4101610 0x7ff0e4101a90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.731+0000 7ff0e9000640 1 --2- 172.21.15.8:0/3455144197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0e4100420 0x7ff0e4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.731+0000 7ff0e9000640 1 -- 172.21.15.8:0/3455144197 >> 172.21.15.8:0/3455144197 conn(0x7ff0e40fb990 msgr2=0x7ff0e40fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:38.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.731+0000 7ff0e9000640 1 -- 172.21.15.8:0/3455144197 shutdown_connections 2024-03-16T20:57:38.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.731+0000 7ff0e9000640 1 -- 172.21.15.8:0/3455144197 wait complete. 2024-03-16T20:57:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.732+0000 7ff0e9000640 1 Processor -- start 2024-03-16T20:57:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.732+0000 7ff0e9000640 1 -- start start 2024-03-16T20:57:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.732+0000 7ff0e9000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0e4100420 0x7ff0e41975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.732+0000 7ff0e9000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e4101610 0x7ff0e4197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.732+0000 7ff0e9000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0e4101fd0 0x7ff0e419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.732+0000 7ff0e9000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e419f0e0 con 0x7ff0e4101610 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.732+0000 7ff0e9000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e419f250 con 0x7ff0e4101fd0 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.732+0000 7ff0e9000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e419f410 con 0x7ff0e4100420 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.733+0000 7ff0e1e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0e4100420 0x7ff0e41975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.733+0000 7ff0dbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e4101610 0x7ff0e4197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.733+0000 7ff0e1e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0e4100420 0x7ff0e41975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55938/0 (socket says 172.21.15.8:55938) 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.733+0000 7ff0e1e00640 1 -- 172.21.15.8:0/390977468 learned_addr learned my addr 172.21.15.8:0/390977468 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.733+0000 7ff0e2800640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0e4101fd0 0x7ff0e419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.733+0000 7ff0e1e00640 1 -- 172.21.15.8:0/390977468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0e4101fd0 msgr2=0x7ff0e419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.733+0000 7ff0e1e00640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0e4101fd0 0x7ff0e419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.733+0000 7ff0e1e00640 1 -- 172.21.15.8:0/390977468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e4101610 msgr2=0x7ff0e4197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.733+0000 7ff0e1e00640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e4101610 0x7ff0e4197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.733+0000 7ff0e1e00640 1 -- 172.21.15.8:0/390977468 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4009560 con 0x7ff0e4100420 2024-03-16T20:57:38.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.734+0000 7ff0e1e00640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0e4100420 0x7ff0e41975f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400e9a0 tx=0x7ff0d400eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:38.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.734+0000 7ff0daa00640 1 -- 172.21.15.8:0/390977468 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400ccc0 con 0x7ff0e4100420 2024-03-16T20:57:38.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.734+0000 7ff0daa00640 1 -- 172.21.15.8:0/390977468 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff0d400ce20 con 0x7ff0e4100420 2024-03-16T20:57:38.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.734+0000 7ff0daa00640 1 -- 172.21.15.8:0/390977468 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4018a80 con 0x7ff0e4100420 2024-03-16T20:57:38.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.734+0000 7ff0e9000640 1 -- 172.21.15.8:0/390977468 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc009840 con 0x7ff0e4100420 2024-03-16T20:57:38.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.734+0000 7ff0e9000640 1 -- 172.21.15.8:0/390977468 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0cc009490 con 0x7ff0e4100420 2024-03-16T20:57:38.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.735+0000 7ff0e9000640 1 -- 172.21.15.8:0/390977468 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e410bf50 con 0x7ff0e4100420 2024-03-16T20:57:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.739+0000 7ff0daa00640 1 -- 172.21.15.8:0/390977468 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7ff0d4010cc0 con 0x7ff0e4100420 2024-03-16T20:57:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.740+0000 7ff0daa00640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff0c80a1b50 0x7ff0c80a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.740+0000 7ff0daa00640 1 -- 172.21.15.8:0/390977468 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff0d4014070 con 0x7ff0e4100420 2024-03-16T20:57:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.741+0000 7ff0dbe00640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff0c80a1b50 0x7ff0c80a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.742+0000 7ff0dbe00640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff0c80a1b50 0x7ff0c80a4010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009830 tx=0x7ff0cc034c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.747+0000 7fccf9000640 1 -- 172.21.15.8:0/391059195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf4101500 msgr2=0x7fccf4101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.747+0000 7fccf9000640 1 --2- 172.21.15.8:0/391059195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf4101500 0x7fccf4101920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009900 tx=0x7fcce402bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:38.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.747+0000 7fccf9000640 1 -- 172.21.15.8:0/391059195 shutdown_connections 2024-03-16T20:57:38.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.747+0000 7fccf9000640 1 --2- 172.21.15.8:0/391059195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf41030b0 0x7fccf4109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.747+0000 7fccf9000640 1 --2- 172.21.15.8:0/391059195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf41026f0 0x7fccf4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.747+0000 7fccf9000640 1 --2- 172.21.15.8:0/391059195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf4101500 0x7fccf4101920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.747+0000 7fccf9000640 1 -- 172.21.15.8:0/391059195 >> 172.21.15.8:0/391059195 conn(0x7fccf40fca90 msgr2=0x7fccf40feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:38.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.747+0000 7fccf9000640 1 -- 172.21.15.8:0/391059195 shutdown_connections 2024-03-16T20:57:38.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.747+0000 7fccf9000640 1 -- 172.21.15.8:0/391059195 wait complete. 2024-03-16T20:57:38.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.748+0000 7ff0daa00640 1 -- 172.21.15.8:0/390977468 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff0d4096ad0 con 0x7ff0e4100420 2024-03-16T20:57:38.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.749+0000 7fccf9000640 1 Processor -- start 2024-03-16T20:57:38.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.749+0000 7fccf9000640 1 -- start start 2024-03-16T20:57:38.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.749+0000 7fccf9000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf4101500 0x7fccf4199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.749+0000 7fccf9000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf41026f0 0x7fccf4199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf9000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf41030b0 0x7fccf41a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf9000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf41a13f0 con 0x7fccf41026f0 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf9000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf41a1560 con 0x7fccf4101500 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf9000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf41a1720 con 0x7fccf41030b0 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf41026f0 0x7fccf4199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf4101500 0x7fccf4199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf4101500 0x7fccf4199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:57068/0 (socket says 172.21.15.8:57068) 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf1e00640 1 -- 172.21.15.8:0/3272968422 learned_addr learned my addr 172.21.15.8:0/3272968422 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf41026f0 0x7fccf4199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47190/0 (socket says 172.21.15.8:47190) 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf2800640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf41030b0 0x7fccf41a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf1e00640 1 -- 172.21.15.8:0/3272968422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf41030b0 msgr2=0x7fccf41a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf1e00640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf41030b0 0x7fccf41a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf1e00640 1 -- 172.21.15.8:0/3272968422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf41026f0 msgr2=0x7fccf4199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf1e00640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf41026f0 0x7fccf4199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf1e00640 1 -- 172.21.15.8:0/3272968422 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce0009490 con 0x7fccf4101500 2024-03-16T20:57:38.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.750+0000 7fccf2800640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf41030b0 0x7fccf41a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:38.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.751+0000 7fccf1e00640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf4101500 0x7fccf4199900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcce402ce70 tx=0x7fcce4005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:38.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.751+0000 7fcceaa00640 1 -- 172.21.15.8:0/3272968422 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4004e10 con 0x7fccf4101500 2024-03-16T20:57:38.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.751+0000 7fcceaa00640 1 -- 172.21.15.8:0/3272968422 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcce4005470 con 0x7fccf4101500 2024-03-16T20:57:38.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.751+0000 7fccf9000640 1 -- 172.21.15.8:0/3272968422 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec009840 con 0x7fccf4101500 2024-03-16T20:57:38.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.751+0000 7fcceaa00640 1 -- 172.21.15.8:0/3272968422 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4034440 con 0x7fccf4101500 2024-03-16T20:57:38.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.751+0000 7fccf9000640 1 -- 172.21.15.8:0/3272968422 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce4009560 con 0x7fccf4101500 2024-03-16T20:57:38.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.755+0000 7fccfbda8740 1 Processor -- start 2024-03-16T20:57:38.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.755+0000 7fccfbda8740 1 -- start start 2024-03-16T20:57:38.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.755+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a5817380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.755+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5817950 0x5572a581c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.755+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a581cac0 0x5572a581ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.755+0000 7fccfbda8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a57d3300 con 0x5572a5816f60 2024-03-16T20:57:38.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.755+0000 7fccfbda8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a5785e50 con 0x5572a581cac0 2024-03-16T20:57:38.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.755+0000 7fccfbda8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a5783380 con 0x5572a5817950 2024-03-16T20:57:38.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.756+0000 7fccf2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a5817380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.756+0000 7fccf1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a581cac0 0x5572a581ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.756+0000 7fccf2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a5817380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47194/0 (socket says 172.21.15.8:47194) 2024-03-16T20:57:38.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.756+0000 7fccf2800640 1 -- 172.21.15.8:0/1230808058 learned_addr learned my addr 172.21.15.8:0/1230808058 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:38.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.756+0000 7fccf1400640 1 -- 172.21.15.8:0/1230808058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5817950 msgr2=0x5572a581c450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T20:57:38.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.756+0000 7fccf1400640 1 --2- 172.21.15.8:0/1230808058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5817950 0x5572a581c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.756+0000 7fccf1400640 1 -- 172.21.15.8:0/1230808058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 msgr2=0x5572a5817380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:38.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.756+0000 7fccf1400640 1 --2- 172.21.15.8:0/1230808058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a5817380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.756+0000 7fccf1400640 1 -- 172.21.15.8:0/1230808058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572a5747c80 con 0x5572a581cac0 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.756+0000 7fccf1400640 1 --2- 172.21.15.8:0/1230808058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a581cac0 0x5572a581ef50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009d80 tx=0x7fcce0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d48d758dd417c7a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.756+0000 7fccdf400640 1 -- 172.21.15.8:0/1230808058 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0019410 con 0x5572a581cac0 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.757+0000 7fccdf400640 1 -- 172.21.15.8:0/1230808058 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcce0019a70 con 0x5572a581cac0 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.757+0000 7fcceaa00640 1 -- 172.21.15.8:0/3272968422 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7fcce4003680 con 0x7fccf4101500 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.757+0000 7fccdf400640 1 -- 172.21.15.8:0/1230808058 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0018c10 con 0x5572a581cac0 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.758+0000 7fccfbda8740 1 -- 172.21.15.8:0/1230808058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a581cac0 msgr2=0x5572a581ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.758+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1230808058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a581cac0 0x5572a581ef50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009d80 tx=0x7fcce0011810 comp rx=0 tx=0).stop 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.758+0000 7fccfbda8740 1 -- 172.21.15.8:0/1230808058 shutdown_connections 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.758+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1230808058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a581cac0 0x5572a581ef50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.758+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1230808058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5817950 0x5572a581c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.758+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1230808058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a5817380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.758+0000 7fccfbda8740 1 -- 172.21.15.8:0/1230808058 >> 172.21.15.8:0/1230808058 conn(0x5572a58124d0 msgr2=0x5572a58128d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:38.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.758+0000 7fccfbda8740 1 -- 172.21.15.8:0/1230808058 shutdown_connections 2024-03-16T20:57:38.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.758+0000 7fccfbda8740 1 -- 172.21.15.8:0/1230808058 wait complete. 2024-03-16T20:57:38.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.759+0000 7fccfbda8740 1 -- start start 2024-03-16T20:57:38.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.759+0000 7fcceaa00640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fccd80a1940 0x7fccd80a3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.759+0000 7fcceaa00640 1 -- 172.21.15.8:0/3272968422 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fcce40ef3f0 con 0x7fccf4101500 2024-03-16T20:57:38.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.759+0000 7fccfbda8740 1 Processor -- start 2024-03-16T20:57:38.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.759+0000 7fccf2800640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fccd80a1940 0x7fccd80a3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a58211b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5817950 0x5572a58216f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a581cac0 0x5572a5828730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccfbda8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a577eb60 con 0x5572a5816f60 2024-03-16T20:57:38.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccfbda8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a5723fd0 con 0x5572a581cac0 2024-03-16T20:57:38.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccfbda8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a5723c70 con 0x5572a5817950 2024-03-16T20:57:38.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccfbda8740 10 client.0 _ll_register_callbacks cb 0x5572a548fc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:57:38.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccf1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5817950 0x5572a58216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccf1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5817950 0x5572a58216f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55972/0 (socket says 172.21.15.8:55972) 2024-03-16T20:57:38.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccf1400640 1 -- 172.21.15.8:0/4109584911 learned_addr learned my addr 172.21.15.8:0/4109584911 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:38.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccf1e00640 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a58211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.760+0000 7fccf2800640 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a581cac0 0x5572a5828730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.761+0000 7fccf1400640 1 -- 172.21.15.8:0/4109584911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a581cac0 msgr2=0x5572a5828730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:38.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.761+0000 7fccf1400640 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a581cac0 0x5572a5828730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.761+0000 7fccf1400640 1 -- 172.21.15.8:0/4109584911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 msgr2=0x5572a58211b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:38.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.761+0000 7fccf1400640 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a58211b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.761+0000 7fccf1400640 1 -- 172.21.15.8:0/4109584911 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce00099e0 con 0x5572a5817950 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.761+0000 7fccf2800640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fccd80a1940 0x7fccd80a3e00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5572a58181b0 tx=0x7fccec012820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.761+0000 7fccf1400640 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5817950 0x5572a58216f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcce001c040 tx=0x7fcce00196c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16513e3c065509e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.761+0000 7fccd3e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.761+0000 7fccd3e00640 1 -- 172.21.15.8:0/4109584911 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0018990 con 0x5572a5817950 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.761+0000 7fccd3e00640 1 -- 172.21.15.8:0/4109584911 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fcce0018af0 con 0x5572a5817950 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.762+0000 7fccfbda8740 1 -- 172.21.15.8:0/4109584911 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5572a547e860 con 0x5572a5817950 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.762+0000 7fccd3e00640 1 -- 172.21.15.8:0/4109584911 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcce0018cb0 con 0x5572a5817950 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.762+0000 7fccfbda8740 10 client.25330 fetch_fsmap learned FSMap version 24 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.762+0000 7fccfbda8740 1 -- 172.21.15.8:0/4109584911 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5572a577d1e0 con 0x5572a5817950 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.762+0000 7fccd3e00640 1 -- 172.21.15.8:0/4109584911 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5572a547e860 con 0x5572a5817950 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.762+0000 7fccd3e00640 1 -- 172.21.15.8:0/4109584911 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fcce0004ad0 con 0x5572a5817950 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.762+0000 7fccfbda8740 10 client.25330 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:57:38.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.762+0000 7fccfbda8740 10 client.25330 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:57:38.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.762+0000 7fccfbda8740 20 client.25330 populate_metadata read hostname 'smithi008' 2024-03-16T20:57:38.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.763+0000 7fccfbda8740 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5572a582d220 0x5572a582f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.763+0000 7fccfbda8740 4 client.25330 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:57:38.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.763+0000 7fccfbda8740 1 -- 172.21.15.8:0/4109584911 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5572a54cf410 con 0x5572a582d220 2024-03-16T20:57:38.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.763+0000 7fccf1e00640 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5572a582d220 0x5572a582f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.764+0000 7fccd3e00640 10 client.25330 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:38.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.764+0000 7fccf1e00640 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5572a582d220 0x5572a582f640 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13b6f5245254dfed server_cookie=ec51758ffeb8702a in_seq=0 out_seq=0 2024-03-16T20:57:38.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.764+0000 7fccd3e00640 1 -- 172.21.15.8:0/4109584911 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5572a54cf410 con 0x5572a582d220 2024-03-16T20:57:38.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.764+0000 7fccd3e00640 10 client.25330 handle_command_reply: tid=0 2024-03-16T20:57:38.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.764+0000 7fccfbda8740 1 client.25330 shutdown 2024-03-16T20:57:38.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccfbda8740 1 -- 172.21.15.8:0/4109584911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5817950 msgr2=0x5572a58216f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccfbda8740 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5817950 0x5572a58216f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcce001c040 tx=0x7fcce00196c0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccfbda8740 1 -- 172.21.15.8:0/4109584911 shutdown_connections 2024-03-16T20:57:38.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccfbda8740 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a581cac0 0x5572a5828730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccfbda8740 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5817950 0x5572a58216f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccfbda8740 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5572a582d220 0x5572a582f640 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccfbda8740 1 --2- 172.21.15.8:0/4109584911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a58211b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccfbda8740 1 -- 172.21.15.8:0/4109584911 >> 172.21.15.8:0/4109584911 conn(0x5572a58124d0 msgr2=0x5572a58116f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:38.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccd3e00640 0 client.25330 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:38.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccfbda8740 1 -- 172.21.15.8:0/4109584911 shutdown_connections 2024-03-16T20:57:38.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccfbda8740 1 -- 172.21.15.8:0/4109584911 wait complete. 2024-03-16T20:57:38.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.765+0000 7fccfbda8740 20 client.25330 trim_cache size 0 max 16384 2024-03-16T20:57:38.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.783+0000 7fccfbda8740 1 Processor -- start 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.783+0000 7fccfbda8740 1 -- start start 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.783+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a5811570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.783+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a58286f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.783+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a581cac0 0x5572a5833f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.783+0000 7fccfbda8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a54c70c0 con 0x5572a5816f60 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.783+0000 7fccfbda8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a5821820 con 0x5572a5817950 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.783+0000 7fccfbda8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a54cf410 con 0x5572a581cac0 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.784+0000 7fccf1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a58286f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.784+0000 7fccf2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a581cac0 0x5572a5833f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.784+0000 7fccf1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a58286f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:57086/0 (socket says 172.21.15.8:57086) 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.784+0000 7fccf1400640 1 -- 172.21.15.8:0/1067698782 learned_addr learned my addr 172.21.15.8:0/1067698782 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:38.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.784+0000 7fccf1e00640 1 --2- 172.21.15.8:0/1067698782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a5811570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.784+0000 7fccf1400640 1 -- 172.21.15.8:0/1067698782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a581cac0 msgr2=0x5572a5833f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:38.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.784+0000 7fccf1400640 1 --2- 172.21.15.8:0/1067698782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a581cac0 0x5572a5833f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.784+0000 7fccf1400640 1 -- 172.21.15.8:0/1067698782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 msgr2=0x5572a5811570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:38.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.784+0000 7fccf1400640 1 --2- 172.21.15.8:0/1067698782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a5811570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.784+0000 7fccf1400640 1 -- 172.21.15.8:0/1067698782 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572a5719a90 con 0x5572a5817950 2024-03-16T20:57:38.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.784+0000 7fccf1400640 1 --2- 172.21.15.8:0/1067698782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a58286f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcce0004ee0 tx=0x7fcce0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a84237b885aa3e9d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:38.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.785+0000 7fccdea00640 1 -- 172.21.15.8:0/1067698782 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0009e70 con 0x5572a5817950 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.785+0000 7fccdea00640 1 -- 172.21.15.8:0/1067698782 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcce0005500 con 0x5572a5817950 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.785+0000 7fccdea00640 1 -- 172.21.15.8:0/1067698782 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0018720 con 0x5572a5817950 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.785+0000 7fccfbda8740 1 -- 172.21.15.8:0/1067698782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 msgr2=0x5572a58286f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.785+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1067698782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a58286f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcce0004ee0 tx=0x7fcce0000bc0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.785+0000 7fccfbda8740 1 -- 172.21.15.8:0/1067698782 shutdown_connections 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.785+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1067698782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a581cac0 0x5572a5833f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.785+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1067698782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a58286f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.785+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1067698782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a5816f60 0x5572a5811570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.785+0000 7fccfbda8740 1 -- 172.21.15.8:0/1067698782 >> 172.21.15.8:0/1067698782 conn(0x5572a58124d0 msgr2=0x5572a5810e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.786+0000 7fccfbda8740 1 -- 172.21.15.8:0/1067698782 shutdown_connections 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.786+0000 7fccfbda8740 1 -- 172.21.15.8:0/1067698782 wait complete. 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.786+0000 7fccfbda8740 1 -- start start 2024-03-16T20:57:38.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.786+0000 7fccfbda8740 1 Processor -- start 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5816f60 0x5572a5826df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a5827330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccfbda8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a581cac0 0x5572a5827870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccfbda8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a58289f0 con 0x5572a581cac0 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccfbda8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a5828b60 con 0x5572a5817950 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccfbda8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572a5888b50 con 0x5572a5816f60 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccfbda8740 10 client.0 _ll_register_callbacks cb 0x7fcce001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a581cac0 0x5572a5827870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf1e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5816f60 0x5572a5826df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a5827330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf1e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5816f60 0x5572a5826df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:55994/0 (socket says 172.21.15.8:55994) 2024-03-16T20:57:38.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf1e00640 1 -- 172.21.15.8:0/1328387928 learned_addr learned my addr 172.21.15.8:0/1328387928 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a581cac0 0x5572a5827870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47224/0 (socket says 172.21.15.8:47224) 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a5827330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:57102/0 (socket says 172.21.15.8:57102) 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf1e00640 1 -- 172.21.15.8:0/1328387928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 msgr2=0x5572a5827330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf1e00640 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a5827330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf1e00640 1 -- 172.21.15.8:0/1328387928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a581cac0 msgr2=0x5572a5827870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf1e00640 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a581cac0 0x5572a5827870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf1e00640 1 -- 172.21.15.8:0/1328387928 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572a577d1e0 con 0x5572a5816f60 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf1400640 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a5827330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.787+0000 7fccf2800640 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a581cac0 0x5572a5827870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.788+0000 7fccf1e00640 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5816f60 0x5572a5826df0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcce40b8d40 tx=0x7fcce4003a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d6754ff805e023a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.788+0000 7fccd3e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.788+0000 7fccd3e00640 1 -- 172.21.15.8:0/1328387928 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce40bca70 con 0x5572a5816f60 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.788+0000 7fccd3e00640 1 -- 172.21.15.8:0/1328387928 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fcce40bc370 con 0x5572a5816f60 2024-03-16T20:57:38.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.788+0000 7fccfbda8740 1 -- 172.21.15.8:0/1328387928 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcce0019a70 con 0x5572a5816f60 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.788+0000 7fccd3e00640 1 -- 172.21.15.8:0/1328387928 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcce40d9070 con 0x5572a5816f60 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.788+0000 7fccfbda8740 10 client.25336 fetch_fsmap learned FSMap version 24 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.788+0000 7fccfbda8740 1 -- 172.21.15.8:0/1328387928 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5572a573f6a0 con 0x5572a5816f60 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.788+0000 7fccd3e00640 1 -- 172.21.15.8:0/1328387928 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcce0019a70 con 0x5572a5816f60 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.789+0000 7fccd3e00640 1 -- 172.21.15.8:0/1328387928 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fcce40b89e0 con 0x5572a5816f60 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.789+0000 7fccfbda8740 10 client.25336 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.789+0000 7fccfbda8740 10 client.25336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.789+0000 7fccfbda8740 20 client.25336 populate_metadata read hostname 'smithi008' 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.789+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5572a588a380 0x5572a588c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.789+0000 7fccfbda8740 4 client.25336 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.789+0000 7fccfbda8740 1 -- 172.21.15.8:0/1328387928 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5572a54bb7b0 con 0x5572a588a380 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.789+0000 7fccf1400640 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5572a588a380 0x5572a588c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:38.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.790+0000 7fccf1400640 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5572a588a380 0x5572a588c7a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8748f22d6f2c174 server_cookie=dc7bd17817fea8fc in_seq=0 out_seq=0 2024-03-16T20:57:38.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.790+0000 7fccd3e00640 10 client.25336 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccd3e00640 1 -- 172.21.15.8:0/1328387928 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5572a54bb7b0 con 0x5572a588a380 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccd3e00640 10 client.25336 handle_command_reply: tid=0 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccfbda8740 1 client.25336 shutdown 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccfbda8740 1 -- 172.21.15.8:0/1328387928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5816f60 msgr2=0x5572a5826df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5816f60 0x5572a5826df0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcce40b8d40 tx=0x7fcce4003a20 comp rx=0 tx=0).stop 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccfbda8740 1 -- 172.21.15.8:0/1328387928 shutdown_connections 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5572a588a380 0x5572a588c7a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5572a581cac0 0x5572a5827870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5572a5817950 0x5572a5827330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccd3e00640 0 client.25336 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccfbda8740 1 --2- 172.21.15.8:0/1328387928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5572a5816f60 0x5572a5826df0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.791+0000 7fccfbda8740 1 -- 172.21.15.8:0/1328387928 >> 172.21.15.8:0/1328387928 conn(0x5572a58124d0 msgr2=0x5572a5815fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:38.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.792+0000 7fccfbda8740 1 -- 172.21.15.8:0/1328387928 shutdown_connections 2024-03-16T20:57:38.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.792+0000 7fccfbda8740 1 -- 172.21.15.8:0/1328387928 wait complete. 2024-03-16T20:57:38.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.792+0000 7fccfbda8740 20 client.25336 trim_cache size 0 max 16384 2024-03-16T20:57:38.799 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:57:38.799 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T20:57:38.799 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "731b38dc-d580-4e10-a15f-69dd7d55cc4f", 2024-03-16T20:57:38.799 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T20:57:38.799 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:57:38.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 -- 172.21.15.8:0/3272968422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fccd80a1940 msgr2=0x7fccd80a3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fccd80a1940 0x7fccd80a3e00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5572a58181b0 tx=0x7fccec012820 comp rx=0 tx=0).stop 2024-03-16T20:57:38.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 -- 172.21.15.8:0/3272968422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf4101500 msgr2=0x7fccf4199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:38.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf4101500 0x7fccf4199900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcce402ce70 tx=0x7fcce4005dc0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 -- 172.21.15.8:0/3272968422 shutdown_connections 2024-03-16T20:57:38.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fccd80a1940 0x7fccd80a3e00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccf41030b0 0x7fccf41a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccf41026f0 0x7fccf4199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 --2- 172.21.15.8:0/3272968422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf4101500 0x7fccf4199900 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:38.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 -- 172.21.15.8:0/3272968422 >> 172.21.15.8:0/3272968422 conn(0x7fccf40fca90 msgr2=0x7fccf4073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:38.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 -- 172.21.15.8:0/3272968422 shutdown_connections 2024-03-16T20:57:38.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:38.793+0000 7fccf9000640 1 -- 172.21.15.8:0/3272968422 wait complete. 2024-03-16T20:57:38.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T20:57:38.815 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T20:57:39.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.007+0000 7f6706800640 1 -- 172.21.15.8:0/3888393170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67001013f0 msgr2=0x7f6700101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:39.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.007+0000 7f6706800640 1 --2- 172.21.15.8:0/3888393170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67001013f0 0x7f6700101810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009900 tx=0x7f66f402bc30 comp rx=0 tx=0).stop 2024-03-16T20:57:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.007+0000 7f6706800640 1 -- 172.21.15.8:0/3888393170 shutdown_connections 2024-03-16T20:57:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.007+0000 7f6706800640 1 --2- 172.21.15.8:0/3888393170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6700102fa0 0x7f6700109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.007+0000 7f6706800640 1 --2- 172.21.15.8:0/3888393170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67001025e0 0x7f6700102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.007+0000 7f6706800640 1 --2- 172.21.15.8:0/3888393170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67001013f0 0x7f6700101810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.007+0000 7f6706800640 1 -- 172.21.15.8:0/3888393170 >> 172.21.15.8:0/3888393170 conn(0x7f67000fc960 msgr2=0x7f67000feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.007+0000 7f6706800640 1 -- 172.21.15.8:0/3888393170 shutdown_connections 2024-03-16T20:57:39.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.007+0000 7f6706800640 1 -- 172.21.15.8:0/3888393170 wait complete. 2024-03-16T20:57:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.009+0000 7f6706800640 1 Processor -- start 2024-03-16T20:57:39.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.009+0000 7f6706800640 1 -- start start 2024-03-16T20:57:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.009+0000 7f6706800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67001013f0 0x7f6700197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.009+0000 7f6706800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67001025e0 0x7f6700197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.009+0000 7f6706800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6700102fa0 0x7f670019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.009+0000 7f6706800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670019f040 con 0x7f67001025e0 2024-03-16T20:57:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.009+0000 7f6706800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670019f1b0 con 0x7f67001013f0 2024-03-16T20:57:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.009+0000 7f6706800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670019f370 con 0x7f6700102fa0 2024-03-16T20:57:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6705400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67001013f0 0x7f6700197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6705400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67001013f0 0x7f6700197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:57114/0 (socket says 172.21.15.8:57114) 2024-03-16T20:57:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6705400640 1 -- 172.21.15.8:0/3709043706 learned_addr learned my addr 172.21.15.8:0/3709043706 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6705e00640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6700102fa0 0x7f670019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6704a00640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67001025e0 0x7f6700197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6705400640 1 -- 172.21.15.8:0/3709043706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6700102fa0 msgr2=0x7f670019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:39.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6705400640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6700102fa0 0x7f670019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6705400640 1 -- 172.21.15.8:0/3709043706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67001025e0 msgr2=0x7f6700197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:39.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6705400640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67001025e0 0x7f6700197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6705400640 1 -- 172.21.15.8:0/3709043706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f4009560 con 0x7f67001013f0 2024-03-16T20:57:39.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6704a00640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67001025e0 0x7f6700197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:39.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.010+0000 7f6705400640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67001013f0 0x7f6700197550 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f66f4000c00 tx=0x7f66f4005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:39.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.011+0000 7f66fe000640 1 -- 172.21.15.8:0/3709043706 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4004350 con 0x7f67001013f0 2024-03-16T20:57:39.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.011+0000 7f6706800640 1 -- 172.21.15.8:0/3709043706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670019f5f0 con 0x7f67001013f0 2024-03-16T20:57:39.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.011+0000 7f66fe000640 1 -- 172.21.15.8:0/3709043706 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f66f40044b0 con 0x7f67001013f0 2024-03-16T20:57:39.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.011+0000 7f66fe000640 1 -- 172.21.15.8:0/3709043706 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4003de0 con 0x7f67001013f0 2024-03-16T20:57:39.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.011+0000 7f6706800640 1 -- 172.21.15.8:0/3709043706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670019fb00 con 0x7f67001013f0 2024-03-16T20:57:39.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.014+0000 7f66fe000640 1 -- 172.21.15.8:0/3709043706 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 136278+0+0 (secure 0 0 0) 0x7f66f4004e10 con 0x7f67001013f0 2024-03-16T20:57:39.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.014+0000 7f670abbc740 1 Processor -- start 2024-03-16T20:57:39.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.015+0000 7f670abbc740 1 -- start start 2024-03-16T20:57:39.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.015+0000 7f670abbc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 0x563ee3c83810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.015+0000 7f670abbc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c83de0 0x563ee3c888e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.015+0000 7f670abbc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c88f50 0x563ee3c8b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.015+0000 7f670abbc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee3bf3150 con 0x563ee3c83de0 2024-03-16T20:57:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.015+0000 7f670abbc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee3bf0680 con 0x563ee3c88f50 2024-03-16T20:57:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.015+0000 7f670abbc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee3bebe60 con 0x563ee3c833f0 2024-03-16T20:57:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.015+0000 7f6705e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 0x563ee3c83810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.015+0000 7f6705e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 0x563ee3c83810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56028/0 (socket says 172.21.15.8:56028) 2024-03-16T20:57:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.015+0000 7f6705e00640 1 -- 172.21.15.8:0/1687307709 learned_addr learned my addr 172.21.15.8:0/1687307709 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.015+0000 7f6705400640 1 --2- 172.21.15.8:0/1687307709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c83de0 0x563ee3c888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.016+0000 7f6705e00640 1 -- 172.21.15.8:0/1687307709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c88f50 msgr2=0x563ee3c8b3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-16T20:57:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.016+0000 7f6705e00640 1 --2- 172.21.15.8:0/1687307709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c88f50 0x563ee3c8b3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.016+0000 7f6705e00640 1 -- 172.21.15.8:0/1687307709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c83de0 msgr2=0x563ee3c888e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.016+0000 7f6705e00640 1 --2- 172.21.15.8:0/1687307709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c83de0 0x563ee3c888e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.016+0000 7f6705e00640 1 -- 172.21.15.8:0/1687307709 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ee3ba5060 con 0x563ee3c833f0 2024-03-16T20:57:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.016+0000 7f6705400640 1 --2- 172.21.15.8:0/1687307709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c83de0 0x563ee3c888e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:39.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.016+0000 7f6705e00640 1 --2- 172.21.15.8:0/1687307709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 0x563ee3c83810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009fd0 tx=0x7f66f80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b255552e37442f0f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.016+0000 7f66fe000640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f66e80a1a30 0x7f66e80a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.016+0000 7f66f2600640 1 -- 172.21.15.8:0/1687307709 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8004d20 con 0x563ee3c833f0 2024-03-16T20:57:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.017+0000 7f66f2600640 1 -- 172.21.15.8:0/1687307709 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f66f8004e80 con 0x563ee3c833f0 2024-03-16T20:57:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.017+0000 7f66f2600640 1 -- 172.21.15.8:0/1687307709 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8005260 con 0x563ee3c833f0 2024-03-16T20:57:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.017+0000 7f66fe000640 1 -- 172.21.15.8:0/3709043706 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f66f40efb20 con 0x7f67001013f0 2024-03-16T20:57:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f670abbc740 1 -- 172.21.15.8:0/1687307709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 msgr2=0x563ee3c83810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f6705400640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f66e80a1a30 0x7f66e80a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f670abbc740 1 --2- 172.21.15.8:0/1687307709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 0x563ee3c83810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009fd0 tx=0x7f66f80118d0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f670abbc740 1 -- 172.21.15.8:0/1687307709 shutdown_connections 2024-03-16T20:57:39.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f670abbc740 1 --2- 172.21.15.8:0/1687307709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c88f50 0x563ee3c8b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f670abbc740 1 --2- 172.21.15.8:0/1687307709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c83de0 0x563ee3c888e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f670abbc740 1 --2- 172.21.15.8:0/1687307709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 0x563ee3c83810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f670abbc740 1 -- 172.21.15.8:0/1687307709 >> 172.21.15.8:0/1687307709 conn(0x563ee3c4b5a0 msgr2=0x563ee3c7ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:39.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f670abbc740 1 -- 172.21.15.8:0/1687307709 shutdown_connections 2024-03-16T20:57:39.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f670abbc740 1 -- 172.21.15.8:0/1687307709 wait complete. 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f6705400640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f66e80a1a30 0x7f66e80a3ef0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f66f40bc740 tx=0x7f66f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.018+0000 7f670abbc740 1 -- start start 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.019+0000 7f670abbc740 1 Processor -- start 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.019+0000 7f670abbc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c833f0 0x563ee3c91aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.019+0000 7f670abbc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c91fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.019+0000 7f670abbc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c88f50 0x563ee3c99020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f670abbc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee3b90ec0 con 0x563ee3c833f0 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f670abbc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee3b90b60 con 0x563ee3c88f50 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f670abbc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee395a1c0 con 0x563ee3c83de0 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f670abbc740 10 client.0 _ll_register_callbacks cb 0x563ee3ba4960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f6704a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c91fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f6704a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c91fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56030/0 (socket says 172.21.15.8:56030) 2024-03-16T20:57:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f6704a00640 1 -- 172.21.15.8:0/997538358 learned_addr learned my addr 172.21.15.8:0/997538358 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f6705e00640 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c833f0 0x563ee3c91aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f6705e00640 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c88f50 0x563ee3c99020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f6704a00640 1 -- 172.21.15.8:0/997538358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c88f50 msgr2=0x563ee3c99020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f6704a00640 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c88f50 0x563ee3c99020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f6704a00640 1 -- 172.21.15.8:0/997538358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c833f0 msgr2=0x563ee3c91aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f6704a00640 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c833f0 0x563ee3c91aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f6704a00640 1 -- 172.21.15.8:0/997538358 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f8009c80 con 0x563ee3c83de0 2024-03-16T20:57:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.020+0000 7f6705e00640 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c88f50 0x563ee3c99020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:57:39.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.021+0000 7ff0e9000640 1 -- 172.21.15.8:0/390977468 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff0e4102f30 con 0x7ff0e4100420 2024-03-16T20:57:39.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.021+0000 7f6704a00640 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c91fe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f66ec011480 tx=0x7f66ec011940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df8c0d56c952d5f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:39.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.021+0000 7f66e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:57:39.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.021+0000 7f66e6a00640 1 -- 172.21.15.8:0/997538358 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec012980 con 0x563ee3c83de0 2024-03-16T20:57:39.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.021+0000 7f66e6a00640 1 -- 172.21.15.8:0/997538358 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f66ec012ae0 con 0x563ee3c83de0 2024-03-16T20:57:39.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.021+0000 7f670abbc740 1 -- 172.21.15.8:0/997538358 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ee3928720 con 0x563ee3c83de0 2024-03-16T20:57:39.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.022+0000 7f66e6a00640 1 -- 172.21.15.8:0/997538358 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66ec012ca0 con 0x563ee3c83de0 2024-03-16T20:57:39.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.022+0000 7f670abbc740 10 client.25348 fetch_fsmap learned FSMap version 24 2024-03-16T20:57:39.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.022+0000 7f670abbc740 1 -- 172.21.15.8:0/997538358 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563ee3bea4e0 con 0x563ee3c83de0 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.022+0000 7f66e6a00640 1 -- 172.21.15.8:0/997538358 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x563ee3928720 con 0x563ee3c83de0 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.022+0000 7f66e6a00640 1 -- 172.21.15.8:0/997538358 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f66ec00f3e0 con 0x563ee3c83de0 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.022+0000 7f670abbc740 10 client.25348 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.022+0000 7f670abbc740 10 client.25348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.022+0000 7f670abbc740 20 client.25348 populate_metadata read hostname 'smithi008' 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.022+0000 7f670abbc740 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563ee3c9d9c0 0x563ee3c9fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.022+0000 7f670abbc740 4 client.25348 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.022+0000 7f670abbc740 1 -- 172.21.15.8:0/997538358 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ee3977890 con 0x563ee3c9d9c0 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.023+0000 7f6705e00640 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563ee3c9d9c0 0x563ee3c9fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.023+0000 7f6705e00640 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563ee3c9d9c0 0x563ee3c9fde0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e972c7e037792858 server_cookie=cd04a53c23e8da21 in_seq=0 out_seq=0 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.023+0000 7f66e6a00640 10 client.25348 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.024+0000 7f66e6a00640 1 -- 172.21.15.8:0/997538358 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563ee3977890 con 0x563ee3c9d9c0 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.024+0000 7f66e6a00640 10 client.25348 handle_command_reply: tid=0 2024-03-16T20:57:39.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.024+0000 7f670abbc740 1 client.25348 shutdown 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f670abbc740 1 -- 172.21.15.8:0/997538358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 msgr2=0x563ee3c91fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f670abbc740 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c91fe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f66ec011480 tx=0x7f66ec011940 comp rx=0 tx=0).stop 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f670abbc740 1 -- 172.21.15.8:0/997538358 shutdown_connections 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f670abbc740 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c88f50 0x563ee3c99020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f670abbc740 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c91fe0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f670abbc740 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563ee3c9d9c0 0x563ee3c9fde0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f670abbc740 1 --2- 172.21.15.8:0/997538358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c833f0 0x563ee3c91aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f66e6a00640 0 client.25348 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f670abbc740 1 -- 172.21.15.8:0/997538358 >> 172.21.15.8:0/997538358 conn(0x563ee3c4b5a0 msgr2=0x563ee3c7df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f670abbc740 1 -- 172.21.15.8:0/997538358 shutdown_connections 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f670abbc740 1 -- 172.21.15.8:0/997538358 wait complete. 2024-03-16T20:57:39.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.025+0000 7f670abbc740 20 client.25348 trim_cache size 0 max 16384 2024-03-16T20:57:39.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.043+0000 7f670abbc740 1 Processor -- start 2024-03-16T20:57:39.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.043+0000 7f670abbc740 1 -- start start 2024-03-16T20:57:39.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f670abbc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 0x563ee3c90560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f670abbc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c83de0 0x563ee3c98fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f670abbc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c88f50 0x563ee3c81fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f670abbc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee3c7f360 con 0x563ee3c88f50 2024-03-16T20:57:39.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f670abbc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee3c844d0 con 0x563ee3c83de0 2024-03-16T20:57:39.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f670abbc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee3c84210 con 0x563ee3c833f0 2024-03-16T20:57:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f6704a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c83de0 0x563ee3c98fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f6705e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 0x563ee3c90560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f6704a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c83de0 0x563ee3c98fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:57148/0 (socket says 172.21.15.8:57148) 2024-03-16T20:57:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f6704a00640 1 -- 172.21.15.8:0/138329241 learned_addr learned my addr 172.21.15.8:0/138329241 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f6705e00640 1 --2- 172.21.15.8:0/138329241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c88f50 0x563ee3c81fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f6704a00640 1 -- 172.21.15.8:0/138329241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 msgr2=0x563ee3c90560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f6704a00640 1 --2- 172.21.15.8:0/138329241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 0x563ee3c90560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f6704a00640 1 -- 172.21.15.8:0/138329241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c88f50 msgr2=0x563ee3c81fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.044+0000 7f6704a00640 1 --2- 172.21.15.8:0/138329241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c88f50 0x563ee3c81fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.045+0000 7f6704a00640 1 -- 172.21.15.8:0/138329241 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ee3b86950 con 0x563ee3c83de0 2024-03-16T20:57:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.045+0000 7f6704a00640 1 --2- 172.21.15.8:0/138329241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c83de0 0x563ee3c98fe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f66ec011450 tx=0x7f66ec00fd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c7b98451aa603df server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.045+0000 7f66f1c00640 1 -- 172.21.15.8:0/138329241 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00fa00 con 0x563ee3c83de0 2024-03-16T20:57:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.045+0000 7f66f1c00640 1 -- 172.21.15.8:0/138329241 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f66ec00fb60 con 0x563ee3c83de0 2024-03-16T20:57:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.045+0000 7f66f1c00640 1 -- 172.21.15.8:0/138329241 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec012dc0 con 0x563ee3c83de0 2024-03-16T20:57:39.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.046+0000 7f670abbc740 1 -- 172.21.15.8:0/138329241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c83de0 msgr2=0x563ee3c98fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:39.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.046+0000 7f670abbc740 1 --2- 172.21.15.8:0/138329241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c83de0 0x563ee3c98fe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f66ec011450 tx=0x7f66ec00fd60 comp rx=0 tx=0).stop 2024-03-16T20:57:39.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.046+0000 7f670abbc740 1 -- 172.21.15.8:0/138329241 shutdown_connections 2024-03-16T20:57:39.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.046+0000 7f670abbc740 1 --2- 172.21.15.8:0/138329241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c88f50 0x563ee3c81fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.046+0000 7f670abbc740 1 --2- 172.21.15.8:0/138329241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c83de0 0x563ee3c98fe0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.046+0000 7f670abbc740 1 --2- 172.21.15.8:0/138329241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c833f0 0x563ee3c90560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.046+0000 7f670abbc740 1 -- 172.21.15.8:0/138329241 >> 172.21.15.8:0/138329241 conn(0x563ee3c4b5a0 msgr2=0x563ee3c85380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.046+0000 7f670abbc740 1 -- 172.21.15.8:0/138329241 shutdown_connections 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.046+0000 7f670abbc740 1 -- 172.21.15.8:0/138329241 wait complete. 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.047+0000 7f670abbc740 1 -- start start 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.047+0000 7f670abbc740 1 Processor -- start 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.047+0000 7f670abbc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c833f0 0x563ee3c989d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.047+0000 7f670abbc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c98f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.047+0000 7f670abbc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c88f50 0x563ee3c97030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.047+0000 7f670abbc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee3c97700 con 0x563ee3c88f50 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.047+0000 7f670abbc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee3c97870 con 0x563ee3c833f0 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.047+0000 7f670abbc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ee3c97a30 con 0x563ee3c83de0 2024-03-16T20:57:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.047+0000 7f670abbc740 10 client.0 _ll_register_callbacks cb 0x7f66ec009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6705e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c833f0 0x563ee3c989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6704a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c98f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6704a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c98f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56048/0 (socket says 172.21.15.8:56048) 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6705e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c833f0 0x563ee3c989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:57150/0 (socket says 172.21.15.8:57150) 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6704a00640 1 -- 172.21.15.8:0/1963554902 learned_addr learned my addr 172.21.15.8:0/1963554902 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6705e00640 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c88f50 0x563ee3c97030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6704a00640 1 -- 172.21.15.8:0/1963554902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c833f0 msgr2=0x563ee3c989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6704a00640 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c833f0 0x563ee3c989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6704a00640 1 -- 172.21.15.8:0/1963554902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c88f50 msgr2=0x563ee3c97030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6704a00640 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c88f50 0x563ee3c97030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6704a00640 1 -- 172.21.15.8:0/1963554902 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ee3bea4e0 con 0x563ee3c83de0 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6705e00640 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c833f0 0x563ee3c989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f6704a00640 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c98f10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00f930 tx=0x7f66ec012d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39bfdd25dfa1a0e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:39.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.048+0000 7f66e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.049+0000 7f66e6a00640 1 -- 172.21.15.8:0/1963554902 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00fa00 con 0x563ee3c83de0 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.049+0000 7f66e6a00640 1 -- 172.21.15.8:0/1963554902 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f66ec000e40 con 0x563ee3c83de0 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.049+0000 7f670abbc740 1 -- 172.21.15.8:0/1963554902 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ee38eb7e0 con 0x563ee3c83de0 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.049+0000 7f66e6a00640 1 -- 172.21.15.8:0/1963554902 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66ec005440 con 0x563ee3c83de0 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.049+0000 7f670abbc740 10 client.25354 fetch_fsmap learned FSMap version 24 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.049+0000 7f670abbc740 1 -- 172.21.15.8:0/1963554902 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563ee3bac430 con 0x563ee3c83de0 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.049+0000 7f66e6a00640 1 -- 172.21.15.8:0/1963554902 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f66ec03d020 con 0x563ee3c83de0 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.049+0000 7f66e6a00640 1 -- 172.21.15.8:0/1963554902 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f66ec02b020 con 0x563ee3c83de0 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.050+0000 7f670abbc740 10 client.25354 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.050+0000 7f670abbc740 10 client.25354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.050+0000 7f670abbc740 20 client.25354 populate_metadata read hostname 'smithi008' 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.050+0000 7f670abbc740 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563ee3cfa640 0x563ee3cfca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.050+0000 7f670abbc740 4 client.25354 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T20:57:39.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.050+0000 7f670abbc740 1 -- 172.21.15.8:0/1963554902 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563ee3897700 con 0x563ee3cfa640 2024-03-16T20:57:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.050+0000 7f6705e00640 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563ee3cfa640 0x563ee3cfca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.050+0000 7f6705e00640 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563ee3cfa640 0x563ee3cfca60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ffbd005da3df8aa server_cookie=84586d84819cc919 in_seq=0 out_seq=0 2024-03-16T20:57:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.050+0000 7f66e6a00640 10 client.25354 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f66e6a00640 1 -- 172.21.15.8:0/1963554902 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x563ee3897700 con 0x563ee3cfa640 2024-03-16T20:57:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f66e6a00640 10 client.25354 handle_command_reply: tid=0 2024-03-16T20:57:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 1 client.25354 shutdown 2024-03-16T20:57:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 1 -- 172.21.15.8:0/1963554902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 msgr2=0x563ee3c98f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c98f10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00f930 tx=0x7f66ec012d70 comp rx=0 tx=0).stop 2024-03-16T20:57:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 1 -- 172.21.15.8:0/1963554902 shutdown_connections 2024-03-16T20:57:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563ee3cfa640 0x563ee3cfca60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ee3c88f50 0x563ee3c97030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f66e6a00640 0 client.25354 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:57:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563ee3c83de0 0x563ee3c98f10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 1 --2- 172.21.15.8:0/1963554902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ee3c833f0 0x563ee3c989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 1 -- 172.21.15.8:0/1963554902 >> 172.21.15.8:0/1963554902 conn(0x563ee3c4b5a0 msgr2=0x563ee3c7d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 1 -- 172.21.15.8:0/1963554902 shutdown_connections 2024-03-16T20:57:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 1 -- 172.21.15.8:0/1963554902 wait complete. 2024-03-16T20:57:39.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.051+0000 7f670abbc740 20 client.25354 trim_cache size 0 max 16384 2024-03-16T20:57:39.059 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:57:39.059 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T20:57:39.059 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T20:57:39.059 INFO:teuthology.orchestra.run.smithi008.stdout: "731b38dc-d580-4e10-a15f-69dd7d55cc4f": { 2024-03-16T20:57:39.060 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T20:57:39.060 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "731b38dc-d580-4e10-a15f-69dd7d55cc4f", 2024-03-16T20:57:39.060 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T20:57:39.060 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T20:57:39.060 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T20:57:39.060 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:57:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 -- 172.21.15.8:0/3709043706 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f66e80a1a30 msgr2=0x7f66e80a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:39.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f66e80a1a30 0x7f66e80a3ef0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f66f40bc740 tx=0x7f66f4009260 comp rx=0 tx=0).stop 2024-03-16T20:57:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 -- 172.21.15.8:0/3709043706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67001013f0 msgr2=0x7f6700197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67001013f0 0x7f6700197550 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f66f4000c00 tx=0x7f66f4005dc0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 -- 172.21.15.8:0/3709043706 shutdown_connections 2024-03-16T20:57:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f66e80a1a30 0x7f66e80a3ef0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6700102fa0 0x7f670019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67001025e0 0x7f6700197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 --2- 172.21.15.8:0/3709043706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67001013f0 0x7f6700197550 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 -- 172.21.15.8:0/3709043706 >> 172.21.15.8:0/3709043706 conn(0x7f67000fc960 msgr2=0x7f6700105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 -- 172.21.15.8:0/3709043706 shutdown_connections 2024-03-16T20:57:39.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.052+0000 7f6706800640 1 -- 172.21.15.8:0/3709043706 wait complete. 2024-03-16T20:57:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:38 smithi008 ceph-mon[31434]: pgmap v395: 97 pgs: 97 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 7 op/s 2024-03-16T20:57:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:38 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3308470660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:38 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:38 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3040596323' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:38 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T20:57:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:38 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:57:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:38 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T20:57:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:38 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:57:39.074 INFO:tasks.cephfs.filesystem:scrub status for tag:731b38dc-d580-4e10-a15f-69dd7d55cc4f - {'path': '/', 'tag': '731b38dc-d580-4e10-a15f-69dd7d55cc4f', 'options': 'recursive,force'} 2024-03-16T20:57:39.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:38 smithi170 ceph-mon[35947]: pgmap v395: 97 pgs: 97 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 7 op/s 2024-03-16T20:57:39.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:38 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:39.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:38 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3308470660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:39.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:38 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:39.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:38 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3040596323' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:39.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:38 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T20:57:39.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:38 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:57:39.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:38 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T20:57:39.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:38 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:57:39.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:38 smithi186 ceph-mon[36391]: pgmap v395: 97 pgs: 97 active+clean; 648 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 7 op/s 2024-03-16T20:57:39.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:38 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:39.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:38 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3308470660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:57:39.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:38 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:39.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:38 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3040596323' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T20:57:39.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:38 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T20:57:39.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:38 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:57:39.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:38 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T20:57:39.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:38 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:57:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.941+0000 7ff0daa00640 1 -- 172.21.15.8:0/390977468 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mgrmap(e 19) v1 ==== 136295+0+0 (secure 0 0 0) 0x7ff0d4096ea0 con 0x7ff0e4100420 2024-03-16T20:57:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.944+0000 7ff0daa00640 1 -- 172.21.15.8:0/390977468 <== mon.1 v2:172.21.15.186:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff0d4063b40 con 0x7ff0e4100420 2024-03-16T20:57:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 -- 172.21.15.8:0/390977468 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff0c80a1b50 msgr2=0x7ff0c80a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff0c80a1b50 0x7ff0c80a4010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009830 tx=0x7ff0cc034c20 comp rx=0 tx=0).stop 2024-03-16T20:57:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 -- 172.21.15.8:0/390977468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0e4100420 msgr2=0x7ff0e41975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0e4100420 0x7ff0e41975f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400e9a0 tx=0x7ff0d400eda0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 -- 172.21.15.8:0/390977468 shutdown_connections 2024-03-16T20:57:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7ff0c80a1b50 0x7ff0c80a4010 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0e4101fd0 0x7ff0e419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e4101610 0x7ff0e4197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 --2- 172.21.15.8:0/390977468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0e4100420 0x7ff0e41975f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:39.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 -- 172.21.15.8:0/390977468 >> 172.21.15.8:0/390977468 conn(0x7ff0e40fb990 msgr2=0x7ff0e40fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:39.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 -- 172.21.15.8:0/390977468 shutdown_connections 2024-03-16T20:57:39.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:39.949+0000 7ff0e9000640 1 -- 172.21.15.8:0/390977468 wait complete. 2024-03-16T20:57:39.971 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-03-16T20:57:40.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.179+0000 7fa5fb400640 1 -- 172.21.15.8:0/2879485595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f4101fb0 msgr2=0x7fa5f41043a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:40.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.179+0000 7fa5fb400640 1 --2- 172.21.15.8:0/2879485595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f4101fb0 0x7fa5f41043a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009900 tx=0x7fa5e802bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:40.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.179+0000 7fa5fb400640 1 -- 172.21.15.8:0/2879485595 shutdown_connections 2024-03-16T20:57:40.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.179+0000 7fa5fb400640 1 --2- 172.21.15.8:0/2879485595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f4107210 0x7fa5f4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.179+0000 7fa5fb400640 1 --2- 172.21.15.8:0/2879485595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5f41048e0 0x7fa5f4106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.179+0000 7fa5fb400640 1 --2- 172.21.15.8:0/2879485595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f4101fb0 0x7fa5f41043a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.179+0000 7fa5fb400640 1 -- 172.21.15.8:0/2879485595 >> 172.21.15.8:0/2879485595 conn(0x7fa5f40fb9a0 msgr2=0x7fa5f40fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:40.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.179+0000 7fa5fb400640 1 -- 172.21.15.8:0/2879485595 shutdown_connections 2024-03-16T20:57:40.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.179+0000 7fa5fb400640 1 -- 172.21.15.8:0/2879485595 wait complete. 2024-03-16T20:57:40.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.180+0000 7fa5fb400640 1 Processor -- start 2024-03-16T20:57:40.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.180+0000 7fa5fb400640 1 -- start start 2024-03-16T20:57:40.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5fb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f4101fb0 0x7fa5f41997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:40.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5fb400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f41048e0 0x7fa5f4199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5fb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5f4107210 0x7fa5f41a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5fb400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f41a12b0 con 0x7fa5f4101fb0 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5fb400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f41a1420 con 0x7fa5f4107210 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5fb400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f41a15e0 con 0x7fa5f41048e0 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5f9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5f4107210 0x7fa5f41a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5f8a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f4101fb0 0x7fa5f41997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5f3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f41048e0 0x7fa5f4199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5f9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5f4107210 0x7fa5f41a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:57166/0 (socket says 172.21.15.8:57166) 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5f3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f41048e0 0x7fa5f4199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56076/0 (socket says 172.21.15.8:56076) 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5f3e00640 1 -- 172.21.15.8:0/402561817 learned_addr learned my addr 172.21.15.8:0/402561817 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5f9400640 1 -- 172.21.15.8:0/402561817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f41048e0 msgr2=0x7fa5f4199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5f9400640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f41048e0 0x7fa5f4199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5f9400640 1 -- 172.21.15.8:0/402561817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f4101fb0 msgr2=0x7fa5f41997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5f9400640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f4101fb0 0x7fa5f41997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.181+0000 7fa5f9400640 1 -- 172.21.15.8:0/402561817 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8009560 con 0x7fa5f4107210 2024-03-16T20:57:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.182+0000 7fa5f9400640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5f4107210 0x7fa5f41a0d70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009fd0 tx=0x7fa5ec00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.182+0000 7fa5f1600640 1 -- 172.21.15.8:0/402561817 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec00ce20 con 0x7fa5f4107210 2024-03-16T20:57:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.182+0000 7fa5fb400640 1 -- 172.21.15.8:0/402561817 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f41a18c0 con 0x7fa5f4107210 2024-03-16T20:57:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.182+0000 7fa5f1600640 1 -- 172.21.15.8:0/402561817 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa5ec004b20 con 0x7fa5f4107210 2024-03-16T20:57:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.182+0000 7fa5f1600640 1 -- 172.21.15.8:0/402561817 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec010710 con 0x7fa5f4107210 2024-03-16T20:57:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.182+0000 7fa5fb400640 1 -- 172.21.15.8:0/402561817 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f41a1dd0 con 0x7fa5f4107210 2024-03-16T20:57:40.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.184+0000 7fa5fb400640 1 -- 172.21.15.8:0/402561817 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f4108d60 con 0x7fa5f4107210 2024-03-16T20:57:40.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.185+0000 7fa5f1600640 1 -- 172.21.15.8:0/402561817 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 136295+0+0 (secure 0 0 0) 0x7fa5ec004c90 con 0x7fa5f4107210 2024-03-16T20:57:40.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.186+0000 7fa5f1600640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa5dc0a1b20 0x7fa5dc0a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:40.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.187+0000 7fa5f8a00640 1 -- 172.21.15.8:0/402561817 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa5dc0a1b20 msgr2=0x7fa5dc0a3fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1064583862 2024-03-16T20:57:40.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.187+0000 7fa5f1600640 1 -- 172.21.15.8:0/402561817 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa5ec014070 con 0x7fa5f4107210 2024-03-16T20:57:40.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.187+0000 7fa5f8a00640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa5dc0a1b20 0x7fa5dc0a3fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T20:57:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.195+0000 7fa5f1600640 1 -- 172.21.15.8:0/402561817 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa5ec096de0 con 0x7fa5f4107210 2024-03-16T20:57:40.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:40 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: ignoring --setuser ceph since I am not root 2024-03-16T20:57:40.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:40 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: ignoring --setgroup ceph since I am not root 2024-03-16T20:57:40.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:39 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/390977468' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-16T20:57:40.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:39 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-16T20:57:40.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:57:40.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:57:40.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:39 smithi008 ceph-mon[31434]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:40.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:39 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/390977468' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-16T20:57:40.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:39 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-16T20:57:40.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:39 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:57:40.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:39 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:57:40.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:39 smithi170 ceph-mon[35947]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:40.368 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:39 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: ignoring --setuser ceph since I am not root 2024-03-16T20:57:40.368 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:39 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: ignoring --setgroup ceph since I am not root 2024-03-16T20:57:40.368 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:39 smithi170 ceph-mgr[37359]: -- 172.21.15.170:0/30745122 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561c766ea1a0 con 0x561c766c0800 2024-03-16T20:57:40.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.388+0000 7fa5f8a00640 1 -- 172.21.15.8:0/402561817 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa5dc0a1b20 msgr2=0x7fa5dc0a3fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1064583862 2024-03-16T20:57:40.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.388+0000 7fa5f8a00640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa5dc0a1b20 0x7fa5dc0a3fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T20:57:40.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:39 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/390977468' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-16T20:57:40.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:39 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-16T20:57:40.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:39 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:57:40.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:39 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:57:40.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:39 smithi186 ceph-mon[36391]: from='mgr.14152 172.21.15.8:0/616590435' entity='mgr.x' 2024-03-16T20:57:40.393 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:39 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: ignoring --setuser ceph since I am not root 2024-03-16T20:57:40.393 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:39 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: ignoring --setgroup ceph since I am not root 2024-03-16T20:57:40.393 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:39 smithi186 ceph-mgr[38320]: -- 172.21.15.186:0/1855474020 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5562c2f781a0 con 0x5562c2f4ec00 2024-03-16T20:57:40.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.399+0000 7fa5fb400640 1 -- 172.21.15.8:0/402561817 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fa5f402d000 con 0x7fa5f4107210 2024-03-16T20:57:40.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.408+0000 7fa5f1600640 1 -- 172.21.15.8:0/402561817 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa5ec09a4a0 con 0x7fa5f4107210 2024-03-16T20:57:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.410+0000 7fa5fb400640 1 -- 172.21.15.8:0/402561817 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa5dc0a1b20 msgr2=0x7fa5dc0a3fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T20:57:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.411+0000 7fa5fb400640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa5dc0a1b20 0x7fa5dc0a3fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.411+0000 7fa5fb400640 1 -- 172.21.15.8:0/402561817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5f4107210 msgr2=0x7fa5f41a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.411+0000 7fa5fb400640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5f4107210 0x7fa5f41a0d70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009fd0 tx=0x7fa5ec00ef10 comp rx=0 tx=0).stop 2024-03-16T20:57:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.411+0000 7fa5fb400640 1 -- 172.21.15.8:0/402561817 shutdown_connections 2024-03-16T20:57:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.411+0000 7fa5fb400640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7fa5dc0a1b20 0x7fa5dc0a3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.411+0000 7fa5fb400640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5f4107210 0x7fa5f41a0d70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.411+0000 7fa5fb400640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5f41048e0 0x7fa5f4199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.411+0000 7fa5fb400640 1 --2- 172.21.15.8:0/402561817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f4101fb0 0x7fa5f41997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.411+0000 7fa5fb400640 1 -- 172.21.15.8:0/402561817 >> 172.21.15.8:0/402561817 conn(0x7fa5f40fb9a0 msgr2=0x7fa5f4101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.411+0000 7fa5fb400640 1 -- 172.21.15.8:0/402561817 shutdown_connections 2024-03-16T20:57:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.411+0000 7fa5fb400640 1 -- 172.21.15.8:0/402561817 wait complete. 2024-03-16T20:57:40.432 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-03-16T20:57:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.636+0000 7f216ec00640 1 -- 172.21.15.8:0/426614319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2168101520 msgr2=0x7f2168101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.636+0000 7f216ec00640 1 --2- 172.21.15.8:0/426614319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2168101520 0x7f2168101940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2158009900 tx=0x7f215802bc30 comp rx=0 tx=0).stop 2024-03-16T20:57:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.636+0000 7f216ec00640 1 -- 172.21.15.8:0/426614319 shutdown_connections 2024-03-16T20:57:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.636+0000 7f216ec00640 1 --2- 172.21.15.8:0/426614319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21681030d0 0x7f2168109960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.636+0000 7f216ec00640 1 --2- 172.21.15.8:0/426614319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2168102710 0x7f2168102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.636+0000 7f216ec00640 1 --2- 172.21.15.8:0/426614319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2168101520 0x7f2168101940 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.636+0000 7f216ec00640 1 -- 172.21.15.8:0/426614319 >> 172.21.15.8:0/426614319 conn(0x7f21680fcab0 msgr2=0x7f21680feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.636+0000 7f216ec00640 1 -- 172.21.15.8:0/426614319 shutdown_connections 2024-03-16T20:57:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.636+0000 7f216ec00640 1 -- 172.21.15.8:0/426614319 wait complete. 2024-03-16T20:57:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.638+0000 7f216ec00640 1 Processor -- start 2024-03-16T20:57:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.638+0000 7f216ec00640 1 -- start start 2024-03-16T20:57:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.638+0000 7f216ec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2168101520 0x7f21681975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.638+0000 7f216ec00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2168102710 0x7f2168197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.638+0000 7f216ec00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21681030d0 0x7f216819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f216ec00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216819f0c0 con 0x7f2168101520 2024-03-16T20:57:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f216ec00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216819f230 con 0x7f21681030d0 2024-03-16T20:57:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f216ec00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216819f3f0 con 0x7f2168102710 2024-03-16T20:57:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f2167e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2168101520 0x7f21681975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f2167400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2168102710 0x7f2168197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f2167e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2168101520 0x7f21681975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47332/0 (socket says 172.21.15.8:47332) 2024-03-16T20:57:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f216cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21681030d0 0x7f216819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f2167e00640 1 -- 172.21.15.8:0/2492287463 learned_addr learned my addr 172.21.15.8:0/2492287463 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f2167400640 1 -- 172.21.15.8:0/2492287463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21681030d0 msgr2=0x7f216819eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f2167400640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21681030d0 0x7f216819eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f2167400640 1 -- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2168101520 msgr2=0x7f21681975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f2167400640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2168101520 0x7f21681975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f2167400640 1 -- 172.21.15.8:0/2492287463 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158009560 con 0x7f2168102710 2024-03-16T20:57:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f2167e00640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2168101520 0x7f21681975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.639+0000 7f216cc00640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21681030d0 0x7f216819eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.640+0000 7f2167400640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2168102710 0x7f2168197b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f215400e9f0 tx=0x7f215400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.640+0000 7f2164c00640 1 -- 172.21.15.8:0/2492287463 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215400ccc0 con 0x7f2168102710 2024-03-16T20:57:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.640+0000 7f2164c00640 1 -- 172.21.15.8:0/2492287463 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f215400ce20 con 0x7f2168102710 2024-03-16T20:57:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.640+0000 7f2164c00640 1 -- 172.21.15.8:0/2492287463 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154004ad0 con 0x7f2168102710 2024-03-16T20:57:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.640+0000 7f216ec00640 1 -- 172.21.15.8:0/2492287463 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216819f6d0 con 0x7f2168102710 2024-03-16T20:57:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.640+0000 7f216ec00640 1 -- 172.21.15.8:0/2492287463 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216819fb90 con 0x7f2168102710 2024-03-16T20:57:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.641+0000 7f216ec00640 1 -- 172.21.15.8:0/2492287463 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2168108770 con 0x7f2168102710 2024-03-16T20:57:40.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.643+0000 7f2164c00640 1 -- 172.21.15.8:0/2492287463 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 19) v1 ==== 136295+0+0 (secure 0 0 0) 0x7f21540051b0 con 0x7f2168102710 2024-03-16T20:57:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.644+0000 7f2164c00640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f214c0a1ba0 0x7f214c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.645+0000 7f2167e00640 1 -- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f214c0a1ba0 msgr2=0x7f214c0a4060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1064583862 2024-03-16T20:57:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.645+0000 7f2164c00640 1 -- 172.21.15.8:0/2492287463 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2154014070 con 0x7f2168102710 2024-03-16T20:57:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.645+0000 7f2167e00640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f214c0a1ba0 0x7f214c0a4060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T20:57:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.648+0000 7f2164c00640 1 -- 172.21.15.8:0/2492287463 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2154096500 con 0x7f2168102710 2024-03-16T20:57:40.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.846+0000 7f2167e00640 1 -- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f214c0a1ba0 msgr2=0x7f214c0a4060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1064583862 2024-03-16T20:57:40.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.846+0000 7f2167e00640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f214c0a1ba0 0x7f214c0a4060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T20:57:40.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.852+0000 7f216ec00640 1 -- 172.21.15.8:0/2492287463 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f216802d070 con 0x7f2168102710 2024-03-16T20:57:40.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.859+0000 7f2164c00640 1 -- 172.21.15.8:0/2492287463 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v29)=0 v29) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2154099bc0 con 0x7f2168102710 2024-03-16T20:57:40.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.861+0000 7f216ec00640 1 -- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f214c0a1ba0 msgr2=0x7f214c0a4060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T20:57:40.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.861+0000 7f216ec00640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f214c0a1ba0 0x7f214c0a4060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.862+0000 7f216ec00640 1 -- 172.21.15.8:0/2492287463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2168102710 msgr2=0x7f2168197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:40.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.862+0000 7f216ec00640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2168102710 0x7f2168197b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f215400e9f0 tx=0x7f215400eeb0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.862+0000 7f216ec00640 1 -- 172.21.15.8:0/2492287463 shutdown_connections 2024-03-16T20:57:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.862+0000 7f216ec00640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f214c0a1ba0 0x7f214c0a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.862+0000 7f216ec00640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21681030d0 0x7f216819eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.862+0000 7f216ec00640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2168102710 0x7f2168197b10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.862+0000 7f216ec00640 1 --2- 172.21.15.8:0/2492287463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2168101520 0x7f21681975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.862+0000 7f216ec00640 1 -- 172.21.15.8:0/2492287463 >> 172.21.15.8:0/2492287463 conn(0x7f21680fcab0 msgr2=0x7f2168105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.862+0000 7f216ec00640 1 -- 172.21.15.8:0/2492287463 shutdown_connections 2024-03-16T20:57:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:40.862+0000 7f216ec00640 1 -- 172.21.15.8:0/2492287463 wait complete. 2024-03-16T20:57:40.867 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:40 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:40.529+0000 7fb2163ba200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T20:57:40.868 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:40 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:40.656+0000 7fb2163ba200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T20:57:40.884 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-03-16T20:57:40.893 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:40 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:40.525+0000 7f7e78fe9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T20:57:40.893 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:40 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:40.633+0000 7f7e78fe9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T20:57:41.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.087+0000 7f9454c00640 1 -- 172.21.15.8:0/1666659657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9450103740 msgr2=0x7f9450103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:41.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.087+0000 7f9454c00640 1 --2- 172.21.15.8:0/1666659657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9450103740 0x7f9450103b60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9440009900 tx=0x7f944002bc40 comp rx=0 tx=0).stop 2024-03-16T20:57:41.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.087+0000 7f9454c00640 1 -- 172.21.15.8:0/1666659657 shutdown_connections 2024-03-16T20:57:41.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.087+0000 7f9454c00640 1 --2- 172.21.15.8:0/1666659657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94501052f0 0x7f945010bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:41.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.087+0000 7f9454c00640 1 --2- 172.21.15.8:0/1666659657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450104930 0x7f9450104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:41.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.087+0000 7f9454c00640 1 --2- 172.21.15.8:0/1666659657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9450103740 0x7f9450103b60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:41.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.087+0000 7f9454c00640 1 -- 172.21.15.8:0/1666659657 >> 172.21.15.8:0/1666659657 conn(0x7f94500fecb0 msgr2=0x7f94501010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:41.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.087+0000 7f9454c00640 1 -- 172.21.15.8:0/1666659657 shutdown_connections 2024-03-16T20:57:41.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.087+0000 7f9454c00640 1 -- 172.21.15.8:0/1666659657 wait complete. 2024-03-16T20:57:41.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.088+0000 7f9454c00640 1 Processor -- start 2024-03-16T20:57:41.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.088+0000 7f9454c00640 1 -- start start 2024-03-16T20:57:41.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.088+0000 7f9454c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9450103740 0x7f9450199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:41.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.088+0000 7f9454c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450104930 0x7f9450199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:41.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.088+0000 7f9454c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94501052f0 0x7f94501a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:41.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.088+0000 7f9454c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94501a1300 con 0x7f9450103740 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.088+0000 7f9454c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94501a1470 con 0x7f94501052f0 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.088+0000 7f9454c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94501a1630 con 0x7f9450104930 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.089+0000 7f944d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450104930 0x7f9450199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.089+0000 7f944d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450104930 0x7f9450199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56128/0 (socket says 172.21.15.8:56128) 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.089+0000 7f944d400640 1 -- 172.21.15.8:0/2875313017 learned_addr learned my addr 172.21.15.8:0/2875313017 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.089+0000 7f944de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9450103740 0x7f9450199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.089+0000 7f944e800640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94501052f0 0x7f94501a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.089+0000 7f944d400640 1 -- 172.21.15.8:0/2875313017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94501052f0 msgr2=0x7f94501a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.089+0000 7f944d400640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94501052f0 0x7f94501a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.089+0000 7f944d400640 1 -- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9450103740 msgr2=0x7f9450199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.089+0000 7f944d400640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9450103740 0x7f9450199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.089+0000 7f944d400640 1 -- 172.21.15.8:0/2875313017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9440009560 con 0x7f9450104930 2024-03-16T20:57:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.090+0000 7f944d400640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450104930 0x7f9450199d50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f943c00d950 tx=0x7f943c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.090+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c009a30 con 0x7f9450104930 2024-03-16T20:57:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.090+0000 7f9454c00640 1 -- 172.21.15.8:0/2875313017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94501a1910 con 0x7f9450104930 2024-03-16T20:57:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.090+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f943c009b90 con 0x7f9450104930 2024-03-16T20:57:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.090+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c004a00 con 0x7f9450104930 2024-03-16T20:57:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.090+0000 7f9454c00640 1 -- 172.21.15.8:0/2875313017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94501a1e20 con 0x7f9450104930 2024-03-16T20:57:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.091+0000 7f9454c00640 1 -- 172.21.15.8:0/2875313017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945010a990 con 0x7f9450104930 2024-03-16T20:57:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.094+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 19) v1 ==== 136295+0+0 (secure 0 0 0) 0x7f943c009d00 con 0x7f9450104930 2024-03-16T20:57:41.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.095+0000 7f9446a00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 0x7f94340a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:41.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.096+0000 7f944de00640 1 -- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 msgr2=0x7f94340a3fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1064583862 2024-03-16T20:57:41.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.096+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f943c0cce30 con 0x7f9450104930 2024-03-16T20:57:41.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.096+0000 7f944de00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 0x7f94340a3fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T20:57:41.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.097+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f943c095ff0 con 0x7f9450104930 2024-03-16T20:57:41.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:40 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-16T20:57:41.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:40 smithi008 ceph-mon[31434]: mgrmap e19: x(active, since 10m), standbys: y, z 2024-03-16T20:57:41.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:40 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' 2024-03-16T20:57:41.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:40 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' 2024-03-16T20:57:41.245 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:40 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:40.832+0000 7fbfc3c5b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T20:57:41.245 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:40 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:40.969+0000 7fbfc3c5b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T20:57:41.293 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:40 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-16T20:57:41.294 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:40 smithi186 ceph-mon[36391]: mgrmap e19: x(active, since 10m), standbys: y, z 2024-03-16T20:57:41.294 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:40 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' 2024-03-16T20:57:41.294 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:40 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' 2024-03-16T20:57:41.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.297+0000 7f944de00640 1 -- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 msgr2=0x7f94340a3fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1064583862 2024-03-16T20:57:41.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.297+0000 7f944de00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 0x7f94340a3fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T20:57:41.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:40 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-16T20:57:41.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:40 smithi170 ceph-mon[35947]: mgrmap e19: x(active, since 10m), standbys: y, z 2024-03-16T20:57:41.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:40 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' 2024-03-16T20:57:41.312 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:40 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' 2024-03-16T20:57:41.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.320+0000 7f9454c00640 1 -- 172.21.15.8:0/2875313017 --> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f945002d070 con 0x7f94340a1b20 2024-03-16T20:57:41.566 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:41.307+0000 7fb2163ba200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T20:57:41.566 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:41.406+0000 7fb2163ba200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T20:57:41.566 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:41.561+0000 7fb2163ba200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T20:57:41.631 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:41.289+0000 7f7e78fe9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T20:57:41.631 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:41.384+0000 7f7e78fe9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T20:57:41.631 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:41.529+0000 7f7e78fe9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T20:57:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.698+0000 7f944de00640 1 -- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 msgr2=0x7f94340a3fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1064583862 2024-03-16T20:57:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:41.698+0000 7f944de00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 0x7f94340a3fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-16T20:57:41.867 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:41.659+0000 7fb2163ba200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T20:57:41.867 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:41.747+0000 7fb2163ba200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T20:57:41.893 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:41.627+0000 7f7e78fe9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T20:57:41.893 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:41.716+0000 7f7e78fe9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T20:57:42.107 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:41 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:41.791+0000 7fbfc3c5b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T20:57:42.107 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:41 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:41.918+0000 7fbfc3c5b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T20:57:42.107 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:42 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:42.102+0000 7fbfc3c5b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T20:57:42.287 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:41.985+0000 7f7e78fe9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T20:57:42.287 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:42 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:42.098+0000 7f7e78fe9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T20:57:42.287 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:42 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:42.186+0000 7f7e78fe9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T20:57:42.287 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:42 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:42.282+0000 7f7e78fe9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T20:57:42.313 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:42.015+0000 7fb2163ba200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T20:57:42.313 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:42.126+0000 7fb2163ba200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T20:57:42.314 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:42.213+0000 7fb2163ba200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T20:57:42.494 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:42 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:42.232+0000 7fbfc3c5b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T20:57:42.494 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:42 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:42.349+0000 7fbfc3c5b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T20:57:42.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:42.499+0000 7f944de00640 1 -- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 msgr2=0x7f94340a3fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1064583862 2024-03-16T20:57:42.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:42.499+0000 7f944de00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 0x7f94340a3fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-16T20:57:42.617 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:42.309+0000 7fb2163ba200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T20:57:42.617 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:42.487+0000 7fb2163ba200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T20:57:42.643 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:42 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:42.466+0000 7f7e78fe9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T20:57:42.968 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:42 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:42.696+0000 7fbfc3c5b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T20:57:42.969 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:42 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:42.843+0000 7fbfc3c5b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T20:57:42.969 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:42 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:42.963+0000 7fbfc3c5b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T20:57:43.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:43 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:43.093+0000 7fbfc3c5b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T20:57:43.746 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:43 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:43.320+0000 7fbfc3c5b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T20:57:43.867 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:43 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:43.606+0000 7fb2163ba200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T20:57:43.867 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:43 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:43.743+0000 7fb2163ba200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T20:57:43.893 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:43.545+0000 7f7e78fe9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T20:57:43.893 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:43.686+0000 7f7e78fe9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T20:57:44.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:44.101+0000 7f944de00640 1 -- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 msgr2=0x7f94340a3fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1064583862 2024-03-16T20:57:44.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:44.101+0000 7f944de00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 0x7f94340a3fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-16T20:57:44.367 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:44.104+0000 7fb2163ba200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T20:57:44.367 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:44.239+0000 7fb2163ba200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T20:57:44.393 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:44.050+0000 7f7e78fe9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T20:57:44.393 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:44.168+0000 7f7e78fe9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T20:57:44.866 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:44.389+0000 7f7e78fe9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:57:44.866 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:44.576+0000 7f7e78fe9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T20:57:44.866 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:44.861+0000 7f7e78fe9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:57:44.867 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:44.448+0000 7fb2163ba200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:57:44.867 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:44.689+0000 7fb2163ba200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T20:57:44.994 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:44 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:44.657+0000 7fbfc3c5b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T20:57:44.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:44 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:44.838+0000 7fbfc3c5b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T20:57:45.259 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:44.991+0000 7fb2163ba200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:57:45.259 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:45 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:45.254+0000 7fb2163ba200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T20:57:45.393 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:45 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:45.124+0000 7f7e78fe9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T20:57:45.393 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:45 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:45.364+0000 7f7e78fe9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T20:57:45.679 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:45 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:45.273+0000 7fbfc3c5b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T20:57:45.679 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:45 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:45.403+0000 7fbfc3c5b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T20:57:45.867 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:45 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:45.572+0000 7fb2163ba200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T20:57:45.936 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:45 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:45.674+0000 7fbfc3c5b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:57:46.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:45 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:45.931+0000 7fbfc3c5b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T20:57:46.643 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:46.229+0000 7f7e78fe9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T20:57:46.663 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:46 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:46.327+0000 7fbfc3c5b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T20:57:46.867 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:46 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:46.444+0000 7fb2163ba200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T20:57:46.986 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:46 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:46.658+0000 7fbfc3c5b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T20:57:47.143 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:46.864+0000 7f7e78fe9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T20:57:47.143 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:46.963+0000 7f7e78fe9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T20:57:47.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:46 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:46.981+0000 7fbfc3c5b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T20:57:47.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:47.266+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mgrmap(e 20) v1 ==== 136295+0+0 (secure 0 0 0) 0x7f943c0963c0 con 0x7f9450104930 2024-03-16T20:57:47.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:47.302+0000 7f944de00640 1 -- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 msgr2=0x7f94340a3fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/1064583862 2024-03-16T20:57:47.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:47.302+0000 7f944de00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 0x7f94340a3fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-03-16T20:57:47.531 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:47 smithi170 ceph-mon[35947]: Standby manager daemon z restarted 2024-03-16T20:57:47.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:47 smithi170 ceph-mon[35947]: Standby manager daemon z started 2024-03-16T20:57:47.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:47 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-16T20:57:47.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:47 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:57:47.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:47 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-16T20:57:47.532 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:47 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:57:47.532 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:47 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:47.135+0000 7fb2163ba200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T20:57:47.532 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:47 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:47.253+0000 7fb2163ba200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T20:57:47.643 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 20:57:47 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z[38282]: 2024-03-16T20:57:47.182+0000 7f7e78fe9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T20:57:47.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:47 smithi186 ceph-mon[36391]: Standby manager daemon z restarted 2024-03-16T20:57:47.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:47 smithi186 ceph-mon[36391]: Standby manager daemon z started 2024-03-16T20:57:47.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:47 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-16T20:57:47.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:47 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:57:47.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:47 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-16T20:57:47.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:47 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:57:47.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:47 smithi008 ceph-mon[31434]: Standby manager daemon z restarted 2024-03-16T20:57:47.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:47 smithi008 ceph-mon[31434]: Standby manager daemon z started 2024-03-16T20:57:47.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:47 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-16T20:57:47.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:47 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:57:47.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:47 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-16T20:57:47.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:47 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.186:0/323325805' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:57:47.867 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 20:57:47 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y[37355]: 2024-03-16T20:57:47.526+0000 7fb2163ba200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T20:57:48.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:48.296+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 <== mon.1 v2:172.21.15.186:3300/0 8 ==== mgrmap(e 21) v1 ==== 136295+0+0 (secure 0 0 0) 0x7f943c0ca960 con 0x7f9450104930 2024-03-16T20:57:48.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:48 smithi008 ceph-mon[31434]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-03-16T20:57:48.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:48 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-16T20:57:48.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:48 smithi008 ceph-mon[31434]: Standby manager daemon y restarted 2024-03-16T20:57:48.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:48 smithi008 ceph-mon[31434]: Standby manager daemon y started 2024-03-16T20:57:48.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:48 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:57:48.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:48 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-16T20:57:48.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:48 smithi008 ceph-mon[31434]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:57:48.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:48 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:48.075+0000 7fbfc3c5b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T20:57:48.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:48 smithi170 ceph-mon[35947]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-03-16T20:57:48.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:48 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-16T20:57:48.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:48 smithi170 ceph-mon[35947]: Standby manager daemon y restarted 2024-03-16T20:57:48.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:48 smithi170 ceph-mon[35947]: Standby manager daemon y started 2024-03-16T20:57:48.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:48 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:57:48.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:48 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-16T20:57:48.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:48 smithi170 ceph-mon[35947]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:57:48.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:48 smithi186 ceph-mon[36391]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-03-16T20:57:48.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:48 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-16T20:57:48.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:48 smithi186 ceph-mon[36391]: Standby manager daemon y restarted 2024-03-16T20:57:48.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:48 smithi186 ceph-mon[36391]: Standby manager daemon y started 2024-03-16T20:57:48.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:48 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T20:57:48.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:48 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-16T20:57:48.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:48 smithi186 ceph-mon[36391]: from='mgr.? 172.21.15.170:0/555516195' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T20:57:49.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:48 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:48.811+0000 7fbfc3c5b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T20:57:49.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:48 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:48.948+0000 7fbfc3c5b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T20:57:49.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:49.267+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 <== mon.1 v2:172.21.15.186:3300/0 9 ==== mgrmap(e 22) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f943c0cada0 con 0x7f9450104930 2024-03-16T20:57:49.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:49.269+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 msgr2=0x7f94340a3fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T20:57:49.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:49.269+0000 7f9446a00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/1064583862,v1:172.21.15.8:6801/1064583862] conn(0x7f94340a1b20 0x7f94340a3fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:49.588 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: mgrmap e21: x(active, since 10m), standbys: z, y 2024-03-16T20:57:49.588 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: Active manager daemon x restarted 2024-03-16T20:57:49.588 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: Activating manager daemon x 2024-03-16T20:57:49.588 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: osdmap e89: 12 total, 12 up, 12 in 2024-03-16T20:57:49.588 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: mgrmap e22: x(active, starting, since 0.0253417s), standbys: z, y 2024-03-16T20:57:49.588 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:57:49.588 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:57:49.588 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:57:49.588 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-16T20:57:49.588 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T20:57:49.588 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T20:57:49.589 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T20:57:49.589 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:49 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T20:57:49.599 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:49.247+0000 7fbfc3c5b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T20:57:49.599 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: mgrmap e21: x(active, since 10m), standbys: z, y 2024-03-16T20:57:49.599 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: Active manager daemon x restarted 2024-03-16T20:57:49.599 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: Activating manager daemon x 2024-03-16T20:57:49.599 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: osdmap e89: 12 total, 12 up, 12 in 2024-03-16T20:57:49.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: mgrmap e22: x(active, starting, since 0.0253417s), standbys: z, y 2024-03-16T20:57:49.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:57:49.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:57:49.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:57:49.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-16T20:57:49.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T20:57:49.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T20:57:49.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T20:57:49.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: mgrmap e21: x(active, since 10m), standbys: z, y 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: Active manager daemon x restarted 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: Activating manager daemon x 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: osdmap e89: 12 total, 12 up, 12 in 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: mgrmap e22: x(active, starting, since 0.0253417s), standbys: z, y 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T20:57:49.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:49 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T20:57:49.994 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:49.595+0000 7fbf16600700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:57:49.994 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:49.595+0000 7fbf16600700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:57:49.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:49.595+0000 7fbf16600700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:57:49.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:49.595+0000 7fbf16600700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:57:49.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:49.595+0000 7fbf16600700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:57:49.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:49.596+0000 7fbf19800700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:57:49.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:49.596+0000 7fbf19800700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:57:49.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:49.596+0000 7fbf19800700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:57:49.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:49.596+0000 7fbf19800700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:57:49.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:57:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:57:49.596+0000 7fbf19800700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:57:50.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.325+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 <== mon.1 v2:172.21.15.186:3300/0 10 ==== mgrmap(e 23) v1 ==== 136091+0+0 (secure 0 0 0) 0x7f943c096c90 con 0x7f9450104930 2024-03-16T20:57:50.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.325+0000 7f9446a00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f943404d8b0 0x7f943404dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:50.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.325+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 --> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f945002d070 con 0x7f943404d8b0 2024-03-16T20:57:50.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.334+0000 7f944de00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f943404d8b0 0x7f943404dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:50.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.344+0000 7f944de00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f943404d8b0 0x7f943404dc90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f944002c180 tx=0x7f944002df90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:50.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.431+0000 7f9446a00640 1 -- 172.21.15.8:0/2875313017 <== mgr.15240 v2:172.21.15.8:6800/4227086558 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f945002d070 con 0x7f943404d8b0 2024-03-16T20:57:50.436 INFO:teuthology.orchestra.run.smithi008.stdout:Schedule set for path / 2024-03-16T20:57:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.434+0000 7f9454c00640 1 -- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f943404d8b0 msgr2=0x7f943404dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.434+0000 7f9454c00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f943404d8b0 0x7f943404dc90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f944002c180 tx=0x7f944002df90 comp rx=0 tx=0).stop 2024-03-16T20:57:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.434+0000 7f9454c00640 1 -- 172.21.15.8:0/2875313017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450104930 msgr2=0x7f9450199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.434+0000 7f9454c00640 1 --2- 172.21.15.8:0/2875313017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450104930 0x7f9450199d50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f943c00d950 tx=0x7f943c00de10 comp rx=0 tx=0).stop 2024-03-16T20:57:50.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.434+0000 7f944e800640 1 -- 172.21.15.8:0/2875313017 reap_dead start 2024-03-16T20:57:50.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.434+0000 7f9454c00640 1 -- 172.21.15.8:0/2875313017 shutdown_connections 2024-03-16T20:57:50.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.434+0000 7f9454c00640 1 -- 172.21.15.8:0/2875313017 >> 172.21.15.8:0/2875313017 conn(0x7f94500fecb0 msgr2=0x7f9450107b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:50.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.434+0000 7f9454c00640 1 -- 172.21.15.8:0/2875313017 shutdown_connections 2024-03-16T20:57:50.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.434+0000 7f9454c00640 1 -- 172.21.15.8:0/2875313017 wait complete. 2024-03-16T20:57:50.455 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-03-16T20:57:50.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-16T20:57:50.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T20:57:50.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T20:57:50.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:57:50.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:57:50.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:57:50.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:57:50.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:57:50.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-16T20:57:50.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-16T20:57:50.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-16T20:57:50.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: Manager daemon x is now available 2024-03-16T20:57:50.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:50.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:50.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-16T20:57:50.620 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:50 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-16T20:57:50.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-16T20:57:50.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T20:57:50.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T20:57:50.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T20:57:50.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T20:57:50.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T20:57:50.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T20:57:50.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-16T20:57:50.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-16T20:57:50.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-16T20:57:50.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: Manager daemon x is now available 2024-03-16T20:57:50.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:50.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:50.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-16T20:57:50.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:50 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-16T20:57:50.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.639+0000 7f07c8a00640 1 -- 172.21.15.8:0/53099194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c40ffc30 msgr2=0x7f07c4100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:50.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.639+0000 7f07c8a00640 1 --2- 172.21.15.8:0/53099194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c40ffc30 0x7f07c4100050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009900 tx=0x7f07b402bcd0 comp rx=0 tx=0).stop 2024-03-16T20:57:50.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.639+0000 7f07c8a00640 1 -- 172.21.15.8:0/53099194 shutdown_connections 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.639+0000 7f07c8a00640 1 --2- 172.21.15.8:0/53099194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c4100f30 0x7f07c41013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.640+0000 7f07c8a00640 1 --2- 172.21.15.8:0/53099194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c4100590 0x7f07c41009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.640+0000 7f07c8a00640 1 --2- 172.21.15.8:0/53099194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c40ffc30 0x7f07c4100050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.640+0000 7f07c8a00640 1 -- 172.21.15.8:0/53099194 >> 172.21.15.8:0/53099194 conn(0x7f07c40fb7d0 msgr2=0x7f07c40fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.640+0000 7f07c8a00640 1 -- 172.21.15.8:0/53099194 shutdown_connections 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.640+0000 7f07c8a00640 1 -- 172.21.15.8:0/53099194 wait complete. 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c8a00640 1 Processor -- start 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c8a00640 1 -- start start 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c8a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c40ffc30 0x7f07c4199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c8a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c4100590 0x7f07c4199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c8a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c4100f30 0x7f07c41a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c8a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c41a1180 con 0x7f07c4100f30 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c8a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c41a12f0 con 0x7f07c4100590 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c8a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c41a14b0 con 0x7f07c40ffc30 2024-03-16T20:57:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c40ffc30 0x7f07c4199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c40ffc30 0x7f07c4199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:34550/0 (socket says 172.21.15.8:34550) 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c2800640 1 -- 172.21.15.8:0/1502356817 learned_addr learned my addr 172.21.15.8:0/1502356817 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c1e00640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c4100590 0x7f07c4199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.641+0000 7f07c3200640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c4100f30 0x7f07c41a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.642+0000 7f07c2800640 1 -- 172.21.15.8:0/1502356817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c4100590 msgr2=0x7f07c4199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.642+0000 7f07c2800640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c4100590 0x7f07c4199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.642+0000 7f07c2800640 1 -- 172.21.15.8:0/1502356817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c4100f30 msgr2=0x7f07c41a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.642+0000 7f07c2800640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c4100f30 0x7f07c41a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.642+0000 7f07c2800640 1 -- 172.21.15.8:0/1502356817 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4009560 con 0x7f07c40ffc30 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.642+0000 7f07c2800640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c40ffc30 0x7f07c4199690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000c00 tx=0x7f07b402df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.642+0000 7f07bb400640 1 -- 172.21.15.8:0/1502356817 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40043d0 con 0x7f07c40ffc30 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.643+0000 7f07c8a00640 1 -- 172.21.15.8:0/1502356817 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c41a1730 con 0x7f07c40ffc30 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.643+0000 7f07c8a00640 1 -- 172.21.15.8:0/1502356817 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c41a1c90 con 0x7f07c40ffc30 2024-03-16T20:57:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.643+0000 7f07bb400640 1 -- 172.21.15.8:0/1502356817 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f07b4005310 con 0x7f07c40ffc30 2024-03-16T20:57:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.643+0000 7f07bb400640 1 -- 172.21.15.8:0/1502356817 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4003e80 con 0x7f07c40ffc30 2024-03-16T20:57:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.644+0000 7f07c8a00640 1 -- 172.21.15.8:0/1502356817 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c410aa90 con 0x7f07c40ffc30 2024-03-16T20:57:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.645+0000 7f07bb400640 1 -- 172.21.15.8:0/1502356817 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 23) v1 ==== 136091+0+0 (secure 0 0 0) 0x7f07b40035f0 con 0x7f07c40ffc30 2024-03-16T20:57:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.647+0000 7f07bb400640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07a80a1890 0x7f07a80a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:50.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.647+0000 7f07bb400640 1 -- 172.21.15.8:0/1502356817 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f07b40ef800 con 0x7f07c40ffc30 2024-03-16T20:57:50.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.647+0000 7f07c1e00640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07a80a1890 0x7f07a80a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:50.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.648+0000 7f07c1e00640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07a80a1890 0x7f07a80a3d50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f07c419aba0 tx=0x7f07b000b410 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.651+0000 7f07bb400640 1 -- 172.21.15.8:0/1502356817 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f07b40b8cf0 con 0x7f07c40ffc30 2024-03-16T20:57:50.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T20:57:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: Manager daemon x is now available 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:50.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-16T20:57:50.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:50 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-16T20:57:50.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:50.890+0000 7f07c8a00640 1 -- 172.21.15.8:0/1502356817 --> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f07c4061930 con 0x7f07a80a1890 2024-03-16T20:57:51.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.018+0000 7f07bb400640 1 -- 172.21.15.8:0/1502356817 <== mgr.15240 v2:172.21.15.8:6800/4227086558 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f07c4061930 con 0x7f07a80a1890 2024-03-16T20:57:51.023 INFO:teuthology.orchestra.run.smithi008.stdout:Retention added to path / 2024-03-16T20:57:51.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.021+0000 7f07c8a00640 1 -- 172.21.15.8:0/1502356817 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07a80a1890 msgr2=0x7f07a80a3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.021+0000 7f07c8a00640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07a80a1890 0x7f07a80a3d50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f07c419aba0 tx=0x7f07b000b410 comp rx=0 tx=0).stop 2024-03-16T20:57:51.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.021+0000 7f07c8a00640 1 -- 172.21.15.8:0/1502356817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c40ffc30 msgr2=0x7f07c4199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.021+0000 7f07c8a00640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c40ffc30 0x7f07c4199690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000c00 tx=0x7f07b402df70 comp rx=0 tx=0).stop 2024-03-16T20:57:51.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.021+0000 7f07c8a00640 1 -- 172.21.15.8:0/1502356817 shutdown_connections 2024-03-16T20:57:51.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.022+0000 7f07c8a00640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07a80a1890 0x7f07a80a3d50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.022+0000 7f07c8a00640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c4100f30 0x7f07c41a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.022+0000 7f07c8a00640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07c4100590 0x7f07c4199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.022+0000 7f07c8a00640 1 --2- 172.21.15.8:0/1502356817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c40ffc30 0x7f07c4199690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.022+0000 7f07c8a00640 1 -- 172.21.15.8:0/1502356817 >> 172.21.15.8:0/1502356817 conn(0x7f07c40fb7d0 msgr2=0x7f07c40fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:51.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.022+0000 7f07c8a00640 1 -- 172.21.15.8:0/1502356817 shutdown_connections 2024-03-16T20:57:51.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.022+0000 7f07c8a00640 1 -- 172.21.15.8:0/1502356817 wait complete. 2024-03-16T20:57:51.045 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-03-16T20:57:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.223+0000 7f2b5f200640 1 -- 172.21.15.8:0/2333714271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b60107060 msgr2=0x7f2b601094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.223+0000 7f2b5f200640 1 --2- 172.21.15.8:0/2333714271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b60107060 0x7f2b601094b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009ca0 tx=0x7f2b5802c100 comp rx=0 tx=0).stop 2024-03-16T20:57:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.224+0000 7f2b5f200640 1 -- 172.21.15.8:0/2333714271 shutdown_connections 2024-03-16T20:57:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.224+0000 7f2b5f200640 1 --2- 172.21.15.8:0/2333714271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b60107060 0x7f2b601094b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.224+0000 7f2b5f200640 1 --2- 172.21.15.8:0/2333714271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b60104730 0x7f2b60106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.224+0000 7f2b5f200640 1 --2- 172.21.15.8:0/2333714271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b60101e00 0x7f2b601041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.224+0000 7f2b5f200640 1 -- 172.21.15.8:0/2333714271 >> 172.21.15.8:0/2333714271 conn(0x7f2b600fb7f0 msgr2=0x7f2b600fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.224+0000 7f2b5f200640 1 -- 172.21.15.8:0/2333714271 shutdown_connections 2024-03-16T20:57:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.224+0000 7f2b5f200640 1 -- 172.21.15.8:0/2333714271 wait complete. 2024-03-16T20:57:51.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5f200640 1 Processor -- start 2024-03-16T20:57:51.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5f200640 1 -- start start 2024-03-16T20:57:51.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b60101e00 0x7f2b601996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:51.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b60104730 0x7f2b60199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b60107060 0x7f2b601a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5f200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b601a11c0 con 0x7f2b60101e00 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b601a1330 con 0x7f2b60107060 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b601a14f0 con 0x7f2b60104730 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b60101e00 0x7f2b601996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b60104730 0x7f2b60199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b60104730 0x7f2b60199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:34570/0 (socket says 172.21.15.8:34570) 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5d400640 1 -- 172.21.15.8:0/298267109 learned_addr learned my addr 172.21.15.8:0/298267109 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.225+0000 7f2b5e800640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b60107060 0x7f2b601a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.226+0000 7f2b5d400640 1 -- 172.21.15.8:0/298267109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b60107060 msgr2=0x7f2b601a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.226+0000 7f2b5d400640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b60107060 0x7f2b601a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.226+0000 7f2b5d400640 1 -- 172.21.15.8:0/298267109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b60101e00 msgr2=0x7f2b601996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.226+0000 7f2b5d400640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b60101e00 0x7f2b601996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.226+0000 7f2b5d400640 1 -- 172.21.15.8:0/298267109 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c009490 con 0x7f2b60104730 2024-03-16T20:57:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.226+0000 7f2b5d400640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b60104730 0x7f2b60199c10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00e9a0 tx=0x7f2b4c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.226+0000 7f2b56a00640 1 -- 172.21.15.8:0/298267109 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00cd80 con 0x7f2b60104730 2024-03-16T20:57:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.226+0000 7f2b56a00640 1 -- 172.21.15.8:0/298267109 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2b4c0035f0 con 0x7f2b60104730 2024-03-16T20:57:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.226+0000 7f2b5f200640 1 -- 172.21.15.8:0/298267109 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b58009900 con 0x7f2b60104730 2024-03-16T20:57:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.226+0000 7f2b56a00640 1 -- 172.21.15.8:0/298267109 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c010690 con 0x7f2b60104730 2024-03-16T20:57:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.226+0000 7f2b5f200640 1 -- 172.21.15.8:0/298267109 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b601a1b50 con 0x7f2b60104730 2024-03-16T20:57:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.227+0000 7f2b5f200640 1 -- 172.21.15.8:0/298267109 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b60108b50 con 0x7f2b60104730 2024-03-16T20:57:51.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.229+0000 7f2b56a00640 1 -- 172.21.15.8:0/298267109 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 23) v1 ==== 136091+0+0 (secure 0 0 0) 0x7f2b4c003b60 con 0x7f2b60104730 2024-03-16T20:57:51.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.231+0000 7f2b56a00640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2b440a1810 0x7f2b440a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:51.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.231+0000 7f2b56a00640 1 -- 172.21.15.8:0/298267109 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2b4c014070 con 0x7f2b60104730 2024-03-16T20:57:51.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.231+0000 7f2b5de00640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2b440a1810 0x7f2b440a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:51.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.232+0000 7f2b5de00640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2b440a1810 0x7f2b440a3cd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000bbe0 tx=0x7f2b5000b390 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.235+0000 7f2b56a00640 1 -- 172.21.15.8:0/298267109 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2b4c096960 con 0x7f2b60104730 2024-03-16T20:57:51.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.376+0000 7f2b56a00640 1 -- 172.21.15.8:0/298267109 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mgrmap(e 24) v1 ==== 136398+0+0 (secure 0 0 0) 0x7f2b4c096d30 con 0x7f2b60104730 2024-03-16T20:57:51.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.477+0000 7f2b5f200640 1 -- 172.21.15.8:0/298267109 --> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b6002d070 con 0x7f2b440a1810 2024-03-16T20:57:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.490+0000 7f2b56a00640 1 -- 172.21.15.8:0/298267109 <== mgr.15240 v2:172.21.15.8:6800/4227086558 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+298 (secure 0 0 0) 0x7f2b6002d070 con 0x7f2b440a1810 2024-03-16T20:57:51.495 INFO:teuthology.orchestra.run.smithi008.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-03-16T00:00:00", "created": "2024-03-16T20:57:50", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-03-16T20:57:51.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 -- 172.21.15.8:0/298267109 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2b440a1810 msgr2=0x7f2b440a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2b440a1810 0x7f2b440a3cd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000bbe0 tx=0x7f2b5000b390 comp rx=0 tx=0).stop 2024-03-16T20:57:51.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 -- 172.21.15.8:0/298267109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b60104730 msgr2=0x7f2b60199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b60104730 0x7f2b60199c10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00e9a0 tx=0x7f2b4c00ee60 comp rx=0 tx=0).stop 2024-03-16T20:57:51.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 -- 172.21.15.8:0/298267109 shutdown_connections 2024-03-16T20:57:51.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2b440a1810 0x7f2b440a3cd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b60107060 0x7f2b601a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b60104730 0x7f2b60199c10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 --2- 172.21.15.8:0/298267109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b60101e00 0x7f2b601996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 -- 172.21.15.8:0/298267109 >> 172.21.15.8:0/298267109 conn(0x7f2b600fb7f0 msgr2=0x7f2b60101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:51.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 -- 172.21.15.8:0/298267109 shutdown_connections 2024-03-16T20:57:51.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.493+0000 7f2b5f200640 1 -- 172.21.15.8:0/298267109 wait complete. 2024-03-16T20:57:51.516 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-03-16T20:57:51.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:51 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:51.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:51 smithi008 ceph-mon[31434]: mgrmap e23: x(active, since 1.07161s), standbys: z, y 2024-03-16T20:57:51.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:51 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:51.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:51 smithi008 ceph-mon[31434]: [16/Mar/2024:20:57:50] ENGINE Bus STARTING 2024-03-16T20:57:51.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:51 smithi008 ceph-mon[31434]: [16/Mar/2024:20:57:50] ENGINE Serving on https://172.21.15.8:7150 2024-03-16T20:57:51.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:51 smithi008 ceph-mon[31434]: [16/Mar/2024:20:57:50] ENGINE Serving on http://172.21.15.8:8765 2024-03-16T20:57:51.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:51 smithi008 ceph-mon[31434]: [16/Mar/2024:20:57:50] ENGINE Bus STARTED 2024-03-16T20:57:51.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:51 smithi008 ceph-mon[31434]: from='client.25426 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:51.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:51 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:51.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:51 smithi170 ceph-mon[35947]: mgrmap e23: x(active, since 1.07161s), standbys: z, y 2024-03-16T20:57:51.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:51 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:51.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:51 smithi170 ceph-mon[35947]: [16/Mar/2024:20:57:50] ENGINE Bus STARTING 2024-03-16T20:57:51.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:51 smithi170 ceph-mon[35947]: [16/Mar/2024:20:57:50] ENGINE Serving on https://172.21.15.8:7150 2024-03-16T20:57:51.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:51 smithi170 ceph-mon[35947]: [16/Mar/2024:20:57:50] ENGINE Serving on http://172.21.15.8:8765 2024-03-16T20:57:51.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:51 smithi170 ceph-mon[35947]: [16/Mar/2024:20:57:50] ENGINE Bus STARTED 2024-03-16T20:57:51.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:51 smithi170 ceph-mon[35947]: from='client.25426 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:51.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:51 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:51.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:51 smithi186 ceph-mon[36391]: mgrmap e23: x(active, since 1.07161s), standbys: z, y 2024-03-16T20:57:51.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:51 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:51.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:51 smithi186 ceph-mon[36391]: [16/Mar/2024:20:57:50] ENGINE Bus STARTING 2024-03-16T20:57:51.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:51 smithi186 ceph-mon[36391]: [16/Mar/2024:20:57:50] ENGINE Serving on https://172.21.15.8:7150 2024-03-16T20:57:51.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:51 smithi186 ceph-mon[36391]: [16/Mar/2024:20:57:50] ENGINE Serving on http://172.21.15.8:8765 2024-03-16T20:57:51.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:51 smithi186 ceph-mon[36391]: [16/Mar/2024:20:57:50] ENGINE Bus STARTED 2024-03-16T20:57:51.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:51 smithi186 ceph-mon[36391]: from='client.25426 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:51.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.708+0000 7fdd32c00640 1 -- 172.21.15.8:0/2619268902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c100420 msgr2=0x7fdd2c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.708+0000 7fdd32c00640 1 --2- 172.21.15.8:0/2619268902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c100420 0x7fdd2c100840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009900 tx=0x7fdd1c02bc50 comp rx=0 tx=0).stop 2024-03-16T20:57:51.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.708+0000 7fdd32c00640 1 -- 172.21.15.8:0/2619268902 shutdown_connections 2024-03-16T20:57:51.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.708+0000 7fdd32c00640 1 --2- 172.21.15.8:0/2619268902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c101fd0 0x7fdd2c108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.708+0000 7fdd32c00640 1 --2- 172.21.15.8:0/2619268902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd2c101610 0x7fdd2c101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.708+0000 7fdd32c00640 1 --2- 172.21.15.8:0/2619268902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c100420 0x7fdd2c100840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.708+0000 7fdd32c00640 1 -- 172.21.15.8:0/2619268902 >> 172.21.15.8:0/2619268902 conn(0x7fdd2c0fb9b0 msgr2=0x7fdd2c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:51.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.708+0000 7fdd32c00640 1 -- 172.21.15.8:0/2619268902 shutdown_connections 2024-03-16T20:57:51.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.709+0000 7fdd32c00640 1 -- 172.21.15.8:0/2619268902 wait complete. 2024-03-16T20:57:51.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.709+0000 7fdd32c00640 1 Processor -- start 2024-03-16T20:57:51.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd32c00640 1 -- start start 2024-03-16T20:57:51.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd32c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c100420 0x7fdd2c1975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:51.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd32c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd2c101610 0x7fdd2c197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:51.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd32c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c101fd0 0x7fdd2c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:51.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd32c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c19f0b0 con 0x7fdd2c101610 2024-03-16T20:57:51.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd32c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c19f220 con 0x7fdd2c101fd0 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd32c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c19f3e0 con 0x7fdd2c100420 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd2be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c100420 0x7fdd2c1975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd2be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c100420 0x7fdd2c1975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:34612/0 (socket says 172.21.15.8:34612) 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd2be00640 1 -- 172.21.15.8:0/3411749424 learned_addr learned my addr 172.21.15.8:0/3411749424 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd2b400640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd2c101610 0x7fdd2c197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.710+0000 7fdd30c00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c101fd0 0x7fdd2c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.711+0000 7fdd2be00640 1 -- 172.21.15.8:0/3411749424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c101fd0 msgr2=0x7fdd2c19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.711+0000 7fdd2be00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c101fd0 0x7fdd2c19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.711+0000 7fdd2be00640 1 -- 172.21.15.8:0/3411749424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd2c101610 msgr2=0x7fdd2c197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.711+0000 7fdd2be00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd2c101610 0x7fdd2c197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.711+0000 7fdd2be00640 1 -- 172.21.15.8:0/3411749424 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c009560 con 0x7fdd2c100420 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.711+0000 7fdd30c00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c101fd0 0x7fdd2c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:57:51.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.711+0000 7fdd2be00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c100420 0x7fdd2c1975c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c02ce80 tx=0x7fdd1c005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:51.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.711+0000 7fdd28c00640 1 -- 172.21.15.8:0/3411749424 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c004e10 con 0x7fdd2c100420 2024-03-16T20:57:51.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.712+0000 7fdd28c00640 1 -- 172.21.15.8:0/3411749424 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fdd1c005470 con 0x7fdd2c100420 2024-03-16T20:57:51.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.712+0000 7fdd28c00640 1 -- 172.21.15.8:0/3411749424 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c034440 con 0x7fdd2c100420 2024-03-16T20:57:51.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.712+0000 7fdd32c00640 1 -- 172.21.15.8:0/3411749424 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2c19f660 con 0x7fdd2c100420 2024-03-16T20:57:51.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.712+0000 7fdd32c00640 1 -- 172.21.15.8:0/3411749424 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2c19fb10 con 0x7fdd2c100420 2024-03-16T20:57:51.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.713+0000 7fdd32c00640 1 -- 172.21.15.8:0/3411749424 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2c10bf50 con 0x7fdd2c100420 2024-03-16T20:57:51.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.715+0000 7fdd28c00640 1 -- 172.21.15.8:0/3411749424 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 24) v1 ==== 136398+0+0 (secure 0 0 0) 0x7fdd1c0036f0 con 0x7fdd2c100420 2024-03-16T20:57:51.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.716+0000 7fdd28c00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdd0c0a1c40 0x7fdd0c0a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:57:51.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.716+0000 7fdd28c00640 1 -- 172.21.15.8:0/3411749424 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdd1c0ef950 con 0x7fdd2c100420 2024-03-16T20:57:51.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.717+0000 7fdd2b400640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdd0c0a1c40 0x7fdd0c0a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:57:51.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.717+0000 7fdd2b400640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdd0c0a1c40 0x7fdd0c0a4100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c198ad0 tx=0x7fdd14005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:57:51.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.723+0000 7fdd28c00640 1 -- 172.21.15.8:0/3411749424 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fdd1c0b89b0 con 0x7fdd2c100420 2024-03-16T20:57:51.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.962+0000 7fdd32c00640 1 -- 172.21.15.8:0/3411749424 --> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fdd2c06a3a0 con 0x7fdd0c0a1c40 2024-03-16T20:57:51.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.972+0000 7fdd28c00640 1 -- 172.21.15.8:0/3411749424 <== mgr.15240 v2:172.21.15.8:6800/4227086558 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fdd2c06a3a0 con 0x7fdd0c0a1c40 2024-03-16T20:57:51.977 INFO:teuthology.orchestra.run.smithi008.stdout:/ 1m 6m3h 2024-03-16T20:57:51.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.975+0000 7fdd32c00640 1 -- 172.21.15.8:0/3411749424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdd0c0a1c40 msgr2=0x7fdd0c0a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.975+0000 7fdd32c00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdd0c0a1c40 0x7fdd0c0a4100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c198ad0 tx=0x7fdd14005f90 comp rx=0 tx=0).stop 2024-03-16T20:57:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.975+0000 7fdd32c00640 1 -- 172.21.15.8:0/3411749424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c100420 msgr2=0x7fdd2c1975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:57:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.975+0000 7fdd32c00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c100420 0x7fdd2c1975c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c02ce80 tx=0x7fdd1c005dc0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.975+0000 7fdd32c00640 1 -- 172.21.15.8:0/3411749424 shutdown_connections 2024-03-16T20:57:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.975+0000 7fdd32c00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdd0c0a1c40 0x7fdd0c0a4100 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.975+0000 7fdd32c00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c101fd0 0x7fdd2c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.975+0000 7fdd32c00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd2c101610 0x7fdd2c197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.975+0000 7fdd32c00640 1 --2- 172.21.15.8:0/3411749424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c100420 0x7fdd2c1975c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:57:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.975+0000 7fdd32c00640 1 -- 172.21.15.8:0/3411749424 >> 172.21.15.8:0/3411749424 conn(0x7fdd2c0fb9b0 msgr2=0x7fdd2c069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:57:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.976+0000 7fdd32c00640 1 -- 172.21.15.8:0/3411749424 shutdown_connections 2024-03-16T20:57:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:57:51.976+0000 7fdd32c00640 1 -- 172.21.15.8:0/3411749424 wait complete. 2024-03-16T20:57:51.997 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-03-16T20:57:52.075 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-03-16T20:57:52.085 INFO:teuthology.run_tasks:Running task background_exec... 2024-03-16T20:57:52.124 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2024-03-16T20:57:52.125 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-03-16T20:57:52.131 INFO:teuthology.run_tasks:Running task workunit... 2024-03-16T20:57:52.160 INFO:tasks.workunit:Pulling workunits from ref aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:57:52.161 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-16T20:57:52.161 INFO:tasks.workunit:timeout=3h 2024-03-16T20:57:52.161 INFO:tasks.workunit:cleanup=True 2024-03-16T20:57:52.161 DEBUG:teuthology.orchestra.run.smithi008:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi008.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 76h/118d Inode: 1099511628283 Links: 2 2024-03-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T20:57:52.203 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-16T20:57:52.204 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-03-16 20:55:12.431302986 +0000 2024-03-16T20:57:52.204 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-03-16 20:55:12.431302986 +0000 2024-03-16T20:57:52.204 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-03-16 20:57:28.196404863 +0000 2024-03-16T20:57:52.204 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-03-16 20:55:12.431302986 +0000 2024-03-16T20:57:52.204 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-16T20:57:52.204 DEBUG:teuthology.orchestra.run.smithi008:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-16T20:57:52.329 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T20:57:52.375 INFO:tasks.workunit.client.0.smithi008.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-16T20:57:52.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:52 smithi170 ceph-mon[35947]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:57:52.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:52 smithi170 ceph-mon[35947]: mgrmap e24: x(active, since 2s), standbys: z, y 2024-03-16T20:57:52.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:52 smithi170 ceph-mon[35947]: from='client.25432 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:52.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:52 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:52.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:52 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:52.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:52 smithi170 ceph-mon[35947]: from='client.25444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:52.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:52 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:52.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:52 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:52.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:52 smithi186 ceph-mon[36391]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:57:52.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:52 smithi186 ceph-mon[36391]: mgrmap e24: x(active, since 2s), standbys: z, y 2024-03-16T20:57:52.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:52 smithi186 ceph-mon[36391]: from='client.25432 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:52.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:52 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:52.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:52 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:52.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:52 smithi186 ceph-mon[36391]: from='client.25444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:52.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:52 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:52.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:52 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:52.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:52 smithi008 ceph-mon[31434]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:57:52.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:52 smithi008 ceph-mon[31434]: mgrmap e24: x(active, since 2s), standbys: z, y 2024-03-16T20:57:52.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:52 smithi008 ceph-mon[31434]: from='client.25432 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:52.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:52 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:52.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:52 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:52.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:52 smithi008 ceph-mon[31434]: from='client.25444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T20:57:52.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:52 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:52.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:52 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi170 to 174.1M 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: Unable to set osd_memory_target on smithi170 to 182637772: error parsing value: Value '182637772' is below minimum 939524096 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:53 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi170 to 174.1M 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: Unable to set osd_memory_target on smithi170 to 182637772: error parsing value: Value '182637772' is below minimum 939524096 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:53 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi170 to 174.1M 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: Unable to set osd_memory_target on smithi170 to 182637772: error parsing value: Value '182637772' is below minimum 939524096 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T20:57:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:53.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:53.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:53 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:57:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi186 to 174.1M 2024-03-16T20:57:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: Unable to set osd_memory_target on smithi186 to 182634905: error parsing value: Value '182634905' is below minimum 939524096 2024-03-16T20:57:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: mgrmap e25: x(active, since 4s), standbys: z, y 2024-03-16T20:57:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:57:55.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:54 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:57:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:57:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi186 to 174.1M 2024-03-16T20:57:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: Unable to set osd_memory_target on smithi186 to 182634905: error parsing value: Value '182634905' is below minimum 939524096 2024-03-16T20:57:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: mgrmap e25: x(active, since 4s), standbys: z, y 2024-03-16T20:57:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:57:55.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:54 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:57:55.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:57:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi186 to 174.1M 2024-03-16T20:57:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: Unable to set osd_memory_target on smithi186 to 182634905: error parsing value: Value '182634905' is below minimum 939524096 2024-03-16T20:57:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: mgrmap e25: x(active, since 4s), standbys: z, y 2024-03-16T20:57:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T20:57:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:57:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:54 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:57:56.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:55 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi008 to 177.8M 2024-03-16T20:57:56.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:55 smithi170 ceph-mon[35947]: Unable to set osd_memory_target on smithi008 to 186497740: error parsing value: Value '186497740' is below minimum 939524096 2024-03-16T20:57:56.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:55 smithi170 ceph-mon[35947]: Updating smithi008:/etc/ceph/ceph.conf 2024-03-16T20:57:56.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:55 smithi170 ceph-mon[35947]: Updating smithi170:/etc/ceph/ceph.conf 2024-03-16T20:57:56.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:55 smithi170 ceph-mon[35947]: Updating smithi186:/etc/ceph/ceph.conf 2024-03-16T20:57:56.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:55 smithi170 ceph-mon[35947]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:57:56.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:55 smithi170 ceph-mon[35947]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:57:56.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:55 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi008 to 177.8M 2024-03-16T20:57:56.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:55 smithi186 ceph-mon[36391]: Unable to set osd_memory_target on smithi008 to 186497740: error parsing value: Value '186497740' is below minimum 939524096 2024-03-16T20:57:56.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:55 smithi186 ceph-mon[36391]: Updating smithi008:/etc/ceph/ceph.conf 2024-03-16T20:57:56.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:55 smithi186 ceph-mon[36391]: Updating smithi170:/etc/ceph/ceph.conf 2024-03-16T20:57:56.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:55 smithi186 ceph-mon[36391]: Updating smithi186:/etc/ceph/ceph.conf 2024-03-16T20:57:56.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:55 smithi186 ceph-mon[36391]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:57:56.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:55 smithi186 ceph-mon[36391]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:57:56.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:55 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi008 to 177.8M 2024-03-16T20:57:56.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:55 smithi008 ceph-mon[31434]: Unable to set osd_memory_target on smithi008 to 186497740: error parsing value: Value '186497740' is below minimum 939524096 2024-03-16T20:57:56.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:55 smithi008 ceph-mon[31434]: Updating smithi008:/etc/ceph/ceph.conf 2024-03-16T20:57:56.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:55 smithi008 ceph-mon[31434]: Updating smithi170:/etc/ceph/ceph.conf 2024-03-16T20:57:56.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:55 smithi008 ceph-mon[31434]: Updating smithi186:/etc/ceph/ceph.conf 2024-03-16T20:57:56.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:55 smithi008 ceph-mon[31434]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:57:56.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:55 smithi008 ceph-mon[31434]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:57:57.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:56 smithi170 ceph-mon[35947]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:57:57.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:56 smithi170 ceph-mon[35947]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:57:57.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:56 smithi170 ceph-mon[35947]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:57:57.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:56 smithi170 ceph-mon[35947]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:57:57.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:56 smithi170 ceph-mon[35947]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:57:57.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:56 smithi170 ceph-mon[35947]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:57:57.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:56 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:57.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:56 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:57.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:56 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:57.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:56 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:57.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:56 smithi186 ceph-mon[36391]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:57:57.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:56 smithi186 ceph-mon[36391]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:57:57.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:56 smithi186 ceph-mon[36391]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:57:57.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:56 smithi186 ceph-mon[36391]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:57:57.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:56 smithi186 ceph-mon[36391]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:57:57.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:56 smithi186 ceph-mon[36391]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:57:57.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:56 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:57.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:56 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:57.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:56 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:57.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:56 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:57.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:56 smithi008 ceph-mon[31434]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T20:57:57.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:57 smithi008 ceph-mon[31434]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:57:57.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:57 smithi008 ceph-mon[31434]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:57:57.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:57 smithi008 ceph-mon[31434]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T20:57:57.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:57 smithi008 ceph-mon[31434]: Updating smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:57:57.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:57 smithi008 ceph-mon[31434]: Updating smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:57:57.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:57 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:57.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:57 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:57.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:57 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:57.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:57 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:58.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:58 smithi170 ceph-mon[35947]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:57:58.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:58 smithi170 ceph-mon[35947]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:57:58.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:58 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:58.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:58 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:58.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:58 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:58.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:58 smithi186 ceph-mon[36391]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:57:58.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:58 smithi186 ceph-mon[36391]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:57:58.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:58 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:58.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:58 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:58.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:58 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:58.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:58 smithi008 ceph-mon[31434]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2024-03-16T20:57:58.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:58 smithi008 ceph-mon[31434]: Updating smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T20:57:58.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:58 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:58.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:58 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:58.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:58 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:59.077 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:59 smithi008 ceph-mon[31434]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-03-16T20:57:59.078 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:59 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:59.078 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:59 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:57:59.078 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:59 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:57:59.078 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:57:59 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:59.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:59 smithi170 ceph-mon[35947]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-03-16T20:57:59.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:59 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:59.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:59 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:57:59.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:59 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:57:59.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:57:59 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:57:59.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:59 smithi186 ceph-mon[36391]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-03-16T20:57:59.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:59 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:57:59.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:59 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:57:59.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:59 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:57:59.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:57:59 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:58:00.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:58:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:58:00.033+0000 7fbeefa00700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:58:00.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:58:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:58:00.033+0000 7fbeefa00700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:58:00.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:58:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:58:00.033+0000 7fbeefa00700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:58:00.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:58:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:58:00.033+0000 7fbeefa00700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:58:00.496 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 20:58:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T20:58:00.033+0000 7fbeefa00700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T20:58:01.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:01 smithi170 ceph-mon[35947]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-03-16T20:58:01.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:01 smithi186 ceph-mon[36391]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-03-16T20:58:01.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:01 smithi008 ceph-mon[31434]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-03-16T20:58:03.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:03 smithi170 ceph-mon[35947]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 109 KiB/s wr, 68 op/s 2024-03-16T20:58:03.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:03 smithi170 ceph-mon[35947]: mgrmap e26: x(active, since 12s), standbys: z, y 2024-03-16T20:58:03.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:03 smithi186 ceph-mon[36391]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 109 KiB/s wr, 68 op/s 2024-03-16T20:58:03.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:03 smithi186 ceph-mon[36391]: mgrmap e26: x(active, since 12s), standbys: z, y 2024-03-16T20:58:03.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:03 smithi008 ceph-mon[31434]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 109 KiB/s wr, 68 op/s 2024-03-16T20:58:03.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:03 smithi008 ceph-mon[31434]: mgrmap e26: x(active, since 12s), standbys: z, y 2024-03-16T20:58:05.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:05 smithi170 ceph-mon[35947]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 99 KiB/s wr, 62 op/s 2024-03-16T20:58:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.380+0000 7f811e400640 1 -- 172.21.15.8:0/1870735189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f811810dad0 msgr2=0x7f811810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.380+0000 7f811e400640 1 --2- 172.21.15.8:0/1870735189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f811810dad0 0x7f811810deb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8108009ca0 tx=0x7f810802c100 comp rx=0 tx=0).stop 2024-03-16T20:58:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.380+0000 7f811e400640 1 -- 172.21.15.8:0/1870735189 shutdown_connections 2024-03-16T20:58:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.380+0000 7f811e400640 1 --2- 172.21.15.8:0/1870735189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8118108480 0x7f8118114990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.380+0000 7f811e400640 1 --2- 172.21.15.8:0/1870735189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8118107ac0 0x7f8118107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.380+0000 7f811e400640 1 --2- 172.21.15.8:0/1870735189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f811810dad0 0x7f811810deb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.380+0000 7f811e400640 1 -- 172.21.15.8:0/1870735189 >> 172.21.15.8:0/1870735189 conn(0x7f8118075a60 msgr2=0x7f8118077e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.380+0000 7f811e400640 1 -- 172.21.15.8:0/1870735189 shutdown_connections 2024-03-16T20:58:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.380+0000 7f811e400640 1 -- 172.21.15.8:0/1870735189 wait complete. 2024-03-16T20:58:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.381+0000 7f811e400640 1 Processor -- start 2024-03-16T20:58:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.382+0000 7f811e400640 1 -- start start 2024-03-16T20:58:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.382+0000 7f811e400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8118107ac0 0x7f811819e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.382+0000 7f811e400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8118108480 0x7f811819e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.382+0000 7f811e400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f811810dad0 0x7f81181a29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.382+0000 7f811e400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81181a2ff0 con 0x7f8118108480 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.382+0000 7f811e400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81181a3160 con 0x7f8118107ac0 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.382+0000 7f811e400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81181a3320 con 0x7f811810dad0 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.382+0000 7f8117400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8118107ac0 0x7f811819e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.383+0000 7f8117400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8118107ac0 0x7f811819e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:40506/0 (socket says 172.21.15.8:40506) 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.383+0000 7f8117400640 1 -- 172.21.15.8:0/3537886699 learned_addr learned my addr 172.21.15.8:0/3537886699 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.383+0000 7f8117e00640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f811810dad0 0x7f81181a29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.383+0000 7f810ea00640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8118108480 0x7f811819e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.383+0000 7f8117400640 1 -- 172.21.15.8:0/3537886699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f811810dad0 msgr2=0x7f81181a29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.383+0000 7f8117400640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f811810dad0 0x7f81181a29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.383+0000 7f8117400640 1 -- 172.21.15.8:0/3537886699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8118108480 msgr2=0x7f811819e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.383+0000 7f8117400640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8118108480 0x7f811819e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.383+0000 7f8117400640 1 -- 172.21.15.8:0/3537886699 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8108009900 con 0x7f8118107ac0 2024-03-16T20:58:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.383+0000 7f810ea00640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8118108480 0x7f811819e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.383+0000 7f8117400640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8118107ac0 0x7f811819e130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8108005e30 tx=0x7f81080329e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.384+0000 7f8114c00640 1 -- 172.21.15.8:0/3537886699 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108034650 con 0x7f8118107ac0 2024-03-16T20:58:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.384+0000 7f8114c00640 1 -- 172.21.15.8:0/3537886699 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8108003e70 con 0x7f8118107ac0 2024-03-16T20:58:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.384+0000 7f8114c00640 1 -- 172.21.15.8:0/3537886699 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810803f440 con 0x7f8118107ac0 2024-03-16T20:58:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.384+0000 7f811e400640 1 -- 172.21.15.8:0/3537886699 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81181a35a0 con 0x7f8118107ac0 2024-03-16T20:58:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.384+0000 7f811e400640 1 -- 172.21.15.8:0/3537886699 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81181aaca0 con 0x7f8118107ac0 2024-03-16T20:58:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.387+0000 7f8121184740 1 Processor -- start 2024-03-16T20:58:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.387+0000 7f8121184740 1 -- start start 2024-03-16T20:58:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.387+0000 7f8114c00640 1 -- 172.21.15.8:0/3537886699 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f810803b040 con 0x7f8118107ac0 2024-03-16T20:58:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8121184740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8121184740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728ccdb0 0x559d728cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8121184740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728d6330 0x559d728d8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8121184740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d72888620 con 0x559d728ccdb0 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8121184740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d7283a8c0 con 0x559d728d6330 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8121184740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d72837df0 con 0x559d728cdb20 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8117400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728ccdb0 0x559d728cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8117e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8117e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40018/0 (socket says 172.21.15.8:40018) 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8117e00640 1 -- 172.21.15.8:0/2002309592 learned_addr learned my addr 172.21.15.8:0/2002309592 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f810ea00640 1 --2- 172.21.15.8:0/2002309592 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728d6330 0x559d728d8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8117e00640 1 -- 172.21.15.8:0/2002309592 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728d6330 msgr2=0x559d728d8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8117e00640 1 --2- 172.21.15.8:0/2002309592 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728d6330 0x559d728d8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8117e00640 1 -- 172.21.15.8:0/2002309592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728ccdb0 msgr2=0x559d728cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8117e00640 1 --2- 172.21.15.8:0/2002309592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728ccdb0 0x559d728cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.388+0000 7f8117e00640 1 -- 172.21.15.8:0/2002309592 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d727b4b00 con 0x559d728cdb20 2024-03-16T20:58:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.389+0000 7f8117e00640 1 --2- 172.21.15.8:0/2002309592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728cc870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8110009c20 tx=0x7f8110011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaafbaecc375ca22 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.389+0000 7f810cc00640 1 -- 172.21.15.8:0/2002309592 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110019630 con 0x559d728cdb20 2024-03-16T20:58:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.389+0000 7f810cc00640 1 -- 172.21.15.8:0/2002309592 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8110009e90 con 0x559d728cdb20 2024-03-16T20:58:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.389+0000 7f810cc00640 1 -- 172.21.15.8:0/2002309592 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000eb10 con 0x559d728cdb20 2024-03-16T20:58:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.389+0000 7f8114c00640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80fc0a1de0 0x7f80fc0a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.397 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:05 smithi186 ceph-mon[36391]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 99 KiB/s wr, 62 op/s 2024-03-16T20:58:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8114c00640 1 -- 172.21.15.8:0/3537886699 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f81080f0360 con 0x7f8118107ac0 2024-03-16T20:58:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8117400640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80fc0a1de0 0x7f80fc0a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8121184740 1 -- 172.21.15.8:0/2002309592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 msgr2=0x559d728cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8121184740 1 --2- 172.21.15.8:0/2002309592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728cc870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8110009c20 tx=0x7f8110011810 comp rx=0 tx=0).stop 2024-03-16T20:58:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8121184740 1 -- 172.21.15.8:0/2002309592 shutdown_connections 2024-03-16T20:58:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8121184740 1 --2- 172.21.15.8:0/2002309592 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728d6330 0x559d728d8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8121184740 1 --2- 172.21.15.8:0/2002309592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728ccdb0 0x559d728cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8121184740 1 --2- 172.21.15.8:0/2002309592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728cc870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8121184740 1 -- 172.21.15.8:0/2002309592 >> 172.21.15.8:0/2002309592 conn(0x559d728944b0 msgr2=0x559d728c7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8121184740 1 -- 172.21.15.8:0/2002309592 shutdown_connections 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8121184740 1 -- 172.21.15.8:0/2002309592 wait complete. 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.390+0000 7f8117400640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80fc0a1de0 0x7f80fc0a42a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f81080eda70 tx=0x7f81080f3db0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.391+0000 7f8121184740 1 -- start start 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.391+0000 7f8121184740 1 Processor -- start 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.391+0000 7f8121184740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728ccdb0 0x559d728d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.391+0000 7f8121184740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.391+0000 7f8121184740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728d6330 0x559d728d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.391+0000 7f8121184740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d728335d0 con 0x559d728d6330 2024-03-16T20:58:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.391+0000 7f8121184740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d727d8b50 con 0x559d728ccdb0 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.391+0000 7f8121184740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d727d87f0 con 0x559d728cdb20 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.391+0000 7f8121184740 10 client.0 _ll_register_callbacks cb 0x559d727ec550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f810ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f8117e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728ccdb0 0x559d728d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f810ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728d38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40030/0 (socket says 172.21.15.8:40030) 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f810ea00640 1 -- 172.21.15.8:0/3525653204 learned_addr learned my addr 172.21.15.8:0/3525653204 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f8117e00640 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728d6330 0x559d728d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f810ea00640 1 -- 172.21.15.8:0/3525653204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728ccdb0 msgr2=0x559d728d33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f810ea00640 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728ccdb0 0x559d728d33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f810ea00640 1 -- 172.21.15.8:0/3525653204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728d6330 msgr2=0x559d728d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f810ea00640 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728d6330 0x559d728d3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f810ea00640 1 -- 172.21.15.8:0/3525653204 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81100098d0 con 0x559d728cdb20 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f8117e00640 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728ccdb0 0x559d728d33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f810ea00640 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728d38f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8100012730 tx=0x7f8100012bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3908f2e490e1e15a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f8105600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.392+0000 7f8105600640 1 -- 172.21.15.8:0/3525653204 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100017070 con 0x559d728cdb20 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.393+0000 7f8105600640 1 -- 172.21.15.8:0/3525653204 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8100004320 con 0x559d728cdb20 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.393+0000 7f8121184740 1 -- 172.21.15.8:0/3525653204 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d72805cd0 con 0x559d728cdb20 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.393+0000 7f8105600640 1 -- 172.21.15.8:0/3525653204 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81000044e0 con 0x559d728cdb20 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.393+0000 7f8121184740 10 client.25462 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.393+0000 7f8121184740 1 -- 172.21.15.8:0/3525653204 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x559d72831c50 con 0x559d728cdb20 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.393+0000 7f8105600640 1 -- 172.21.15.8:0/3525653204 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x559d72805cd0 con 0x559d728cdb20 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.393+0000 7f8105600640 1 -- 172.21.15.8:0/3525653204 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f8100025450 con 0x559d728cdb20 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.393+0000 7f8121184740 10 client.25462 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.393+0000 7f8121184740 10 client.25462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.393+0000 7f8121184740 20 client.25462 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.393+0000 7f8121184740 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559d728e6420 0x559d728e8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.394+0000 7f8121184740 4 client.25462 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.394+0000 7f8121184740 1 -- 172.21.15.8:0/3525653204 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d72829ce0 con 0x559d728e6420 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.394+0000 7f8117e00640 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559d728e6420 0x559d728e8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.394+0000 7f8117e00640 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559d728e6420 0x559d728e8840 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=537d6dc0d16cd907 server_cookie=85d09020683bd0 in_seq=0 out_seq=0 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.394+0000 7f8105600640 10 client.25462 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8105600640 1 -- 172.21.15.8:0/3525653204 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x559d72829ce0 con 0x559d728e6420 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8105600640 10 client.25462 handle_command_reply: tid=0 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8121184740 1 client.25462 shutdown 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8121184740 1 -- 172.21.15.8:0/3525653204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 msgr2=0x559d728d38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8121184740 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728d38f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8100012730 tx=0x7f8100012bf0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8121184740 1 -- 172.21.15.8:0/3525653204 shutdown_connections 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8121184740 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559d728e6420 0x559d728e8840 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8121184740 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728d6330 0x559d728d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8121184740 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728d38f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8121184740 1 --2- 172.21.15.8:0/3525653204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728ccdb0 0x559d728d33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8121184740 1 -- 172.21.15.8:0/3525653204 >> 172.21.15.8:0/3525653204 conn(0x559d728944b0 msgr2=0x559d728c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.395+0000 7f8105600640 0 client.25462 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.396+0000 7f8121184740 1 -- 172.21.15.8:0/3525653204 shutdown_connections 2024-03-16T20:58:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.396+0000 7f8121184740 1 -- 172.21.15.8:0/3525653204 wait complete. 2024-03-16T20:58:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.396+0000 7f8121184740 20 client.25462 trim_cache size 0 max 16384 2024-03-16T20:58:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.411+0000 7f8121184740 1 Processor -- start 2024-03-16T20:58:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.411+0000 7f8121184740 1 -- start start 2024-03-16T20:58:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.411+0000 7f8121184740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728ccdb0 0x559d728d5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.411+0000 7f8121184740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.411+0000 7f8121184740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728d6330 0x559d728e1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.411+0000 7f8121184740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d7257be60 con 0x559d728d6330 2024-03-16T20:58:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.411+0000 7f8121184740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d728cd620 con 0x559d728ccdb0 2024-03-16T20:58:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.411+0000 7f8121184740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d728b96a0 con 0x559d728cdb20 2024-03-16T20:58:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.412+0000 7f810ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.412+0000 7f810ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40032/0 (socket says 172.21.15.8:40032) 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.412+0000 7f810ea00640 1 -- 172.21.15.8:0/1765857300 learned_addr learned my addr 172.21.15.8:0/1765857300 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.412+0000 7f8117e00640 1 --2- 172.21.15.8:0/1765857300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728ccdb0 0x559d728d5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.412+0000 7f8117e00640 1 --2- 172.21.15.8:0/1765857300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728d6330 0x559d728e1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.412+0000 7f810ea00640 1 -- 172.21.15.8:0/1765857300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728ccdb0 msgr2=0x559d728d5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.412+0000 7f810ea00640 1 --2- 172.21.15.8:0/1765857300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728ccdb0 0x559d728d5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.412+0000 7f810ea00640 1 -- 172.21.15.8:0/1765857300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728d6330 msgr2=0x559d728e1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.412+0000 7f810ea00640 1 --2- 172.21.15.8:0/1765857300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728d6330 0x559d728e1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.412+0000 7f810ea00640 1 -- 172.21.15.8:0/1765857300 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d727ce530 con 0x559d728cdb20 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.412+0000 7f8117e00640 1 --2- 172.21.15.8:0/1765857300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728d6330 0x559d728e1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.413+0000 7f810ea00640 1 --2- 172.21.15.8:0/1765857300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728c6bc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8100025860 tx=0x7f8100009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5b3354fda1872c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.413+0000 7f8107e00640 1 -- 172.21.15.8:0/1765857300 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100017040 con 0x559d728cdb20 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.413+0000 7f8107e00640 1 -- 172.21.15.8:0/1765857300 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8100011ea0 con 0x559d728cdb20 2024-03-16T20:58:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.413+0000 7f8107e00640 1 -- 172.21.15.8:0/1765857300 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100003650 con 0x559d728cdb20 2024-03-16T20:58:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.414+0000 7f8121184740 1 -- 172.21.15.8:0/1765857300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 msgr2=0x559d728c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.414+0000 7f8121184740 1 --2- 172.21.15.8:0/1765857300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728c6bc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8100025860 tx=0x7f8100009240 comp rx=0 tx=0).stop 2024-03-16T20:58:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.414+0000 7f8121184740 1 -- 172.21.15.8:0/1765857300 shutdown_connections 2024-03-16T20:58:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.414+0000 7f8121184740 1 --2- 172.21.15.8:0/1765857300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728d6330 0x559d728e1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.414+0000 7f8121184740 1 --2- 172.21.15.8:0/1765857300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728cdb20 0x559d728c6bc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.414+0000 7f8121184740 1 --2- 172.21.15.8:0/1765857300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728ccdb0 0x559d728d5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.414+0000 7f8121184740 1 -- 172.21.15.8:0/1765857300 >> 172.21.15.8:0/1765857300 conn(0x559d728944b0 msgr2=0x559d728c64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.414+0000 7f8121184740 1 -- 172.21.15.8:0/1765857300 shutdown_connections 2024-03-16T20:58:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.414+0000 7f8121184740 1 -- 172.21.15.8:0/1765857300 wait complete. 2024-03-16T20:58:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.414+0000 7f8121184740 1 -- start start 2024-03-16T20:58:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.414+0000 7f8121184740 1 Processor -- start 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f8121184740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728ccdb0 0x559d728d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f8121184740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728cdb20 0x559d728d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f8121184740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728d6330 0x559d728dd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f8121184740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d728dda40 con 0x559d728cdb20 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f8121184740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d728ddb80 con 0x559d728d6330 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f8121184740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d728ddd40 con 0x559d728ccdb0 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f8121184740 10 client.0 _ll_register_callbacks cb 0x7f8100009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f810ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728cdb20 0x559d728d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f8117e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728ccdb0 0x559d728d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f810ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728cdb20 0x559d728d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39234/0 (socket says 172.21.15.8:39234) 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f810ea00640 1 -- 172.21.15.8:0/664483123 learned_addr learned my addr 172.21.15.8:0/664483123 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.415+0000 7f8117e00640 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728d6330 0x559d728dd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f810ea00640 1 -- 172.21.15.8:0/664483123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728ccdb0 msgr2=0x559d728d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f810ea00640 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728ccdb0 0x559d728d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f810ea00640 1 -- 172.21.15.8:0/664483123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728d6330 msgr2=0x559d728dd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f810ea00640 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728d6330 0x559d728dd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f810ea00640 1 -- 172.21.15.8:0/664483123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d72831c50 con 0x559d728cdb20 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f8117e00640 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728d6330 0x559d728dd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f810ea00640 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728cdb20 0x559d728d0980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8100009570 tx=0x7f8100025670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b068fba8b910e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f8105600640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f8105600640 1 -- 172.21.15.8:0/664483123 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100017040 con 0x559d728cdb20 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f8105600640 1 -- 172.21.15.8:0/664483123 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8100000e40 con 0x559d728cdb20 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f8121184740 1 -- 172.21.15.8:0/664483123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d72858d30 con 0x559d728cdb20 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f8105600640 1 -- 172.21.15.8:0/664483123 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8100025b90 con 0x559d728cdb20 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.416+0000 7f8121184740 10 client.15336 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.417+0000 7f8121184740 1 -- 172.21.15.8:0/664483123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x559d727f42c0 con 0x559d728cdb20 2024-03-16T20:58:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.417+0000 7f8105600640 1 -- 172.21.15.8:0/664483123 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x559d72858d30 con 0x559d728cdb20 2024-03-16T20:58:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.417+0000 7f8105600640 1 -- 172.21.15.8:0/664483123 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f810001c420 con 0x559d728cdb20 2024-03-16T20:58:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.417+0000 7f8121184740 10 client.15336 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.417+0000 7f8121184740 10 client.15336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.417+0000 7f8121184740 20 client.15336 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.417+0000 7f8121184740 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559d72942aa0 0x559d72944ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.417+0000 7f8121184740 4 client.15336 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T20:58:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.417+0000 7f8121184740 1 -- 172.21.15.8:0/664483123 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559d72533600 con 0x559d72942aa0 2024-03-16T20:58:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.417+0000 7f8117e00640 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559d72942aa0 0x559d72944ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.418+0000 7f8117e00640 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559d72942aa0 0x559d72944ec0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1666a735013cccf3 server_cookie=e13f7ce69947c750 in_seq=0 out_seq=0 2024-03-16T20:58:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.418+0000 7f8105600640 10 client.15336 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8105600640 1 -- 172.21.15.8:0/664483123 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559d72533600 con 0x559d72942aa0 2024-03-16T20:58:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8105600640 10 client.15336 handle_command_reply: tid=0 2024-03-16T20:58:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 1 client.15336 shutdown 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 1 -- 172.21.15.8:0/664483123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728cdb20 msgr2=0x559d728d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728cdb20 0x559d728d0980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8100009570 tx=0x7f8100025670 comp rx=0 tx=0).stop 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 1 -- 172.21.15.8:0/664483123 shutdown_connections 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559d728d6330 0x559d728dd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559d72942aa0 0x559d72944ec0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559d728cdb20 0x559d728d0980 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 1 --2- 172.21.15.8:0/664483123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559d728ccdb0 0x559d728d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8105600640 0 client.15336 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 1 -- 172.21.15.8:0/664483123 >> 172.21.15.8:0/664483123 conn(0x559d728944b0 msgr2=0x559d728c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 1 -- 172.21.15.8:0/664483123 shutdown_connections 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 1 -- 172.21.15.8:0/664483123 wait complete. 2024-03-16T20:58:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.431+0000 7f8121184740 20 client.15336 trim_cache size 0 max 16384 2024-03-16T20:58:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T20:58:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T20:58:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T20:58:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 -- 172.21.15.8:0/3537886699 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80fc0a1de0 msgr2=0x7f80fc0a42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80fc0a1de0 0x7f80fc0a42a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f81080eda70 tx=0x7f81080f3db0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 -- 172.21.15.8:0/3537886699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8118107ac0 msgr2=0x7f811819e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8118107ac0 0x7f811819e130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8108005e30 tx=0x7f81080329e0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 -- 172.21.15.8:0/3537886699 shutdown_connections 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80fc0a1de0 0x7f80fc0a42a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f811810dad0 0x7f81181a29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8118108480 0x7f811819e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 --2- 172.21.15.8:0/3537886699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8118107ac0 0x7f811819e130 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 -- 172.21.15.8:0/3537886699 >> 172.21.15.8:0/3537886699 conn(0x7f8118075a60 msgr2=0x7f8118075f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 -- 172.21.15.8:0/3537886699 shutdown_connections 2024-03-16T20:58:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:05.432+0000 7f811e400640 1 -- 172.21.15.8:0/3537886699 wait complete. 2024-03-16T20:58:05.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:05 smithi008 ceph-mon[31434]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 99 KiB/s wr, 62 op/s 2024-03-16T20:58:07.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:07 smithi170 ceph-mon[35947]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 99 KiB/s wr, 62 op/s 2024-03-16T20:58:07.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:07 smithi186 ceph-mon[36391]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 99 KiB/s wr, 62 op/s 2024-03-16T20:58:07.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:07 smithi008 ceph-mon[31434]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 99 KiB/s wr, 62 op/s 2024-03-16T20:58:09.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T20:58:09.076 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T20:58:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.319+0000 7fbc23e00640 1 -- 172.21.15.8:0/309649992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc24100100 msgr2=0x7fbc241004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.319+0000 7fbc23e00640 1 --2- 172.21.15.8:0/309649992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc24100100 0x7fbc241004e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c009900 tx=0x7fbc0c02bc40 comp rx=0 tx=0).stop 2024-03-16T20:58:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.320+0000 7fbc23e00640 1 -- 172.21.15.8:0/309649992 shutdown_connections 2024-03-16T20:58:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.320+0000 7fbc23e00640 1 --2- 172.21.15.8:0/309649992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2410dcb0 0x7fbc241100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.320+0000 7fbc23e00640 1 --2- 172.21.15.8:0/309649992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc24100ab0 0x7fbc2410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.320+0000 7fbc23e00640 1 --2- 172.21.15.8:0/309649992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc24100100 0x7fbc241004e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.320+0000 7fbc23e00640 1 -- 172.21.15.8:0/309649992 >> 172.21.15.8:0/309649992 conn(0x7fbc240fbd40 msgr2=0x7fbc240fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:09.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.320+0000 7fbc23e00640 1 -- 172.21.15.8:0/309649992 shutdown_connections 2024-03-16T20:58:09.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.320+0000 7fbc23e00640 1 -- 172.21.15.8:0/309649992 wait complete. 2024-03-16T20:58:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.321+0000 7fbc23e00640 1 Processor -- start 2024-03-16T20:58:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.321+0000 7fbc23e00640 1 -- start start 2024-03-16T20:58:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.321+0000 7fbc23e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc24100100 0x7fbc2419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.321+0000 7fbc23e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc24100ab0 0x7fbc2419ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.321+0000 7fbc23e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2410dcb0 0x7fbc24199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.321+0000 7fbc23e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2419a2a0 con 0x7fbc2410dcb0 2024-03-16T20:58:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.321+0000 7fbc23e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2419a410 con 0x7fbc24100100 2024-03-16T20:58:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.321+0000 7fbc23e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2419a5d0 con 0x7fbc24100ab0 2024-03-16T20:58:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc22a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc24100100 0x7fbc2419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc22a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc24100100 0x7fbc2419fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54462/0 (socket says 172.21.15.8:54462) 2024-03-16T20:58:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc22a00640 1 -- 172.21.15.8:0/466528246 learned_addr learned my addr 172.21.15.8:0/466528246 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc22000640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc24100ab0 0x7fbc2419ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc23400640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2410dcb0 0x7fbc24199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc22a00640 1 -- 172.21.15.8:0/466528246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc24100ab0 msgr2=0x7fbc2419ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc22a00640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc24100ab0 0x7fbc2419ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc22a00640 1 -- 172.21.15.8:0/466528246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2410dcb0 msgr2=0x7fbc24199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc22a00640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2410dcb0 0x7fbc24199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc22a00640 1 -- 172.21.15.8:0/466528246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c009560 con 0x7fbc24100100 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc23400640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2410dcb0 0x7fbc24199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.322+0000 7fbc22a00640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc24100100 0x7fbc2419fa50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c02c250 tx=0x7fbc0c02ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.323+0000 7fbc1b400640 1 -- 172.21.15.8:0/466528246 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c004250 con 0x7fbc24100100 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.323+0000 7fbc1b400640 1 -- 172.21.15.8:0/466528246 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbc0c0043b0 con 0x7fbc24100100 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.323+0000 7fbc1b400640 1 -- 172.21.15.8:0/466528246 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c003c50 con 0x7fbc24100100 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.323+0000 7fbc23e00640 1 -- 172.21.15.8:0/466528246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2419a850 con 0x7fbc24100100 2024-03-16T20:58:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.323+0000 7fbc23e00640 1 -- 172.21.15.8:0/466528246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc241a69d0 con 0x7fbc24100100 2024-03-16T20:58:09.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.326+0000 7fbc1b400640 1 -- 172.21.15.8:0/466528246 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7fbc0c004e10 con 0x7fbc24100100 2024-03-16T20:58:09.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.326+0000 7fbc2ca21740 1 Processor -- start 2024-03-16T20:58:09.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.326+0000 7fbc2ca21740 1 -- start start 2024-03-16T20:58:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621770ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 0x560621771910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 0x56062177cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606216e0150 con 0x560621772170 2024-03-16T20:58:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606216dd680 con 0x560621771490 2024-03-16T20:58:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606216d8e60 con 0x56062177a800 2024-03-16T20:58:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc22a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 0x560621771910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc22000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 0x56062177cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc23400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621770ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc22000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 0x56062177cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39914/0 (socket says 172.21.15.8:39914) 2024-03-16T20:58:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc22000640 1 -- 172.21.15.8:0/1761980415 learned_addr learned my addr 172.21.15.8:0/1761980415 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc22000640 1 -- 172.21.15.8:0/1761980415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 msgr2=0x560621771910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc22000640 1 --2- 172.21.15.8:0/1761980415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 0x560621771910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc22000640 1 -- 172.21.15.8:0/1761980415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 msgr2=0x560621770ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc22000640 1 --2- 172.21.15.8:0/1761980415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621770ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.327+0000 7fbc22000640 1 -- 172.21.15.8:0/1761980415 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560621692060 con 0x56062177a800 2024-03-16T20:58:09.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.328+0000 7fbc22000640 1 --2- 172.21.15.8:0/1761980415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 0x56062177cbf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009ca0 tx=0x7fbc14011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cff2f0a16d76ef0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:09.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.328+0000 7fbc1b400640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbc080a1d40 0x7fbc080a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.328+0000 7fbc13e00640 1 -- 172.21.15.8:0/1761980415 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14019630 con 0x56062177a800 2024-03-16T20:58:09.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.328+0000 7fbc13e00640 1 -- 172.21.15.8:0/1761980415 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbc14019c90 con 0x56062177a800 2024-03-16T20:58:09.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.328+0000 7fbc13e00640 1 -- 172.21.15.8:0/1761980415 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1400eba0 con 0x56062177a800 2024-03-16T20:58:09.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.328+0000 7fbc1b400640 1 -- 172.21.15.8:0/466528246 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbc0c0f0100 con 0x7fbc24100100 2024-03-16T20:58:09.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.328+0000 7fbc23400640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbc080a1d40 0x7fbc080a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.329+0000 7fbc2ca21740 1 -- 172.21.15.8:0/1761980415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 msgr2=0x56062177cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.329+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/1761980415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 0x56062177cbf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009ca0 tx=0x7fbc14011810 comp rx=0 tx=0).stop 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.329+0000 7fbc2ca21740 1 -- 172.21.15.8:0/1761980415 shutdown_connections 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.329+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/1761980415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 0x56062177cbf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.329+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/1761980415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 0x560621771910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.329+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/1761980415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621770ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.329+0000 7fbc2ca21740 1 -- 172.21.15.8:0/1761980415 >> 172.21.15.8:0/1761980415 conn(0x5606217385a0 msgr2=0x56062176bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.329+0000 7fbc23400640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbc080a1d40 0x7fbc080a4200 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbc241022e0 tx=0x7fbc1c009820 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.329+0000 7fbc2ca21740 1 -- 172.21.15.8:0/1761980415 shutdown_connections 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.329+0000 7fbc2ca21740 1 -- 172.21.15.8:0/1761980415 wait complete. 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.329+0000 7fbc2ca21740 1 -- start start 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.330+0000 7fbc2ca21740 1 Processor -- start 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.330+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x5606217777e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.330+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621777d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.330+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56062177a800 0x560621778260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.330+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56062167dec0 con 0x560621772170 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.330+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56062167db60 con 0x56062177a800 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.330+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606214471c0 con 0x560621771490 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.330+0000 7fbc2ca21740 10 client.0 _ll_register_callbacks cb 0x560621691960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc22a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x5606217777e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc22a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x5606217777e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39916/0 (socket says 172.21.15.8:39916) 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc22a00640 1 -- 172.21.15.8:0/4102976662 learned_addr learned my addr 172.21.15.8:0/4102976662 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc22000640 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621777d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc23400640 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56062177a800 0x560621778260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc22a00640 1 -- 172.21.15.8:0/4102976662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56062177a800 msgr2=0x560621778260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc22a00640 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56062177a800 0x560621778260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc22a00640 1 -- 172.21.15.8:0/4102976662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 msgr2=0x560621777d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc22a00640 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621777d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc22a00640 1 -- 172.21.15.8:0/4102976662 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc140098d0 con 0x560621771490 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc23400640 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56062177a800 0x560621778260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:09.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc22a00640 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x5606217777e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0bc8c0 tx=0x7fbc0c005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a05f5f49a956d970 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:09.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.331+0000 7fbc10c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:09.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc10c00640 1 -- 172.21.15.8:0/4102976662 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c0bc990 con 0x560621771490 2024-03-16T20:58:09.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc10c00640 1 -- 172.21.15.8:0/4102976662 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbc0c0bd2c0 con 0x560621771490 2024-03-16T20:58:09.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc2ca21740 1 -- 172.21.15.8:0/4102976662 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606213d87e0 con 0x560621771490 2024-03-16T20:58:09.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc10c00640 1 -- 172.21.15.8:0/4102976662 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc0c0bc700 con 0x560621771490 2024-03-16T20:58:09.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc2ca21740 10 client.25480 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:09.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc2ca21740 1 -- 172.21.15.8:0/4102976662 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5606216d74e0 con 0x560621771490 2024-03-16T20:58:09.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc10c00640 1 -- 172.21.15.8:0/4102976662 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5606213d87e0 con 0x560621771490 2024-03-16T20:58:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc10c00640 1 -- 172.21.15.8:0/4102976662 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fbc0c03c070 con 0x560621771490 2024-03-16T20:58:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc2ca21740 10 client.25480 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc2ca21740 10 client.25480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc2ca21740 20 client.25480 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56062178a710 0x56062178cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc2ca21740 4 client.25480 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.332+0000 7fbc2ca21740 1 -- 172.21.15.8:0/4102976662 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560621415720 con 0x56062178a710 2024-03-16T20:58:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.333+0000 7fbc22000640 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56062178a710 0x56062178cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.333+0000 7fbc22000640 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56062178a710 0x56062178cb00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45960f4fe7376974 server_cookie=95b75b6d1acb999f in_seq=0 out_seq=0 2024-03-16T20:58:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.333+0000 7fbc10c00640 10 client.25480 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:09.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc10c00640 1 -- 172.21.15.8:0/4102976662 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560621415720 con 0x56062178a710 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc10c00640 10 client.25480 handle_command_reply: tid=0 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc2ca21740 1 client.25480 shutdown 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc2ca21740 1 -- 172.21.15.8:0/4102976662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 msgr2=0x5606217777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x5606217777e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0bc8c0 tx=0x7fbc0c005bd0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc2ca21740 1 -- 172.21.15.8:0/4102976662 shutdown_connections 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56062177a800 0x560621778260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56062178a710 0x56062178cb00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621777d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/4102976662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x5606217777e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc10c00640 0 client.25480 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc2ca21740 1 -- 172.21.15.8:0/4102976662 >> 172.21.15.8:0/4102976662 conn(0x5606217385a0 msgr2=0x56062176dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.334+0000 7fbc2ca21740 1 -- 172.21.15.8:0/4102976662 shutdown_connections 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.335+0000 7fbc2ca21740 1 -- 172.21.15.8:0/4102976662 wait complete. 2024-03-16T20:58:09.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.335+0000 7fbc2ca21740 20 client.25480 trim_cache size 0 max 16384 2024-03-16T20:58:09.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.352+0000 7fbc2ca21740 1 Processor -- start 2024-03-16T20:58:09.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.352+0000 7fbc2ca21740 1 -- start start 2024-03-16T20:58:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 0x560621779ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621777d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 0x560621778290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56062176d080 con 0x560621772170 2024-03-16T20:58:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56062178a510 con 0x560621771490 2024-03-16T20:58:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560621771dd0 con 0x56062177a800 2024-03-16T20:58:09.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc22a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 0x560621779ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc23400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 0x560621778290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc22a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 0x560621779ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54496/0 (socket says 172.21.15.8:54496) 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc22a00640 1 -- 172.21.15.8:0/1896856391 learned_addr learned my addr 172.21.15.8:0/1896856391 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc22000640 1 --2- 172.21.15.8:0/1896856391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621777d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc22a00640 1 -- 172.21.15.8:0/1896856391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 msgr2=0x560621778290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc22a00640 1 --2- 172.21.15.8:0/1896856391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 0x560621778290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc22a00640 1 -- 172.21.15.8:0/1896856391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 msgr2=0x560621777d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc22a00640 1 --2- 172.21.15.8:0/1896856391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621777d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc22a00640 1 -- 172.21.15.8:0/1896856391 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560621673950 con 0x560621771490 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.353+0000 7fbc23400640 1 --2- 172.21.15.8:0/1896856391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 0x560621778290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.354+0000 7fbc22a00640 1 --2- 172.21.15.8:0/1896856391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 0x560621779ea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0b9540 tx=0x7fbc0c0bb0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a98e6f9ee650f33 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.354+0000 7fbc13400640 1 -- 172.21.15.8:0/1896856391 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c0bc700 con 0x560621771490 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.354+0000 7fbc13400640 1 -- 172.21.15.8:0/1896856391 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbc0c0bc990 con 0x560621771490 2024-03-16T20:58:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.354+0000 7fbc13400640 1 -- 172.21.15.8:0/1896856391 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c0c0d10 con 0x560621771490 2024-03-16T20:58:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.355+0000 7fbc2ca21740 1 -- 172.21.15.8:0/1896856391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 msgr2=0x560621779ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.355+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/1896856391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 0x560621779ea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0b9540 tx=0x7fbc0c0bb0d0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.355+0000 7fbc2ca21740 1 -- 172.21.15.8:0/1896856391 shutdown_connections 2024-03-16T20:58:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.355+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/1896856391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56062177a800 0x560621778290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.355+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/1896856391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560621772170 0x560621777d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.355+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/1896856391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621771490 0x560621779ea0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.355+0000 7fbc2ca21740 1 -- 172.21.15.8:0/1896856391 >> 172.21.15.8:0/1896856391 conn(0x5606217385a0 msgr2=0x56062176af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.355+0000 7fbc2ca21740 1 -- 172.21.15.8:0/1896856391 shutdown_connections 2024-03-16T20:58:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.355+0000 7fbc2ca21740 1 -- 172.21.15.8:0/1896856391 wait complete. 2024-03-16T20:58:09.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.355+0000 7fbc2ca21740 1 -- start start 2024-03-16T20:58:09.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc2ca21740 1 Processor -- start 2024-03-16T20:58:09.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x560621774dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621772170 0x560621775300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc2ca21740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56062177a800 0x56062177b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56062177b860 con 0x56062177a800 2024-03-16T20:58:09.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56062177b9d0 con 0x560621772170 2024-03-16T20:58:09.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc2ca21740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56062177bb90 con 0x560621771490 2024-03-16T20:58:09.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc2ca21740 10 client.0 _ll_register_callbacks cb 0x7fbc0c0f3840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:09.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc22a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x560621774dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc22a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x560621774dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39926/0 (socket says 172.21.15.8:39926) 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc22a00640 1 -- 172.21.15.8:0/3740800903 learned_addr learned my addr 172.21.15.8:0/3740800903 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc23400640 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56062177a800 0x56062177b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.356+0000 7fbc22000640 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621772170 0x560621775300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc22a00640 1 -- 172.21.15.8:0/3740800903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621772170 msgr2=0x560621775300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc22a00640 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621772170 0x560621775300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc22a00640 1 -- 172.21.15.8:0/3740800903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56062177a800 msgr2=0x56062177b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc22a00640 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56062177a800 0x56062177b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc22a00640 1 -- 172.21.15.8:0/3740800903 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1c018070 con 0x560621771490 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc22a00640 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x560621774dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0036a0 tx=0x7fbc0c0f2140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d7a3d7012ec24a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc10c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc10c00640 1 -- 172.21.15.8:0/3740800903 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c0c50d0 con 0x560621771490 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc10c00640 1 -- 172.21.15.8:0/3740800903 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbc0c0bd2c0 con 0x560621771490 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc2ca21740 1 -- 172.21.15.8:0/3740800903 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc14019c90 con 0x560621771490 2024-03-16T20:58:09.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc10c00640 1 -- 172.21.15.8:0/3740800903 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc0c0bc700 con 0x560621771490 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc2ca21740 10 client.25486 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.357+0000 7fbc2ca21740 1 -- 172.21.15.8:0/3740800903 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5606216d74e0 con 0x560621771490 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.358+0000 7fbc10c00640 1 -- 172.21.15.8:0/3740800903 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbc14019c90 con 0x560621771490 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.358+0000 7fbc10c00640 1 -- 172.21.15.8:0/3740800903 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fbc0c03c050 con 0x560621771490 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.358+0000 7fbc2ca21740 10 client.25486 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.358+0000 7fbc2ca21740 10 client.25486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.358+0000 7fbc2ca21740 20 client.25486 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.358+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5606217e69a0 0x5606217e8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.358+0000 7fbc2ca21740 4 client.25486 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.358+0000 7fbc2ca21740 1 -- 172.21.15.8:0/3740800903 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560621464890 con 0x5606217e69a0 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.358+0000 7fbc22000640 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5606217e69a0 0x5606217e8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc22000640 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5606217e69a0 0x5606217e8d90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5db77faf7d631df5 server_cookie=1867f341bf8771c4 in_seq=0 out_seq=0 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc10c00640 10 client.25486 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc10c00640 1 -- 172.21.15.8:0/3740800903 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560621464890 con 0x5606217e69a0 2024-03-16T20:58:09.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc10c00640 10 client.25486 handle_command_reply: tid=0 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc2ca21740 1 client.25486 shutdown 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc2ca21740 1 -- 172.21.15.8:0/3740800903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 msgr2=0x560621774dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x560621774dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0036a0 tx=0x7fbc0c0f2140 comp rx=0 tx=0).stop 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc2ca21740 1 -- 172.21.15.8:0/3740800903 shutdown_connections 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5606217e69a0 0x5606217e8d90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56062177a800 0x56062177b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560621772170 0x560621775300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc10c00640 0 client.25486 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc2ca21740 1 --2- 172.21.15.8:0/3740800903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560621771490 0x560621774dc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.359+0000 7fbc2ca21740 1 -- 172.21.15.8:0/3740800903 >> 172.21.15.8:0/3740800903 conn(0x5606217385a0 msgr2=0x56062176af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.360+0000 7fbc2ca21740 1 -- 172.21.15.8:0/3740800903 shutdown_connections 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.360+0000 7fbc2ca21740 1 -- 172.21.15.8:0/3740800903 wait complete. 2024-03-16T20:58:09.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.360+0000 7fbc2ca21740 20 client.25486 trim_cache size 0 max 16384 2024-03-16T20:58:09.370 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:58:09.370 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T20:58:09.370 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T20:58:09.370 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:58:09.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.360+0000 7fbc23e00640 1 -- 172.21.15.8:0/466528246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbc080a1d40 msgr2=0x7fbc080a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.360+0000 7fbc23e00640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbc080a1d40 0x7fbc080a4200 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbc241022e0 tx=0x7fbc1c009820 comp rx=0 tx=0).stop 2024-03-16T20:58:09.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.360+0000 7fbc23e00640 1 -- 172.21.15.8:0/466528246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc24100100 msgr2=0x7fbc2419fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.360+0000 7fbc23e00640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc24100100 0x7fbc2419fa50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c02c250 tx=0x7fbc0c02ccb0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.361+0000 7fbc23e00640 1 -- 172.21.15.8:0/466528246 shutdown_connections 2024-03-16T20:58:09.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.361+0000 7fbc23e00640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbc080a1d40 0x7fbc080a4200 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.361+0000 7fbc23e00640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc2410dcb0 0x7fbc24199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.361+0000 7fbc23e00640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc24100ab0 0x7fbc2419ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.361+0000 7fbc23e00640 1 --2- 172.21.15.8:0/466528246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc24100100 0x7fbc2419fa50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.361+0000 7fbc23e00640 1 -- 172.21.15.8:0/466528246 >> 172.21.15.8:0/466528246 conn(0x7fbc240fbd40 msgr2=0x7fbc240ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:09.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.361+0000 7fbc23e00640 1 -- 172.21.15.8:0/466528246 shutdown_connections 2024-03-16T20:58:09.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.361+0000 7fbc23e00640 1 -- 172.21.15.8:0/466528246 wait complete. 2024-03-16T20:58:09.372 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:09 smithi170 ceph-mon[35947]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-03-16T20:58:09.381 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:09 smithi008 ceph-mon[31434]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-03-16T20:58:09.383 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T20:58:09.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:58:09.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:09 smithi186 ceph-mon[36391]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-03-16T20:58:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.581+0000 7f3e94e00640 1 -- 172.21.15.8:0/1410289789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e90103e90 msgr2=0x7f3e90110350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.581+0000 7f3e94e00640 1 --2- 172.21.15.8:0/1410289789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e90103e90 0x7f3e90110350 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009c10 tx=0x7f3e8802bef0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.581+0000 7f3e94e00640 1 -- 172.21.15.8:0/1410289789 shutdown_connections 2024-03-16T20:58:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.581+0000 7f3e94e00640 1 --2- 172.21.15.8:0/1410289789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e90103e90 0x7f3e90110350 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.581+0000 7f3e94e00640 1 --2- 172.21.15.8:0/1410289789 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e901034d0 0x7f3e90103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.581+0000 7f3e94e00640 1 --2- 172.21.15.8:0/1410289789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e90109590 0x7f3e90109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.581+0000 7f3e94e00640 1 -- 172.21.15.8:0/1410289789 >> 172.21.15.8:0/1410289789 conn(0x7f3e900fef60 msgr2=0x7f3e90101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.581+0000 7f3e94e00640 1 -- 172.21.15.8:0/1410289789 shutdown_connections 2024-03-16T20:58:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.581+0000 7f3e94e00640 1 -- 172.21.15.8:0/1410289789 wait complete. 2024-03-16T20:58:09.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.582+0000 7f3e94e00640 1 Processor -- start 2024-03-16T20:58:09.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.582+0000 7f3e94e00640 1 -- start start 2024-03-16T20:58:09.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e94e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e901034d0 0x7f3e9019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e94e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e90103e90 0x7f3e9019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e94e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e90109590 0x7f3e901999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e94e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e90199ff0 con 0x7f3e901034d0 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e94e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9019a160 con 0x7f3e90109590 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e94e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9019a320 con 0x7f3e90103e90 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e8f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e901034d0 0x7f3e9019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e86a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e90103e90 0x7f3e9019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e8fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e90109590 0x7f3e901999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e8f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e901034d0 0x7f3e9019f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42080/0 (socket says 172.21.15.8:42080) 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e86a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e90103e90 0x7f3e9019fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39944/0 (socket says 172.21.15.8:39944) 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e8fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e90109590 0x7f3e901999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54536/0 (socket says 172.21.15.8:54536) 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.583+0000 7f3e8f400640 1 -- 172.21.15.8:0/298273583 learned_addr learned my addr 172.21.15.8:0/298273583 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e8fe00640 1 -- 172.21.15.8:0/298273583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e90103e90 msgr2=0x7f3e9019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e8fe00640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e90103e90 0x7f3e9019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e8fe00640 1 -- 172.21.15.8:0/298273583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e901034d0 msgr2=0x7f3e9019f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e8fe00640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e901034d0 0x7f3e9019f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e8fe00640 1 -- 172.21.15.8:0/298273583 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80009560 con 0x7f3e90109590 2024-03-16T20:58:09.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e8f400640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e901034d0 0x7f3e9019f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:09.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e8fe00640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e90109590 0x7f3e901999a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3e88036040 tx=0x7f3e880337f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:09.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e8cc00640 1 -- 172.21.15.8:0/298273583 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88003b80 con 0x7f3e90109590 2024-03-16T20:58:09.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e8cc00640 1 -- 172.21.15.8:0/298273583 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3e88003ce0 con 0x7f3e90109590 2024-03-16T20:58:09.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e94e00640 1 -- 172.21.15.8:0/298273583 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e88009840 con 0x7f3e90109590 2024-03-16T20:58:09.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e8cc00640 1 -- 172.21.15.8:0/298273583 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8803e9b0 con 0x7f3e90109590 2024-03-16T20:58:09.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.584+0000 7f3e94e00640 1 -- 172.21.15.8:0/298273583 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e901a66b0 con 0x7f3e90109590 2024-03-16T20:58:09.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.585+0000 7f3e94e00640 1 -- 172.21.15.8:0/298273583 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e90068650 con 0x7f3e90109590 2024-03-16T20:58:09.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.588+0000 7f3e8cc00640 1 -- 172.21.15.8:0/298273583 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f3e88004660 con 0x7f3e90109590 2024-03-16T20:58:09.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.589+0000 7f3e8cc00640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3e700a1cc0 0x7f3e700a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:09.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.589+0000 7f3e8cc00640 1 -- 172.21.15.8:0/298273583 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3e880f08b0 con 0x7f3e90109590 2024-03-16T20:58:09.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.589+0000 7f3e8f400640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3e700a1cc0 0x7f3e700a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:09.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.590+0000 7f3e8f400640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3e700a1cc0 0x7f3e700a4180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e9019aae0 tx=0x7f3e80009260 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:09.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.596+0000 7f3e8cc00640 1 -- 172.21.15.8:0/298273583 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3e880b9610 con 0x7f3e90109590 2024-03-16T20:58:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.839+0000 7f3e94e00640 1 -- 172.21.15.8:0/298273583 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e90113820 con 0x7f3e90109590 2024-03-16T20:58:09.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.840+0000 7f3e8cc00640 1 -- 172.21.15.8:0/298273583 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f3e880bccd0 con 0x7f3e90109590 2024-03-16T20:58:09.845 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:58:09.846 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:57:29.077799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T20:58:09.846 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 24 2024-03-16T20:58:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.843+0000 7f3e94e00640 1 -- 172.21.15.8:0/298273583 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3e700a1cc0 msgr2=0x7f3e700a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.843+0000 7f3e94e00640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3e700a1cc0 0x7f3e700a4180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e9019aae0 tx=0x7f3e80009260 comp rx=0 tx=0).stop 2024-03-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.843+0000 7f3e94e00640 1 -- 172.21.15.8:0/298273583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e90109590 msgr2=0x7f3e901999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.843+0000 7f3e94e00640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e90109590 0x7f3e901999a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3e88036040 tx=0x7f3e880337f0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.843+0000 7f3e94e00640 1 -- 172.21.15.8:0/298273583 shutdown_connections 2024-03-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.843+0000 7f3e94e00640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3e700a1cc0 0x7f3e700a4180 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.843+0000 7f3e94e00640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e90109590 0x7f3e901999a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.843+0000 7f3e94e00640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e90103e90 0x7f3e9019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.843+0000 7f3e94e00640 1 --2- 172.21.15.8:0/298273583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e901034d0 0x7f3e9019f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.843+0000 7f3e94e00640 1 -- 172.21.15.8:0/298273583 >> 172.21.15.8:0/298273583 conn(0x7f3e900fef60 msgr2=0x7f3e90100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.843+0000 7f3e94e00640 1 -- 172.21.15.8:0/298273583 shutdown_connections 2024-03-16T20:58:09.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:09.844+0000 7f3e94e00640 1 -- 172.21.15.8:0/298273583 wait complete. 2024-03-16T20:58:09.869 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:58:09.869 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T20:58:10.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.100+0000 7fba9ec00640 1 -- 172.21.15.8:0/342087749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba98106530 msgr2=0x7fba98106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.100+0000 7fba9ec00640 1 --2- 172.21.15.8:0/342087749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba98106530 0x7fba98106910 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fba88009900 tx=0x7fba8802bc30 comp rx=0 tx=0).stop 2024-03-16T20:58:10.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.101+0000 7fba9ec00640 1 -- 172.21.15.8:0/342087749 shutdown_connections 2024-03-16T20:58:10.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.101+0000 7fba9ec00640 1 --2- 172.21.15.8:0/342087749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba98101020 0x7fba9810d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.101+0000 7fba9ec00640 1 --2- 172.21.15.8:0/342087749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba98100660 0x7fba98100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.101+0000 7fba9ec00640 1 --2- 172.21.15.8:0/342087749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba98106530 0x7fba98106910 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.101+0000 7fba9ec00640 1 -- 172.21.15.8:0/342087749 >> 172.21.15.8:0/342087749 conn(0x7fba980772e0 msgr2=0x7fba980776f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.101+0000 7fba9ec00640 1 -- 172.21.15.8:0/342087749 shutdown_connections 2024-03-16T20:58:10.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.101+0000 7fba9ec00640 1 -- 172.21.15.8:0/342087749 wait complete. 2024-03-16T20:58:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.102+0000 7fba9ec00640 1 Processor -- start 2024-03-16T20:58:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.102+0000 7fba9ec00640 1 -- start start 2024-03-16T20:58:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.102+0000 7fba9ec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba98100660 0x7fba98199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.102+0000 7fba9ec00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba98101020 0x7fba9819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.102+0000 7fba9ec00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba98106530 0x7fba9819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.102+0000 7fba9ec00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9819ecf0 con 0x7fba98100660 2024-03-16T20:58:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.102+0000 7fba9ec00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9819ee60 con 0x7fba98106530 2024-03-16T20:58:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.102+0000 7fba9ec00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9819f020 con 0x7fba98101020 2024-03-16T20:58:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba97400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba98101020 0x7fba9819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba97400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba98101020 0x7fba9819a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39966/0 (socket says 172.21.15.8:39966) 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba97400640 1 -- 172.21.15.8:0/3297037424 learned_addr learned my addr 172.21.15.8:0/3297037424 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba9cc00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba98106530 0x7fba9819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba97e00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba98100660 0x7fba98199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba97400640 1 -- 172.21.15.8:0/3297037424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba98106530 msgr2=0x7fba9819e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba97400640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba98106530 0x7fba9819e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba97400640 1 -- 172.21.15.8:0/3297037424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba98100660 msgr2=0x7fba98199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba97400640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba98100660 0x7fba98199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba97400640 1 -- 172.21.15.8:0/3297037424 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90009840 con 0x7fba98101020 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba9cc00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba98106530 0x7fba9819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.103+0000 7fba97400640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba98101020 0x7fba9819a3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba8000e9f0 tx=0x7fba8000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.104+0000 7fba94c00640 1 -- 172.21.15.8:0/3297037424 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80009700 con 0x7fba98101020 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.104+0000 7fba94c00640 1 -- 172.21.15.8:0/3297037424 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fba8000ccc0 con 0x7fba98101020 2024-03-16T20:58:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.104+0000 7fba94c00640 1 -- 172.21.15.8:0/3297037424 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba800188c0 con 0x7fba98101020 2024-03-16T20:58:10.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.104+0000 7fba9ec00640 1 -- 172.21.15.8:0/3297037424 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba88009560 con 0x7fba98101020 2024-03-16T20:58:10.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.104+0000 7fba9ec00640 1 -- 172.21.15.8:0/3297037424 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba981a69a0 con 0x7fba98101020 2024-03-16T20:58:10.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.107+0000 7fba94c00640 1 -- 172.21.15.8:0/3297037424 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7fba80010ac0 con 0x7fba98101020 2024-03-16T20:58:10.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.108+0000 7fbaa17f7740 1 Processor -- start 2024-03-16T20:58:10.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.108+0000 7fbaa17f7740 1 -- start start 2024-03-16T20:58:10.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.108+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdb1c40 0x563d5fdb2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.108+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb2560 0x563d5fdbac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.108+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdbb140 0x563d5fdbd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.108+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fd20210 con 0x563d5fdb1c40 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.108+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fd1d740 con 0x563d5fdbb140 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.108+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fd18f20 con 0x563d5fdb2560 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba97e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb2560 0x563d5fdbac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba97e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb2560 0x563d5fdbac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39970/0 (socket says 172.21.15.8:39970) 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba97e00640 1 -- 172.21.15.8:0/3493219047 learned_addr learned my addr 172.21.15.8:0/3493219047 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba9cc00640 1 --2- 172.21.15.8:0/3493219047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdb1c40 0x563d5fdb2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba97400640 1 --2- 172.21.15.8:0/3493219047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdbb140 0x563d5fdbd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba97e00640 1 -- 172.21.15.8:0/3493219047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdbb140 msgr2=0x563d5fdbd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba97e00640 1 --2- 172.21.15.8:0/3493219047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdbb140 0x563d5fdbd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba97e00640 1 -- 172.21.15.8:0/3493219047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdb1c40 msgr2=0x563d5fdb2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba97e00640 1 --2- 172.21.15.8:0/3493219047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdb1c40 0x563d5fdb2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba97e00640 1 -- 172.21.15.8:0/3493219047 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d5fcdadf0 con 0x563d5fdb2560 2024-03-16T20:58:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba97400640 1 --2- 172.21.15.8:0/3493219047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdbb140 0x563d5fdbd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.109+0000 7fba94c00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fba7c0a1d40 0x7fba7c0a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.110+0000 7fba97e00640 1 --2- 172.21.15.8:0/3493219047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb2560 0x563d5fdbac00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba88000c00 tx=0x7fba8802c5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54100f9484d0dcc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.110+0000 7fba94c00640 1 -- 172.21.15.8:0/3297037424 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fba80014070 con 0x7fba98101020 2024-03-16T20:58:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.110+0000 7fba9cc00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fba7c0a1d40 0x7fba7c0a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.110+0000 7fba8d200640 1 -- 172.21.15.8:0/3493219047 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88004780 con 0x563d5fdb2560 2024-03-16T20:58:10.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.110+0000 7fba8d200640 1 -- 172.21.15.8:0/3493219047 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fba880048e0 con 0x563d5fdb2560 2024-03-16T20:58:10.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.110+0000 7fba8d200640 1 -- 172.21.15.8:0/3493219047 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88005070 con 0x563d5fdb2560 2024-03-16T20:58:10.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.111+0000 7fbaa17f7740 1 -- 172.21.15.8:0/3493219047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb2560 msgr2=0x563d5fdbac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.111+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/3493219047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb2560 0x563d5fdbac00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba88000c00 tx=0x7fba8802c5f0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.111+0000 7fba9cc00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fba7c0a1d40 0x7fba7c0a4200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba90005fd0 tx=0x7fba90009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.111+0000 7fbaa17f7740 1 -- 172.21.15.8:0/3493219047 shutdown_connections 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.111+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/3493219047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdbb140 0x563d5fdbd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.111+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/3493219047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb2560 0x563d5fdbac00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.111+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/3493219047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdb1c40 0x563d5fdb2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.111+0000 7fbaa17f7740 1 -- 172.21.15.8:0/3493219047 >> 172.21.15.8:0/3493219047 conn(0x563d5fdac370 msgr2=0x563d5fdac750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.111+0000 7fbaa17f7740 1 -- 172.21.15.8:0/3493219047 shutdown_connections 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.111+0000 7fbaa17f7740 1 -- 172.21.15.8:0/3493219047 wait complete. 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.112+0000 7fbaa17f7740 1 -- start start 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.112+0000 7fbaa17f7740 1 Processor -- start 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.112+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 0x563d5fdb80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.112+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdb8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.112+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdbb140 0x563d5fdb8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.112+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fcbe150 con 0x563d5fdbb140 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.112+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fcbddf0 con 0x563d5fdb2560 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.112+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fa871c0 con 0x563d5fdb1c40 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.112+0000 7fbaa17f7740 10 client.0 _ll_register_callbacks cb 0x563d5fd0d2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba97e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 0x563d5fdb80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba97e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 0x563d5fdb80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39978/0 (socket says 172.21.15.8:39978) 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba97e00640 1 -- 172.21.15.8:0/514206267 learned_addr learned my addr 172.21.15.8:0/514206267 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba97400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdb8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba9cc00640 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdbb140 0x563d5fdb8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba97e00640 1 -- 172.21.15.8:0/514206267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 msgr2=0x563d5fdb8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba97e00640 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdb8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba97e00640 1 -- 172.21.15.8:0/514206267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdbb140 msgr2=0x563d5fdb8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba97e00640 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdbb140 0x563d5fdb8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba97e00640 1 -- 172.21.15.8:0/514206267 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9810daf0 con 0x563d5fdb1c40 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba97400640 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdb8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba97e00640 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 0x563d5fdb80c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fba8802c240 tx=0x7fba88005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85a8753956b0621e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.113+0000 7fba85600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.114+0000 7fba85600640 1 -- 172.21.15.8:0/514206267 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88004780 con 0x563d5fdb1c40 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.114+0000 7fba85600640 1 -- 172.21.15.8:0/514206267 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fba88005020 con 0x563d5fdb1c40 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.114+0000 7fbaa17f7740 1 -- 172.21.15.8:0/514206267 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d5fa187e0 con 0x563d5fdb1c40 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.114+0000 7fba85600640 1 -- 172.21.15.8:0/514206267 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba880051e0 con 0x563d5fdb1c40 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.114+0000 7fbaa17f7740 10 client.25504 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.114+0000 7fbaa17f7740 1 -- 172.21.15.8:0/514206267 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563d5fd175a0 con 0x563d5fdb1c40 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.114+0000 7fba85600640 1 -- 172.21.15.8:0/514206267 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x563d5fa187e0 con 0x563d5fdb1c40 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.114+0000 7fba85600640 1 -- 172.21.15.8:0/514206267 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fba8803c050 con 0x563d5fdb1c40 2024-03-16T20:58:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.115+0000 7fbaa17f7740 10 client.25504 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.115+0000 7fbaa17f7740 10 client.25504 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T20:58:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.115+0000 7fbaa17f7740 20 client.25504 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.115+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563d5fdcad70 0x563d5fdcd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.115+0000 7fbaa17f7740 4 client.25504 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.115+0000 7fbaa17f7740 1 -- 172.21.15.8:0/514206267 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d5fa55720 con 0x563d5fdcad70 2024-03-16T20:58:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.115+0000 7fba97400640 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563d5fdcad70 0x563d5fdcd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.116+0000 7fba85600640 10 client.25504 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:58:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.116+0000 7fba97400640 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563d5fdcad70 0x563d5fdcd180 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=95cf694af0d835e4 server_cookie=226ca39a0b1fbf20 in_seq=0 out_seq=0 2024-03-16T20:58:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fba85600640 1 -- 172.21.15.8:0/514206267 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563d5fa55720 con 0x563d5fdcad70 2024-03-16T20:58:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fba85600640 10 client.25504 handle_command_reply: tid=0 2024-03-16T20:58:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fbaa17f7740 1 client.25504 shutdown 2024-03-16T20:58:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fbaa17f7740 1 -- 172.21.15.8:0/514206267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 msgr2=0x563d5fdb80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 0x563d5fdb80c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fba8802c240 tx=0x7fba88005850 comp rx=0 tx=0).stop 2024-03-16T20:58:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fbaa17f7740 1 -- 172.21.15.8:0/514206267 shutdown_connections 2024-03-16T20:58:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563d5fdcad70 0x563d5fdcd180 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdbb140 0x563d5fdb8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdb8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fba85600640 0 client.25504 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:58:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/514206267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 0x563d5fdb80c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fbaa17f7740 1 -- 172.21.15.8:0/514206267 >> 172.21.15.8:0/514206267 conn(0x563d5fdac370 msgr2=0x563d5fdae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fbaa17f7740 1 -- 172.21.15.8:0/514206267 shutdown_connections 2024-03-16T20:58:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.117+0000 7fbaa17f7740 1 -- 172.21.15.8:0/514206267 wait complete. 2024-03-16T20:58:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.118+0000 7fbaa17f7740 20 client.25504 trim_cache size 0 max 16384 2024-03-16T20:58:10.132 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:10 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/298273583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:58:10.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.132+0000 7fbaa17f7740 1 Processor -- start 2024-03-16T20:58:10.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.132+0000 7fbaa17f7740 1 -- start start 2024-03-16T20:58:10.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.132+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdb1c40 0x563d5fdba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdbb140 0x563d5fdb8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fda7ae0 con 0x563d5fdb1c40 2024-03-16T20:58:10.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fdad1a0 con 0x563d5fdb2560 2024-03-16T20:58:10.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fdacfc0 con 0x563d5fdbb140 2024-03-16T20:58:10.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fba97400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fba97e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdb1c40 0x563d5fdba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fba9cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdbb140 0x563d5fdb8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fba97400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54572/0 (socket says 172.21.15.8:54572) 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fba97400640 1 -- 172.21.15.8:0/1159704821 learned_addr learned my addr 172.21.15.8:0/1159704821 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fba97400640 1 -- 172.21.15.8:0/1159704821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdbb140 msgr2=0x563d5fdb8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fba97400640 1 --2- 172.21.15.8:0/1159704821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdbb140 0x563d5fdb8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fba97400640 1 -- 172.21.15.8:0/1159704821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdb1c40 msgr2=0x563d5fdba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fba97400640 1 --2- 172.21.15.8:0/1159704821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdb1c40 0x563d5fdba7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.133+0000 7fba97400640 1 -- 172.21.15.8:0/1159704821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d5fcb3ab0 con 0x563d5fdb2560 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.134+0000 7fba97400640 1 --2- 172.21.15.8:0/1159704821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdab470 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fba8000c6a0 tx=0x7fba80085040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d85b831ede903261 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.134+0000 7fba87e00640 1 -- 172.21.15.8:0/1159704821 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8009af30 con 0x563d5fdb2560 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.134+0000 7fba87e00640 1 -- 172.21.15.8:0/1159704821 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fba8009a830 con 0x563d5fdb2560 2024-03-16T20:58:10.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.134+0000 7fba87e00640 1 -- 172.21.15.8:0/1159704821 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba800cb700 con 0x563d5fdb2560 2024-03-16T20:58:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.135+0000 7fbaa17f7740 1 -- 172.21.15.8:0/1159704821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 msgr2=0x563d5fdab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.135+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/1159704821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdab470 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fba8000c6a0 tx=0x7fba80085040 comp rx=0 tx=0).stop 2024-03-16T20:58:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.135+0000 7fbaa17f7740 1 -- 172.21.15.8:0/1159704821 shutdown_connections 2024-03-16T20:58:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.135+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/1159704821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdbb140 0x563d5fdb8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.135+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/1159704821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdab470 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.135+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/1159704821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdb1c40 0x563d5fdba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.135+0000 7fbaa17f7740 1 -- 172.21.15.8:0/1159704821 >> 172.21.15.8:0/1159704821 conn(0x563d5fdac370 msgr2=0x563d5fdac750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.135+0000 7fbaa17f7740 1 -- 172.21.15.8:0/1159704821 shutdown_connections 2024-03-16T20:58:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.135+0000 7fbaa17f7740 1 -- 172.21.15.8:0/1159704821 wait complete. 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.135+0000 7fbaa17f7740 1 -- start start 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.135+0000 7fbaa17f7740 1 Processor -- start 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 0x563d5fdb5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdb5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fbaa17f7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdbb140 0x563d5fe1e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fe1ecb0 con 0x563d5fdbb140 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fe1ee20 con 0x563d5fdb2560 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fbaa17f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5fe1efe0 con 0x563d5fdb1c40 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fbaa17f7740 10 client.0 _ll_register_callbacks cb 0x7fba9000e490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fba97e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 0x563d5fdb5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fba97400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdb5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fba97400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdb5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54586/0 (socket says 172.21.15.8:54586) 2024-03-16T20:58:10.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fba97400640 1 -- 172.21.15.8:0/2983298039 learned_addr learned my addr 172.21.15.8:0/2983298039 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.136+0000 7fba9cc00640 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdbb140 0x563d5fe1e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba97400640 1 -- 172.21.15.8:0/2983298039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 msgr2=0x563d5fdb5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba97400640 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 0x563d5fdb5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba97400640 1 -- 172.21.15.8:0/2983298039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdbb140 msgr2=0x563d5fe1e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba97400640 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdbb140 0x563d5fe1e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba97400640 1 -- 172.21.15.8:0/2983298039 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba981a69a0 con 0x563d5fdb2560 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba97e00640 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 0x563d5fdb5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba97400640 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdb5850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba8009a530 tx=0x7fba800cb440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a762b6e2e621bf81 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba85600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba85600640 1 -- 172.21.15.8:0/2983298039 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8009e980 con 0x563d5fdb2560 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba85600640 1 -- 172.21.15.8:0/2983298039 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fba800a2fd0 con 0x563d5fdb2560 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fbaa17f7740 1 -- 172.21.15.8:0/2983298039 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba880048e0 con 0x563d5fdb2560 2024-03-16T20:58:10.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba85600640 1 -- 172.21.15.8:0/2983298039 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba8009af30 con 0x563d5fdb2560 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fbaa17f7740 10 client.25511 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fbaa17f7740 1 -- 172.21.15.8:0/2983298039 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563d5fcd9650 con 0x563d5fdb2560 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.137+0000 7fba85600640 1 -- 172.21.15.8:0/2983298039 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fba880048e0 con 0x563d5fdb2560 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.138+0000 7fba85600640 1 -- 172.21.15.8:0/2983298039 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fba800d3070 con 0x563d5fdb2560 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.138+0000 7fbaa17f7740 10 client.25511 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.138+0000 7fbaa17f7740 10 client.25511 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.138+0000 7fbaa17f7740 20 client.25511 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.138+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563d5fe27580 0x563d5fe299a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.138+0000 7fbaa17f7740 4 client.25511 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.138+0000 7fbaa17f7740 1 -- 172.21.15.8:0/2983298039 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563d5faa4890 con 0x563d5fe27580 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.138+0000 7fba97e00640 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563d5fe27580 0x563d5fe299a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.138+0000 7fba97e00640 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563d5fe27580 0x563d5fe299a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ed568401e0a8c05 server_cookie=7320f78e2636f762 in_seq=0 out_seq=0 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.138+0000 7fba85600640 10 client.25511 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fba85600640 1 -- 172.21.15.8:0/2983298039 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563d5faa4890 con 0x563d5fe27580 2024-03-16T20:58:10.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fba85600640 10 client.25511 handle_command_reply: tid=0 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 1 client.25511 shutdown 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 1 -- 172.21.15.8:0/2983298039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 msgr2=0x563d5fdb5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdb5850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba8009a530 tx=0x7fba800cb440 comp rx=0 tx=0).stop 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 1 -- 172.21.15.8:0/2983298039 shutdown_connections 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563d5fe27580 0x563d5fe299a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5fdbb140 0x563d5fe1e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d5fdb2560 0x563d5fdb5850 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fba85600640 0 client.25511 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 1 --2- 172.21.15.8:0/2983298039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d5fdb1c40 0x563d5fdb5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 1 -- 172.21.15.8:0/2983298039 >> 172.21.15.8:0/2983298039 conn(0x563d5fdac370 msgr2=0x563d5fdab470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 1 -- 172.21.15.8:0/2983298039 shutdown_connections 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 1 -- 172.21.15.8:0/2983298039 wait complete. 2024-03-16T20:58:10.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.139+0000 7fbaa17f7740 20 client.25511 trim_cache size 0 max 16384 2024-03-16T20:58:10.150 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:58:10.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 -- 172.21.15.8:0/3297037424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fba7c0a1d40 msgr2=0x7fba7c0a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fba7c0a1d40 0x7fba7c0a4200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba90005fd0 tx=0x7fba90009500 comp rx=0 tx=0).stop 2024-03-16T20:58:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 -- 172.21.15.8:0/3297037424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba98101020 msgr2=0x7fba9819a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba98101020 0x7fba9819a3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba8000e9f0 tx=0x7fba8000edf0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 -- 172.21.15.8:0/3297037424 shutdown_connections 2024-03-16T20:58:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fba7c0a1d40 0x7fba7c0a4200 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba98106530 0x7fba9819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba98101020 0x7fba9819a3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 --2- 172.21.15.8:0/3297037424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba98100660 0x7fba98199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 -- 172.21.15.8:0/3297037424 >> 172.21.15.8:0/3297037424 conn(0x7fba980772e0 msgr2=0x7fba98069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 -- 172.21.15.8:0/3297037424 shutdown_connections 2024-03-16T20:58:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.140+0000 7fba9ec00640 1 -- 172.21.15.8:0/3297037424 wait complete. 2024-03-16T20:58:10.163 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:58:10.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T20:58:10.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:10 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/298273583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:58:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.371+0000 7fb20a200640 1 -- 172.21.15.8:0/3180337524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb204103690 msgr2=0x7fb204103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.371+0000 7fb20a200640 1 --2- 172.21.15.8:0/3180337524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb204103690 0x7fb204103b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009900 tx=0x7fb1f002bc30 comp rx=0 tx=0).stop 2024-03-16T20:58:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.371+0000 7fb20a200640 1 -- 172.21.15.8:0/3180337524 shutdown_connections 2024-03-16T20:58:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.371+0000 7fb20a200640 1 --2- 172.21.15.8:0/3180337524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb204104050 0x7fb204110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.371+0000 7fb20a200640 1 --2- 172.21.15.8:0/3180337524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb204103690 0x7fb204103b10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.371+0000 7fb20a200640 1 --2- 172.21.15.8:0/3180337524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2041096a0 0x7fb204109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.371+0000 7fb20a200640 1 -- 172.21.15.8:0/3180337524 >> 172.21.15.8:0/3180337524 conn(0x7fb2040ff140 msgr2=0x7fb204101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.371+0000 7fb20a200640 1 -- 172.21.15.8:0/3180337524 shutdown_connections 2024-03-16T20:58:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.371+0000 7fb20a200640 1 -- 172.21.15.8:0/3180337524 wait complete. 2024-03-16T20:58:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.372+0000 7fb20a200640 1 Processor -- start 2024-03-16T20:58:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.372+0000 7fb20a200640 1 -- start start 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.373+0000 7fb20a200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204103690 0x7fb204199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.373+0000 7fb20a200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb204104050 0x7fb20419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.373+0000 7fb20a200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2041096a0 0x7fb20419e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.373+0000 7fb20a200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20419ecc0 con 0x7fb204103690 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.373+0000 7fb20a200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20419ee30 con 0x7fb2041096a0 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.373+0000 7fb20a200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20419eff0 con 0x7fb204104050 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.373+0000 7fb202a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb204104050 0x7fb20419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.373+0000 7fb203400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204103690 0x7fb204199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.373+0000 7fb202a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb204104050 0x7fb20419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40014/0 (socket says 172.21.15.8:40014) 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.373+0000 7fb202a00640 1 -- 172.21.15.8:0/3196643085 learned_addr learned my addr 172.21.15.8:0/3196643085 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.373+0000 7fb203e00640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2041096a0 0x7fb20419e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.374+0000 7fb202a00640 1 -- 172.21.15.8:0/3196643085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2041096a0 msgr2=0x7fb20419e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.374+0000 7fb202a00640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2041096a0 0x7fb20419e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.374+0000 7fb202a00640 1 -- 172.21.15.8:0/3196643085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204103690 msgr2=0x7fb204199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.374+0000 7fb202a00640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204103690 0x7fb204199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.374+0000 7fb202a00640 1 -- 172.21.15.8:0/3196643085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0009560 con 0x7fb204104050 2024-03-16T20:58:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.374+0000 7fb202a00640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb204104050 0x7fb20419a340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0000c00 tx=0x7fb1f002ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.374+0000 7fb1fbe00640 1 -- 172.21.15.8:0/3196643085 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0004310 con 0x7fb204104050 2024-03-16T20:58:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.374+0000 7fb20a200640 1 -- 172.21.15.8:0/3196643085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20419f270 con 0x7fb204104050 2024-03-16T20:58:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.374+0000 7fb1fbe00640 1 -- 172.21.15.8:0/3196643085 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb1f0004470 con 0x7fb204104050 2024-03-16T20:58:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.374+0000 7fb1fbe00640 1 -- 172.21.15.8:0/3196643085 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0003d00 con 0x7fb204104050 2024-03-16T20:58:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.375+0000 7fb20a200640 1 -- 172.21.15.8:0/3196643085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2041a6b50 con 0x7fb204104050 2024-03-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb20cfc1740 1 Processor -- start 2024-03-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb1fbe00640 1 -- 172.21.15.8:0/3196643085 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7fb1f0004e10 con 0x7fb204104050 2024-03-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb20cfc1740 1 -- start start 2024-03-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00050020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00050560 0x55cf00058c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00059140 0x55cf0005b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cefffbe210 con 0x55cf00050560 2024-03-16T20:58:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cefffbb740 con 0x55cf00059140 2024-03-16T20:58:10.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cefffb6f20 con 0x55cf0004fc40 2024-03-16T20:58:10.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb203e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00050020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb203e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00050020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40024/0 (socket says 172.21.15.8:40024) 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.378+0000 7fb203e00640 1 -- 172.21.15.8:0/1079512039 learned_addr learned my addr 172.21.15.8:0/1079512039 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb202a00640 1 --2- 172.21.15.8:0/1079512039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00059140 0x55cf0005b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb203400640 1 --2- 172.21.15.8:0/1079512039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00050560 0x55cf00058c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb203e00640 1 -- 172.21.15.8:0/1079512039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00059140 msgr2=0x55cf0005b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb203e00640 1 --2- 172.21.15.8:0/1079512039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00059140 0x55cf0005b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb203e00640 1 -- 172.21.15.8:0/1079512039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00050560 msgr2=0x55cf00058c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb203e00640 1 --2- 172.21.15.8:0/1079512039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00050560 0x55cf00058c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb203e00640 1 -- 172.21.15.8:0/1079512039 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cefff78df0 con 0x55cf0004fc40 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb203e00640 1 --2- 172.21.15.8:0/1079512039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00050020 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009fd0 tx=0x7fb1fc0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5ae3f5ececf0813 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb1efe00640 1 -- 172.21.15.8:0/1079512039 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc004d20 con 0x55cf0004fc40 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb1fbe00640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1e80a1cc0 0x7fb1e80a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb1efe00640 1 -- 172.21.15.8:0/1079512039 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb1fc004e80 con 0x55cf0004fc40 2024-03-16T20:58:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.379+0000 7fb1efe00640 1 -- 172.21.15.8:0/1079512039 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc005240 con 0x55cf0004fc40 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb1fbe00640 1 -- 172.21.15.8:0/3196643085 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb1f00efff0 con 0x7fb204104050 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb203400640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1e80a1cc0 0x7fb1e80a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1079512039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 msgr2=0x55cf00050020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/1079512039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00050020 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009fd0 tx=0x7fb1fc0118d0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1079512039 shutdown_connections 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/1079512039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00059140 0x55cf0005b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/1079512039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00050560 0x55cf00058c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/1079512039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00050020 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1079512039 >> 172.21.15.8:0/1079512039 conn(0x55cf0004a370 msgr2=0x55cf0004a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1079512039 shutdown_connections 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb203400640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1e80a1cc0 0x7fb1e80a4180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x55cf0004f710 tx=0x7fb1f400b390 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.380+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1079512039 wait complete. 2024-03-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.381+0000 7fb20cfc1740 1 -- start start 2024-03-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.381+0000 7fb20cfc1740 1 Processor -- start 2024-03-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf0004fc40 0x55cf00056210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 0x55cf00056750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf00059140 0x55cf00056c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cefff5c150 con 0x55cf0004fc40 2024-03-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cefff5bdf0 con 0x55cf00050560 2024-03-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceffd251c0 con 0x55cf00059140 2024-03-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb20cfc1740 10 client.0 _ll_register_callbacks cb 0x55cefffab2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:10.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb202a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 0x55cf00056750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb202a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 0x55cf00056750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54628/0 (socket says 172.21.15.8:54628) 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb202a00640 1 -- 172.21.15.8:0/1568422708 learned_addr learned my addr 172.21.15.8:0/1568422708 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb203400640 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf0004fc40 0x55cf00056210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb203e00640 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf00059140 0x55cf00056c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb202a00640 1 -- 172.21.15.8:0/1568422708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf00059140 msgr2=0x55cf00056c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb202a00640 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf00059140 0x55cf00056c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb202a00640 1 -- 172.21.15.8:0/1568422708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf0004fc40 msgr2=0x55cf00056210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb202a00640 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf0004fc40 0x55cf00056210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.382+0000 7fb202a00640 1 -- 172.21.15.8:0/1568422708 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc009c80 con 0x55cf00050560 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.383+0000 7fb202a00640 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 0x55cf00056750 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0005ec0 tx=0x7fb1f00f3590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d8acaa40fd12102 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.383+0000 7fb1ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.383+0000 7fb1ecc00640 1 -- 172.21.15.8:0/1568422708 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00bc5f0 con 0x55cf00050560 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.383+0000 7fb1ecc00640 1 -- 172.21.15.8:0/1568422708 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb1f00035f0 con 0x55cf00050560 2024-03-16T20:58:10.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.383+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1568422708 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ceffcf3720 con 0x55cf00050560 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.383+0000 7fb1ecc00640 1 -- 172.21.15.8:0/1568422708 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1f00bc410 con 0x55cf00050560 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.383+0000 7fb20cfc1740 10 client.25523 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.383+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1568422708 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55cefffb55a0 con 0x55cf00050560 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.383+0000 7fb1ecc00640 1 -- 172.21.15.8:0/1568422708 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55ceffcf3720 con 0x55cf00050560 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.383+0000 7fb1ecc00640 1 -- 172.21.15.8:0/1568422708 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fb1f003c070 con 0x55cf00050560 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.384+0000 7fb20cfc1740 10 client.25523 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.384+0000 7fb20cfc1740 10 client.25523 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.384+0000 7fb20cfc1740 20 client.25523 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.384+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cf00069040 0x55cf0006b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.384+0000 7fb20cfc1740 4 client.25523 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.384+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1568422708 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ceffd42890 con 0x55cf00069040 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.384+0000 7fb203400640 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cf00069040 0x55cf0006b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.384+0000 7fb203400640 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cf00069040 0x55cf0006b460 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57a710a9d3d32fa6 server_cookie=fe8158b5c1cc9dce in_seq=0 out_seq=0 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.384+0000 7fb1ecc00640 10 client.25523 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.385+0000 7fb1ecc00640 1 -- 172.21.15.8:0/1568422708 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ceffd42890 con 0x55cf00069040 2024-03-16T20:58:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.385+0000 7fb1ecc00640 10 client.25523 handle_command_reply: tid=0 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.385+0000 7fb20cfc1740 1 client.25523 shutdown 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.385+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1568422708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 msgr2=0x55cf00056750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.385+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 0x55cf00056750 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0005ec0 tx=0x7fb1f00f3590 comp rx=0 tx=0).stop 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.385+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1568422708 shutdown_connections 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.385+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cf00069040 0x55cf0006b460 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.385+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf00059140 0x55cf00056c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.386+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 0x55cf00056750 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.386+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/1568422708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf0004fc40 0x55cf00056210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.386+0000 7fb1ecc00640 0 client.25523 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.386+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1568422708 >> 172.21.15.8:0/1568422708 conn(0x55cf0004a370 msgr2=0x55cf0004c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.386+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1568422708 shutdown_connections 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.386+0000 7fb20cfc1740 1 -- 172.21.15.8:0/1568422708 wait complete. 2024-03-16T20:58:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.386+0000 7fb20cfc1740 20 client.25523 trim_cache size 0 max 16384 2024-03-16T20:58:10.395 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:10 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/298273583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:58:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb20cfc1740 1 Processor -- start 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb20cfc1740 1 -- start start 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00058940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 0x55cf00056ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00059140 0x55cf0004be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf00049bf0 con 0x55cf00059140 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0004b370 con 0x55cf00050560 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf00050fd0 con 0x55cf0004fc40 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb203400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00058940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb203400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00058940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40050/0 (socket says 172.21.15.8:40050) 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb203400640 1 -- 172.21.15.8:0/2753646745 learned_addr learned my addr 172.21.15.8:0/2753646745 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb202a00640 1 --2- 172.21.15.8:0/2753646745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 0x55cf00056ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.400+0000 7fb203e00640 1 --2- 172.21.15.8:0/2753646745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00059140 0x55cf0004be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.401+0000 7fb203400640 1 -- 172.21.15.8:0/2753646745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 msgr2=0x55cf00056ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.401+0000 7fb203400640 1 --2- 172.21.15.8:0/2753646745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 0x55cf00056ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.401+0000 7fb203400640 1 -- 172.21.15.8:0/2753646745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00059140 msgr2=0x55cf0004be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.401+0000 7fb203400640 1 --2- 172.21.15.8:0/2753646745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00059140 0x55cf0004be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.401+0000 7fb203400640 1 -- 172.21.15.8:0/2753646745 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cefff51ab0 con 0x55cf0004fc40 2024-03-16T20:58:10.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.401+0000 7fb203400640 1 --2- 172.21.15.8:0/2753646745 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00058940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55cf0006bca0 tx=0x7fb1f4019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0148dd30a874d82 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.401+0000 7fb1ef400640 1 -- 172.21.15.8:0/2753646745 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f402e070 con 0x55cf0004fc40 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.401+0000 7fb1ef400640 1 -- 172.21.15.8:0/2753646745 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb1f4005020 con 0x55cf0004fc40 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.401+0000 7fb1ef400640 1 -- 172.21.15.8:0/2753646745 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4024040 con 0x55cf0004fc40 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.402+0000 7fb20cfc1740 1 -- 172.21.15.8:0/2753646745 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 msgr2=0x55cf00058940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.402+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/2753646745 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00058940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55cf0006bca0 tx=0x7fb1f4019000 comp rx=0 tx=0).stop 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.402+0000 7fb20cfc1740 1 -- 172.21.15.8:0/2753646745 shutdown_connections 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.402+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/2753646745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00059140 0x55cf0004be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.402+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/2753646745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00050560 0x55cf00056ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.402+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/2753646745 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf00058940 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.402+0000 7fb20cfc1740 1 -- 172.21.15.8:0/2753646745 >> 172.21.15.8:0/2753646745 conn(0x55cf0004a370 msgr2=0x55cf0004b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.402+0000 7fb20cfc1740 1 -- 172.21.15.8:0/2753646745 shutdown_connections 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.402+0000 7fb20cfc1740 1 -- 172.21.15.8:0/2753646745 wait complete. 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.402+0000 7fb20cfc1740 1 -- start start 2024-03-16T20:58:10.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.403+0000 7fb20cfc1740 1 Processor -- start 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.403+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf0005c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.403+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00050560 0x55cf0005cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.403+0000 7fb20cfc1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00059140 0x55cf0005d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.403+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf000c3ab0 con 0x55cf00050560 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.403+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf000c3c20 con 0x55cf00059140 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.403+0000 7fb20cfc1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf000c3de0 con 0x55cf0004fc40 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.403+0000 7fb20cfc1740 10 client.0 _ll_register_callbacks cb 0x7fb1f0005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.403+0000 7fb203400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf0005c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb203400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf0005c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40052/0 (socket says 172.21.15.8:40052) 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb203400640 1 -- 172.21.15.8:0/3603031421 learned_addr learned my addr 172.21.15.8:0/3603031421 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb203e00640 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00059140 0x55cf0005d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb202a00640 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00050560 0x55cf0005cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb203400640 1 -- 172.21.15.8:0/3603031421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00059140 msgr2=0x55cf0005d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb203400640 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00059140 0x55cf0005d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb203400640 1 -- 172.21.15.8:0/3603031421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00050560 msgr2=0x55cf0005cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb203400640 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00050560 0x55cf0005cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb203400640 1 -- 172.21.15.8:0/3603031421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f4003910 con 0x55cf0004fc40 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb203400640 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf0005c6b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb1f401e9f0 tx=0x7fb1f401ea20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edf78905f4af73f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb1ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb1ecc00640 1 -- 172.21.15.8:0/3603031421 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4024050 con 0x55cf0004fc40 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb1ecc00640 1 -- 172.21.15.8:0/3603031421 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb1f4005390 con 0x55cf0004fc40 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.404+0000 7fb20cfc1740 1 -- 172.21.15.8:0/3603031421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ceffcb67e0 con 0x55cf0004fc40 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.405+0000 7fb1ecc00640 1 -- 172.21.15.8:0/3603031421 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1f402e040 con 0x55cf0004fc40 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.405+0000 7fb20cfc1740 10 client.25528 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.405+0000 7fb20cfc1740 1 -- 172.21.15.8:0/3603031421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55cefff77650 con 0x55cf0004fc40 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.405+0000 7fb1ecc00640 1 -- 172.21.15.8:0/3603031421 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55ceffcb67e0 con 0x55cf0004fc40 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.405+0000 7fb1ecc00640 1 -- 172.21.15.8:0/3603031421 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fb1f402ac20 con 0x55cf0004fc40 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.405+0000 7fb20cfc1740 10 client.25528 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:10.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.405+0000 7fb20cfc1740 10 client.25528 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.405+0000 7fb20cfc1740 20 client.25528 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.405+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cf000c55f0 0x55cf000c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.405+0000 7fb20cfc1740 4 client.25528 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.405+0000 7fb20cfc1740 1 -- 172.21.15.8:0/3603031421 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ceffca54e0 con 0x55cf000c55f0 2024-03-16T20:58:10.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.406+0000 7fb202a00640 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cf000c55f0 0x55cf000c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.406+0000 7fb202a00640 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cf000c55f0 0x55cf000c7a10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72a3d7287a77a90b server_cookie=e198e810f4f73fcf in_seq=0 out_seq=0 2024-03-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.406+0000 7fb1ecc00640 10 client.25528 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.406+0000 7fb1ecc00640 1 -- 172.21.15.8:0/3603031421 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ceffca54e0 con 0x55cf000c55f0 2024-03-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.406+0000 7fb1ecc00640 10 client.25528 handle_command_reply: tid=0 2024-03-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.406+0000 7fb20cfc1740 1 client.25528 shutdown 2024-03-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.406+0000 7fb20cfc1740 1 -- 172.21.15.8:0/3603031421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 msgr2=0x55cf0005c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.406+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf0005c6b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb1f401e9f0 tx=0x7fb1f401ea20 comp rx=0 tx=0).stop 2024-03-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb20cfc1740 1 -- 172.21.15.8:0/3603031421 shutdown_connections 2024-03-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cf000c55f0 0x55cf000c7a10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf00059140 0x55cf0005d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf00050560 0x55cf0005cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb20cfc1740 1 --2- 172.21.15.8:0/3603031421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf0004fc40 0x55cf0005c6b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb1ecc00640 0 client.25528 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb20cfc1740 1 -- 172.21.15.8:0/3603031421 >> 172.21.15.8:0/3603031421 conn(0x55cf0004a370 msgr2=0x55cf00049470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb20cfc1740 1 -- 172.21.15.8:0/3603031421 shutdown_connections 2024-03-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb20cfc1740 1 -- 172.21.15.8:0/3603031421 wait complete. 2024-03-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb20cfc1740 20 client.25528 trim_cache size 0 max 16384 2024-03-16T20:58:10.416 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:58:10.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb20a200640 1 -- 172.21.15.8:0/3196643085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1e80a1cc0 msgr2=0x7fb1e80a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.407+0000 7fb20a200640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1e80a1cc0 0x7fb1e80a4180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x55cf0004f710 tx=0x7fb1f400b390 comp rx=0 tx=0).stop 2024-03-16T20:58:10.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.408+0000 7fb20a200640 1 -- 172.21.15.8:0/3196643085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb204104050 msgr2=0x7fb20419a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.408+0000 7fb20a200640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb204104050 0x7fb20419a340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0000c00 tx=0x7fb1f002ce50 comp rx=0 tx=0).stop 2024-03-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.408+0000 7fb20a200640 1 -- 172.21.15.8:0/3196643085 shutdown_connections 2024-03-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.408+0000 7fb20a200640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1e80a1cc0 0x7fb1e80a4180 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.408+0000 7fb20a200640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2041096a0 0x7fb20419e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.408+0000 7fb20a200640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb204104050 0x7fb20419a340 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.408+0000 7fb20a200640 1 --2- 172.21.15.8:0/3196643085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204103690 0x7fb204199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.408+0000 7fb20a200640 1 -- 172.21.15.8:0/3196643085 >> 172.21.15.8:0/3196643085 conn(0x7fb2040ff140 msgr2=0x7fb2040ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.408+0000 7fb20a200640 1 -- 172.21.15.8:0/3196643085 shutdown_connections 2024-03-16T20:58:10.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.408+0000 7fb20a200640 1 -- 172.21.15.8:0/3196643085 wait complete. 2024-03-16T20:58:10.431 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:58:10.431 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T20:58:10.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.649+0000 7f43d6200640 1 -- 172.21.15.8:0/3053212058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43d0100110 msgr2=0x7f43d01004f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.649+0000 7f43d6200640 1 --2- 172.21.15.8:0/3053212058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43d0100110 0x7f43d01004f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009900 tx=0x7f43c402bc30 comp rx=0 tx=0).stop 2024-03-16T20:58:10.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.649+0000 7f43d6200640 1 -- 172.21.15.8:0/3053212058 shutdown_connections 2024-03-16T20:58:10.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.649+0000 7f43d6200640 1 --2- 172.21.15.8:0/3053212058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43d010dcc0 0x7f43d01100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.649+0000 7f43d6200640 1 --2- 172.21.15.8:0/3053212058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43d0100ac0 0x7f43d010d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.649+0000 7f43d6200640 1 --2- 172.21.15.8:0/3053212058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43d0100110 0x7f43d01004f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.649+0000 7f43d6200640 1 -- 172.21.15.8:0/3053212058 >> 172.21.15.8:0/3053212058 conn(0x7f43d00fbd30 msgr2=0x7f43d00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.649+0000 7f43d6200640 1 -- 172.21.15.8:0/3053212058 shutdown_connections 2024-03-16T20:58:10.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.649+0000 7f43d6200640 1 -- 172.21.15.8:0/3053212058 wait complete. 2024-03-16T20:58:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.651+0000 7f43d6200640 1 Processor -- start 2024-03-16T20:58:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.651+0000 7f43d6200640 1 -- start start 2024-03-16T20:58:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.651+0000 7f43d6200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43d0100110 0x7f43d0199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.651+0000 7f43d6200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43d0100ac0 0x7f43d019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.651+0000 7f43d6200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43d010dcc0 0x7f43d019e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.651+0000 7f43d6200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d019ebe0 con 0x7f43d0100ac0 2024-03-16T20:58:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.651+0000 7f43d6200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d019ed50 con 0x7f43d0100110 2024-03-16T20:58:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.651+0000 7f43d6200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d019ef10 con 0x7f43d010dcc0 2024-03-16T20:58:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.652+0000 7f43d5800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43d010dcc0 0x7f43d019e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.652+0000 7f43d4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43d0100110 0x7f43d0199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.652+0000 7f43d5800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43d010dcc0 0x7f43d019e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40074/0 (socket says 172.21.15.8:40074) 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.652+0000 7f43d5800640 1 -- 172.21.15.8:0/1128745812 learned_addr learned my addr 172.21.15.8:0/1128745812 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.652+0000 7f43cfe00640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43d0100ac0 0x7f43d019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.652+0000 7f43d5800640 1 -- 172.21.15.8:0/1128745812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43d0100110 msgr2=0x7f43d0199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.652+0000 7f43d5800640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43d0100110 0x7f43d0199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.652+0000 7f43d5800640 1 -- 172.21.15.8:0/1128745812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43d0100ac0 msgr2=0x7f43d019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.652+0000 7f43d5800640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43d0100ac0 0x7f43d019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.652+0000 7f43d5800640 1 -- 172.21.15.8:0/1128745812 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c8009840 con 0x7f43d010dcc0 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.652+0000 7f43d5800640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43d010dcc0 0x7f43d019e5e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009c90 tx=0x7f43c800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.653+0000 7f43cd600640 1 -- 172.21.15.8:0/1128745812 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8003b70 con 0x7f43d010dcc0 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.653+0000 7f43cd600640 1 -- 172.21.15.8:0/1128745812 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f43c8003cd0 con 0x7f43d010dcc0 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.653+0000 7f43d6200640 1 -- 172.21.15.8:0/1128745812 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c4009560 con 0x7f43d010dcc0 2024-03-16T20:58:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.653+0000 7f43cd600640 1 -- 172.21.15.8:0/1128745812 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8010990 con 0x7f43d010dcc0 2024-03-16T20:58:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.653+0000 7f43d6200640 1 -- 172.21.15.8:0/1128745812 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d01a6890 con 0x7f43d010dcc0 2024-03-16T20:58:10.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.656+0000 7f43cd600640 1 -- 172.21.15.8:0/1128745812 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f43c8004020 con 0x7f43d010dcc0 2024-03-16T20:58:10.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.656+0000 7f43da629740 1 Processor -- start 2024-03-16T20:58:10.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.656+0000 7f43da629740 1 -- start start 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43da629740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b8b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43da629740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8b710 0x55a2b7b93db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43da629740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b942f0 0x55a2b7b966e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43da629740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b7af9210 con 0x55a2b7b8adf0 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43da629740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b7af6740 con 0x55a2b7b8b710 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43da629740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b7af1f20 con 0x55a2b7b942f0 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43d4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8b710 0x55a2b7b93db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43d4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8b710 0x55a2b7b93db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54670/0 (socket says 172.21.15.8:54670) 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43d4e00640 1 -- 172.21.15.8:0/1553487742 learned_addr learned my addr 172.21.15.8:0/1553487742 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43cfe00640 1 --2- 172.21.15.8:0/1553487742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b8b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43cfe00640 1 --2- 172.21.15.8:0/1553487742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b942f0 0x55a2b7b966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43d4e00640 1 -- 172.21.15.8:0/1553487742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b942f0 msgr2=0x55a2b7b966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43d4e00640 1 --2- 172.21.15.8:0/1553487742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b942f0 0x55a2b7b966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43d4e00640 1 -- 172.21.15.8:0/1553487742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8adf0 msgr2=0x55a2b7b8b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43d4e00640 1 --2- 172.21.15.8:0/1553487742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b8b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43d4e00640 1 -- 172.21.15.8:0/1553487742 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2b7ab3df0 con 0x55a2b7b8b710 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43cfe00640 1 --2- 172.21.15.8:0/1553487742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b8b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43cd600640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f43b80a1d40 0x7f43b80a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.657+0000 7f43cd600640 1 -- 172.21.15.8:0/1128745812 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f43c8014070 con 0x7f43d010dcc0 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.658+0000 7f43d4e00640 1 --2- 172.21.15.8:0/1553487742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8b710 0x55a2b7b93db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f43c4000c00 tx=0x7f43c402c5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c4030614350a1c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.658+0000 7f43cfe00640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f43b80a1d40 0x7f43b80a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.658+0000 7f43c2000640 1 -- 172.21.15.8:0/1553487742 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4004780 con 0x55a2b7b8b710 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.658+0000 7f43c2000640 1 -- 172.21.15.8:0/1553487742 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f43c40048e0 con 0x55a2b7b8b710 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.658+0000 7f43c2000640 1 -- 172.21.15.8:0/1553487742 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4005010 con 0x55a2b7b8b710 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.659+0000 7f43da629740 1 -- 172.21.15.8:0/1553487742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8b710 msgr2=0x55a2b7b93db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.659+0000 7f43da629740 1 --2- 172.21.15.8:0/1553487742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8b710 0x55a2b7b93db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f43c4000c00 tx=0x7f43c402c5f0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.659+0000 7f43cfe00640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f43b80a1d40 0x7f43b80a4200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x55a2b7b866b0 tx=0x7f43bc0096c0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.659+0000 7f43da629740 1 -- 172.21.15.8:0/1553487742 shutdown_connections 2024-03-16T20:58:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.659+0000 7f43da629740 1 --2- 172.21.15.8:0/1553487742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b942f0 0x55a2b7b966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.659+0000 7f43da629740 1 --2- 172.21.15.8:0/1553487742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8b710 0x55a2b7b93db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.659+0000 7f43da629740 1 --2- 172.21.15.8:0/1553487742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b8b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.659+0000 7f43da629740 1 -- 172.21.15.8:0/1553487742 >> 172.21.15.8:0/1553487742 conn(0x55a2b7b85520 msgr2=0x55a2b7b85900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.659+0000 7f43da629740 1 -- 172.21.15.8:0/1553487742 shutdown_connections 2024-03-16T20:58:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.659+0000 7f43da629740 1 -- 172.21.15.8:0/1553487742 wait complete. 2024-03-16T20:58:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.659+0000 7f43da629740 1 -- start start 2024-03-16T20:58:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43da629740 1 Processor -- start 2024-03-16T20:58:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43da629740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b912e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43da629740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8b710 0x55a2b7b91820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43da629740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b942f0 0x55a2b7b91d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43da629740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b7a97150 con 0x55a2b7b942f0 2024-03-16T20:58:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43da629740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b7a96df0 con 0x55a2b7b8adf0 2024-03-16T20:58:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43da629740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b78601c0 con 0x55a2b7b8b710 2024-03-16T20:58:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43da629740 10 client.0 _ll_register_callbacks cb 0x55a2b7ae62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43d4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b912e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43d4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b912e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54678/0 (socket says 172.21.15.8:54678) 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43d4e00640 1 -- 172.21.15.8:0/3239019758 learned_addr learned my addr 172.21.15.8:0/3239019758 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43cfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8b710 0x55a2b7b91820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.660+0000 7f43d5800640 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b942f0 0x55a2b7b91d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.661+0000 7f43d4e00640 1 -- 172.21.15.8:0/3239019758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8b710 msgr2=0x55a2b7b91820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.661+0000 7f43d4e00640 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8b710 0x55a2b7b91820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.661+0000 7f43d4e00640 1 -- 172.21.15.8:0/3239019758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b942f0 msgr2=0x55a2b7b91d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.661+0000 7f43d4e00640 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b942f0 0x55a2b7b91d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.661+0000 7f43d4e00640 1 -- 172.21.15.8:0/3239019758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d0110c90 con 0x55a2b7b8adf0 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.661+0000 7f43cfe00640 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8b710 0x55a2b7b91820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.661+0000 7f43d4e00640 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b912e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f43c402c240 tx=0x7f43c402ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30d9f286261b6224 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.661+0000 7f43b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.661+0000 7f43b6a00640 1 -- 172.21.15.8:0/3239019758 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4005220 con 0x55a2b7b8adf0 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.661+0000 7f43b6a00640 1 -- 172.21.15.8:0/3239019758 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f43c4005380 con 0x55a2b7b8adf0 2024-03-16T20:58:10.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.661+0000 7f43da629740 1 -- 172.21.15.8:0/3239019758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2b77f17e0 con 0x55a2b7b8adf0 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43b6a00640 1 -- 172.21.15.8:0/3239019758 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43c4005540 con 0x55a2b7b8adf0 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43da629740 10 client.25541 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43da629740 1 -- 172.21.15.8:0/3239019758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a2b7af05a0 con 0x55a2b7b8adf0 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43b6a00640 1 -- 172.21.15.8:0/3239019758 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a2b77f17e0 con 0x55a2b7b8adf0 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43b6a00640 1 -- 172.21.15.8:0/3239019758 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f43c403c050 con 0x55a2b7b8adf0 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43da629740 10 client.25541 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43da629740 10 client.25541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43da629740 20 client.25541 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43da629740 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2b7ba3ef0 0x55a2b7ba6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43da629740 4 client.25541 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43da629740 1 -- 172.21.15.8:0/3239019758 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2b782e720 con 0x55a2b7ba3ef0 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.662+0000 7f43cfe00640 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2b7ba3ef0 0x55a2b7ba6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.663+0000 7f43cfe00640 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2b7ba3ef0 0x55a2b7ba6300 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba0cca2553266b5f server_cookie=2e885d623b34d75b in_seq=0 out_seq=0 2024-03-16T20:58:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.663+0000 7f43b6a00640 10 client.25541 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43b6a00640 1 -- 172.21.15.8:0/3239019758 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a2b782e720 con 0x55a2b7ba3ef0 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43b6a00640 10 client.25541 handle_command_reply: tid=0 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 1 client.25541 shutdown 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 1 -- 172.21.15.8:0/3239019758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8adf0 msgr2=0x55a2b7b912e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b912e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f43c402c240 tx=0x7f43c402ce60 comp rx=0 tx=0).stop 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 1 -- 172.21.15.8:0/3239019758 shutdown_connections 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2b7ba3ef0 0x55a2b7ba6300 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b942f0 0x55a2b7b91d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8b710 0x55a2b7b91820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 1 --2- 172.21.15.8:0/3239019758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b912e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43b6a00640 0 client.25541 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 1 -- 172.21.15.8:0/3239019758 >> 172.21.15.8:0/3239019758 conn(0x55a2b7b85520 msgr2=0x55a2b7b87270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 1 -- 172.21.15.8:0/3239019758 shutdown_connections 2024-03-16T20:58:10.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 1 -- 172.21.15.8:0/3239019758 wait complete. 2024-03-16T20:58:10.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.664+0000 7f43da629740 20 client.25541 trim_cache size 0 max 16384 2024-03-16T20:58:10.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.678+0000 7f43da629740 1 Processor -- start 2024-03-16T20:58:10.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43da629740 1 -- start start 2024-03-16T20:58:10.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43da629740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b846c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43da629740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 0x55a2b7b91b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43da629740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b942f0 0x55a2b7b86fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43da629740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b77f17e0 con 0x55a2b7b8b710 2024-03-16T20:58:10.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43da629740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b7b86520 con 0x55a2b7b942f0 2024-03-16T20:58:10.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43da629740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b7b8a830 con 0x55a2b7b8adf0 2024-03-16T20:58:10.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43cfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 0x55a2b7b91b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43cfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 0x55a2b7b91b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42238/0 (socket says 172.21.15.8:42238) 2024-03-16T20:58:10.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43cfe00640 1 -- 172.21.15.8:0/1182042223 learned_addr learned my addr 172.21.15.8:0/1182042223 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43d4e00640 1 --2- 172.21.15.8:0/1182042223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b846c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.679+0000 7f43d5800640 1 --2- 172.21.15.8:0/1182042223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b942f0 0x55a2b7b86fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.680+0000 7f43cfe00640 1 -- 172.21.15.8:0/1182042223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 msgr2=0x55a2b7b846c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.680+0000 7f43cfe00640 1 --2- 172.21.15.8:0/1182042223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b846c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.680+0000 7f43cfe00640 1 -- 172.21.15.8:0/1182042223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b942f0 msgr2=0x55a2b7b86fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.680+0000 7f43cfe00640 1 --2- 172.21.15.8:0/1182042223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b942f0 0x55a2b7b86fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.680+0000 7f43cfe00640 1 -- 172.21.15.8:0/1182042223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2b7a8cab0 con 0x55a2b7b8b710 2024-03-16T20:58:10.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.680+0000 7f43cfe00640 1 --2- 172.21.15.8:0/1182042223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 0x55a2b7b91b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55a2b7b90b40 tx=0x7f43bc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12390be8f59600b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.680+0000 7f43c1600640 1 -- 172.21.15.8:0/1182042223 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc028070 con 0x55a2b7b8b710 2024-03-16T20:58:10.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.680+0000 7f43c1600640 1 -- 172.21.15.8:0/1182042223 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f43bc019070 con 0x55a2b7b8b710 2024-03-16T20:58:10.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.680+0000 7f43c1600640 1 -- 172.21.15.8:0/1182042223 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc004a00 con 0x55a2b7b8b710 2024-03-16T20:58:10.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.681+0000 7f43da629740 1 -- 172.21.15.8:0/1182042223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 msgr2=0x55a2b7b91b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.681+0000 7f43da629740 1 --2- 172.21.15.8:0/1182042223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 0x55a2b7b91b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55a2b7b90b40 tx=0x7f43bc019000 comp rx=0 tx=0).stop 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.681+0000 7f43da629740 1 -- 172.21.15.8:0/1182042223 shutdown_connections 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.681+0000 7f43da629740 1 --2- 172.21.15.8:0/1182042223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b942f0 0x55a2b7b86fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.681+0000 7f43da629740 1 --2- 172.21.15.8:0/1182042223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 0x55a2b7b91b80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.681+0000 7f43da629740 1 --2- 172.21.15.8:0/1182042223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b846c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.681+0000 7f43da629740 1 -- 172.21.15.8:0/1182042223 >> 172.21.15.8:0/1182042223 conn(0x55a2b7b85520 msgr2=0x55a2b7b868c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.681+0000 7f43da629740 1 -- 172.21.15.8:0/1182042223 shutdown_connections 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.681+0000 7f43da629740 1 -- 172.21.15.8:0/1182042223 wait complete. 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.681+0000 7f43da629740 1 -- start start 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43da629740 1 Processor -- start 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43da629740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b99150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43da629740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 0x55a2b7b99690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43da629740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b942f0 0x55a2b7b99bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43da629740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b7b8f2d0 con 0x55a2b7b8b710 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43da629740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b7bff7e0 con 0x55a2b7b942f0 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43da629740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b7bff920 con 0x55a2b7b8adf0 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43da629740 10 client.0 _ll_register_callbacks cb 0x7f43c4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43d4e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b99150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43d5800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b942f0 0x55a2b7b99bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43d4e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b99150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40106/0 (socket says 172.21.15.8:40106) 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43d4e00640 1 -- 172.21.15.8:0/2533115467 learned_addr learned my addr 172.21.15.8:0/2533115467 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.682+0000 7f43cfe00640 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 0x55a2b7b99690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43d4e00640 1 -- 172.21.15.8:0/2533115467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b942f0 msgr2=0x55a2b7b99bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43d4e00640 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b942f0 0x55a2b7b99bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43d4e00640 1 -- 172.21.15.8:0/2533115467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 msgr2=0x55a2b7b99690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43d4e00640 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 0x55a2b7b99690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43d4e00640 1 -- 172.21.15.8:0/2533115467 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc0043b0 con 0x55a2b7b8adf0 2024-03-16T20:58:10.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43d5800640 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b942f0 0x55a2b7b99bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43d4e00640 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b99150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f43c4000c00 tx=0x7f43c402cdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eabe36ab30f9115a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43b6a00640 1 -- 172.21.15.8:0/2533115467 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c403fd30 con 0x55a2b7b8adf0 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43da629740 1 -- 172.21.15.8:0/2533115467 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2b7b84dc0 con 0x55a2b7b8adf0 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43b6a00640 1 -- 172.21.15.8:0/2533115467 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f43c4005020 con 0x55a2b7b8adf0 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43b6a00640 1 -- 172.21.15.8:0/2533115467 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43c403fe90 con 0x55a2b7b8adf0 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43da629740 10 client.25546 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.683+0000 7f43da629740 1 -- 172.21.15.8:0/2533115467 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a2b7ab2650 con 0x55a2b7b8adf0 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.684+0000 7f43b6a00640 1 -- 172.21.15.8:0/2533115467 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a2b7b84dc0 con 0x55a2b7b8adf0 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.684+0000 7f43b6a00640 1 -- 172.21.15.8:0/2533115467 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f43c403c070 con 0x55a2b7b8adf0 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.684+0000 7f43da629740 10 client.25546 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.684+0000 7f43da629740 10 client.25546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.684+0000 7f43da629740 20 client.25546 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:10.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.684+0000 7f43da629740 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2b7c00bb0 0x55a2b7c02fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:10.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.684+0000 7f43da629740 4 client.25546 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:58:10.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.684+0000 7f43da629740 1 -- 172.21.15.8:0/2533115467 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f43c40048e0 con 0x55a2b7c00bb0 2024-03-16T20:58:10.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.684+0000 7f43cfe00640 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2b7c00bb0 0x55a2b7c02fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43cfe00640 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2b7c00bb0 0x55a2b7c02fa0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a62c99d45b9eaaec server_cookie=60beb5c98e28543a in_seq=0 out_seq=0 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43b6a00640 10 client.25546 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43b6a00640 1 -- 172.21.15.8:0/2533115467 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f43c40048e0 con 0x55a2b7c00bb0 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43b6a00640 10 client.25546 handle_command_reply: tid=0 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43da629740 1 client.25546 shutdown 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43da629740 1 -- 172.21.15.8:0/2533115467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 msgr2=0x55a2b7b99150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43da629740 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b99150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f43c4000c00 tx=0x7f43c402cdd0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43da629740 1 -- 172.21.15.8:0/2533115467 shutdown_connections 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43da629740 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2b7b942f0 0x55a2b7b99bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43da629740 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2b7c00bb0 0x55a2b7c02fa0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43da629740 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2b7b8b710 0x55a2b7b99690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43da629740 1 --2- 172.21.15.8:0/2533115467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2b7b8adf0 0x55a2b7b99150 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43da629740 1 -- 172.21.15.8:0/2533115467 >> 172.21.15.8:0/2533115467 conn(0x55a2b7b85520 msgr2=0x55a2b7b87150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.685+0000 7f43b6a00640 0 client.25546 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:10.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43da629740 1 -- 172.21.15.8:0/2533115467 shutdown_connections 2024-03-16T20:58:10.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43da629740 1 -- 172.21.15.8:0/2533115467 wait complete. 2024-03-16T20:58:10.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43da629740 20 client.25546 trim_cache size 0 max 16384 2024-03-16T20:58:10.695 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43d6200640 1 -- 172.21.15.8:0/1128745812 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f43b80a1d40 msgr2=0x7f43b80a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43d6200640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f43b80a1d40 0x7f43b80a4200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x55a2b7b866b0 tx=0x7f43bc0096c0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43d6200640 1 -- 172.21.15.8:0/1128745812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43d010dcc0 msgr2=0x7f43d019e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43d6200640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43d010dcc0 0x7f43d019e5e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009c90 tx=0x7f43c800c6a0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43d6200640 1 -- 172.21.15.8:0/1128745812 shutdown_connections 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43d6200640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f43b80a1d40 0x7f43b80a4200 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43d6200640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43d010dcc0 0x7f43d019e5e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43d6200640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43d0100ac0 0x7f43d019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43d6200640 1 --2- 172.21.15.8:0/1128745812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43d0100110 0x7f43d0199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.686+0000 7f43d6200640 1 -- 172.21.15.8:0/1128745812 >> 172.21.15.8:0/1128745812 conn(0x7f43d00fbd30 msgr2=0x7f43d010efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.687+0000 7f43d6200640 1 -- 172.21.15.8:0/1128745812 shutdown_connections 2024-03-16T20:58:10.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:10.687+0000 7f43d6200640 1 -- 172.21.15.8:0/1128745812 wait complete. 2024-03-16T20:58:11.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:11 smithi170 ceph-mon[35947]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-03-16T20:58:11.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:11 smithi186 ceph-mon[36391]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-03-16T20:58:11.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:11 smithi008 ceph-mon[31434]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-03-16T20:58:11.709 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T20:58:11.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:58:11.709 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T20:58:11.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.948+0000 7f9f52e00640 1 -- 172.21.15.8:0/1701161546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f4c108450 msgr2=0x7f9f4c114960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:11.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.948+0000 7f9f52e00640 1 --2- 172.21.15.8:0/1701161546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f4c108450 0x7f9f4c114960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9f44009c10 tx=0x7f9f4402bef0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.948+0000 7f9f52e00640 1 -- 172.21.15.8:0/1701161546 shutdown_connections 2024-03-16T20:58:11.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.948+0000 7f9f52e00640 1 --2- 172.21.15.8:0/1701161546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f4c108450 0x7f9f4c114960 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.948+0000 7f9f52e00640 1 --2- 172.21.15.8:0/1701161546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f4c107a90 0x7f9f4c107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.948+0000 7f9f52e00640 1 --2- 172.21.15.8:0/1701161546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f4c10daa0 0x7f9f4c10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.948+0000 7f9f52e00640 1 -- 172.21.15.8:0/1701161546 >> 172.21.15.8:0/1701161546 conn(0x7f9f4c075a30 msgr2=0x7f9f4c077e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:11.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.948+0000 7f9f52e00640 1 -- 172.21.15.8:0/1701161546 shutdown_connections 2024-03-16T20:58:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.948+0000 7f9f52e00640 1 -- 172.21.15.8:0/1701161546 wait complete. 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.949+0000 7f9f52e00640 1 Processor -- start 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f52e00640 1 -- start start 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f52e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f4c107a90 0x7f9f4c19e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f52e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f4c108450 0x7f9f4c19e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f52e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f4c10daa0 0x7f9f4c1a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f52e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c1a30d0 con 0x7f9f4c107a90 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f52e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c1a3240 con 0x7f9f4c108450 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f52e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c1a3400 con 0x7f9f4c10daa0 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f4b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f4c108450 0x7f9f4c19e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f4b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f4c108450 0x7f9f4c19e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54722/0 (socket says 172.21.15.8:54722) 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f50e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f4c10daa0 0x7f9f4c1a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f4b400640 1 -- 172.21.15.8:0/3874736697 learned_addr learned my addr 172.21.15.8:0/3874736697 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.950+0000 7f9f4be00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f4c107a90 0x7f9f4c19e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f4b400640 1 -- 172.21.15.8:0/3874736697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f4c10daa0 msgr2=0x7f9f4c1a2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f4b400640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f4c10daa0 0x7f9f4c1a2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f4b400640 1 -- 172.21.15.8:0/3874736697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f4c107a90 msgr2=0x7f9f4c19e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f4b400640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f4c107a90 0x7f9f4c19e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f4b400640 1 -- 172.21.15.8:0/3874736697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c009560 con 0x7f9f4c108450 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f50e00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f4c10daa0 0x7f9f4c1a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f4be00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f4c107a90 0x7f9f4c19e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f4b400640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f4c108450 0x7f9f4c19e750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800e9f0 tx=0x7f9f3800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f48c00640 1 -- 172.21.15.8:0/3874736697 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38009700 con 0x7f9f4c108450 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f48c00640 1 -- 172.21.15.8:0/3874736697 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9f3800cd80 con 0x7f9f4c108450 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f52e00640 1 -- 172.21.15.8:0/3874736697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f44009840 con 0x7f9f4c108450 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.951+0000 7f9f48c00640 1 -- 172.21.15.8:0/3874736697 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380189c0 con 0x7f9f4c108450 2024-03-16T20:58:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.952+0000 7f9f52e00640 1 -- 172.21.15.8:0/3874736697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c1aad80 con 0x7f9f4c108450 2024-03-16T20:58:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.955+0000 7f9f55a3c740 1 Processor -- start 2024-03-16T20:58:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.955+0000 7f9f55a3c740 1 -- start start 2024-03-16T20:58:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.955+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 0x55b8a6e02320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.955+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 0x55b8a6e0af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.955+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e0b440 0x55b8a6e0d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.955+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6dbd300 con 0x55b8a6e0b440 2024-03-16T20:58:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.955+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6d6fe50 con 0x55b8a6e02860 2024-03-16T20:58:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.955+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6d6d380 con 0x55b8a6e01f40 2024-03-16T20:58:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.955+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 0x55b8a6e0af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.955+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 0x55b8a6e0af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54732/0 (socket says 172.21.15.8:54732) 2024-03-16T20:58:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.956+0000 7f9f4be00640 1 -- 172.21.15.8:0/3067512901 learned_addr learned my addr 172.21.15.8:0/3067512901 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.956+0000 7f9f48c00640 1 -- 172.21.15.8:0/3874736697 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f9f38018b20 con 0x7f9f4c108450 2024-03-16T20:58:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.956+0000 7f9f50e00640 1 --2- 172.21.15.8:0/3067512901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 0x55b8a6e02320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.956+0000 7f9f4be00640 1 -- 172.21.15.8:0/3067512901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 msgr2=0x55b8a6e02320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.956+0000 7f9f4be00640 1 --2- 172.21.15.8:0/3067512901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 0x55b8a6e02320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.956+0000 7f9f4be00640 1 -- 172.21.15.8:0/3067512901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e0b440 msgr2=0x55b8a6e0d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.956+0000 7f9f4be00640 1 --2- 172.21.15.8:0/3067512901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e0b440 0x55b8a6e0d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.956+0000 7f9f4be00640 1 -- 172.21.15.8:0/3067512901 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8a6d31c80 con 0x55b8a6e02860 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.956+0000 7f9f4be00640 1 --2- 172.21.15.8:0/3067512901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 0x55b8a6e0af00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c011600 tx=0x7f9f3c011ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36ce9b741146070c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.957+0000 7f9f41600640 1 -- 172.21.15.8:0/3067512901 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c005020 con 0x55b8a6e02860 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.957+0000 7f9f41600640 1 -- 172.21.15.8:0/3067512901 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9f3c005680 con 0x55b8a6e02860 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.957+0000 7f9f41600640 1 -- 172.21.15.8:0/3067512901 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c00fbc0 con 0x55b8a6e02860 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.957+0000 7f9f55a3c740 1 -- 172.21.15.8:0/3067512901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 msgr2=0x55b8a6e0af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.957+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/3067512901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 0x55b8a6e0af00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c011600 tx=0x7f9f3c011ac0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.957+0000 7f9f48c00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9f300a1d40 0x7f9f300a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.957+0000 7f9f48c00640 1 -- 172.21.15.8:0/3874736697 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9f38014070 con 0x7f9f4c108450 2024-03-16T20:58:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.958+0000 7f9f55a3c740 1 -- 172.21.15.8:0/3067512901 shutdown_connections 2024-03-16T20:58:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.958+0000 7f9f50e00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9f300a1d40 0x7f9f300a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.958+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/3067512901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e0b440 0x55b8a6e0d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.958+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/3067512901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 0x55b8a6e0af00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.958+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/3067512901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 0x55b8a6e02320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.958+0000 7f9f55a3c740 1 -- 172.21.15.8:0/3067512901 >> 172.21.15.8:0/3067512901 conn(0x55b8a6dfc670 msgr2=0x55b8a6dfca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.958+0000 7f9f55a3c740 1 -- 172.21.15.8:0/3067512901 shutdown_connections 2024-03-16T20:58:11.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.958+0000 7f9f55a3c740 1 -- 172.21.15.8:0/3067512901 wait complete. 2024-03-16T20:58:11.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.958+0000 7f9f55a3c740 1 -- start start 2024-03-16T20:58:11.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f50e00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9f300a1d40 0x7f9f300a4200 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9f44033420 tx=0x7f9f44005fd0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:11.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f55a3c740 1 Processor -- start 2024-03-16T20:58:11.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e01f40 0x55b8a6e08410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 0x55b8a6e08950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e0b440 0x55b8a6e08e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6d68b60 con 0x55b8a6e01f40 2024-03-16T20:58:11.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6d0dfd0 con 0x55b8a6e02860 2024-03-16T20:58:11.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6d0dc70 con 0x55b8a6e0b440 2024-03-16T20:58:11.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f55a3c740 10 client.0 _ll_register_callbacks cb 0x55b8a6a79c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:11.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f50e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e0b440 0x55b8a6e08e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e01f40 0x55b8a6e08410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f4b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 0x55b8a6e08950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f50e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e0b440 0x55b8a6e08e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40136/0 (socket says 172.21.15.8:40136) 2024-03-16T20:58:11.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.959+0000 7f9f50e00640 1 -- 172.21.15.8:0/1831123855 learned_addr learned my addr 172.21.15.8:0/1831123855 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:11.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.960+0000 7f9f50e00640 1 -- 172.21.15.8:0/1831123855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 msgr2=0x55b8a6e08950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:11.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.960+0000 7f9f50e00640 1 --2- 172.21.15.8:0/1831123855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 0x55b8a6e08950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.960+0000 7f9f50e00640 1 -- 172.21.15.8:0/1831123855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e01f40 msgr2=0x55b8a6e08410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:11.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.960+0000 7f9f50e00640 1 --2- 172.21.15.8:0/1831123855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e01f40 0x55b8a6e08410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.960+0000 7f9f50e00640 1 -- 172.21.15.8:0/1831123855 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c009df0 con 0x55b8a6e0b440 2024-03-16T20:58:11.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.960+0000 7f9f50e00640 1 --2- 172.21.15.8:0/1831123855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e0b440 0x55b8a6e08e90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f44035000 tx=0x7f9f44009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c93905c15870cbae server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:11.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.960+0000 7f9f36000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:11.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.960+0000 7f9f36000640 1 -- 172.21.15.8:0/1831123855 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f44004680 con 0x55b8a6e0b440 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.960+0000 7f9f55a3c740 1 -- 172.21.15.8:0/1831123855 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8a6a68860 con 0x55b8a6e0b440 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.960+0000 7f9f36000640 1 -- 172.21.15.8:0/1831123855 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9f440047e0 con 0x55b8a6e0b440 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.961+0000 7f9f36000640 1 -- 172.21.15.8:0/1831123855 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f44055430 con 0x55b8a6e0b440 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.961+0000 7f9f55a3c740 10 client.25558 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.961+0000 7f9f55a3c740 1 -- 172.21.15.8:0/1831123855 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b8a6d671e0 con 0x55b8a6e0b440 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.961+0000 7f9f36000640 1 -- 172.21.15.8:0/1831123855 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55b8a6a68860 con 0x55b8a6e0b440 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.961+0000 7f9f36000640 1 -- 172.21.15.8:0/1831123855 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f9f44048040 con 0x55b8a6e0b440 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.961+0000 7f9f55a3c740 10 client.25558 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.961+0000 7f9f55a3c740 10 client.25558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.961+0000 7f9f55a3c740 20 client.25558 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.961+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/1831123855 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b8a6e1b950 0x55b8a6e1dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.961+0000 7f9f55a3c740 4 client.25558 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.961+0000 7f9f55a3c740 1 -- 172.21.15.8:0/1831123855 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8a6ab9410 con 0x55b8a6e1b950 2024-03-16T20:58:11.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.962+0000 7f9f4be00640 1 --2- 172.21.15.8:0/1831123855 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b8a6e1b950 0x55b8a6e1dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.962+0000 7f9f4be00640 1 --2- 172.21.15.8:0/1831123855 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b8a6e1b950 0x55b8a6e1dd70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7533d6cf6814155 server_cookie=61bb058ef3e9332e in_seq=0 out_seq=0 2024-03-16T20:58:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.962+0000 7f9f36000640 10 client.25558 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f36000640 1 -- 172.21.15.8:0/1831123855 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55b8a6ab9410 con 0x55b8a6e1b950 2024-03-16T20:58:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f36000640 10 client.25558 handle_command_reply: tid=0 2024-03-16T20:58:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f55a3c740 1 client.25558 shutdown 2024-03-16T20:58:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f55a3c740 1 -- 172.21.15.8:0/1831123855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e0b440 msgr2=0x55b8a6e08e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/1831123855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e0b440 0x55b8a6e08e90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f44035000 tx=0x7f9f44009500 comp rx=0 tx=0).stop 2024-03-16T20:58:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f55a3c740 1 -- 172.21.15.8:0/1831123855 shutdown_connections 2024-03-16T20:58:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/1831123855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e0b440 0x55b8a6e08e90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/1831123855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e02860 0x55b8a6e08950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/1831123855 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b8a6e1b950 0x55b8a6e1dd70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/1831123855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e01f40 0x55b8a6e08410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f36000640 0 client.25558 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:11.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f55a3c740 1 -- 172.21.15.8:0/1831123855 >> 172.21.15.8:0/1831123855 conn(0x55b8a6dfc670 msgr2=0x55b8a6dfe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:11.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f55a3c740 1 -- 172.21.15.8:0/1831123855 shutdown_connections 2024-03-16T20:58:11.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.963+0000 7f9f55a3c740 1 -- 172.21.15.8:0/1831123855 wait complete. 2024-03-16T20:58:11.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.964+0000 7f9f55a3c740 20 client.25558 trim_cache size 0 max 16384 2024-03-16T20:58:11.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.981+0000 7f9f55a3c740 1 Processor -- start 2024-03-16T20:58:11.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.981+0000 7f9f55a3c740 1 -- start start 2024-03-16T20:58:11.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e01f40 0x55b8a6e08c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e02860 0x55b8a6e16820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e0b440 0x55b8a6e16d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6ab10c0 con 0x55b8a6e01f40 2024-03-16T20:58:11.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6df7f60 con 0x55b8a6e0b440 2024-03-16T20:58:11.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6e01ba0 con 0x55b8a6e02860 2024-03-16T20:58:11.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f4b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e02860 0x55b8a6e16820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f50e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e0b440 0x55b8a6e16d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f4b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e02860 0x55b8a6e16820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40150/0 (socket says 172.21.15.8:40150) 2024-03-16T20:58:11.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f50e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e0b440 0x55b8a6e16d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54746/0 (socket says 172.21.15.8:54746) 2024-03-16T20:58:11.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f4b400640 1 -- 172.21.15.8:0/2366970376 learned_addr learned my addr 172.21.15.8:0/2366970376 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:11.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f4be00640 1 --2- 172.21.15.8:0/2366970376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e01f40 0x55b8a6e08c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f4b400640 1 -- 172.21.15.8:0/2366970376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e0b440 msgr2=0x55b8a6e16d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f4b400640 1 --2- 172.21.15.8:0/2366970376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e0b440 0x55b8a6e16d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.982+0000 7f9f4b400640 1 -- 172.21.15.8:0/2366970376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e01f40 msgr2=0x55b8a6e08c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.983+0000 7f9f4b400640 1 --2- 172.21.15.8:0/2366970376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e01f40 0x55b8a6e08c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.983+0000 7f9f4b400640 1 -- 172.21.15.8:0/2366970376 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8a6d03a90 con 0x55b8a6e02860 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.983+0000 7f9f4be00640 1 --2- 172.21.15.8:0/2366970376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e01f40 0x55b8a6e08c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.983+0000 7f9f4b400640 1 --2- 172.21.15.8:0/2366970376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e02860 0x55b8a6e16820 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c6a0 tx=0x7f9f380ba040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c929bdff024dc78b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.983+0000 7f9f40c00640 1 -- 172.21.15.8:0/2366970376 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3809e8c0 con 0x55b8a6e02860 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.983+0000 7f9f40c00640 1 -- 172.21.15.8:0/2366970376 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9f380a2f10 con 0x55b8a6e02860 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.983+0000 7f9f40c00640 1 -- 172.21.15.8:0/2366970376 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380cb640 con 0x55b8a6e02860 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.984+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2366970376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e02860 msgr2=0x55b8a6e16820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.984+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/2366970376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e02860 0x55b8a6e16820 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c6a0 tx=0x7f9f380ba040 comp rx=0 tx=0).stop 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.984+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2366970376 shutdown_connections 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.984+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/2366970376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e0b440 0x55b8a6e16d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.984+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/2366970376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e02860 0x55b8a6e16820 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.984+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/2366970376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e01f40 0x55b8a6e08c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.984+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2366970376 >> 172.21.15.8:0/2366970376 conn(0x55b8a6dfc670 msgr2=0x55b8a6dfd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.984+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2366970376 shutdown_connections 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.984+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2366970376 wait complete. 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.984+0000 7f9f55a3c740 1 -- start start 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.984+0000 7f9f55a3c740 1 Processor -- start 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 0x55b8a6e10330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e02860 0x55b8a6e10870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f55a3c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e0b440 0x55b8a6e10db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6e064e0 con 0x55b8a6e02860 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6e77210 con 0x55b8a6e0b440 2024-03-16T20:58:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f55a3c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6e77380 con 0x55b8a6e01f40 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f55a3c740 10 client.0 _ll_register_callbacks cb 0x7f9f44009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 0x55b8a6e10330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f4b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e02860 0x55b8a6e10870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 0x55b8a6e10330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40156/0 (socket says 172.21.15.8:40156) 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f4be00640 1 -- 172.21.15.8:0/2302893391 learned_addr learned my addr 172.21.15.8:0/2302893391 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f50e00640 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e0b440 0x55b8a6e10db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.985+0000 7f9f4be00640 1 -- 172.21.15.8:0/2302893391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e0b440 msgr2=0x55b8a6e10db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f4be00640 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e0b440 0x55b8a6e10db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f4be00640 1 -- 172.21.15.8:0/2302893391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e02860 msgr2=0x55b8a6e10870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f4be00640 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e02860 0x55b8a6e10870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f4be00640 1 -- 172.21.15.8:0/2302893391 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c1aad80 con 0x55b8a6e01f40 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f4be00640 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 0x55b8a6e10330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0092a0 tx=0x7f9f3c009d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ca3659cc43bc9f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f36000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f36000640 1 -- 172.21.15.8:0/2302893391 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c02a070 con 0x55b8a6e01f40 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f36000640 1 -- 172.21.15.8:0/2302893391 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9f3c0049d0 con 0x55b8a6e01f40 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2302893391 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f3c005680 con 0x55b8a6e01f40 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f36000640 1 -- 172.21.15.8:0/2302893391 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f3c005bb0 con 0x55b8a6e01f40 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f55a3c740 10 client.25564 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.986+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2302893391 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b8a6d296a0 con 0x55b8a6e01f40 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.987+0000 7f9f36000640 1 -- 172.21.15.8:0/2302893391 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9f3c005680 con 0x55b8a6e01f40 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.987+0000 7f9f36000640 1 -- 172.21.15.8:0/2302893391 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f9f3c021040 con 0x55b8a6e01f40 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.987+0000 7f9f55a3c740 10 client.25564 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.987+0000 7f9f55a3c740 10 client.25564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.987+0000 7f9f55a3c740 20 client.25564 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.987+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b8a6e78b90 0x55b8a6e7afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.987+0000 7f9f55a3c740 4 client.25564 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T20:58:11.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.987+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2302893391 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b8a6aa57b0 con 0x55b8a6e78b90 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.987+0000 7f9f4b400640 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b8a6e78b90 0x55b8a6e7afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.988+0000 7f9f4b400640 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b8a6e78b90 0x55b8a6e7afb0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=448fc27962136ee6 server_cookie=a3c4a56bf780ca65 in_seq=0 out_seq=0 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.988+0000 7f9f36000640 10 client.25564 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f36000640 1 -- 172.21.15.8:0/2302893391 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b8a6aa57b0 con 0x55b8a6e78b90 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f36000640 10 client.25564 handle_command_reply: tid=0 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f55a3c740 1 client.25564 shutdown 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2302893391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 msgr2=0x55b8a6e10330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 0x55b8a6e10330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0092a0 tx=0x7f9f3c009d30 comp rx=0 tx=0).stop 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2302893391 shutdown_connections 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8a6e0b440 0x55b8a6e10db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b8a6e78b90 0x55b8a6e7afb0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8a6e02860 0x55b8a6e10870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f55a3c740 1 --2- 172.21.15.8:0/2302893391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b8a6e01f40 0x55b8a6e10330 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f36000640 0 client.25564 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2302893391 >> 172.21.15.8:0/2302893391 conn(0x55b8a6dfc670 msgr2=0x55b8a6dfdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2302893391 shutdown_connections 2024-03-16T20:58:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.989+0000 7f9f55a3c740 1 -- 172.21.15.8:0/2302893391 wait complete. 2024-03-16T20:58:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f55a3c740 20 client.25564 trim_cache size 0 max 16384 2024-03-16T20:58:11.998 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:58:11.998 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T20:58:11.998 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "248dd8dd-4bd2-4837-84b8-b15c072e1f07", 2024-03-16T20:58:11.998 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T20:58:11.998 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:58:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f52e00640 1 -- 172.21.15.8:0/3874736697 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9f300a1d40 msgr2=0x7f9f300a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f52e00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9f300a1d40 0x7f9f300a4200 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9f44033420 tx=0x7f9f44005fd0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f52e00640 1 -- 172.21.15.8:0/3874736697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f4c108450 msgr2=0x7f9f4c19e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f52e00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f4c108450 0x7f9f4c19e750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800e9f0 tx=0x7f9f3800eeb0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f52e00640 1 -- 172.21.15.8:0/3874736697 shutdown_connections 2024-03-16T20:58:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f52e00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9f300a1d40 0x7f9f300a4200 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f52e00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f4c10daa0 0x7f9f4c1a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f52e00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f4c108450 0x7f9f4c19e750 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f52e00640 1 --2- 172.21.15.8:0/3874736697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f4c107a90 0x7f9f4c19e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f52e00640 1 -- 172.21.15.8:0/3874736697 >> 172.21.15.8:0/3874736697 conn(0x7f9f4c075a30 msgr2=0x7f9f4c075f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:12.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.990+0000 7f9f52e00640 1 -- 172.21.15.8:0/3874736697 shutdown_connections 2024-03-16T20:58:12.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:11.991+0000 7f9f52e00640 1 -- 172.21.15.8:0/3874736697 wait complete. 2024-03-16T20:58:12.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T20:58:12.015 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T20:58:12.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.236+0000 7f2f2be00640 1 -- 172.21.15.8:0/2160745442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f2c109650 msgr2=0x7f2f2c109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:12.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.236+0000 7f2f2be00640 1 --2- 172.21.15.8:0/2160745442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f2c109650 0x7f2f2c109a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009930 tx=0x7f2f1c02bc20 comp rx=0 tx=0).stop 2024-03-16T20:58:12.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.236+0000 7f2f2be00640 1 -- 172.21.15.8:0/2160745442 shutdown_connections 2024-03-16T20:58:12.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.236+0000 7f2f2be00640 1 --2- 172.21.15.8:0/2160745442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f2c103f50 0x7f2f2c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.236+0000 7f2f2be00640 1 --2- 172.21.15.8:0/2160745442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f2c103590 0x7f2f2c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.236+0000 7f2f2be00640 1 --2- 172.21.15.8:0/2160745442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f2c109650 0x7f2f2c109a30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.236+0000 7f2f2be00640 1 -- 172.21.15.8:0/2160745442 >> 172.21.15.8:0/2160745442 conn(0x7f2f2c0ff020 msgr2=0x7f2f2c101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.236+0000 7f2f2be00640 1 -- 172.21.15.8:0/2160745442 shutdown_connections 2024-03-16T20:58:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.236+0000 7f2f2be00640 1 -- 172.21.15.8:0/2160745442 wait complete. 2024-03-16T20:58:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.237+0000 7f2f2be00640 1 Processor -- start 2024-03-16T20:58:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.237+0000 7f2f2be00640 1 -- start start 2024-03-16T20:58:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.238+0000 7f2f2be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f2c103590 0x7f2f2c19f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.238+0000 7f2f2be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f2c103f50 0x7f2f2c19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.238+0000 7f2f2be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f2c109650 0x7f2f2c199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.238+0000 7f2f2be00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c19a0f0 con 0x7f2f2c103590 2024-03-16T20:58:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.238+0000 7f2f2be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c19a260 con 0x7f2f2c109650 2024-03-16T20:58:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.238+0000 7f2f2be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c19a420 con 0x7f2f2c103f50 2024-03-16T20:58:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.238+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f2c103590 0x7f2f2c19f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.238+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f2c103590 0x7f2f2c19f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42298/0 (socket says 172.21.15.8:42298) 2024-03-16T20:58:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.238+0000 7f2f2aa00640 1 -- 172.21.15.8:0/752107941 learned_addr learned my addr 172.21.15.8:0/752107941 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.238+0000 7f2f2a000640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f2c103f50 0x7f2f2c19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.238+0000 7f2f2b400640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f2c109650 0x7f2f2c199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.239+0000 7f2f2aa00640 1 -- 172.21.15.8:0/752107941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f2c103f50 msgr2=0x7f2f2c19fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.239+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f2c103f50 0x7f2f2c19fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.239+0000 7f2f2aa00640 1 -- 172.21.15.8:0/752107941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f2c109650 msgr2=0x7f2f2c199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.239+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f2c109650 0x7f2f2c199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.239+0000 7f2f2aa00640 1 -- 172.21.15.8:0/752107941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c009560 con 0x7f2f2c103590 2024-03-16T20:58:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.239+0000 7f2f2a000640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f2c103f50 0x7f2f2c19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.239+0000 7f2f2b400640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f2c109650 0x7f2f2c199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.239+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f2c103590 0x7f2f2c19f8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c005ab0 tx=0x7f2f1c02cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.239+0000 7f2f23400640 1 -- 172.21.15.8:0/752107941 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c004250 con 0x7f2f2c103590 2024-03-16T20:58:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.239+0000 7f2f23400640 1 -- 172.21.15.8:0/752107941 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2f1c0043b0 con 0x7f2f2c103590 2024-03-16T20:58:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.239+0000 7f2f23400640 1 -- 172.21.15.8:0/752107941 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c003be0 con 0x7f2f2c103590 2024-03-16T20:58:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.240+0000 7f2f2be00640 1 -- 172.21.15.8:0/752107941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c19a6a0 con 0x7f2f2c103590 2024-03-16T20:58:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.240+0000 7f2f2be00640 1 -- 172.21.15.8:0/752107941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c1a6990 con 0x7f2f2c103590 2024-03-16T20:58:12.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.243+0000 7f2f3480a740 1 Processor -- start 2024-03-16T20:58:12.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.243+0000 7f2f3480a740 1 -- start start 2024-03-16T20:58:12.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f23400640 1 -- 172.21.15.8:0/752107941 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f2f1c003d40 con 0x7f2f2c103590 2024-03-16T20:58:12.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfd170 0x5555bccfbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 0x5555bccfc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bcd05800 0x5555bcd07bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f3480a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bcc6b150 con 0x5555bccfd170 2024-03-16T20:58:12.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f3480a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bcc68680 con 0x5555bccfc490 2024-03-16T20:58:12.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f3480a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bcc63e60 con 0x5555bcd05800 2024-03-16T20:58:12.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 0x5555bccfc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f2b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfd170 0x5555bccfbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f2a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bcd05800 0x5555bcd07bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 0x5555bccfc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:54782/0 (socket says 172.21.15.8:54782) 2024-03-16T20:58:12.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.244+0000 7f2f2aa00640 1 -- 172.21.15.8:0/1642463676 learned_addr learned my addr 172.21.15.8:0/1642463676 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:12.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.245+0000 7f2f2a000640 1 -- 172.21.15.8:0/1642463676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 msgr2=0x5555bccfc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:12.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.245+0000 7f2f2a000640 1 --2- 172.21.15.8:0/1642463676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 0x5555bccfc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.245+0000 7f2f2a000640 1 -- 172.21.15.8:0/1642463676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfd170 msgr2=0x5555bccfbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:12.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.245+0000 7f2f2a000640 1 --2- 172.21.15.8:0/1642463676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfd170 0x5555bccfbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.245+0000 7f2f2a000640 1 -- 172.21.15.8:0/1642463676 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555bcc1d060 con 0x5555bcd05800 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.245+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/1642463676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 0x5555bccfc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.245+0000 7f2f2a000640 1 --2- 172.21.15.8:0/1642463676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bcd05800 0x5555bcd07bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c19b290 tx=0x7f2f180118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0c95647815c3949 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.245+0000 7f2f17e00640 1 -- 172.21.15.8:0/1642463676 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18004030 con 0x5555bcd05800 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.245+0000 7f2f17e00640 1 -- 172.21.15.8:0/1642463676 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2f18005520 con 0x5555bcd05800 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.245+0000 7f2f17e00640 1 -- 172.21.15.8:0/1642463676 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18004d50 con 0x5555bcd05800 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.245+0000 7f2f23400640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2f100a1cc0 0x7f2f100a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.246+0000 7f2f23400640 1 -- 172.21.15.8:0/752107941 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2f1c0efed0 con 0x7f2f2c103590 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.246+0000 7f2f2b400640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2f100a1cc0 0x7f2f100a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.246+0000 7f2f3480a740 1 -- 172.21.15.8:0/1642463676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bcd05800 msgr2=0x5555bcd07bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.246+0000 7f2f3480a740 1 --2- 172.21.15.8:0/1642463676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bcd05800 0x5555bcd07bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c19b290 tx=0x7f2f180118d0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.246+0000 7f2f3480a740 1 -- 172.21.15.8:0/1642463676 shutdown_connections 2024-03-16T20:58:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.246+0000 7f2f3480a740 1 --2- 172.21.15.8:0/1642463676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bcd05800 0x5555bcd07bf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.246+0000 7f2f3480a740 1 --2- 172.21.15.8:0/1642463676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 0x5555bccfc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.246+0000 7f2f3480a740 1 --2- 172.21.15.8:0/1642463676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfd170 0x5555bccfbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.246+0000 7f2f3480a740 1 -- 172.21.15.8:0/1642463676 >> 172.21.15.8:0/1642463676 conn(0x5555bccc35a0 msgr2=0x5555bccf6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:12.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.246+0000 7f2f3480a740 1 -- 172.21.15.8:0/1642463676 shutdown_connections 2024-03-16T20:58:12.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.246+0000 7f2f3480a740 1 -- 172.21.15.8:0/1642463676 wait complete. 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.247+0000 7f2f2b400640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2f100a1cc0 0x7f2f100a4180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009fd0 tx=0x7f2f24009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.247+0000 7f2f3480a740 1 -- start start 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.247+0000 7f2f3480a740 1 Processor -- start 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.247+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 0x5555bcd02790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.247+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 0x5555bcd02cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bcd05800 0x5555bcd03210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f3480a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bcc08ec0 con 0x5555bcd05800 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f3480a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bcc08b60 con 0x5555bccfc490 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f3480a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bc9d21c0 con 0x5555bccfd170 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f3480a740 10 client.0 _ll_register_callbacks cb 0x5555bcc1c960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f2b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bcd05800 0x5555bcd03210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f2a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 0x5555bcd02cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 0x5555bcd02790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f2a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 0x5555bcd02cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40212/0 (socket says 172.21.15.8:40212) 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f2a000640 1 -- 172.21.15.8:0/2881951706 learned_addr learned my addr 172.21.15.8:0/2881951706 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f2aa00640 1 -- 172.21.15.8:0/2881951706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 msgr2=0x5555bcd02cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/2881951706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 0x5555bcd02cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f2aa00640 1 -- 172.21.15.8:0/2881951706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bcd05800 msgr2=0x5555bcd03210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/2881951706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bcd05800 0x5555bcd03210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f2aa00640 1 -- 172.21.15.8:0/2881951706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f18009c00 con 0x5555bccfc490 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/2881951706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 0x5555bcd02790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0edc50 tx=0x7f2f1c0035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e88c0f68e47f670 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.248+0000 7f2f14c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f14c00640 1 -- 172.21.15.8:0/2881951706 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0f3e70 con 0x5555bccfc490 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f14c00640 1 -- 172.21.15.8:0/2881951706 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2f1c0bd0f0 con 0x5555bccfc490 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f3480a740 1 -- 172.21.15.8:0/2881951706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555bc9637e0 con 0x5555bccfc490 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f14c00640 1 -- 172.21.15.8:0/2881951706 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f1c0b8c90 con 0x5555bccfc490 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f3480a740 10 client.25577 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f3480a740 1 -- 172.21.15.8:0/2881951706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5555bcc624e0 con 0x5555bccfc490 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f14c00640 1 -- 172.21.15.8:0/2881951706 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5555bc9637e0 con 0x5555bccfc490 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f14c00640 1 -- 172.21.15.8:0/2881951706 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f2f1c0bdd20 con 0x5555bccfc490 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f3480a740 10 client.25577 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f3480a740 10 client.25577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f3480a740 20 client.25577 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.249+0000 7f2f3480a740 1 --2- 172.21.15.8:0/2881951706 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5555bcd15710 0x5555bcd17b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.250+0000 7f2f3480a740 4 client.25577 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.250+0000 7f2f3480a740 1 -- 172.21.15.8:0/2881951706 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555bc9a0720 con 0x5555bcd15710 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.250+0000 7f2f2a000640 1 --2- 172.21.15.8:0/2881951706 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5555bcd15710 0x5555bcd17b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.250+0000 7f2f2a000640 1 --2- 172.21.15.8:0/2881951706 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5555bcd15710 0x5555bcd17b00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=577cc123a0e65f19 server_cookie=afa5f84a340a64c0 in_seq=0 out_seq=0 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.250+0000 7f2f14c00640 10 client.25577 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f14c00640 1 -- 172.21.15.8:0/2881951706 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5555bc9a0720 con 0x5555bcd15710 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f14c00640 10 client.25577 handle_command_reply: tid=0 2024-03-16T20:58:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f3480a740 1 client.25577 shutdown 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f3480a740 1 -- 172.21.15.8:0/2881951706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 msgr2=0x5555bcd02790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f3480a740 1 --2- 172.21.15.8:0/2881951706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 0x5555bcd02790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0edc50 tx=0x7f2f1c0035f0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f3480a740 1 -- 172.21.15.8:0/2881951706 shutdown_connections 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f3480a740 1 --2- 172.21.15.8:0/2881951706 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5555bcd15710 0x5555bcd17b00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f3480a740 1 --2- 172.21.15.8:0/2881951706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bcd05800 0x5555bcd03210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f3480a740 1 --2- 172.21.15.8:0/2881951706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 0x5555bcd02cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f3480a740 1 --2- 172.21.15.8:0/2881951706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bccfc490 0x5555bcd02790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f14c00640 0 client.25577 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f3480a740 1 -- 172.21.15.8:0/2881951706 >> 172.21.15.8:0/2881951706 conn(0x5555bccc35a0 msgr2=0x5555bccf8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.251+0000 7f2f3480a740 1 -- 172.21.15.8:0/2881951706 shutdown_connections 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.252+0000 7f2f3480a740 1 -- 172.21.15.8:0/2881951706 wait complete. 2024-03-16T20:58:12.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.252+0000 7f2f3480a740 20 client.25577 trim_cache size 0 max 16384 2024-03-16T20:58:12.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.269+0000 7f2f3480a740 1 Processor -- start 2024-03-16T20:58:12.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.269+0000 7f2f3480a740 1 -- start start 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfc490 0x5555bcd04ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfd170 0x5555bccf8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bcd05800 0x5555bcd10c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f3480a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bccf8080 con 0x5555bccfd170 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f3480a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bccfb4c0 con 0x5555bcd05800 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f3480a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bcd00ce0 con 0x5555bccfc490 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfc490 0x5555bcd04ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfc490 0x5555bcd04ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40228/0 (socket says 172.21.15.8:40228) 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2aa00640 1 -- 172.21.15.8:0/4001544421 learned_addr learned my addr 172.21.15.8:0/4001544421 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2b400640 1 --2- 172.21.15.8:0/4001544421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bcd05800 0x5555bcd10c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2a000640 1 --2- 172.21.15.8:0/4001544421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfd170 0x5555bccf8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2aa00640 1 -- 172.21.15.8:0/4001544421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bcd05800 msgr2=0x5555bcd10c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/4001544421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bcd05800 0x5555bcd10c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2aa00640 1 -- 172.21.15.8:0/4001544421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfd170 msgr2=0x5555bccf8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/4001544421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfd170 0x5555bccf8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2aa00640 1 -- 172.21.15.8:0/4001544421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555bcbfe950 con 0x5555bccfc490 2024-03-16T20:58:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2a000640 1 --2- 172.21.15.8:0/4001544421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfd170 0x5555bccf8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.270+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/4001544421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfc490 0x5555bcd04ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c02c200 tx=0x7f2f1c003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=208e093e17ca0a9d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.271+0000 7f2f17400640 1 -- 172.21.15.8:0/4001544421 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0c4f50 con 0x5555bccfc490 2024-03-16T20:58:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.271+0000 7f2f17400640 1 -- 172.21.15.8:0/4001544421 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2f1c0c0b40 con 0x5555bccfc490 2024-03-16T20:58:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.271+0000 7f2f17400640 1 -- 172.21.15.8:0/4001544421 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0f32d0 con 0x5555bccfc490 2024-03-16T20:58:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.271+0000 7f2f3480a740 1 -- 172.21.15.8:0/4001544421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfc490 msgr2=0x5555bcd04ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.271+0000 7f2f3480a740 1 --2- 172.21.15.8:0/4001544421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfc490 0x5555bcd04ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c02c200 tx=0x7f2f1c003680 comp rx=0 tx=0).stop 2024-03-16T20:58:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.271+0000 7f2f3480a740 1 -- 172.21.15.8:0/4001544421 shutdown_connections 2024-03-16T20:58:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.271+0000 7f2f3480a740 1 --2- 172.21.15.8:0/4001544421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bcd05800 0x5555bcd10c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.271+0000 7f2f3480a740 1 --2- 172.21.15.8:0/4001544421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfd170 0x5555bccf8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.271+0000 7f2f3480a740 1 --2- 172.21.15.8:0/4001544421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfc490 0x5555bcd04ec0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.271+0000 7f2f3480a740 1 -- 172.21.15.8:0/4001544421 >> 172.21.15.8:0/4001544421 conn(0x5555bccc35a0 msgr2=0x5555bccf8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.272+0000 7f2f3480a740 1 -- 172.21.15.8:0/4001544421 shutdown_connections 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.272+0000 7f2f3480a740 1 -- 172.21.15.8:0/4001544421 wait complete. 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.272+0000 7f2f3480a740 1 -- start start 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.272+0000 7f2f3480a740 1 Processor -- start 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfc490 0x5555bccffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 0x5555bccfff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f3480a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bcd05800 0x5555bcd061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f3480a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bcd00830 con 0x5555bccfc490 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f3480a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bcd066e0 con 0x5555bcd05800 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f3480a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bcd068a0 con 0x5555bccfd170 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f3480a740 10 client.0 _ll_register_callbacks cb 0x7f2f1c0f3690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f2a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 0x5555bccfff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f2a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 0x5555bccfff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40244/0 (socket says 172.21.15.8:40244) 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f2a000640 1 -- 172.21.15.8:0/1217064164 learned_addr learned my addr 172.21.15.8:0/1217064164 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfc490 0x5555bccffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f2b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bcd05800 0x5555bcd061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f2a000640 1 -- 172.21.15.8:0/1217064164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bcd05800 msgr2=0x5555bcd061a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f2a000640 1 --2- 172.21.15.8:0/1217064164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bcd05800 0x5555bcd061a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f2a000640 1 -- 172.21.15.8:0/1217064164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfc490 msgr2=0x5555bccffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f2a000640 1 --2- 172.21.15.8:0/1217064164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfc490 0x5555bccffa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.273+0000 7f2f2a000640 1 -- 172.21.15.8:0/1217064164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555bcc624e0 con 0x5555bccfd170 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.274+0000 7f2f2a000640 1 --2- 172.21.15.8:0/1217064164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 0x5555bccfff50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2f18004cf0 tx=0x7f2f18005690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb81d27a423ea680 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.274+0000 7f2f14c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.274+0000 7f2f14c00640 1 -- 172.21.15.8:0/1217064164 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18004da0 con 0x5555bccfd170 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.274+0000 7f2f14c00640 1 -- 172.21.15.8:0/1217064164 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2f18027040 con 0x5555bccfd170 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.274+0000 7f2f3480a740 1 -- 172.21.15.8:0/1217064164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f18005520 con 0x5555bccfd170 2024-03-16T20:58:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.274+0000 7f2f14c00640 1 -- 172.21.15.8:0/1217064164 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f18004f00 con 0x5555bccfd170 2024-03-16T20:58:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.274+0000 7f2f3480a740 10 client.25582 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.274+0000 7f2f3480a740 1 -- 172.21.15.8:0/1217064164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5555bcc24430 con 0x5555bccfd170 2024-03-16T20:58:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.275+0000 7f2f14c00640 1 -- 172.21.15.8:0/1217064164 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2f18005520 con 0x5555bccfd170 2024-03-16T20:58:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.275+0000 7f2f14c00640 1 -- 172.21.15.8:0/1217064164 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f2f1802b050 con 0x5555bccfd170 2024-03-16T20:58:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.275+0000 7f2f3480a740 10 client.25582 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.275+0000 7f2f3480a740 10 client.25582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.275+0000 7f2f3480a740 20 client.25582 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.275+0000 7f2f3480a740 1 --2- 172.21.15.8:0/1217064164 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5555bcd71d80 0x5555bcd741a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.275+0000 7f2f3480a740 4 client.25582 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T20:58:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.275+0000 7f2f3480a740 1 -- 172.21.15.8:0/1217064164 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5555bc9ef890 con 0x5555bcd71d80 2024-03-16T20:58:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.275+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/1217064164 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5555bcd71d80 0x5555bcd741a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f2aa00640 1 --2- 172.21.15.8:0/1217064164 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5555bcd71d80 0x5555bcd741a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8571af86bfb0e4cd server_cookie=b34a3edb51a3430c in_seq=0 out_seq=0 2024-03-16T20:58:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f14c00640 10 client.25582 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f14c00640 1 -- 172.21.15.8:0/1217064164 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5555bc9ef890 con 0x5555bcd71d80 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f14c00640 10 client.25582 handle_command_reply: tid=0 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 1 client.25582 shutdown 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 1 -- 172.21.15.8:0/1217064164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 msgr2=0x5555bccfff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 1 --2- 172.21.15.8:0/1217064164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 0x5555bccfff50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2f18004cf0 tx=0x7f2f18005690 comp rx=0 tx=0).stop 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 1 -- 172.21.15.8:0/1217064164 shutdown_connections 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 1 --2- 172.21.15.8:0/1217064164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555bcd05800 0x5555bcd061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 1 --2- 172.21.15.8:0/1217064164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5555bccfd170 0x5555bccfff50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 1 --2- 172.21.15.8:0/1217064164 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5555bcd71d80 0x5555bcd741a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 1 --2- 172.21.15.8:0/1217064164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555bccfc490 0x5555bccffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 1 -- 172.21.15.8:0/1217064164 >> 172.21.15.8:0/1217064164 conn(0x5555bccc35a0 msgr2=0x5555bccf5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f14c00640 0 client.25582 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 1 -- 172.21.15.8:0/1217064164 shutdown_connections 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 1 -- 172.21.15.8:0/1217064164 wait complete. 2024-03-16T20:58:12.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.276+0000 7f2f3480a740 20 client.25582 trim_cache size 0 max 16384 2024-03-16T20:58:12.286 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:58:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T20:58:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T20:58:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "248dd8dd-4bd2-4837-84b8-b15c072e1f07": { 2024-03-16T20:58:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T20:58:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "248dd8dd-4bd2-4837-84b8-b15c072e1f07", 2024-03-16T20:58:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T20:58:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T20:58:12.286 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T20:58:12.287 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:58:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 -- 172.21.15.8:0/752107941 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2f100a1cc0 msgr2=0x7f2f100a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2f100a1cc0 0x7f2f100a4180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009fd0 tx=0x7f2f24009500 comp rx=0 tx=0).stop 2024-03-16T20:58:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 -- 172.21.15.8:0/752107941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f2c103590 msgr2=0x7f2f2c19f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f2c103590 0x7f2f2c19f8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c005ab0 tx=0x7f2f1c02cc10 comp rx=0 tx=0).stop 2024-03-16T20:58:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 -- 172.21.15.8:0/752107941 shutdown_connections 2024-03-16T20:58:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2f100a1cc0 0x7f2f100a4180 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f2c109650 0x7f2f2c199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f2c103f50 0x7f2f2c19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 --2- 172.21.15.8:0/752107941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f2c103590 0x7f2f2c19f8f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 -- 172.21.15.8:0/752107941 >> 172.21.15.8:0/752107941 conn(0x7f2f2c0ff020 msgr2=0x7f2f2c1005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 -- 172.21.15.8:0/752107941 shutdown_connections 2024-03-16T20:58:12.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:12.277+0000 7f2f2be00640 1 -- 172.21.15.8:0/752107941 wait complete. 2024-03-16T20:58:12.299 INFO:tasks.cephfs.filesystem:scrub status for tag:248dd8dd-4bd2-4837-84b8-b15c072e1f07 - {'path': '/', 'tag': '248dd8dd-4bd2-4837-84b8-b15c072e1f07', 'options': 'recursive,force'} 2024-03-16T20:58:13.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:13 smithi170 ceph-mon[35947]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-03-16T20:58:13.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:13 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T20:58:13.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:13 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:13.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:13 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T20:58:13.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:13 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:13.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:13 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T20:58:13.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:13 smithi186 ceph-mon[36391]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-03-16T20:58:13.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:13 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T20:58:13.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:13 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:13.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:13 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T20:58:13.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:13 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:13.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:13 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T20:58:13.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:13 smithi008 ceph-mon[31434]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-03-16T20:58:13.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:13 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T20:58:13.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:13 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:13.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:13 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T20:58:13.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:13 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:13.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:13 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T20:58:15.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:15 smithi170 ceph-mon[35947]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-16T20:58:15.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:15 smithi186 ceph-mon[36391]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-16T20:58:15.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:15 smithi008 ceph-mon[31434]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-16T20:58:17.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:17 smithi170 ceph-mon[35947]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-16T20:58:17.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:17 smithi186 ceph-mon[36391]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-16T20:58:17.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:17 smithi008 ceph-mon[31434]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-03-16T20:58:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.577+0000 7fad75800640 1 -- 172.21.15.8:0/2512135528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad70103ec0 msgr2=0x7fad70110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.577+0000 7fad75800640 1 --2- 172.21.15.8:0/2512135528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad70103ec0 0x7fad70110380 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fad68009930 tx=0x7fad6802bc20 comp rx=0 tx=0).stop 2024-03-16T20:58:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.577+0000 7fad75800640 1 -- 172.21.15.8:0/2512135528 shutdown_connections 2024-03-16T20:58:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.577+0000 7fad75800640 1 --2- 172.21.15.8:0/2512135528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad70103ec0 0x7fad70110380 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.577+0000 7fad75800640 1 --2- 172.21.15.8:0/2512135528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70103500 0x7fad70103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.577+0000 7fad75800640 1 --2- 172.21.15.8:0/2512135528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad701095c0 0x7fad701099a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.577+0000 7fad75800640 1 -- 172.21.15.8:0/2512135528 >> 172.21.15.8:0/2512135528 conn(0x7fad700fefd0 msgr2=0x7fad701013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.577+0000 7fad75800640 1 -- 172.21.15.8:0/2512135528 shutdown_connections 2024-03-16T20:58:18.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.577+0000 7fad75800640 1 -- 172.21.15.8:0/2512135528 wait complete. 2024-03-16T20:58:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.578+0000 7fad75800640 1 Processor -- start 2024-03-16T20:58:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad75800640 1 -- start start 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad75800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad70103500 0x7fad7019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad75800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70103ec0 0x7fad7019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad75800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad701095c0 0x7fad701999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad75800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7019a000 con 0x7fad70103500 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad75800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7019a170 con 0x7fad70103ec0 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad75800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7019a330 con 0x7fad701095c0 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad6fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad70103500 0x7fad7019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad6f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70103ec0 0x7fad7019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad74e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad701095c0 0x7fad701999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad6fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad70103500 0x7fad7019f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34236/0 (socket says 172.21.15.8:34236) 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad6fe00640 1 -- 172.21.15.8:0/3265934518 learned_addr learned my addr 172.21.15.8:0/3265934518 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:18.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.579+0000 7fad6f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70103ec0 0x7fad7019fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:53934/0 (socket says 172.21.15.8:53934) 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.580+0000 7fad6fe00640 1 -- 172.21.15.8:0/3265934518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad701095c0 msgr2=0x7fad701999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.580+0000 7fad6fe00640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad701095c0 0x7fad701999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.580+0000 7fad6fe00640 1 -- 172.21.15.8:0/3265934518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70103ec0 msgr2=0x7fad7019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.580+0000 7fad6fe00640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70103ec0 0x7fad7019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.580+0000 7fad6fe00640 1 -- 172.21.15.8:0/3265934518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68009560 con 0x7fad70103500 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.580+0000 7fad74e00640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad701095c0 0x7fad701999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.580+0000 7fad6fe00640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad70103500 0x7fad7019f800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad5800e9f0 tx=0x7fad5800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.580+0000 7fad6cc00640 1 -- 172.21.15.8:0/3265934518 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58009700 con 0x7fad70103500 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.580+0000 7fad75800640 1 -- 172.21.15.8:0/3265934518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7019a610 con 0x7fad70103500 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.580+0000 7fad6cc00640 1 -- 172.21.15.8:0/3265934518 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fad5800cd80 con 0x7fad70103500 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.580+0000 7fad6cc00640 1 -- 172.21.15.8:0/3265934518 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad580189c0 con 0x7fad70103500 2024-03-16T20:58:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.581+0000 7fad75800640 1 -- 172.21.15.8:0/3265934518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad701a68a0 con 0x7fad70103500 2024-03-16T20:58:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.584+0000 7fad79bd5740 1 Processor -- start 2024-03-16T20:58:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.584+0000 7fad79bd5740 1 -- start start 2024-03-16T20:58:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef31ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef31ff0 0x56128ef32470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef3d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad79bd5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128eeed620 con 0x56128ef3b570 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad79bd5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128ee9f8c0 con 0x56128ef31ff0 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad79bd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128ee9cdf0 con 0x56128ef32d60 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad74e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef31ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad6cc00640 1 -- 172.21.15.8:0/3265934518 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7fad58018b20 con 0x7fad70103500 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad74e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef31ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57242/0 (socket says 172.21.15.8:57242) 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad74e00640 1 -- 172.21.15.8:0/1256080827 learned_addr learned my addr 172.21.15.8:0/1256080827 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad6f400640 1 --2- 172.21.15.8:0/1256080827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef3d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad6fe00640 1 --2- 172.21.15.8:0/1256080827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef31ff0 0x56128ef32470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad74e00640 1 -- 172.21.15.8:0/1256080827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef31ff0 msgr2=0x56128ef32470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad74e00640 1 --2- 172.21.15.8:0/1256080827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef31ff0 0x56128ef32470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad74e00640 1 -- 172.21.15.8:0/1256080827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 msgr2=0x56128ef3d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad74e00640 1 --2- 172.21.15.8:0/1256080827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef3d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad74e00640 1 -- 172.21.15.8:0/1256080827 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56128ee19b00 con 0x56128ef32d60 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad6fe00640 1 --2- 172.21.15.8:0/1256080827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef31ff0 0x56128ef32470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.585+0000 7fad6f400640 1 --2- 172.21.15.8:0/1256080827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef3d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.586+0000 7fad74e00640 1 --2- 172.21.15.8:0/1256080827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef31ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fad68009900 tx=0x7fad68004a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48d1249a9230f573 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.586+0000 7fad65600640 1 -- 172.21.15.8:0/1256080827 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6802c680 con 0x56128ef32d60 2024-03-16T20:58:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.586+0000 7fad65600640 1 -- 172.21.15.8:0/1256080827 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fad68004040 con 0x56128ef32d60 2024-03-16T20:58:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.586+0000 7fad65600640 1 -- 172.21.15.8:0/1256080827 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad680053b0 con 0x56128ef32d60 2024-03-16T20:58:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad6cc00640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fad540a1cb0 0x7fad540a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad79bd5740 1 -- 172.21.15.8:0/1256080827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 msgr2=0x56128ef31ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1256080827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef31ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fad68009900 tx=0x7fad68004a70 comp rx=0 tx=0).stop 2024-03-16T20:58:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad79bd5740 1 -- 172.21.15.8:0/1256080827 shutdown_connections 2024-03-16T20:58:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1256080827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef3d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1256080827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef31ff0 0x56128ef32470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1256080827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef31ab0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad79bd5740 1 -- 172.21.15.8:0/1256080827 >> 172.21.15.8:0/1256080827 conn(0x56128eef94b0 msgr2=0x56128ef2cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad6cc00640 1 -- 172.21.15.8:0/3265934518 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fad58014070 con 0x7fad70103500 2024-03-16T20:58:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad6fe00640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fad540a1cb0 0x7fad540a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad79bd5740 1 -- 172.21.15.8:0/1256080827 shutdown_connections 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.587+0000 7fad79bd5740 1 -- 172.21.15.8:0/1256080827 wait complete. 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.588+0000 7fad79bd5740 1 -- start start 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.588+0000 7fad6fe00640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fad540a1cb0 0x7fad540a4170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fad580cb410 tx=0x7fad58000bc0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.588+0000 7fad79bd5740 1 Processor -- start 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.588+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef31ff0 0x56128ef38630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.588+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef38b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.588+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef3b570 0x56128ef390b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.588+0000 7fad79bd5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128ee985d0 con 0x56128ef31ff0 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad79bd5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128ee3db50 con 0x56128ef3b570 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad79bd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128ee3d7f0 con 0x56128ef32d60 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad79bd5740 10 client.0 _ll_register_callbacks cb 0x56128ee51550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad74e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef31ff0 0x56128ef38630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad6f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef38b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad74e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef31ff0 0x56128ef38630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34252/0 (socket says 172.21.15.8:34252) 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad74e00640 1 -- 172.21.15.8:0/1024624902 learned_addr learned my addr 172.21.15.8:0/1024624902 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad74e00640 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef3b570 0x56128ef390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad6f400640 1 -- 172.21.15.8:0/1024624902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef3b570 msgr2=0x56128ef390b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad6f400640 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef3b570 0x56128ef390b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad6f400640 1 -- 172.21.15.8:0/1024624902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef31ff0 msgr2=0x56128ef38630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad6f400640 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef31ff0 0x56128ef38630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad6f400640 1 -- 172.21.15.8:0/1024624902 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad70110c80 con 0x56128ef32d60 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.589+0000 7fad74e00640 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef31ff0 0x56128ef38630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.590+0000 7fad6f400640 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef38b70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56128ef32a90 tx=0x7fad6000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87e1d3aa56998410 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.590+0000 7fad5e000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.590+0000 7fad5e000640 1 -- 172.21.15.8:0/1024624902 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60016070 con 0x56128ef32d60 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.590+0000 7fad5e000640 1 -- 172.21.15.8:0/1024624902 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fad60003970 con 0x56128ef32d60 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.590+0000 7fad79bd5740 1 -- 172.21.15.8:0/1024624902 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56128ee6acd0 con 0x56128ef32d60 2024-03-16T20:58:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.590+0000 7fad5e000640 1 -- 172.21.15.8:0/1024624902 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad6000fe50 con 0x56128ef32d60 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.590+0000 7fad79bd5740 10 client.25594 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.590+0000 7fad79bd5740 1 -- 172.21.15.8:0/1024624902 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56128ee96c50 con 0x56128ef32d60 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.590+0000 7fad5e000640 1 -- 172.21.15.8:0/1024624902 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fad60027080 con 0x56128ef32d60 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.591+0000 7fad5e000640 1 -- 172.21.15.8:0/1024624902 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fad60004c20 con 0x56128ef32d60 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.591+0000 7fad79bd5740 10 client.25594 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.591+0000 7fad79bd5740 10 client.25594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.591+0000 7fad79bd5740 20 client.25594 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.591+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56128ef4b520 0x56128ef4d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.591+0000 7fad79bd5740 4 client.25594 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.591+0000 7fad79bd5740 1 -- 172.21.15.8:0/1024624902 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56128ee8ece0 con 0x56128ef4b520 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.591+0000 7fad74e00640 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56128ef4b520 0x56128ef4d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.591+0000 7fad74e00640 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56128ef4b520 0x56128ef4d940 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fca93ac5a2264d0 server_cookie=64f246d9a84b7729 in_seq=0 out_seq=0 2024-03-16T20:58:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.591+0000 7fad5e000640 10 client.25594 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad5e000640 1 -- 172.21.15.8:0/1024624902 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56128ee8ece0 con 0x56128ef4b520 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad5e000640 10 client.25594 handle_command_reply: tid=0 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad79bd5740 1 client.25594 shutdown 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad79bd5740 1 -- 172.21.15.8:0/1024624902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 msgr2=0x56128ef38b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef38b70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56128ef32a90 tx=0x7fad6000f790 comp rx=0 tx=0).stop 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad79bd5740 1 -- 172.21.15.8:0/1024624902 shutdown_connections 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef3b570 0x56128ef390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef38b70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56128ef4b520 0x56128ef4d940 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1024624902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef31ff0 0x56128ef38630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad79bd5740 1 -- 172.21.15.8:0/1024624902 >> 172.21.15.8:0/1024624902 conn(0x56128eef94b0 msgr2=0x56128ef2ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.592+0000 7fad5e000640 0 client.25594 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.593+0000 7fad79bd5740 1 -- 172.21.15.8:0/1024624902 shutdown_connections 2024-03-16T20:58:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.593+0000 7fad79bd5740 1 -- 172.21.15.8:0/1024624902 wait complete. 2024-03-16T20:58:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.593+0000 7fad79bd5740 20 client.25594 trim_cache size 0 max 16384 2024-03-16T20:58:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.608+0000 7fad79bd5740 1 Processor -- start 2024-03-16T20:58:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.608+0000 7fad79bd5740 1 -- start start 2024-03-16T20:58:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.608+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef31ff0 0x56128ef3ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.608+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef32d60 0x56128ef46810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.608+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef46d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.608+0000 7fad79bd5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128ebe0e60 con 0x56128ef3b570 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.608+0000 7fad79bd5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128ef342e0 con 0x56128ef32d60 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.608+0000 7fad79bd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128ee8ece0 con 0x56128ef31ff0 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.609+0000 7fad74e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef31ff0 0x56128ef3ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.609+0000 7fad6f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef32d60 0x56128ef46810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.609+0000 7fad74e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef46d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.609+0000 7fad6f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef32d60 0x56128ef46810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:53972/0 (socket says 172.21.15.8:53972) 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.609+0000 7fad74e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef31ff0 0x56128ef3ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57258/0 (socket says 172.21.15.8:57258) 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.609+0000 7fad6f400640 1 -- 172.21.15.8:0/868262956 learned_addr learned my addr 172.21.15.8:0/868262956 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.609+0000 7fad74e00640 1 -- 172.21.15.8:0/868262956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef32d60 msgr2=0x56128ef46810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.609+0000 7fad74e00640 1 --2- 172.21.15.8:0/868262956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef32d60 0x56128ef46810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.609+0000 7fad74e00640 1 -- 172.21.15.8:0/868262956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 msgr2=0x56128ef46d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.609+0000 7fad74e00640 1 --2- 172.21.15.8:0/868262956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef46d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.609+0000 7fad74e00640 1 -- 172.21.15.8:0/868262956 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56128ee33530 con 0x56128ef31ff0 2024-03-16T20:58:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.610+0000 7fad74e00640 1 --2- 172.21.15.8:0/868262956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef31ff0 0x56128ef3ad60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fad68004f30 tx=0x7fad68004f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fbda7dbf9b9e4de server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.610+0000 7fad64c00640 1 -- 172.21.15.8:0/868262956 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68058350 con 0x56128ef31ff0 2024-03-16T20:58:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.610+0000 7fad64c00640 1 -- 172.21.15.8:0/868262956 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fad680586b0 con 0x56128ef31ff0 2024-03-16T20:58:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.610+0000 7fad64c00640 1 -- 172.21.15.8:0/868262956 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6804a450 con 0x56128ef31ff0 2024-03-16T20:58:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.611+0000 7fad79bd5740 1 -- 172.21.15.8:0/868262956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef31ff0 msgr2=0x56128ef3ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.611+0000 7fad79bd5740 1 --2- 172.21.15.8:0/868262956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef31ff0 0x56128ef3ad60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fad68004f30 tx=0x7fad68004f90 comp rx=0 tx=0).stop 2024-03-16T20:58:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.611+0000 7fad79bd5740 1 -- 172.21.15.8:0/868262956 shutdown_connections 2024-03-16T20:58:18.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.611+0000 7fad79bd5740 1 --2- 172.21.15.8:0/868262956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef46d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.611+0000 7fad79bd5740 1 --2- 172.21.15.8:0/868262956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef32d60 0x56128ef46810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.611+0000 7fad79bd5740 1 --2- 172.21.15.8:0/868262956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef31ff0 0x56128ef3ad60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.611+0000 7fad79bd5740 1 -- 172.21.15.8:0/868262956 >> 172.21.15.8:0/868262956 conn(0x56128eef94b0 msgr2=0x56128ef2c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.611+0000 7fad79bd5740 1 -- 172.21.15.8:0/868262956 shutdown_connections 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.611+0000 7fad79bd5740 1 -- 172.21.15.8:0/868262956 wait complete. 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.611+0000 7fad79bd5740 1 -- start start 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.611+0000 7fad79bd5740 1 Processor -- start 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef31ff0 0x56128ef3d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad79bd5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef36030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad79bd5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128ef36730 con 0x56128ef3b570 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad79bd5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128ef3bb30 con 0x56128ef31ff0 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad79bd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128ef3bcf0 con 0x56128ef32d60 2024-03-16T20:58:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad79bd5740 10 client.0 _ll_register_callbacks cb 0x7fad60011920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad6f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad6f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57268/0 (socket says 172.21.15.8:57268) 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad6f400640 1 -- 172.21.15.8:0/1852820195 learned_addr learned my addr 172.21.15.8:0/1852820195 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad74e00640 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef31ff0 0x56128ef3d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.612+0000 7fad74e00640 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef36030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad6f400640 1 -- 172.21.15.8:0/1852820195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef31ff0 msgr2=0x56128ef3d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad6f400640 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef31ff0 0x56128ef3d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad6f400640 1 -- 172.21.15.8:0/1852820195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 msgr2=0x56128ef36030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad6f400640 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef36030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad6f400640 1 -- 172.21.15.8:0/1852820195 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad68052040 con 0x56128ef32d60 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad74e00640 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef36030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad6f400640 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef358f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad60023500 tx=0x7fad60003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18f5a404e9f053b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad5e000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad5e000640 1 -- 172.21.15.8:0/1852820195 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60016040 con 0x56128ef32d60 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad5e000640 1 -- 172.21.15.8:0/1852820195 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fad60023870 con 0x56128ef32d60 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad79bd5740 1 -- 172.21.15.8:0/1852820195 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56128ef38460 con 0x56128ef32d60 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad5e000640 1 -- 172.21.15.8:0/1852820195 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad60009570 con 0x56128ef32d60 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad79bd5740 10 client.25600 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.613+0000 7fad79bd5740 1 -- 172.21.15.8:0/1852820195 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56128ee592c0 con 0x56128ef32d60 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.614+0000 7fad5e000640 1 -- 172.21.15.8:0/1852820195 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x56128ef38460 con 0x56128ef32d60 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.614+0000 7fad5e000640 1 -- 172.21.15.8:0/1852820195 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fad6002faa0 con 0x56128ef32d60 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.614+0000 7fad79bd5740 10 client.25600 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.614+0000 7fad79bd5740 10 client.25600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.614+0000 7fad79bd5740 20 client.25600 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.614+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56128efa7730 0x56128efa9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.614+0000 7fad79bd5740 4 client.25600 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.614+0000 7fad79bd5740 1 -- 172.21.15.8:0/1852820195 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56128eebdd30 con 0x56128efa7730 2024-03-16T20:58:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.614+0000 7fad74e00640 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56128efa7730 0x56128efa9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.614+0000 7fad74e00640 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56128efa7730 0x56128efa9b50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee4df2c045c43213 server_cookie=29932ad453758b39 in_seq=0 out_seq=0 2024-03-16T20:58:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.614+0000 7fad5e000640 10 client.25600 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad5e000640 1 -- 172.21.15.8:0/1852820195 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56128eebdd30 con 0x56128efa7730 2024-03-16T20:58:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad5e000640 10 client.25600 handle_command_reply: tid=0 2024-03-16T20:58:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad79bd5740 1 client.25600 shutdown 2024-03-16T20:58:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad79bd5740 1 -- 172.21.15.8:0/1852820195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 msgr2=0x56128ef358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef358f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad60023500 tx=0x7fad60003ba0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad79bd5740 1 -- 172.21.15.8:0/1852820195 shutdown_connections 2024-03-16T20:58:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56128efa7730 0x56128efa9b50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56128ef3b570 0x56128ef36030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56128ef32d60 0x56128ef358f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad79bd5740 1 --2- 172.21.15.8:0/1852820195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56128ef31ff0 0x56128ef3d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad79bd5740 1 -- 172.21.15.8:0/1852820195 >> 172.21.15.8:0/1852820195 conn(0x56128eef94b0 msgr2=0x56128ef2b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad5e000640 0 client.25600 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.620+0000 7fad79bd5740 1 -- 172.21.15.8:0/1852820195 shutdown_connections 2024-03-16T20:58:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad79bd5740 1 -- 172.21.15.8:0/1852820195 wait complete. 2024-03-16T20:58:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad79bd5740 20 client.25600 trim_cache size 0 max 16384 2024-03-16T20:58:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T20:58:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T20:58:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T20:58:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T20:58:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad75800640 1 -- 172.21.15.8:0/3265934518 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fad540a1cb0 msgr2=0x7fad540a4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad75800640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fad540a1cb0 0x7fad540a4170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fad580cb410 tx=0x7fad58000bc0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad75800640 1 -- 172.21.15.8:0/3265934518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad70103500 msgr2=0x7fad7019f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad75800640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad70103500 0x7fad7019f800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad5800e9f0 tx=0x7fad5800eeb0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad75800640 1 -- 172.21.15.8:0/3265934518 shutdown_connections 2024-03-16T20:58:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad75800640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fad540a1cb0 0x7fad540a4170 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad75800640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad701095c0 0x7fad701999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad75800640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad70103ec0 0x7fad7019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad75800640 1 --2- 172.21.15.8:0/3265934518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad70103500 0x7fad7019f800 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.621+0000 7fad75800640 1 -- 172.21.15.8:0/3265934518 >> 172.21.15.8:0/3265934518 conn(0x7fad700fefd0 msgr2=0x7fad701005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.622+0000 7fad75800640 1 -- 172.21.15.8:0/3265934518 shutdown_connections 2024-03-16T20:58:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:18.622+0000 7fad75800640 1 -- 172.21.15.8:0/3265934518 wait complete. 2024-03-16T20:58:19.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:19 smithi170 ceph-mon[35947]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-03-16T20:58:19.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:19 smithi186 ceph-mon[36391]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-03-16T20:58:19.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:19 smithi008 ceph-mon[31434]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-03-16T20:58:21.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:21 smithi170 ceph-mon[35947]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-03-16T20:58:21.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:21 smithi186 ceph-mon[36391]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-03-16T20:58:21.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:21 smithi008 ceph-mon[31434]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-03-16T20:58:23.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:23 smithi170 ceph-mon[35947]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-03-16T20:58:23.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:23 smithi186 ceph-mon[36391]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-03-16T20:58:23.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:23 smithi008 ceph-mon[31434]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-03-16T20:58:25.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:25 smithi170 ceph-mon[35947]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:58:25.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:25 smithi186 ceph-mon[36391]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:58:25.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:25 smithi008 ceph-mon[31434]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:58:27.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:27 smithi170 ceph-mon[35947]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:58:27.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:27 smithi186 ceph-mon[36391]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:58:27.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:27 smithi008 ceph-mon[31434]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-16T20:58:29.369 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:29 smithi170 ceph-mon[35947]: pgmap v22: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-03-16T20:58:29.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:29 smithi186 ceph-mon[36391]: pgmap v22: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-03-16T20:58:29.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:29 smithi008 ceph-mon[31434]: pgmap v22: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-03-16T20:58:31.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:31 smithi170 ceph-mon[35947]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-03-16T20:58:31.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:31 smithi186 ceph-mon[36391]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-03-16T20:58:31.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:31 smithi008 ceph-mon[31434]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-03-16T20:58:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.783+0000 7f9043200640 1 -- 172.21.15.8:0/3674672267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9044102520 msgr2=0x7f9044102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.783+0000 7f9043200640 1 --2- 172.21.15.8:0/3674672267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9044102520 0x7f9044102900 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9034009900 tx=0x7f903402bcd0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.783+0000 7f9043200640 1 -- 172.21.15.8:0/3674672267 shutdown_connections 2024-03-16T20:58:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.783+0000 7f9043200640 1 --2- 172.21.15.8:0/3674672267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f904410b8f0 0x7f904410dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.783+0000 7f9043200640 1 --2- 172.21.15.8:0/3674672267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9044102e40 0x7f904410b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.783+0000 7f9043200640 1 --2- 172.21.15.8:0/3674672267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9044102520 0x7f9044102900 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.783+0000 7f9043200640 1 -- 172.21.15.8:0/3674672267 >> 172.21.15.8:0/3674672267 conn(0x7f90440fbd00 msgr2=0x7f90440fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.783+0000 7f9043200640 1 -- 172.21.15.8:0/3674672267 shutdown_connections 2024-03-16T20:58:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.783+0000 7f9043200640 1 -- 172.21.15.8:0/3674672267 wait complete. 2024-03-16T20:58:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.784+0000 7f9043200640 1 Processor -- start 2024-03-16T20:58:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.784+0000 7f9043200640 1 -- start start 2024-03-16T20:58:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.785+0000 7f9043200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9044102520 0x7f904419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.785+0000 7f9043200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9044102e40 0x7f904419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.785+0000 7f9043200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f904410b8f0 0x7f9044197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.785+0000 7f9043200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9044197eb0 con 0x7f904410b8f0 2024-03-16T20:58:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.785+0000 7f9043200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9044198020 con 0x7f9044102520 2024-03-16T20:58:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.785+0000 7f9043200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90441981e0 con 0x7f9044102e40 2024-03-16T20:58:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.785+0000 7f9041400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9044102e40 0x7f904419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.785+0000 7f9041e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9044102520 0x7f904419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.785+0000 7f9041400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9044102e40 0x7f904419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56584/0 (socket says 172.21.15.8:56584) 2024-03-16T20:58:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.785+0000 7f9041400640 1 -- 172.21.15.8:0/3772006755 learned_addr learned my addr 172.21.15.8:0/3772006755 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.785+0000 7f9042800640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f904410b8f0 0x7f9044197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.786+0000 7f9041e00640 1 -- 172.21.15.8:0/3772006755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9044102e40 msgr2=0x7f904419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.786+0000 7f9041e00640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9044102e40 0x7f904419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.786+0000 7f9041e00640 1 -- 172.21.15.8:0/3772006755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f904410b8f0 msgr2=0x7f9044197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.786+0000 7f9041e00640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f904410b8f0 0x7f9044197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.786+0000 7f9041e00640 1 -- 172.21.15.8:0/3772006755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034009560 con 0x7f9044102520 2024-03-16T20:58:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.786+0000 7f9041400640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9044102e40 0x7f904419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.786+0000 7f9041e00640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9044102520 0x7f904419d6a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f903402c210 tx=0x7f903402c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.786+0000 7f903aa00640 1 -- 172.21.15.8:0/3772006755 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903402dc70 con 0x7f9044102520 2024-03-16T20:58:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.786+0000 7f903aa00640 1 -- 172.21.15.8:0/3772006755 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f903402ddd0 con 0x7f9044102520 2024-03-16T20:58:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.786+0000 7f9043200640 1 -- 172.21.15.8:0/3772006755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9044198460 con 0x7f9044102520 2024-03-16T20:58:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.786+0000 7f903aa00640 1 -- 172.21.15.8:0/3772006755 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034003d00 con 0x7f9044102520 2024-03-16T20:58:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.787+0000 7f9043200640 1 -- 172.21.15.8:0/3772006755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90441a46d0 con 0x7f9044102520 2024-03-16T20:58:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f904bbb9740 1 Processor -- start 2024-03-16T20:58:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f904bbb9740 1 -- start start 2024-03-16T20:58:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ad4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7ad5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ade570 0x55b2a7ae0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f904bbb9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a7a90620 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f904bbb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a7a428c0 con 0x55b2a7ad5d60 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f904bbb9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a7a3fdf0 con 0x55b2a7ade570 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f9042800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ad4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f9042800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ad4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44320/0 (socket says 172.21.15.8:44320) 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f9042800640 1 -- 172.21.15.8:0/4185176878 learned_addr learned my addr 172.21.15.8:0/4185176878 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.790+0000 7f9041400640 1 --2- 172.21.15.8:0/4185176878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ade570 0x55b2a7ae0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.791+0000 7f9042800640 1 -- 172.21.15.8:0/4185176878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ade570 msgr2=0x55b2a7ae0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.791+0000 7f9042800640 1 --2- 172.21.15.8:0/4185176878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ade570 0x55b2a7ae0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.791+0000 7f9042800640 1 -- 172.21.15.8:0/4185176878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad4ff0 msgr2=0x55b2a7ad5470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.791+0000 7f9042800640 1 --2- 172.21.15.8:0/4185176878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7ad5470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.791+0000 7f9042800640 1 -- 172.21.15.8:0/4185176878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2a79bcb00 con 0x55b2a7ad5d60 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.791+0000 7f9042800640 1 --2- 172.21.15.8:0/4185176878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ad4ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f903c009f70 tx=0x7f903c010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13fa91357ebcb01c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.791+0000 7f903aa00640 1 -- 172.21.15.8:0/3772006755 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f9034004e10 con 0x7f9044102520 2024-03-16T20:58:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.791+0000 7f902f400640 1 -- 172.21.15.8:0/4185176878 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c004d20 con 0x55b2a7ad5d60 2024-03-16T20:58:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.791+0000 7f902f400640 1 -- 172.21.15.8:0/4185176878 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f903c004e80 con 0x55b2a7ad5d60 2024-03-16T20:58:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.791+0000 7f902f400640 1 -- 172.21.15.8:0/4185176878 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c012ab0 con 0x55b2a7ad5d60 2024-03-16T20:58:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.792+0000 7f904bbb9740 1 -- 172.21.15.8:0/4185176878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad5d60 msgr2=0x55b2a7ad4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.792+0000 7f904bbb9740 1 --2- 172.21.15.8:0/4185176878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ad4ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f903c009f70 tx=0x7f903c010800 comp rx=0 tx=0).stop 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.792+0000 7f904bbb9740 1 -- 172.21.15.8:0/4185176878 shutdown_connections 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.792+0000 7f904bbb9740 1 --2- 172.21.15.8:0/4185176878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ade570 0x55b2a7ae0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.792+0000 7f904bbb9740 1 --2- 172.21.15.8:0/4185176878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7ad5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.792+0000 7f904bbb9740 1 --2- 172.21.15.8:0/4185176878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ad4ab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.792+0000 7f904bbb9740 1 -- 172.21.15.8:0/4185176878 >> 172.21.15.8:0/4185176878 conn(0x55b2a7a9c4b0 msgr2=0x55b2a7acfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.793+0000 7f904bbb9740 1 -- 172.21.15.8:0/4185176878 shutdown_connections 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.793+0000 7f904bbb9740 1 -- 172.21.15.8:0/4185176878 wait complete. 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.793+0000 7f903aa00640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f90280a1bc0 0x7f90280a4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.793+0000 7f903aa00640 1 -- 172.21.15.8:0/3772006755 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f90340eff70 con 0x7f9044102520 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.793+0000 7f9041400640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f90280a1bc0 0x7f90280a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.793+0000 7f904bbb9740 1 -- start start 2024-03-16T20:58:31.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.793+0000 7f904bbb9740 1 Processor -- start 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.794+0000 7f9041400640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f90280a1bc0 0x7f90280a4080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x55b2a7ad0e70 tx=0x7f903000b480 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.794+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7adb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.794+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ad5d60 0x55b2a7adbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.794+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ade570 0x55b2a7adc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.794+0000 7f904bbb9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a7a3b5d0 con 0x55b2a7ade570 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.794+0000 7f904bbb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a79e0b50 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.794+0000 7f904bbb9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a79e07f0 con 0x55b2a7ad5d60 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.794+0000 7f904bbb9740 10 client.0 _ll_register_callbacks cb 0x55b2a79f4550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.794+0000 7f9041e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7adb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9041e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7adb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44330/0 (socket says 172.21.15.8:44330) 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9041e00640 1 -- 172.21.15.8:0/70297300 learned_addr learned my addr 172.21.15.8:0/70297300 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:31.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9041400640 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ad5d60 0x55b2a7adbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9042800640 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ade570 0x55b2a7adc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9041e00640 1 -- 172.21.15.8:0/70297300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ad5d60 msgr2=0x55b2a7adbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9041e00640 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ad5d60 0x55b2a7adbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9041e00640 1 -- 172.21.15.8:0/70297300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ade570 msgr2=0x55b2a7adc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9041e00640 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ade570 0x55b2a7adc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9041e00640 1 -- 172.21.15.8:0/70297300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c009bd0 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9041e00640 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7adb690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f90340ed790 tx=0x7f90340bc7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d7b9c8126d39cf5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9023e00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.795+0000 7f9023e00640 1 -- 172.21.15.8:0/70297300 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340d4070 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f9023e00640 1 -- 172.21.15.8:0/70297300 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f90340ede40 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f904bbb9740 1 -- 172.21.15.8:0/70297300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2a7a0dcd0 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f9023e00640 1 -- 172.21.15.8:0/70297300 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90340bcbb0 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f904bbb9740 10 client.25610 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f904bbb9740 1 -- 172.21.15.8:0/70297300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b2a7a39c50 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f9023e00640 1 -- 172.21.15.8:0/70297300 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55b2a7a0dcd0 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f9023e00640 1 -- 172.21.15.8:0/70297300 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f903403c070 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f904bbb9740 10 client.25610 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f904bbb9740 10 client.25610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f904bbb9740 20 client.25610 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f904bbb9740 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b2a7aee3c0 0x55b2a7af07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f904bbb9740 4 client.25610 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.796+0000 7f904bbb9740 1 -- 172.21.15.8:0/70297300 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2a7a31ce0 con 0x55b2a7aee3c0 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.797+0000 7f9041400640 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b2a7aee3c0 0x55b2a7af07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.797+0000 7f9023e00640 10 client.25610 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.797+0000 7f9041400640 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b2a7aee3c0 0x55b2a7af07e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8859dfa0e76c5ef2 server_cookie=bc337332bad533fb in_seq=0 out_seq=0 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f9023e00640 1 -- 172.21.15.8:0/70297300 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55b2a7a31ce0 con 0x55b2a7aee3c0 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f9023e00640 10 client.25610 handle_command_reply: tid=0 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f904bbb9740 1 client.25610 shutdown 2024-03-16T20:58:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f904bbb9740 1 -- 172.21.15.8:0/70297300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 msgr2=0x55b2a7adb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f904bbb9740 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7adb690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f90340ed790 tx=0x7f90340bc7e0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f904bbb9740 1 -- 172.21.15.8:0/70297300 shutdown_connections 2024-03-16T20:58:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f904bbb9740 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b2a7aee3c0 0x55b2a7af07e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f904bbb9740 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ade570 0x55b2a7adc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f904bbb9740 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ad5d60 0x55b2a7adbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f904bbb9740 1 --2- 172.21.15.8:0/70297300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7adb690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f9023e00640 0 client.25610 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.798+0000 7f904bbb9740 1 -- 172.21.15.8:0/70297300 >> 172.21.15.8:0/70297300 conn(0x55b2a7a9c4b0 msgr2=0x55b2a7ad1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.799+0000 7f904bbb9740 1 -- 172.21.15.8:0/70297300 shutdown_connections 2024-03-16T20:58:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.799+0000 7f904bbb9740 1 -- 172.21.15.8:0/70297300 wait complete. 2024-03-16T20:58:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.799+0000 7f904bbb9740 20 client.25610 trim_cache size 0 max 16384 2024-03-16T20:58:31.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f904bbb9740 1 Processor -- start 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f904bbb9740 1 -- start start 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7adddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ae9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ade570 0x55b2a7ae9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f904bbb9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a7783e60 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f904bbb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a7ad4e80 con 0x55b2a7ade570 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f904bbb9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a7aeaba0 con 0x55b2a7ad5d60 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f9041e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7adddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f9041400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ae9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f9041e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7adddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60952/0 (socket says 172.21.15.8:60952) 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f9041e00640 1 -- 172.21.15.8:0/3953066369 learned_addr learned my addr 172.21.15.8:0/3953066369 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.816+0000 7f9042800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ade570 0x55b2a7ae9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.817+0000 7f9042800640 1 -- 172.21.15.8:0/3953066369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ad5d60 msgr2=0x55b2a7ae9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:31.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.817+0000 7f9042800640 1 --2- 172.21.15.8:0/3953066369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ae9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.817+0000 7f9042800640 1 -- 172.21.15.8:0/3953066369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad4ff0 msgr2=0x55b2a7adddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.817+0000 7f9042800640 1 --2- 172.21.15.8:0/3953066369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7adddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.817+0000 7f9042800640 1 -- 172.21.15.8:0/3953066369 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2a79d6530 con 0x55b2a7ade570 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.817+0000 7f9042800640 1 --2- 172.21.15.8:0/3953066369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ade570 0x55b2a7ae9db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f903c010d00 tx=0x7f903c0125f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb4bba83645801d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.817+0000 7f902ea00640 1 -- 172.21.15.8:0/3953066369 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c004c00 con 0x55b2a7ade570 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.817+0000 7f902ea00640 1 -- 172.21.15.8:0/3953066369 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f903c012c30 con 0x55b2a7ade570 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.817+0000 7f902ea00640 1 -- 172.21.15.8:0/3953066369 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c005740 con 0x55b2a7ade570 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.818+0000 7f904bbb9740 1 -- 172.21.15.8:0/3953066369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ade570 msgr2=0x55b2a7ae9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.818+0000 7f904bbb9740 1 --2- 172.21.15.8:0/3953066369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ade570 0x55b2a7ae9db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f903c010d00 tx=0x7f903c0125f0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.818+0000 7f904bbb9740 1 -- 172.21.15.8:0/3953066369 shutdown_connections 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.818+0000 7f904bbb9740 1 --2- 172.21.15.8:0/3953066369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ade570 0x55b2a7ae9db0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.818+0000 7f904bbb9740 1 --2- 172.21.15.8:0/3953066369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ae9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.818+0000 7f904bbb9740 1 --2- 172.21.15.8:0/3953066369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7adddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.818+0000 7f904bbb9740 1 -- 172.21.15.8:0/3953066369 >> 172.21.15.8:0/3953066369 conn(0x55b2a7a9c4b0 msgr2=0x55b2a7aced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.818+0000 7f904bbb9740 1 -- 172.21.15.8:0/3953066369 shutdown_connections 2024-03-16T20:58:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.819+0000 7f904bbb9740 1 -- 172.21.15.8:0/3953066369 wait complete. 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.819+0000 7f904bbb9740 1 -- start start 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.819+0000 7f904bbb9740 1 Processor -- start 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7ad7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ad7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f904bbb9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ade570 0x55b2a7ad85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f904bbb9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a7ad8c70 con 0x55b2a7ad5d60 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f904bbb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a7ad8de0 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f904bbb9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a7ad8fa0 con 0x55b2a7ade570 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f904bbb9740 10 client.0 _ll_register_callbacks cb 0x7f90340bca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f9041e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7ad7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f9041e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7ad7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44342/0 (socket says 172.21.15.8:44342) 2024-03-16T20:58:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f9041e00640 1 -- 172.21.15.8:0/1778375446 learned_addr learned my addr 172.21.15.8:0/1778375446 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f9042800640 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ade570 0x55b2a7ad85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.820+0000 7f9041400640 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ad7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f9041e00640 1 -- 172.21.15.8:0/1778375446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ade570 msgr2=0x55b2a7ad85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f9041e00640 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ade570 0x55b2a7ad85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f9041e00640 1 -- 172.21.15.8:0/1778375446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad5d60 msgr2=0x55b2a7ad7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f9041e00640 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ad7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f9041e00640 1 -- 172.21.15.8:0/1778375446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b2a79bcb00 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f9041400640 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ad7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f9041e00640 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7ad7920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f90340b9530 tx=0x7f90340c50d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf7a43a82a2280c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f9023e00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f9023e00640 1 -- 172.21.15.8:0/1778375446 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340d4070 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f9023e00640 1 -- 172.21.15.8:0/1778375446 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f90340ede40 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f904bbb9740 1 -- 172.21.15.8:0/1778375446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2a7a60d30 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f9023e00640 1 -- 172.21.15.8:0/1778375446 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9034003e60 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f904bbb9740 10 client.25616 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.821+0000 7f904bbb9740 1 -- 172.21.15.8:0/1778375446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b2a79fc2c0 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.822+0000 7f9023e00640 1 -- 172.21.15.8:0/1778375446 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55b2a7a60d30 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.822+0000 7f9023e00640 1 -- 172.21.15.8:0/1778375446 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f903403c040 con 0x55b2a7ad4ff0 2024-03-16T20:58:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.822+0000 7f904bbb9740 10 client.25616 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.822+0000 7f904bbb9740 10 client.25616 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.822+0000 7f904bbb9740 20 client.25616 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.822+0000 7f904bbb9740 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b2a7b4b550 0x55b2a7b4d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.822+0000 7f904bbb9740 4 client.25616 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T20:58:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.822+0000 7f904bbb9740 1 -- 172.21.15.8:0/1778375446 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b2a773b600 con 0x55b2a7b4b550 2024-03-16T20:58:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.822+0000 7f9041400640 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b2a7b4b550 0x55b2a7b4d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.823+0000 7f9041400640 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b2a7b4b550 0x55b2a7b4d940 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=285ec3b3a98a1918 server_cookie=e38b43b509eaecdc in_seq=0 out_seq=0 2024-03-16T20:58:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.823+0000 7f9023e00640 10 client.25616 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f9023e00640 1 -- 172.21.15.8:0/1778375446 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b2a773b600 con 0x55b2a7b4b550 2024-03-16T20:58:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f9023e00640 10 client.25616 handle_command_reply: tid=0 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f904bbb9740 1 client.25616 shutdown 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f904bbb9740 1 -- 172.21.15.8:0/1778375446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 msgr2=0x55b2a7ad7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f904bbb9740 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7ad7920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f90340b9530 tx=0x7f90340c50d0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f904bbb9740 1 -- 172.21.15.8:0/1778375446 shutdown_connections 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f904bbb9740 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2a7ade570 0x55b2a7ad85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f904bbb9740 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b2a7b4b550 0x55b2a7b4d940 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f904bbb9740 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b2a7ad5d60 0x55b2a7ad7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f904bbb9740 1 --2- 172.21.15.8:0/1778375446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2a7ad4ff0 0x55b2a7ad7920 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f9023e00640 0 client.25616 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f904bbb9740 1 -- 172.21.15.8:0/1778375446 >> 172.21.15.8:0/1778375446 conn(0x55b2a7a9c4b0 msgr2=0x55b2a7ad0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f904bbb9740 1 -- 172.21.15.8:0/1778375446 shutdown_connections 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.830+0000 7f904bbb9740 1 -- 172.21.15.8:0/1778375446 wait complete. 2024-03-16T20:58:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.831+0000 7f904bbb9740 20 client.25616 trim_cache size 0 max 16384 2024-03-16T20:58:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T20:58:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T20:58:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T20:58:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.831+0000 7f9043200640 1 -- 172.21.15.8:0/3772006755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f90280a1bc0 msgr2=0x7f90280a4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.831+0000 7f9043200640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f90280a1bc0 0x7f90280a4080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x55b2a7ad0e70 tx=0x7f903000b480 comp rx=0 tx=0).stop 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.831+0000 7f9043200640 1 -- 172.21.15.8:0/3772006755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9044102520 msgr2=0x7f904419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.832+0000 7f9043200640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9044102520 0x7f904419d6a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f903402c210 tx=0x7f903402c7d0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.832+0000 7f9043200640 1 -- 172.21.15.8:0/3772006755 shutdown_connections 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.832+0000 7f9043200640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f90280a1bc0 0x7f90280a4080 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.832+0000 7f9043200640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f904410b8f0 0x7f9044197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.832+0000 7f9043200640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9044102e40 0x7f904419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.832+0000 7f9043200640 1 --2- 172.21.15.8:0/3772006755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9044102520 0x7f904419d6a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.832+0000 7f9043200640 1 -- 172.21.15.8:0/3772006755 >> 172.21.15.8:0/3772006755 conn(0x7f90440fbd00 msgr2=0x7f90440fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.832+0000 7f9043200640 1 -- 172.21.15.8:0/3772006755 shutdown_connections 2024-03-16T20:58:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:31.832+0000 7f9043200640 1 -- 172.21.15.8:0/3772006755 wait complete. 2024-03-16T20:58:33.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:33 smithi170 ceph-mon[35947]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-16T20:58:33.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:33 smithi186 ceph-mon[36391]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-16T20:58:33.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:33 smithi008 ceph-mon[31434]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-16T20:58:34.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:34 smithi170 ceph-mon[35947]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-16T20:58:34.392 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:34 smithi186 ceph-mon[36391]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-16T20:58:34.494 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:34 smithi008 ceph-mon[31434]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-16T20:58:36.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:36 smithi186 ceph-mon[36391]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-16T20:58:36.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:36 smithi008 ceph-mon[31434]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-16T20:58:36.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:36 smithi170 ceph-mon[35947]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-16T20:58:38.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:38 smithi186 ceph-mon[36391]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-03-16T20:58:38.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:38 smithi008 ceph-mon[31434]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-03-16T20:58:38.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:38 smithi170 ceph-mon[35947]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-03-16T20:58:40.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:40 smithi186 ceph-mon[36391]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:58:40.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:40 smithi008 ceph-mon[31434]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:58:40.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:40 smithi170 ceph-mon[35947]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:58:42.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T20:58:42.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T20:58:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.542+0000 7fa6bd200640 1 -- 172.21.15.8:0/364862420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b8069fa0 msgr2=0x7fa6b806a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.542+0000 7fa6bd200640 1 --2- 172.21.15.8:0/364862420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b8069fa0 0x7fa6b806a3e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009900 tx=0x7fa6a402bc50 comp rx=0 tx=0).stop 2024-03-16T20:58:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.542+0000 7fa6bd200640 1 -- 172.21.15.8:0/364862420 shutdown_connections 2024-03-16T20:58:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.542+0000 7fa6bd200640 1 --2- 172.21.15.8:0/364862420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6b810dd40 0x7fa6b8110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.542+0000 7fa6bd200640 1 --2- 172.21.15.8:0/364862420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b8069fa0 0x7fa6b806a3e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.542+0000 7fa6bd200640 1 --2- 172.21.15.8:0/364862420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b81023a0 0x7fa6b8069a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.542+0000 7fa6bd200640 1 -- 172.21.15.8:0/364862420 >> 172.21.15.8:0/364862420 conn(0x7fa6b80773d0 msgr2=0x7fa6b80777e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:42.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.542+0000 7fa6bd200640 1 -- 172.21.15.8:0/364862420 shutdown_connections 2024-03-16T20:58:42.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.542+0000 7fa6bd200640 1 -- 172.21.15.8:0/364862420 wait complete. 2024-03-16T20:58:42.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.544+0000 7fa6bd200640 1 Processor -- start 2024-03-16T20:58:42.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.544+0000 7fa6bd200640 1 -- start start 2024-03-16T20:58:42.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.544+0000 7fa6bd200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b8069fa0 0x7fa6b8199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.544+0000 7fa6bd200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b81023a0 0x7fa6b819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.544+0000 7fa6bd200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6b810dd40 0x7fa6b819e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.544+0000 7fa6bd200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b819ed00 con 0x7fa6b8069fa0 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.544+0000 7fa6bd200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b819ee70 con 0x7fa6b81023a0 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.544+0000 7fa6bd200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b819f030 con 0x7fa6b810dd40 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.545+0000 7fa6b5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b8069fa0 0x7fa6b8199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.545+0000 7fa6b5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b8069fa0 0x7fa6b8199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40158/0 (socket says 172.21.15.8:40158) 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.545+0000 7fa6b5e00640 1 -- 172.21.15.8:0/2882599902 learned_addr learned my addr 172.21.15.8:0/2882599902 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.545+0000 7fa6b6800640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6b810dd40 0x7fa6b819e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.545+0000 7fa6b5400640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b81023a0 0x7fa6b819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.545+0000 7fa6b6800640 1 -- 172.21.15.8:0/2882599902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b81023a0 msgr2=0x7fa6b819a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.545+0000 7fa6b6800640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b81023a0 0x7fa6b819a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.545+0000 7fa6b6800640 1 -- 172.21.15.8:0/2882599902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b8069fa0 msgr2=0x7fa6b8199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.545+0000 7fa6b6800640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b8069fa0 0x7fa6b8199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.545+0000 7fa6b6800640 1 -- 172.21.15.8:0/2882599902 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a4009560 con 0x7fa6b810dd40 2024-03-16T20:58:42.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.546+0000 7fa6b6800640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6b810dd40 0x7fa6b819e700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0005fd0 tx=0x7fa6b000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.546+0000 7fa6aea00640 1 -- 172.21.15.8:0/2882599902 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b000cdf0 con 0x7fa6b810dd40 2024-03-16T20:58:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.546+0000 7fa6aea00640 1 -- 172.21.15.8:0/2882599902 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa6b0004b20 con 0x7fa6b810dd40 2024-03-16T20:58:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.546+0000 7fa6aea00640 1 -- 172.21.15.8:0/2882599902 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0010720 con 0x7fa6b810dd40 2024-03-16T20:58:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.546+0000 7fa6bd200640 1 -- 172.21.15.8:0/2882599902 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b819f310 con 0x7fa6b810dd40 2024-03-16T20:58:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.546+0000 7fa6bd200640 1 -- 172.21.15.8:0/2882599902 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b81a6b90 con 0x7fa6b810dd40 2024-03-16T20:58:42.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.549+0000 7fa6bffa0740 1 Processor -- start 2024-03-16T20:58:42.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.550+0000 7fa6aea00640 1 -- 172.21.15.8:0/2882599902 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7fa6b0004c90 con 0x7fa6b810dd40 2024-03-16T20:58:42.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.550+0000 7fa6bffa0740 1 -- start start 2024-03-16T20:58:42.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.551+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x559370273cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.551+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5593702742c0 0x559370274740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.551+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55937027d630 0x55937027fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.551+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593701e3150 con 0x5593702742c0 2024-03-16T20:58:42.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.551+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593701e0680 con 0x55937027d630 2024-03-16T20:58:42.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.551+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593701dbe60 con 0x559370274fa0 2024-03-16T20:58:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.551+0000 7fa6b5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x559370273cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.551+0000 7fa6b5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x559370273cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52680/0 (socket says 172.21.15.8:52680) 2024-03-16T20:58:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.551+0000 7fa6b5400640 1 -- 172.21.15.8:0/153396176 learned_addr learned my addr 172.21.15.8:0/153396176 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.551+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/153396176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5593702742c0 0x559370274740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.551+0000 7fa6b5400640 1 --2- 172.21.15.8:0/153396176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55937027d630 0x55937027fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.552+0000 7fa6b5e00640 1 -- 172.21.15.8:0/153396176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 msgr2=0x559370273cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.552+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/153396176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x559370273cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.552+0000 7fa6b5e00640 1 -- 172.21.15.8:0/153396176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55937027d630 msgr2=0x55937027fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.552+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/153396176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55937027d630 0x55937027fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.552+0000 7fa6b5e00640 1 -- 172.21.15.8:0/153396176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559370195060 con 0x5593702742c0 2024-03-16T20:58:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.552+0000 7fa6b5400640 1 --2- 172.21.15.8:0/153396176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x559370273cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.552+0000 7fa6aea00640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa69c0a1d40 0x7fa69c0a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.552+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/153396176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5593702742c0 0x559370274740 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009c80 tx=0x7fa6a8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0a64962a7d3a38 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.552+0000 7fa6aea00640 1 -- 172.21.15.8:0/2882599902 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa6b0014070 con 0x7fa6b810dd40 2024-03-16T20:58:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.553+0000 7fa6b5400640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa69c0a1d40 0x7fa69c0a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.553+0000 7fa6a3400640 1 -- 172.21.15.8:0/153396176 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8004230 con 0x5593702742c0 2024-03-16T20:58:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.553+0000 7fa6a3400640 1 -- 172.21.15.8:0/153396176 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa6a8005520 con 0x5593702742c0 2024-03-16T20:58:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.553+0000 7fa6a3400640 1 -- 172.21.15.8:0/153396176 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8004e30 con 0x5593702742c0 2024-03-16T20:58:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.553+0000 7fa6bffa0740 1 -- 172.21.15.8:0/153396176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5593702742c0 msgr2=0x559370274740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.553+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/153396176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5593702742c0 0x559370274740 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009c80 tx=0x7fa6a8011810 comp rx=0 tx=0).stop 2024-03-16T20:58:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.553+0000 7fa6b5400640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa69c0a1d40 0x7fa69c0a4200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009900 tx=0x7fa6a402e040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.554+0000 7fa6bffa0740 1 -- 172.21.15.8:0/153396176 shutdown_connections 2024-03-16T20:58:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.554+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/153396176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55937027d630 0x55937027fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.554+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/153396176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5593702742c0 0x559370274740 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.554+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/153396176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x559370273cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.554+0000 7fa6bffa0740 1 -- 172.21.15.8:0/153396176 >> 172.21.15.8:0/153396176 conn(0x55937023b5a0 msgr2=0x55937026ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.554+0000 7fa6bffa0740 1 -- 172.21.15.8:0/153396176 shutdown_connections 2024-03-16T20:58:42.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.554+0000 7fa6bffa0740 1 -- 172.21.15.8:0/153396176 wait complete. 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.554+0000 7fa6bffa0740 1 -- start start 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.555+0000 7fa6bffa0740 1 Processor -- start 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.555+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x55937027a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.555+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 0x55937027ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.555+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 0x55937027b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.555+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559370180ec0 con 0x559370274fa0 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.555+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559370180b60 con 0x5593702742c0 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.555+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55936ff4a1c0 con 0x55937027d630 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.555+0000 7fa6bffa0740 10 client.0 _ll_register_callbacks cb 0x559370194960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x55937027a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x55937027a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46596/0 (socket says 172.21.15.8:46596) 2024-03-16T20:58:42.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b5e00640 1 -- 172.21.15.8:0/406987085 learned_addr learned my addr 172.21.15.8:0/406987085 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b6800640 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 0x55937027b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b5400640 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 0x55937027ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b6800640 1 -- 172.21.15.8:0/406987085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 msgr2=0x55937027a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b6800640 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x55937027a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b6800640 1 -- 172.21.15.8:0/406987085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 msgr2=0x55937027ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b6800640 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 0x55937027ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b6800640 1 -- 172.21.15.8:0/406987085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a80098e0 con 0x55937027d630 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x55937027a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b5400640 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 0x55937027ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa6b6800640 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 0x55937027b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00cb650 tx=0x7fa6b009b190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb08c9918fb28599 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.556+0000 7fa697e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa697e00640 1 -- 172.21.15.8:0/406987085 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b00b2070 con 0x55937027d630 2024-03-16T20:58:42.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa697e00640 1 -- 172.21.15.8:0/406987085 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa6b00a3230 con 0x55937027d630 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa6bffa0740 1 -- 172.21.15.8:0/406987085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55936fedb7e0 con 0x55937027d630 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa697e00640 1 -- 172.21.15.8:0/406987085 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6b00b9020 con 0x55937027d630 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa6bffa0740 10 client.25630 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa6bffa0740 1 -- 172.21.15.8:0/406987085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5593701da4e0 con 0x55937027d630 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa697e00640 1 -- 172.21.15.8:0/406987085 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa6b007d080 con 0x55937027d630 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa697e00640 1 -- 172.21.15.8:0/406987085 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fa6b001f070 con 0x55937027d630 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa6bffa0740 10 client.25630 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa6bffa0740 10 client.25630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa6bffa0740 20 client.25630 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.557+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55937028d770 0x55937028fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.558+0000 7fa6bffa0740 4 client.25630 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:42.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.558+0000 7fa6bffa0740 1 -- 172.21.15.8:0/406987085 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55936ff18720 con 0x55937028d770 2024-03-16T20:58:42.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.558+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55937028d770 0x55937028fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.559+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55937028d770 0x55937028fb90 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6c1f37153a6e016 server_cookie=f8ce2e3bed45e2b1 in_seq=0 out_seq=0 2024-03-16T20:58:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.559+0000 7fa697e00640 10 client.25630 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa697e00640 1 -- 172.21.15.8:0/406987085 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55936ff18720 con 0x55937028d770 2024-03-16T20:58:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa697e00640 10 client.25630 handle_command_reply: tid=0 2024-03-16T20:58:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 1 client.25630 shutdown 2024-03-16T20:58:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 1 -- 172.21.15.8:0/406987085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 msgr2=0x55937027b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 0x55937027b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00cb650 tx=0x7fa6b009b190 comp rx=0 tx=0).stop 2024-03-16T20:58:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 1 -- 172.21.15.8:0/406987085 shutdown_connections 2024-03-16T20:58:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 0x55937027b0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55937028d770 0x55937028fb90 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 0x55937027ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/406987085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x55937027a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa697e00640 0 client.25630 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 1 -- 172.21.15.8:0/406987085 >> 172.21.15.8:0/406987085 conn(0x55937023b5a0 msgr2=0x559370270a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 1 -- 172.21.15.8:0/406987085 shutdown_connections 2024-03-16T20:58:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 1 -- 172.21.15.8:0/406987085 wait complete. 2024-03-16T20:58:42.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.560+0000 7fa6bffa0740 20 client.25630 trim_cache size 0 max 16384 2024-03-16T20:58:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.578+0000 7fa6bffa0740 1 Processor -- start 2024-03-16T20:58:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.578+0000 7fa6bffa0740 1 -- start start 2024-03-16T20:58:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.578+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x55937027cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.578+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x55937027aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.578+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55937027d630 0x5593702707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.578+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937026a5e0 con 0x55937027d630 2024-03-16T20:58:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.578+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937026e5b0 con 0x5593702742c0 2024-03-16T20:58:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.578+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559370290220 con 0x559370274fa0 2024-03-16T20:58:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x55937027aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x55937027aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52706/0 (socket says 172.21.15.8:52706) 2024-03-16T20:58:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b5400640 1 -- 172.21.15.8:0/3176429770 learned_addr learned my addr 172.21.15.8:0/3176429770 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b6800640 1 --2- 172.21.15.8:0/3176429770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55937027d630 0x5593702707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/3176429770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x55937027cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b5400640 1 -- 172.21.15.8:0/3176429770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 msgr2=0x55937027cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b5400640 1 --2- 172.21.15.8:0/3176429770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x55937027cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b5400640 1 -- 172.21.15.8:0/3176429770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55937027d630 msgr2=0x5593702707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b5400640 1 --2- 172.21.15.8:0/3176429770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55937027d630 0x5593702707c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b5400640 1 -- 172.21.15.8:0/3176429770 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559370176950 con 0x559370274fa0 2024-03-16T20:58:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/3176429770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x55937027cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.579+0000 7fa6b5400640 1 --2- 172.21.15.8:0/3176429770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x55937027aec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009230 tx=0x7fa6a4005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612f77e1e212b79d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.580+0000 7fa6a2a00640 1 -- 172.21.15.8:0/3176429770 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4004300 con 0x559370274fa0 2024-03-16T20:58:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.580+0000 7fa6a2a00640 1 -- 172.21.15.8:0/3176429770 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa6a4004460 con 0x559370274fa0 2024-03-16T20:58:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.580+0000 7fa6a2a00640 1 -- 172.21.15.8:0/3176429770 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4003c30 con 0x559370274fa0 2024-03-16T20:58:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.581+0000 7fa6bffa0740 1 -- 172.21.15.8:0/3176429770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 msgr2=0x55937027aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.581+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/3176429770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x55937027aec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009230 tx=0x7fa6a4005fd0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.581+0000 7fa6bffa0740 1 -- 172.21.15.8:0/3176429770 shutdown_connections 2024-03-16T20:58:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.581+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/3176429770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55937027d630 0x5593702707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.581+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/3176429770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559370274fa0 0x55937027aec0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.581+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/3176429770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x55937027cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.581+0000 7fa6bffa0740 1 -- 172.21.15.8:0/3176429770 >> 172.21.15.8:0/3176429770 conn(0x55937023b5a0 msgr2=0x5593702700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.581+0000 7fa6bffa0740 1 -- 172.21.15.8:0/3176429770 shutdown_connections 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.581+0000 7fa6bffa0740 1 -- 172.21.15.8:0/3176429770 wait complete. 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.581+0000 7fa6bffa0740 1 -- start start 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.582+0000 7fa6bffa0740 1 Processor -- start 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.582+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x559370280570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.582+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 0x559370280ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.582+0000 7fa6bffa0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 0x559370280ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.582+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937027f450 con 0x559370274fa0 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.582+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937027f5c0 con 0x5593702742c0 2024-03-16T20:58:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.582+0000 7fa6bffa0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593702f1830 con 0x55937027d630 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.582+0000 7fa6bffa0740 10 client.0 _ll_register_callbacks cb 0x7fa6b009a5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x559370280570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x559370280570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46606/0 (socket says 172.21.15.8:46606) 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b5e00640 1 -- 172.21.15.8:0/2154925161 learned_addr learned my addr 172.21.15.8:0/2154925161 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b6800640 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 0x559370280ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b5400640 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 0x559370280ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b6800640 1 -- 172.21.15.8:0/2154925161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 msgr2=0x559370280570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b6800640 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x559370280570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b6800640 1 -- 172.21.15.8:0/2154925161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 msgr2=0x559370280ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b6800640 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 0x559370280ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b6800640 1 -- 172.21.15.8:0/2154925161 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b8110d90 con 0x55937027d630 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x559370280570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.583+0000 7fa6b5400640 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 0x559370280ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.584+0000 7fa6b6800640 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 0x559370280ff0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa6b009b340 tx=0x7fa6b009a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6fbbbf6f5f72768 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.584+0000 7fa697e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.584+0000 7fa697e00640 1 -- 172.21.15.8:0/2154925161 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b00b2070 con 0x55937027d630 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.584+0000 7fa697e00640 1 -- 172.21.15.8:0/2154925161 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa6b00108a0 con 0x55937027d630 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.584+0000 7fa6bffa0740 1 -- 172.21.15.8:0/2154925161 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6a8005520 con 0x55937027d630 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.584+0000 7fa697e00640 1 -- 172.21.15.8:0/2154925161 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6b00a3230 con 0x55937027d630 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.584+0000 7fa6bffa0740 10 client.25636 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.584+0000 7fa6bffa0740 1 -- 172.21.15.8:0/2154925161 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55937019c430 con 0x55937027d630 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.585+0000 7fa697e00640 1 -- 172.21.15.8:0/2154925161 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa6a8005520 con 0x55937027d630 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.585+0000 7fa697e00640 1 -- 172.21.15.8:0/2154925161 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fa6b0080020 con 0x55937027d630 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.585+0000 7fa6bffa0740 10 client.25636 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.585+0000 7fa6bffa0740 10 client.25636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.585+0000 7fa6bffa0740 20 client.25636 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.585+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5593702f2ce0 0x5593702f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.585+0000 7fa6bffa0740 4 client.25636 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T20:58:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.585+0000 7fa6bffa0740 1 -- 172.21.15.8:0/2154925161 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55936ff67890 con 0x5593702f2ce0 2024-03-16T20:58:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.585+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5593702f2ce0 0x5593702f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.586+0000 7fa6b5e00640 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5593702f2ce0 0x5593702f50d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fc9d164567f5396 server_cookie=4aab60f6c8297df1 in_seq=0 out_seq=0 2024-03-16T20:58:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.586+0000 7fa697e00640 10 client.25636 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.586+0000 7fa697e00640 1 -- 172.21.15.8:0/2154925161 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55936ff67890 con 0x5593702f2ce0 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.586+0000 7fa697e00640 10 client.25636 handle_command_reply: tid=0 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.586+0000 7fa6bffa0740 1 client.25636 shutdown 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa6bffa0740 1 -- 172.21.15.8:0/2154925161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 msgr2=0x559370280ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 0x559370280ff0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa6b009b340 tx=0x7fa6b009a680 comp rx=0 tx=0).stop 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa6bffa0740 1 -- 172.21.15.8:0/2154925161 shutdown_connections 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55937027d630 0x559370280ff0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5593702f2ce0 0x5593702f50d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559370274fa0 0x559370280ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa6bffa0740 1 --2- 172.21.15.8:0/2154925161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5593702742c0 0x559370280570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa6bffa0740 1 -- 172.21.15.8:0/2154925161 >> 172.21.15.8:0/2154925161 conn(0x55937023b5a0 msgr2=0x55937026de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa697e00640 0 client.25636 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa6bffa0740 1 -- 172.21.15.8:0/2154925161 shutdown_connections 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa6bffa0740 1 -- 172.21.15.8:0/2154925161 wait complete. 2024-03-16T20:58:42.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.587+0000 7fa6bffa0740 20 client.25636 trim_cache size 0 max 16384 2024-03-16T20:58:42.597 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:58:42.597 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T20:58:42.597 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T20:58:42.597 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:58:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 -- 172.21.15.8:0/2882599902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa69c0a1d40 msgr2=0x7fa69c0a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa69c0a1d40 0x7fa69c0a4200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009900 tx=0x7fa6a402e040 comp rx=0 tx=0).stop 2024-03-16T20:58:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 -- 172.21.15.8:0/2882599902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6b810dd40 msgr2=0x7fa6b819e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6b810dd40 0x7fa6b819e700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0005fd0 tx=0x7fa6b000ef10 comp rx=0 tx=0).stop 2024-03-16T20:58:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 -- 172.21.15.8:0/2882599902 shutdown_connections 2024-03-16T20:58:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa69c0a1d40 0x7fa69c0a4200 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6b810dd40 0x7fa6b819e700 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6b81023a0 0x7fa6b819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 --2- 172.21.15.8:0/2882599902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6b8069fa0 0x7fa6b8199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 -- 172.21.15.8:0/2882599902 >> 172.21.15.8:0/2882599902 conn(0x7fa6b80773d0 msgr2=0x7fa6b80ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:42.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 -- 172.21.15.8:0/2882599902 shutdown_connections 2024-03-16T20:58:42.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.588+0000 7fa6bd200640 1 -- 172.21.15.8:0/2882599902 wait complete. 2024-03-16T20:58:42.617 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T20:58:42.617 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:58:42.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:42 smithi186 ceph-mon[36391]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-16T20:58:42.681 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:42 smithi008 ceph-mon[31434]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-16T20:58:42.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.800+0000 7fc9a1c00640 1 -- 172.21.15.8:0/712281329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c1030a0 msgr2=0x7fc99c10b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.800+0000 7fc9a1c00640 1 --2- 172.21.15.8:0/712281329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c1030a0 0x7fc99c10b580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc988009900 tx=0x7fc98802bcd0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.800+0000 7fc9a1c00640 1 -- 172.21.15.8:0/712281329 shutdown_connections 2024-03-16T20:58:42.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.800+0000 7fc9a1c00640 1 --2- 172.21.15.8:0/712281329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c10bac0 0x7fc99c10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.800+0000 7fc9a1c00640 1 --2- 172.21.15.8:0/712281329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c1030a0 0x7fc99c10b580 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.800+0000 7fc9a1c00640 1 --2- 172.21.15.8:0/712281329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc99c102780 0x7fc99c102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.800+0000 7fc9a1c00640 1 -- 172.21.15.8:0/712281329 >> 172.21.15.8:0/712281329 conn(0x7fc99c077550 msgr2=0x7fc99c077960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.800+0000 7fc9a1c00640 1 -- 172.21.15.8:0/712281329 shutdown_connections 2024-03-16T20:58:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.801+0000 7fc9a1c00640 1 -- 172.21.15.8:0/712281329 wait complete. 2024-03-16T20:58:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.802+0000 7fc9a1c00640 1 Processor -- start 2024-03-16T20:58:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.802+0000 7fc9a1c00640 1 -- start start 2024-03-16T20:58:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.802+0000 7fc9a1c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c102780 0x7fc99c19d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc9a1c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c1030a0 0x7fc99c19ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc9a1c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc99c10bac0 0x7fc99c197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc9a1c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c198070 con 0x7fc99c1030a0 2024-03-16T20:58:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc9a1c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c1981e0 con 0x7fc99c102780 2024-03-16T20:58:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc9a1c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c1983a0 con 0x7fc99c10bac0 2024-03-16T20:58:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc99aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c102780 0x7fc99c19d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc99a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c1030a0 0x7fc99c19ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc99aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c102780 0x7fc99c19d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46626/0 (socket says 172.21.15.8:46626) 2024-03-16T20:58:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc99aa00640 1 -- 172.21.15.8:0/3251455500 learned_addr learned my addr 172.21.15.8:0/3251455500 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc99b400640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc99c10bac0 0x7fc99c197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc99aa00640 1 -- 172.21.15.8:0/3251455500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc99c10bac0 msgr2=0x7fc99c197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc99aa00640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc99c10bac0 0x7fc99c197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc99aa00640 1 -- 172.21.15.8:0/3251455500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c1030a0 msgr2=0x7fc99c19ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc99aa00640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c1030a0 0x7fc99c19ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc99aa00640 1 -- 172.21.15.8:0/3251455500 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc988009560 con 0x7fc99c102780 2024-03-16T20:58:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.803+0000 7fc99b400640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc99c10bac0 0x7fc99c197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.804+0000 7fc99aa00640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c102780 0x7fc99c19d870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00e9f0 tx=0x7fc98c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.804+0000 7fc993400640 1 -- 172.21.15.8:0/3251455500 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c009720 con 0x7fc99c102780 2024-03-16T20:58:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.804+0000 7fc993400640 1 -- 172.21.15.8:0/3251455500 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc98c00cd80 con 0x7fc99c102780 2024-03-16T20:58:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.804+0000 7fc993400640 1 -- 172.21.15.8:0/3251455500 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c010690 con 0x7fc99c102780 2024-03-16T20:58:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.804+0000 7fc9a1c00640 1 -- 172.21.15.8:0/3251455500 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c198680 con 0x7fc99c102780 2024-03-16T20:58:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.804+0000 7fc9a1c00640 1 -- 172.21.15.8:0/3251455500 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c1a4910 con 0x7fc99c102780 2024-03-16T20:58:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.806+0000 7fc9a1c00640 1 -- 172.21.15.8:0/3251455500 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c06a390 con 0x7fc99c102780 2024-03-16T20:58:42.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.807+0000 7fc993400640 1 -- 172.21.15.8:0/3251455500 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7fc98c0046c0 con 0x7fc99c102780 2024-03-16T20:58:42.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.809+0000 7fc993400640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9800a1cc0 0x7fc9800a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:42.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.809+0000 7fc993400640 1 -- 172.21.15.8:0/3251455500 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc98c014070 con 0x7fc99c102780 2024-03-16T20:58:42.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.810+0000 7fc99a000640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9800a1cc0 0x7fc9800a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:42.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.810+0000 7fc99a000640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9800a1cc0 0x7fc9800a4180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc988005ab0 tx=0x7fc988005a20 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:42.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:42.817+0000 7fc993400640 1 -- 172.21.15.8:0/3251455500 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc98c096ab0 con 0x7fc99c102780 2024-03-16T20:58:42.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:42 smithi170 ceph-mon[35947]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-16T20:58:43.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.164+0000 7fc9a1c00640 1 -- 172.21.15.8:0/3251455500 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc99c111780 con 0x7fc99c102780 2024-03-16T20:58:43.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.165+0000 7fc993400640 1 -- 172.21.15.8:0/3251455500 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11387 (secure 0 0 0) 0x7fc98c09a170 con 0x7fc99c102780 2024-03-16T20:58:43.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:58:43.171 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:57:29.077799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T20:58:43.171 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 24 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.167+0000 7fc9a1c00640 1 -- 172.21.15.8:0/3251455500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9800a1cc0 msgr2=0x7fc9800a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.167+0000 7fc9a1c00640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9800a1cc0 0x7fc9800a4180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc988005ab0 tx=0x7fc988005a20 comp rx=0 tx=0).stop 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.167+0000 7fc9a1c00640 1 -- 172.21.15.8:0/3251455500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c102780 msgr2=0x7fc99c19d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.167+0000 7fc9a1c00640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c102780 0x7fc99c19d870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00e9f0 tx=0x7fc98c00edf0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.167+0000 7fc9a1c00640 1 -- 172.21.15.8:0/3251455500 shutdown_connections 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.167+0000 7fc9a1c00640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9800a1cc0 0x7fc9800a4180 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.167+0000 7fc9a1c00640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc99c10bac0 0x7fc99c197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.167+0000 7fc9a1c00640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c1030a0 0x7fc99c19ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.167+0000 7fc9a1c00640 1 --2- 172.21.15.8:0/3251455500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c102780 0x7fc99c19d870 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.167+0000 7fc9a1c00640 1 -- 172.21.15.8:0/3251455500 >> 172.21.15.8:0/3251455500 conn(0x7fc99c077550 msgr2=0x7fc99c0fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.168+0000 7fc9a1c00640 1 -- 172.21.15.8:0/3251455500 shutdown_connections 2024-03-16T20:58:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.168+0000 7fc9a1c00640 1 -- 172.21.15.8:0/3251455500 wait complete. 2024-03-16T20:58:43.190 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:58:43.190 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T20:58:43.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.377+0000 7faee6e00640 1 -- 172.21.15.8:0/3548921339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee00741e0 msgr2=0x7faee010d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.377+0000 7faee6e00640 1 --2- 172.21.15.8:0/3548921339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee00741e0 0x7faee010d7e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faecc009900 tx=0x7faecc02bcd0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.377+0000 7faee6e00640 1 -- 172.21.15.8:0/3548921339 shutdown_connections 2024-03-16T20:58:43.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.377+0000 7faee6e00640 1 --2- 172.21.15.8:0/3548921339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee010dd20 0x7faee0110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.377+0000 7faee6e00640 1 --2- 172.21.15.8:0/3548921339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee00741e0 0x7faee010d7e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.377+0000 7faee6e00640 1 --2- 172.21.15.8:0/3548921339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee00738c0 0x7faee0073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.377+0000 7faee6e00640 1 -- 172.21.15.8:0/3548921339 >> 172.21.15.8:0/3548921339 conn(0x7faee00788f0 msgr2=0x7faee0078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.377+0000 7faee6e00640 1 -- 172.21.15.8:0/3548921339 shutdown_connections 2024-03-16T20:58:43.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.377+0000 7faee6e00640 1 -- 172.21.15.8:0/3548921339 wait complete. 2024-03-16T20:58:43.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.378+0000 7faee6e00640 1 Processor -- start 2024-03-16T20:58:43.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.378+0000 7faee6e00640 1 -- start start 2024-03-16T20:58:43.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.379+0000 7faee6e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee00738c0 0x7faee0199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.379+0000 7faee6e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee00741e0 0x7faee019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.379+0000 7faee6e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee010dd20 0x7faee019e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.379+0000 7faee6e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee019ed60 con 0x7faee010dd20 2024-03-16T20:58:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.379+0000 7faee6e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee019eed0 con 0x7faee00741e0 2024-03-16T20:58:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.379+0000 7faee6e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee019f090 con 0x7faee00738c0 2024-03-16T20:58:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.379+0000 7faedfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee00738c0 0x7faee0199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.379+0000 7faedfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee00738c0 0x7faee0199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52748/0 (socket says 172.21.15.8:52748) 2024-03-16T20:58:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.379+0000 7faedfe00640 1 -- 172.21.15.8:0/3975345363 learned_addr learned my addr 172.21.15.8:0/3975345363 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.379+0000 7faedf400640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee00741e0 0x7faee019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.379+0000 7faee4e00640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee010dd20 0x7faee019e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.380+0000 7faedf400640 1 -- 172.21.15.8:0/3975345363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee00738c0 msgr2=0x7faee0199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.380+0000 7faedf400640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee00738c0 0x7faee0199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.380+0000 7faedf400640 1 -- 172.21.15.8:0/3975345363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee010dd20 msgr2=0x7faee019e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.380+0000 7faedf400640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee010dd20 0x7faee019e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.380+0000 7faedf400640 1 -- 172.21.15.8:0/3975345363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009560 con 0x7faee00741e0 2024-03-16T20:58:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.380+0000 7faedfe00640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee00738c0 0x7faee0199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.380+0000 7faedf400640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee00741e0 0x7faee019a3e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faecc000c00 tx=0x7faecc02ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.380+0000 7faedcc00640 1 -- 172.21.15.8:0/3975345363 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc004250 con 0x7faee00741e0 2024-03-16T20:58:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.380+0000 7faedcc00640 1 -- 172.21.15.8:0/3975345363 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7faecc0043b0 con 0x7faee00741e0 2024-03-16T20:58:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.380+0000 7faedcc00640 1 -- 172.21.15.8:0/3975345363 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc003be0 con 0x7faee00741e0 2024-03-16T20:58:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.381+0000 7faee6e00640 1 -- 172.21.15.8:0/3975345363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee019f310 con 0x7faee00741e0 2024-03-16T20:58:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.381+0000 7faee6e00640 1 -- 172.21.15.8:0/3975345363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee01a6bf0 con 0x7faee00741e0 2024-03-16T20:58:43.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.386+0000 7faee9bcc740 1 Processor -- start 2024-03-16T20:58:43.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.386+0000 7faedcc00640 1 -- 172.21.15.8:0/3975345363 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7faecc003d40 con 0x7faee00741e0 2024-03-16T20:58:43.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.386+0000 7faee9bcc740 1 -- start start 2024-03-16T20:58:43.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.387+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea25a3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.387+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea25abc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.387+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.387+0000 7faee9bcc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea2511210 con 0x55bea25ac140 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.387+0000 7faee9bcc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea250e740 con 0x55bea25a2c40 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.387+0000 7faee9bcc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea2509f20 con 0x55bea25a3560 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.387+0000 7faedfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea25abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.387+0000 7faedfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea25abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52762/0 (socket says 172.21.15.8:52762) 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.387+0000 7faedfe00640 1 -- 172.21.15.8:0/548202320 learned_addr learned my addr 172.21.15.8:0/548202320 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.387+0000 7faee4e00640 1 --2- 172.21.15.8:0/548202320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea25a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.387+0000 7faedf400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.388+0000 7faedfe00640 1 -- 172.21.15.8:0/548202320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 msgr2=0x55bea25a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.388+0000 7faedfe00640 1 --2- 172.21.15.8:0/548202320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea25a3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.388+0000 7faedfe00640 1 -- 172.21.15.8:0/548202320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 msgr2=0x55bea25ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.388+0000 7faedfe00640 1 --2- 172.21.15.8:0/548202320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.388+0000 7faedfe00640 1 -- 172.21.15.8:0/548202320 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bea24cbdf0 con 0x55bea25a3560 2024-03-16T20:58:43.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.388+0000 7faedf400640 1 --2- 172.21.15.8:0/548202320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:43.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.388+0000 7faedcc00640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faec40a1d40 0x7faec40a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.388+0000 7faedfe00640 1 --2- 172.21.15.8:0/548202320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea25abc00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faed0011650 tx=0x7faed0009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da2c6ade4b8a3019 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.388+0000 7faedcc00640 1 -- 172.21.15.8:0/3975345363 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faecc0ef9c0 con 0x7faee00741e0 2024-03-16T20:58:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.388+0000 7faed5600640 1 -- 172.21.15.8:0/548202320 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000f6c0 con 0x55bea25a3560 2024-03-16T20:58:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.389+0000 7faed5600640 1 -- 172.21.15.8:0/548202320 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7faed000fd20 con 0x55bea25a3560 2024-03-16T20:58:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.389+0000 7faed5600640 1 -- 172.21.15.8:0/548202320 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00183b0 con 0x55bea25a3560 2024-03-16T20:58:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.389+0000 7faee4e00640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faec40a1d40 0x7faec40a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.390+0000 7faee9bcc740 1 -- 172.21.15.8:0/548202320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 msgr2=0x55bea25abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.390+0000 7faee4e00640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faec40a1d40 0x7faec40a4200 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faee006ad90 tx=0x7faed8009760 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.390+0000 7faee9bcc740 1 --2- 172.21.15.8:0/548202320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea25abc00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faed0011650 tx=0x7faed0009f90 comp rx=0 tx=0).stop 2024-03-16T20:58:43.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.390+0000 7faee9bcc740 1 -- 172.21.15.8:0/548202320 shutdown_connections 2024-03-16T20:58:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.390+0000 7faee9bcc740 1 --2- 172.21.15.8:0/548202320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.390+0000 7faee9bcc740 1 --2- 172.21.15.8:0/548202320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea25abc00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.390+0000 7faee9bcc740 1 --2- 172.21.15.8:0/548202320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea25a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.390+0000 7faee9bcc740 1 -- 172.21.15.8:0/548202320 >> 172.21.15.8:0/548202320 conn(0x55bea259d370 msgr2=0x55bea259d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.390+0000 7faee9bcc740 1 -- 172.21.15.8:0/548202320 shutdown_connections 2024-03-16T20:58:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.390+0000 7faee9bcc740 1 -- 172.21.15.8:0/548202320 wait complete. 2024-03-16T20:58:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.391+0000 7faee9bcc740 1 -- start start 2024-03-16T20:58:43.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.391+0000 7faee9bcc740 1 Processor -- start 2024-03-16T20:58:43.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.391+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25a2c40 0x55bea25a9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a3560 0x55bea25a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25ac140 0x55bea25a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee9bcc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea24af150 con 0x55bea25a2c40 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee9bcc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea24aedf0 con 0x55bea25a3560 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee9bcc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea22781c0 con 0x55bea25ac140 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee9bcc740 10 client.0 _ll_register_callbacks cb 0x55bea24fe2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee4e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25ac140 0x55bea25a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faedfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25a2c40 0x55bea25a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee4e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25ac140 0x55bea25a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52772/0 (socket says 172.21.15.8:52772) 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee4e00640 1 -- 172.21.15.8:0/783506715 learned_addr learned my addr 172.21.15.8:0/783506715 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faedf400640 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a3560 0x55bea25a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee4e00640 1 -- 172.21.15.8:0/783506715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a3560 msgr2=0x55bea25a96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee4e00640 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a3560 0x55bea25a96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee4e00640 1 -- 172.21.15.8:0/783506715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25a2c40 msgr2=0x55bea25a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee4e00640 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25a2c40 0x55bea25a9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faee4e00640 1 -- 172.21.15.8:0/783506715 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed0009e00 con 0x55bea25ac140 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faedfe00640 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25a2c40 0x55bea25a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.392+0000 7faedf400640 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a3560 0x55bea25a96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.393+0000 7faee4e00640 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25ac140 0x55bea25a9be0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faed801e8d0 tx=0x7faed8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a4d490dc6b9b517 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.393+0000 7faeca000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.393+0000 7faeca000640 1 -- 172.21.15.8:0/783506715 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8010d60 con 0x55bea25ac140 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.393+0000 7faeca000640 1 -- 172.21.15.8:0/783506715 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faed8003970 con 0x55bea25ac140 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.393+0000 7faee9bcc740 1 -- 172.21.15.8:0/783506715 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bea22097e0 con 0x55bea25ac140 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.393+0000 7faeca000640 1 -- 172.21.15.8:0/783506715 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7faed8010ec0 con 0x55bea25ac140 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.393+0000 7faee9bcc740 10 client.25654 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.393+0000 7faee9bcc740 1 -- 172.21.15.8:0/783506715 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55bea25085a0 con 0x55bea25ac140 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.394+0000 7faeca000640 1 -- 172.21.15.8:0/783506715 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55bea22097e0 con 0x55bea25ac140 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.394+0000 7faeca000640 1 -- 172.21.15.8:0/783506715 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7faed801f420 con 0x55bea25ac140 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.394+0000 7faee9bcc740 10 client.25654 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.394+0000 7faee9bcc740 10 client.25654 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T20:58:43.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.394+0000 7faee9bcc740 20 client.25654 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:43.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.394+0000 7faee9bcc740 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55bea25bc200 0x55bea25be5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.394+0000 7faee9bcc740 4 client.25654 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:43.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.394+0000 7faee9bcc740 1 -- 172.21.15.8:0/783506715 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bea2246720 con 0x55bea25bc200 2024-03-16T20:58:43.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.394+0000 7faedfe00640 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55bea25bc200 0x55bea25be5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.395+0000 7faedfe00640 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55bea25bc200 0x55bea25be5f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=98d3a316f9a451f4 server_cookie=bc905dbd61b5dfe3 in_seq=0 out_seq=0 2024-03-16T20:58:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.395+0000 7faeca000640 10 client.25654 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:58:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.396+0000 7faeca000640 1 -- 172.21.15.8:0/783506715 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55bea2246720 con 0x55bea25bc200 2024-03-16T20:58:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.396+0000 7faeca000640 10 client.25654 handle_command_reply: tid=0 2024-03-16T20:58:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.396+0000 7faee9bcc740 1 client.25654 shutdown 2024-03-16T20:58:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.396+0000 7faee9bcc740 1 -- 172.21.15.8:0/783506715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25ac140 msgr2=0x55bea25a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.396+0000 7faee9bcc740 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25ac140 0x55bea25a9be0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faed801e8d0 tx=0x7faed8004a40 comp rx=0 tx=0).stop 2024-03-16T20:58:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.397+0000 7faee9bcc740 1 -- 172.21.15.8:0/783506715 shutdown_connections 2024-03-16T20:58:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.397+0000 7faee9bcc740 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55bea25bc200 0x55bea25be5f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.397+0000 7faee9bcc740 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25ac140 0x55bea25a9be0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.397+0000 7faee9bcc740 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a3560 0x55bea25a96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.397+0000 7faeca000640 0 client.25654 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:58:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.397+0000 7faee9bcc740 1 --2- 172.21.15.8:0/783506715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25a2c40 0x55bea25a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.397+0000 7faee9bcc740 1 -- 172.21.15.8:0/783506715 >> 172.21.15.8:0/783506715 conn(0x55bea259d370 msgr2=0x55bea259f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.397+0000 7faee9bcc740 1 -- 172.21.15.8:0/783506715 shutdown_connections 2024-03-16T20:58:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.397+0000 7faee9bcc740 1 -- 172.21.15.8:0/783506715 wait complete. 2024-03-16T20:58:43.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.397+0000 7faee9bcc740 20 client.25654 trim_cache size 0 max 16384 2024-03-16T20:58:43.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.422+0000 7faee9bcc740 1 Processor -- start 2024-03-16T20:58:43.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.422+0000 7faee9bcc740 1 -- start start 2024-03-16T20:58:43.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.422+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea25ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea259c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faee9bcc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea25a8f50 con 0x55bea25ac140 2024-03-16T20:58:43.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faee9bcc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea259e370 con 0x55bea25a2c40 2024-03-16T20:58:43.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faee9bcc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea25a76b0 con 0x55bea25a3560 2024-03-16T20:58:43.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faedf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea259c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faedf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea259c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52778/0 (socket says 172.21.15.8:52778) 2024-03-16T20:58:43.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faedf400640 1 -- 172.21.15.8:0/2734807222 learned_addr learned my addr 172.21.15.8:0/2734807222 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faedfe00640 1 --2- 172.21.15.8:0/2734807222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea25ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faedf400640 1 -- 172.21.15.8:0/2734807222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 msgr2=0x55bea25ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faedf400640 1 --2- 172.21.15.8:0/2734807222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea25ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faee4e00640 1 --2- 172.21.15.8:0/2734807222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faedf400640 1 -- 172.21.15.8:0/2734807222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 msgr2=0x55bea25b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.423+0000 7faedf400640 1 --2- 172.21.15.8:0/2734807222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.424+0000 7faedf400640 1 -- 172.21.15.8:0/2734807222 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bea24a4ab0 con 0x55bea25a3560 2024-03-16T20:58:43.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.424+0000 7faee4e00640 1 --2- 172.21.15.8:0/2734807222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:43.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.424+0000 7faedf400640 1 --2- 172.21.15.8:0/2734807222 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea259c2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faecc005ab0 tx=0x7faecc0045f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20b9ae2679ca6dd9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.424+0000 7faed4c00640 1 -- 172.21.15.8:0/2734807222 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0bbde0 con 0x55bea25a3560 2024-03-16T20:58:43.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.424+0000 7faed4c00640 1 -- 172.21.15.8:0/2734807222 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7faecc0dc0b0 con 0x55bea25a3560 2024-03-16T20:58:43.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.424+0000 7faed4c00640 1 -- 172.21.15.8:0/2734807222 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0054a0 con 0x55bea25a3560 2024-03-16T20:58:43.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.425+0000 7faee9bcc740 1 -- 172.21.15.8:0/2734807222 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 msgr2=0x55bea259c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.425+0000 7faee9bcc740 1 --2- 172.21.15.8:0/2734807222 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea259c2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faecc005ab0 tx=0x7faecc0045f0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.425+0000 7faee9bcc740 1 -- 172.21.15.8:0/2734807222 shutdown_connections 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.425+0000 7faee9bcc740 1 --2- 172.21.15.8:0/2734807222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.425+0000 7faee9bcc740 1 --2- 172.21.15.8:0/2734807222 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea259c2f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.425+0000 7faee9bcc740 1 --2- 172.21.15.8:0/2734807222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea25ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.425+0000 7faee9bcc740 1 -- 172.21.15.8:0/2734807222 >> 172.21.15.8:0/2734807222 conn(0x55bea259d370 msgr2=0x55bea259bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.425+0000 7faee9bcc740 1 -- 172.21.15.8:0/2734807222 shutdown_connections 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.425+0000 7faee9bcc740 1 -- 172.21.15.8:0/2734807222 wait complete. 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.426+0000 7faee9bcc740 1 -- start start 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.426+0000 7faee9bcc740 1 Processor -- start 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea260fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea2610350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faee9bcc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faee9bcc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea25a6690 con 0x55bea25ac140 2024-03-16T20:58:43.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faee9bcc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea25a6800 con 0x55bea25a2c40 2024-03-16T20:58:43.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faee9bcc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea25a69c0 con 0x55bea25a3560 2024-03-16T20:58:43.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faee9bcc740 10 client.0 _ll_register_callbacks cb 0x7faed8009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:43.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faedfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea260fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faedfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea260fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46682/0 (socket says 172.21.15.8:46682) 2024-03-16T20:58:43.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faedfe00640 1 -- 172.21.15.8:0/1308683241 learned_addr learned my addr 172.21.15.8:0/1308683241 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faedf400640 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea2610350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faee4e00640 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faedfe00640 1 -- 172.21.15.8:0/1308683241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 msgr2=0x55bea2610350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faedfe00640 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea2610350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.427+0000 7faedfe00640 1 -- 172.21.15.8:0/1308683241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 msgr2=0x55bea25a60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.428+0000 7faedfe00640 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25a60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.428+0000 7faedfe00640 1 -- 172.21.15.8:0/1308683241 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee01a6bf0 con 0x55bea25a2c40 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.428+0000 7faedfe00640 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea260fe10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faed0009250 tx=0x7faed0005da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c82beaeb55eb86be server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.428+0000 7faeca000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.428+0000 7faeca000640 1 -- 172.21.15.8:0/1308683241 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000f6c0 con 0x55bea25a2c40 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.428+0000 7faeca000640 1 -- 172.21.15.8:0/1308683241 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faed000f820 con 0x55bea25a2c40 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.428+0000 7faee9bcc740 1 -- 172.21.15.8:0/1308683241 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faed000fd20 con 0x55bea25a2c40 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.429+0000 7faeca000640 1 -- 172.21.15.8:0/1308683241 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7faed000f9e0 con 0x55bea25a2c40 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.429+0000 7faee9bcc740 10 client.25655 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.429+0000 7faee9bcc740 1 -- 172.21.15.8:0/1308683241 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55bea24ca650 con 0x55bea25a2c40 2024-03-16T20:58:43.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.429+0000 7faeca000640 1 -- 172.21.15.8:0/1308683241 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7faed000fd20 con 0x55bea25a2c40 2024-03-16T20:58:43.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.429+0000 7faeca000640 1 -- 172.21.15.8:0/1308683241 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7faed0003b60 con 0x55bea25a2c40 2024-03-16T20:58:43.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.429+0000 7faee9bcc740 10 client.25655 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:43.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.429+0000 7faee9bcc740 10 client.25655 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T20:58:43.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.429+0000 7faee9bcc740 20 client.25655 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:43.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.429+0000 7faee9bcc740 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55bea26214a0 0x55bea26238c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.429+0000 7faee9bcc740 4 client.25655 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:58:43.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.429+0000 7faee9bcc740 1 -- 172.21.15.8:0/1308683241 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bea2295890 con 0x55bea26214a0 2024-03-16T20:58:43.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.430+0000 7faedf400640 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55bea26214a0 0x55bea26238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.430+0000 7faedf400640 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55bea26214a0 0x55bea26238c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8f71a32f9d5cd8e9 server_cookie=392ad65df214cf1c in_seq=0 out_seq=0 2024-03-16T20:58:43.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.430+0000 7faeca000640 10 client.25655 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faeca000640 1 -- 172.21.15.8:0/1308683241 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bea2295890 con 0x55bea26214a0 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faeca000640 10 client.25655 handle_command_reply: tid=0 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 1 client.25655 shutdown 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 1 -- 172.21.15.8:0/1308683241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 msgr2=0x55bea260fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea260fe10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faed0009250 tx=0x7faed0005da0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 1 -- 172.21.15.8:0/1308683241 shutdown_connections 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55bea26214a0 0x55bea26238c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bea25ac140 0x55bea25a60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bea25a3560 0x55bea2610350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 1 --2- 172.21.15.8:0/1308683241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bea25a2c40 0x55bea260fe10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 1 -- 172.21.15.8:0/1308683241 >> 172.21.15.8:0/1308683241 conn(0x55bea259d370 msgr2=0x55bea25a9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faeca000640 0 client.25655 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 1 -- 172.21.15.8:0/1308683241 shutdown_connections 2024-03-16T20:58:43.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 1 -- 172.21.15.8:0/1308683241 wait complete. 2024-03-16T20:58:43.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.431+0000 7faee9bcc740 20 client.25655 trim_cache size 0 max 16384 2024-03-16T20:58:43.439 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.432+0000 7faee6e00640 1 -- 172.21.15.8:0/3975345363 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faec40a1d40 msgr2=0x7faec40a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.432+0000 7faee6e00640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faec40a1d40 0x7faec40a4200 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faee006ad90 tx=0x7faed8009760 comp rx=0 tx=0).stop 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.432+0000 7faee6e00640 1 -- 172.21.15.8:0/3975345363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee00741e0 msgr2=0x7faee019a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.432+0000 7faee6e00640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee00741e0 0x7faee019a3e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faecc000c00 tx=0x7faecc02ccd0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.432+0000 7faee6e00640 1 -- 172.21.15.8:0/3975345363 shutdown_connections 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.432+0000 7faee6e00640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faec40a1d40 0x7faec40a4200 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.432+0000 7faee6e00640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faee010dd20 0x7faee019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.432+0000 7faee6e00640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee00741e0 0x7faee019a3e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.432+0000 7faee6e00640 1 --2- 172.21.15.8:0/3975345363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faee00738c0 0x7faee0199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.432+0000 7faee6e00640 1 -- 172.21.15.8:0/3975345363 >> 172.21.15.8:0/3975345363 conn(0x7faee00788f0 msgr2=0x7faee00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.432+0000 7faee6e00640 1 -- 172.21.15.8:0/3975345363 shutdown_connections 2024-03-16T20:58:43.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.433+0000 7faee6e00640 1 -- 172.21.15.8:0/3975345363 wait complete. 2024-03-16T20:58:43.451 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:43 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3251455500' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:58:43.453 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:58:43.453 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T20:58:43.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.624+0000 7ffab7a00640 1 -- 172.21.15.8:0/1879165651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffab0103690 msgr2=0x7ffab0103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.624+0000 7ffab7a00640 1 --2- 172.21.15.8:0/1879165651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffab0103690 0x7ffab0103b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009900 tx=0x7ffa9c02bc40 comp rx=0 tx=0).stop 2024-03-16T20:58:43.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.625+0000 7ffab7a00640 1 -- 172.21.15.8:0/1879165651 shutdown_connections 2024-03-16T20:58:43.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.625+0000 7ffab7a00640 1 --2- 172.21.15.8:0/1879165651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffab0104050 0x7ffab0110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.625+0000 7ffab7a00640 1 --2- 172.21.15.8:0/1879165651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffab0103690 0x7ffab0103b10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.625+0000 7ffab7a00640 1 --2- 172.21.15.8:0/1879165651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffab01096a0 0x7ffab0109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.625+0000 7ffab7a00640 1 -- 172.21.15.8:0/1879165651 >> 172.21.15.8:0/1879165651 conn(0x7ffab00ff1a0 msgr2=0x7ffab01015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.625+0000 7ffab7a00640 1 -- 172.21.15.8:0/1879165651 shutdown_connections 2024-03-16T20:58:43.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.625+0000 7ffab7a00640 1 -- 172.21.15.8:0/1879165651 wait complete. 2024-03-16T20:58:43.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.626+0000 7ffab7a00640 1 Processor -- start 2024-03-16T20:58:43.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.626+0000 7ffab7a00640 1 -- start start 2024-03-16T20:58:43.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.626+0000 7ffab7a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffab0103690 0x7ffab0199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.626+0000 7ffab7a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffab0104050 0x7ffab019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.626+0000 7ffab7a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffab01096a0 0x7ffab019e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.626+0000 7ffab7a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab019ece0 con 0x7ffab0104050 2024-03-16T20:58:43.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.626+0000 7ffab7a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab019ee50 con 0x7ffab0103690 2024-03-16T20:58:43.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.626+0000 7ffab7a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab019f010 con 0x7ffab01096a0 2024-03-16T20:58:43.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.626+0000 7ffab5000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffab0103690 0x7ffab0199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.626+0000 7ffab5000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffab0103690 0x7ffab0199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46702/0 (socket says 172.21.15.8:46702) 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.626+0000 7ffab5000640 1 -- 172.21.15.8:0/3442888427 learned_addr learned my addr 172.21.15.8:0/3442888427 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.627+0000 7ffaafe00640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffab0104050 0x7ffab019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.627+0000 7ffab5a00640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffab01096a0 0x7ffab019e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.627+0000 7ffab5000640 1 -- 172.21.15.8:0/3442888427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffab01096a0 msgr2=0x7ffab019e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.627+0000 7ffab5000640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffab01096a0 0x7ffab019e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.627+0000 7ffab5000640 1 -- 172.21.15.8:0/3442888427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffab0104050 msgr2=0x7ffab019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.627+0000 7ffab5000640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffab0104050 0x7ffab019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.627+0000 7ffab5000640 1 -- 172.21.15.8:0/3442888427 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa8009840 con 0x7ffab0103690 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.627+0000 7ffab5a00640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffab01096a0 0x7ffab019e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.627+0000 7ffab5000640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffab0103690 0x7ffab0199e20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400d950 tx=0x7ffaa400dd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.628+0000 7ffaad600640 1 -- 172.21.15.8:0/3442888427 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400de80 con 0x7ffab0103690 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.628+0000 7ffaad600640 1 -- 172.21.15.8:0/3442888427 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ffaa4004020 con 0x7ffab0103690 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.628+0000 7ffaad600640 1 -- 172.21.15.8:0/3442888427 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4004a00 con 0x7ffab0103690 2024-03-16T20:58:43.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.628+0000 7ffab7a00640 1 -- 172.21.15.8:0/3442888427 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9c009560 con 0x7ffab0103690 2024-03-16T20:58:43.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.628+0000 7ffab7a00640 1 -- 172.21.15.8:0/3442888427 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab01a6990 con 0x7ffab0103690 2024-03-16T20:58:43.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.632+0000 7ffaba5fe740 1 Processor -- start 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.632+0000 7ffaba5fe740 1 -- start start 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.632+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da091eae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.632+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091eb400 0x55da091fc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091fc950 0x55da091fed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da09159210 con 0x55da091eb400 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da09156740 con 0x55da091fc950 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da09151f20 con 0x55da091eaa50 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffaafe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091fc950 0x55da091fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffab5a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da091eae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffaafe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091fc950 0x55da091fed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46706/0 (socket says 172.21.15.8:46706) 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffaafe00640 1 -- 172.21.15.8:0/334238690 learned_addr learned my addr 172.21.15.8:0/334238690 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffaad600640 1 -- 172.21.15.8:0/3442888427 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7ffaa4004190 con 0x7ffab0103690 2024-03-16T20:58:43.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffab5a00640 1 -- 172.21.15.8:0/334238690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091fc950 msgr2=0x55da091fed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffab5a00640 1 --2- 172.21.15.8:0/334238690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091fc950 0x55da091fed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.633+0000 7ffab5a00640 1 -- 172.21.15.8:0/334238690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091eb400 msgr2=0x55da091fc410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T20:58:43.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.634+0000 7ffab5a00640 1 --2- 172.21.15.8:0/334238690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091eb400 0x55da091fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.634+0000 7ffab5a00640 1 -- 172.21.15.8:0/334238690 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da09113df0 con 0x55da091eaa50 2024-03-16T20:58:43.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.634+0000 7ffab5a00640 1 --2- 172.21.15.8:0/334238690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da091eae30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800e890 tx=0x7ffaa800ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d1864b1649555e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.634+0000 7ffaa2000640 1 -- 172.21.15.8:0/334238690 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8004d20 con 0x55da091eaa50 2024-03-16T20:58:43.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.634+0000 7ffaa2000640 1 -- 172.21.15.8:0/334238690 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ffaa8003970 con 0x55da091eaa50 2024-03-16T20:58:43.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.634+0000 7ffaa2000640 1 -- 172.21.15.8:0/334238690 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8004650 con 0x55da091eaa50 2024-03-16T20:58:43.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.635+0000 7ffaad600640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ffa980a1d40 0x7ffa980a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.635+0000 7ffaba5fe740 1 -- 172.21.15.8:0/334238690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 msgr2=0x55da091eae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.635+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/334238690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da091eae30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800e890 tx=0x7ffaa800ed50 comp rx=0 tx=0).stop 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.635+0000 7ffaba5fe740 1 -- 172.21.15.8:0/334238690 shutdown_connections 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.635+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/334238690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091fc950 0x55da091fed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.635+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/334238690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091eb400 0x55da091fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.635+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/334238690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da091eae30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.635+0000 7ffaba5fe740 1 -- 172.21.15.8:0/334238690 >> 172.21.15.8:0/334238690 conn(0x55da091e5370 msgr2=0x55da091e5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.635+0000 7ffaad600640 1 -- 172.21.15.8:0/3442888427 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ffaa40cd370 con 0x7ffab0103690 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.635+0000 7ffab5000640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ffa980a1d40 0x7ffa980a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.635+0000 7ffaba5fe740 1 -- 172.21.15.8:0/334238690 shutdown_connections 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.636+0000 7ffaba5fe740 1 -- 172.21.15.8:0/334238690 wait complete. 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.636+0000 7ffaba5fe740 1 -- start start 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.636+0000 7ffab5000640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ffa980a1d40 0x7ffa980a4200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40ca970 tx=0x7ffaa4005bf0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.636+0000 7ffaba5fe740 1 Processor -- start 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eaa50 0x55da091f6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eb400 0x55da091f6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091fc950 0x55da091fc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da090f7150 con 0x55da091fc950 2024-03-16T20:58:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da090f6df0 con 0x55da091eaa50 2024-03-16T20:58:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da08ec01c0 con 0x55da091eb400 2024-03-16T20:58:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffaba5fe740 10 client.0 _ll_register_callbacks cb 0x55da091462b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffab5a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eaa50 0x55da091f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffaafe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eb400 0x55da091f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffab5a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eaa50 0x55da091f6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46710/0 (socket says 172.21.15.8:46710) 2024-03-16T20:58:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffab5a00640 1 -- 172.21.15.8:0/1389685680 learned_addr learned my addr 172.21.15.8:0/1389685680 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffab5a00640 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091fc950 0x55da091fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:43 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3251455500' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:58:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.637+0000 7ffaafe00640 1 -- 172.21.15.8:0/1389685680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eaa50 msgr2=0x55da091f6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.638+0000 7ffaafe00640 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eaa50 0x55da091f6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.638+0000 7ffaafe00640 1 -- 172.21.15.8:0/1389685680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091fc950 msgr2=0x55da091fc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.638+0000 7ffaafe00640 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091fc950 0x55da091fc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.638+0000 7ffaafe00640 1 -- 172.21.15.8:0/1389685680 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa800e540 con 0x55da091eb400 2024-03-16T20:58:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.638+0000 7ffab5a00640 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eaa50 0x55da091f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.638+0000 7ffaafe00640 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eb400 0x55da091f6890 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55da091e6500 tx=0x7ffa9c02caf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8019877a17e96b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.638+0000 7ffa96a00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.638+0000 7ffa96a00640 1 -- 172.21.15.8:0/1389685680 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c02cce0 con 0x55da091eb400 2024-03-16T20:58:43.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.638+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1389685680 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da08e517e0 con 0x55da091eb400 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.638+0000 7ffa96a00640 1 -- 172.21.15.8:0/1389685680 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ffa9c046070 con 0x55da091eb400 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.638+0000 7ffa96a00640 1 -- 172.21.15.8:0/1389685680 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa9c004250 con 0x55da091eb400 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.639+0000 7ffaba5fe740 10 client.25672 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.639+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1389685680 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55da091505a0 con 0x55da091eb400 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.639+0000 7ffa96a00640 1 -- 172.21.15.8:0/1389685680 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55da08e517e0 con 0x55da091eb400 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.639+0000 7ffa96a00640 1 -- 172.21.15.8:0/1389685680 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7ffa9c03c040 con 0x55da091eb400 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.639+0000 7ffaba5fe740 10 client.25672 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.639+0000 7ffaba5fe740 10 client.25672 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.639+0000 7ffaba5fe740 20 client.25672 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.639+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55da09215200 0x55da09217620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.639+0000 7ffaba5fe740 4 client.25672 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.639+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1389685680 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da08e8e720 con 0x55da09215200 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.639+0000 7ffab5a00640 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55da09215200 0x55da09217620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.640+0000 7ffab5a00640 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55da09215200 0x55da09217620 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ba7f11cceed9d8bf server_cookie=8bbe9f72f0b5102 in_seq=0 out_seq=0 2024-03-16T20:58:43.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.640+0000 7ffa96a00640 10 client.25672 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffa96a00640 1 -- 172.21.15.8:0/1389685680 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55da08e8e720 con 0x55da09215200 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffa96a00640 10 client.25672 handle_command_reply: tid=0 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 1 client.25672 shutdown 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1389685680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eb400 msgr2=0x55da091f6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eb400 0x55da091f6890 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55da091e6500 tx=0x7ffa9c02caf0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1389685680 shutdown_connections 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55da09215200 0x55da09217620 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091fc950 0x55da091fc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eb400 0x55da091f6890 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1389685680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eaa50 0x55da091f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1389685680 >> 172.21.15.8:0/1389685680 conn(0x55da091e5370 msgr2=0x55da091e70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffa96a00640 0 client.25672 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1389685680 shutdown_connections 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1389685680 wait complete. 2024-03-16T20:58:43.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.641+0000 7ffaba5fe740 20 client.25672 trim_cache size 0 max 16384 2024-03-16T20:58:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.655+0000 7ffaba5fe740 1 Processor -- start 2024-03-16T20:58:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.655+0000 7ffaba5fe740 1 -- start start 2024-03-16T20:58:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.655+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da091fbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.655+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091eb400 0x55da091ee9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.655+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091fc950 0x55da091eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.655+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da091e9fa0 con 0x55da091eb400 2024-03-16T20:58:43.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.655+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da091f21a0 con 0x55da091fc950 2024-03-16T20:58:43.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.655+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da091e5f40 con 0x55da091eaa50 2024-03-16T20:58:43.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.655+0000 7ffab5a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da091fbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.656+0000 7ffab5a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da091fbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52838/0 (socket says 172.21.15.8:52838) 2024-03-16T20:58:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.656+0000 7ffab5a00640 1 -- 172.21.15.8:0/1739347270 learned_addr learned my addr 172.21.15.8:0/1739347270 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.656+0000 7ffaafe00640 1 --2- 172.21.15.8:0/1739347270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091eb400 0x55da091ee9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.656+0000 7ffab5a00640 1 --2- 172.21.15.8:0/1739347270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091fc950 0x55da091eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.656+0000 7ffab5a00640 1 -- 172.21.15.8:0/1739347270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091fc950 msgr2=0x55da091eeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.656+0000 7ffab5a00640 1 --2- 172.21.15.8:0/1739347270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091fc950 0x55da091eeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.656+0000 7ffab5a00640 1 -- 172.21.15.8:0/1739347270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091eb400 msgr2=0x55da091ee9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.656+0000 7ffab5a00640 1 --2- 172.21.15.8:0/1739347270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091eb400 0x55da091ee9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.656+0000 7ffab5a00640 1 -- 172.21.15.8:0/1739347270 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da090ecab0 con 0x55da091eaa50 2024-03-16T20:58:43.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.656+0000 7ffab5a00640 1 --2- 172.21.15.8:0/1739347270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da091fbfb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800e890 tx=0x7ffaa8000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8199bac021028bfb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaa1600640 1 -- 172.21.15.8:0/1739347270 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8033040 con 0x55da091eaa50 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaa1600640 1 -- 172.21.15.8:0/1739347270 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ffaa8034040 con 0x55da091eaa50 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaa1600640 1 -- 172.21.15.8:0/1739347270 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa802e780 con 0x55da091eaa50 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1739347270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 msgr2=0x55da091fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1739347270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da091fbfb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800e890 tx=0x7ffaa8000f40 comp rx=0 tx=0).stop 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1739347270 shutdown_connections 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1739347270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091fc950 0x55da091eeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1739347270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091eb400 0x55da091ee9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1739347270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da091fbfb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1739347270 >> 172.21.15.8:0/1739347270 conn(0x55da091e5370 msgr2=0x55da091e4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1739347270 shutdown_connections 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.657+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1739347270 wait complete. 2024-03-16T20:58:43.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.658+0000 7ffaba5fe740 1 -- start start 2024-03-16T20:58:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.658+0000 7ffaba5fe740 1 Processor -- start 2024-03-16T20:58:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.658+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da09264c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.658+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eb400 0x55da09265180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.658+0000 7ffaba5fe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091fc950 0x55da09269b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.658+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da0926a050 con 0x55da091fc950 2024-03-16T20:58:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.658+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da0926a190 con 0x55da091eb400 2024-03-16T20:58:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.658+0000 7ffaba5fe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da0926a350 con 0x55da091eaa50 2024-03-16T20:58:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.658+0000 7ffaba5fe740 10 client.0 _ll_register_callbacks cb 0x55da091fc8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.658+0000 7ffaafe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eb400 0x55da09265180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffaafe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eb400 0x55da09265180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46728/0 (socket says 172.21.15.8:46728) 2024-03-16T20:58:43.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffaafe00640 1 -- 172.21.15.8:0/1244198009 learned_addr learned my addr 172.21.15.8:0/1244198009 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffaafe00640 1 -- 172.21.15.8:0/1244198009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 msgr2=0x55da09264c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-16T20:58:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffaafe00640 1 --2- 172.21.15.8:0/1244198009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da09264c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffaafe00640 1 -- 172.21.15.8:0/1244198009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091fc950 msgr2=0x55da09269b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffaafe00640 1 --2- 172.21.15.8:0/1244198009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091fc950 0x55da09269b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffaafe00640 1 -- 172.21.15.8:0/1244198009 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da09113df0 con 0x55da091eb400 2024-03-16T20:58:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffaafe00640 1 --2- 172.21.15.8:0/1244198009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eb400 0x55da09265180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c005ec0 tx=0x7ffa9c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c745369804fda4e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffa96a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffa96a00640 1 -- 172.21.15.8:0/1244198009 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c003ad0 con 0x55da091eb400 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffa96a00640 1 -- 172.21.15.8:0/1244198009 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ffa9c000e40 con 0x55da091eb400 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1244198009 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffaa8003970 con 0x55da091eb400 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffa96a00640 1 -- 172.21.15.8:0/1244198009 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa9c02cd60 con 0x55da091eb400 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffaba5fe740 10 client.25673 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.660+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1244198009 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55da09112650 con 0x55da091eb400 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.661+0000 7ffa96a00640 1 -- 172.21.15.8:0/1244198009 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ffaa8003970 con 0x55da091eb400 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.661+0000 7ffa96a00640 1 -- 172.21.15.8:0/1244198009 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7ffa9c03c040 con 0x55da091eb400 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.661+0000 7ffaba5fe740 10 client.25673 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.661+0000 7ffaba5fe740 10 client.25673 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.661+0000 7ffaba5fe740 20 client.25673 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.661+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1244198009 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55da09271a50 0x55da09273e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.661+0000 7ffaba5fe740 4 client.25673 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.661+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1244198009 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55da08edd890 con 0x55da09271a50 2024-03-16T20:58:43.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.661+0000 7ffab5a00640 1 --2- 172.21.15.8:0/1244198009 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55da09271a50 0x55da09273e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffab5a00640 1 --2- 172.21.15.8:0/1244198009 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55da09271a50 0x55da09273e70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=270a19a4f40b840a server_cookie=bf0194b3058fa781 in_seq=0 out_seq=0 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffa96a00640 10 client.25673 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffa96a00640 1 -- 172.21.15.8:0/1244198009 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55da08edd890 con 0x55da09271a50 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffa96a00640 10 client.25673 handle_command_reply: tid=0 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffaba5fe740 1 client.25673 shutdown 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1244198009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eb400 msgr2=0x55da09265180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1244198009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eb400 0x55da09265180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c005ec0 tx=0x7ffa9c000bc0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1244198009 shutdown_connections 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1244198009 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55da09271a50 0x55da09273e70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1244198009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da091fc950 0x55da09269b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1244198009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da091eb400 0x55da09265180 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffaba5fe740 1 --2- 172.21.15.8:0/1244198009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55da091eaa50 0x55da09264c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1244198009 >> 172.21.15.8:0/1244198009 conn(0x55da091e5370 msgr2=0x55da091e6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.662+0000 7ffa96a00640 0 client.25673 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:58:43.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.663+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1244198009 shutdown_connections 2024-03-16T20:58:43.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.663+0000 7ffaba5fe740 1 -- 172.21.15.8:0/1244198009 wait complete. 2024-03-16T20:58:43.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.663+0000 7ffaba5fe740 20 client.25673 trim_cache size 0 max 16384 2024-03-16T20:58:43.671 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:58:43.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.663+0000 7ffab7a00640 1 -- 172.21.15.8:0/3442888427 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ffa980a1d40 msgr2=0x7ffa980a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.663+0000 7ffab7a00640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ffa980a1d40 0x7ffa980a4200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40ca970 tx=0x7ffaa4005bf0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.663+0000 7ffab7a00640 1 -- 172.21.15.8:0/3442888427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffab0103690 msgr2=0x7ffab0199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.663+0000 7ffab7a00640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffab0103690 0x7ffab0199e20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400d950 tx=0x7ffaa400dd50 comp rx=0 tx=0).stop 2024-03-16T20:58:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.664+0000 7ffab7a00640 1 -- 172.21.15.8:0/3442888427 shutdown_connections 2024-03-16T20:58:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.664+0000 7ffab7a00640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ffa980a1d40 0x7ffa980a4200 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.664+0000 7ffab7a00640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffab01096a0 0x7ffab019e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.664+0000 7ffab7a00640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffab0104050 0x7ffab019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.664+0000 7ffab7a00640 1 --2- 172.21.15.8:0/3442888427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffab0103690 0x7ffab0199e20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.664+0000 7ffab7a00640 1 -- 172.21.15.8:0/3442888427 >> 172.21.15.8:0/3442888427 conn(0x7ffab00ff1a0 msgr2=0x7ffab00ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.664+0000 7ffab7a00640 1 -- 172.21.15.8:0/3442888427 shutdown_connections 2024-03-16T20:58:43.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.664+0000 7ffab7a00640 1 -- 172.21.15.8:0/3442888427 wait complete. 2024-03-16T20:58:43.688 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:58:43.688 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T20:58:43.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:43 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3251455500' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:58:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.887+0000 7fe5f7200640 1 -- 172.21.15.8:0/3351549429 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5f8103590 msgr2=0x7fe5f8103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.887+0000 7fe5f7200640 1 --2- 172.21.15.8:0/3351549429 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5f8103590 0x7fe5f8103a10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4009930 tx=0x7fe5e402bc30 comp rx=0 tx=0).stop 2024-03-16T20:58:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.887+0000 7fe5f7200640 1 -- 172.21.15.8:0/3351549429 shutdown_connections 2024-03-16T20:58:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.887+0000 7fe5f7200640 1 --2- 172.21.15.8:0/3351549429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8103f50 0x7fe5f8110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.887+0000 7fe5f7200640 1 --2- 172.21.15.8:0/3351549429 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5f8103590 0x7fe5f8103a10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.887+0000 7fe5f7200640 1 --2- 172.21.15.8:0/3351549429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f8109650 0x7fe5f8109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.887+0000 7fe5f7200640 1 -- 172.21.15.8:0/3351549429 >> 172.21.15.8:0/3351549429 conn(0x7fe5f80ff000 msgr2=0x7fe5f8101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.887+0000 7fe5f7200640 1 -- 172.21.15.8:0/3351549429 shutdown_connections 2024-03-16T20:58:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.887+0000 7fe5f7200640 1 -- 172.21.15.8:0/3351549429 wait complete. 2024-03-16T20:58:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.888+0000 7fe5f7200640 1 Processor -- start 2024-03-16T20:58:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.889+0000 7fe5f7200640 1 -- start start 2024-03-16T20:58:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.889+0000 7fe5f7200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5f8103590 0x7fe5f819f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.889+0000 7fe5f7200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8103f50 0x7fe5f819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.889+0000 7fe5f7200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f8109650 0x7fe5f81999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.889+0000 7fe5f7200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f819a030 con 0x7fe5f8109650 2024-03-16T20:58:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.889+0000 7fe5f7200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f819a1a0 con 0x7fe5f8103f50 2024-03-16T20:58:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.889+0000 7fe5f7200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f819a360 con 0x7fe5f8103590 2024-03-16T20:58:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.889+0000 7fe5f5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5f8103590 0x7fe5f819f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.889+0000 7fe5f5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5f8103590 0x7fe5f819f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52864/0 (socket says 172.21.15.8:52864) 2024-03-16T20:58:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.889+0000 7fe5f5e00640 1 -- 172.21.15.8:0/3379387932 learned_addr learned my addr 172.21.15.8:0/3379387932 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.889+0000 7fe5f5400640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8103f50 0x7fe5f819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.890+0000 7fe5f6800640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f8109650 0x7fe5f81999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.890+0000 7fe5f5e00640 1 -- 172.21.15.8:0/3379387932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8103f50 msgr2=0x7fe5f819fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.890+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8103f50 0x7fe5f819fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.890+0000 7fe5f5e00640 1 -- 172.21.15.8:0/3379387932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f8109650 msgr2=0x7fe5f81999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.890+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f8109650 0x7fe5f81999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.890+0000 7fe5f5e00640 1 -- 172.21.15.8:0/3379387932 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4009560 con 0x7fe5f8103590 2024-03-16T20:58:43.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.890+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5f8103590 0x7fe5f819f830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e9f0 tx=0x7fe5e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.890+0000 7fe5eea00640 1 -- 172.21.15.8:0/3379387932 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8009700 con 0x7fe5f8103590 2024-03-16T20:58:43.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.890+0000 7fe5eea00640 1 -- 172.21.15.8:0/3379387932 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe5e800cd80 con 0x7fe5f8103590 2024-03-16T20:58:43.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.890+0000 7fe5f7200640 1 -- 172.21.15.8:0/3379387932 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f819a640 con 0x7fe5f8103590 2024-03-16T20:58:43.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.891+0000 7fe5eea00640 1 -- 172.21.15.8:0/3379387932 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80189c0 con 0x7fe5f8103590 2024-03-16T20:58:43.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.891+0000 7fe5f7200640 1 -- 172.21.15.8:0/3379387932 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f81a68d0 con 0x7fe5f8103590 2024-03-16T20:58:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.895+0000 7fe5ff781740 1 Processor -- start 2024-03-16T20:58:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.895+0000 7fe5eea00640 1 -- 172.21.15.8:0/3379387932 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7fe5e8018b20 con 0x7fe5f8103590 2024-03-16T20:58:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.895+0000 7fe5ff781740 1 -- start start 2024-03-16T20:58:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 0x5570a960f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960f710 0x5570a9617db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a96182f0 0x5570a961a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5ff781740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a957d210 con 0x5570a960edf0 2024-03-16T20:58:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5ff781740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a957a740 con 0x5570a960f710 2024-03-16T20:58:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5ff781740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a9575f20 con 0x5570a96182f0 2024-03-16T20:58:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5f5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960f710 0x5570a9617db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5f5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a96182f0 0x5570a961a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5f5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a96182f0 0x5570a961a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52866/0 (socket says 172.21.15.8:52866) 2024-03-16T20:58:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5f6800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 0x5570a960f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5f5400640 1 -- 172.21.15.8:0/249200676 learned_addr learned my addr 172.21.15.8:0/249200676 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.896+0000 7fe5f5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960f710 0x5570a9617db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46764/0 (socket says 172.21.15.8:46764) 2024-03-16T20:58:43.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.897+0000 7fe5f5400640 1 -- 172.21.15.8:0/249200676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960f710 msgr2=0x5570a9617db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.897+0000 7fe5f5400640 1 --2- 172.21.15.8:0/249200676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960f710 0x5570a9617db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.897+0000 7fe5f5400640 1 -- 172.21.15.8:0/249200676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 msgr2=0x5570a960f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.897+0000 7fe5f5400640 1 --2- 172.21.15.8:0/249200676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 0x5570a960f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.897+0000 7fe5f5400640 1 -- 172.21.15.8:0/249200676 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570a9537df0 con 0x5570a96182f0 2024-03-16T20:58:43.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.897+0000 7fe5f5400640 1 --2- 172.21.15.8:0/249200676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a96182f0 0x5570a961a6e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4005ab0 tx=0x7fe5e402c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7955fd1e93638b05 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.897+0000 7fe5eea00640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe5dc0a1d40 0x7fe5dc0a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.898+0000 7fe5e3000640 1 -- 172.21.15.8:0/249200676 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4004880 con 0x5570a96182f0 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.898+0000 7fe5eea00640 1 -- 172.21.15.8:0/3379387932 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe5e8014070 con 0x7fe5f8103590 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.898+0000 7fe5e3000640 1 -- 172.21.15.8:0/249200676 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe5e40049e0 con 0x5570a96182f0 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.898+0000 7fe5e3000640 1 -- 172.21.15.8:0/249200676 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4005270 con 0x5570a96182f0 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.898+0000 7fe5f6800640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe5dc0a1d40 0x7fe5dc0a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.898+0000 7fe5ff781740 1 -- 172.21.15.8:0/249200676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a96182f0 msgr2=0x5570a961a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.898+0000 7fe5ff781740 1 --2- 172.21.15.8:0/249200676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a96182f0 0x5570a961a6e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4005ab0 tx=0x7fe5e402c770 comp rx=0 tx=0).stop 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.899+0000 7fe5ff781740 1 -- 172.21.15.8:0/249200676 shutdown_connections 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.899+0000 7fe5ff781740 1 --2- 172.21.15.8:0/249200676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a96182f0 0x5570a961a6e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.899+0000 7fe5ff781740 1 --2- 172.21.15.8:0/249200676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960f710 0x5570a9617db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.899+0000 7fe5ff781740 1 --2- 172.21.15.8:0/249200676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 0x5570a960f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.899+0000 7fe5ff781740 1 -- 172.21.15.8:0/249200676 >> 172.21.15.8:0/249200676 conn(0x5570a9609520 msgr2=0x5570a9609900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.899+0000 7fe5f6800640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe5dc0a1d40 0x7fe5dc0a4200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0007ed0 tx=0x7fe5f0007680 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.899+0000 7fe5ff781740 1 -- 172.21.15.8:0/249200676 shutdown_connections 2024-03-16T20:58:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.899+0000 7fe5ff781740 1 -- 172.21.15.8:0/249200676 wait complete. 2024-03-16T20:58:43.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.899+0000 7fe5ff781740 1 -- start start 2024-03-16T20:58:43.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.899+0000 7fe5ff781740 1 Processor -- start 2024-03-16T20:58:43.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 0x5570a9615360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 0x5570a96158a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a96182f0 0x5570a9615de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5ff781740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a951b150 con 0x5570a960edf0 2024-03-16T20:58:43.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5ff781740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a951adf0 con 0x5570a96182f0 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5ff781740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a92e41c0 con 0x5570a960f710 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5ff781740 10 client.0 _ll_register_callbacks cb 0x5570a956a2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5f5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 0x5570a9615360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5f5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 0x5570a9615360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40332/0 (socket says 172.21.15.8:40332) 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5f5e00640 1 -- 172.21.15.8:0/1392064588 learned_addr learned my addr 172.21.15.8:0/1392064588 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5f5400640 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 0x5570a96158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.900+0000 7fe5f6800640 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a96182f0 0x5570a9615de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.901+0000 7fe5f5400640 1 -- 172.21.15.8:0/1392064588 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a96182f0 msgr2=0x5570a9615de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.901+0000 7fe5f5400640 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a96182f0 0x5570a9615de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.901+0000 7fe5f5400640 1 -- 172.21.15.8:0/1392064588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 msgr2=0x5570a9615360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.901+0000 7fe5f5400640 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 0x5570a9615360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.901+0000 7fe5f5400640 1 -- 172.21.15.8:0/1392064588 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f8110d10 con 0x5570a960f710 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.901+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 0x5570a9615360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.901+0000 7fe5f5400640 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 0x5570a96158a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe5e402c240 tx=0x7fe5e4005870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a132a8ff853b2ad server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.901+0000 7fe5d7400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:43.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.901+0000 7fe5d7400640 1 -- 172.21.15.8:0/1392064588 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4004880 con 0x5570a960f710 2024-03-16T20:58:43.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.901+0000 7fe5d7400640 1 -- 172.21.15.8:0/1392064588 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe5e40051c0 con 0x5570a960f710 2024-03-16T20:58:43.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.901+0000 7fe5ff781740 1 -- 172.21.15.8:0/1392064588 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570a92757e0 con 0x5570a960f710 2024-03-16T20:58:43.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.902+0000 7fe5d7400640 1 -- 172.21.15.8:0/1392064588 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5e4005380 con 0x5570a960f710 2024-03-16T20:58:43.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.902+0000 7fe5ff781740 10 client.25687 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:43.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.902+0000 7fe5ff781740 1 -- 172.21.15.8:0/1392064588 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5570a95745a0 con 0x5570a960f710 2024-03-16T20:58:43.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.902+0000 7fe5d7400640 1 -- 172.21.15.8:0/1392064588 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5570a92757e0 con 0x5570a960f710 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.902+0000 7fe5d7400640 1 -- 172.21.15.8:0/1392064588 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe5e403c050 con 0x5570a960f710 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.902+0000 7fe5ff781740 10 client.25687 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.902+0000 7fe5ff781740 10 client.25687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.902+0000 7fe5ff781740 20 client.25687 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.902+0000 7fe5ff781740 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570a9627eb0 0x5570a962a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.902+0000 7fe5ff781740 4 client.25687 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.902+0000 7fe5ff781740 1 -- 172.21.15.8:0/1392064588 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5570a92b2720 con 0x5570a9627eb0 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.903+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570a9627eb0 0x5570a962a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.903+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570a9627eb0 0x5570a962a2c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f4807586695d16a server_cookie=2a7b573765494b6b in_seq=0 out_seq=0 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.903+0000 7fe5d7400640 10 client.25687 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.904+0000 7fe5d7400640 1 -- 172.21.15.8:0/1392064588 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5570a92b2720 con 0x5570a9627eb0 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.904+0000 7fe5d7400640 10 client.25687 handle_command_reply: tid=0 2024-03-16T20:58:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.904+0000 7fe5ff781740 1 client.25687 shutdown 2024-03-16T20:58:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.904+0000 7fe5ff781740 1 -- 172.21.15.8:0/1392064588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 msgr2=0x5570a96158a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.904+0000 7fe5ff781740 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 0x5570a96158a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe5e402c240 tx=0x7fe5e4005870 comp rx=0 tx=0).stop 2024-03-16T20:58:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.905+0000 7fe5ff781740 1 -- 172.21.15.8:0/1392064588 shutdown_connections 2024-03-16T20:58:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.905+0000 7fe5ff781740 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a96182f0 0x5570a9615de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.905+0000 7fe5ff781740 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 0x5570a96158a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.905+0000 7fe5ff781740 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570a9627eb0 0x5570a962a2c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.905+0000 7fe5ff781740 1 --2- 172.21.15.8:0/1392064588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960edf0 0x5570a9615360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.905+0000 7fe5ff781740 1 -- 172.21.15.8:0/1392064588 >> 172.21.15.8:0/1392064588 conn(0x5570a9609520 msgr2=0x5570a960b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.905+0000 7fe5d7400640 0 client.25687 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.905+0000 7fe5ff781740 1 -- 172.21.15.8:0/1392064588 shutdown_connections 2024-03-16T20:58:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.905+0000 7fe5ff781740 1 -- 172.21.15.8:0/1392064588 wait complete. 2024-03-16T20:58:43.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.905+0000 7fe5ff781740 20 client.25687 trim_cache size 0 max 16384 2024-03-16T20:58:43.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.919+0000 7fe5ff781740 1 Processor -- start 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.919+0000 7fe5ff781740 1 -- start start 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.919+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960edf0 0x5570a9617a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.919+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 0x5570a9604550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.919+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a96182f0 0x5570a960b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.919+0000 7fe5ff781740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a92757e0 con 0x5570a96182f0 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.919+0000 7fe5ff781740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a960e210 con 0x5570a960edf0 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.919+0000 7fe5ff781740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a9624e60 con 0x5570a960f710 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960edf0 0x5570a9617a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 0x5570a9604550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960edf0 0x5570a9617a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46778/0 (socket says 172.21.15.8:46778) 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 0x5570a9604550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52892/0 (socket says 172.21.15.8:52892) 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5e00640 1 -- 172.21.15.8:0/2144056806 learned_addr learned my addr 172.21.15.8:0/2144056806 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f6800640 1 --2- 172.21.15.8:0/2144056806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a96182f0 0x5570a960b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5e00640 1 -- 172.21.15.8:0/2144056806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 msgr2=0x5570a9604550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/2144056806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 0x5570a9604550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5e00640 1 -- 172.21.15.8:0/2144056806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a96182f0 msgr2=0x5570a960b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/2144056806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a96182f0 0x5570a960b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5e00640 1 -- 172.21.15.8:0/2144056806 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570a9510ab0 con 0x5570a960edf0 2024-03-16T20:58:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5400640 1 --2- 172.21.15.8:0/2144056806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 0x5570a9604550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f6800640 1 --2- 172.21.15.8:0/2144056806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a96182f0 0x5570a960b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/2144056806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960edf0 0x5570a9617a90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe5e809a520 tx=0x7fe5e80d0190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d84ab8a8c222786 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.920+0000 7fe5e2600640 1 -- 172.21.15.8:0/2144056806 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e809a5f0 con 0x5570a960edf0 2024-03-16T20:58:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.921+0000 7fe5e2600640 1 -- 172.21.15.8:0/2144056806 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe5e809a360 con 0x5570a960edf0 2024-03-16T20:58:43.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.921+0000 7fe5e2600640 1 -- 172.21.15.8:0/2144056806 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8098bb0 con 0x5570a960edf0 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.921+0000 7fe5ff781740 1 -- 172.21.15.8:0/2144056806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960edf0 msgr2=0x5570a9617a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.921+0000 7fe5ff781740 1 --2- 172.21.15.8:0/2144056806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960edf0 0x5570a9617a90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe5e809a520 tx=0x7fe5e80d0190 comp rx=0 tx=0).stop 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.921+0000 7fe5ff781740 1 -- 172.21.15.8:0/2144056806 shutdown_connections 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.921+0000 7fe5ff781740 1 --2- 172.21.15.8:0/2144056806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a96182f0 0x5570a960b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.921+0000 7fe5ff781740 1 --2- 172.21.15.8:0/2144056806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960f710 0x5570a9604550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.921+0000 7fe5ff781740 1 --2- 172.21.15.8:0/2144056806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a960edf0 0x5570a9617a90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.921+0000 7fe5ff781740 1 -- 172.21.15.8:0/2144056806 >> 172.21.15.8:0/2144056806 conn(0x5570a9609520 msgr2=0x5570a960a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.921+0000 7fe5ff781740 1 -- 172.21.15.8:0/2144056806 shutdown_connections 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.922+0000 7fe5ff781740 1 -- 172.21.15.8:0/2144056806 wait complete. 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.922+0000 7fe5ff781740 1 -- start start 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.922+0000 7fe5ff781740 1 Processor -- start 2024-03-16T20:58:43.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960edf0 0x5570a961fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960f710 0x5570a96124a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5ff781740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a96182f0 0x5570a96129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5ff781740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a9612f20 con 0x5570a960f710 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5ff781740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a9613090 con 0x5570a96182f0 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5ff781740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570a9613250 con 0x5570a960edf0 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5ff781740 10 client.0 _ll_register_callbacks cb 0x7fe5f0007520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5f5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960edf0 0x5570a961fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5f5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960edf0 0x5570a961fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52894/0 (socket says 172.21.15.8:52894) 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5f5e00640 1 -- 172.21.15.8:0/691156386 learned_addr learned my addr 172.21.15.8:0/691156386 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5f5400640 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960f710 0x5570a96124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.923+0000 7fe5f6800640 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a96182f0 0x5570a96129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5f5e00640 1 -- 172.21.15.8:0/691156386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a96182f0 msgr2=0x5570a96129e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a96182f0 0x5570a96129e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5f5e00640 1 -- 172.21.15.8:0/691156386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960f710 msgr2=0x5570a96124a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:43.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960f710 0x5570a96124a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5f5e00640 1 -- 172.21.15.8:0/691156386 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5570a95745a0 con 0x5570a960edf0 2024-03-16T20:58:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5f6800640 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a96182f0 0x5570a96129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5f5e00640 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960edf0 0x5570a961fc30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8000c00 tx=0x7fe5e80d1340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daf74580d40e8b62 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5d7400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5d7400640 1 -- 172.21.15.8:0/691156386 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e809a180 con 0x5570a960edf0 2024-03-16T20:58:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5d7400640 1 -- 172.21.15.8:0/691156386 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe5e809a820 con 0x5570a960edf0 2024-03-16T20:58:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5ff781740 1 -- 172.21.15.8:0/691156386 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570a9604c30 con 0x5570a960edf0 2024-03-16T20:58:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5d7400640 1 -- 172.21.15.8:0/691156386 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5e809af20 con 0x5570a960edf0 2024-03-16T20:58:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.924+0000 7fe5ff781740 10 client.25693 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.925+0000 7fe5ff781740 1 -- 172.21.15.8:0/691156386 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fe5f81a68d0 con 0x5570a960edf0 2024-03-16T20:58:43.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.925+0000 7fe5d7400640 1 -- 172.21.15.8:0/691156386 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5570a9604c30 con 0x5570a960edf0 2024-03-16T20:58:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.925+0000 7fe5d7400640 1 -- 172.21.15.8:0/691156386 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe5e809bc70 con 0x5570a960edf0 2024-03-16T20:58:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.925+0000 7fe5ff781740 10 client.25693 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.925+0000 7fe5ff781740 10 client.25693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.925+0000 7fe5ff781740 20 client.25693 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.925+0000 7fe5ff781740 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570a968d140 0x5570a968f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.925+0000 7fe5ff781740 4 client.25693 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:58:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.925+0000 7fe5ff781740 1 -- 172.21.15.8:0/691156386 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fe5e40049e0 con 0x5570a968d140 2024-03-16T20:58:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.926+0000 7fe5f5400640 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570a968d140 0x5570a968f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:43.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.926+0000 7fe5f5400640 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570a968d140 0x5570a968f560 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8de2e2f41dbad39d server_cookie=caa3dbfcecf36e7b in_seq=0 out_seq=0 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.926+0000 7fe5d7400640 10 client.25693 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.926+0000 7fe5d7400640 1 -- 172.21.15.8:0/691156386 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fe5e40049e0 con 0x5570a968d140 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.926+0000 7fe5d7400640 10 client.25693 handle_command_reply: tid=0 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.926+0000 7fe5ff781740 1 client.25693 shutdown 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5ff781740 1 -- 172.21.15.8:0/691156386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960edf0 msgr2=0x5570a961fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5ff781740 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960edf0 0x5570a961fc30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8000c00 tx=0x7fe5e80d1340 comp rx=0 tx=0).stop 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5ff781740 1 -- 172.21.15.8:0/691156386 shutdown_connections 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5ff781740 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570a96182f0 0x5570a96129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5ff781740 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570a968d140 0x5570a968f560 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5ff781740 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570a960f710 0x5570a96124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5ff781740 1 --2- 172.21.15.8:0/691156386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570a960edf0 0x5570a961fc30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5ff781740 1 -- 172.21.15.8:0/691156386 >> 172.21.15.8:0/691156386 conn(0x5570a9609520 msgr2=0x5570a9615b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5d7400640 0 client.25693 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5ff781740 1 -- 172.21.15.8:0/691156386 shutdown_connections 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5ff781740 1 -- 172.21.15.8:0/691156386 wait complete. 2024-03-16T20:58:43.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.927+0000 7fe5ff781740 20 client.25693 trim_cache size 0 max 16384 2024-03-16T20:58:43.936 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:58:43.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.928+0000 7fe5f7200640 1 -- 172.21.15.8:0/3379387932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe5dc0a1d40 msgr2=0x7fe5dc0a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.928+0000 7fe5f7200640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe5dc0a1d40 0x7fe5dc0a4200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0007ed0 tx=0x7fe5f0007680 comp rx=0 tx=0).stop 2024-03-16T20:58:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.928+0000 7fe5f7200640 1 -- 172.21.15.8:0/3379387932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5f8103590 msgr2=0x7fe5f819f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.928+0000 7fe5f7200640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5f8103590 0x7fe5f819f830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e9f0 tx=0x7fe5e800eeb0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.928+0000 7fe5f7200640 1 -- 172.21.15.8:0/3379387932 shutdown_connections 2024-03-16T20:58:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.928+0000 7fe5f7200640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe5dc0a1d40 0x7fe5dc0a4200 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.928+0000 7fe5f7200640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5f8109650 0x7fe5f81999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.928+0000 7fe5f7200640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f8103f50 0x7fe5f819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.928+0000 7fe5f7200640 1 --2- 172.21.15.8:0/3379387932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5f8103590 0x7fe5f819f830 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.928+0000 7fe5f7200640 1 -- 172.21.15.8:0/3379387932 >> 172.21.15.8:0/3379387932 conn(0x7fe5f80ff000 msgr2=0x7fe5f8100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.928+0000 7fe5f7200640 1 -- 172.21.15.8:0/3379387932 shutdown_connections 2024-03-16T20:58:43.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:43.929+0000 7fe5f7200640 1 -- 172.21.15.8:0/3379387932 wait complete. 2024-03-16T20:58:44.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:44 smithi186 ceph-mon[36391]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:58:44.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:44 smithi008 ceph-mon[31434]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:58:44.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:44 smithi170 ceph-mon[35947]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:58:44.950 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T20:58:44.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:58:44.950 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T20:58:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.976+0000 7f5e4ce00640 1 -- 172.21.15.8:0/457742320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e48076340 msgr2=0x7f5e48111e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.976+0000 7f5e4ce00640 1 --2- 172.21.15.8:0/457742320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e48076340 0x7f5e48111e00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009930 tx=0x7f5e3402bc30 comp rx=0 tx=0).stop 2024-03-16T20:58:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.976+0000 7f5e4ce00640 1 -- 172.21.15.8:0/457742320 shutdown_connections 2024-03-16T20:58:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.976+0000 7f5e4ce00640 1 --2- 172.21.15.8:0/457742320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e48112340 0x7f5e48114730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.976+0000 7f5e4ce00640 1 --2- 172.21.15.8:0/457742320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e48076340 0x7f5e48111e00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.976+0000 7f5e4ce00640 1 --2- 172.21.15.8:0/457742320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48075a20 0x7f5e48075e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.976+0000 7f5e4ce00640 1 -- 172.21.15.8:0/457742320 >> 172.21.15.8:0/457742320 conn(0x7f5e480ff170 msgr2=0x7f5e48101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.976+0000 7f5e4ce00640 1 -- 172.21.15.8:0/457742320 shutdown_connections 2024-03-16T20:58:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.976+0000 7f5e4ce00640 1 -- 172.21.15.8:0/457742320 wait complete. 2024-03-16T20:58:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.977+0000 7f5e4ce00640 1 Processor -- start 2024-03-16T20:58:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.977+0000 7f5e4ce00640 1 -- start start 2024-03-16T20:58:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.977+0000 7f5e4ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48075a20 0x7f5e4819e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.977+0000 7f5e4ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e48076340 0x7f5e4819e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.977+0000 7f5e4ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e48112340 0x7f5e481a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.977+0000 7f5e4ce00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e481a3090 con 0x7f5e48075a20 2024-03-16T20:58:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e4ce00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e481a3200 con 0x7f5e48112340 2024-03-16T20:58:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e4ce00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e481a33c0 con 0x7f5e48076340 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e46800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e48112340 0x7f5e481a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e46800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e48112340 0x7f5e481a2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46802/0 (socket says 172.21.15.8:46802) 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e46800640 1 -- 172.21.15.8:0/2975240043 learned_addr learned my addr 172.21.15.8:0/2975240043 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e45e00640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48075a20 0x7f5e4819e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e45400640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e48076340 0x7f5e4819e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e46800640 1 -- 172.21.15.8:0/2975240043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e48076340 msgr2=0x7f5e4819e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e46800640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e48076340 0x7f5e4819e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e46800640 1 -- 172.21.15.8:0/2975240043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48075a20 msgr2=0x7f5e4819e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e46800640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48075a20 0x7f5e4819e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e46800640 1 -- 172.21.15.8:0/2975240043 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009560 con 0x7f5e48112340 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.978+0000 7f5e45400640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e48076340 0x7f5e4819e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.979+0000 7f5e46800640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e48112340 0x7f5e481a2a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000eb40 tx=0x7f5e4000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.979+0000 7f5e3ea00640 1 -- 172.21.15.8:0/2975240043 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40004b20 con 0x7f5e48112340 2024-03-16T20:58:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.979+0000 7f5e3ea00640 1 -- 172.21.15.8:0/2975240043 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f5e40004c80 con 0x7f5e48112340 2024-03-16T20:58:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.979+0000 7f5e3ea00640 1 -- 172.21.15.8:0/2975240043 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40010830 con 0x7f5e48112340 2024-03-16T20:58:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.979+0000 7f5e4ce00640 1 -- 172.21.15.8:0/2975240043 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e481a36a0 con 0x7f5e48112340 2024-03-16T20:58:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.979+0000 7f5e4ce00640 1 -- 172.21.15.8:0/2975240043 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e481aaf20 con 0x7f5e48112340 2024-03-16T20:58:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.982+0000 7f5e4fb85740 1 Processor -- start 2024-03-16T20:58:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.982+0000 7f5e3ea00640 1 -- 172.21.15.8:0/2975240043 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f5e40005020 con 0x7f5e48112340 2024-03-16T20:58:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e4fb85740 1 -- start start 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 0x563c4fa3a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 0x563c4fa3b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa46720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4f9f6620 con 0x563c4fa44330 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4f9a88c0 con 0x563c4fa3bb20 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4f9a5df0 con 0x563c4fa3adb0 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e45400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 0x563c4fa3a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e45e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 0x563c4fa3b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e45400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 0x563c4fa3a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46804/0 (socket says 172.21.15.8:46804) 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e45400640 1 -- 172.21.15.8:0/3033743619 learned_addr learned my addr 172.21.15.8:0/3033743619 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.983+0000 7f5e45400640 1 --2- 172.21.15.8:0/3033743619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa46720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.984+0000 7f5e45e00640 1 -- 172.21.15.8:0/3033743619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 msgr2=0x563c4fa3a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.984+0000 7f5e45e00640 1 --2- 172.21.15.8:0/3033743619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 0x563c4fa3a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.984+0000 7f5e45e00640 1 -- 172.21.15.8:0/3033743619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 msgr2=0x563c4fa46720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.984+0000 7f5e45e00640 1 --2- 172.21.15.8:0/3033743619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa46720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.984+0000 7f5e45e00640 1 -- 172.21.15.8:0/3033743619 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c4f922b00 con 0x563c4fa3adb0 2024-03-16T20:58:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.984+0000 7f5e45400640 1 --2- 172.21.15.8:0/3033743619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa46720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.984+0000 7f5e45e00640 1 --2- 172.21.15.8:0/3033743619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 0x563c4fa3b230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009c20 tx=0x7f5e38011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e693b5213c65fd30 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.984+0000 7f5e33400640 1 -- 172.21.15.8:0/3033743619 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38009dd0 con 0x563c4fa3adb0 2024-03-16T20:58:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.984+0000 7f5e33400640 1 -- 172.21.15.8:0/3033743619 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f5e38005020 con 0x563c4fa3adb0 2024-03-16T20:58:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.984+0000 7f5e33400640 1 -- 172.21.15.8:0/3033743619 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38004c60 con 0x563c4fa3adb0 2024-03-16T20:58:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.984+0000 7f5e3ea00640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5e2c0a1de0 0x7f5e2c0a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e3ea00640 1 -- 172.21.15.8:0/2975240043 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e40014070 con 0x7f5e48112340 2024-03-16T20:58:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e45400640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5e2c0a1de0 0x7f5e2c0a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e4fb85740 1 -- 172.21.15.8:0/3033743619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 msgr2=0x563c4fa3b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/3033743619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 0x563c4fa3b230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009c20 tx=0x7f5e38011810 comp rx=0 tx=0).stop 2024-03-16T20:58:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e4fb85740 1 -- 172.21.15.8:0/3033743619 shutdown_connections 2024-03-16T20:58:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/3033743619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa46720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/3033743619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 0x563c4fa3b230 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/3033743619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 0x563c4fa3a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e4fb85740 1 -- 172.21.15.8:0/3033743619 >> 172.21.15.8:0/3033743619 conn(0x563c4fa024b0 msgr2=0x563c4fa35aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e4fb85740 1 -- 172.21.15.8:0/3033743619 shutdown_connections 2024-03-16T20:58:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e45400640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5e2c0a1de0 0x7f5e2c0a42a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x563c4fa3b850 tx=0x7f5e34005a20 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.985+0000 7f5e4fb85740 1 -- 172.21.15.8:0/3033743619 wait complete. 2024-03-16T20:58:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.986+0000 7f5e4fb85740 1 -- start start 2024-03-16T20:58:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.986+0000 7f5e4fb85740 1 Processor -- start 2024-03-16T20:58:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.986+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 0x563c4fa413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.986+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 0x563c4fa41910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa41e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4f9a15d0 con 0x563c4fa44330 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4f946b50 con 0x563c4fa3bb20 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4f9467f0 con 0x563c4fa3adb0 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e4fb85740 10 client.0 _ll_register_callbacks cb 0x563c4f95a550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e45e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 0x563c4fa413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e45e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 0x563c4fa413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52936/0 (socket says 172.21.15.8:52936) 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e45400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 0x563c4fa41910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e45e00640 1 -- 172.21.15.8:0/1975508629 learned_addr learned my addr 172.21.15.8:0/1975508629 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e46800640 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa41e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e45e00640 1 -- 172.21.15.8:0/1975508629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 msgr2=0x563c4fa41910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e45e00640 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 0x563c4fa41910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e45e00640 1 -- 172.21.15.8:0/1975508629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 msgr2=0x563c4fa41e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e45e00640 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa41e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e45e00640 1 -- 172.21.15.8:0/1975508629 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e38009850 con 0x563c4fa3adb0 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.987+0000 7f5e45400640 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 0x563c4fa41910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.988+0000 7f5e45e00640 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 0x563c4fa413d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5e3801b040 tx=0x7f5e38019b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90ea20f2b28bfdc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.988+0000 7f5e27e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.988+0000 7f5e27e00640 1 -- 172.21.15.8:0/1975508629 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38019d30 con 0x563c4fa3adb0 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.988+0000 7f5e27e00640 1 -- 172.21.15.8:0/1975508629 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e38024440 con 0x563c4fa3adb0 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.988+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1975508629 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c4f973cd0 con 0x563c4fa3adb0 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.988+0000 7f5e27e00640 1 -- 172.21.15.8:0/1975508629 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e38019e90 con 0x563c4fa3adb0 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.988+0000 7f5e4fb85740 10 client.25705 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.988+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1975508629 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563c4f99fc50 con 0x563c4fa3adb0 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.988+0000 7f5e27e00640 1 -- 172.21.15.8:0/1975508629 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x563c4f973cd0 con 0x563c4fa3adb0 2024-03-16T20:58:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.989+0000 7f5e27e00640 1 -- 172.21.15.8:0/1975508629 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f5e380229a0 con 0x563c4fa3adb0 2024-03-16T20:58:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.989+0000 7f5e4fb85740 10 client.25705 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.989+0000 7f5e4fb85740 10 client.25705 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.989+0000 7f5e4fb85740 20 client.25705 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.989+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563c4fa54270 0x563c4fa56680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.989+0000 7f5e4fb85740 4 client.25705 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.989+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1975508629 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c4f997ce0 con 0x563c4fa54270 2024-03-16T20:58:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.989+0000 7f5e45400640 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563c4fa54270 0x563c4fa56680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.990+0000 7f5e45400640 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563c4fa54270 0x563c4fa56680 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=933f4a5b735ab388 server_cookie=3b42829b2a101389 in_seq=0 out_seq=0 2024-03-16T20:58:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.990+0000 7f5e27e00640 10 client.25705 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e27e00640 1 -- 172.21.15.8:0/1975508629 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563c4f997ce0 con 0x563c4fa54270 2024-03-16T20:58:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e27e00640 10 client.25705 handle_command_reply: tid=0 2024-03-16T20:58:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 1 client.25705 shutdown 2024-03-16T20:58:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1975508629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 msgr2=0x563c4fa413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 0x563c4fa413d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5e3801b040 tx=0x7f5e38019b40 comp rx=0 tx=0).stop 2024-03-16T20:58:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1975508629 shutdown_connections 2024-03-16T20:58:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563c4fa54270 0x563c4fa56680 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa41e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3bb20 0x563c4fa41910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e27e00640 0 client.25705 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1975508629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3adb0 0x563c4fa413d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1975508629 >> 172.21.15.8:0/1975508629 conn(0x563c4fa024b0 msgr2=0x563c4fa377f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1975508629 shutdown_connections 2024-03-16T20:58:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1975508629 wait complete. 2024-03-16T20:58:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:44.991+0000 7f5e4fb85740 20 client.25705 trim_cache size 0 max 16384 2024-03-16T20:58:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.006+0000 7f5e4fb85740 1 Processor -- start 2024-03-16T20:58:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.006+0000 7f5e4fb85740 1 -- start start 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.006+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 0x563c4fa34bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.006+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3bb20 0x563c4fa41920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa41e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4f6e9e60 con 0x563c4fa44330 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4fa36ae0 con 0x563c4fa3adb0 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4fa3a100 con 0x563c4fa3bb20 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e45400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3bb20 0x563c4fa41920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e45e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 0x563c4fa34bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e45400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3bb20 0x563c4fa41920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52942/0 (socket says 172.21.15.8:52942) 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e45400640 1 -- 172.21.15.8:0/1676182991 learned_addr learned my addr 172.21.15.8:0/1676182991 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e46800640 1 --2- 172.21.15.8:0/1676182991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa41e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e45e00640 1 -- 172.21.15.8:0/1676182991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3bb20 msgr2=0x563c4fa41920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e45e00640 1 --2- 172.21.15.8:0/1676182991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3bb20 0x563c4fa41920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e45e00640 1 -- 172.21.15.8:0/1676182991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 msgr2=0x563c4fa41e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e45e00640 1 --2- 172.21.15.8:0/1676182991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa41e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e45e00640 1 -- 172.21.15.8:0/1676182991 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c4f93c530 con 0x563c4fa3adb0 2024-03-16T20:58:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e45400640 1 --2- 172.21.15.8:0/1676182991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3bb20 0x563c4fa41920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.007+0000 7f5e45e00640 1 --2- 172.21.15.8:0/1676182991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 0x563c4fa34bc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e38011d10 tx=0x7f5e38011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e3f666dafcfb6a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.008+0000 7f5e32a00640 1 -- 172.21.15.8:0/1676182991 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38019db0 con 0x563c4fa3adb0 2024-03-16T20:58:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.008+0000 7f5e32a00640 1 -- 172.21.15.8:0/1676182991 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f5e380055d0 con 0x563c4fa3adb0 2024-03-16T20:58:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.008+0000 7f5e32a00640 1 -- 172.21.15.8:0/1676182991 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e380035f0 con 0x563c4fa3adb0 2024-03-16T20:58:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.009+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1676182991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 msgr2=0x563c4fa34bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.009+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1676182991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 0x563c4fa34bc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e38011d10 tx=0x7f5e38011810 comp rx=0 tx=0).stop 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.009+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1676182991 shutdown_connections 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.009+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1676182991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa44330 0x563c4fa41e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.009+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1676182991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa3bb20 0x563c4fa41920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.009+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1676182991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 0x563c4fa34bc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.009+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1676182991 >> 172.21.15.8:0/1676182991 conn(0x563c4fa024b0 msgr2=0x563c4fa344b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.009+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1676182991 shutdown_connections 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.009+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1676182991 wait complete. 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.009+0000 7f5e4fb85740 1 -- start start 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e4fb85740 1 Processor -- start 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 0x563c4fa3e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa3bb20 0x563c4fa3ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e4fb85740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa44330 0x563c4fa44eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4fa453f0 con 0x563c4fa3bb20 2024-03-16T20:58:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4fa45560 con 0x563c4fa3adb0 2024-03-16T20:58:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e4fb85740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4fa45720 con 0x563c4fa44330 2024-03-16T20:58:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e4fb85740 10 client.0 _ll_register_callbacks cb 0x7f5e380197d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e45e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 0x563c4fa3e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e46800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa44330 0x563c4fa44eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e45e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 0x563c4fa3e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46848/0 (socket says 172.21.15.8:46848) 2024-03-16T20:58:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e45400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa3bb20 0x563c4fa3ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.010+0000 7f5e45e00640 1 -- 172.21.15.8:0/1515207596 learned_addr learned my addr 172.21.15.8:0/1515207596 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.011+0000 7f5e46800640 1 -- 172.21.15.8:0/1515207596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 msgr2=0x563c4fa3e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.011+0000 7f5e46800640 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 0x563c4fa3e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.011+0000 7f5e46800640 1 -- 172.21.15.8:0/1515207596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa3bb20 msgr2=0x563c4fa3ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.011+0000 7f5e46800640 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa3bb20 0x563c4fa3ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.011+0000 7f5e46800640 1 -- 172.21.15.8:0/1515207596 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e481151c0 con 0x563c4fa44330 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.011+0000 7f5e45400640 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa3bb20 0x563c4fa3ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.011+0000 7f5e46800640 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa44330 0x563c4fa44eb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5e400cb640 tx=0x7f5e400053f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52131afb8055d9fc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.011+0000 7f5e27e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.011+0000 7f5e27e00640 1 -- 172.21.15.8:0/1515207596 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4009eba0 con 0x563c4fa44330 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.011+0000 7f5e27e00640 1 -- 172.21.15.8:0/1515207596 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e400a31f0 con 0x563c4fa44330 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.011+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1515207596 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c4f9c6d30 con 0x563c4fa44330 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e27e00640 1 -- 172.21.15.8:0/1515207596 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e40005640 con 0x563c4fa44330 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e4fb85740 10 client.25711 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1515207596 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563c4f99fc50 con 0x563c4fa44330 2024-03-16T20:58:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e27e00640 1 -- 172.21.15.8:0/1515207596 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x563c4f9c6d30 con 0x563c4fa44330 2024-03-16T20:58:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e27e00640 1 -- 172.21.15.8:0/1515207596 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f5e40099ea0 con 0x563c4fa44330 2024-03-16T20:58:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e4fb85740 10 client.25711 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e4fb85740 10 client.25711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e4fb85740 20 client.25711 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563c4fab0b40 0x563c4fab2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e4fb85740 4 client.25711 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T20:58:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1515207596 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563c4f6a1600 con 0x563c4fab0b40 2024-03-16T20:58:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.012+0000 7f5e45e00640 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563c4fab0b40 0x563c4fab2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.013+0000 7f5e45e00640 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563c4fab0b40 0x563c4fab2f60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1c4e1026210b9e2 server_cookie=a5c847b5e8995234 in_seq=0 out_seq=0 2024-03-16T20:58:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.013+0000 7f5e27e00640 10 client.25711 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.015+0000 7f5e27e00640 1 -- 172.21.15.8:0/1515207596 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563c4f6a1600 con 0x563c4fab0b40 2024-03-16T20:58:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.015+0000 7f5e27e00640 10 client.25711 handle_command_reply: tid=0 2024-03-16T20:58:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 1 client.25711 shutdown 2024-03-16T20:58:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1515207596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa44330 msgr2=0x563c4fa44eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa44330 0x563c4fa44eb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5e400cb640 tx=0x7f5e400053f0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1515207596 shutdown_connections 2024-03-16T20:58:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c4fa44330 0x563c4fa44eb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563c4fab0b40 0x563c4fab2f60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c4fa3bb20 0x563c4fa3ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 1 --2- 172.21.15.8:0/1515207596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563c4fa3adb0 0x563c4fa3e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1515207596 >> 172.21.15.8:0/1515207596 conn(0x563c4fa024b0 msgr2=0x563c4fa37600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e27e00640 0 client.25711 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1515207596 shutdown_connections 2024-03-16T20:58:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 1 -- 172.21.15.8:0/1515207596 wait complete. 2024-03-16T20:58:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.016+0000 7f5e4fb85740 20 client.25711 trim_cache size 0 max 16384 2024-03-16T20:58:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T20:58:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T20:58:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T20:58:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T20:58:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.017+0000 7f5e4ce00640 1 -- 172.21.15.8:0/2975240043 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5e2c0a1de0 msgr2=0x7f5e2c0a42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.017+0000 7f5e4ce00640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5e2c0a1de0 0x7f5e2c0a42a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x563c4fa3b850 tx=0x7f5e34005a20 comp rx=0 tx=0).stop 2024-03-16T20:58:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.017+0000 7f5e4ce00640 1 -- 172.21.15.8:0/2975240043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e48112340 msgr2=0x7f5e481a2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.017+0000 7f5e4ce00640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e48112340 0x7f5e481a2a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000eb40 tx=0x7f5e4000c2d0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.018+0000 7f5e4ce00640 1 -- 172.21.15.8:0/2975240043 shutdown_connections 2024-03-16T20:58:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.018+0000 7f5e4ce00640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5e2c0a1de0 0x7f5e2c0a42a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.018+0000 7f5e4ce00640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e48112340 0x7f5e481a2a90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.018+0000 7f5e4ce00640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e48076340 0x7f5e4819e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.018+0000 7f5e4ce00640 1 --2- 172.21.15.8:0/2975240043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48075a20 0x7f5e4819e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.018+0000 7f5e4ce00640 1 -- 172.21.15.8:0/2975240043 >> 172.21.15.8:0/2975240043 conn(0x7f5e480ff170 msgr2=0x7f5e48113d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.018+0000 7f5e4ce00640 1 -- 172.21.15.8:0/2975240043 shutdown_connections 2024-03-16T20:58:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:45.018+0000 7f5e4ce00640 1 -- 172.21.15.8:0/2975240043 wait complete. 2024-03-16T20:58:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.152+0000 7fe2d5400640 1 -- 172.21.15.8:0/974705592 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2d0101f70 msgr2=0x7fe2d0105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.152+0000 7fe2d5400640 1 --2- 172.21.15.8:0/974705592 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2d0101f70 0x7fe2d0105fb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009930 tx=0x7fe2bc02bc20 comp rx=0 tx=0).stop 2024-03-16T20:58:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.152+0000 7fe2d5400640 1 -- 172.21.15.8:0/974705592 shutdown_connections 2024-03-16T20:58:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.152+0000 7fe2d5400640 1 --2- 172.21.15.8:0/974705592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2d0106690 0x7fe2d010e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.152+0000 7fe2d5400640 1 --2- 172.21.15.8:0/974705592 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2d0101f70 0x7fe2d0105fb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.152+0000 7fe2d5400640 1 --2- 172.21.15.8:0/974705592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2d01015c0 0x7fe2d01019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.152+0000 7fe2d5400640 1 -- 172.21.15.8:0/974705592 >> 172.21.15.8:0/974705592 conn(0x7fe2d00fce60 msgr2=0x7fe2d00ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.152+0000 7fe2d5400640 1 -- 172.21.15.8:0/974705592 shutdown_connections 2024-03-16T20:58:45.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.152+0000 7fe2d5400640 1 -- 172.21.15.8:0/974705592 wait complete. 2024-03-16T20:58:45.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.153+0000 7fe2d5400640 1 Processor -- start 2024-03-16T20:58:45.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.153+0000 7fe2d5400640 1 -- start start 2024-03-16T20:58:45.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.154+0000 7fe2d5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2d01015c0 0x7fe2d00737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.154+0000 7fe2d5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2d0106690 0x7fe2d0073d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.154+0000 7fe2d5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2d0074270 0x7fe2d01a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.154+0000 7fe2d5400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d01a6300 con 0x7fe2d01015c0 2024-03-16T20:58:45.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.154+0000 7fe2d5400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d01a6470 con 0x7fe2d0106690 2024-03-16T20:58:45.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.154+0000 7fe2d5400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d01a6630 con 0x7fe2d0074270 2024-03-16T20:58:45.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.154+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2d01015c0 0x7fe2d00737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.154+0000 7fe2d4a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2d0074270 0x7fe2d01a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.154+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2d01015c0 0x7fe2d00737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40410/0 (socket says 172.21.15.8:40410) 2024-03-16T20:58:45.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.154+0000 7fe2cfe00640 1 -- 172.21.15.8:0/2288340140 learned_addr learned my addr 172.21.15.8:0/2288340140 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.154+0000 7fe2cf400640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2d0106690 0x7fe2d0073d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.155+0000 7fe2cfe00640 1 -- 172.21.15.8:0/2288340140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2d0074270 msgr2=0x7fe2d01a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.155+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2d0074270 0x7fe2d01a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.155+0000 7fe2cfe00640 1 -- 172.21.15.8:0/2288340140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2d0106690 msgr2=0x7fe2d0073d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.155+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2d0106690 0x7fe2d0073d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.155+0000 7fe2cfe00640 1 -- 172.21.15.8:0/2288340140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c0009490 con 0x7fe2d01015c0 2024-03-16T20:58:45.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.155+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2d0074270 0x7fe2d01a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:45.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.155+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2d01015c0 0x7fe2d00737f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000ea60 tx=0x7fe2c000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.155+0000 7fe2ccc00640 1 -- 172.21.15.8:0/2288340140 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000cde0 con 0x7fe2d01015c0 2024-03-16T20:58:45.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.156+0000 7fe2ccc00640 1 -- 172.21.15.8:0/2288340140 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe2c00035f0 con 0x7fe2d01015c0 2024-03-16T20:58:45.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.156+0000 7fe2ccc00640 1 -- 172.21.15.8:0/2288340140 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0010690 con 0x7fe2d01015c0 2024-03-16T20:58:45.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.156+0000 7fe2d5400640 1 -- 172.21.15.8:0/2288340140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2bc009560 con 0x7fe2d01015c0 2024-03-16T20:58:45.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.156+0000 7fe2d5400640 1 -- 172.21.15.8:0/2288340140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d01a6c10 con 0x7fe2d01015c0 2024-03-16T20:58:45.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.159+0000 7fe2ccc00640 1 -- 172.21.15.8:0/2288340140 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7fe2c0003b80 con 0x7fe2d01015c0 2024-03-16T20:58:45.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.160+0000 7fe2d9811740 1 Processor -- start 2024-03-16T20:58:45.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.161+0000 7fe2d9811740 1 -- start start 2024-03-16T20:58:45.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.161+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.161+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798b1a30 0x561a798ba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.161+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798ba610 0x561a798bca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.161+0000 7fe2d9811740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7986c300 con 0x561a798b1110 2024-03-16T20:58:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.161+0000 7fe2d9811740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7981ee50 con 0x561a798b1a30 2024-03-16T20:58:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.161+0000 7fe2d9811740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7981c380 con 0x561a798ba610 2024-03-16T20:58:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.161+0000 7fe2d4a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.161+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798b1a30 0x561a798ba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.161+0000 7fe2d4a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40420/0 (socket says 172.21.15.8:40420) 2024-03-16T20:58:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.161+0000 7fe2d4a00640 1 -- 172.21.15.8:0/1381216016 learned_addr learned my addr 172.21.15.8:0/1381216016 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.162+0000 7fe2ccc00640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2b40a1d70 0x7fe2b40a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.162+0000 7fe2cf400640 1 --2- 172.21.15.8:0/1381216016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798ba610 0x561a798bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.162+0000 7fe2ccc00640 1 -- 172.21.15.8:0/2288340140 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe2c0014070 con 0x7fe2d01015c0 2024-03-16T20:58:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.162+0000 7fe2cfe00640 1 -- 172.21.15.8:0/1381216016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798ba610 msgr2=0x561a798bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.162+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/1381216016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798ba610 0x561a798bca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.162+0000 7fe2cfe00640 1 -- 172.21.15.8:0/1381216016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 msgr2=0x561a798b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.162+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/1381216016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.162+0000 7fe2cfe00640 1 -- 172.21.15.8:0/1381216016 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a797e0c80 con 0x561a798b1a30 2024-03-16T20:58:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.162+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2b40a1d70 0x7fe2b40a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.162+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/1381216016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798b1a30 0x561a798ba0d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00cb4d0 tx=0x7fe2c000ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7d9ddbfa1762347 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.163+0000 7fe2c5200640 1 -- 172.21.15.8:0/1381216016 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c009afe0 con 0x561a798b1a30 2024-03-16T20:58:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.163+0000 7fe2c5200640 1 -- 172.21.15.8:0/1381216016 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe2c009a8e0 con 0x561a798b1a30 2024-03-16T20:58:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.163+0000 7fe2c5200640 1 -- 172.21.15.8:0/1381216016 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00a2e50 con 0x561a798b1a30 2024-03-16T20:58:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.163+0000 7fe2d9811740 1 -- 172.21.15.8:0/1381216016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798b1a30 msgr2=0x561a798ba0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.163+0000 7fe2d9811740 1 --2- 172.21.15.8:0/1381216016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798b1a30 0x561a798ba0d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00cb4d0 tx=0x7fe2c000ef90 comp rx=0 tx=0).stop 2024-03-16T20:58:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.164+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2b40a1d70 0x7fe2b40a4230 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80139e0 tx=0x7fe2c8015040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.164+0000 7fe2d9811740 1 -- 172.21.15.8:0/1381216016 shutdown_connections 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.164+0000 7fe2d9811740 1 --2- 172.21.15.8:0/1381216016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798ba610 0x561a798bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.164+0000 7fe2d9811740 1 --2- 172.21.15.8:0/1381216016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798b1a30 0x561a798ba0d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.164+0000 7fe2d9811740 1 --2- 172.21.15.8:0/1381216016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.164+0000 7fe2d9811740 1 -- 172.21.15.8:0/1381216016 >> 172.21.15.8:0/1381216016 conn(0x561a798ab840 msgr2=0x561a798abc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.164+0000 7fe2d9811740 1 -- 172.21.15.8:0/1381216016 shutdown_connections 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.164+0000 7fe2d9811740 1 -- 172.21.15.8:0/1381216016 wait complete. 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.164+0000 7fe2d9811740 1 -- start start 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.165+0000 7fe2d9811740 1 Processor -- start 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.165+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1110 0x561a798b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.165+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1a30 0x561a798b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.165+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798b8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.165+0000 7fe2d9811740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a79817b60 con 0x561a798b1a30 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.165+0000 7fe2d9811740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a797bcfd0 con 0x561a798ba610 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.165+0000 7fe2d9811740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a797bcc70 con 0x561a798b1110 2024-03-16T20:58:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2d9811740 10 client.0 _ll_register_callbacks cb 0x561a79528c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1110 0x561a798b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1110 0x561a798b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52988/0 (socket says 172.21.15.8:52988) 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2cfe00640 1 -- 172.21.15.8:0/2765813555 learned_addr learned my addr 172.21.15.8:0/2765813555 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2cf400640 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1a30 0x561a798b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2cfe00640 1 -- 172.21.15.8:0/2765813555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 msgr2=0x561a798b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2cfe00640 1 -- 172.21.15.8:0/2765813555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1a30 msgr2=0x561a798b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1a30 0x561a798b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2cfe00640 1 -- 172.21.15.8:0/2765813555 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d01a6c10 con 0x561a798b1110 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.166+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1110 0x561a798b7680 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00972b0 tx=0x7fe2c0096bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c819479346f2473b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2b9600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2b9600640 1 -- 172.21.15.8:0/2765813555 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c009ea30 con 0x561a798b1110 2024-03-16T20:58:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2b9600640 1 -- 172.21.15.8:0/2765813555 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe2c00a3080 con 0x561a798b1110 2024-03-16T20:58:45.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2d9811740 1 -- 172.21.15.8:0/2765813555 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a79517860 con 0x561a798b1110 2024-03-16T20:58:45.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2b9600640 1 -- 172.21.15.8:0/2765813555 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2c00b3260 con 0x561a798b1110 2024-03-16T20:58:45.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2d9811740 10 client.25723 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:45.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2d9811740 1 -- 172.21.15.8:0/2765813555 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x561a798161e0 con 0x561a798b1110 2024-03-16T20:58:45.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2b9600640 1 -- 172.21.15.8:0/2765813555 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x561a79517860 con 0x561a798b1110 2024-03-16T20:58:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2b9600640 1 -- 172.21.15.8:0/2765813555 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe2c00cb840 con 0x561a798b1110 2024-03-16T20:58:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2d9811740 10 client.25723 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.167+0000 7fe2d9811740 10 client.25723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.168+0000 7fe2d9811740 20 client.25723 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.168+0000 7fe2d9811740 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561a798ca600 0x561a798cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.168+0000 7fe2d9811740 4 client.25723 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.168+0000 7fe2d9811740 1 -- 172.21.15.8:0/2765813555 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a79568410 con 0x561a798ca600 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.168+0000 7fe2cf400640 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561a798ca600 0x561a798cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.168+0000 7fe2cf400640 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561a798ca600 0x561a798cca10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e56693c8cd4a0ee6 server_cookie=69d4083b178246da in_seq=0 out_seq=0 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.168+0000 7fe2b9600640 10 client.25723 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.169+0000 7fe2b9600640 1 -- 172.21.15.8:0/2765813555 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561a79568410 con 0x561a798ca600 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.169+0000 7fe2b9600640 10 client.25723 handle_command_reply: tid=0 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.169+0000 7fe2d9811740 1 client.25723 shutdown 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2d9811740 1 -- 172.21.15.8:0/2765813555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1110 msgr2=0x561a798b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2d9811740 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1110 0x561a798b7680 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00972b0 tx=0x7fe2c0096bf0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2d9811740 1 -- 172.21.15.8:0/2765813555 shutdown_connections 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2d9811740 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2d9811740 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561a798ca600 0x561a798cca10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2d9811740 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1a30 0x561a798b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2d9811740 1 --2- 172.21.15.8:0/2765813555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1110 0x561a798b7680 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2b9600640 0 client.25723 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:45.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2d9811740 1 -- 172.21.15.8:0/2765813555 >> 172.21.15.8:0/2765813555 conn(0x561a798ab840 msgr2=0x561a798ad590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2d9811740 1 -- 172.21.15.8:0/2765813555 shutdown_connections 2024-03-16T20:58:45.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2d9811740 1 -- 172.21.15.8:0/2765813555 wait complete. 2024-03-16T20:58:45.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.170+0000 7fe2d9811740 20 client.25723 trim_cache size 0 max 16384 2024-03-16T20:58:45.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.196+0000 7fe2d9811740 1 Processor -- start 2024-03-16T20:58:45.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.196+0000 7fe2d9811740 1 -- start start 2024-03-16T20:58:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.196+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.196+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1a30 0x561a798c5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.196+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.196+0000 7fe2d9811740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a798a6950 con 0x561a798b1110 2024-03-16T20:58:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.196+0000 7fe2d9811740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a795600c0 con 0x561a798ba610 2024-03-16T20:58:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.196+0000 7fe2d9811740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a798b08e0 con 0x561a798b1a30 2024-03-16T20:58:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.197+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.197+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798b9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40448/0 (socket says 172.21.15.8:40448) 2024-03-16T20:58:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.197+0000 7fe2cf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1a30 0x561a798c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.197+0000 7fe2cfe00640 1 -- 172.21.15.8:0/97724920 learned_addr learned my addr 172.21.15.8:0/97724920 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.197+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/97724920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.197+0000 7fe2d4a00640 1 -- 172.21.15.8:0/97724920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1a30 msgr2=0x561a798c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.197+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/97724920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1a30 0x561a798c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.197+0000 7fe2d4a00640 1 -- 172.21.15.8:0/97724920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 msgr2=0x561a798b9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.197+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/97724920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798b9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.197+0000 7fe2d4a00640 1 -- 172.21.15.8:0/97724920 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a797b2a90 con 0x561a798ba610 2024-03-16T20:58:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.198+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/97724920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798c5ec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8005fd0 tx=0x7fe2c8005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42f56288ec5ba03c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.198+0000 7fe2bbe00640 1 -- 172.21.15.8:0/97724920 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8025070 con 0x561a798ba610 2024-03-16T20:58:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.198+0000 7fe2bbe00640 1 -- 172.21.15.8:0/97724920 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe2c8020400 con 0x561a798ba610 2024-03-16T20:58:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.198+0000 7fe2bbe00640 1 -- 172.21.15.8:0/97724920 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8029620 con 0x561a798ba610 2024-03-16T20:58:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.199+0000 7fe2d9811740 1 -- 172.21.15.8:0/97724920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 msgr2=0x561a798c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.199+0000 7fe2d9811740 1 --2- 172.21.15.8:0/97724920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798c5ec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8005fd0 tx=0x7fe2c8005bd0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.199+0000 7fe2d9811740 1 -- 172.21.15.8:0/97724920 shutdown_connections 2024-03-16T20:58:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.199+0000 7fe2d9811740 1 --2- 172.21.15.8:0/97724920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798c5ec0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.199+0000 7fe2d9811740 1 --2- 172.21.15.8:0/97724920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1a30 0x561a798c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.199+0000 7fe2d9811740 1 --2- 172.21.15.8:0/97724920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798b9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.199+0000 7fe2d9811740 1 -- 172.21.15.8:0/97724920 >> 172.21.15.8:0/97724920 conn(0x561a798ab840 msgr2=0x561a798ad500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.199+0000 7fe2d9811740 1 -- 172.21.15.8:0/97724920 shutdown_connections 2024-03-16T20:58:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.199+0000 7fe2d9811740 1 -- 172.21.15.8:0/97724920 wait complete. 2024-03-16T20:58:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.200+0000 7fe2d9811740 1 -- start start 2024-03-16T20:58:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.200+0000 7fe2d9811740 1 Processor -- start 2024-03-16T20:58:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.200+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798bf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.200+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1a30 0x561a798bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.200+0000 7fe2d9811740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798bff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.200+0000 7fe2d9811740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a79925fa0 con 0x561a798b1110 2024-03-16T20:58:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.200+0000 7fe2d9811740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a79926110 con 0x561a798ba610 2024-03-16T20:58:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.200+0000 7fe2d9811740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a799262d0 con 0x561a798b1a30 2024-03-16T20:58:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2d9811740 10 client.0 _ll_register_callbacks cb 0x7fe2c009e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798bf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2d4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798bf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40456/0 (socket says 172.21.15.8:40456) 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2cfe00640 1 -- 172.21.15.8:0/277995868 learned_addr learned my addr 172.21.15.8:0/277995868 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2cf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1a30 0x561a798bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2d4a00640 1 -- 172.21.15.8:0/277995868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1a30 msgr2=0x561a798bf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1a30 0x561a798bf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2d4a00640 1 -- 172.21.15.8:0/277995868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 msgr2=0x561a798bf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798bf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2d4a00640 1 -- 172.21.15.8:0/277995868 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c8013380 con 0x561a798ba610 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2cf400640 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1a30 0x561a798bf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.201+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798bf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.202+0000 7fe2d4a00640 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798bff10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800ffd0 tx=0x7fe2c8020820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a47d25b79684f9e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.202+0000 7fe2b9600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.202+0000 7fe2b9600640 1 -- 172.21.15.8:0/277995868 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8025040 con 0x561a798ba610 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.202+0000 7fe2d9811740 1 -- 172.21.15.8:0/277995868 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe2c009a8e0 con 0x561a798ba610 2024-03-16T20:58:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.202+0000 7fe2b9600640 1 -- 172.21.15.8:0/277995868 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe2c802a820 con 0x561a798ba610 2024-03-16T20:58:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.202+0000 7fe2b9600640 1 -- 172.21.15.8:0/277995868 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2c8020bb0 con 0x561a798ba610 2024-03-16T20:58:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.202+0000 7fe2d9811740 10 client.25721 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.202+0000 7fe2d9811740 1 -- 172.21.15.8:0/277995868 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x561a797d86a0 con 0x561a798ba610 2024-03-16T20:58:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.203+0000 7fe2b9600640 1 -- 172.21.15.8:0/277995868 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe2c009a8e0 con 0x561a798ba610 2024-03-16T20:58:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.203+0000 7fe2b9600640 1 -- 172.21.15.8:0/277995868 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe2c8033730 con 0x561a798ba610 2024-03-16T20:58:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.203+0000 7fe2d9811740 10 client.25721 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.203+0000 7fe2d9811740 10 client.25721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.203+0000 7fe2d9811740 20 client.25721 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.203+0000 7fe2d9811740 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561a79927ac0 0x561a79929ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.203+0000 7fe2d9811740 4 client.25721 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T20:58:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.203+0000 7fe2d9811740 1 -- 172.21.15.8:0/277995868 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561a795547b0 con 0x561a79927ac0 2024-03-16T20:58:45.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.203+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561a79927ac0 0x561a79929ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.204+0000 7fe2cfe00640 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561a79927ac0 0x561a79929ee0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ff7cac06a6275c5 server_cookie=31b764feb7b2235c in_seq=0 out_seq=0 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.204+0000 7fe2b9600640 10 client.25721 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.205+0000 7fe2b9600640 1 -- 172.21.15.8:0/277995868 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561a795547b0 con 0x561a79927ac0 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.205+0000 7fe2b9600640 10 client.25721 handle_command_reply: tid=0 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.205+0000 7fe2d9811740 1 client.25721 shutdown 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.205+0000 7fe2d9811740 1 -- 172.21.15.8:0/277995868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 msgr2=0x561a798bff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.205+0000 7fe2d9811740 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798bff10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800ffd0 tx=0x7fe2c8020820 comp rx=0 tx=0).stop 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.206+0000 7fe2d9811740 1 -- 172.21.15.8:0/277995868 shutdown_connections 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.206+0000 7fe2d9811740 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a798ba610 0x561a798bff10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.206+0000 7fe2d9811740 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a798b1a30 0x561a798bf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.206+0000 7fe2d9811740 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561a79927ac0 0x561a79929ee0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.206+0000 7fe2b9600640 0 client.25721 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.206+0000 7fe2d9811740 1 --2- 172.21.15.8:0/277995868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a798b1110 0x561a798bf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.206+0000 7fe2d9811740 1 -- 172.21.15.8:0/277995868 >> 172.21.15.8:0/277995868 conn(0x561a798ab840 msgr2=0x561a798b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.206+0000 7fe2d9811740 1 -- 172.21.15.8:0/277995868 shutdown_connections 2024-03-16T20:58:45.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.206+0000 7fe2d9811740 1 -- 172.21.15.8:0/277995868 wait complete. 2024-03-16T20:58:45.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.206+0000 7fe2d9811740 20 client.25721 trim_cache size 0 max 16384 2024-03-16T20:58:45.213 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:58:45.213 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T20:58:45.213 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "3b23f998-bb62-4b08-96f1-62cbc8584cfe", 2024-03-16T20:58:45.213 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T20:58:45.213 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:58:45.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.207+0000 7fe2d5400640 1 -- 172.21.15.8:0/2288340140 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2b40a1d70 msgr2=0x7fe2b40a4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.207+0000 7fe2d5400640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2b40a1d70 0x7fe2b40a4230 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80139e0 tx=0x7fe2c8015040 comp rx=0 tx=0).stop 2024-03-16T20:58:45.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.207+0000 7fe2d5400640 1 -- 172.21.15.8:0/2288340140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2d01015c0 msgr2=0x7fe2d00737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.207+0000 7fe2d5400640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2d01015c0 0x7fe2d00737f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000ea60 tx=0x7fe2c000ef20 comp rx=0 tx=0).stop 2024-03-16T20:58:45.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.207+0000 7fe2d5400640 1 -- 172.21.15.8:0/2288340140 shutdown_connections 2024-03-16T20:58:45.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.207+0000 7fe2d5400640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2b40a1d70 0x7fe2b40a4230 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.207+0000 7fe2d5400640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2d0074270 0x7fe2d01a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.207+0000 7fe2d5400640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2d0106690 0x7fe2d0073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.207+0000 7fe2d5400640 1 --2- 172.21.15.8:0/2288340140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2d01015c0 0x7fe2d00737f0 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000ea60 tx=0x7fe2c000ef20 comp rx=0 tx=0).stop 2024-03-16T20:58:45.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.207+0000 7fe2d5400640 1 -- 172.21.15.8:0/2288340140 >> 172.21.15.8:0/2288340140 conn(0x7fe2d00fce60 msgr2=0x7fe2d00ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.208+0000 7fe2d5400640 1 -- 172.21.15.8:0/2288340140 shutdown_connections 2024-03-16T20:58:45.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.208+0000 7fe2d5400640 1 -- 172.21.15.8:0/2288340140 wait complete. 2024-03-16T20:58:45.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T20:58:45.233 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T20:58:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.495+0000 7f40b3200640 1 -- 172.21.15.8:0/257105437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40b4105590 msgr2=0x7f40b410d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.495+0000 7f40b3200640 1 --2- 172.21.15.8:0/257105437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40b4105590 0x7f40b410d160 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009cd0 tx=0x7f40ac02c0f0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.495+0000 7f40b3200640 1 -- 172.21.15.8:0/257105437 shutdown_connections 2024-03-16T20:58:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.495+0000 7f40b3200640 1 --2- 172.21.15.8:0/257105437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40b4105590 0x7f40b410d160 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.495+0000 7f40b3200640 1 --2- 172.21.15.8:0/257105437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b4100e70 0x7f40b4104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.495+0000 7f40b3200640 1 --2- 172.21.15.8:0/257105437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40b41004c0 0x7f40b41008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.495+0000 7f40b3200640 1 -- 172.21.15.8:0/257105437 >> 172.21.15.8:0/257105437 conn(0x7f40b40fbd40 msgr2=0x7f40b40fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.495+0000 7f40b3200640 1 -- 172.21.15.8:0/257105437 shutdown_connections 2024-03-16T20:58:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.495+0000 7f40b3200640 1 -- 172.21.15.8:0/257105437 wait complete. 2024-03-16T20:58:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.496+0000 7f40b3200640 1 Processor -- start 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.496+0000 7f40b3200640 1 -- start start 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.496+0000 7f40b3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b41004c0 0x7f40b419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.496+0000 7f40b3200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40b4105590 0x7f40b419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.496+0000 7f40b3200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40b4199a70 0x7f40b4199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.496+0000 7f40b3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b419a460 con 0x7f40b41004c0 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.496+0000 7f40b3200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b419a5d0 con 0x7f40b4199a70 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.496+0000 7f40b3200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b419a790 con 0x7f40b4105590 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.497+0000 7f40b1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40b4105590 0x7f40b419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.497+0000 7f40b1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b41004c0 0x7f40b419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.497+0000 7f40b1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40b4105590 0x7f40b419fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53036/0 (socket says 172.21.15.8:53036) 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.497+0000 7f40b1400640 1 -- 172.21.15.8:0/1636451091 learned_addr learned my addr 172.21.15.8:0/1636451091 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.497+0000 7f40b2800640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40b4199a70 0x7f40b4199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.497+0000 7f40b1400640 1 -- 172.21.15.8:0/1636451091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40b4199a70 msgr2=0x7f40b4199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.497+0000 7f40b1400640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40b4199a70 0x7f40b4199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.497+0000 7f40b1400640 1 -- 172.21.15.8:0/1636451091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b41004c0 msgr2=0x7f40b419f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.497+0000 7f40b1400640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b41004c0 0x7f40b419f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.497+0000 7f40b1400640 1 -- 172.21.15.8:0/1636451091 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009900 con 0x7f40b4105590 2024-03-16T20:58:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.497+0000 7f40b2800640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40b4199a70 0x7f40b4199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.498+0000 7f40b1400640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40b4105590 0x7f40b419fe00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f40a000e9c0 tx=0x7f40a000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.498+0000 7f40aaa00640 1 -- 172.21.15.8:0/1636451091 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0009700 con 0x7f40b4105590 2024-03-16T20:58:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.498+0000 7f40aaa00640 1 -- 172.21.15.8:0/1636451091 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f40a000cd80 con 0x7f40b4105590 2024-03-16T20:58:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.498+0000 7f40b3200640 1 -- 172.21.15.8:0/1636451091 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b41a6780 con 0x7f40b4105590 2024-03-16T20:58:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.498+0000 7f40aaa00640 1 -- 172.21.15.8:0/1636451091 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0010690 con 0x7f40b4105590 2024-03-16T20:58:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.498+0000 7f40b3200640 1 -- 172.21.15.8:0/1636451091 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b41a6ce0 con 0x7f40b4105590 2024-03-16T20:58:45.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.501+0000 7f40aaa00640 1 -- 172.21.15.8:0/1636451091 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f40a00046c0 con 0x7f40b4105590 2024-03-16T20:58:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.502+0000 7f40aaa00640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40980a1d40 0x7f40980a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.502+0000 7f40bb5ff740 1 Processor -- start 2024-03-16T20:58:45.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.503+0000 7f40aaa00640 1 -- 172.21.15.8:0/1636451091 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f40a0014070 con 0x7f40b4105590 2024-03-16T20:58:45.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.503+0000 7f40b1e00640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40980a1d40 0x7f40980a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.503+0000 7f40bb5ff740 1 -- start start 2024-03-16T20:58:45.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.503+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228485170 0x556228483ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.503+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228484490 0x556228484910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.503+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x55622848fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.503+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562283f3150 con 0x556228484490 2024-03-16T20:58:45.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.503+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562283f0680 con 0x556228485170 2024-03-16T20:58:45.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.503+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562283ebe60 con 0x55622848d800 2024-03-16T20:58:45.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228484490 0x556228484910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228485170 0x556228483ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228484490 0x556228484910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40478/0 (socket says 172.21.15.8:40478) 2024-03-16T20:58:45.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1400640 1 -- 172.21.15.8:0/155797653 learned_addr learned my addr 172.21.15.8:0/155797653 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1e00640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40980a1d40 0x7f40980a4200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40b419abb0 tx=0x7f40a4005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b2800640 1 --2- 172.21.15.8:0/155797653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x55622848fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1e00640 1 -- 172.21.15.8:0/155797653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 msgr2=0x55622848fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1e00640 1 --2- 172.21.15.8:0/155797653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x55622848fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1e00640 1 -- 172.21.15.8:0/155797653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228484490 msgr2=0x556228484910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1e00640 1 --2- 172.21.15.8:0/155797653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228484490 0x556228484910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1e00640 1 -- 172.21.15.8:0/155797653 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562283a5060 con 0x556228485170 2024-03-16T20:58:45.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1400640 1 --2- 172.21.15.8:0/155797653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228484490 0x556228484910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:45.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b2800640 1 --2- 172.21.15.8:0/155797653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x55622848fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:45.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.504+0000 7f40b1e00640 1 --2- 172.21.15.8:0/155797653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228485170 0x556228483ec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f40a40118d0 tx=0x7f40a4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c18ee053901ae9ab server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.505+0000 7f409f000640 1 -- 172.21.15.8:0/155797653 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a400ee60 con 0x556228485170 2024-03-16T20:58:45.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.505+0000 7f409f000640 1 -- 172.21.15.8:0/155797653 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f40a4021070 con 0x556228485170 2024-03-16T20:58:45.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.505+0000 7f409f000640 1 -- 172.21.15.8:0/155797653 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4025940 con 0x556228485170 2024-03-16T20:58:45.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.506+0000 7f40bb5ff740 1 -- 172.21.15.8:0/155797653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228485170 msgr2=0x556228483ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.506+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/155797653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228485170 0x556228483ec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f40a40118d0 tx=0x7f40a4014000 comp rx=0 tx=0).stop 2024-03-16T20:58:45.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.506+0000 7f40bb5ff740 1 -- 172.21.15.8:0/155797653 shutdown_connections 2024-03-16T20:58:45.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.506+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/155797653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x55622848fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.506+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/155797653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228484490 0x556228484910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.506+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/155797653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228485170 0x556228483ec0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.506+0000 7f40bb5ff740 1 -- 172.21.15.8:0/155797653 >> 172.21.15.8:0/155797653 conn(0x55622844b5a0 msgr2=0x55622847eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.506+0000 7f40bb5ff740 1 -- 172.21.15.8:0/155797653 shutdown_connections 2024-03-16T20:58:45.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.506+0000 7f40bb5ff740 1 -- 172.21.15.8:0/155797653 wait complete. 2024-03-16T20:58:45.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.507+0000 7f40bb5ff740 1 -- start start 2024-03-16T20:58:45.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.507+0000 7f40bb5ff740 1 Processor -- start 2024-03-16T20:58:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.507+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.507+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228485170 0x55622848acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x55622848b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556228390ec0 con 0x556228485170 2024-03-16T20:58:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556228390b60 con 0x556228484490 2024-03-16T20:58:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622815a1c0 con 0x55622848d800 2024-03-16T20:58:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40bb5ff740 10 client.0 _ll_register_callbacks cb 0x5562283a4960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40b1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40b1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46938/0 (socket says 172.21.15.8:46938) 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40b1e00640 1 -- 172.21.15.8:0/2129975399 learned_addr learned my addr 172.21.15.8:0/2129975399 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40b2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x55622848b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40b1400640 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228485170 0x55622848acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40b1e00640 1 -- 172.21.15.8:0/2129975399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 msgr2=0x55622848b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40b1e00640 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x55622848b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40b1e00640 1 -- 172.21.15.8:0/2129975399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228485170 msgr2=0x55622848acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40b1e00640 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228485170 0x55622848acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40b1e00640 1 -- 172.21.15.8:0/2129975399 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a4017070 con 0x556228484490 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.508+0000 7f40b1400640 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228485170 0x55622848acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.509+0000 7f40b1e00640 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848a7b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f40a4025680 tx=0x7f40a400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d1f40be292af490 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.509+0000 7f4093400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.509+0000 7f4093400640 1 -- 172.21.15.8:0/2129975399 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4005390 con 0x556228484490 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.509+0000 7f4093400640 1 -- 172.21.15.8:0/2129975399 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f40a40054f0 con 0x556228484490 2024-03-16T20:58:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.509+0000 7f40bb5ff740 1 -- 172.21.15.8:0/2129975399 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562280eb7e0 con 0x556228484490 2024-03-16T20:58:45.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.509+0000 7f4093400640 1 -- 172.21.15.8:0/2129975399 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40a4004020 con 0x556228484490 2024-03-16T20:58:45.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.510+0000 7f40bb5ff740 10 client.25733 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:45.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.510+0000 7f40bb5ff740 1 -- 172.21.15.8:0/2129975399 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5562283ea4e0 con 0x556228484490 2024-03-16T20:58:45.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.510+0000 7f4093400640 1 -- 172.21.15.8:0/2129975399 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5562280eb7e0 con 0x556228484490 2024-03-16T20:58:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.511+0000 7f4093400640 1 -- 172.21.15.8:0/2129975399 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f40a40046c0 con 0x556228484490 2024-03-16T20:58:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.511+0000 7f40bb5ff740 10 client.25733 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.511+0000 7f40bb5ff740 10 client.25733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.511+0000 7f40bb5ff740 20 client.25733 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.511+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55622849d950 0x55622849fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.511+0000 7f40bb5ff740 4 client.25733 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.511+0000 7f40bb5ff740 1 -- 172.21.15.8:0/2129975399 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556228128720 con 0x55622849d950 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.511+0000 7f40b1400640 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55622849d950 0x55622849fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.512+0000 7f40b1400640 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55622849d950 0x55622849fd70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed6d005fe8b7016d server_cookie=485a9a8347448da in_seq=0 out_seq=0 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.512+0000 7f4093400640 10 client.25733 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f4093400640 1 -- 172.21.15.8:0/2129975399 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556228128720 con 0x55622849d950 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f4093400640 10 client.25733 handle_command_reply: tid=0 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f40bb5ff740 1 client.25733 shutdown 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f40bb5ff740 1 -- 172.21.15.8:0/2129975399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 msgr2=0x55622848a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848a7b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f40a4025680 tx=0x7f40a400ee60 comp rx=0 tx=0).stop 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f40bb5ff740 1 -- 172.21.15.8:0/2129975399 shutdown_connections 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x55622848b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55622849d950 0x55622849fd70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228485170 0x55622848acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/2129975399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848a7b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f40bb5ff740 1 -- 172.21.15.8:0/2129975399 >> 172.21.15.8:0/2129975399 conn(0x55622844b5a0 msgr2=0x556228480c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f4093400640 0 client.25733 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:45.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f40bb5ff740 1 -- 172.21.15.8:0/2129975399 shutdown_connections 2024-03-16T20:58:45.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.513+0000 7f40bb5ff740 1 -- 172.21.15.8:0/2129975399 wait complete. 2024-03-16T20:58:45.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.514+0000 7f40bb5ff740 20 client.25733 trim_cache size 0 max 16384 2024-03-16T20:58:45.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.546+0000 7f40bb5ff740 1 Processor -- start 2024-03-16T20:58:45.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.546+0000 7f40bb5ff740 1 -- start start 2024-03-16T20:58:45.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556228485170 0x55622848b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55622848d800 0x556228480a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556228485550 con 0x55622848d800 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622849d700 con 0x556228484490 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562284a03d0 con 0x556228485170 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40b1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556228485170 0x55622848b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40b1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40b1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46946/0 (socket says 172.21.15.8:46946) 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40b1e00640 1 -- 172.21.15.8:0/1036829053 learned_addr learned my addr 172.21.15.8:0/1036829053 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40b1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556228485170 0x55622848b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53064/0 (socket says 172.21.15.8:53064) 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40b2800640 1 --2- 172.21.15.8:0/1036829053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55622848d800 0x556228480a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40b1e00640 1 -- 172.21.15.8:0/1036829053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556228485170 msgr2=0x55622848b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40b1e00640 1 --2- 172.21.15.8:0/1036829053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556228485170 0x55622848b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40b1e00640 1 -- 172.21.15.8:0/1036829053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55622848d800 msgr2=0x556228480a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40b1e00640 1 --2- 172.21.15.8:0/1036829053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55622848d800 0x556228480a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.547+0000 7f40b1e00640 1 -- 172.21.15.8:0/1036829053 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556228386950 con 0x556228484490 2024-03-16T20:58:45.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.548+0000 7f40b1400640 1 --2- 172.21.15.8:0/1036829053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556228485170 0x55622848b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:45.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.548+0000 7f40b2800640 1 --2- 172.21.15.8:0/1036829053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55622848d800 0x556228480a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:45.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.548+0000 7f40b1e00640 1 --2- 172.21.15.8:0/1036829053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848cee0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f40a40092e0 tx=0x7f40a400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e814d7aa40661555 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.548+0000 7f409e600640 1 -- 172.21.15.8:0/1036829053 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4004880 con 0x556228484490 2024-03-16T20:58:45.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.548+0000 7f409e600640 1 -- 172.21.15.8:0/1036829053 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f40a400e9f0 con 0x556228484490 2024-03-16T20:58:45.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.548+0000 7f409e600640 1 -- 172.21.15.8:0/1036829053 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4025e10 con 0x556228484490 2024-03-16T20:58:45.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.549+0000 7f40bb5ff740 1 -- 172.21.15.8:0/1036829053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 msgr2=0x55622848cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.549+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/1036829053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848cee0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f40a40092e0 tx=0x7f40a400ed30 comp rx=0 tx=0).stop 2024-03-16T20:58:45.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.549+0000 7f40bb5ff740 1 -- 172.21.15.8:0/1036829053 shutdown_connections 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.549+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/1036829053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55622848d800 0x556228480a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.549+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/1036829053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556228485170 0x55622848b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.549+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/1036829053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x55622848cee0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.549+0000 7f40bb5ff740 1 -- 172.21.15.8:0/1036829053 >> 172.21.15.8:0/1036829053 conn(0x55622844b5a0 msgr2=0x556228480330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.550+0000 7f40bb5ff740 1 -- 172.21.15.8:0/1036829053 shutdown_connections 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.550+0000 7f40bb5ff740 1 -- 172.21.15.8:0/1036829053 wait complete. 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.550+0000 7f40bb5ff740 1 -- start start 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.550+0000 7f40bb5ff740 1 Processor -- start 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x556228487080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228485170 0x5562284875c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40bb5ff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x556228487b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556228500b00 con 0x556228485170 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556228500c70 con 0x556228484490 2024-03-16T20:58:45.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40bb5ff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556228500e30 con 0x55622848d800 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40bb5ff740 10 client.0 _ll_register_callbacks cb 0x7f40a400ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40b1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x556228487080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40b1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x556228487080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46962/0 (socket says 172.21.15.8:46962) 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40b1e00640 1 -- 172.21.15.8:0/304997534 learned_addr learned my addr 172.21.15.8:0/304997534 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40b2800640 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x556228487b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40b1400640 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228485170 0x5562284875c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40b1e00640 1 -- 172.21.15.8:0/304997534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 msgr2=0x556228487b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40b1e00640 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x556228487b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40b1e00640 1 -- 172.21.15.8:0/304997534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228485170 msgr2=0x5562284875c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40b1e00640 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228485170 0x5562284875c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.551+0000 7f40b1e00640 1 -- 172.21.15.8:0/304997534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b41a6780 con 0x556228484490 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.552+0000 7f40b1e00640 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x556228487080 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009460 tx=0x7f40a40048b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82e1f0eef39c023c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.552+0000 7f4093400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:58:45.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.552+0000 7f4093400640 1 -- 172.21.15.8:0/304997534 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4004ea0 con 0x556228484490 2024-03-16T20:58:45.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.552+0000 7f4093400640 1 -- 172.21.15.8:0/304997534 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f40a4041460 con 0x556228484490 2024-03-16T20:58:45.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.552+0000 7f40bb5ff740 1 -- 172.21.15.8:0/304997534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40a4021070 con 0x556228484490 2024-03-16T20:58:45.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.552+0000 7f4093400640 1 -- 172.21.15.8:0/304997534 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40a4041620 con 0x556228484490 2024-03-16T20:58:45.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.552+0000 7f40bb5ff740 10 client.25739 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:45.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.552+0000 7f40bb5ff740 1 -- 172.21.15.8:0/304997534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5562283ea4e0 con 0x556228484490 2024-03-16T20:58:45.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.553+0000 7f4093400640 1 -- 172.21.15.8:0/304997534 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f40a4021070 con 0x556228484490 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.553+0000 7f4093400640 1 -- 172.21.15.8:0/304997534 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f40a4038940 con 0x556228484490 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.553+0000 7f40bb5ff740 10 client.25739 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.553+0000 7f40bb5ff740 10 client.25739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.553+0000 7f40bb5ff740 20 client.25739 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.553+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5562285020d0 0x5562285044c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.553+0000 7f40bb5ff740 4 client.25739 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.553+0000 7f40bb5ff740 1 -- 172.21.15.8:0/304997534 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556228177890 con 0x5562285020d0 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.553+0000 7f40b1400640 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5562285020d0 0x5562285044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f4093400640 10 client.25739 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f40b1400640 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5562285020d0 0x5562285044c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fdc4d4e713de686 server_cookie=9e284241d18d5ada in_seq=0 out_seq=0 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f4093400640 1 -- 172.21.15.8:0/304997534 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556228177890 con 0x5562285020d0 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f4093400640 10 client.25739 handle_command_reply: tid=0 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f40bb5ff740 1 client.25739 shutdown 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f40bb5ff740 1 -- 172.21.15.8:0/304997534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 msgr2=0x556228487080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x556228487080 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009460 tx=0x7f40a40048b0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f40bb5ff740 1 -- 172.21.15.8:0/304997534 shutdown_connections 2024-03-16T20:58:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55622848d800 0x556228487b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5562285020d0 0x5562285044c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556228485170 0x5562284875c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f40bb5ff740 1 --2- 172.21.15.8:0/304997534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556228484490 0x556228487080 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f40bb5ff740 1 -- 172.21.15.8:0/304997534 >> 172.21.15.8:0/304997534 conn(0x55622844b5a0 msgr2=0x55622847d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.554+0000 7f4093400640 0 client.25739 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.555+0000 7f40bb5ff740 1 -- 172.21.15.8:0/304997534 shutdown_connections 2024-03-16T20:58:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.555+0000 7f40bb5ff740 1 -- 172.21.15.8:0/304997534 wait complete. 2024-03-16T20:58:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.555+0000 7f40bb5ff740 20 client.25739 trim_cache size 0 max 16384 2024-03-16T20:58:45.562 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:58:45.563 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T20:58:45.563 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T20:58:45.563 INFO:teuthology.orchestra.run.smithi008.stdout: "3b23f998-bb62-4b08-96f1-62cbc8584cfe": { 2024-03-16T20:58:45.563 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T20:58:45.563 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "3b23f998-bb62-4b08-96f1-62cbc8584cfe", 2024-03-16T20:58:45.563 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T20:58:45.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T20:58:45.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T20:58:45.563 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:58:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.555+0000 7f40b3200640 1 -- 172.21.15.8:0/1636451091 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40980a1d40 msgr2=0x7f40980a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.555+0000 7f40b3200640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40980a1d40 0x7f40980a4200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40b419abb0 tx=0x7f40a4005f90 comp rx=0 tx=0).stop 2024-03-16T20:58:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.555+0000 7f40b3200640 1 -- 172.21.15.8:0/1636451091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40b4105590 msgr2=0x7f40b419fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.555+0000 7f40b3200640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40b4105590 0x7f40b419fe00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f40a000e9c0 tx=0x7f40a000ee80 comp rx=0 tx=0).stop 2024-03-16T20:58:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.556+0000 7f40b3200640 1 -- 172.21.15.8:0/1636451091 shutdown_connections 2024-03-16T20:58:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.556+0000 7f40b3200640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40980a1d40 0x7f40980a4200 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.556+0000 7f40b3200640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40b4199a70 0x7f40b4199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.556+0000 7f40b3200640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40b4105590 0x7f40b419fe00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.556+0000 7f40b3200640 1 --2- 172.21.15.8:0/1636451091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40b41004c0 0x7f40b419f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.556+0000 7f40b3200640 1 -- 172.21.15.8:0/1636451091 >> 172.21.15.8:0/1636451091 conn(0x7f40b40fbd40 msgr2=0x7f40b40fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.556+0000 7f40b3200640 1 -- 172.21.15.8:0/1636451091 shutdown_connections 2024-03-16T20:58:45.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:58:45.556+0000 7f40b3200640 1 -- 172.21.15.8:0/1636451091 wait complete. 2024-03-16T20:58:45.577 INFO:tasks.cephfs.filesystem:scrub status for tag:3b23f998-bb62-4b08-96f1-62cbc8584cfe - {'path': '/', 'tag': '3b23f998-bb62-4b08-96f1-62cbc8584cfe', 'options': 'recursive,force'} 2024-03-16T20:58:46.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:46 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T20:58:46.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:46 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:46.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:46 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T20:58:46.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:46 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:46.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:46 smithi186 ceph-mon[36391]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:58:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:46 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T20:58:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:46 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:46 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T20:58:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:46 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:46.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:46 smithi008 ceph-mon[31434]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:58:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:46 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T20:58:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:46 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:46.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:46 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T20:58:46.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:46 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:58:46.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:46 smithi170 ceph-mon[35947]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-16T20:58:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:48 smithi008 ceph-mon[31434]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-16T20:58:48.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:48 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T20:58:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:48 smithi170 ceph-mon[35947]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-16T20:58:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:48 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T20:58:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:48 smithi186 ceph-mon[36391]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-16T20:58:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:48 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T20:58:50.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:50 smithi008 ceph-mon[31434]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:58:50.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:50 smithi170 ceph-mon[35947]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:58:50.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:50 smithi186 ceph-mon[36391]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:58:52.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:52 smithi008 ceph-mon[31434]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T20:58:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:52 smithi170 ceph-mon[35947]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T20:58:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:52 smithi186 ceph-mon[36391]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T20:58:54.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:54 smithi008 ceph-mon[31434]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:58:54.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:54 smithi170 ceph-mon[35947]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:58:54.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:54 smithi186 ceph-mon[36391]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:58:56.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:56 smithi008 ceph-mon[31434]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:58:56.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:56 smithi170 ceph-mon[35947]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:58:56.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:56 smithi186 ceph-mon[36391]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T20:58:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.153+0000 7fd751a00640 1 -- 172.21.15.8:0/3347036154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd74c101560 msgr2=0x7fd74c101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.153+0000 7fd751a00640 1 --2- 172.21.15.8:0/3347036154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd74c101560 0x7fd74c101940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009890 tx=0x7fd73c02bb70 comp rx=0 tx=0).stop 2024-03-16T20:58:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.153+0000 7fd751a00640 1 -- 172.21.15.8:0/3347036154 shutdown_connections 2024-03-16T20:58:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.153+0000 7fd751a00640 1 --2- 172.21.15.8:0/3347036154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd74c106630 0x7fd74c10e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.153+0000 7fd751a00640 1 --2- 172.21.15.8:0/3347036154 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd74c101f10 0x7fd74c105f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.153+0000 7fd751a00640 1 --2- 172.21.15.8:0/3347036154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd74c101560 0x7fd74c101940 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.153+0000 7fd751a00640 1 -- 172.21.15.8:0/3347036154 >> 172.21.15.8:0/3347036154 conn(0x7fd74c0fce00 msgr2=0x7fd74c0ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.153+0000 7fd751a00640 1 -- 172.21.15.8:0/3347036154 shutdown_connections 2024-03-16T20:58:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.153+0000 7fd751a00640 1 -- 172.21.15.8:0/3347036154 wait complete. 2024-03-16T20:58:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.155+0000 7fd751a00640 1 Processor -- start 2024-03-16T20:58:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.155+0000 7fd751a00640 1 -- start start 2024-03-16T20:58:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.155+0000 7fd751a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd74c101560 0x7fd74c0737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd751a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd74c106630 0x7fd74c073d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd751a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd74c074270 0x7fd74c1a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd751a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c1a6250 con 0x7fd74c101560 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd751a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c1a63c0 con 0x7fd74c074270 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd751a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c1a6580 con 0x7fd74c106630 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd74b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd74c106630 0x7fd74c073d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd74b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd74c106630 0x7fd74c073d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47836/0 (socket says 172.21.15.8:47836) 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd74b400640 1 -- 172.21.15.8:0/3262400396 learned_addr learned my addr 172.21.15.8:0/3262400396 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd74be00640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd74c101560 0x7fd74c0737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd751000640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd74c074270 0x7fd74c1a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd74b400640 1 -- 172.21.15.8:0/3262400396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd74c074270 msgr2=0x7fd74c1a5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd74b400640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd74c074270 0x7fd74c1a5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd74b400640 1 -- 172.21.15.8:0/3262400396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd74c101560 msgr2=0x7fd74c0737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd74b400640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd74c101560 0x7fd74c0737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd74b400640 1 -- 172.21.15.8:0/3262400396 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738009560 con 0x7fd74c106630 2024-03-16T20:58:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd751000640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd74c074270 0x7fd74c1a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.156+0000 7fd74be00640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd74c101560 0x7fd74c0737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:58:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.157+0000 7fd74b400640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd74c106630 0x7fd74c073d30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd73800e9a0 tx=0x7fd73800ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.157+0000 7fd748c00640 1 -- 172.21.15.8:0/3262400396 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73800cd80 con 0x7fd74c106630 2024-03-16T20:58:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.157+0000 7fd748c00640 1 -- 172.21.15.8:0/3262400396 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd7380035f0 con 0x7fd74c106630 2024-03-16T20:58:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.157+0000 7fd751a00640 1 -- 172.21.15.8:0/3262400396 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd744009840 con 0x7fd74c106630 2024-03-16T20:58:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.157+0000 7fd748c00640 1 -- 172.21.15.8:0/3262400396 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738010690 con 0x7fd74c106630 2024-03-16T20:58:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.157+0000 7fd751a00640 1 -- 172.21.15.8:0/3262400396 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c009490 con 0x7fd74c106630 2024-03-16T20:58:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.162+0000 7fd755dc8740 1 Processor -- start 2024-03-16T20:58:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.162+0000 7fd755dc8740 1 -- start start 2024-03-16T20:58:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.162+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 0x55a339929ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 0x55a33992a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd748c00640 1 -- 172.21.15.8:0/3262400396 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7fd738003b60 con 0x7fd74c106630 2024-03-16T20:58:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd751000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 0x55a339929ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd751000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 0x55a339929ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35508/0 (socket says 172.21.15.8:35508) 2024-03-16T20:58:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a339933570 0x55a339935960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd755dc8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3398e5620 con 0x55a339933570 2024-03-16T20:58:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd755dc8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3398978c0 con 0x55a33992ad60 2024-03-16T20:58:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd755dc8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a339894df0 con 0x55a339929ff0 2024-03-16T20:58:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd74be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 0x55a33992a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd74be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 0x55a33992a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47844/0 (socket says 172.21.15.8:47844) 2024-03-16T20:58:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd74be00640 1 -- 172.21.15.8:0/864074931 learned_addr learned my addr 172.21.15.8:0/864074931 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.163+0000 7fd74b400640 1 --2- 172.21.15.8:0/864074931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a339933570 0x55a339935960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.164+0000 7fd751000640 1 -- 172.21.15.8:0/864074931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 msgr2=0x55a33992a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.164+0000 7fd751000640 1 --2- 172.21.15.8:0/864074931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 0x55a33992a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.164+0000 7fd751000640 1 -- 172.21.15.8:0/864074931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a339933570 msgr2=0x55a339935960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.164+0000 7fd751000640 1 --2- 172.21.15.8:0/864074931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a339933570 0x55a339935960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.164+0000 7fd751000640 1 -- 172.21.15.8:0/864074931 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a339811b00 con 0x55a33992ad60 2024-03-16T20:58:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.165+0000 7fd751000640 1 --2- 172.21.15.8:0/864074931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 0x55a339929ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd744009fb0 tx=0x7fd74400f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ac37f6326b4d57f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.165+0000 7fd741600640 1 -- 172.21.15.8:0/864074931 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744011700 con 0x55a33992ad60 2024-03-16T20:58:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.165+0000 7fd741600640 1 -- 172.21.15.8:0/864074931 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd744011d60 con 0x55a33992ad60 2024-03-16T20:58:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.165+0000 7fd741600640 1 -- 172.21.15.8:0/864074931 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74401a370 con 0x55a33992ad60 2024-03-16T20:58:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.165+0000 7fd748c00640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd7300a1d30 0x7fd7300a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.166+0000 7fd748c00640 1 -- 172.21.15.8:0/3262400396 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd738014070 con 0x7fd74c106630 2024-03-16T20:58:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.166+0000 7fd755dc8740 1 -- 172.21.15.8:0/864074931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 msgr2=0x55a339929ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.166+0000 7fd755dc8740 1 --2- 172.21.15.8:0/864074931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 0x55a339929ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd744009fb0 tx=0x7fd74400f7f0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.166+0000 7fd74be00640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd7300a1d30 0x7fd7300a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.166+0000 7fd755dc8740 1 -- 172.21.15.8:0/864074931 shutdown_connections 2024-03-16T20:58:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.166+0000 7fd755dc8740 1 --2- 172.21.15.8:0/864074931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a339933570 0x55a339935960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.166+0000 7fd755dc8740 1 --2- 172.21.15.8:0/864074931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 0x55a33992a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.166+0000 7fd755dc8740 1 --2- 172.21.15.8:0/864074931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 0x55a339929ab0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.166+0000 7fd755dc8740 1 -- 172.21.15.8:0/864074931 >> 172.21.15.8:0/864074931 conn(0x55a3398f14b0 msgr2=0x55a339924ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.167+0000 7fd755dc8740 1 -- 172.21.15.8:0/864074931 shutdown_connections 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.167+0000 7fd755dc8740 1 -- 172.21.15.8:0/864074931 wait complete. 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.167+0000 7fd755dc8740 1 -- start start 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.167+0000 7fd74be00640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd7300a1d30 0x7fd7300a41f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55a33992b4c0 tx=0x7fd73c005c90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.168+0000 7fd755dc8740 1 Processor -- start 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.168+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a339929ff0 0x55a339930610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.168+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 0x55a339930b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.168+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339933570 0x55a339931090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.168+0000 7fd755dc8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3398905d0 con 0x55a33992ad60 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.168+0000 7fd755dc8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a339835b50 con 0x55a339929ff0 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.168+0000 7fd755dc8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3398357f0 con 0x55a339933570 2024-03-16T20:58:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.168+0000 7fd755dc8740 10 client.0 _ll_register_callbacks cb 0x55a339849550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.169+0000 7fd74be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a339929ff0 0x55a339930610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.169+0000 7fd74be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a339929ff0 0x55a339930610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35514/0 (socket says 172.21.15.8:35514) 2024-03-16T20:58:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.169+0000 7fd74be00640 1 -- 172.21.15.8:0/129775865 learned_addr learned my addr 172.21.15.8:0/129775865 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.169+0000 7fd751000640 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339933570 0x55a339931090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.169+0000 7fd74b400640 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 0x55a339930b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.169+0000 7fd751000640 1 -- 172.21.15.8:0/129775865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a339929ff0 msgr2=0x55a339930610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.169+0000 7fd751000640 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a339929ff0 0x55a339930610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.169+0000 7fd751000640 1 -- 172.21.15.8:0/129775865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 msgr2=0x55a339930b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.169+0000 7fd751000640 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 0x55a339930b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.169+0000 7fd751000640 1 -- 172.21.15.8:0/129775865 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd744009c90 con 0x55a339933570 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.169+0000 7fd74b400640 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 0x55a339930b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.170+0000 7fd751000640 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339933570 0x55a339931090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd744009fb0 tx=0x7fd744010e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4020345104406c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.170+0000 7fd736000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.170+0000 7fd736000640 1 -- 172.21.15.8:0/129775865 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744022070 con 0x55a339933570 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.170+0000 7fd736000640 1 -- 172.21.15.8:0/129775865 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd744004d90 con 0x55a339933570 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.170+0000 7fd755dc8740 1 -- 172.21.15.8:0/129775865 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a339862cd0 con 0x55a339933570 2024-03-16T20:58:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.171+0000 7fd736000640 1 -- 172.21.15.8:0/129775865 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7440103d0 con 0x55a339933570 2024-03-16T20:58:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.171+0000 7fd755dc8740 10 client.25759 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.171+0000 7fd755dc8740 1 -- 172.21.15.8:0/129775865 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a33988ec50 con 0x55a339933570 2024-03-16T20:58:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.171+0000 7fd736000640 1 -- 172.21.15.8:0/129775865 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a339862cd0 con 0x55a339933570 2024-03-16T20:58:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.171+0000 7fd736000640 1 -- 172.21.15.8:0/129775865 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fd74402e070 con 0x55a339933570 2024-03-16T20:58:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.172+0000 7fd755dc8740 10 client.25759 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.172+0000 7fd755dc8740 10 client.25759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.172+0000 7fd755dc8740 20 client.25759 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.172+0000 7fd755dc8740 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a339943450 0x55a339945840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.172+0000 7fd755dc8740 4 client.25759 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:58:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.172+0000 7fd755dc8740 1 -- 172.21.15.8:0/129775865 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a339886ce0 con 0x55a339943450 2024-03-16T20:58:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.173+0000 7fd74be00640 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a339943450 0x55a339945840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.173+0000 7fd74be00640 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a339943450 0x55a339945840 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3641abe0c9f08cfe server_cookie=43d683bd616d17d0 in_seq=0 out_seq=0 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.173+0000 7fd736000640 10 client.25759 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.174+0000 7fd736000640 1 -- 172.21.15.8:0/129775865 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a339886ce0 con 0x55a339943450 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.174+0000 7fd736000640 10 client.25759 handle_command_reply: tid=0 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.174+0000 7fd755dc8740 1 client.25759 shutdown 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd755dc8740 1 -- 172.21.15.8:0/129775865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339933570 msgr2=0x55a339931090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd755dc8740 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339933570 0x55a339931090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd744009fb0 tx=0x7fd744010e50 comp rx=0 tx=0).stop 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd755dc8740 1 -- 172.21.15.8:0/129775865 shutdown_connections 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd755dc8740 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339933570 0x55a339931090 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd755dc8740 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a339943450 0x55a339945840 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd755dc8740 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 0x55a339930b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd755dc8740 1 --2- 172.21.15.8:0/129775865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a339929ff0 0x55a339930610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd755dc8740 1 -- 172.21.15.8:0/129775865 >> 172.21.15.8:0/129775865 conn(0x55a3398f14b0 msgr2=0x55a339926a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd736000640 0 client.25759 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd755dc8740 1 -- 172.21.15.8:0/129775865 shutdown_connections 2024-03-16T20:58:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd755dc8740 1 -- 172.21.15.8:0/129775865 wait complete. 2024-03-16T20:58:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.175+0000 7fd755dc8740 20 client.25759 trim_cache size 0 max 16384 2024-03-16T20:58:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.204+0000 7fd755dc8740 1 Processor -- start 2024-03-16T20:58:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.204+0000 7fd755dc8740 1 -- start start 2024-03-16T20:58:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3398f14b0 0x55a339932d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 0x55a339926840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 0x55a339930b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd755dc8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3395d8e60 con 0x55a33992ad60 2024-03-16T20:58:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd755dc8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a339945e70 con 0x55a3398f14b0 2024-03-16T20:58:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd755dc8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a339925ce0 con 0x55a339929ff0 2024-03-16T20:58:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd74be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3398f14b0 0x55a339932d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd74be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3398f14b0 0x55a339932d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35524/0 (socket says 172.21.15.8:35524) 2024-03-16T20:58:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd74be00640 1 -- 172.21.15.8:0/1616694846 learned_addr learned my addr 172.21.15.8:0/1616694846 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd74b400640 1 --2- 172.21.15.8:0/1616694846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 0x55a339926840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd751000640 1 --2- 172.21.15.8:0/1616694846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 0x55a339930b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd74b400640 1 -- 172.21.15.8:0/1616694846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3398f14b0 msgr2=0x55a339932d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd74b400640 1 --2- 172.21.15.8:0/1616694846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3398f14b0 0x55a339932d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd74b400640 1 -- 172.21.15.8:0/1616694846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 msgr2=0x55a339930b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd74b400640 1 --2- 172.21.15.8:0/1616694846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 0x55a339930b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd74b400640 1 -- 172.21.15.8:0/1616694846 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a33982b530 con 0x55a339929ff0 2024-03-16T20:58:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.205+0000 7fd74be00640 1 --2- 172.21.15.8:0/1616694846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3398f14b0 0x55a339932d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.206+0000 7fd751000640 1 --2- 172.21.15.8:0/1616694846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 0x55a339930b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.206+0000 7fd74b400640 1 --2- 172.21.15.8:0/1616694846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 0x55a339926840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd7380cb630 tx=0x7fd7380d1bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=236d41ef265303b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.206+0000 7fd740c00640 1 -- 172.21.15.8:0/1616694846 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73809a580 con 0x55a339929ff0 2024-03-16T20:58:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.206+0000 7fd740c00640 1 -- 172.21.15.8:0/1616694846 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd73809a3a0 con 0x55a339929ff0 2024-03-16T20:58:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.206+0000 7fd740c00640 1 -- 172.21.15.8:0/1616694846 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7380d1c40 con 0x55a339929ff0 2024-03-16T20:58:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.207+0000 7fd755dc8740 1 -- 172.21.15.8:0/1616694846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 msgr2=0x55a339926840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.207+0000 7fd755dc8740 1 --2- 172.21.15.8:0/1616694846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 0x55a339926840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd7380cb630 tx=0x7fd7380d1bd0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.207+0000 7fd755dc8740 1 -- 172.21.15.8:0/1616694846 shutdown_connections 2024-03-16T20:58:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.207+0000 7fd755dc8740 1 --2- 172.21.15.8:0/1616694846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a33992ad60 0x55a339930b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.207+0000 7fd755dc8740 1 --2- 172.21.15.8:0/1616694846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a339929ff0 0x55a339926840 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.207+0000 7fd755dc8740 1 --2- 172.21.15.8:0/1616694846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3398f14b0 0x55a339932d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.207+0000 7fd755dc8740 1 -- 172.21.15.8:0/1616694846 >> 172.21.15.8:0/1616694846 conn(0x55a339935b40 msgr2=0x55a339926130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.207+0000 7fd755dc8740 1 -- 172.21.15.8:0/1616694846 shutdown_connections 2024-03-16T20:58:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.207+0000 7fd755dc8740 1 -- 172.21.15.8:0/1616694846 wait complete. 2024-03-16T20:58:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.208+0000 7fd755dc8740 1 -- start start 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.208+0000 7fd755dc8740 1 Processor -- start 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3398f14b0 0x55a339934240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a339929ff0 0x55a339934780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd755dc8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 0x55a339939410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd755dc8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a339934ea0 con 0x55a339929ff0 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd755dc8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a339939950 con 0x55a33992ad60 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd755dc8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a339939ac0 con 0x55a3398f14b0 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd755dc8740 10 client.0 _ll_register_callbacks cb 0x7fd73c037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd74be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3398f14b0 0x55a339934240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd751000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 0x55a339939410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd74be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3398f14b0 0x55a339934240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47864/0 (socket says 172.21.15.8:47864) 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd74be00640 1 -- 172.21.15.8:0/3203334755 learned_addr learned my addr 172.21.15.8:0/3203334755 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:58:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd74b400640 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a339929ff0 0x55a339934780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd74be00640 1 -- 172.21.15.8:0/3203334755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 msgr2=0x55a339939410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd74be00640 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 0x55a339939410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd74be00640 1 -- 172.21.15.8:0/3203334755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a339929ff0 msgr2=0x55a339934780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd74be00640 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a339929ff0 0x55a339934780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd74be00640 1 -- 172.21.15.8:0/3203334755 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74c10ea10 con 0x55a3398f14b0 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd74b400640 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a339929ff0 0x55a339934780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.209+0000 7fd751000640 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 0x55a339939410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.210+0000 7fd74be00640 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3398f14b0 0x55a339934240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd73c02c180 tx=0x7fd73c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c2fb98151b9a4f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.210+0000 7fd736000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.210+0000 7fd736000640 1 -- 172.21.15.8:0/3203334755 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c064040 con 0x55a3398f14b0 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.210+0000 7fd736000640 1 -- 172.21.15.8:0/3203334755 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd73c057040 con 0x55a3398f14b0 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.210+0000 7fd755dc8740 1 -- 172.21.15.8:0/3203334755 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3398b5d30 con 0x55a3398f14b0 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.211+0000 7fd736000640 1 -- 172.21.15.8:0/3203334755 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd73c005450 con 0x55a3398f14b0 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.211+0000 7fd755dc8740 10 client.25765 fetch_fsmap learned FSMap version 24 2024-03-16T20:58:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.211+0000 7fd755dc8740 1 -- 172.21.15.8:0/3203334755 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fd73c009490 con 0x55a3398f14b0 2024-03-16T20:58:58.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.211+0000 7fd736000640 1 -- 172.21.15.8:0/3203334755 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd73c074030 con 0x55a3398f14b0 2024-03-16T20:58:58.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.211+0000 7fd736000640 1 -- 172.21.15.8:0/3203334755 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fd73c02ca60 con 0x55a3398f14b0 2024-03-16T20:58:58.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.211+0000 7fd755dc8740 10 client.25765 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:58:58.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.211+0000 7fd755dc8740 10 client.25765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:58:58.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.211+0000 7fd755dc8740 20 client.25765 populate_metadata read hostname 'smithi008' 2024-03-16T20:58:58.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.211+0000 7fd755dc8740 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a339933570 0x55a3399a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:58:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.211+0000 7fd755dc8740 4 client.25765 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T20:58:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.211+0000 7fd755dc8740 1 -- 172.21.15.8:0/3203334755 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a339590600 con 0x55a339933570 2024-03-16T20:58:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.212+0000 7fd74b400640 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a339933570 0x55a3399a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:58:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.212+0000 7fd74b400640 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a339933570 0x55a3399a1bb0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a1d6b63ba75a3c2 server_cookie=62253bff6c7881a0 in_seq=0 out_seq=0 2024-03-16T20:58:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.212+0000 7fd736000640 10 client.25765 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.216+0000 7fd736000640 1 -- 172.21.15.8:0/3203334755 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a339590600 con 0x55a339933570 2024-03-16T20:58:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.216+0000 7fd736000640 10 client.25765 handle_command_reply: tid=0 2024-03-16T20:58:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.216+0000 7fd755dc8740 1 client.25765 shutdown 2024-03-16T20:58:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd755dc8740 1 -- 172.21.15.8:0/3203334755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3398f14b0 msgr2=0x55a339934240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd755dc8740 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3398f14b0 0x55a339934240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd73c02c180 tx=0x7fd73c005f90 comp rx=0 tx=0).stop 2024-03-16T20:58:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd755dc8740 1 -- 172.21.15.8:0/3203334755 shutdown_connections 2024-03-16T20:58:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd755dc8740 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a33992ad60 0x55a339939410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd755dc8740 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a339933570 0x55a3399a1bb0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd755dc8740 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a339929ff0 0x55a339934780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd755dc8740 1 --2- 172.21.15.8:0/3203334755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3398f14b0 0x55a339934240 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd736000640 0 client.25765 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:58:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd755dc8740 1 -- 172.21.15.8:0/3203334755 >> 172.21.15.8:0/3203334755 conn(0x55a339935b40 msgr2=0x55a339923d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd755dc8740 1 -- 172.21.15.8:0/3203334755 shutdown_connections 2024-03-16T20:58:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd755dc8740 1 -- 172.21.15.8:0/3203334755 wait complete. 2024-03-16T20:58:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.217+0000 7fd755dc8740 20 client.25765 trim_cache size 0 max 16384 2024-03-16T20:58:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T20:58:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T20:58:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T20:58:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T20:58:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 -- 172.21.15.8:0/3262400396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd7300a1d30 msgr2=0x7fd7300a41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd7300a1d30 0x7fd7300a41f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55a33992b4c0 tx=0x7fd73c005c90 comp rx=0 tx=0).stop 2024-03-16T20:58:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 -- 172.21.15.8:0/3262400396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd74c106630 msgr2=0x7fd74c073d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:58:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd74c106630 0x7fd74c073d30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd73800e9a0 tx=0x7fd73800ee60 comp rx=0 tx=0).stop 2024-03-16T20:58:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 -- 172.21.15.8:0/3262400396 shutdown_connections 2024-03-16T20:58:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd7300a1d30 0x7fd7300a41f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd74c074270 0x7fd74c1a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd74c106630 0x7fd74c073d30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 --2- 172.21.15.8:0/3262400396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd74c101560 0x7fd74c0737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:58:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 -- 172.21.15.8:0/3262400396 >> 172.21.15.8:0/3262400396 conn(0x7fd74c0fce00 msgr2=0x7fd74c0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:58:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 -- 172.21.15.8:0/3262400396 shutdown_connections 2024-03-16T20:58:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:58:58.218+0000 7fd751a00640 1 -- 172.21.15.8:0/3262400396 wait complete. 2024-03-16T20:58:58.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:58 smithi008 ceph-mon[31434]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T20:58:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:58 smithi170 ceph-mon[35947]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T20:58:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:58 smithi186 ceph-mon[36391]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T20:58:59.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:58:59 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:58:59.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:58:59 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:58:59.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:58:59 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T20:59:00.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:00 smithi008 ceph-mon[31434]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-16T20:59:00.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:00 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:59:00.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:00 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:59:00.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:00 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:59:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:00 smithi170 ceph-mon[35947]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-16T20:59:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:00 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:59:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:00 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:59:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:00 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:59:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:00 smithi186 ceph-mon[36391]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-16T20:59:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:00 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T20:59:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:00 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T20:59:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:00 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T20:59:02.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:02 smithi008 ceph-mon[31434]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T20:59:02.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:02 smithi170 ceph-mon[35947]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T20:59:02.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:02 smithi186 ceph-mon[36391]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T20:59:04.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:04 smithi008 ceph-mon[31434]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T20:59:04.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:04 smithi170 ceph-mon[35947]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T20:59:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:04 smithi186 ceph-mon[36391]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T20:59:06.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:06 smithi008 ceph-mon[31434]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T20:59:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:06 smithi170 ceph-mon[35947]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T20:59:06.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:06 smithi186 ceph-mon[36391]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T20:59:08.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:08 smithi008 ceph-mon[31434]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T20:59:08.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:08 smithi170 ceph-mon[35947]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T20:59:08.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:08 smithi186 ceph-mon[36391]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T20:59:10.695 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:10 smithi186 ceph-mon[36391]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T20:59:10.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:10 smithi008 ceph-mon[31434]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T20:59:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:10 smithi170 ceph-mon[35947]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T20:59:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.395+0000 7fca8e200640 1 -- 172.21.15.8:0/2263663687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca881096d0 msgr2=0x7fca88109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.395+0000 7fca8e200640 1 --2- 172.21.15.8:0/2263663687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca881096d0 0x7fca88109ab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fca78009930 tx=0x7fca7802bc20 comp rx=0 tx=0).stop 2024-03-16T20:59:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.395+0000 7fca8e200640 1 -- 172.21.15.8:0/2263663687 shutdown_connections 2024-03-16T20:59:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.395+0000 7fca8e200640 1 --2- 172.21.15.8:0/2263663687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca88104080 0x7fca88110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.395+0000 7fca8e200640 1 --2- 172.21.15.8:0/2263663687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca881036c0 0x7fca88103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.395+0000 7fca8e200640 1 --2- 172.21.15.8:0/2263663687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca881096d0 0x7fca88109ab0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.395+0000 7fca8e200640 1 -- 172.21.15.8:0/2263663687 >> 172.21.15.8:0/2263663687 conn(0x7fca880ff1b0 msgr2=0x7fca881015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.395+0000 7fca8e200640 1 -- 172.21.15.8:0/2263663687 shutdown_connections 2024-03-16T20:59:11.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.395+0000 7fca8e200640 1 -- 172.21.15.8:0/2263663687 wait complete. 2024-03-16T20:59:11.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.396+0000 7fca8e200640 1 Processor -- start 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.396+0000 7fca8e200640 1 -- start start 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca8e200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca881036c0 0x7fca88199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca8e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca88104080 0x7fca8819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca8e200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca881096d0 0x7fca8819e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca8e200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8819ec60 con 0x7fca88104080 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca8e200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8819edd0 con 0x7fca881036c0 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca8e200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8819ef90 con 0x7fca881096d0 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca87400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca881036c0 0x7fca88199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca87400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca881036c0 0x7fca88199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35530/0 (socket says 172.21.15.8:35530) 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca87400640 1 -- 172.21.15.8:0/1672093 learned_addr learned my addr 172.21.15.8:0/1672093 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca87e00640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca881096d0 0x7fca8819e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca87400640 1 -- 172.21.15.8:0/1672093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca881096d0 msgr2=0x7fca8819e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca87400640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca881096d0 0x7fca8819e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca87400640 1 -- 172.21.15.8:0/1672093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca88104080 msgr2=0x7fca8819a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca87400640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca88104080 0x7fca8819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.397+0000 7fca87400640 1 -- 172.21.15.8:0/1672093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78009560 con 0x7fca881036c0 2024-03-16T20:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.398+0000 7fca87400640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca881036c0 0x7fca88199da0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fca78009230 tx=0x7fca7802c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.398+0000 7fca7fe00640 1 -- 172.21.15.8:0/1672093 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78004e10 con 0x7fca881036c0 2024-03-16T20:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.398+0000 7fca8e200640 1 -- 172.21.15.8:0/1672093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8819f210 con 0x7fca881036c0 2024-03-16T20:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.398+0000 7fca7fe00640 1 -- 172.21.15.8:0/1672093 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fca78005470 con 0x7fca881036c0 2024-03-16T20:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.398+0000 7fca7fe00640 1 -- 172.21.15.8:0/1672093 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78034440 con 0x7fca881036c0 2024-03-16T20:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.398+0000 7fca8e200640 1 -- 172.21.15.8:0/1672093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8819f4e0 con 0x7fca881036c0 2024-03-16T20:59:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.403+0000 7fca90e7e740 1 Processor -- start 2024-03-16T20:59:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.403+0000 7fca90e7e740 1 -- start start 2024-03-16T20:59:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.403+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421ebb20 0x5650421ea870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.403+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421eadb0 0x5650421eb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.403+0000 7fca7fe00640 1 -- 172.21.15.8:0/1672093 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7fca780035f0 con 0x7fca881036c0 2024-03-16T20:59:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421f4330 0x5650421f6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca90e7e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650421a6620 con 0x5650421ebb20 2024-03-16T20:59:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca90e7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650421588c0 con 0x5650421f4330 2024-03-16T20:59:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca90e7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x565042155df0 con 0x5650421eadb0 2024-03-16T20:59:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca87400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421eadb0 0x5650421eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca87400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421eadb0 0x5650421eb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36886/0 (socket says 172.21.15.8:36886) 2024-03-16T20:59:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca87400640 1 -- 172.21.15.8:0/3924390310 learned_addr learned my addr 172.21.15.8:0/3924390310 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca87e00640 1 --2- 172.21.15.8:0/3924390310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421ebb20 0x5650421ea870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca86a00640 1 --2- 172.21.15.8:0/3924390310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421f4330 0x5650421f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca87400640 1 -- 172.21.15.8:0/3924390310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421f4330 msgr2=0x5650421f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca87400640 1 --2- 172.21.15.8:0/3924390310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421f4330 0x5650421f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca87400640 1 -- 172.21.15.8:0/3924390310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421ebb20 msgr2=0x5650421ea870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca87400640 1 --2- 172.21.15.8:0/3924390310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421ebb20 0x5650421ea870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.404+0000 7fca87400640 1 -- 172.21.15.8:0/3924390310 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650420d2b00 con 0x5650421eadb0 2024-03-16T20:59:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.405+0000 7fca87400640 1 --2- 172.21.15.8:0/3924390310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421eadb0 0x5650421eb230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fca780ed280 tx=0x7fca780f3c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec808f88a6a01baf server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.405+0000 7fca73e00640 1 -- 172.21.15.8:0/3924390310 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780f8c80 con 0x5650421eadb0 2024-03-16T20:59:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.405+0000 7fca73e00640 1 -- 172.21.15.8:0/3924390310 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fca780f3840 con 0x5650421eadb0 2024-03-16T20:59:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.405+0000 7fca73e00640 1 -- 172.21.15.8:0/3924390310 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780fa7a0 con 0x5650421eadb0 2024-03-16T20:59:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.406+0000 7fca7fe00640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca6c0a1d60 0x7fca6c0a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.406+0000 7fca7fe00640 1 -- 172.21.15.8:0/1672093 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fca780efc30 con 0x7fca881036c0 2024-03-16T20:59:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.406+0000 7fca90e7e740 1 -- 172.21.15.8:0/3924390310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421eadb0 msgr2=0x5650421eb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.406+0000 7fca90e7e740 1 --2- 172.21.15.8:0/3924390310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421eadb0 0x5650421eb230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fca780ed280 tx=0x7fca780f3c90 comp rx=0 tx=0).stop 2024-03-16T20:59:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.406+0000 7fca87e00640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca6c0a1d60 0x7fca6c0a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.406+0000 7fca90e7e740 1 -- 172.21.15.8:0/3924390310 shutdown_connections 2024-03-16T20:59:11.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.406+0000 7fca90e7e740 1 --2- 172.21.15.8:0/3924390310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421f4330 0x5650421f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.406+0000 7fca90e7e740 1 --2- 172.21.15.8:0/3924390310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421eadb0 0x5650421eb230 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.406+0000 7fca90e7e740 1 --2- 172.21.15.8:0/3924390310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421ebb20 0x5650421ea870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.406+0000 7fca90e7e740 1 -- 172.21.15.8:0/3924390310 >> 172.21.15.8:0/3924390310 conn(0x5650421b24b0 msgr2=0x5650421e5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:11.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.407+0000 7fca90e7e740 1 -- 172.21.15.8:0/3924390310 shutdown_connections 2024-03-16T20:59:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.408+0000 7fca90e7e740 1 -- 172.21.15.8:0/3924390310 wait complete. 2024-03-16T20:59:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.408+0000 7fca87e00640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca6c0a1d60 0x7fca6c0a4220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca80005fd0 tx=0x7fca80009600 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.408+0000 7fca90e7e740 1 -- start start 2024-03-16T20:59:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.408+0000 7fca90e7e740 1 Processor -- start 2024-03-16T20:59:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.409+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421eadb0 0x5650421f1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.409+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421ebb20 0x5650421f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.409+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421f4330 0x5650421f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.409+0000 7fca90e7e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650421515d0 con 0x5650421ebb20 2024-03-16T20:59:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.409+0000 7fca90e7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650420f6b50 con 0x5650421eadb0 2024-03-16T20:59:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.409+0000 7fca90e7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650420f67f0 con 0x5650421f4330 2024-03-16T20:59:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.409+0000 7fca90e7e740 10 client.0 _ll_register_callbacks cb 0x56504210a550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.409+0000 7fca87e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421f4330 0x5650421f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.409+0000 7fca87e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421f4330 0x5650421f1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36896/0 (socket says 172.21.15.8:36896) 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.409+0000 7fca87e00640 1 -- 172.21.15.8:0/729715727 learned_addr learned my addr 172.21.15.8:0/729715727 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.409+0000 7fca87400640 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421eadb0 0x5650421f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca86a00640 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421ebb20 0x5650421f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca87400640 1 -- 172.21.15.8:0/729715727 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421f4330 msgr2=0x5650421f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca87400640 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421f4330 0x5650421f1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca87400640 1 -- 172.21.15.8:0/729715727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421ebb20 msgr2=0x5650421f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca87400640 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421ebb20 0x5650421f18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca87400640 1 -- 172.21.15.8:0/729715727 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8819f4e0 con 0x5650421eadb0 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca86a00640 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421ebb20 0x5650421f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca87400640 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421eadb0 0x5650421f1380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fca78000c00 tx=0x7fca78003990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7cbdc93b2d0eca0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca70c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca70c00640 1 -- 172.21.15.8:0/729715727 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780f31b0 con 0x5650421eadb0 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca70c00640 1 -- 172.21.15.8:0/729715727 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fca780bcdf0 con 0x5650421eadb0 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.410+0000 7fca90e7e740 1 -- 172.21.15.8:0/729715727 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565042123cd0 con 0x5650421eadb0 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.411+0000 7fca70c00640 1 -- 172.21.15.8:0/729715727 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca780fbd10 con 0x5650421eadb0 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.411+0000 7fca90e7e740 10 client.25766 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.411+0000 7fca90e7e740 1 -- 172.21.15.8:0/729715727 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56504214fc50 con 0x5650421eadb0 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.411+0000 7fca70c00640 1 -- 172.21.15.8:0/729715727 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x565042123cd0 con 0x5650421eadb0 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.411+0000 7fca70c00640 1 -- 172.21.15.8:0/729715727 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fca780dc0b0 con 0x5650421eadb0 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.411+0000 7fca90e7e740 10 client.25766 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.411+0000 7fca90e7e740 10 client.25766 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.411+0000 7fca90e7e740 20 client.25766 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.412+0000 7fca90e7e740 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56504220c310 0x56504220e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.412+0000 7fca90e7e740 4 client.25766 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.412+0000 7fca90e7e740 1 -- 172.21.15.8:0/729715727 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565042147ce0 con 0x56504220c310 2024-03-16T20:59:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.412+0000 7fca86a00640 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56504220c310 0x56504220e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.412+0000 7fca86a00640 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56504220c310 0x56504220e700 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=635053d650206bf9 server_cookie=b51c2205bf8daeb3 in_seq=0 out_seq=0 2024-03-16T20:59:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.412+0000 7fca70c00640 10 client.25766 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.413+0000 7fca70c00640 1 -- 172.21.15.8:0/729715727 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x565042147ce0 con 0x56504220c310 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.413+0000 7fca70c00640 10 client.25766 handle_command_reply: tid=0 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.413+0000 7fca90e7e740 1 client.25766 shutdown 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.413+0000 7fca90e7e740 1 -- 172.21.15.8:0/729715727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421eadb0 msgr2=0x5650421f1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.413+0000 7fca90e7e740 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421eadb0 0x5650421f1380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fca78000c00 tx=0x7fca78003990 comp rx=0 tx=0).stop 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.414+0000 7fca90e7e740 1 -- 172.21.15.8:0/729715727 shutdown_connections 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.414+0000 7fca90e7e740 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421f4330 0x5650421f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.414+0000 7fca90e7e740 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56504220c310 0x56504220e700 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.414+0000 7fca90e7e740 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421ebb20 0x5650421f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.414+0000 7fca90e7e740 1 --2- 172.21.15.8:0/729715727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421eadb0 0x5650421f1380 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.414+0000 7fca90e7e740 1 -- 172.21.15.8:0/729715727 >> 172.21.15.8:0/729715727 conn(0x5650421b24b0 msgr2=0x5650421e77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.414+0000 7fca70c00640 0 client.25766 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.414+0000 7fca90e7e740 1 -- 172.21.15.8:0/729715727 shutdown_connections 2024-03-16T20:59:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.414+0000 7fca90e7e740 1 -- 172.21.15.8:0/729715727 wait complete. 2024-03-16T20:59:11.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.414+0000 7fca90e7e740 20 client.25766 trim_cache size 0 max 16384 2024-03-16T20:59:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca90e7e740 1 Processor -- start 2024-03-16T20:59:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca90e7e740 1 -- start start 2024-03-16T20:59:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421eadb0 0x5650421f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421ebb20 0x5650421f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421f4330 0x5650421f0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca90e7e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x565041e99e60 con 0x5650421eadb0 2024-03-16T20:59:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca90e7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650421ea080 con 0x5650421f4330 2024-03-16T20:59:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca90e7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650421ef8d0 con 0x5650421ebb20 2024-03-16T20:59:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca87400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421eadb0 0x5650421f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca87400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421eadb0 0x5650421f3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60182/0 (socket says 172.21.15.8:60182) 2024-03-16T20:59:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca87400640 1 -- 172.21.15.8:0/976170230 learned_addr learned my addr 172.21.15.8:0/976170230 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca86a00640 1 --2- 172.21.15.8:0/976170230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421ebb20 0x5650421f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.431+0000 7fca87e00640 1 --2- 172.21.15.8:0/976170230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421f4330 0x5650421f0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.432+0000 7fca87400640 1 -- 172.21.15.8:0/976170230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421ebb20 msgr2=0x5650421f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.432+0000 7fca87400640 1 --2- 172.21.15.8:0/976170230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421ebb20 0x5650421f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.432+0000 7fca87400640 1 -- 172.21.15.8:0/976170230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421f4330 msgr2=0x5650421f0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.432+0000 7fca87400640 1 --2- 172.21.15.8:0/976170230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421f4330 0x5650421f0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.432+0000 7fca87400640 1 -- 172.21.15.8:0/976170230 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650420ec530 con 0x5650421eadb0 2024-03-16T20:59:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.432+0000 7fca87400640 1 --2- 172.21.15.8:0/976170230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421eadb0 0x5650421f3ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca780bc3f0 tx=0x7fca780045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f4c82c0f32b7b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.432+0000 7fca73400640 1 -- 172.21.15.8:0/976170230 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780f31b0 con 0x5650421eadb0 2024-03-16T20:59:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.432+0000 7fca73400640 1 -- 172.21.15.8:0/976170230 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fca780055e0 con 0x5650421eadb0 2024-03-16T20:59:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.432+0000 7fca73400640 1 -- 172.21.15.8:0/976170230 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780bcdf0 con 0x5650421eadb0 2024-03-16T20:59:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.433+0000 7fca90e7e740 1 -- 172.21.15.8:0/976170230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421eadb0 msgr2=0x5650421f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.433+0000 7fca90e7e740 1 --2- 172.21.15.8:0/976170230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421eadb0 0x5650421f3ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca780bc3f0 tx=0x7fca780045d0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.433+0000 7fca90e7e740 1 -- 172.21.15.8:0/976170230 shutdown_connections 2024-03-16T20:59:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.433+0000 7fca90e7e740 1 --2- 172.21.15.8:0/976170230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421f4330 0x5650421f0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.433+0000 7fca90e7e740 1 --2- 172.21.15.8:0/976170230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421ebb20 0x5650421f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.433+0000 7fca90e7e740 1 --2- 172.21.15.8:0/976170230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421eadb0 0x5650421f3ab0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.433+0000 7fca90e7e740 1 -- 172.21.15.8:0/976170230 >> 172.21.15.8:0/976170230 conn(0x5650421b24b0 msgr2=0x5650421efc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.433+0000 7fca90e7e740 1 -- 172.21.15.8:0/976170230 shutdown_connections 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.433+0000 7fca90e7e740 1 -- 172.21.15.8:0/976170230 wait complete. 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.434+0000 7fca90e7e740 1 -- start start 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.434+0000 7fca90e7e740 1 Processor -- start 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.434+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421eadb0 0x5650421fb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.434+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421ebb20 0x5650421fbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.434+0000 7fca90e7e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421f4330 0x5650421f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.434+0000 7fca90e7e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650421f7500 con 0x5650421f4330 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.434+0000 7fca90e7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650421f7670 con 0x5650421eadb0 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.434+0000 7fca90e7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650421f7830 con 0x5650421ebb20 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.434+0000 7fca90e7e740 10 client.0 _ll_register_callbacks cb 0x7fca780f3ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.434+0000 7fca87e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421f4330 0x5650421f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca87e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421f4330 0x5650421f6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60192/0 (socket says 172.21.15.8:60192) 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca86a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421ebb20 0x5650421fbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca87e00640 1 -- 172.21.15.8:0/1385425556 learned_addr learned my addr 172.21.15.8:0/1385425556 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca87400640 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421eadb0 0x5650421fb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca87e00640 1 -- 172.21.15.8:0/1385425556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421ebb20 msgr2=0x5650421fbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca87e00640 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421ebb20 0x5650421fbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca87e00640 1 -- 172.21.15.8:0/1385425556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421eadb0 msgr2=0x5650421fb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca87e00640 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421eadb0 0x5650421fb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca87e00640 1 -- 172.21.15.8:0/1385425556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8819f4e0 con 0x5650421f4330 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca87e00640 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421f4330 0x5650421f6e30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca80013fd0 tx=0x7fca80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f5b8eba0aabf6f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca70c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.435+0000 7fca70c00640 1 -- 172.21.15.8:0/1385425556 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80025070 con 0x5650421f4330 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca70c00640 1 -- 172.21.15.8:0/1385425556 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fca80020930 con 0x5650421f4330 2024-03-16T20:59:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca90e7e740 1 -- 172.21.15.8:0/1385425556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565042176d30 con 0x5650421f4330 2024-03-16T20:59:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca70c00640 1 -- 172.21.15.8:0/1385425556 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca80020af0 con 0x5650421f4330 2024-03-16T20:59:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca90e7e740 10 client.15615 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca90e7e740 1 -- 172.21.15.8:0/1385425556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5650421122c0 con 0x5650421f4330 2024-03-16T20:59:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca70c00640 1 -- 172.21.15.8:0/1385425556 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x565042176d30 con 0x5650421f4330 2024-03-16T20:59:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca70c00640 1 -- 172.21.15.8:0/1385425556 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fca8001e3b0 con 0x5650421f4330 2024-03-16T20:59:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca90e7e740 10 client.15615 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca90e7e740 10 client.15615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca90e7e740 20 client.15615 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca90e7e740 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x565042267d80 0x56504226a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.436+0000 7fca90e7e740 4 client.15615 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T20:59:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.437+0000 7fca90e7e740 1 -- 172.21.15.8:0/1385425556 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565041e51600 con 0x565042267d80 2024-03-16T20:59:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.437+0000 7fca87400640 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x565042267d80 0x56504226a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.437+0000 7fca87400640 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x565042267d80 0x56504226a1a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b187aba9bea1fc server_cookie=9b68ecbb9d7b4f0 in_seq=0 out_seq=0 2024-03-16T20:59:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.437+0000 7fca70c00640 10 client.15615 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.442+0000 7fca70c00640 1 -- 172.21.15.8:0/1385425556 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565041e51600 con 0x565042267d80 2024-03-16T20:59:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.442+0000 7fca70c00640 10 client.15615 handle_command_reply: tid=0 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.442+0000 7fca90e7e740 1 client.15615 shutdown 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca90e7e740 1 -- 172.21.15.8:0/1385425556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421f4330 msgr2=0x5650421f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca90e7e740 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421f4330 0x5650421f6e30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca80013fd0 tx=0x7fca80004a40 comp rx=0 tx=0).stop 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca90e7e740 1 -- 172.21.15.8:0/1385425556 shutdown_connections 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca90e7e740 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x565042267d80 0x56504226a1a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca90e7e740 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650421f4330 0x5650421f6e30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca90e7e740 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650421ebb20 0x5650421fbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca90e7e740 1 --2- 172.21.15.8:0/1385425556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650421eadb0 0x5650421fb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca70c00640 0 client.15615 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca90e7e740 1 -- 172.21.15.8:0/1385425556 >> 172.21.15.8:0/1385425556 conn(0x5650421b24b0 msgr2=0x5650421e44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca90e7e740 1 -- 172.21.15.8:0/1385425556 shutdown_connections 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca90e7e740 1 -- 172.21.15.8:0/1385425556 wait complete. 2024-03-16T20:59:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.443+0000 7fca90e7e740 20 client.15615 trim_cache size 0 max 16384 2024-03-16T20:59:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T20:59:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T20:59:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T20:59:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 -- 172.21.15.8:0/1672093 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca6c0a1d60 msgr2=0x7fca6c0a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca6c0a1d60 0x7fca6c0a4220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca80005fd0 tx=0x7fca80009600 comp rx=0 tx=0).stop 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 -- 172.21.15.8:0/1672093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca881036c0 msgr2=0x7fca88199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca881036c0 0x7fca88199da0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fca78009230 tx=0x7fca7802c790 comp rx=0 tx=0).stop 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 -- 172.21.15.8:0/1672093 shutdown_connections 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca6c0a1d60 0x7fca6c0a4220 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca881096d0 0x7fca8819e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca88104080 0x7fca8819a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 --2- 172.21.15.8:0/1672093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca881036c0 0x7fca88199da0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 -- 172.21.15.8:0/1672093 >> 172.21.15.8:0/1672093 conn(0x7fca880ff1b0 msgr2=0x7fca880ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 -- 172.21.15.8:0/1672093 shutdown_connections 2024-03-16T20:59:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:11.444+0000 7fca8e200640 1 -- 172.21.15.8:0/1672093 wait complete. 2024-03-16T20:59:12.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:12 smithi008 ceph-mon[31434]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-16T20:59:12.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:12 smithi170 ceph-mon[35947]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-16T20:59:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:12 smithi186 ceph-mon[36391]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-16T20:59:14.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:14 smithi008 ceph-mon[31434]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-16T20:59:14.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:14 smithi170 ceph-mon[35947]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-16T20:59:14.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:14 smithi186 ceph-mon[36391]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-16T20:59:15.132 INFO:tasks.workunit.client.0.smithi008.stderr:Updating files: 59% (7298/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 99% (12150/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-16T20:59:15.439 INFO:tasks.workunit.client.0.smithi008.stderr:Note: switching to 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b'. 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr:state without impacting any branches by switching back to a branch. 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr: git switch -c 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr:Or undo this operation with: 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr: git switch - 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-16T20:59:15.440 INFO:tasks.workunit.client.0.smithi008.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-16T20:59:15.441 INFO:tasks.workunit.client.0.smithi008.stderr: 2024-03-16T20:59:15.441 INFO:tasks.workunit.client.0.smithi008.stderr:HEAD is now at aba3c1d240c mds/quiesce-db: keep the db thread alive until shutdown 2024-03-16T20:59:15.447 DEBUG:teuthology.orchestra.run.smithi008:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-16T20:59:15.556 INFO:tasks.workunit.client.0.smithi008.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-16T20:59:15.564 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-16T20:59:15.564 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-16T20:59:15.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T20:59:15.578 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T20:59:15.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.792+0000 7f22c0e00640 1 -- 172.21.15.8:0/1554419293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22bc074240 msgr2=0x7f22bc10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:15.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.792+0000 7f22c0e00640 1 --2- 172.21.15.8:0/1554419293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22bc074240 0x7f22bc10d650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009900 tx=0x7f22a402bcd0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.792+0000 7f22c0e00640 1 -- 172.21.15.8:0/1554419293 shutdown_connections 2024-03-16T20:59:15.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.792+0000 7f22c0e00640 1 --2- 172.21.15.8:0/1554419293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22bc10db90 0x7f22bc10ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.792+0000 7f22c0e00640 1 --2- 172.21.15.8:0/1554419293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22bc074240 0x7f22bc10d650 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.792+0000 7f22c0e00640 1 --2- 172.21.15.8:0/1554419293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc073920 0x7f22bc073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.792+0000 7f22c0e00640 1 -- 172.21.15.8:0/1554419293 >> 172.21.15.8:0/1554419293 conn(0x7f22bc0fce60 msgr2=0x7f22bc0ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:15.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.792+0000 7f22c0e00640 1 -- 172.21.15.8:0/1554419293 shutdown_connections 2024-03-16T20:59:15.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.792+0000 7f22c0e00640 1 -- 172.21.15.8:0/1554419293 wait complete. 2024-03-16T20:59:15.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.793+0000 7f22c0e00640 1 Processor -- start 2024-03-16T20:59:15.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22c0e00640 1 -- start start 2024-03-16T20:59:15.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22c0e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22bc073920 0x7f22bc19fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22c0e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22bc074240 0x7f22bc19ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22c0e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc10db90 0x7f22bc199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22c0e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc19a2a0 con 0x7f22bc073920 2024-03-16T20:59:15.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22c0e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc19a410 con 0x7f22bc074240 2024-03-16T20:59:15.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22c0e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc19a5d0 con 0x7f22bc10db90 2024-03-16T20:59:15.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22bc073920 0x7f22bc19fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22b2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22bc074240 0x7f22bc19ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22bc073920 0x7f22bc19fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60214/0 (socket says 172.21.15.8:60214) 2024-03-16T20:59:15.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22bbe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc10db90 0x7f22bc199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.794+0000 7f22bb400640 1 -- 172.21.15.8:0/4059971539 learned_addr learned my addr 172.21.15.8:0/4059971539 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:15.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.795+0000 7f22b2a00640 1 -- 172.21.15.8:0/4059971539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc10db90 msgr2=0x7f22bc199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:15.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.795+0000 7f22b2a00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc10db90 0x7f22bc199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.795+0000 7f22b2a00640 1 -- 172.21.15.8:0/4059971539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22bc073920 msgr2=0x7f22bc19fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:15.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.795+0000 7f22b2a00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22bc073920 0x7f22bc19fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.795+0000 7f22b2a00640 1 -- 172.21.15.8:0/4059971539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a4009560 con 0x7f22bc074240 2024-03-16T20:59:15.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.795+0000 7f22bbe00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc10db90 0x7f22bc199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:15.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.795+0000 7f22b2a00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22bc074240 0x7f22bc19ff90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f22a4000c00 tx=0x7f22a402ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:15.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.795+0000 7f22b8c00640 1 -- 172.21.15.8:0/4059971539 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4004250 con 0x7f22bc074240 2024-03-16T20:59:15.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.795+0000 7f22b8c00640 1 -- 172.21.15.8:0/4059971539 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f22a40043b0 con 0x7f22bc074240 2024-03-16T20:59:15.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.796+0000 7f22c0e00640 1 -- 172.21.15.8:0/4059971539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc19a850 con 0x7f22bc074240 2024-03-16T20:59:15.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.796+0000 7f22b8c00640 1 -- 172.21.15.8:0/4059971539 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4003be0 con 0x7f22bc074240 2024-03-16T20:59:15.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.796+0000 7f22c0e00640 1 -- 172.21.15.8:0/4059971539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc1a69d0 con 0x7f22bc074240 2024-03-16T20:59:15.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.799+0000 7f22b8c00640 1 -- 172.21.15.8:0/4059971539 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f22a4003d40 con 0x7f22bc074240 2024-03-16T20:59:15.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.799+0000 7f22c51dc740 1 Processor -- start 2024-03-16T20:59:15.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.799+0000 7f22c51dc740 1 -- start start 2024-03-16T20:59:15.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.799+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 0x557493021ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.799+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x557493022910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.799+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 0x55749302dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.799+0000 7f22c51dc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557492f91150 con 0x557493023170 2024-03-16T20:59:15.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.799+0000 7f22c51dc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557492f8e680 con 0x55749302b800 2024-03-16T20:59:15.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.799+0000 7f22c51dc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557492f89e60 con 0x557493022490 2024-03-16T20:59:15.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22b2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 0x55749302dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22bbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 0x557493021ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22bb400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x557493022910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22bb400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x557493022910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36954/0 (socket says 172.21.15.8:36954) 2024-03-16T20:59:15.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22b2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 0x55749302dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35580/0 (socket says 172.21.15.8:35580) 2024-03-16T20:59:15.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22bbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 0x557493021ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60230/0 (socket says 172.21.15.8:60230) 2024-03-16T20:59:15.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22bb400640 1 -- 172.21.15.8:0/3915253069 learned_addr learned my addr 172.21.15.8:0/3915253069 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:15.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22bb400640 1 -- 172.21.15.8:0/3915253069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 msgr2=0x55749302dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:15.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22bb400640 1 --2- 172.21.15.8:0/3915253069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 0x55749302dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22bb400640 1 -- 172.21.15.8:0/3915253069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 msgr2=0x557493021ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:15.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22bb400640 1 --2- 172.21.15.8:0/3915253069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 0x557493021ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22bb400640 1 -- 172.21.15.8:0/3915253069 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557492f43060 con 0x557493022490 2024-03-16T20:59:15.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22b2a00640 1 --2- 172.21.15.8:0/3915253069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 0x55749302dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:15.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22bb400640 1 --2- 172.21.15.8:0/3915253069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x557493022910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009e10 tx=0x7f22ac011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23bdc83f725508d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:15.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.800+0000 7f22b8c00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f22a00a1cc0 0x7f22a00a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22b0c00640 1 -- 172.21.15.8:0/3915253069 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac019630 con 0x557493022490 2024-03-16T20:59:15.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22b0c00640 1 -- 172.21.15.8:0/3915253069 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f22ac019c90 con 0x557493022490 2024-03-16T20:59:15.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22b0c00640 1 -- 172.21.15.8:0/3915253069 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00fdb0 con 0x557493022490 2024-03-16T20:59:15.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22b8c00640 1 -- 172.21.15.8:0/4059971539 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f22a40eff30 con 0x7f22bc074240 2024-03-16T20:59:15.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22bbe00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f22a00a1cc0 0x7f22a00a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22c51dc740 1 -- 172.21.15.8:0/3915253069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 msgr2=0x557493022910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22c51dc740 1 --2- 172.21.15.8:0/3915253069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x557493022910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009e10 tx=0x7f22ac011810 comp rx=0 tx=0).stop 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22c51dc740 1 -- 172.21.15.8:0/3915253069 shutdown_connections 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22c51dc740 1 --2- 172.21.15.8:0/3915253069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 0x55749302dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22c51dc740 1 --2- 172.21.15.8:0/3915253069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x557493022910 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22c51dc740 1 --2- 172.21.15.8:0/3915253069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 0x557493021ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22c51dc740 1 -- 172.21.15.8:0/3915253069 >> 172.21.15.8:0/3915253069 conn(0x557492fe95a0 msgr2=0x55749301cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.801+0000 7f22c51dc740 1 -- 172.21.15.8:0/3915253069 shutdown_connections 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.802+0000 7f22bbe00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f22a00a1cc0 0x7f22a00a4180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22b4005fd0 tx=0x7f22b40096a0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.802+0000 7f22c51dc740 1 -- 172.21.15.8:0/3915253069 wait complete. 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.802+0000 7f22c51dc740 1 -- start start 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.802+0000 7f22c51dc740 1 Processor -- start 2024-03-16T20:59:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493022490 0x5574930287d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493023170 0x557493028d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55749302b800 0x557493029250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22c51dc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557492f2eec0 con 0x55749302b800 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22c51dc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557492f2eb60 con 0x557493022490 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22c51dc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557492cf81c0 con 0x557493023170 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22c51dc740 10 client.0 _ll_register_callbacks cb 0x557492f42960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22bb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493022490 0x5574930287d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22bb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493022490 0x5574930287d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35596/0 (socket says 172.21.15.8:35596) 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22b2a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493023170 0x557493028d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22bb400640 1 -- 172.21.15.8:0/2358716906 learned_addr learned my addr 172.21.15.8:0/2358716906 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22bbe00640 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55749302b800 0x557493029250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22bb400640 1 -- 172.21.15.8:0/2358716906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493023170 msgr2=0x557493028d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22bb400640 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493023170 0x557493028d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22bb400640 1 -- 172.21.15.8:0/2358716906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55749302b800 msgr2=0x557493029250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22bb400640 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55749302b800 0x557493029250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22bb400640 1 -- 172.21.15.8:0/2358716906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac009a70 con 0x557493022490 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.803+0000 7f22b2a00640 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493023170 0x557493028d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.804+0000 7f22bb400640 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493022490 0x5574930287d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f22ac005bc0 tx=0x7f22ac005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9021cd29f5c42b87 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.804+0000 7f22a9600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.804+0000 7f22a9600640 1 -- 172.21.15.8:0/2358716906 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00f750 con 0x557493022490 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.804+0000 7f22a9600640 1 -- 172.21.15.8:0/2358716906 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f22ac005240 con 0x557493022490 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.804+0000 7f22c51dc740 1 -- 172.21.15.8:0/2358716906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557492c897e0 con 0x557493022490 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.804+0000 7f22a9600640 1 -- 172.21.15.8:0/2358716906 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22ac005400 con 0x557493022490 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.804+0000 7f22c51dc740 10 client.25784 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.804+0000 7f22c51dc740 1 -- 172.21.15.8:0/2358716906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557492f884e0 con 0x557493022490 2024-03-16T20:59:15.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.804+0000 7f22a9600640 1 -- 172.21.15.8:0/2358716906 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x557492c897e0 con 0x557493022490 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.805+0000 7f22a9600640 1 -- 172.21.15.8:0/2358716906 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f22ac004a50 con 0x557493022490 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.805+0000 7f22c51dc740 10 client.25784 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.805+0000 7f22c51dc740 10 client.25784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.805+0000 7f22c51dc740 20 client.25784 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.805+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55749303b830 0x55749303dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.805+0000 7f22c51dc740 4 client.25784 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.805+0000 7f22c51dc740 1 -- 172.21.15.8:0/2358716906 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557492cc6720 con 0x55749303b830 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.805+0000 7f22b2a00640 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55749303b830 0x55749303dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.805+0000 7f22b2a00640 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55749303b830 0x55749303dc20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d94e3b37d8f6eda server_cookie=bedaf61d373f0dfd in_seq=0 out_seq=0 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.806+0000 7f22a9600640 10 client.25784 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.806+0000 7f22a9600640 1 -- 172.21.15.8:0/2358716906 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x557492cc6720 con 0x55749303b830 2024-03-16T20:59:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.806+0000 7f22a9600640 10 client.25784 handle_command_reply: tid=0 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.806+0000 7f22c51dc740 1 client.25784 shutdown 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.806+0000 7f22c51dc740 1 -- 172.21.15.8:0/2358716906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493022490 msgr2=0x5574930287d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.806+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493022490 0x5574930287d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f22ac005bc0 tx=0x7f22ac005d30 comp rx=0 tx=0).stop 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.806+0000 7f22c51dc740 1 -- 172.21.15.8:0/2358716906 shutdown_connections 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.806+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55749303b830 0x55749303dc20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.806+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55749302b800 0x557493029250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.806+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493023170 0x557493028d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.807+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2358716906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493022490 0x5574930287d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.806+0000 7f22a9600640 0 client.25784 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.807+0000 7f22c51dc740 1 -- 172.21.15.8:0/2358716906 >> 172.21.15.8:0/2358716906 conn(0x557492fe95a0 msgr2=0x55749301ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.807+0000 7f22c51dc740 1 -- 172.21.15.8:0/2358716906 shutdown_connections 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.807+0000 7f22c51dc740 1 -- 172.21.15.8:0/2358716906 wait complete. 2024-03-16T20:59:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.807+0000 7f22c51dc740 20 client.25784 trim_cache size 0 max 16384 2024-03-16T20:59:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.824+0000 7f22c51dc740 1 Processor -- start 2024-03-16T20:59:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.824+0000 7f22c51dc740 1 -- start start 2024-03-16T20:59:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.824+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x55749302af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.824+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 0x557493029070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 0x557493036c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22c51dc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557493026d20 con 0x557493023170 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22c51dc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749301cc40 con 0x55749302b800 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22c51dc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749301ce00 con 0x557493022490 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22bb400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x55749302af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22bb400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x55749302af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36978/0 (socket says 172.21.15.8:36978) 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22bb400640 1 -- 172.21.15.8:0/2558447538 learned_addr learned my addr 172.21.15.8:0/2558447538 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22bbe00640 1 --2- 172.21.15.8:0/2558447538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 0x557493036c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22b2a00640 1 --2- 172.21.15.8:0/2558447538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 0x557493029070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22bb400640 1 -- 172.21.15.8:0/2558447538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 msgr2=0x557493036c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22bb400640 1 --2- 172.21.15.8:0/2558447538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 0x557493036c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22bb400640 1 -- 172.21.15.8:0/2558447538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 msgr2=0x557493029070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22bb400640 1 --2- 172.21.15.8:0/2558447538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 0x557493029070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22bb400640 1 -- 172.21.15.8:0/2558447538 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557492f24950 con 0x557493022490 2024-03-16T20:59:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22b2a00640 1 --2- 172.21.15.8:0/2558447538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 0x557493029070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.825+0000 7f22bb400640 1 --2- 172.21.15.8:0/2558447538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x55749302af00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0059f0 tx=0x7f22ac00f5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc1275e3cfac8e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:15.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22abe00640 1 -- 172.21.15.8:0/2558447538 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac011dc0 con 0x557493022490 2024-03-16T20:59:15.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22abe00640 1 -- 172.21.15.8:0/2558447538 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f22ac00feb0 con 0x557493022490 2024-03-16T20:59:15.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22abe00640 1 -- 172.21.15.8:0/2558447538 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac004990 con 0x557493022490 2024-03-16T20:59:15.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22c51dc740 1 -- 172.21.15.8:0/2558447538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 msgr2=0x55749302af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:15.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2558447538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x55749302af00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0059f0 tx=0x7f22ac00f5d0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22c51dc740 1 -- 172.21.15.8:0/2558447538 shutdown_connections 2024-03-16T20:59:15.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2558447538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55749302b800 0x557493036c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2558447538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493023170 0x557493029070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2558447538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557493022490 0x55749302af00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22c51dc740 1 -- 172.21.15.8:0/2558447538 >> 172.21.15.8:0/2558447538 conn(0x557492fe95a0 msgr2=0x55749301bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22c51dc740 1 -- 172.21.15.8:0/2558447538 shutdown_connections 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.826+0000 7f22c51dc740 1 -- 172.21.15.8:0/2558447538 wait complete. 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.827+0000 7f22c51dc740 1 -- start start 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.827+0000 7f22c51dc740 1 Processor -- start 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.827+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493022490 0x5574930332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.827+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493023170 0x557493025870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.827+0000 7f22c51dc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55749302b800 0x557493025db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.827+0000 7f22c51dc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557493033ae0 con 0x557493022490 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.827+0000 7f22c51dc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574930262f0 con 0x557493023170 2024-03-16T20:59:15.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.827+0000 7f22c51dc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574930264b0 con 0x55749302b800 2024-03-16T20:59:15.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.827+0000 7f22c51dc740 10 client.0 _ll_register_callbacks cb 0x7f22a40f3850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:15.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493022490 0x5574930332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22bbe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55749302b800 0x557493025db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22b2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493023170 0x557493025870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22bbe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55749302b800 0x557493025db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36992/0 (socket says 172.21.15.8:36992) 2024-03-16T20:59:15.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22b2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493023170 0x557493025870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35622/0 (socket says 172.21.15.8:35622) 2024-03-16T20:59:15.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493022490 0x5574930332a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60270/0 (socket says 172.21.15.8:60270) 2024-03-16T20:59:15.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22bbe00640 1 -- 172.21.15.8:0/2581953207 learned_addr learned my addr 172.21.15.8:0/2581953207 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:15.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22bbe00640 1 -- 172.21.15.8:0/2581953207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493023170 msgr2=0x557493025870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:15.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22bbe00640 1 --2- 172.21.15.8:0/2581953207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493023170 0x557493025870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22bbe00640 1 -- 172.21.15.8:0/2581953207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493022490 msgr2=0x5574930332a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22bbe00640 1 --2- 172.21.15.8:0/2581953207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493022490 0x5574930332a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22bbe00640 1 -- 172.21.15.8:0/2581953207 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557492f884e0 con 0x55749302b800 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22bbe00640 1 --2- 172.21.15.8:0/2581953207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55749302b800 0x557493025db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f22b4010c40 tx=0x7f22b4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df9846dd0e4b4a5f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.828+0000 7f22a9600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22a9600640 1 -- 172.21.15.8:0/2581953207 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4024070 con 0x55749302b800 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22a9600640 1 -- 172.21.15.8:0/2581953207 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f22b401e9a0 con 0x55749302b800 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22c51dc740 1 -- 172.21.15.8:0/2581953207 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22ac019c90 con 0x55749302b800 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22a9600640 1 -- 172.21.15.8:0/2581953207 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22b4016070 con 0x55749302b800 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22c51dc740 10 client.25801 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22c51dc740 1 -- 172.21.15.8:0/2581953207 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557492f4a430 con 0x55749302b800 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22a9600640 1 -- 172.21.15.8:0/2581953207 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f22ac019c90 con 0x55749302b800 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22a9600640 1 -- 172.21.15.8:0/2581953207 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f22b4004420 con 0x55749302b800 2024-03-16T20:59:15.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22c51dc740 10 client.25801 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22c51dc740 10 client.25801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22c51dc740 20 client.25801 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2581953207 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557493098630 0x55749309aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22c51dc740 4 client.25801 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.829+0000 7f22c51dc740 1 -- 172.21.15.8:0/2581953207 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557492d15890 con 0x557493098630 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22bb400640 1 --2- 172.21.15.8:0/2581953207 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557493098630 0x55749309aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22bb400640 1 --2- 172.21.15.8:0/2581953207 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557493098630 0x55749309aa50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=328ab13094c3c0a9 server_cookie=193ae3b5ed8c5024 in_seq=0 out_seq=0 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22a9600640 10 client.25801 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22a9600640 1 -- 172.21.15.8:0/2581953207 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557492d15890 con 0x557493098630 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22a9600640 10 client.25801 handle_command_reply: tid=0 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22c51dc740 1 client.25801 shutdown 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22c51dc740 1 -- 172.21.15.8:0/2581953207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55749302b800 msgr2=0x557493025db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2581953207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55749302b800 0x557493025db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f22b4010c40 tx=0x7f22b4004a40 comp rx=0 tx=0).stop 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22c51dc740 1 -- 172.21.15.8:0/2581953207 shutdown_connections 2024-03-16T20:59:15.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2581953207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55749302b800 0x557493025db0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2581953207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557493023170 0x557493025870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.830+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2581953207 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557493098630 0x55749309aa50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c51dc740 1 --2- 172.21.15.8:0/2581953207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557493022490 0x5574930332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c51dc740 1 -- 172.21.15.8:0/2581953207 >> 172.21.15.8:0/2581953207 conn(0x557492fe95a0 msgr2=0x557493042520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:15.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22a9600640 0 client.25801 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:15.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c51dc740 1 -- 172.21.15.8:0/2581953207 shutdown_connections 2024-03-16T20:59:15.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c51dc740 1 -- 172.21.15.8:0/2581953207 wait complete. 2024-03-16T20:59:15.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c51dc740 20 client.25801 trim_cache size 0 max 16384 2024-03-16T20:59:15.840 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:59:15.841 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T20:59:15.841 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T20:59:15.841 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:59:15.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c0e00640 1 -- 172.21.15.8:0/4059971539 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f22a00a1cc0 msgr2=0x7f22a00a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c0e00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f22a00a1cc0 0x7f22a00a4180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22b4005fd0 tx=0x7f22b40096a0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c0e00640 1 -- 172.21.15.8:0/4059971539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22bc074240 msgr2=0x7f22bc19ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c0e00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22bc074240 0x7f22bc19ff90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f22a4000c00 tx=0x7f22a402ccd0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c0e00640 1 -- 172.21.15.8:0/4059971539 shutdown_connections 2024-03-16T20:59:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c0e00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f22a00a1cc0 0x7f22a00a4180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c0e00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc10db90 0x7f22bc199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.831+0000 7f22c0e00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22bc074240 0x7f22bc19ff90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.832+0000 7f22c0e00640 1 --2- 172.21.15.8:0/4059971539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22bc073920 0x7f22bc19fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.832+0000 7f22c0e00640 1 -- 172.21.15.8:0/4059971539 >> 172.21.15.8:0/4059971539 conn(0x7f22bc0fce60 msgr2=0x7f22bc0fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.832+0000 7f22c0e00640 1 -- 172.21.15.8:0/4059971539 shutdown_connections 2024-03-16T20:59:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:15.832+0000 7f22c0e00640 1 -- 172.21.15.8:0/4059971539 wait complete. 2024-03-16T20:59:15.851 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T20:59:15.852 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:59:16.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.065+0000 7f7c67200640 1 -- 172.21.15.8:0/630538839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c68101550 msgr2=0x7f7c68101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.065+0000 7f7c67200640 1 --2- 172.21.15.8:0/630538839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c68101550 0x7f7c68101930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009930 tx=0x7f7c5802bc30 comp rx=0 tx=0).stop 2024-03-16T20:59:16.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.065+0000 7f7c67200640 1 -- 172.21.15.8:0/630538839 shutdown_connections 2024-03-16T20:59:16.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.065+0000 7f7c67200640 1 --2- 172.21.15.8:0/630538839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c68106620 0x7f7c6810e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.065+0000 7f7c67200640 1 --2- 172.21.15.8:0/630538839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c68101f00 0x7f7c68105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.065+0000 7f7c67200640 1 --2- 172.21.15.8:0/630538839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c68101550 0x7f7c68101930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.065+0000 7f7c67200640 1 -- 172.21.15.8:0/630538839 >> 172.21.15.8:0/630538839 conn(0x7f7c680fcdd0 msgr2=0x7f7c680ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.065+0000 7f7c67200640 1 -- 172.21.15.8:0/630538839 shutdown_connections 2024-03-16T20:59:16.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.065+0000 7f7c67200640 1 -- 172.21.15.8:0/630538839 wait complete. 2024-03-16T20:59:16.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.066+0000 7f7c67200640 1 Processor -- start 2024-03-16T20:59:16.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.066+0000 7f7c67200640 1 -- start start 2024-03-16T20:59:16.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.066+0000 7f7c67200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c68101550 0x7f7c6819d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.066+0000 7f7c67200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c68106620 0x7f7c6819dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.066+0000 7f7c67200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c68197890 0x7f7c68197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.066+0000 7f7c67200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c68198280 con 0x7f7c68197890 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.066+0000 7f7c67200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c681983f0 con 0x7f7c68106620 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.066+0000 7f7c67200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c681985b0 con 0x7f7c68101550 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.067+0000 7f7c65e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c68101550 0x7f7c6819d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.067+0000 7f7c65e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c68101550 0x7f7c6819d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:37014/0 (socket says 172.21.15.8:37014) 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.067+0000 7f7c65e00640 1 -- 172.21.15.8:0/2191727551 learned_addr learned my addr 172.21.15.8:0/2191727551 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.067+0000 7f7c65400640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c68106620 0x7f7c6819dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.067+0000 7f7c66800640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c68197890 0x7f7c68197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.067+0000 7f7c65e00640 1 -- 172.21.15.8:0/2191727551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c68106620 msgr2=0x7f7c6819dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.067+0000 7f7c65e00640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c68106620 0x7f7c6819dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.067+0000 7f7c65e00640 1 -- 172.21.15.8:0/2191727551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c68197890 msgr2=0x7f7c68197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.067+0000 7f7c65e00640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c68197890 0x7f7c68197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.067+0000 7f7c65e00640 1 -- 172.21.15.8:0/2191727551 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58009560 con 0x7f7c68101550 2024-03-16T20:59:16.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.067+0000 7f7c65e00640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c68101550 0x7f7c6819d6e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7c58000c00 tx=0x7f7c5802cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.068+0000 7f7c5ea00640 1 -- 172.21.15.8:0/2191727551 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58004250 con 0x7f7c68101550 2024-03-16T20:59:16.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.068+0000 7f7c5ea00640 1 -- 172.21.15.8:0/2191727551 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7c580043b0 con 0x7f7c68101550 2024-03-16T20:59:16.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.068+0000 7f7c5ea00640 1 -- 172.21.15.8:0/2191727551 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58003be0 con 0x7f7c68101550 2024-03-16T20:59:16.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.068+0000 7f7c67200640 1 -- 172.21.15.8:0/2191727551 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c681a45a0 con 0x7f7c68101550 2024-03-16T20:59:16.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.068+0000 7f7c67200640 1 -- 172.21.15.8:0/2191727551 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c681a4a00 con 0x7f7c68101550 2024-03-16T20:59:16.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.069+0000 7f7c67200640 1 -- 172.21.15.8:0/2191727551 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c68102a20 con 0x7f7c68101550 2024-03-16T20:59:16.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.071+0000 7f7c5ea00640 1 -- 172.21.15.8:0/2191727551 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f7c58003d40 con 0x7f7c68101550 2024-03-16T20:59:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.072+0000 7f7c5ea00640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7c480a1d40 0x7f7c480a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.073+0000 7f7c5ea00640 1 -- 172.21.15.8:0/2191727551 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7c580efe50 con 0x7f7c68101550 2024-03-16T20:59:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.073+0000 7f7c65400640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7c480a1d40 0x7f7c480a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.073+0000 7f7c65400640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7c480a1d40 0x7f7c480a4200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7c68107b00 tx=0x7f7c50009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.076+0000 7f7c5ea00640 1 -- 172.21.15.8:0/2191727551 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7c580b8bb0 con 0x7f7c68101550 2024-03-16T20:59:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.319+0000 7f7c67200640 1 -- 172.21.15.8:0/2191727551 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c68068200 con 0x7f7c68101550 2024-03-16T20:59:16.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.320+0000 7f7c5ea00640 1 -- 172.21.15.8:0/2191727551 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f7c58043090 con 0x7f7c68101550 2024-03-16T20:59:16.325 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:59:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:57:29.077799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T20:59:16.325 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 24 2024-03-16T20:59:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 -- 172.21.15.8:0/2191727551 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7c480a1d40 msgr2=0x7f7c480a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7c480a1d40 0x7f7c480a4200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7c68107b00 tx=0x7f7c50009500 comp rx=0 tx=0).stop 2024-03-16T20:59:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 -- 172.21.15.8:0/2191727551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c68101550 msgr2=0x7f7c6819d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c68101550 0x7f7c6819d6e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7c58000c00 tx=0x7f7c5802cc20 comp rx=0 tx=0).stop 2024-03-16T20:59:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 -- 172.21.15.8:0/2191727551 shutdown_connections 2024-03-16T20:59:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7c480a1d40 0x7f7c480a4200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c68197890 0x7f7c68197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c68106620 0x7f7c6819dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 --2- 172.21.15.8:0/2191727551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c68101550 0x7f7c6819d6e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 -- 172.21.15.8:0/2191727551 >> 172.21.15.8:0/2191727551 conn(0x7f7c680fcdd0 msgr2=0x7f7c680ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 -- 172.21.15.8:0/2191727551 shutdown_connections 2024-03-16T20:59:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.323+0000 7f7c67200640 1 -- 172.21.15.8:0/2191727551 wait complete. 2024-03-16T20:59:16.348 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:59:16.348 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T20:59:16.441 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-16T20:59:16.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.568+0000 7f8e34c00640 1 -- 172.21.15.8:0/2256235143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e30103690 msgr2=0x7f8e30103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.568+0000 7f8e34c00640 1 --2- 172.21.15.8:0/2256235143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e30103690 0x7f8e30103b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009900 tx=0x7f8e1c02bc30 comp rx=0 tx=0).stop 2024-03-16T20:59:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.568+0000 7f8e34c00640 1 -- 172.21.15.8:0/2256235143 shutdown_connections 2024-03-16T20:59:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.568+0000 7f8e34c00640 1 --2- 172.21.15.8:0/2256235143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30104050 0x7f8e30110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.568+0000 7f8e34c00640 1 --2- 172.21.15.8:0/2256235143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e30103690 0x7f8e30103b10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.568+0000 7f8e34c00640 1 --2- 172.21.15.8:0/2256235143 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e301096a0 0x7f8e30109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.568+0000 7f8e34c00640 1 -- 172.21.15.8:0/2256235143 >> 172.21.15.8:0/2256235143 conn(0x7f8e300ff140 msgr2=0x7f8e30101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.568+0000 7f8e34c00640 1 -- 172.21.15.8:0/2256235143 shutdown_connections 2024-03-16T20:59:16.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.568+0000 7f8e34c00640 1 -- 172.21.15.8:0/2256235143 wait complete. 2024-03-16T20:59:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.569+0000 7f8e34c00640 1 Processor -- start 2024-03-16T20:59:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.569+0000 7f8e34c00640 1 -- start start 2024-03-16T20:59:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e34c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e30103690 0x7f8e30199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e34c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30104050 0x7f8e3019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e34c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e301096a0 0x7f8e3019e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e34c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3019ecd0 con 0x7f8e30104050 2024-03-16T20:59:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e34c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3019ee40 con 0x7f8e30103690 2024-03-16T20:59:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e34c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3019f000 con 0x7f8e301096a0 2024-03-16T20:59:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e2de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e30103690 0x7f8e30199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e2de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e30103690 0x7f8e30199e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35648/0 (socket says 172.21.15.8:35648) 2024-03-16T20:59:16.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e2de00640 1 -- 172.21.15.8:0/1474037040 learned_addr learned my addr 172.21.15.8:0/1474037040 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e2d400640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30104050 0x7f8e3019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e2e800640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e301096a0 0x7f8e3019e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e2de00640 1 -- 172.21.15.8:0/1474037040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e301096a0 msgr2=0x7f8e3019e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e301096a0 0x7f8e3019e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e2de00640 1 -- 172.21.15.8:0/1474037040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30104050 msgr2=0x7f8e3019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30104050 0x7f8e3019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.570+0000 7f8e2de00640 1 -- 172.21.15.8:0/1474037040 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c009560 con 0x7f8e30103690 2024-03-16T20:59:16.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.571+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e30103690 0x7f8e30199e60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000e9f0 tx=0x7f8e2000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.571+0000 7f8e26a00640 1 -- 172.21.15.8:0/1474037040 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20009720 con 0x7f8e30103690 2024-03-16T20:59:16.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.571+0000 7f8e26a00640 1 -- 172.21.15.8:0/1474037040 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8e2000cd80 con 0x7f8e30103690 2024-03-16T20:59:16.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.571+0000 7f8e34c00640 1 -- 172.21.15.8:0/1474037040 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3019f2e0 con 0x7f8e30103690 2024-03-16T20:59:16.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.571+0000 7f8e26a00640 1 -- 172.21.15.8:0/1474037040 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20010690 con 0x7f8e30103690 2024-03-16T20:59:16.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.571+0000 7f8e34c00640 1 -- 172.21.15.8:0/1474037040 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e301a6b60 con 0x7f8e30103690 2024-03-16T20:59:16.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.574+0000 7f8e26a00640 1 -- 172.21.15.8:0/1474037040 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f8e200046c0 con 0x7f8e30103690 2024-03-16T20:59:16.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.574+0000 7f8e37a0e740 1 Processor -- start 2024-03-16T20:59:16.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e37a0e740 1 -- start start 2024-03-16T20:59:16.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 0x55e992fa1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992fa1560 0x55e992fa9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992faa140 0x55e992fac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e992f0f210 con 0x55e992fa0c40 2024-03-16T20:59:16.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e992f0c740 con 0x55e992fa1560 2024-03-16T20:59:16.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e992f07f20 con 0x55e992faa140 2024-03-16T20:59:16.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e2e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 0x55e992fa1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e2de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992fa1560 0x55e992fa9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e2e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 0x55e992fa1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60326/0 (socket says 172.21.15.8:60326) 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e2d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992faa140 0x55e992fac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.575+0000 7f8e2e800640 1 -- 172.21.15.8:0/4164027292 learned_addr learned my addr 172.21.15.8:0/4164027292 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e2d400640 1 -- 172.21.15.8:0/4164027292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992fa1560 msgr2=0x55e992fa9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e2d400640 1 --2- 172.21.15.8:0/4164027292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992fa1560 0x55e992fa9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e2d400640 1 -- 172.21.15.8:0/4164027292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 msgr2=0x55e992fa1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e2d400640 1 --2- 172.21.15.8:0/4164027292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 0x55e992fa1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e2d400640 1 -- 172.21.15.8:0/4164027292 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e992ec9df0 con 0x55e992faa140 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e26a00640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e140a1d40 0x7f8e140a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e2d400640 1 --2- 172.21.15.8:0/4164027292 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992faa140 0x55e992fac530 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c02c170 tx=0x7f8e1c02c5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2132e6dea50cbb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e26a00640 1 -- 172.21.15.8:0/1474037040 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8e20014070 con 0x7f8e30103690 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e2e800640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e140a1d40 0x7f8e140a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e1b000640 1 -- 172.21.15.8:0/4164027292 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c004780 con 0x55e992faa140 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e1b000640 1 -- 172.21.15.8:0/4164027292 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8e1c0048e0 con 0x55e992faa140 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.576+0000 7f8e1b000640 1 -- 172.21.15.8:0/4164027292 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c005070 con 0x55e992faa140 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.577+0000 7f8e37a0e740 1 -- 172.21.15.8:0/4164027292 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992faa140 msgr2=0x55e992fac530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.577+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/4164027292 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992faa140 0x55e992fac530 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c02c170 tx=0x7f8e1c02c5f0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.577+0000 7f8e2e800640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e140a1d40 0x7f8e140a4200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e280116b0 tx=0x7f8e28009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.577+0000 7f8e37a0e740 1 -- 172.21.15.8:0/4164027292 shutdown_connections 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.577+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/4164027292 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992faa140 0x55e992fac530 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.577+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/4164027292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992fa1560 0x55e992fa9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.577+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/4164027292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 0x55e992fa1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.577+0000 7f8e37a0e740 1 -- 172.21.15.8:0/4164027292 >> 172.21.15.8:0/4164027292 conn(0x55e992f9b370 msgr2=0x55e992f9b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.577+0000 7f8e37a0e740 1 -- 172.21.15.8:0/4164027292 shutdown_connections 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.577+0000 7f8e37a0e740 1 -- 172.21.15.8:0/4164027292 wait complete. 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.578+0000 7f8e37a0e740 1 -- start start 2024-03-16T20:59:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.578+0000 7f8e37a0e740 1 Processor -- start 2024-03-16T20:59:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.578+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 0x55e992fa71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.578+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992fa1560 0x55e992fa76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992faa140 0x55e992fa7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e992ead150 con 0x55e992fa0c40 2024-03-16T20:59:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e992eacdf0 con 0x55e992fa1560 2024-03-16T20:59:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e992c761c0 con 0x55e992faa140 2024-03-16T20:59:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e37a0e740 10 client.0 _ll_register_callbacks cb 0x55e992efc2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e2de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 0x55e992fa71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e2de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 0x55e992fa71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60336/0 (socket says 172.21.15.8:60336) 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e2de00640 1 -- 172.21.15.8:0/1241568578 learned_addr learned my addr 172.21.15.8:0/1241568578 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e2e800640 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992faa140 0x55e992fa7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e2d400640 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992fa1560 0x55e992fa76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e2de00640 1 -- 172.21.15.8:0/1241568578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992faa140 msgr2=0x55e992fa7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992faa140 0x55e992fa7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e2de00640 1 -- 172.21.15.8:0/1241568578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992fa1560 msgr2=0x55e992fa76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992fa1560 0x55e992fa76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e2de00640 1 -- 172.21.15.8:0/1241568578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e30110e60 con 0x55e992fa0c40 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 0x55e992fa71a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c6a0 tx=0x7f8e2000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b94ef050f639ee server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.579+0000 7f8e0f400640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e0f400640 1 -- 172.21.15.8:0/1241568578 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2009a290 con 0x55e992fa0c40 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e0f400640 1 -- 172.21.15.8:0/1241568578 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8e2009ae50 con 0x55e992fa0c40 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1241568578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e992c077e0 con 0x55e992fa0c40 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e0f400640 1 -- 172.21.15.8:0/1241568578 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e2009a0b0 con 0x55e992fa0c40 2024-03-16T20:59:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e37a0e740 10 client.15651 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1241568578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e992f065a0 con 0x55e992fa0c40 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e0f400640 1 -- 172.21.15.8:0/1241568578 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55e992c077e0 con 0x55e992fa0c40 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e0f400640 1 -- 172.21.15.8:0/1241568578 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f8e2001f060 con 0x55e992fa0c40 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e37a0e740 10 client.15651 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e37a0e740 10 client.15651 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e37a0e740 20 client.15651 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e992fba240 0x55e992fbc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e37a0e740 4 client.15651 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.580+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1241568578 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e992c44720 con 0x55e992fba240 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.581+0000 7f8e2d400640 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e992fba240 0x55e992fbc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.581+0000 7f8e2d400640 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e992fba240 0x55e992fbc630 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2d6c4c838c77e60 server_cookie=c672b3b90f22fa86 in_seq=0 out_seq=0 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.581+0000 7f8e0f400640 10 client.15651 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e0f400640 1 -- 172.21.15.8:0/1241568578 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55e992c44720 con 0x55e992fba240 2024-03-16T20:59:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e0f400640 10 client.15651 handle_command_reply: tid=0 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e37a0e740 1 client.15651 shutdown 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1241568578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 msgr2=0x55e992fa71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 0x55e992fa71a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c6a0 tx=0x7f8e2000cef0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1241568578 shutdown_connections 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e992fba240 0x55e992fbc630 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992faa140 0x55e992fa7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992fa1560 0x55e992fa76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1241568578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa0c40 0x55e992fa71a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1241568578 >> 172.21.15.8:0/1241568578 conn(0x55e992f9b370 msgr2=0x55e992f9d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e0f400640 0 client.15651 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1241568578 shutdown_connections 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.582+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1241568578 wait complete. 2024-03-16T20:59:16.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.583+0000 7f8e37a0e740 20 client.15651 trim_cache size 0 max 16384 2024-03-16T20:59:16.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.596+0000 7f8e37a0e740 1 Processor -- start 2024-03-16T20:59:16.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.596+0000 7f8e37a0e740 1 -- start start 2024-03-16T20:59:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.596+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.596+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa1560 0x55e992fa7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.596+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992faa140 0x55e992fb5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.596+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e992f96cb0 con 0x55e992fa1560 2024-03-16T20:59:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e992f9c370 con 0x55e992faa140 2024-03-16T20:59:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e992fa03e0 con 0x55e992fa0c40 2024-03-16T20:59:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992faa140 0x55e992fb5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:37064/0 (socket says 172.21.15.8:37064) 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2de00640 1 -- 172.21.15.8:0/1932894232 learned_addr learned my addr 172.21.15.8:0/1932894232 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2d400640 1 --2- 172.21.15.8:0/1932894232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa1560 0x55e992fa7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2de00640 1 -- 172.21.15.8:0/1932894232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992faa140 msgr2=0x55e992fb5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1932894232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992faa140 0x55e992fb5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2de00640 1 -- 172.21.15.8:0/1932894232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa1560 msgr2=0x55e992fa7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1932894232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa1560 0x55e992fa7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2de00640 1 -- 172.21.15.8:0/1932894232 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e992ea2ab0 con 0x55e992fa0c40 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2e800640 1 --2- 172.21.15.8:0/1932894232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992faa140 0x55e992fb5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.597+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1932894232 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa98d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8e2009a6e0 tx=0x7f8e20005e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f82e8ba10eeb903f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e1a600640 1 -- 172.21.15.8:0/1932894232 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e200cb280 con 0x55e992fa0c40 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e1a600640 1 -- 172.21.15.8:0/1932894232 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8e200d1080 con 0x55e992fa0c40 2024-03-16T20:59:16.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e1a600640 1 -- 172.21.15.8:0/1932894232 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2009e8a0 con 0x55e992fa0c40 2024-03-16T20:59:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1932894232 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 msgr2=0x55e992fa98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1932894232 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa98d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8e2009a6e0 tx=0x7f8e20005e70 comp rx=0 tx=0).stop 2024-03-16T20:59:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1932894232 shutdown_connections 2024-03-16T20:59:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1932894232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992faa140 0x55e992fb5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1932894232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa1560 0x55e992fa7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1932894232 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa98d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1932894232 >> 172.21.15.8:0/1932894232 conn(0x55e992f9b370 msgr2=0x55e992f9a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1932894232 shutdown_connections 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.598+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1932894232 wait complete. 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.599+0000 7f8e37a0e740 1 -- start start 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.599+0000 7f8e37a0e740 1 Processor -- start 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.599+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.599+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa1560 0x55e992fa4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.599+0000 7f8e37a0e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992faa140 0x55e99300daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99300e170 con 0x55e992fa1560 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99300e2e0 con 0x55e992faa140 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e37a0e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99300e4a0 con 0x55e992fa0c40 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e37a0e740 10 client.0 _ll_register_callbacks cb 0x7f8e20096330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e2de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e2de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:37066/0 (socket says 172.21.15.8:37066) 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e2e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992faa140 0x55e99300daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e2de00640 1 -- 172.21.15.8:0/1444108320 learned_addr learned my addr 172.21.15.8:0/1444108320 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e2d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa1560 0x55e992fa4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e2de00640 1 -- 172.21.15.8:0/1444108320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992faa140 msgr2=0x55e99300daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1444108320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992faa140 0x55e99300daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e2de00640 1 -- 172.21.15.8:0/1444108320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa1560 msgr2=0x55e992fa4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1444108320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa1560 0x55e992fa4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e2de00640 1 -- 172.21.15.8:0/1444108320 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e280111a0 con 0x55e992fa0c40 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e2de00640 1 --2- 172.21.15.8:0/1444108320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa4450 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000e9c0 tx=0x7f8e200d1630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4834628badbb725 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.600+0000 7f8e0f400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e0f400640 1 -- 172.21.15.8:0/1444108320 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e200d1090 con 0x55e992fa0c40 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1444108320 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e992c93890 con 0x55e992fa0c40 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e0f400640 1 -- 172.21.15.8:0/1444108320 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8e2009ae50 con 0x55e992fa0c40 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e0f400640 1 -- 172.21.15.8:0/1444108320 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e2009a290 con 0x55e992fa0c40 2024-03-16T20:59:16.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e37a0e740 10 client.25825 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1444108320 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e992f065a0 con 0x55e992fa0c40 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e0f400640 1 -- 172.21.15.8:0/1444108320 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55e992c93890 con 0x55e992fa0c40 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e0f400640 1 -- 172.21.15.8:0/1444108320 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f8e200a7020 con 0x55e992fa0c40 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e37a0e740 10 client.25825 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e37a0e740 10 client.25825 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e37a0e740 20 client.25825 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1444108320 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e993016800 0x55e993018bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e37a0e740 4 client.25825 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1444108320 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e992bf64e0 con 0x55e993016800 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.601+0000 7f8e2d400640 1 --2- 172.21.15.8:0/1444108320 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e993016800 0x55e993018bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e2d400640 1 --2- 172.21.15.8:0/1444108320 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e993016800 0x55e993018bf0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=139580f5aa353d34 server_cookie=1ac2ced46c26e407 in_seq=0 out_seq=0 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e0f400640 10 client.25825 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e0f400640 1 -- 172.21.15.8:0/1444108320 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e992bf64e0 con 0x55e993016800 2024-03-16T20:59:16.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e0f400640 10 client.25825 handle_command_reply: tid=0 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e37a0e740 1 client.25825 shutdown 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1444108320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 msgr2=0x55e992fa4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1444108320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa4450 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000e9c0 tx=0x7f8e200d1630 comp rx=0 tx=0).stop 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1444108320 shutdown_connections 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1444108320 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e993016800 0x55e993018bf0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1444108320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e992faa140 0x55e99300daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1444108320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e992fa1560 0x55e992fa4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e37a0e740 1 --2- 172.21.15.8:0/1444108320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e992fa0c40 0x55e992fa4450 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e0f400640 0 client.25825 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1444108320 >> 172.21.15.8:0/1444108320 conn(0x55e992f9b370 msgr2=0x55e992f99be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1444108320 shutdown_connections 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.602+0000 7f8e37a0e740 1 -- 172.21.15.8:0/1444108320 wait complete. 2024-03-16T20:59:16.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e37a0e740 20 client.25825 trim_cache size 0 max 16384 2024-03-16T20:59:16.612 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:59:16.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 -- 172.21.15.8:0/1474037040 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e140a1d40 msgr2=0x7f8e140a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e140a1d40 0x7f8e140a4200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e280116b0 tx=0x7f8e28009500 comp rx=0 tx=0).stop 2024-03-16T20:59:16.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 -- 172.21.15.8:0/1474037040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e30103690 msgr2=0x7f8e30199e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e30103690 0x7f8e30199e60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000e9f0 tx=0x7f8e2000edf0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 -- 172.21.15.8:0/1474037040 shutdown_connections 2024-03-16T20:59:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e140a1d40 0x7f8e140a4200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e301096a0 0x7f8e3019e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30104050 0x7f8e3019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 --2- 172.21.15.8:0/1474037040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e30103690 0x7f8e30199e60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 -- 172.21.15.8:0/1474037040 >> 172.21.15.8:0/1474037040 conn(0x7f8e300ff140 msgr2=0x7f8e300ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 -- 172.21.15.8:0/1474037040 shutdown_connections 2024-03-16T20:59:16.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.603+0000 7f8e34c00640 1 -- 172.21.15.8:0/1474037040 wait complete. 2024-03-16T20:59:16.621 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:16 smithi008 ceph-mon[31434]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-16T20:59:16.621 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:16 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2191727551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:59:16.623 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:59:16.624 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T20:59:16.774 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-16T20:59:16.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.832+0000 7f71ad200640 1 -- 172.21.15.8:0/2629125539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a8109650 msgr2=0x7f71a8109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.832+0000 7f71ad200640 1 --2- 172.21.15.8:0/2629125539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a8109650 0x7f71a8109a30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7198009930 tx=0x7f719802bc20 comp rx=0 tx=0).stop 2024-03-16T20:59:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.832+0000 7f71ad200640 1 -- 172.21.15.8:0/2629125539 shutdown_connections 2024-03-16T20:59:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.832+0000 7f71ad200640 1 --2- 172.21.15.8:0/2629125539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71a8103f50 0x7f71a8110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.832+0000 7f71ad200640 1 --2- 172.21.15.8:0/2629125539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71a8103590 0x7f71a8103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.832+0000 7f71ad200640 1 --2- 172.21.15.8:0/2629125539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a8109650 0x7f71a8109a30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.832+0000 7f71ad200640 1 -- 172.21.15.8:0/2629125539 >> 172.21.15.8:0/2629125539 conn(0x7f71a80ff000 msgr2=0x7f71a8101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.832+0000 7f71ad200640 1 -- 172.21.15.8:0/2629125539 shutdown_connections 2024-03-16T20:59:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.832+0000 7f71ad200640 1 -- 172.21.15.8:0/2629125539 wait complete. 2024-03-16T20:59:16.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.834+0000 7f71ad200640 1 Processor -- start 2024-03-16T20:59:16.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.834+0000 7f71ad200640 1 -- start start 2024-03-16T20:59:16.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.835+0000 7f71ad200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71a8103590 0x7f71a819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.835+0000 7f71ad200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71a8103f50 0x7f71a819ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.835+0000 7f71ad200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a8109650 0x7f71a8199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.835+0000 7f71ad200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a819a310 con 0x7f71a8103f50 2024-03-16T20:59:16.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.835+0000 7f71ad200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a819a480 con 0x7f71a8109650 2024-03-16T20:59:16.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.835+0000 7f71ad200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a819a640 con 0x7f71a8103590 2024-03-16T20:59:16.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.835+0000 7f71a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71a8103590 0x7f71a819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.835+0000 7f71a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71a8103590 0x7f71a819fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:37076/0 (socket says 172.21.15.8:37076) 2024-03-16T20:59:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.835+0000 7f71a7400640 1 -- 172.21.15.8:0/926064053 learned_addr learned my addr 172.21.15.8:0/926064053 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.835+0000 7f719fe00640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71a8103f50 0x7f71a819ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.835+0000 7f71a7e00640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a8109650 0x7f71a8199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.836+0000 7f71a7400640 1 -- 172.21.15.8:0/926064053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a8109650 msgr2=0x7f71a8199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.836+0000 7f71a7400640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a8109650 0x7f71a8199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.836+0000 7f71a7400640 1 -- 172.21.15.8:0/926064053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71a8103f50 msgr2=0x7f71a819ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.836+0000 7f71a7400640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71a8103f50 0x7f71a819ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.836+0000 7f71a7400640 1 -- 172.21.15.8:0/926064053 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7198009560 con 0x7f71a8103590 2024-03-16T20:59:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.836+0000 7f71a7400640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71a8103590 0x7f71a819fa70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7198005ab0 tx=0x7f719802cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.836+0000 7f71a4c00640 1 -- 172.21.15.8:0/926064053 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198004250 con 0x7f71a8103590 2024-03-16T20:59:16.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.836+0000 7f71a4c00640 1 -- 172.21.15.8:0/926064053 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f71980043b0 con 0x7f71a8103590 2024-03-16T20:59:16.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.836+0000 7f71a4c00640 1 -- 172.21.15.8:0/926064053 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198003be0 con 0x7f71a8103590 2024-03-16T20:59:16.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.836+0000 7f71ad200640 1 -- 172.21.15.8:0/926064053 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a819a8c0 con 0x7f71a8103590 2024-03-16T20:59:16.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.837+0000 7f71ad200640 1 -- 172.21.15.8:0/926064053 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a81a69f0 con 0x7f71a8103590 2024-03-16T20:59:16.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.840+0000 7f71a4c00640 1 -- 172.21.15.8:0/926064053 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f7198003d40 con 0x7f71a8103590 2024-03-16T20:59:16.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.841+0000 7f71a4c00640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f718c0a1d40 0x7f718c0a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.841+0000 7f71a4c00640 1 -- 172.21.15.8:0/926064053 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f71980efeb0 con 0x7f71a8103590 2024-03-16T20:59:16.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.841+0000 7f71b1122740 1 Processor -- start 2024-03-16T20:59:16.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.841+0000 7f719fe00640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f718c0a1d40 0x7f718c0a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.841+0000 7f71b1122740 1 -- start start 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f71b1122740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a5cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f719fe00640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f718c0a1d40 0x7f718c0a4200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71a819b310 tx=0x7f7190005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f71b1122740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 0x564e7a5d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f71b1122740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5d42f0 0x564e7a5d66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f71b1122740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a539210 con 0x564e7a5cb710 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f71b1122740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a536740 con 0x564e7a5cadf0 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f71b1122740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a531f20 con 0x564e7a5d42f0 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f71a7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a5cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f71a7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a5cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35708/0 (socket says 172.21.15.8:35708) 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f71a7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5d42f0 0x564e7a5d66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f71a7400640 1 -- 172.21.15.8:0/116194024 learned_addr learned my addr 172.21.15.8:0/116194024 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.842+0000 7f719fe00640 1 --2- 172.21.15.8:0/116194024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 0x564e7a5d3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.843+0000 7f71a7400640 1 -- 172.21.15.8:0/116194024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5d42f0 msgr2=0x564e7a5d66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.843+0000 7f71a7400640 1 --2- 172.21.15.8:0/116194024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5d42f0 0x564e7a5d66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.843+0000 7f71a7400640 1 -- 172.21.15.8:0/116194024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 msgr2=0x564e7a5d3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.843+0000 7f71a7400640 1 --2- 172.21.15.8:0/116194024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 0x564e7a5d3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.843+0000 7f71a7400640 1 -- 172.21.15.8:0/116194024 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e7a4f3df0 con 0x564e7a5cadf0 2024-03-16T20:59:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.843+0000 7f719fe00640 1 --2- 172.21.15.8:0/116194024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 0x564e7a5d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.843+0000 7f71a7400640 1 --2- 172.21.15.8:0/116194024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a5cb1d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7198009900 tx=0x7f7198003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20068e881cd56f76 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.843+0000 7f719cc00640 1 -- 172.21.15.8:0/116194024 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980bc970 con 0x564e7a5cadf0 2024-03-16T20:59:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.843+0000 7f719cc00640 1 -- 172.21.15.8:0/116194024 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f71980c0ac0 con 0x564e7a5cadf0 2024-03-16T20:59:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.843+0000 7f719cc00640 1 -- 172.21.15.8:0/116194024 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980d5410 con 0x564e7a5cadf0 2024-03-16T20:59:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.844+0000 7f71b1122740 1 -- 172.21.15.8:0/116194024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 msgr2=0x564e7a5cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.844+0000 7f71b1122740 1 --2- 172.21.15.8:0/116194024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a5cb1d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7198009900 tx=0x7f7198003680 comp rx=0 tx=0).stop 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.844+0000 7f71b1122740 1 -- 172.21.15.8:0/116194024 shutdown_connections 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.844+0000 7f71b1122740 1 --2- 172.21.15.8:0/116194024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5d42f0 0x564e7a5d66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.844+0000 7f71b1122740 1 --2- 172.21.15.8:0/116194024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 0x564e7a5d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.844+0000 7f71b1122740 1 --2- 172.21.15.8:0/116194024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a5cb1d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.844+0000 7f71b1122740 1 -- 172.21.15.8:0/116194024 >> 172.21.15.8:0/116194024 conn(0x564e7a5c5520 msgr2=0x564e7a5c5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.844+0000 7f71b1122740 1 -- 172.21.15.8:0/116194024 shutdown_connections 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.844+0000 7f71b1122740 1 -- 172.21.15.8:0/116194024 wait complete. 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.845+0000 7f71b1122740 1 -- start start 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.845+0000 7f71b1122740 1 Processor -- start 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.845+0000 7f71b1122740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 0x564e7a5d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71b1122740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 0x564e7a5d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71b1122740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5d42f0 0x564e7a5d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71b1122740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a4d7150 con 0x564e7a5cb710 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71b1122740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a4d6df0 con 0x564e7a5d42f0 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71b1122740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a2a01c0 con 0x564e7a5cadf0 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71b1122740 10 client.0 _ll_register_callbacks cb 0x564e7a5262b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 0x564e7a5d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 0x564e7a5d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:37098/0 (socket says 172.21.15.8:37098) 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71a7400640 1 -- 172.21.15.8:0/828078727 learned_addr learned my addr 172.21.15.8:0/828078727 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f719fe00640 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 0x564e7a5d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71a7e00640 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5d42f0 0x564e7a5d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71a7400640 1 -- 172.21.15.8:0/828078727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5d42f0 msgr2=0x564e7a5d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71a7400640 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5d42f0 0x564e7a5d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71a7400640 1 -- 172.21.15.8:0/828078727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 msgr2=0x564e7a5d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71a7400640 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 0x564e7a5d18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f71a7400640 1 -- 172.21.15.8:0/828078727 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a81a69f0 con 0x564e7a5cadf0 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.846+0000 7f719fe00640 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 0x564e7a5d18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.847+0000 7f71a7400640 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 0x564e7a5d1390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f71980c4be0 tx=0x7f71980056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4b92b3a7ea93b92 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.847+0000 7f7195600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.847+0000 7f7195600640 1 -- 172.21.15.8:0/828078727 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980c5110 con 0x564e7a5cadf0 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.847+0000 7f7195600640 1 -- 172.21.15.8:0/828078727 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f71980bc970 con 0x564e7a5cadf0 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.847+0000 7f71b1122740 1 -- 172.21.15.8:0/828078727 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e7a2317e0 con 0x564e7a5cadf0 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.847+0000 7f7195600640 1 -- 172.21.15.8:0/828078727 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71980d5420 con 0x564e7a5cadf0 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.847+0000 7f71b1122740 10 client.25837 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.847+0000 7f71b1122740 1 -- 172.21.15.8:0/828078727 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x564e7a5305a0 con 0x564e7a5cadf0 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.847+0000 7f7195600640 1 -- 172.21.15.8:0/828078727 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x564e7a2317e0 con 0x564e7a5cadf0 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.848+0000 7f7195600640 1 -- 172.21.15.8:0/828078727 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f71980edd20 con 0x564e7a5cadf0 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.848+0000 7f71b1122740 10 client.25837 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.848+0000 7f71b1122740 10 client.25837 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.848+0000 7f71b1122740 20 client.25837 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:16.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.848+0000 7f71b1122740 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x564e7a5e3c10 0x564e7a5e6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.848+0000 7f71b1122740 4 client.25837 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:16.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.848+0000 7f71b1122740 1 -- 172.21.15.8:0/828078727 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e7a26e720 con 0x564e7a5e3c10 2024-03-16T20:59:16.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.848+0000 7f719fe00640 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x564e7a5e3c10 0x564e7a5e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.849+0000 7f7195600640 10 client.25837 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:59:16.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.849+0000 7f719fe00640 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x564e7a5e3c10 0x564e7a5e6000 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97b3a31c466722e4 server_cookie=67c21f43d41e46af in_seq=0 out_seq=0 2024-03-16T20:59:16.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f7195600640 1 -- 172.21.15.8:0/828078727 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x564e7a26e720 con 0x564e7a5e3c10 2024-03-16T20:59:16.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f7195600640 10 client.25837 handle_command_reply: tid=0 2024-03-16T20:59:16.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 1 client.25837 shutdown 2024-03-16T20:59:16.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 1 -- 172.21.15.8:0/828078727 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 msgr2=0x564e7a5d1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 0x564e7a5d1390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f71980c4be0 tx=0x7f71980056d0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 1 -- 172.21.15.8:0/828078727 shutdown_connections 2024-03-16T20:59:16.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x564e7a5e3c10 0x564e7a5e6000 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5d42f0 0x564e7a5d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f7195600640 0 client.25837 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:59:16.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5cb710 0x564e7a5d18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 1 --2- 172.21.15.8:0/828078727 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 0x564e7a5d1390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 1 -- 172.21.15.8:0/828078727 >> 172.21.15.8:0/828078727 conn(0x564e7a5c5520 msgr2=0x564e7a5c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 1 -- 172.21.15.8:0/828078727 shutdown_connections 2024-03-16T20:59:16.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 1 -- 172.21.15.8:0/828078727 wait complete. 2024-03-16T20:59:16.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.850+0000 7f71b1122740 20 client.25837 trim_cache size 0 max 16384 2024-03-16T20:59:16.859 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-16T20:59:16.864 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-16T20:59:16.864 INFO:tasks.workunit.client.0.smithi008.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-16T20:59:16.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:16 smithi170 ceph-mon[35947]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-16T20:59:16.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:16 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2191727551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:59:16.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.864+0000 7f71b1122740 1 Processor -- start 2024-03-16T20:59:16.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.864+0000 7f71b1122740 1 -- start start 2024-03-16T20:59:16.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f71b1122740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 0x564e7a5c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f71b1122740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cb710 0x564e7a5d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f71b1122740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5d42f0 0x564e7a5c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f71b1122740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a5ccfc0 con 0x564e7a5d42f0 2024-03-16T20:59:16.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f71b1122740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a5c6520 con 0x564e7a5cb710 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f71b1122740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a5e0c10 con 0x564e7a5cadf0 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f719fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cb710 0x564e7a5d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f71a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 0x564e7a5c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f719fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cb710 0x564e7a5d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35716/0 (socket says 172.21.15.8:35716) 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f719fe00640 1 -- 172.21.15.8:0/1635598152 learned_addr learned my addr 172.21.15.8:0/1635598152 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f71a7e00640 1 --2- 172.21.15.8:0/1635598152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5d42f0 0x564e7a5c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f719fe00640 1 -- 172.21.15.8:0/1635598152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 msgr2=0x564e7a5c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.865+0000 7f719fe00640 1 --2- 172.21.15.8:0/1635598152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 0x564e7a5c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.866+0000 7f719fe00640 1 -- 172.21.15.8:0/1635598152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5d42f0 msgr2=0x564e7a5c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.866+0000 7f719fe00640 1 --2- 172.21.15.8:0/1635598152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5d42f0 0x564e7a5c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.866+0000 7f719fe00640 1 -- 172.21.15.8:0/1635598152 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e7a5c4dc0 con 0x564e7a5cb710 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.866+0000 7f71a7400640 1 --2- 172.21.15.8:0/1635598152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 0x564e7a5c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.866+0000 7f71a7e00640 1 --2- 172.21.15.8:0/1635598152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5d42f0 0x564e7a5c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:16.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.866+0000 7f719fe00640 1 --2- 172.21.15.8:0/1635598152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cb710 0x564e7a5d1c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x564e7a5ca8c0 tx=0x7f7190014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7941e8ebc7679c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.866+0000 7f7197e00640 1 -- 172.21.15.8:0/1635598152 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190030070 con 0x564e7a5cb710 2024-03-16T20:59:16.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.866+0000 7f7197e00640 1 -- 172.21.15.8:0/1635598152 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7190025040 con 0x564e7a5cb710 2024-03-16T20:59:16.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.866+0000 7f7197e00640 1 -- 172.21.15.8:0/1635598152 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190023040 con 0x564e7a5cb710 2024-03-16T20:59:16.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.867+0000 7f71b1122740 1 -- 172.21.15.8:0/1635598152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cb710 msgr2=0x564e7a5d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.867+0000 7f71b1122740 1 --2- 172.21.15.8:0/1635598152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cb710 0x564e7a5d1c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x564e7a5ca8c0 tx=0x7f7190014000 comp rx=0 tx=0).stop 2024-03-16T20:59:16.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.867+0000 7f71b1122740 1 -- 172.21.15.8:0/1635598152 shutdown_connections 2024-03-16T20:59:16.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.867+0000 7f71b1122740 1 --2- 172.21.15.8:0/1635598152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5d42f0 0x564e7a5c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.867+0000 7f71b1122740 1 --2- 172.21.15.8:0/1635598152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cb710 0x564e7a5d1c30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.867+0000 7f71b1122740 1 --2- 172.21.15.8:0/1635598152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cadf0 0x564e7a5c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.867+0000 7f71b1122740 1 -- 172.21.15.8:0/1635598152 >> 172.21.15.8:0/1635598152 conn(0x564e7a5c5520 msgr2=0x564e7a5c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.867+0000 7f71b1122740 1 -- 172.21.15.8:0/1635598152 shutdown_connections 2024-03-16T20:59:16.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.867+0000 7f71b1122740 1 -- 172.21.15.8:0/1635598152 wait complete. 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.867+0000 7f71b1122740 1 -- start start 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71b1122740 1 Processor -- start 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71b1122740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a6376c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71b1122740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cb710 0x564e7a637c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71b1122740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5d42f0 0x564e7a5d7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71b1122740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a5d8210 con 0x564e7a5d42f0 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71b1122740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a5d8380 con 0x564e7a5cadf0 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71b1122740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a5d8540 con 0x564e7a5cb710 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71b1122740 10 client.0 _ll_register_callbacks cb 0x7f71980d3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71a7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a6376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f719fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cb710 0x564e7a637c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71a7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a6376c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35726/0 (socket says 172.21.15.8:35726) 2024-03-16T20:59:16.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71a7400640 1 -- 172.21.15.8:0/193121052 learned_addr learned my addr 172.21.15.8:0/193121052 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.868+0000 7f71a7e00640 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5d42f0 0x564e7a5d7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.869+0000 7f719fe00640 1 -- 172.21.15.8:0/193121052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 msgr2=0x564e7a6376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.869+0000 7f719fe00640 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a6376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.869+0000 7f719fe00640 1 -- 172.21.15.8:0/193121052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5d42f0 msgr2=0x564e7a5d7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.869+0000 7f719fe00640 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5d42f0 0x564e7a5d7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.869+0000 7f719fe00640 1 -- 172.21.15.8:0/193121052 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719809f030 con 0x564e7a5cb710 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.869+0000 7f71a7400640 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a6376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.869+0000 7f719fe00640 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cb710 0x564e7a637c00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x564e7a5c5f70 tx=0x7f7190011a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fe103807bd77fa6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.869+0000 7f7195600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.869+0000 7f7195600640 1 -- 172.21.15.8:0/193121052 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190030040 con 0x564e7a5cb710 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f7195600640 1 -- 172.21.15.8:0/193121052 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f719002b960 con 0x564e7a5cb710 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f71b1122740 1 -- 172.21.15.8:0/193121052 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71980c0ac0 con 0x564e7a5cb710 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f7195600640 1 -- 172.21.15.8:0/193121052 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7190023040 con 0x564e7a5cb710 2024-03-16T20:59:16.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f71b1122740 10 client.25843 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:16.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f71b1122740 1 -- 172.21.15.8:0/193121052 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f7190017070 con 0x564e7a5cb710 2024-03-16T20:59:16.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f7195600640 1 -- 172.21.15.8:0/193121052 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f71980c0ac0 con 0x564e7a5cb710 2024-03-16T20:59:16.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f7195600640 1 -- 172.21.15.8:0/193121052 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f7190034400 con 0x564e7a5cb710 2024-03-16T20:59:16.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f71b1122740 10 client.25843 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:16.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f71b1122740 10 client.25843 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T20:59:16.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f71b1122740 20 client.25843 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:16.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f71b1122740 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x564e7a640620 0x564e7a642a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:16.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f71b1122740 4 client.25843 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:59:16.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.870+0000 7f71b1122740 1 -- 172.21.15.8:0/193121052 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564e7a2bd890 con 0x564e7a640620 2024-03-16T20:59:16.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.871+0000 7f71a7400640 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x564e7a640620 0x564e7a642a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:16.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.871+0000 7f71a7400640 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x564e7a640620 0x564e7a642a40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ff646cacb6a7c91d server_cookie=9c593a2edabb0b in_seq=0 out_seq=0 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.871+0000 7f7195600640 10 client.25843 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.871+0000 7f7195600640 1 -- 172.21.15.8:0/193121052 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564e7a2bd890 con 0x564e7a640620 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.871+0000 7f7195600640 10 client.25843 handle_command_reply: tid=0 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.871+0000 7f71b1122740 1 client.25843 shutdown 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f71b1122740 1 -- 172.21.15.8:0/193121052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cb710 msgr2=0x564e7a637c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f71b1122740 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cb710 0x564e7a637c00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x564e7a5c5f70 tx=0x7f7190011a20 comp rx=0 tx=0).stop 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f71b1122740 1 -- 172.21.15.8:0/193121052 shutdown_connections 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f71b1122740 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x564e7a640620 0x564e7a642a40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f71b1122740 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e7a5d42f0 0x564e7a5d7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f71b1122740 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7a5cb710 0x564e7a637c00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f71b1122740 1 --2- 172.21.15.8:0/193121052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e7a5cadf0 0x564e7a6376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f7195600640 0 client.25843 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f71b1122740 1 -- 172.21.15.8:0/193121052 >> 172.21.15.8:0/193121052 conn(0x564e7a5c5520 msgr2=0x564e7a5c6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f71b1122740 1 -- 172.21.15.8:0/193121052 shutdown_connections 2024-03-16T20:59:16.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f71b1122740 1 -- 172.21.15.8:0/193121052 wait complete. 2024-03-16T20:59:16.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.872+0000 7f71b1122740 20 client.25843 trim_cache size 0 max 16384 2024-03-16T20:59:16.881 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:59:16.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 -- 172.21.15.8:0/926064053 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f718c0a1d40 msgr2=0x7f718c0a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f718c0a1d40 0x7f718c0a4200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71a819b310 tx=0x7f7190005f90 comp rx=0 tx=0).stop 2024-03-16T20:59:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 -- 172.21.15.8:0/926064053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71a8103590 msgr2=0x7f71a819fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71a8103590 0x7f71a819fa70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7198005ab0 tx=0x7f719802cc10 comp rx=0 tx=0).stop 2024-03-16T20:59:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 -- 172.21.15.8:0/926064053 shutdown_connections 2024-03-16T20:59:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f718c0a1d40 0x7f718c0a4200 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a8109650 0x7f71a8199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71a8103f50 0x7f71a819ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 --2- 172.21.15.8:0/926064053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71a8103590 0x7f71a819fa70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 -- 172.21.15.8:0/926064053 >> 172.21.15.8:0/926064053 conn(0x7f71a80ff000 msgr2=0x7f71a8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 -- 172.21.15.8:0/926064053 shutdown_connections 2024-03-16T20:59:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:16.873+0000 7f71ad200640 1 -- 172.21.15.8:0/926064053 wait complete. 2024-03-16T20:59:16.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:16 smithi186 ceph-mon[36391]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-16T20:59:16.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:16 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2191727551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:59:16.894 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:59:16.894 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T20:59:16.948 INFO:tasks.workunit.client.0.smithi008.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-16T20:59:16.956 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T20:59:16.956 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-16T20:59:17.001 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-03-16T20:59:17.003 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-03-16T20:59:17.003 DEBUG:teuthology.orchestra.run.smithi008:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-03-16T20:59:17.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.093+0000 7f49a8000640 1 -- 172.21.15.8:0/3395560681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49a01096a0 msgr2=0x7f49a0109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:17.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.093+0000 7f49a8000640 1 --2- 172.21.15.8:0/3395560681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49a01096a0 0x7f49a0109a80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4994009930 tx=0x7f499402bc30 comp rx=0 tx=0).stop 2024-03-16T20:59:17.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.093+0000 7f49a8000640 1 -- 172.21.15.8:0/3395560681 shutdown_connections 2024-03-16T20:59:17.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.093+0000 7f49a8000640 1 --2- 172.21.15.8:0/3395560681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49a0104050 0x7f49a0110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.093+0000 7f49a8000640 1 --2- 172.21.15.8:0/3395560681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a0103690 0x7f49a0103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.093+0000 7f49a8000640 1 --2- 172.21.15.8:0/3395560681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49a01096a0 0x7f49a0109a80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.093+0000 7f49a8000640 1 -- 172.21.15.8:0/3395560681 >> 172.21.15.8:0/3395560681 conn(0x7f49a00ff1a0 msgr2=0x7f49a01015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:17.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.094+0000 7f49a8000640 1 -- 172.21.15.8:0/3395560681 shutdown_connections 2024-03-16T20:59:17.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.094+0000 7f49a8000640 1 -- 172.21.15.8:0/3395560681 wait complete. 2024-03-16T20:59:17.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.094+0000 7f49a8000640 1 Processor -- start 2024-03-16T20:59:17.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a8000640 1 -- start start 2024-03-16T20:59:17.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a8000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a0103690 0x7f49a0199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a8000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49a0104050 0x7f49a019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a8000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49a01096a0 0x7f49a019e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a8000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a019ecf0 con 0x7f49a01096a0 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a8000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a019ee60 con 0x7f49a0103690 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a8000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a019f020 con 0x7f49a0104050 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a5600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a0103690 0x7f49a0199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a5600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a0103690 0x7f49a0199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35746/0 (socket says 172.21.15.8:35746) 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a5600640 1 -- 172.21.15.8:0/141114615 learned_addr learned my addr 172.21.15.8:0/141114615 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a4c00640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49a0104050 0x7f49a019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.095+0000 7f49a6000640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49a01096a0 0x7f49a019e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.096+0000 7f49a5600640 1 -- 172.21.15.8:0/141114615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49a0104050 msgr2=0x7f49a019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.096+0000 7f49a5600640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49a0104050 0x7f49a019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.096+0000 7f49a5600640 1 -- 172.21.15.8:0/141114615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49a01096a0 msgr2=0x7f49a019e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.096+0000 7f49a5600640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49a01096a0 0x7f49a019e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.096+0000 7f49a5600640 1 -- 172.21.15.8:0/141114615 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4994009560 con 0x7f49a0103690 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.096+0000 7f49a4c00640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49a0104050 0x7f49a019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:17.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.096+0000 7f49a5600640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a0103690 0x7f49a0199e80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4994000c00 tx=0x7f499402cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:17.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.096+0000 7f499e000640 1 -- 172.21.15.8:0/141114615 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994004250 con 0x7f49a0103690 2024-03-16T20:59:17.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.096+0000 7f499e000640 1 -- 172.21.15.8:0/141114615 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f49940043b0 con 0x7f49a0103690 2024-03-16T20:59:17.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.096+0000 7f499e000640 1 -- 172.21.15.8:0/141114615 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994003be0 con 0x7f49a0103690 2024-03-16T20:59:17.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.096+0000 7f49a8000640 1 -- 172.21.15.8:0/141114615 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a019f2a0 con 0x7f49a0103690 2024-03-16T20:59:17.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.097+0000 7f49a8000640 1 -- 172.21.15.8:0/141114615 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a01a6b80 con 0x7f49a0103690 2024-03-16T20:59:17.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.100+0000 7f49aaddd740 1 Processor -- start 2024-03-16T20:59:17.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.100+0000 7f49aaddd740 1 -- start start 2024-03-16T20:59:17.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.100+0000 7f499e000640 1 -- 172.21.15.8:0/141114615 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f4994003d40 con 0x7f49a0103690 2024-03-16T20:59:17.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.100+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96ec40 0x563a0c96f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.100+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c977c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.100+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c978140 0x563a0c97a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.100+0000 7f49aaddd740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c8dd210 con 0x563a0c96f560 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.100+0000 7f49aaddd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c8da740 con 0x563a0c96ec40 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.100+0000 7f49aaddd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c8d5f20 con 0x563a0c978140 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.101+0000 7f49a6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96ec40 0x563a0c96f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.101+0000 7f49a5600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c977c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.101+0000 7f49a6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96ec40 0x563a0c96f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35758/0 (socket says 172.21.15.8:35758) 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.101+0000 7f49a6000640 1 -- 172.21.15.8:0/216894617 learned_addr learned my addr 172.21.15.8:0/216894617 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.101+0000 7f49a4c00640 1 --2- 172.21.15.8:0/216894617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c978140 0x563a0c97a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.101+0000 7f49a6000640 1 -- 172.21.15.8:0/216894617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c978140 msgr2=0x563a0c97a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.101+0000 7f49a6000640 1 --2- 172.21.15.8:0/216894617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c978140 0x563a0c97a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.101+0000 7f49a6000640 1 -- 172.21.15.8:0/216894617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 msgr2=0x563a0c977c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:17.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.101+0000 7f49a6000640 1 --2- 172.21.15.8:0/216894617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c977c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.101+0000 7f49a6000640 1 -- 172.21.15.8:0/216894617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a0c897df0 con 0x563a0c96ec40 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.101+0000 7f49a6000640 1 --2- 172.21.15.8:0/216894617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96ec40 0x563a0c96f020 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4998009f40 tx=0x7f4998010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8060d078a6ac3b8f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.102+0000 7f4992600640 1 -- 172.21.15.8:0/216894617 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998009a90 con 0x563a0c96ec40 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.102+0000 7f4992600640 1 -- 172.21.15.8:0/216894617 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4998015070 con 0x563a0c96ec40 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.102+0000 7f4992600640 1 -- 172.21.15.8:0/216894617 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998011880 con 0x563a0c96ec40 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.102+0000 7f499e000640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f49880a1d40 0x7f49880a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.102+0000 7f499e000640 1 -- 172.21.15.8:0/141114615 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f49940effa0 con 0x7f49a0103690 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.102+0000 7f49a5600640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f49880a1d40 0x7f49880a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.102+0000 7f49aaddd740 1 -- 172.21.15.8:0/216894617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96ec40 msgr2=0x563a0c96f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.102+0000 7f49aaddd740 1 --2- 172.21.15.8:0/216894617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96ec40 0x563a0c96f020 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4998009f40 tx=0x7f4998010860 comp rx=0 tx=0).stop 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.103+0000 7f49aaddd740 1 -- 172.21.15.8:0/216894617 shutdown_connections 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.103+0000 7f49aaddd740 1 --2- 172.21.15.8:0/216894617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c978140 0x563a0c97a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.103+0000 7f49aaddd740 1 --2- 172.21.15.8:0/216894617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c977c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.103+0000 7f49aaddd740 1 --2- 172.21.15.8:0/216894617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96ec40 0x563a0c96f020 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.103+0000 7f49aaddd740 1 -- 172.21.15.8:0/216894617 >> 172.21.15.8:0/216894617 conn(0x563a0c969370 msgr2=0x563a0c969750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.103+0000 7f49aaddd740 1 -- 172.21.15.8:0/216894617 shutdown_connections 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.103+0000 7f49a5600640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f49880a1d40 0x7f49880a4200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f49940ed6b0 tx=0x7f49940f39f0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.103+0000 7f49aaddd740 1 -- 172.21.15.8:0/216894617 wait complete. 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.103+0000 7f49aaddd740 1 -- start start 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49aaddd740 1 Processor -- start 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c975220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96f560 0x563a0c975760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c978140 0x563a0c975ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49aaddd740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c87b150 con 0x563a0c978140 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49aaddd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c87adf0 con 0x563a0c96f560 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49aaddd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c6441c0 con 0x563a0c96ec40 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49aaddd740 10 client.0 _ll_register_callbacks cb 0x563a0c8ca2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49a4c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96f560 0x563a0c975760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49a6000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c975220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49a4c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96f560 0x563a0c975760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35766/0 (socket says 172.21.15.8:35766) 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49a4c00640 1 -- 172.21.15.8:0/1490004407 learned_addr learned my addr 172.21.15.8:0/1490004407 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.104+0000 7f49a6000640 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c978140 0x563a0c975ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.105+0000 7f49a4c00640 1 -- 172.21.15.8:0/1490004407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 msgr2=0x563a0c975220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.105+0000 7f49a4c00640 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c975220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.105+0000 7f49a4c00640 1 -- 172.21.15.8:0/1490004407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c978140 msgr2=0x563a0c975ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.105+0000 7f49a4c00640 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c978140 0x563a0c975ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.105+0000 7f49a4c00640 1 -- 172.21.15.8:0/1490004407 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4998009bf0 con 0x563a0c96f560 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.105+0000 7f49a6000640 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c978140 0x563a0c975ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.105+0000 7f49a4c00640 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96f560 0x563a0c975760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f498c012d00 tx=0x7f498c00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5bf5b485509f89c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.105+0000 7f4986a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.105+0000 7f4986a00640 1 -- 172.21.15.8:0/1490004407 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c017070 con 0x563a0c96f560 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.105+0000 7f4986a00640 1 -- 172.21.15.8:0/1490004407 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f498c009d90 con 0x563a0c96f560 2024-03-16T20:59:17.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.105+0000 7f49aaddd740 1 -- 172.21.15.8:0/1490004407 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a0c5d57e0 con 0x563a0c96f560 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.106+0000 7f4986a00640 1 -- 172.21.15.8:0/1490004407 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f498c012110 con 0x563a0c96f560 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.106+0000 7f49aaddd740 10 client.25844 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.106+0000 7f49aaddd740 1 -- 172.21.15.8:0/1490004407 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563a0c8d45a0 con 0x563a0c96f560 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.106+0000 7f4986a00640 1 -- 172.21.15.8:0/1490004407 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x563a0c5d57e0 con 0x563a0c96f560 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.106+0000 7f4986a00640 1 -- 172.21.15.8:0/1490004407 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f498c010430 con 0x563a0c96f560 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.106+0000 7f49aaddd740 10 client.25844 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.106+0000 7f49aaddd740 10 client.25844 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.106+0000 7f49aaddd740 20 client.25844 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.106+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563a0c988370 0x563a0c98a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.106+0000 7f49aaddd740 4 client.25844 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.106+0000 7f49aaddd740 1 -- 172.21.15.8:0/1490004407 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a0c612720 con 0x563a0c988370 2024-03-16T20:59:17.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.107+0000 7f49a6000640 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563a0c988370 0x563a0c98a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.107+0000 7f49a6000640 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563a0c988370 0x563a0c98a790 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c308671dad3811c server_cookie=be6f82b91c2386a7 in_seq=0 out_seq=0 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.107+0000 7f4986a00640 10 client.25844 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.108+0000 7f4986a00640 1 -- 172.21.15.8:0/1490004407 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563a0c612720 con 0x563a0c988370 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.108+0000 7f4986a00640 10 client.25844 handle_command_reply: tid=0 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.108+0000 7f49aaddd740 1 client.25844 shutdown 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.108+0000 7f49aaddd740 1 -- 172.21.15.8:0/1490004407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96f560 msgr2=0x563a0c975760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.108+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96f560 0x563a0c975760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f498c012d00 tx=0x7f498c00f790 comp rx=0 tx=0).stop 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.109+0000 7f49aaddd740 1 -- 172.21.15.8:0/1490004407 shutdown_connections 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.109+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563a0c988370 0x563a0c98a790 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.109+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c978140 0x563a0c975ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.109+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c96f560 0x563a0c975760 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.109+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1490004407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c975220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.109+0000 7f4986a00640 0 client.25844 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:17.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.109+0000 7f49aaddd740 1 -- 172.21.15.8:0/1490004407 >> 172.21.15.8:0/1490004407 conn(0x563a0c969370 msgr2=0x563a0c96b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:17.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.109+0000 7f49aaddd740 1 -- 172.21.15.8:0/1490004407 shutdown_connections 2024-03-16T20:59:17.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.109+0000 7f49aaddd740 1 -- 172.21.15.8:0/1490004407 wait complete. 2024-03-16T20:59:17.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.109+0000 7f49aaddd740 20 client.25844 trim_cache size 0 max 16384 2024-03-16T20:59:17.117 INFO:tasks.workunit.client.0.smithi008.stderr:+ KERNEL=linux-4.0.5 2024-03-16T20:59:17.117 INFO:tasks.workunit.client.0.smithi008.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-03-16T20:59:17.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49aaddd740 1 Processor -- start 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49aaddd740 1 -- start start 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c977950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c9758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c978140 0x563a0c9834c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49aaddd740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c968bf0 con 0x563a0c96f560 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49aaddd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c96a370 con 0x563a0c978140 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49aaddd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c98adf0 con 0x563a0c96ec40 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49a6000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c977950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49a4c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c9758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49a6000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c977950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:37156/0 (socket says 172.21.15.8:37156) 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49a6000640 1 -- 172.21.15.8:0/430324014 learned_addr learned my addr 172.21.15.8:0/430324014 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.123+0000 7f49a6000640 1 --2- 172.21.15.8:0/430324014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c978140 0x563a0c9834c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.124+0000 7f49a6000640 1 -- 172.21.15.8:0/430324014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c978140 msgr2=0x563a0c9834c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:17.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.124+0000 7f49a6000640 1 --2- 172.21.15.8:0/430324014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c978140 0x563a0c9834c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.124+0000 7f49a6000640 1 -- 172.21.15.8:0/430324014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 msgr2=0x563a0c9758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:17.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.124+0000 7f49a6000640 1 --2- 172.21.15.8:0/430324014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c9758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.124+0000 7f49a6000640 1 -- 172.21.15.8:0/430324014 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a0c870ab0 con 0x563a0c96ec40 2024-03-16T20:59:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.124+0000 7f49a6000640 1 --2- 172.21.15.8:0/430324014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c977950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f49980108a0 tx=0x7f4998009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77597868487c0a60 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.124+0000 7f4991c00640 1 -- 172.21.15.8:0/430324014 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499802c740 con 0x563a0c96ec40 2024-03-16T20:59:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.124+0000 7f4991c00640 1 -- 172.21.15.8:0/430324014 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4998032070 con 0x563a0c96ec40 2024-03-16T20:59:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.124+0000 7f4991c00640 1 -- 172.21.15.8:0/430324014 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998011d60 con 0x563a0c96ec40 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.125+0000 7f49aaddd740 1 -- 172.21.15.8:0/430324014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 msgr2=0x563a0c977950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.125+0000 7f49aaddd740 1 --2- 172.21.15.8:0/430324014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c977950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f49980108a0 tx=0x7f4998009500 comp rx=0 tx=0).stop 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.125+0000 7f49aaddd740 1 -- 172.21.15.8:0/430324014 shutdown_connections 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.125+0000 7f49aaddd740 1 --2- 172.21.15.8:0/430324014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c978140 0x563a0c9834c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.125+0000 7f49aaddd740 1 --2- 172.21.15.8:0/430324014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c9758f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.125+0000 7f49aaddd740 1 --2- 172.21.15.8:0/430324014 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c977950 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.125+0000 7f49aaddd740 1 -- 172.21.15.8:0/430324014 >> 172.21.15.8:0/430324014 conn(0x563a0c969370 msgr2=0x563a0c9751e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.125+0000 7f49aaddd740 1 -- 172.21.15.8:0/430324014 shutdown_connections 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.125+0000 7f49aaddd740 1 -- 172.21.15.8:0/430324014 wait complete. 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.125+0000 7f49aaddd740 1 -- start start 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.125+0000 7f49aaddd740 1 Processor -- start 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c972ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c97cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49aaddd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c978140 0x563a0c97d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49aaddd740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c97db20 con 0x563a0c96f560 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49aaddd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c97dc90 con 0x563a0c978140 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49aaddd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0c97de50 con 0x563a0c96ec40 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49aaddd740 10 client.0 _ll_register_callbacks cb 0x7f498c009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49a6000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c972ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49a4c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c97cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49a6000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c972ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:37170/0 (socket says 172.21.15.8:37170) 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49a6000640 1 -- 172.21.15.8:0/1579515776 learned_addr learned my addr 172.21.15.8:0/1579515776 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49a4c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c97cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60476/0 (socket says 172.21.15.8:60476) 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.126+0000 7f49a6000640 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c978140 0x563a0c97d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f49a4c00640 1 -- 172.21.15.8:0/1579515776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 msgr2=0x563a0c972ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f49a4c00640 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c972ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f49a4c00640 1 -- 172.21.15.8:0/1579515776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c978140 msgr2=0x563a0c97d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f49a4c00640 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c978140 0x563a0c97d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f49a4c00640 1 -- 172.21.15.8:0/1579515776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a0c897df0 con 0x563a0c96f560 2024-03-16T20:59:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f49a4c00640 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c97cfd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f498c0107e0 tx=0x7f498c012970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1909b9633a2004 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f4986a00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T20:59:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f4986a00640 1 -- 172.21.15.8:0/1579515776 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c017030 con 0x563a0c96f560 2024-03-16T20:59:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f49aaddd740 1 -- 172.21.15.8:0/1579515776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4998015070 con 0x563a0c96f560 2024-03-16T20:59:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f4986a00640 1 -- 172.21.15.8:0/1579515776 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f498c0109d0 con 0x563a0c96f560 2024-03-16T20:59:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f4986a00640 1 -- 172.21.15.8:0/1579515776 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f498c010b90 con 0x563a0c96f560 2024-03-16T20:59:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.127+0000 7f49aaddd740 10 client.15693 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.128+0000 7f49aaddd740 1 -- 172.21.15.8:0/1579515776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563a0c896650 con 0x563a0c96f560 2024-03-16T20:59:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.128+0000 7f4986a00640 1 -- 172.21.15.8:0/1579515776 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f498c03b020 con 0x563a0c96f560 2024-03-16T20:59:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.128+0000 7f4986a00640 1 -- 172.21.15.8:0/1579515776 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f498c0039f0 con 0x563a0c96f560 2024-03-16T20:59:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.128+0000 7f49aaddd740 10 client.15693 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.128+0000 7f49aaddd740 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.128+0000 7f49aaddd740 20 client.15693 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.128+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563a0c9e52c0 0x563a0c9e76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.128+0000 7f49aaddd740 4 client.15693 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.128+0000 7f49aaddd740 1 -- 172.21.15.8:0/1579515776 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563a0c661890 con 0x563a0c9e52c0 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.128+0000 7f49a6000640 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563a0c9e52c0 0x563a0c9e76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f49a6000640 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563a0c9e52c0 0x563a0c9e76e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a2a05d3d121ea3e server_cookie=2db88b45269d4324 in_seq=0 out_seq=0 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f4986a00640 10 client.15693 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f4986a00640 1 -- 172.21.15.8:0/1579515776 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563a0c661890 con 0x563a0c9e52c0 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f4986a00640 10 client.15693 handle_command_reply: tid=0 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f49aaddd740 1 client.15693 shutdown 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f49aaddd740 1 -- 172.21.15.8:0/1579515776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 msgr2=0x563a0c97cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c97cfd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f498c0107e0 tx=0x7f498c012970 comp rx=0 tx=0).stop 2024-03-16T20:59:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f49aaddd740 1 -- 172.21.15.8:0/1579515776 shutdown_connections 2024-03-16T20:59:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563a0c978140 0x563a0c97d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563a0c9e52c0 0x563a0c9e76e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a0c96f560 0x563a0c97cfd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f49aaddd740 1 --2- 172.21.15.8:0/1579515776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563a0c96ec40 0x563a0c972ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f4986a00640 0 client.15693 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.129+0000 7f49aaddd740 1 -- 172.21.15.8:0/1579515776 >> 172.21.15.8:0/1579515776 conn(0x563a0c969370 msgr2=0x563a0c968470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49aaddd740 1 -- 172.21.15.8:0/1579515776 shutdown_connections 2024-03-16T20:59:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49aaddd740 1 -- 172.21.15.8:0/1579515776 wait complete. 2024-03-16T20:59:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49aaddd740 20 client.15693 trim_cache size 0 max 16384 2024-03-16T20:59:17.138 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:59:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49a8000640 1 -- 172.21.15.8:0/141114615 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f49880a1d40 msgr2=0x7f49880a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49a8000640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f49880a1d40 0x7f49880a4200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f49940ed6b0 tx=0x7f49940f39f0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49a8000640 1 -- 172.21.15.8:0/141114615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a0103690 msgr2=0x7f49a0199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49a8000640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a0103690 0x7f49a0199e80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4994000c00 tx=0x7f499402cc20 comp rx=0 tx=0).stop 2024-03-16T20:59:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49a8000640 1 -- 172.21.15.8:0/141114615 shutdown_connections 2024-03-16T20:59:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49a8000640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f49880a1d40 0x7f49880a4200 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49a8000640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49a01096a0 0x7f49a019e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49a8000640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49a0104050 0x7f49a019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49a8000640 1 --2- 172.21.15.8:0/141114615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a0103690 0x7f49a0199e80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.130+0000 7f49a8000640 1 -- 172.21.15.8:0/141114615 >> 172.21.15.8:0/141114615 conn(0x7f49a00ff1a0 msgr2=0x7f49a00ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.131+0000 7f49a8000640 1 -- 172.21.15.8:0/141114615 shutdown_connections 2024-03-16T20:59:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:17.131+0000 7f49a8000640 1 -- 172.21.15.8:0/141114615 wait complete. 2024-03-16T20:59:18.153 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T20:59:18.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:59:18.154 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T20:59:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.388+0000 7f20fec00640 1 -- 172.21.15.8:0/3976023617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f81066a0 msgr2=0x7f20f810e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.388+0000 7f20fec00640 1 --2- 172.21.15.8:0/3976023617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f81066a0 0x7f20f810e270 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009cd0 tx=0x7f20f002c0e0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.388+0000 7f20fec00640 1 -- 172.21.15.8:0/3976023617 shutdown_connections 2024-03-16T20:59:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.388+0000 7f20fec00640 1 --2- 172.21.15.8:0/3976023617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f81066a0 0x7f20f810e270 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.388+0000 7f20fec00640 1 --2- 172.21.15.8:0/3976023617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f8101f80 0x7f20f8105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.388+0000 7f20fec00640 1 --2- 172.21.15.8:0/3976023617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81015d0 0x7f20f81019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.388+0000 7f20fec00640 1 -- 172.21.15.8:0/3976023617 >> 172.21.15.8:0/3976023617 conn(0x7f20f80fce90 msgr2=0x7f20f80ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.388+0000 7f20fec00640 1 -- 172.21.15.8:0/3976023617 shutdown_connections 2024-03-16T20:59:18.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.389+0000 7f20fec00640 1 -- 172.21.15.8:0/3976023617 wait complete. 2024-03-16T20:59:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.389+0000 7f20fec00640 1 Processor -- start 2024-03-16T20:59:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.390+0000 7f20fec00640 1 -- start start 2024-03-16T20:59:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.390+0000 7f20fec00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81015d0 0x7f20f8199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.390+0000 7f20fec00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f81066a0 0x7f20f819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.390+0000 7f20fec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f819e560 0x7f20f819ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.390+0000 7f20fec00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f819ef50 con 0x7f20f819e560 2024-03-16T20:59:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.390+0000 7f20fec00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f819f0c0 con 0x7f20f81066a0 2024-03-16T20:59:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.390+0000 7f20fec00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f819f230 con 0x7f20f81015d0 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.390+0000 7f20fd800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81015d0 0x7f20f8199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.390+0000 7f20fd800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81015d0 0x7f20f8199d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:32892/0 (socket says 172.21.15.8:32892) 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.390+0000 7f20fd800640 1 -- 172.21.15.8:0/1697274421 learned_addr learned my addr 172.21.15.8:0/1697274421 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.390+0000 7f20fce00640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f81066a0 0x7f20f819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20fe200640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f819e560 0x7f20f819ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20fd800640 1 -- 172.21.15.8:0/1697274421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f81066a0 msgr2=0x7f20f819a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20fd800640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f81066a0 0x7f20f819a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20fd800640 1 -- 172.21.15.8:0/1697274421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f819e560 msgr2=0x7f20f819ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20fd800640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f819e560 0x7f20f819ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20fd800640 1 -- 172.21.15.8:0/1697274421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0009900 con 0x7f20f81015d0 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20fce00640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f81066a0 0x7f20f819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20fd800640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81015d0 0x7f20f8199d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00d950 tx=0x7f20ec00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20f6000640 1 -- 172.21.15.8:0/1697274421 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec009c30 con 0x7f20f81015d0 2024-03-16T20:59:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20f6000640 1 -- 172.21.15.8:0/1697274421 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f20ec009d90 con 0x7f20f81015d0 2024-03-16T20:59:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20f6000640 1 -- 172.21.15.8:0/1697274421 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec00f880 con 0x7f20f81015d0 2024-03-16T20:59:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.391+0000 7f20fec00640 1 -- 172.21.15.8:0/1697274421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f81a6810 con 0x7f20f81015d0 2024-03-16T20:59:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.392+0000 7f20fec00640 1 -- 172.21.15.8:0/1697274421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f81a6c70 con 0x7f20f81015d0 2024-03-16T20:59:18.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.396+0000 7f2102e01740 1 Processor -- start 2024-03-16T20:59:18.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.396+0000 7f2102e01740 1 -- start start 2024-03-16T20:59:18.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.396+0000 7f20f6000640 1 -- 172.21.15.8:0/1697274421 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7f20ec010b80 con 0x7f20f81015d0 2024-03-16T20:59:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f2102e01740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f9184f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f2102e01740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 0x562f918580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f2102e01740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f9185aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f2102e01740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f9180a300 con 0x562f91858610 2024-03-16T20:59:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f2102e01740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f917bce50 con 0x562f9184fa30 2024-03-16T20:59:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f2102e01740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f917ba380 con 0x562f9184f110 2024-03-16T20:59:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f20fe200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f9184f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f20fd800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 0x562f918580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f20fe200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f9184f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:32904/0 (socket says 172.21.15.8:32904) 2024-03-16T20:59:18.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f20fe200640 1 -- 172.21.15.8:0/527872919 learned_addr learned my addr 172.21.15.8:0/527872919 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:18.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f20fce00640 1 --2- 172.21.15.8:0/527872919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f9185aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f20fe200640 1 -- 172.21.15.8:0/527872919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 msgr2=0x562f918580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f20fe200640 1 --2- 172.21.15.8:0/527872919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 0x562f918580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f20fe200640 1 -- 172.21.15.8:0/527872919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 msgr2=0x562f9185aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f20fe200640 1 --2- 172.21.15.8:0/527872919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f9185aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.397+0000 7f20fe200640 1 -- 172.21.15.8:0/527872919 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f9177ec80 con 0x562f9184f110 2024-03-16T20:59:18.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.398+0000 7f20fe200640 1 --2- 172.21.15.8:0/527872919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f9184f4f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f20f002c6f0 tx=0x7f20f0009890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab59f0a68e278095 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.398+0000 7f20eaa00640 1 -- 172.21.15.8:0/527872919 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0032540 con 0x562f9184f110 2024-03-16T20:59:18.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.398+0000 7f20eaa00640 1 -- 172.21.15.8:0/527872919 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f20f0034ab0 con 0x562f9184f110 2024-03-16T20:59:18.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.398+0000 7f20eaa00640 1 -- 172.21.15.8:0/527872919 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0003bd0 con 0x562f9184f110 2024-03-16T20:59:18.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.398+0000 7f20f6000640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20e00a1d40 0x7f20e00a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f20f6000640 1 -- 172.21.15.8:0/1697274421 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f20ec0cd6f0 con 0x7f20f81015d0 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f20fd800640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20e00a1d40 0x7f20e00a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f2102e01740 1 -- 172.21.15.8:0/527872919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 msgr2=0x562f9184f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f2102e01740 1 --2- 172.21.15.8:0/527872919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f9184f4f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f20f002c6f0 tx=0x7f20f0009890 comp rx=0 tx=0).stop 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f2102e01740 1 -- 172.21.15.8:0/527872919 shutdown_connections 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f2102e01740 1 --2- 172.21.15.8:0/527872919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f9185aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f2102e01740 1 --2- 172.21.15.8:0/527872919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 0x562f918580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f2102e01740 1 --2- 172.21.15.8:0/527872919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f9184f4f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f2102e01740 1 -- 172.21.15.8:0/527872919 >> 172.21.15.8:0/527872919 conn(0x562f91849840 msgr2=0x562f91849c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f2102e01740 1 -- 172.21.15.8:0/527872919 shutdown_connections 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f2102e01740 1 -- 172.21.15.8:0/527872919 wait complete. 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.399+0000 7f20fd800640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20e00a1d40 0x7f20e00a4200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0cacf0 tx=0x7f20ec0d3530 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.400+0000 7f2102e01740 1 -- start start 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.400+0000 7f2102e01740 1 Processor -- start 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.400+0000 7f2102e01740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f91855610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.400+0000 7f2102e01740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9184fa30 0x562f91855b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f2102e01740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f91858610 0x562f91856090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f2102e01740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f917b5b60 con 0x562f9184fa30 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f2102e01740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f9175afd0 con 0x562f91858610 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f2102e01740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f9175ac70 con 0x562f9184f110 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f2102e01740 10 client.0 _ll_register_callbacks cb 0x562f914c6c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f20fce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9184fa30 0x562f91855b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f20fce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9184fa30 0x562f91855b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39282/0 (socket says 172.21.15.8:39282) 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f20fce00640 1 -- 172.21.15.8:0/3280962100 learned_addr learned my addr 172.21.15.8:0/3280962100 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f20fe200640 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f91858610 0x562f91856090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f20fe200640 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f91855610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f20fce00640 1 -- 172.21.15.8:0/3280962100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 msgr2=0x562f91855610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f20fce00640 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f91855610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f20fce00640 1 -- 172.21.15.8:0/3280962100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f91858610 msgr2=0x562f91856090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f20fce00640 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f91858610 0x562f91856090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f20fce00640 1 -- 172.21.15.8:0/3280962100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f810ea80 con 0x562f9184fa30 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.401+0000 7f20fe200640 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f91855610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.402+0000 7f20fce00640 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9184fa30 0x562f91855b50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f20e4012d20 tx=0x7f20e400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c28487c20bdbc8f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.402+0000 7f20df400640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.402+0000 7f20df400640 1 -- 172.21.15.8:0/3280962100 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4017070 con 0x562f9184fa30 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.402+0000 7f20df400640 1 -- 172.21.15.8:0/3280962100 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f20e4012110 con 0x562f9184fa30 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.402+0000 7f2102e01740 1 -- 172.21.15.8:0/3280962100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f914b5860 con 0x562f9184fa30 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.402+0000 7f20df400640 1 -- 172.21.15.8:0/3280962100 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20e400fe80 con 0x562f9184fa30 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.402+0000 7f2102e01740 10 client.15705 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.402+0000 7f2102e01740 1 -- 172.21.15.8:0/3280962100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x562f917b41e0 con 0x562f9184fa30 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.402+0000 7f20df400640 1 -- 172.21.15.8:0/3280962100 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x562f914b5860 con 0x562f9184fa30 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.403+0000 7f20df400640 1 -- 172.21.15.8:0/3280962100 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f20e4025450 con 0x562f9184fa30 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.403+0000 7f2102e01740 10 client.15705 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.403+0000 7f2102e01740 10 client.15705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.403+0000 7f2102e01740 20 client.15705 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.403+0000 7f2102e01740 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562f918689c0 0x562f9186ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.403+0000 7f2102e01740 4 client.15705 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.403+0000 7f2102e01740 1 -- 172.21.15.8:0/3280962100 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f91506410 con 0x562f918689c0 2024-03-16T20:59:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.403+0000 7f20fe200640 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562f918689c0 0x562f9186ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.404+0000 7f20fe200640 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562f918689c0 0x562f9186ade0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24b90ff0d0a755fc server_cookie=f0971a57de2c6e5c in_seq=0 out_seq=0 2024-03-16T20:59:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.404+0000 7f20df400640 10 client.15705 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.404+0000 7f20df400640 1 -- 172.21.15.8:0/3280962100 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x562f91506410 con 0x562f918689c0 2024-03-16T20:59:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.404+0000 7f20df400640 10 client.15705 handle_command_reply: tid=0 2024-03-16T20:59:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.404+0000 7f2102e01740 1 client.15705 shutdown 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f2102e01740 1 -- 172.21.15.8:0/3280962100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9184fa30 msgr2=0x562f91855b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f2102e01740 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9184fa30 0x562f91855b50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f20e4012d20 tx=0x7f20e400f790 comp rx=0 tx=0).stop 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f2102e01740 1 -- 172.21.15.8:0/3280962100 shutdown_connections 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f2102e01740 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f91858610 0x562f91856090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f2102e01740 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562f918689c0 0x562f9186ade0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f2102e01740 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9184fa30 0x562f91855b50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f2102e01740 1 --2- 172.21.15.8:0/3280962100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f91855610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f2102e01740 1 -- 172.21.15.8:0/3280962100 >> 172.21.15.8:0/3280962100 conn(0x562f91849840 msgr2=0x562f9184b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f20df400640 0 client.15705 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f2102e01740 1 -- 172.21.15.8:0/3280962100 shutdown_connections 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f2102e01740 1 -- 172.21.15.8:0/3280962100 wait complete. 2024-03-16T20:59:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.405+0000 7f2102e01740 20 client.15705 trim_cache size 0 max 16384 2024-03-16T20:59:18.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.423+0000 7f2102e01740 1 Processor -- start 2024-03-16T20:59:18.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.423+0000 7f2102e01740 1 -- start start 2024-03-16T20:59:18.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.423+0000 7f2102e01740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f91857d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.423+0000 7f2102e01740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 0x562f91855eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.423+0000 7f2102e01740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f91863930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.423+0000 7f2102e01740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f914fe0c0 con 0x562f91858610 2024-03-16T20:59:18.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.423+0000 7f2102e01740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f91853b80 con 0x562f9184fa30 2024-03-16T20:59:18.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.423+0000 7f2102e01740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f91849020 con 0x562f9184f110 2024-03-16T20:59:18.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 0x562f91855eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 0x562f91855eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42606/0 (socket says 172.21.15.8:42606) 2024-03-16T20:59:18.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fce00640 1 -- 172.21.15.8:0/2987054359 learned_addr learned my addr 172.21.15.8:0/2987054359 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:18.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fe200640 1 --2- 172.21.15.8:0/2987054359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f91857d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fe200640 1 --2- 172.21.15.8:0/2987054359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f91863930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fce00640 1 -- 172.21.15.8:0/2987054359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 msgr2=0x562f91857d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fce00640 1 --2- 172.21.15.8:0/2987054359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f91857d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fce00640 1 -- 172.21.15.8:0/2987054359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 msgr2=0x562f91863930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fce00640 1 --2- 172.21.15.8:0/2987054359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f91863930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fce00640 1 -- 172.21.15.8:0/2987054359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f91750a90 con 0x562f9184fa30 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fe200640 1 --2- 172.21.15.8:0/2987054359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f91857d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20fce00640 1 --2- 172.21.15.8:0/2987054359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 0x562f91855eb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f20e400a010 tx=0x7f20e4009fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d326cf70e56232be server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20ea000640 1 -- 172.21.15.8:0/2987054359 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4017040 con 0x562f9184fa30 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20ea000640 1 -- 172.21.15.8:0/2987054359 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f20e400fe80 con 0x562f9184fa30 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.424+0000 7f20ea000640 1 -- 172.21.15.8:0/2987054359 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40035f0 con 0x562f9184fa30 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.425+0000 7f2102e01740 1 -- 172.21.15.8:0/2987054359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 msgr2=0x562f91855eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.425+0000 7f2102e01740 1 --2- 172.21.15.8:0/2987054359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 0x562f91855eb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f20e400a010 tx=0x7f20e4009fa0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.425+0000 7f2102e01740 1 -- 172.21.15.8:0/2987054359 shutdown_connections 2024-03-16T20:59:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.425+0000 7f2102e01740 1 --2- 172.21.15.8:0/2987054359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f91863930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.425+0000 7f2102e01740 1 --2- 172.21.15.8:0/2987054359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184fa30 0x562f91855eb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.425+0000 7f2102e01740 1 --2- 172.21.15.8:0/2987054359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184f110 0x562f91857d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.425+0000 7f2102e01740 1 -- 172.21.15.8:0/2987054359 >> 172.21.15.8:0/2987054359 conn(0x562f91849840 msgr2=0x562f9184b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.425+0000 7f2102e01740 1 -- 172.21.15.8:0/2987054359 shutdown_connections 2024-03-16T20:59:18.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.425+0000 7f2102e01740 1 -- 172.21.15.8:0/2987054359 wait complete. 2024-03-16T20:59:18.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.426+0000 7f2102e01740 1 -- start start 2024-03-16T20:59:18.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.426+0000 7f2102e01740 1 Processor -- start 2024-03-16T20:59:18.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.426+0000 7f2102e01740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184f110 0x562f9185d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.426+0000 7f2102e01740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184fa30 0x562f9185d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.426+0000 7f2102e01740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f9185dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.426+0000 7f2102e01740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f918c4280 con 0x562f91858610 2024-03-16T20:59:18.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.426+0000 7f2102e01740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f918c43c0 con 0x562f9184f110 2024-03-16T20:59:18.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.426+0000 7f2102e01740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f918c4500 con 0x562f9184fa30 2024-03-16T20:59:18.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.426+0000 7f2102e01740 10 client.0 _ll_register_callbacks cb 0x7f20e4009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.426+0000 7f20fe200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184f110 0x562f9185d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20fe200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184f110 0x562f9185d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42614/0 (socket says 172.21.15.8:42614) 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20fe200640 1 -- 172.21.15.8:0/551019172 learned_addr learned my addr 172.21.15.8:0/551019172 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20fe200640 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f9185dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20fce00640 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184fa30 0x562f9185d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20fe200640 1 -- 172.21.15.8:0/551019172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184fa30 msgr2=0x562f9185d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20fe200640 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184fa30 0x562f9185d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20fe200640 1 -- 172.21.15.8:0/551019172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 msgr2=0x562f9185dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20fe200640 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f9185dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20fe200640 1 -- 172.21.15.8:0/551019172 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f917b41e0 con 0x562f9184f110 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20fe200640 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184f110 0x562f9185d440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009ca0 tx=0x7f20f0040040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15af2f13e9bb2fad server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20df400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.427+0000 7f20df400640 1 -- 172.21.15.8:0/551019172 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0056350 con 0x562f9184f110 2024-03-16T20:59:18.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f20df400640 1 -- 172.21.15.8:0/551019172 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f20f0032e70 con 0x562f9184f110 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f2102e01740 1 -- 172.21.15.8:0/551019172 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f20f0034ab0 con 0x562f9184f110 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f20df400640 1 -- 172.21.15.8:0/551019172 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20f0004b40 con 0x562f9184f110 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f2102e01740 10 client.25868 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f2102e01740 1 -- 172.21.15.8:0/551019172 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x562f917766a0 con 0x562f9184f110 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f20df400640 1 -- 172.21.15.8:0/551019172 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f20f0034ab0 con 0x562f9184f110 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f20df400640 1 -- 172.21.15.8:0/551019172 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f20f00054d0 con 0x562f9184f110 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f2102e01740 10 client.25868 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f2102e01740 10 client.25868 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f2102e01740 20 client.25868 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f2102e01740 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562f918c5910 0x562f918c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f2102e01740 4 client.25868 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.428+0000 7f2102e01740 1 -- 172.21.15.8:0/551019172 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562f914f27b0 con 0x562f918c5910 2024-03-16T20:59:18.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.429+0000 7f20fce00640 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562f918c5910 0x562f918c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.429+0000 7f20fce00640 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562f918c5910 0x562f918c7d00 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25b2e461f094d44c server_cookie=52a772bf9420853c in_seq=0 out_seq=0 2024-03-16T20:59:18.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.429+0000 7f20df400640 10 client.25868 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:18.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.430+0000 7f20df400640 1 -- 172.21.15.8:0/551019172 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562f914f27b0 con 0x562f918c5910 2024-03-16T20:59:18.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.430+0000 7f20df400640 10 client.25868 handle_command_reply: tid=0 2024-03-16T20:59:18.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.430+0000 7f2102e01740 1 client.25868 shutdown 2024-03-16T20:59:18.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f2102e01740 1 -- 172.21.15.8:0/551019172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184f110 msgr2=0x562f9185d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f2102e01740 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184f110 0x562f9185d440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009ca0 tx=0x7f20f0040040 comp rx=0 tx=0).stop 2024-03-16T20:59:18.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f2102e01740 1 -- 172.21.15.8:0/551019172 shutdown_connections 2024-03-16T20:59:18.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f2102e01740 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562f918c5910 0x562f918c7d00 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f2102e01740 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f91858610 0x562f9185dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f2102e01740 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562f9184fa30 0x562f9185d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f2102e01740 1 --2- 172.21.15.8:0/551019172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562f9184f110 0x562f9185d440 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f20df400640 0 client.25868 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:18.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f2102e01740 1 -- 172.21.15.8:0/551019172 >> 172.21.15.8:0/551019172 conn(0x562f91849840 msgr2=0x562f9184abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f2102e01740 1 -- 172.21.15.8:0/551019172 shutdown_connections 2024-03-16T20:59:18.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f2102e01740 1 -- 172.21.15.8:0/551019172 wait complete. 2024-03-16T20:59:18.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.431+0000 7f2102e01740 20 client.25868 trim_cache size 0 max 16384 2024-03-16T20:59:18.439 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:59:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T20:59:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "8f82dbcb-9f92-428e-8781-9b562eff419f", 2024-03-16T20:59:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T20:59:18.439 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:59:18.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 -- 172.21.15.8:0/1697274421 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20e00a1d40 msgr2=0x7f20e00a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20e00a1d40 0x7f20e00a4200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0cacf0 tx=0x7f20ec0d3530 comp rx=0 tx=0).stop 2024-03-16T20:59:18.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 -- 172.21.15.8:0/1697274421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81015d0 msgr2=0x7f20f8199d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81015d0 0x7f20f8199d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00d950 tx=0x7f20ec00de10 comp rx=0 tx=0).stop 2024-03-16T20:59:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 -- 172.21.15.8:0/1697274421 shutdown_connections 2024-03-16T20:59:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20e00a1d40 0x7f20e00a4200 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f819e560 0x7f20f819ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f81066a0 0x7f20f819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 --2- 172.21.15.8:0/1697274421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81015d0 0x7f20f8199d90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 -- 172.21.15.8:0/1697274421 >> 172.21.15.8:0/1697274421 conn(0x7f20f80fce90 msgr2=0x7f20f80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 -- 172.21.15.8:0/1697274421 shutdown_connections 2024-03-16T20:59:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.432+0000 7f20fec00640 1 -- 172.21.15.8:0/1697274421 wait complete. 2024-03-16T20:59:18.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T20:59:18.454 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T20:59:18.532 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:18 smithi008 ceph-mon[31434]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-03-16T20:59:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.673+0000 7fe620a00640 1 -- 172.21.15.8:0/1211264911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe61c103590 msgr2=0x7fe61c103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.673+0000 7fe620a00640 1 --2- 172.21.15.8:0/1211264911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe61c103590 0x7fe61c103a10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe604009900 tx=0x7fe60402bc30 comp rx=0 tx=0).stop 2024-03-16T20:59:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.673+0000 7fe620a00640 1 -- 172.21.15.8:0/1211264911 shutdown_connections 2024-03-16T20:59:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.673+0000 7fe620a00640 1 --2- 172.21.15.8:0/1211264911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe61c103f50 0x7fe61c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.673+0000 7fe620a00640 1 --2- 172.21.15.8:0/1211264911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe61c103590 0x7fe61c103a10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.673+0000 7fe620a00640 1 --2- 172.21.15.8:0/1211264911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe61c109650 0x7fe61c109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.673+0000 7fe620a00640 1 -- 172.21.15.8:0/1211264911 >> 172.21.15.8:0/1211264911 conn(0x7fe61c0ff020 msgr2=0x7fe61c101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.673+0000 7fe620a00640 1 -- 172.21.15.8:0/1211264911 shutdown_connections 2024-03-16T20:59:18.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.674+0000 7fe620a00640 1 -- 172.21.15.8:0/1211264911 wait complete. 2024-03-16T20:59:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.675+0000 7fe620a00640 1 Processor -- start 2024-03-16T20:59:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.675+0000 7fe620a00640 1 -- start start 2024-03-16T20:59:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.675+0000 7fe620a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe61c103590 0x7fe61c19f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.675+0000 7fe620a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe61c103f50 0x7fe61c19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.675+0000 7fe620a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe61c109650 0x7fe61c199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.675+0000 7fe620a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c19a0f0 con 0x7fe61c103f50 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.675+0000 7fe620a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c19a260 con 0x7fe61c103590 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.675+0000 7fe620a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c19a420 con 0x7fe61c109650 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.675+0000 7fe61b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe61c103590 0x7fe61c19f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.675+0000 7fe61b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe61c103590 0x7fe61c19f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42634/0 (socket says 172.21.15.8:42634) 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.676+0000 7fe61b400640 1 -- 172.21.15.8:0/4185500816 learned_addr learned my addr 172.21.15.8:0/4185500816 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.676+0000 7fe61be00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe61c109650 0x7fe61c199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.676+0000 7fe613e00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe61c103f50 0x7fe61c19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.676+0000 7fe61b400640 1 -- 172.21.15.8:0/4185500816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe61c109650 msgr2=0x7fe61c199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.676+0000 7fe61b400640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe61c109650 0x7fe61c199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.676+0000 7fe61b400640 1 -- 172.21.15.8:0/4185500816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe61c103f50 msgr2=0x7fe61c19fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.676+0000 7fe61b400640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe61c103f50 0x7fe61c19fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.676+0000 7fe61b400640 1 -- 172.21.15.8:0/4185500816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe604009560 con 0x7fe61c103590 2024-03-16T20:59:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.676+0000 7fe61be00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe61c109650 0x7fe61c199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.676+0000 7fe61b400640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe61c103590 0x7fe61c19f8f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00e9f0 tx=0x7fe60c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.676+0000 7fe618c00640 1 -- 172.21.15.8:0/4185500816 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c009700 con 0x7fe61c103590 2024-03-16T20:59:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.677+0000 7fe620a00640 1 -- 172.21.15.8:0/4185500816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c19a700 con 0x7fe61c103590 2024-03-16T20:59:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.677+0000 7fe618c00640 1 -- 172.21.15.8:0/4185500816 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe60c00cd80 con 0x7fe61c103590 2024-03-16T20:59:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.677+0000 7fe618c00640 1 -- 172.21.15.8:0/4185500816 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0189c0 con 0x7fe61c103590 2024-03-16T20:59:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.677+0000 7fe620a00640 1 -- 172.21.15.8:0/4185500816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c1a6990 con 0x7fe61c103590 2024-03-16T20:59:18.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.680+0000 7fe618c00640 1 -- 172.21.15.8:0/4185500816 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 26) v1 ==== 136511+0+0 (secure 0 0 0) 0x7fe60c018b20 con 0x7fe61c103590 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.680+0000 7fe624d97740 1 Processor -- start 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.680+0000 7fe624d97740 1 -- start start 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.680+0000 7fe624d97740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e1170 0x560e5b6dfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.680+0000 7fe624d97740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 0x560e5b6e0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.680+0000 7fe624d97740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e9800 0x560e5b6ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.680+0000 7fe624d97740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b64f150 con 0x560e5b6e1170 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.680+0000 7fe624d97740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b64c680 con 0x560e5b6e0490 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.680+0000 7fe624d97740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b647e60 con 0x560e5b6e9800 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe61b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 0x560e5b6e0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe61be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e1170 0x560e5b6dfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe61b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 0x560e5b6e0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42644/0 (socket says 172.21.15.8:42644) 2024-03-16T20:59:18.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe613e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e9800 0x560e5b6ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe61be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e1170 0x560e5b6dfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39342/0 (socket says 172.21.15.8:39342) 2024-03-16T20:59:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe61b400640 1 -- 172.21.15.8:0/2711761437 learned_addr learned my addr 172.21.15.8:0/2711761437 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe61b400640 1 -- 172.21.15.8:0/2711761437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e9800 msgr2=0x560e5b6ebbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe61b400640 1 --2- 172.21.15.8:0/2711761437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e9800 0x560e5b6ebbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe61b400640 1 -- 172.21.15.8:0/2711761437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e1170 msgr2=0x560e5b6dfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe61b400640 1 --2- 172.21.15.8:0/2711761437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e1170 0x560e5b6dfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe61b400640 1 -- 172.21.15.8:0/2711761437 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e5b601060 con 0x560e5b6e0490 2024-03-16T20:59:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe61b400640 1 --2- 172.21.15.8:0/2711761437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 0x560e5b6e0910 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0cb470 tx=0x7fe60c0d66a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=434f2298f39596de server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.681+0000 7fe618c00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe6000a1cc0 0x7fe6000a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.682+0000 7fe61be00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe6000a1cc0 0x7fe6000a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.682+0000 7fe60be00640 1 -- 172.21.15.8:0/2711761437 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0d6ea0 con 0x560e5b6e0490 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.682+0000 7fe60be00640 1 -- 172.21.15.8:0/2711761437 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe60c096ac0 con 0x560e5b6e0490 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.682+0000 7fe60be00640 1 -- 172.21.15.8:0/2711761437 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c018dd0 con 0x560e5b6e0490 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.682+0000 7fe618c00640 1 -- 172.21.15.8:0/4185500816 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe60c014070 con 0x7fe61c103590 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe61be00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe6000a1cc0 0x7fe6000a4180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe614009fd0 tx=0x7fe614009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe624d97740 1 -- 172.21.15.8:0/2711761437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 msgr2=0x560e5b6e0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe624d97740 1 --2- 172.21.15.8:0/2711761437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 0x560e5b6e0910 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0cb470 tx=0x7fe60c0d66a0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe624d97740 1 -- 172.21.15.8:0/2711761437 shutdown_connections 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe624d97740 1 --2- 172.21.15.8:0/2711761437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e9800 0x560e5b6ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe624d97740 1 --2- 172.21.15.8:0/2711761437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 0x560e5b6e0910 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe624d97740 1 --2- 172.21.15.8:0/2711761437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e1170 0x560e5b6dfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe624d97740 1 -- 172.21.15.8:0/2711761437 >> 172.21.15.8:0/2711761437 conn(0x560e5b6a75a0 msgr2=0x560e5b6daee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe624d97740 1 -- 172.21.15.8:0/2711761437 shutdown_connections 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe624d97740 1 -- 172.21.15.8:0/2711761437 wait complete. 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe624d97740 1 -- start start 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.683+0000 7fe624d97740 1 Processor -- start 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe624d97740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 0x560e5b6e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe624d97740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6e6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe624d97740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e9800 0x560e5b6e71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe624d97740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b5ecec0 con 0x560e5b6e9800 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe624d97740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b5ecb60 con 0x560e5b6e0490 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe624d97740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b3b61c0 con 0x560e5b6e1170 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe624d97740 10 client.0 _ll_register_callbacks cb 0x560e5b600960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe613e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6e6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe61b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 0x560e5b6e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe613e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6e6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:32956/0 (socket says 172.21.15.8:32956) 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe613e00640 1 -- 172.21.15.8:0/1689681726 learned_addr learned my addr 172.21.15.8:0/1689681726 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.684+0000 7fe61be00640 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e9800 0x560e5b6e71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe61b400640 1 -- 172.21.15.8:0/1689681726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 msgr2=0x560e5b6e6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe61b400640 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6e6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe61b400640 1 -- 172.21.15.8:0/1689681726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e9800 msgr2=0x560e5b6e71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe61b400640 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e9800 0x560e5b6e71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe61b400640 1 -- 172.21.15.8:0/1689681726 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c1a6990 con 0x560e5b6e0490 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe613e00640 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6e6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe61b400640 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 0x560e5b6e6760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00a410 tx=0x7fe60c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cba9f164d5a9d798 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe608c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe608c00640 1 -- 172.21.15.8:0/1689681726 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0d1eb0 con 0x560e5b6e0490 2024-03-16T20:59:18.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe608c00640 1 -- 172.21.15.8:0/1689681726 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe60c00a250 con 0x560e5b6e0490 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe624d97740 1 -- 172.21.15.8:0/1689681726 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e5b3477e0 con 0x560e5b6e0490 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe608c00640 1 -- 172.21.15.8:0/1689681726 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe60c01ee30 con 0x560e5b6e0490 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe624d97740 10 client.25880 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.685+0000 7fe624d97740 1 -- 172.21.15.8:0/1689681726 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560e5b6464e0 con 0x560e5b6e0490 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.686+0000 7fe608c00640 1 -- 172.21.15.8:0/1689681726 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe60c0b2020 con 0x560e5b6e0490 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.686+0000 7fe608c00640 1 -- 172.21.15.8:0/1689681726 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe60c0d4070 con 0x560e5b6e0490 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.686+0000 7fe624d97740 10 client.25880 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.686+0000 7fe624d97740 10 client.25880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.686+0000 7fe624d97740 20 client.25880 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.686+0000 7fe624d97740 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560e5b6f93f0 0x560e5b6fb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.686+0000 7fe624d97740 4 client.25880 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.686+0000 7fe624d97740 1 -- 172.21.15.8:0/1689681726 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e5b384720 con 0x560e5b6f93f0 2024-03-16T20:59:18.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.686+0000 7fe613e00640 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560e5b6f93f0 0x560e5b6fb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.687+0000 7fe613e00640 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560e5b6f93f0 0x560e5b6fb7e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb09366ae785dcaf server_cookie=67d0f916f1e07862 in_seq=0 out_seq=0 2024-03-16T20:59:18.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.687+0000 7fe608c00640 10 client.25880 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:18.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe608c00640 1 -- 172.21.15.8:0/1689681726 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560e5b384720 con 0x560e5b6f93f0 2024-03-16T20:59:18.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe608c00640 10 client.25880 handle_command_reply: tid=0 2024-03-16T20:59:18.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe624d97740 1 client.25880 shutdown 2024-03-16T20:59:18.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe624d97740 1 -- 172.21.15.8:0/1689681726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 msgr2=0x560e5b6e6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe624d97740 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 0x560e5b6e6760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00a410 tx=0x7fe60c000bc0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe624d97740 1 -- 172.21.15.8:0/1689681726 shutdown_connections 2024-03-16T20:59:18.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe624d97740 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560e5b6f93f0 0x560e5b6fb7e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe624d97740 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e9800 0x560e5b6e71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe624d97740 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6e6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe608c00640 0 client.25880 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:18.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe624d97740 1 --2- 172.21.15.8:0/1689681726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e0490 0x560e5b6e6760 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.688+0000 7fe624d97740 1 -- 172.21.15.8:0/1689681726 >> 172.21.15.8:0/1689681726 conn(0x560e5b6a75a0 msgr2=0x560e5b6dcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.689+0000 7fe624d97740 1 -- 172.21.15.8:0/1689681726 shutdown_connections 2024-03-16T20:59:18.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.689+0000 7fe624d97740 1 -- 172.21.15.8:0/1689681726 wait complete. 2024-03-16T20:59:18.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.689+0000 7fe624d97740 20 client.25880 trim_cache size 0 max 16384 2024-03-16T20:59:18.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.706+0000 7fe624d97740 1 Processor -- start 2024-03-16T20:59:18.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe624d97740 1 -- start start 2024-03-16T20:59:18.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe624d97740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e0490 0x560e5b6e8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe624d97740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e1170 0x560e5b6d9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe624d97740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e9800 0x560e5b6f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe624d97740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b6df710 con 0x560e5b6e9800 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe624d97740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b6df4c0 con 0x560e5b6e1170 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe624d97740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b6d6820 con 0x560e5b6e0490 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe61be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e9800 0x560e5b6f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe613e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e1170 0x560e5b6d9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe613e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e1170 0x560e5b6d9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42660/0 (socket says 172.21.15.8:42660) 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe613e00640 1 -- 172.21.15.8:0/961338062 learned_addr learned my addr 172.21.15.8:0/961338062 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe61be00640 1 --2- 172.21.15.8:0/961338062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e9800 0x560e5b6f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39368/0 (socket says 172.21.15.8:39368) 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe61b400640 1 --2- 172.21.15.8:0/961338062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e0490 0x560e5b6e8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe613e00640 1 -- 172.21.15.8:0/961338062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e0490 msgr2=0x560e5b6e8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe613e00640 1 --2- 172.21.15.8:0/961338062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e0490 0x560e5b6e8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe613e00640 1 -- 172.21.15.8:0/961338062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e9800 msgr2=0x560e5b6f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe613e00640 1 --2- 172.21.15.8:0/961338062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e9800 0x560e5b6f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.707+0000 7fe613e00640 1 -- 172.21.15.8:0/961338062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e5b5e2950 con 0x560e5b6e1170 2024-03-16T20:59:18.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.708+0000 7fe613e00640 1 --2- 172.21.15.8:0/961338062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e1170 0x560e5b6d9de0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe60402c170 tx=0x7fe60402c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa2cadf20df707e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.708+0000 7fe60b400640 1 -- 172.21.15.8:0/961338062 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604045040 con 0x560e5b6e1170 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.708+0000 7fe60b400640 1 -- 172.21.15.8:0/961338062 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe604047040 con 0x560e5b6e1170 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.708+0000 7fe60b400640 1 -- 172.21.15.8:0/961338062 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60404da10 con 0x560e5b6e1170 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.709+0000 7fe624d97740 1 -- 172.21.15.8:0/961338062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e1170 msgr2=0x560e5b6d9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.709+0000 7fe624d97740 1 --2- 172.21.15.8:0/961338062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e1170 0x560e5b6d9de0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe60402c170 tx=0x7fe60402c3d0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.709+0000 7fe624d97740 1 -- 172.21.15.8:0/961338062 shutdown_connections 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.709+0000 7fe624d97740 1 --2- 172.21.15.8:0/961338062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e9800 0x560e5b6f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.709+0000 7fe624d97740 1 --2- 172.21.15.8:0/961338062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e1170 0x560e5b6d9de0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.709+0000 7fe624d97740 1 --2- 172.21.15.8:0/961338062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e0490 0x560e5b6e8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.709+0000 7fe624d97740 1 -- 172.21.15.8:0/961338062 >> 172.21.15.8:0/961338062 conn(0x560e5b6a75a0 msgr2=0x560e5b6d96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.709+0000 7fe624d97740 1 -- 172.21.15.8:0/961338062 shutdown_connections 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.709+0000 7fe624d97740 1 -- 172.21.15.8:0/961338062 wait complete. 2024-03-16T20:59:18.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.709+0000 7fe624d97740 1 -- start start 2024-03-16T20:59:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.709+0000 7fe624d97740 1 Processor -- start 2024-03-16T20:59:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe624d97740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e0490 0x560e5b6eed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe624d97740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6ef290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe624d97740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e9800 0x560e5b6ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe624d97740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b753be0 con 0x560e5b6e0490 2024-03-16T20:59:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe624d97740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b753d50 con 0x560e5b6e9800 2024-03-16T20:59:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe624d97740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5b753f10 con 0x560e5b6e1170 2024-03-16T20:59:18.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe624d97740 10 client.0 _ll_register_callbacks cb 0x7fe60c0d1a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe613e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe613e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6ef290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:32976/0 (socket says 172.21.15.8:32976) 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe613e00640 1 -- 172.21.15.8:0/3360056391 learned_addr learned my addr 172.21.15.8:0/3360056391 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe61be00640 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e9800 0x560e5b6ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe61b400640 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e0490 0x560e5b6eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe613e00640 1 -- 172.21.15.8:0/3360056391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e9800 msgr2=0x560e5b6ef7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe613e00640 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e9800 0x560e5b6ef7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe613e00640 1 -- 172.21.15.8:0/3360056391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e0490 msgr2=0x560e5b6eed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe613e00640 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e0490 0x560e5b6eed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.710+0000 7fe613e00640 1 -- 172.21.15.8:0/3360056391 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c110d10 con 0x560e5b6e1170 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.711+0000 7fe61b400640 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e0490 0x560e5b6eed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.711+0000 7fe613e00640 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6ef290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe604005ab0 tx=0x7fe60404d3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa8723db126d416b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.711+0000 7fe608c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.711+0000 7fe608c00640 1 -- 172.21.15.8:0/3360056391 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604045070 con 0x560e5b6e1170 2024-03-16T20:59:18.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.711+0000 7fe608c00640 1 -- 172.21.15.8:0/3360056391 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe60402cab0 con 0x560e5b6e1170 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.711+0000 7fe624d97740 1 -- 172.21.15.8:0/3360056391 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe60c096ac0 con 0x560e5b6e1170 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe608c00640 1 -- 172.21.15.8:0/3360056391 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe60402cc70 con 0x560e5b6e1170 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe624d97740 10 client.25897 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe624d97740 1 -- 172.21.15.8:0/3360056391 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560e5b608430 con 0x560e5b6e1170 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe608c00640 1 -- 172.21.15.8:0/3360056391 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe60c096ac0 con 0x560e5b6e1170 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe608c00640 1 -- 172.21.15.8:0/3360056391 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe60403c040 con 0x560e5b6e1170 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe624d97740 10 client.25897 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe624d97740 10 client.25897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe624d97740 20 client.25897 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe624d97740 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560e5b755470 0x560e5b757890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe624d97740 4 client.25897 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe624d97740 1 -- 172.21.15.8:0/3360056391 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560e5b3d3890 con 0x560e5b755470 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.712+0000 7fe61b400640 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560e5b755470 0x560e5b757890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe61b400640 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560e5b755470 0x560e5b757890 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dea8fe5ed710d4b server_cookie=c5609097f7eaeee3 in_seq=0 out_seq=0 2024-03-16T20:59:18.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe608c00640 10 client.25897 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe608c00640 1 -- 172.21.15.8:0/3360056391 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x7fe60c0b2110 con 0x560e5b755470 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe608c00640 10 client.25897 handle_command_reply: tid=0 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe624d97740 1 client.25897 shutdown 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe624d97740 1 -- 172.21.15.8:0/3360056391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 msgr2=0x560e5b6ef290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe624d97740 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6ef290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe604005ab0 tx=0x7fe60404d3c0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe624d97740 1 -- 172.21.15.8:0/3360056391 shutdown_connections 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe624d97740 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e5b6e9800 0x560e5b6ef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe624d97740 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e5b6e1170 0x560e5b6ef290 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe624d97740 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560e5b755470 0x560e5b757890 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe624d97740 1 --2- 172.21.15.8:0/3360056391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e5b6e0490 0x560e5b6eed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe624d97740 1 -- 172.21.15.8:0/3360056391 >> 172.21.15.8:0/3360056391 conn(0x560e5b6a75a0 msgr2=0x560e5b6dcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe608c00640 0 client.25897 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:18.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.713+0000 7fe624d97740 1 -- 172.21.15.8:0/3360056391 shutdown_connections 2024-03-16T20:59:18.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe624d97740 1 -- 172.21.15.8:0/3360056391 wait complete. 2024-03-16T20:59:18.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe624d97740 20 client.25897 trim_cache size 0 max 16384 2024-03-16T20:59:18.723 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:59:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T20:59:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T20:59:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "8f82dbcb-9f92-428e-8781-9b562eff419f": { 2024-03-16T20:59:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T20:59:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "8f82dbcb-9f92-428e-8781-9b562eff419f", 2024-03-16T20:59:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T20:59:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T20:59:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T20:59:18.724 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:59:18.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe620a00640 1 -- 172.21.15.8:0/4185500816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe6000a1cc0 msgr2=0x7fe6000a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe620a00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe6000a1cc0 0x7fe6000a4180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe614009fd0 tx=0x7fe614009500 comp rx=0 tx=0).stop 2024-03-16T20:59:18.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe620a00640 1 -- 172.21.15.8:0/4185500816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe61c103590 msgr2=0x7fe61c19f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:18.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe620a00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe61c103590 0x7fe61c19f8f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00e9f0 tx=0x7fe60c00eeb0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe620a00640 1 -- 172.21.15.8:0/4185500816 shutdown_connections 2024-03-16T20:59:18.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe620a00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe6000a1cc0 0x7fe6000a4180 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe620a00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe61c109650 0x7fe61c199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe620a00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe61c103f50 0x7fe61c19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe620a00640 1 --2- 172.21.15.8:0/4185500816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe61c103590 0x7fe61c19f8f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:18.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe620a00640 1 -- 172.21.15.8:0/4185500816 >> 172.21.15.8:0/4185500816 conn(0x7fe61c0ff020 msgr2=0x7fe61c100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:18.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.714+0000 7fe620a00640 1 -- 172.21.15.8:0/4185500816 shutdown_connections 2024-03-16T20:59:18.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:18.715+0000 7fe620a00640 1 -- 172.21.15.8:0/4185500816 wait complete. 2024-03-16T20:59:18.737 INFO:tasks.cephfs.filesystem:scrub status for tag:8f82dbcb-9f92-428e-8781-9b562eff419f - {'path': '/', 'tag': '8f82dbcb-9f92-428e-8781-9b562eff419f', 'options': 'recursive,force'} 2024-03-16T20:59:18.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:18 smithi170 ceph-mon[35947]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-03-16T20:59:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:18 smithi186 ceph-mon[36391]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-03-16T20:59:19.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:19 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T20:59:19.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:19 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:19.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:19 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T20:59:19.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:19 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:19.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:19 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T20:59:19.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:19 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:19.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:19 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T20:59:19.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:19 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:19.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:19 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T20:59:19.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:19 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:19.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:19 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T20:59:19.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:19 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:20.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:20 smithi008 ceph-mon[31434]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-03-16T20:59:20.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:20 smithi170 ceph-mon[35947]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-03-16T20:59:20.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:20 smithi186 ceph-mon[36391]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-03-16T20:59:22.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:22 smithi008 ceph-mon[31434]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-03-16T20:59:22.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:22 smithi008 ceph-mon[31434]: mgrmap e27: x(active, since 92s), standbys: z, y 2024-03-16T20:59:22.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:22 smithi170 ceph-mon[35947]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-03-16T20:59:22.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:22 smithi170 ceph-mon[35947]: mgrmap e27: x(active, since 92s), standbys: z, y 2024-03-16T20:59:22.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:22 smithi186 ceph-mon[36391]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-03-16T20:59:22.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:22 smithi186 ceph-mon[36391]: mgrmap e27: x(active, since 92s), standbys: z, y 2024-03-16T20:59:23.242 INFO:tasks.workunit.client.0.smithi008.stderr:+ mkdir untar_tar 2024-03-16T20:59:23.248 INFO:tasks.workunit.client.0.smithi008.stderr:+ cd untar_tar 2024-03-16T20:59:23.248 INFO:tasks.workunit.client.0.smithi008.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-03-16T20:59:23.288 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ 2024-03-16T20:59:23.291 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/00-INDEX 2024-03-16T20:59:23.292 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/ 2024-03-16T20:59:23.294 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/README 2024-03-16T20:59:23.295 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-03-16T20:59:23.296 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-03-16T20:59:23.298 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-03-16T20:59:23.299 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-03-16T20:59:23.299 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-03-16T20:59:23.299 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-03-16T20:59:23.299 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-03-16T20:59:23.299 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-03-16T20:59:23.302 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-03-16T20:59:23.305 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-03-16T20:59:23.305 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-03-16T20:59:23.305 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-03-16T20:59:23.306 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-03-16T20:59:23.306 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-03-16T20:59:23.306 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-03-16T20:59:23.306 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-03-16T20:59:23.310 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-03-16T20:59:23.313 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-03-16T20:59:23.313 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-03-16T20:59:23.313 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-03-16T20:59:23.313 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-03-16T20:59:23.314 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-03-16T20:59:23.314 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-03-16T20:59:23.314 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-03-16T20:59:23.314 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-03-16T20:59:23.314 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-03-16T20:59:23.314 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-03-16T20:59:23.315 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-03-16T20:59:23.315 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-03-16T20:59:23.315 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-03-16T20:59:23.315 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-03-16T20:59:23.315 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-03-16T20:59:23.316 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-03-16T20:59:23.317 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-03-16T20:59:23.317 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-03-16T20:59:23.317 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-03-16T20:59:23.318 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-03-16T20:59:23.319 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-03-16T20:59:23.319 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-03-16T20:59:23.320 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-03-16T20:59:23.321 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-03-16T20:59:23.321 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-03-16T20:59:23.322 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-03-16T20:59:23.332 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-03-16T20:59:23.336 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-03-16T20:59:23.337 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-03-16T20:59:23.337 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-03-16T20:59:23.337 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-03-16T20:59:23.337 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-03-16T20:59:23.338 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-03-16T20:59:23.338 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-03-16T20:59:23.338 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-03-16T20:59:23.339 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-03-16T20:59:23.339 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-03-16T20:59:23.339 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-03-16T20:59:23.340 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-03-16T20:59:23.340 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-03-16T20:59:23.341 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-03-16T20:59:23.341 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-03-16T20:59:23.342 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-03-16T20:59:23.342 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-03-16T20:59:23.342 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-03-16T20:59:23.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-03-16T20:59:23.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-03-16T20:59:23.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-03-16T20:59:23.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-03-16T20:59:23.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-03-16T20:59:23.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-03-16T20:59:23.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-03-16T20:59:23.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-03-16T20:59:23.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-03-16T20:59:23.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-03-16T20:59:23.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-03-16T20:59:23.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-03-16T20:59:23.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-03-16T20:59:23.345 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-03-16T20:59:23.345 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-03-16T20:59:23.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-03-16T20:59:23.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-03-16T20:59:23.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-03-16T20:59:23.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-03-16T20:59:23.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-03-16T20:59:23.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-03-16T20:59:23.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-03-16T20:59:23.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-03-16T20:59:23.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-03-16T20:59:23.347 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-03-16T20:59:23.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-03-16T20:59:23.349 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-03-16T20:59:23.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-03-16T20:59:23.351 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-03-16T20:59:23.351 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-03-16T20:59:23.352 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-03-16T20:59:23.352 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-03-16T20:59:23.352 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-03-16T20:59:23.352 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-03-16T20:59:23.352 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-03-16T20:59:23.353 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-03-16T20:59:23.353 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-03-16T20:59:23.353 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-03-16T20:59:23.353 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-03-16T20:59:23.354 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-03-16T20:59:23.355 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-03-16T20:59:23.355 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-03-16T20:59:23.355 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-03-16T20:59:23.356 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-03-16T20:59:23.356 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-03-16T20:59:23.356 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-03-16T20:59:23.356 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-03-16T20:59:23.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-03-16T20:59:23.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-03-16T20:59:23.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-03-16T20:59:23.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-03-16T20:59:23.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-03-16T20:59:23.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-03-16T20:59:23.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-03-16T20:59:23.358 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-03-16T20:59:23.358 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-03-16T20:59:23.359 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-03-16T20:59:23.359 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-03-16T20:59:23.359 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-03-16T20:59:23.359 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-03-16T20:59:23.360 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-03-16T20:59:23.360 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-03-16T20:59:23.360 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-03-16T20:59:23.360 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-03-16T20:59:23.360 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-03-16T20:59:23.361 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-03-16T20:59:23.361 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-03-16T20:59:23.361 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-03-16T20:59:23.361 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-03-16T20:59:23.364 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-03-16T20:59:23.364 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-03-16T20:59:23.364 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-03-16T20:59:23.364 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-03-16T20:59:23.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-03-16T20:59:23.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-03-16T20:59:23.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-03-16T20:59:23.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-03-16T20:59:23.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-03-16T20:59:23.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-03-16T20:59:23.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-03-16T20:59:23.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-03-16T20:59:23.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-03-16T20:59:23.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-03-16T20:59:23.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-03-16T20:59:23.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-03-16T20:59:23.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-03-16T20:59:23.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-03-16T20:59:23.370 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-03-16T20:59:23.370 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-03-16T20:59:23.370 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-03-16T20:59:23.370 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-03-16T20:59:23.370 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-03-16T20:59:23.370 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-03-16T20:59:23.370 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-03-16T20:59:23.370 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-03-16T20:59:23.370 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-03-16T20:59:23.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-03-16T20:59:23.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-03-16T20:59:23.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-03-16T20:59:23.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-03-16T20:59:23.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-03-16T20:59:23.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-03-16T20:59:23.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-03-16T20:59:23.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-03-16T20:59:23.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-03-16T20:59:23.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-03-16T20:59:23.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-03-16T20:59:23.373 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-03-16T20:59:23.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-03-16T20:59:23.375 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-03-16T20:59:23.375 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-03-16T20:59:23.375 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-03-16T20:59:23.375 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-03-16T20:59:23.375 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-03-16T20:59:23.375 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-03-16T20:59:23.376 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-03-16T20:59:23.376 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-03-16T20:59:23.376 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-03-16T20:59:23.376 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-03-16T20:59:23.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-03-16T20:59:23.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-03-16T20:59:23.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-03-16T20:59:23.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-03-16T20:59:23.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-03-16T20:59:23.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-03-16T20:59:23.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-03-16T20:59:23.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-03-16T20:59:23.379 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-03-16T20:59:23.379 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-03-16T20:59:23.379 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-03-16T20:59:23.379 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-03-16T20:59:23.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-03-16T20:59:23.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-03-16T20:59:23.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-03-16T20:59:23.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-03-16T20:59:23.382 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-03-16T20:59:23.382 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-03-16T20:59:23.382 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-03-16T20:59:23.382 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-03-16T20:59:23.383 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-03-16T20:59:23.383 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-03-16T20:59:23.383 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-03-16T20:59:23.383 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-03-16T20:59:23.383 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-03-16T20:59:23.383 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-03-16T20:59:23.383 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-03-16T20:59:23.383 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/Changes 2024-03-16T20:59:23.383 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-03-16T20:59:23.383 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/CodingStyle 2024-03-16T20:59:23.384 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-03-16T20:59:23.386 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-03-16T20:59:23.387 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-03-16T20:59:23.388 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-03-16T20:59:23.388 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/ 2024-03-16T20:59:23.476 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-03-16T20:59:23.535 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-03-16T20:59:23.535 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-03-16T20:59:23.535 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-03-16T20:59:23.535 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-03-16T20:59:23.535 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-03-16T20:59:23.536 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-03-16T20:59:23.537 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-03-16T20:59:23.537 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-03-16T20:59:23.543 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-03-16T20:59:23.544 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-03-16T20:59:23.545 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-03-16T20:59:23.546 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-03-16T20:59:23.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-03-16T20:59:23.549 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-03-16T20:59:23.552 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-03-16T20:59:23.554 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-03-16T20:59:23.556 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-03-16T20:59:23.556 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-03-16T20:59:23.556 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-03-16T20:59:23.560 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-03-16T20:59:23.562 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-03-16T20:59:23.563 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-03-16T20:59:23.563 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-03-16T20:59:23.563 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-03-16T20:59:23.566 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-03-16T20:59:23.568 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-03-16T20:59:23.568 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-03-16T20:59:23.568 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-03-16T20:59:23.569 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-03-16T20:59:23.569 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-03-16T20:59:23.571 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-03-16T20:59:23.571 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-03-16T20:59:23.572 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-03-16T20:59:23.573 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-03-16T20:59:23.573 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-03-16T20:59:23.575 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-03-16T20:59:23.575 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-03-16T20:59:23.577 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-03-16T20:59:23.581 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-03-16T20:59:23.586 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-03-16T20:59:23.590 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-03-16T20:59:23.590 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-03-16T20:59:23.590 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-03-16T20:59:23.593 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-03-16T20:59:23.594 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-03-16T20:59:23.595 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-03-16T20:59:23.597 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-03-16T20:59:23.597 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-03-16T20:59:23.598 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-03-16T20:59:23.599 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-03-16T20:59:23.602 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-03-16T20:59:23.608 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-03-16T20:59:23.608 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-03-16T20:59:23.608 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-03-16T20:59:23.609 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-03-16T20:59:23.609 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-03-16T20:59:23.609 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-03-16T20:59:23.610 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-03-16T20:59:23.610 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-03-16T20:59:23.610 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-03-16T20:59:23.611 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-03-16T20:59:23.613 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-03-16T20:59:23.614 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-03-16T20:59:23.615 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-03-16T20:59:23.616 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-03-16T20:59:23.617 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-03-16T20:59:23.618 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-03-16T20:59:23.619 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-03-16T20:59:23.619 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-03-16T20:59:23.619 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-03-16T20:59:23.620 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-03-16T20:59:23.620 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-03-16T20:59:23.621 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-03-16T20:59:23.621 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-03-16T20:59:23.621 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-03-16T20:59:23.622 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-03-16T20:59:23.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-03-16T20:59:23.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-03-16T20:59:23.624 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-03-16T20:59:23.625 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-03-16T20:59:23.625 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-03-16T20:59:23.626 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-03-16T20:59:23.626 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-03-16T20:59:23.627 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-03-16T20:59:23.627 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-03-16T20:59:23.628 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-03-16T20:59:23.628 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-03-16T20:59:23.629 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-03-16T20:59:23.629 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-03-16T20:59:23.629 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-03-16T20:59:23.630 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-03-16T20:59:23.630 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-03-16T20:59:23.631 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-03-16T20:59:23.631 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-03-16T20:59:23.632 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-03-16T20:59:23.632 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-03-16T20:59:23.632 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-03-16T20:59:23.633 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-03-16T20:59:23.633 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-03-16T20:59:23.633 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-03-16T20:59:23.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-03-16T20:59:23.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-03-16T20:59:23.635 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-03-16T20:59:23.635 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-03-16T20:59:23.635 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-03-16T20:59:23.637 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-03-16T20:59:23.637 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-03-16T20:59:23.637 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-03-16T20:59:23.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-03-16T20:59:23.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-03-16T20:59:23.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-03-16T20:59:23.639 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-03-16T20:59:23.639 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-03-16T20:59:23.639 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-03-16T20:59:23.640 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-03-16T20:59:23.640 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-03-16T20:59:23.640 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-03-16T20:59:23.641 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-03-16T20:59:23.641 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-03-16T20:59:23.641 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-03-16T20:59:23.641 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-03-16T20:59:23.642 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-03-16T20:59:23.642 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-03-16T20:59:23.642 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-03-16T20:59:23.643 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-03-16T20:59:23.644 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-03-16T20:59:23.645 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-03-16T20:59:23.645 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-03-16T20:59:23.646 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-03-16T20:59:23.646 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-03-16T20:59:23.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-03-16T20:59:23.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-03-16T20:59:23.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-03-16T20:59:23.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-03-16T20:59:23.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-03-16T20:59:23.649 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-03-16T20:59:23.649 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-03-16T20:59:23.650 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-03-16T20:59:23.650 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-03-16T20:59:23.650 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-03-16T20:59:23.652 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-03-16T20:59:23.653 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-03-16T20:59:23.654 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-03-16T20:59:23.655 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-03-16T20:59:23.655 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-03-16T20:59:23.655 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-03-16T20:59:23.656 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-03-16T20:59:23.656 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-03-16T20:59:23.657 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-03-16T20:59:23.658 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-03-16T20:59:23.658 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-03-16T20:59:23.658 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-03-16T20:59:23.659 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-03-16T20:59:23.659 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-03-16T20:59:23.660 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-03-16T20:59:23.660 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-03-16T20:59:23.660 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-03-16T20:59:23.661 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-03-16T20:59:23.662 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-03-16T20:59:23.662 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-03-16T20:59:23.663 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-03-16T20:59:23.663 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-03-16T20:59:23.663 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-03-16T20:59:23.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-03-16T20:59:23.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-03-16T20:59:23.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-03-16T20:59:23.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-03-16T20:59:23.665 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-03-16T20:59:23.665 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-03-16T20:59:23.665 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-03-16T20:59:23.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-03-16T20:59:23.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-03-16T20:59:23.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-03-16T20:59:23.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-03-16T20:59:23.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-03-16T20:59:23.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-03-16T20:59:23.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-03-16T20:59:23.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-03-16T20:59:23.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-03-16T20:59:23.668 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-03-16T20:59:23.668 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-03-16T20:59:23.668 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-03-16T20:59:23.668 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-03-16T20:59:23.669 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-03-16T20:59:23.669 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-03-16T20:59:23.669 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-03-16T20:59:23.669 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-03-16T20:59:23.670 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-03-16T20:59:23.670 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-03-16T20:59:23.670 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-03-16T20:59:23.670 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-03-16T20:59:23.671 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-03-16T20:59:23.671 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-03-16T20:59:23.671 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-03-16T20:59:23.672 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-03-16T20:59:23.672 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-03-16T20:59:23.672 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-03-16T20:59:23.672 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-03-16T20:59:23.672 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-03-16T20:59:23.673 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-03-16T20:59:23.673 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-03-16T20:59:23.673 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-03-16T20:59:23.673 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-03-16T20:59:23.673 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-03-16T20:59:23.673 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-03-16T20:59:23.674 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-03-16T20:59:23.674 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-03-16T20:59:23.674 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-03-16T20:59:23.674 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-03-16T20:59:23.674 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-03-16T20:59:23.675 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-03-16T20:59:23.675 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-03-16T20:59:23.675 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-03-16T20:59:23.675 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-03-16T20:59:23.677 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-03-16T20:59:23.677 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-03-16T20:59:23.677 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-03-16T20:59:23.677 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-03-16T20:59:23.677 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-03-16T20:59:23.678 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-03-16T20:59:23.678 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-03-16T20:59:23.678 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-03-16T20:59:23.679 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-03-16T20:59:23.679 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-03-16T20:59:23.679 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-03-16T20:59:23.680 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-03-16T20:59:23.682 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-03-16T20:59:23.682 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-03-16T20:59:23.687 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-03-16T20:59:23.688 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-03-16T20:59:23.689 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-03-16T20:59:23.689 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/EDID/ 2024-03-16T20:59:23.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:23 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T20:59:23.778 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-03-16T20:59:23.806 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-03-16T20:59:23.806 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-03-16T20:59:23.807 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-03-16T20:59:23.807 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-03-16T20:59:23.807 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-03-16T20:59:23.808 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-03-16T20:59:23.808 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-03-16T20:59:23.808 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-03-16T20:59:23.808 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/EDID/hex 2024-03-16T20:59:23.808 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/HOWTO 2024-03-16T20:59:23.809 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-03-16T20:59:23.809 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-03-16T20:59:23.809 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-03-16T20:59:23.809 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-03-16T20:59:23.810 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-03-16T20:59:23.811 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/Makefile 2024-03-16T20:59:23.811 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-03-16T20:59:23.812 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/PCI/ 2024-03-16T20:59:23.820 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-03-16T20:59:23.824 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-03-16T20:59:23.825 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-03-16T20:59:23.825 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-03-16T20:59:23.825 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-03-16T20:59:23.826 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-03-16T20:59:23.826 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-03-16T20:59:23.826 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/ 2024-03-16T20:59:23.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:23 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T20:59:23.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:23 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T20:59:24.144 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-03-16T20:59:24.146 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-03-16T20:59:24.146 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-03-16T20:59:24.148 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-03-16T20:59:24.149 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-03-16T20:59:24.149 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-03-16T20:59:24.151 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-03-16T20:59:24.152 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-03-16T20:59:24.152 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-03-16T20:59:24.153 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-03-16T20:59:24.153 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-03-16T20:59:24.154 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-03-16T20:59:24.155 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-03-16T20:59:24.157 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-03-16T20:59:24.158 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-03-16T20:59:24.159 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-03-16T20:59:24.160 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-03-16T20:59:24.163 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-03-16T20:59:24.166 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/SAK.txt 2024-03-16T20:59:24.166 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/SM501.txt 2024-03-16T20:59:24.166 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-03-16T20:59:24.167 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-03-16T20:59:24.167 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-03-16T20:59:24.168 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-03-16T20:59:24.168 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-03-16T20:59:24.168 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/accounting/ 2024-03-16T20:59:24.209 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-03-16T20:59:24.219 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-03-16T20:59:24.219 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-03-16T20:59:24.220 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-03-16T20:59:24.220 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-03-16T20:59:24.221 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-03-16T20:59:24.221 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-03-16T20:59:24.222 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/ 2024-03-16T20:59:24.229 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-03-16T20:59:24.233 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-03-16T20:59:24.235 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-03-16T20:59:24.235 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-03-16T20:59:24.239 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-03-16T20:59:24.239 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-03-16T20:59:24.239 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-03-16T20:59:24.240 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-03-16T20:59:24.240 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-03-16T20:59:24.240 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-03-16T20:59:24.241 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-03-16T20:59:24.241 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-03-16T20:59:24.241 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-03-16T20:59:24.242 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/aoe/ 2024-03-16T20:59:24.251 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-03-16T20:59:24.257 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-03-16T20:59:24.257 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-03-16T20:59:24.258 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-03-16T20:59:24.258 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-03-16T20:59:24.259 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-03-16T20:59:24.259 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-03-16T20:59:24.259 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/ 2024-03-16T20:59:24.266 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-03-16T20:59:24.271 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-03-16T20:59:24.272 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-03-16T20:59:24.275 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Booting 2024-03-16T20:59:24.275 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-03-16T20:59:24.276 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-03-16T20:59:24.276 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-03-16T20:59:24.276 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-03-16T20:59:24.277 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-03-16T20:59:24.282 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-03-16T20:59:24.287 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-03-16T20:59:24.287 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-03-16T20:59:24.290 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-03-16T20:59:24.292 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-03-16T20:59:24.293 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Porting 2024-03-16T20:59:24.293 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/README 2024-03-16T20:59:24.294 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-03-16T20:59:24.298 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-03-16T20:59:24.301 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-03-16T20:59:24.301 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-03-16T20:59:24.301 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-03-16T20:59:24.302 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-03-16T20:59:24.302 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-03-16T20:59:24.302 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-03-16T20:59:24.303 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-03-16T20:59:24.303 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-03-16T20:59:24.303 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-03-16T20:59:24.303 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-03-16T20:59:24.305 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-03-16T20:59:24.305 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-03-16T20:59:24.305 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-03-16T20:59:24.306 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-03-16T20:59:24.306 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-03-16T20:59:24.308 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-03-16T20:59:24.309 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-03-16T20:59:24.309 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-03-16T20:59:24.315 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-03-16T20:59:24.317 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-03-16T20:59:24.318 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-03-16T20:59:24.318 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-03-16T20:59:24.318 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-03-16T20:59:24.319 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-03-16T20:59:24.321 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-03-16T20:59:24.324 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-03-16T20:59:24.326 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-03-16T20:59:24.327 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-03-16T20:59:24.327 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-03-16T20:59:24.328 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-03-16T20:59:24.328 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-03-16T20:59:24.328 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-03-16T20:59:24.329 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-03-16T20:59:24.329 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-03-16T20:59:24.329 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-03-16T20:59:24.330 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-03-16T20:59:24.330 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-03-16T20:59:24.331 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-03-16T20:59:24.336 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-03-16T20:59:24.340 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-03-16T20:59:24.340 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-03-16T20:59:24.340 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/Setup 2024-03-16T20:59:24.340 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-03-16T20:59:24.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-03-16T20:59:24.345 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-03-16T20:59:24.345 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-03-16T20:59:24.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-03-16T20:59:24.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-03-16T20:59:24.347 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-03-16T20:59:24.347 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-03-16T20:59:24.347 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-03-16T20:59:24.351 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-03-16T20:59:24.354 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-03-16T20:59:24.355 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-03-16T20:59:24.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-03-16T20:59:24.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-03-16T20:59:24.358 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-03-16T20:59:24.358 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-03-16T20:59:24.360 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-03-16T20:59:24.362 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-03-16T20:59:24.364 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-03-16T20:59:24.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-03-16T20:59:24.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-03-16T20:59:24.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-03-16T20:59:24.367 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-03-16T20:59:24.367 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-03-16T20:59:24.370 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-03-16T20:59:24.372 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-03-16T20:59:24.372 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-03-16T20:59:24.373 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-03-16T20:59:24.373 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-03-16T20:59:24.373 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-03-16T20:59:24.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm64/ 2024-03-16T20:59:24.378 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-03-16T20:59:24.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-03-16T20:59:24.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-03-16T20:59:24.382 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-03-16T20:59:24.382 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-03-16T20:59:24.383 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-03-16T20:59:24.384 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-03-16T20:59:24.388 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-03-16T20:59:24.390 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-03-16T20:59:24.391 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-03-16T20:59:24.391 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-03-16T20:59:24.392 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-03-16T20:59:24.392 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/backlight/ 2024-03-16T20:59:24.394 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-03-16T20:59:24.396 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-03-16T20:59:24.396 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-03-16T20:59:24.397 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/bcache.txt 2024-03-16T20:59:24.397 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-03-16T20:59:24.398 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blackfin/ 2024-03-16T20:59:24.400 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-03-16T20:59:24.402 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-03-16T20:59:24.402 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-03-16T20:59:24.403 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-03-16T20:59:24.403 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-03-16T20:59:24.405 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/ 2024-03-16T20:59:24.406 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-03-16T20:59:24.408 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-03-16T20:59:24.409 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-03-16T20:59:24.409 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-03-16T20:59:24.410 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-03-16T20:59:24.410 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-03-16T20:59:24.410 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-03-16T20:59:24.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-03-16T20:59:24.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-03-16T20:59:24.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-03-16T20:59:24.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-03-16T20:59:24.412 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/request.txt 2024-03-16T20:59:24.413 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-03-16T20:59:24.413 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-03-16T20:59:24.413 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-03-16T20:59:24.414 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/ 2024-03-16T20:59:24.421 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-03-16T20:59:24.425 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-03-16T20:59:24.425 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-03-16T20:59:24.426 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-03-16T20:59:24.426 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-03-16T20:59:24.429 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-03-16T20:59:24.431 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-03-16T20:59:24.431 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-03-16T20:59:24.431 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-03-16T20:59:24.432 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-03-16T20:59:24.432 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-03-16T20:59:24.433 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-03-16T20:59:24.433 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-03-16T20:59:24.433 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-03-16T20:59:24.435 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-03-16T20:59:24.436 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-03-16T20:59:24.437 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-03-16T20:59:24.438 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-03-16T20:59:24.439 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-03-16T20:59:24.439 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-03-16T20:59:24.440 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-03-16T20:59:24.441 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-03-16T20:59:24.441 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-03-16T20:59:24.446 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-03-16T20:59:24.449 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-03-16T20:59:24.449 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-03-16T20:59:24.449 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cdrom/ 2024-03-16T20:59:24.452 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-03-16T20:59:24.454 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-03-16T20:59:24.454 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-03-16T20:59:24.455 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-03-16T20:59:24.455 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-03-16T20:59:24.455 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/ 2024-03-16T20:59:24.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-03-16T20:59:24.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-03-16T20:59:24.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-03-16T20:59:24.462 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-03-16T20:59:24.462 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-03-16T20:59:24.463 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-03-16T20:59:24.463 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-03-16T20:59:24.463 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-03-16T20:59:24.464 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-03-16T20:59:24.464 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-03-16T20:59:24.465 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-03-16T20:59:24.466 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-03-16T20:59:24.466 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-03-16T20:59:24.466 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-03-16T20:59:24.467 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/clk.txt 2024-03-16T20:59:24.467 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-03-16T20:59:24.468 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/connector/ 2024-03-16T20:59:24.475 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-03-16T20:59:24.479 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-03-16T20:59:24.479 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-03-16T20:59:24.480 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-03-16T20:59:24.480 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-03-16T20:59:24.481 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/console/ 2024-03-16T20:59:24.484 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/console/console.txt 2024-03-16T20:59:24.486 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-03-16T20:59:24.488 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-03-16T20:59:24.489 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-03-16T20:59:24.490 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-03-16T20:59:24.490 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-03-16T20:59:24.490 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-03-16T20:59:24.491 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-03-16T20:59:24.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-03-16T20:59:24.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-03-16T20:59:24.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-03-16T20:59:24.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-03-16T20:59:24.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-03-16T20:59:24.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-03-16T20:59:24.495 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-03-16T20:59:24.496 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-03-16T20:59:24.501 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-03-16T20:59:24.505 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-03-16T20:59:24.505 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-03-16T20:59:24.505 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-03-16T20:59:24.505 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-03-16T20:59:24.506 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/crc32.txt 2024-03-16T20:59:24.506 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cris/ 2024-03-16T20:59:24.510 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/cris/README 2024-03-16T20:59:24.512 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/crypto/ 2024-03-16T20:59:24.514 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-03-16T20:59:24.516 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-03-16T20:59:24.516 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-03-16T20:59:24.517 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-03-16T20:59:24.517 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-03-16T20:59:24.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-03-16T20:59:24.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-03-16T20:59:24.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-03-16T20:59:24.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-03-16T20:59:24.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/development-process/ 2024-03-16T20:59:24.524 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-03-16T20:59:24.527 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-03-16T20:59:24.527 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-03-16T20:59:24.528 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-03-16T20:59:24.528 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-03-16T20:59:24.529 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-03-16T20:59:24.529 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-03-16T20:59:24.530 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-03-16T20:59:24.530 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-03-16T20:59:24.533 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-03-16T20:59:24.537 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-03-16T20:59:24.538 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-03-16T20:59:24.538 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-03-16T20:59:24.538 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-03-16T20:59:24.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-03-16T20:59:24.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-03-16T20:59:24.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-03-16T20:59:24.540 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-03-16T20:59:24.540 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-03-16T20:59:24.540 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-03-16T20:59:24.540 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-03-16T20:59:24.542 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-03-16T20:59:24.542 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-03-16T20:59:24.543 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-03-16T20:59:24.543 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-03-16T20:59:24.543 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-03-16T20:59:24.544 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-03-16T20:59:24.544 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-03-16T20:59:24.545 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-03-16T20:59:24.546 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-03-16T20:59:24.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-03-16T20:59:24.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devices.txt 2024-03-16T20:59:24.550 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/ 2024-03-16T20:59:24.566 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-03-16T20:59:24.574 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-03-16T20:59:24.575 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-03-16T20:59:24.577 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-03-16T20:59:24.579 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-03-16T20:59:24.581 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-03-16T20:59:24.581 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-03-16T20:59:24.584 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-03-16T20:59:24.586 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-03-16T20:59:24.588 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-03-16T20:59:24.592 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-03-16T20:59:24.592 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-03-16T20:59:24.593 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-03-16T20:59:24.593 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-03-16T20:59:24.593 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-03-16T20:59:24.594 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-03-16T20:59:24.594 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-03-16T20:59:24.594 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-03-16T20:59:24.595 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-03-16T20:59:24.595 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-03-16T20:59:24.596 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-03-16T20:59:24.597 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-03-16T20:59:24.597 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-03-16T20:59:24.597 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-03-16T20:59:24.598 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-03-16T20:59:24.598 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-03-16T20:59:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.595+0000 7f44b5c00640 1 -- 172.21.15.8:0/2716387178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44b0073920 msgr2=0x7f44b0073d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.595+0000 7f44b5c00640 1 --2- 172.21.15.8:0/2716387178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44b0073920 0x7f44b0073d00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009900 tx=0x7f44a002bcd0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.595+0000 7f44b5c00640 1 -- 172.21.15.8:0/2716387178 shutdown_connections 2024-03-16T20:59:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.595+0000 7f44b5c00640 1 --2- 172.21.15.8:0/2716387178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b010db10 0x7f44b010ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.595+0000 7f44b5c00640 1 --2- 172.21.15.8:0/2716387178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44b0074240 0x7f44b010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.595+0000 7f44b5c00640 1 --2- 172.21.15.8:0/2716387178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44b0073920 0x7f44b0073d00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.595+0000 7f44b5c00640 1 -- 172.21.15.8:0/2716387178 >> 172.21.15.8:0/2716387178 conn(0x7f44b00fce40 msgr2=0x7f44b00ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.596+0000 7f44b5c00640 1 -- 172.21.15.8:0/2716387178 shutdown_connections 2024-03-16T20:59:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.596+0000 7f44b5c00640 1 -- 172.21.15.8:0/2716387178 wait complete. 2024-03-16T20:59:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.597+0000 7f44b5c00640 1 Processor -- start 2024-03-16T20:59:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.597+0000 7f44b5c00640 1 -- start start 2024-03-16T20:59:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.597+0000 7f44b5c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b0073920 0x7f44b019f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.597+0000 7f44b5c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44b0074240 0x7f44b019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.597+0000 7f44b5c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44b010db10 0x7f44b0199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.597+0000 7f44b5c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b019a120 con 0x7f44b0073920 2024-03-16T20:59:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.597+0000 7f44b5c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b019a290 con 0x7f44b0074240 2024-03-16T20:59:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.597+0000 7f44b5c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b019a450 con 0x7f44b010db10 2024-03-16T20:59:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.598+0000 7f44af400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44b0074240 0x7f44b019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.598+0000 7f44af400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44b0074240 0x7f44b019fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42700/0 (socket says 172.21.15.8:42700) 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.598+0000 7f44af400640 1 -- 172.21.15.8:0/3805090227 learned_addr learned my addr 172.21.15.8:0/3805090227 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.598+0000 7f44afe00640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b0073920 0x7f44b019f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.598+0000 7f44b5200640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44b010db10 0x7f44b0199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.598+0000 7f44af400640 1 -- 172.21.15.8:0/3805090227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44b010db10 msgr2=0x7f44b0199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.598+0000 7f44af400640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44b010db10 0x7f44b0199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.598+0000 7f44af400640 1 -- 172.21.15.8:0/3805090227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b0073920 msgr2=0x7f44b019f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.598+0000 7f44af400640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b0073920 0x7f44b019f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.598+0000 7f44af400640 1 -- 172.21.15.8:0/3805090227 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a0009560 con 0x7f44b0074240 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.599+0000 7f44af400640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44b0074240 0x7f44b019fe10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9f0 tx=0x7f449c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.599+0000 7f44acc00640 1 -- 172.21.15.8:0/3805090227 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c009700 con 0x7f44b0074240 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.599+0000 7f44acc00640 1 -- 172.21.15.8:0/3805090227 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f449c00cd80 con 0x7f44b0074240 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.599+0000 7f44acc00640 1 -- 172.21.15.8:0/3805090227 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c0189c0 con 0x7f44b0074240 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.599+0000 7f44b5c00640 1 -- 172.21.15.8:0/3805090227 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b019a730 con 0x7f44b0074240 2024-03-16T20:59:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.599+0000 7f44b5c00640 1 -- 172.21.15.8:0/3805090227 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b01a6970 con 0x7f44b0074240 2024-03-16T20:59:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.603+0000 7f44b9fce740 1 Processor -- start 2024-03-16T20:59:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.603+0000 7f44acc00640 1 -- 172.21.15.8:0/3805090227 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f449c018b20 con 0x7f44b0074240 2024-03-16T20:59:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.603+0000 7f44b9fce740 1 -- start start 2024-03-16T20:59:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.603+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.603+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54159ff0 0x556c5415a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.603+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54163570 0x556c54165960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.603+0000 7f44b9fce740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c54115620 con 0x556c54159ff0 2024-03-16T20:59:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.603+0000 7f44b9fce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c540c78c0 con 0x556c5415ad60 2024-03-16T20:59:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.603+0000 7f44b9fce740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c540c4df0 con 0x556c54163570 2024-03-16T20:59:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44b5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44b5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42716/0 (socket says 172.21.15.8:42716) 2024-03-16T20:59:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44b5200640 1 -- 172.21.15.8:0/384722183 learned_addr learned my addr 172.21.15.8:0/384722183 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44af400640 1 --2- 172.21.15.8:0/384722183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54163570 0x556c54165960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44afe00640 1 --2- 172.21.15.8:0/384722183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54159ff0 0x556c5415a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.610 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-03-16T20:59:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44b5200640 1 -- 172.21.15.8:0/384722183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54163570 msgr2=0x556c54165960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44b5200640 1 --2- 172.21.15.8:0/384722183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54163570 0x556c54165960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44b5200640 1 -- 172.21.15.8:0/384722183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54159ff0 msgr2=0x556c5415a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44b5200640 1 --2- 172.21.15.8:0/384722183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54159ff0 0x556c5415a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44b5200640 1 -- 172.21.15.8:0/384722183 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c54041b00 con 0x556c5415ad60 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44af400640 1 --2- 172.21.15.8:0/384722183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54163570 0x556c54165960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44b5200640 1 --2- 172.21.15.8:0/384722183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54159ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009f90 tx=0x7f44a8010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea9585fa52cb6b06 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.604+0000 7f44acc00640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f44940a1b90 0x7f44940a4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.605+0000 7f44a5600640 1 -- 172.21.15.8:0/384722183 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8011700 con 0x556c5415ad60 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.605+0000 7f44a5600640 1 -- 172.21.15.8:0/384722183 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f44a8015070 con 0x556c5415ad60 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.605+0000 7f44acc00640 1 -- 172.21.15.8:0/3805090227 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f449c014070 con 0x7f44b0074240 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.605+0000 7f44a5600640 1 -- 172.21.15.8:0/384722183 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8019d40 con 0x556c5415ad60 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.605+0000 7f44afe00640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f44940a1b90 0x7f44940a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.605+0000 7f44b9fce740 1 -- 172.21.15.8:0/384722183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 msgr2=0x556c54159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.605+0000 7f44b9fce740 1 --2- 172.21.15.8:0/384722183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54159ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009f90 tx=0x7f44a8010860 comp rx=0 tx=0).stop 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.606+0000 7f44b9fce740 1 -- 172.21.15.8:0/384722183 shutdown_connections 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.606+0000 7f44b9fce740 1 --2- 172.21.15.8:0/384722183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54163570 0x556c54165960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.606+0000 7f44b9fce740 1 --2- 172.21.15.8:0/384722183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54159ff0 0x556c5415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.606+0000 7f44b9fce740 1 --2- 172.21.15.8:0/384722183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54159ab0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.606+0000 7f44b9fce740 1 -- 172.21.15.8:0/384722183 >> 172.21.15.8:0/384722183 conn(0x556c541214b0 msgr2=0x556c54154ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.606+0000 7f44afe00640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f44940a1b90 0x7f44940a4050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44b0110060 tx=0x7f44a002df90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.606+0000 7f44b9fce740 1 -- 172.21.15.8:0/384722183 shutdown_connections 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.606+0000 7f44b9fce740 1 -- 172.21.15.8:0/384722183 wait complete. 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.606+0000 7f44b9fce740 1 -- start start 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.606+0000 7f44b9fce740 1 Processor -- start 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54159ff0 0x556c54160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c541610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44b9fce740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c540c05d0 con 0x556c54163570 2024-03-16T20:59:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44b9fce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c54065b50 con 0x556c5415ad60 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44b9fce740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c540657f0 con 0x556c54159ff0 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44b9fce740 10 client.0 _ll_register_callbacks cb 0x556c54079550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44afe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54159ff0 0x556c54160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44af400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44b5200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c541610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44af400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42730/0 (socket says 172.21.15.8:42730) 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44afe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54159ff0 0x556c54160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33022/0 (socket says 172.21.15.8:33022) 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44af400640 1 -- 172.21.15.8:0/3893782739 learned_addr learned my addr 172.21.15.8:0/3893782739 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44af400640 1 -- 172.21.15.8:0/3893782739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54159ff0 msgr2=0x556c54160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44af400640 1 --2- 172.21.15.8:0/3893782739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54159ff0 0x556c54160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44af400640 1 -- 172.21.15.8:0/3893782739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 msgr2=0x556c541610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.607+0000 7f44af400640 1 --2- 172.21.15.8:0/3893782739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c541610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.608+0000 7f44af400640 1 -- 172.21.15.8:0/3893782739 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a8009bf0 con 0x556c5415ad60 2024-03-16T20:59:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.608+0000 7f44af400640 1 --2- 172.21.15.8:0/3893782739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54160b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9c0 tx=0x7f449c09a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e588d1875d0bd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.608+0000 7f449a000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.608+0000 7f449a000640 1 -- 172.21.15.8:0/3893782739 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c0cb700 con 0x556c5415ad60 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.608+0000 7f449a000640 1 -- 172.21.15.8:0/3893782739 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f449c09e8b0 con 0x556c5415ad60 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.608+0000 7f44b9fce740 1 -- 172.21.15.8:0/3893782739 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c54092cd0 con 0x556c5415ad60 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.608+0000 7f449a000640 1 -- 172.21.15.8:0/3893782739 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f449c0a2f00 con 0x556c5415ad60 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.608+0000 7f44b9fce740 10 client.25898 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.608+0000 7f44b9fce740 1 -- 172.21.15.8:0/3893782739 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556c540bec50 con 0x556c5415ad60 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.609+0000 7f449a000640 1 -- 172.21.15.8:0/3893782739 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x556c54092cd0 con 0x556c5415ad60 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.609+0000 7f449a000640 1 -- 172.21.15.8:0/3893782739 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f449c0850b0 con 0x556c5415ad60 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.609+0000 7f44b9fce740 10 client.25898 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.609+0000 7f44b9fce740 10 client.25898 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.609+0000 7f44b9fce740 20 client.25898 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.609+0000 7f44b9fce740 1 --2- 172.21.15.8:0/3893782739 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c541736a0 0x556c54175ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.609+0000 7f44b9fce740 4 client.25898 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.609+0000 7f44b9fce740 1 -- 172.21.15.8:0/3893782739 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c540b6ce0 con 0x556c541736a0 2024-03-16T20:59:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.609+0000 7f44afe00640 1 --2- 172.21.15.8:0/3893782739 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c541736a0 0x556c54175ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.610+0000 7f44afe00640 1 --2- 172.21.15.8:0/3893782739 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c541736a0 0x556c54175ac0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f87d9a191a2d2740 server_cookie=4d9ea17b9c7e366a in_seq=0 out_seq=0 2024-03-16T20:59:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.610+0000 7f449a000640 10 client.25898 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f449a000640 1 -- 172.21.15.8:0/3893782739 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556c540b6ce0 con 0x556c541736a0 2024-03-16T20:59:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f449a000640 10 client.25898 handle_command_reply: tid=0 2024-03-16T20:59:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f44b9fce740 1 client.25898 shutdown 2024-03-16T20:59:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f44b9fce740 1 -- 172.21.15.8:0/3893782739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 msgr2=0x556c54160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f44b9fce740 1 --2- 172.21.15.8:0/3893782739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54160b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9c0 tx=0x7f449c09a660 comp rx=0 tx=0).stop 2024-03-16T20:59:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f44b9fce740 1 -- 172.21.15.8:0/3893782739 shutdown_connections 2024-03-16T20:59:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f44b9fce740 1 --2- 172.21.15.8:0/3893782739 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c541736a0 0x556c54175ac0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f44b9fce740 1 --2- 172.21.15.8:0/3893782739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c541610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f44b9fce740 1 --2- 172.21.15.8:0/3893782739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c5415ad60 0x556c54160b90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f44b9fce740 1 --2- 172.21.15.8:0/3893782739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c54159ff0 0x556c54160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f44b9fce740 1 -- 172.21.15.8:0/3893782739 >> 172.21.15.8:0/3893782739 conn(0x556c541214b0 msgr2=0x556c54156a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f449a000640 0 client.25898 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.611+0000 7f44b9fce740 1 -- 172.21.15.8:0/3893782739 shutdown_connections 2024-03-16T20:59:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.612+0000 7f44b9fce740 1 -- 172.21.15.8:0/3893782739 wait complete. 2024-03-16T20:59:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.612+0000 7f44b9fce740 20 client.25898 trim_cache size 0 max 16384 2024-03-16T20:59:24.622 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-03-16T20:59:24.622 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-03-16T20:59:24.622 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-03-16T20:59:24.622 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-03-16T20:59:24.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-03-16T20:59:24.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-03-16T20:59:24.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-03-16T20:59:24.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-03-16T20:59:24.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-03-16T20:59:24.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-03-16T20:59:24.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-03-16T20:59:24.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-03-16T20:59:24.627 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-03-16T20:59:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.627+0000 7f44b9fce740 1 Processor -- start 2024-03-16T20:59:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.627+0000 7f44b9fce740 1 -- start start 2024-03-16T20:59:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.627+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c54162d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.627+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 0x556c54160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.627+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c54156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.627+0000 7f44b9fce740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c53e08e60 con 0x556c54163570 2024-03-16T20:59:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.627+0000 7f44b9fce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5414f150 con 0x556c54159ff0 2024-03-16T20:59:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.627+0000 7f44b9fce740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c541505a0 con 0x556c5415ad60 2024-03-16T20:59:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44af400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 0x556c54160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44afe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c54162d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44b5200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c54156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44afe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c54162d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42742/0 (socket says 172.21.15.8:42742) 2024-03-16T20:59:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44af400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 0x556c54160ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33036/0 (socket says 172.21.15.8:33036) 2024-03-16T20:59:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44afe00640 1 -- 172.21.15.8:0/3705427503 learned_addr learned my addr 172.21.15.8:0/3705427503 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44afe00640 1 -- 172.21.15.8:0/3705427503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 msgr2=0x556c54160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44afe00640 1 --2- 172.21.15.8:0/3705427503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 0x556c54160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44afe00640 1 -- 172.21.15.8:0/3705427503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 msgr2=0x556c54156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44afe00640 1 --2- 172.21.15.8:0/3705427503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c54156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44afe00640 1 -- 172.21.15.8:0/3705427503 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c5405b530 con 0x556c54159ff0 2024-03-16T20:59:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44af400640 1 --2- 172.21.15.8:0/3705427503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 0x556c54160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44b5200640 1 --2- 172.21.15.8:0/3705427503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c54156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.628+0000 7f44afe00640 1 --2- 172.21.15.8:0/3705427503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c54162d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009230 tx=0x7f44a0041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=407e292633879fbc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44a4c00640 1 -- 172.21.15.8:0/3705427503 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0050040 con 0x556c54159ff0 2024-03-16T20:59:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44a4c00640 1 -- 172.21.15.8:0/3705427503 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f44a0043070 con 0x556c54159ff0 2024-03-16T20:59:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44a4c00640 1 -- 172.21.15.8:0/3705427503 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0057a70 con 0x556c54159ff0 2024-03-16T20:59:24.636 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-03-16T20:59:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44b9fce740 1 -- 172.21.15.8:0/3705427503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 msgr2=0x556c54162d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44b9fce740 1 --2- 172.21.15.8:0/3705427503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c54162d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009230 tx=0x7f44a0041000 comp rx=0 tx=0).stop 2024-03-16T20:59:24.636 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-03-16T20:59:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44b9fce740 1 -- 172.21.15.8:0/3705427503 shutdown_connections 2024-03-16T20:59:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44b9fce740 1 --2- 172.21.15.8:0/3705427503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c54156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44b9fce740 1 --2- 172.21.15.8:0/3705427503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 0x556c54160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44b9fce740 1 --2- 172.21.15.8:0/3705427503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c54162d80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44b9fce740 1 -- 172.21.15.8:0/3705427503 >> 172.21.15.8:0/3705427503 conn(0x556c541214b0 msgr2=0x556c54156130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44b9fce740 1 -- 172.21.15.8:0/3705427503 shutdown_connections 2024-03-16T20:59:24.637 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-03-16T20:59:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.629+0000 7f44b9fce740 1 -- 172.21.15.8:0/3705427503 wait complete. 2024-03-16T20:59:24.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-03-16T20:59:24.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-03-16T20:59:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.630+0000 7f44b9fce740 1 -- start start 2024-03-16T20:59:24.639 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-03-16T20:59:24.639 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-03-16T20:59:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.630+0000 7f44b9fce740 1 Processor -- start 2024-03-16T20:59:24.639 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-03-16T20:59:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.630+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c541651f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.630+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 0x556c5415c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.630+0000 7f44b9fce740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c5415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44b9fce740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5415d430 con 0x556c54163570 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44b9fce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5415d5a0 con 0x556c54159ff0 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44b9fce740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5415d760 con 0x556c5415ad60 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44b9fce740 10 client.0 _ll_register_callbacks cb 0x7f449c096b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44afe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c541651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44b5200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c5415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44afe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c541651f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42758/0 (socket says 172.21.15.8:42758) 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44afe00640 1 -- 172.21.15.8:0/2116163023 learned_addr learned my addr 172.21.15.8:0/2116163023 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44af400640 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 0x556c5415c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44afe00640 1 -- 172.21.15.8:0/2116163023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 msgr2=0x556c5415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44afe00640 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 0x556c5415c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44afe00640 1 -- 172.21.15.8:0/2116163023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 msgr2=0x556c5415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44afe00640 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c5415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44afe00640 1 -- 172.21.15.8:0/2116163023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c540bec50 con 0x556c54159ff0 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f44afe00640 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c541651f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f44a0036040 tx=0x7f44a0005900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=992f681109f73096 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.631+0000 7f449a000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.632+0000 7f449a000640 1 -- 172.21.15.8:0/2116163023 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0050040 con 0x556c54159ff0 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.632+0000 7f449a000640 1 -- 172.21.15.8:0/2116163023 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f44a0004240 con 0x556c54159ff0 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.632+0000 7f44b9fce740 1 -- 172.21.15.8:0/2116163023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c540e5d30 con 0x556c54159ff0 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.632+0000 7f449a000640 1 -- 172.21.15.8:0/2116163023 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44a002cdd0 con 0x556c54159ff0 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.632+0000 7f44b9fce740 10 client.25904 fetch_fsmap learned FSMap version 24 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.632+0000 7f44b9fce740 1 -- 172.21.15.8:0/2116163023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f44a801e040 con 0x556c54159ff0 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.632+0000 7f449a000640 1 -- 172.21.15.8:0/2116163023 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x556c540e5d30 con 0x556c54159ff0 2024-03-16T20:59:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.632+0000 7f449a000640 1 -- 172.21.15.8:0/2116163023 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f44a005e070 con 0x556c54159ff0 2024-03-16T20:59:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.633+0000 7f44b9fce740 10 client.25904 fetch_fsmap finished waiting for FSMap version 24 2024-03-16T20:59:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.633+0000 7f44b9fce740 10 client.25904 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.633+0000 7f44b9fce740 20 client.25904 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.633+0000 7f44b9fce740 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c541d01f0 0x556c541d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.633+0000 7f44b9fce740 4 client.25904 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T20:59:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.633+0000 7f44b9fce740 1 -- 172.21.15.8:0/2116163023 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556c53dc0600 con 0x556c541d01f0 2024-03-16T20:59:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.633+0000 7f44af400640 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c541d01f0 0x556c541d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.633+0000 7f44af400640 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c541d01f0 0x556c541d2610 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9927be879c285d6 server_cookie=9b541016ea8ad685 in_seq=0 out_seq=0 2024-03-16T20:59:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:24.633+0000 7f449a000640 10 client.25904 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:24.644 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-03-16T20:59:24.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-03-16T20:59:24.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-03-16T20:59:24.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-03-16T20:59:24.652 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-03-16T20:59:24.655 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-03-16T20:59:24.655 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-03-16T20:59:24.658 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-03-16T20:59:24.660 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-03-16T20:59:24.661 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-03-16T20:59:24.663 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-03-16T20:59:24.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-03-16T20:59:24.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-03-16T20:59:24.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-03-16T20:59:24.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-03-16T20:59:24.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-03-16T20:59:24.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-03-16T20:59:24.668 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-03-16T20:59:24.675 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-03-16T20:59:24.682 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-03-16T20:59:24.683 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-03-16T20:59:24.683 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-03-16T20:59:24.687 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-03-16T20:59:24.691 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-03-16T20:59:24.691 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-03-16T20:59:24.691 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-03-16T20:59:24.692 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-03-16T20:59:24.692 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-03-16T20:59:24.693 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-03-16T20:59:24.693 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-03-16T20:59:24.693 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-03-16T20:59:24.694 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-03-16T20:59:24.703 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-03-16T20:59:24.709 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-03-16T20:59:24.709 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-03-16T20:59:24.712 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-03-16T20:59:24.715 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-03-16T20:59:24.715 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-03-16T20:59:24.715 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-03-16T20:59:24.716 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-03-16T20:59:24.716 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-03-16T20:59:24.722 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-03-16T20:59:24.725 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-03-16T20:59:24.726 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-03-16T20:59:24.726 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-03-16T20:59:24.727 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-03-16T20:59:24.727 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-03-16T20:59:24.727 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-03-16T20:59:24.728 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-03-16T20:59:24.734 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-03-16T20:59:24.738 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-03-16T20:59:24.738 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-03-16T20:59:24.739 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-03-16T20:59:24.739 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-03-16T20:59:24.739 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-03-16T20:59:24.740 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-03-16T20:59:24.740 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-03-16T20:59:24.740 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-03-16T20:59:24.741 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-03-16T20:59:24.741 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-03-16T20:59:24.742 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-03-16T20:59:24.744 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-03-16T20:59:24.744 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-03-16T20:59:24.745 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-03-16T20:59:24.746 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-03-16T20:59:24.746 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-03-16T20:59:24.757 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-03-16T20:59:24.763 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-03-16T20:59:24.764 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-03-16T20:59:24.765 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-03-16T20:59:24.766 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-03-16T20:59:24.766 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-03-16T20:59:24.772 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-03-16T20:59:24.776 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-03-16T20:59:24.777 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-03-16T20:59:24.778 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-03-16T20:59:24.778 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-03-16T20:59:24.779 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-03-16T20:59:24.779 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-03-16T20:59:24.780 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-03-16T20:59:24.780 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-03-16T20:59:24.780 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-03-16T20:59:24.781 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-03-16T20:59:24.788 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-03-16T20:59:24.794 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-03-16T20:59:24.794 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-03-16T20:59:24.794 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-03-16T20:59:24.795 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-03-16T20:59:24.795 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-03-16T20:59:24.796 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-03-16T20:59:24.796 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-03-16T20:59:24.804 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-03-16T20:59:24.809 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-03-16T20:59:24.810 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-03-16T20:59:24.810 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-03-16T20:59:24.811 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-03-16T20:59:24.811 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-03-16T20:59:24.811 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-03-16T20:59:24.812 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-03-16T20:59:24.813 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-03-16T20:59:24.820 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-03-16T20:59:24.825 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-03-16T20:59:24.825 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-03-16T20:59:24.826 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-03-16T20:59:24.826 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-03-16T20:59:24.826 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-03-16T20:59:24.827 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-03-16T20:59:24.827 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-03-16T20:59:24.827 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-03-16T20:59:24.833 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-03-16T20:59:24.837 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-03-16T20:59:24.838 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-03-16T20:59:24.838 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-03-16T20:59:24.838 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-03-16T20:59:24.839 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-03-16T20:59:24.842 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-03-16T20:59:24.845 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-03-16T20:59:24.846 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-03-16T20:59:24.846 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-03-16T20:59:24.846 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-03-16T20:59:24.847 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-03-16T20:59:24.847 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-03-16T20:59:24.847 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-03-16T20:59:24.848 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-03-16T20:59:24.848 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-03-16T20:59:24.848 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-03-16T20:59:24.850 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-03-16T20:59:24.850 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-03-16T20:59:24.851 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-03-16T20:59:24.851 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-03-16T20:59:24.851 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-03-16T20:59:24.852 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-03-16T20:59:24.863 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-03-16T20:59:24.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:24 smithi170 ceph-mon[35947]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-03-16T20:59:24.876 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-03-16T20:59:24.876 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-03-16T20:59:24.877 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-03-16T20:59:24.877 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-03-16T20:59:24.878 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-03-16T20:59:24.878 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-03-16T20:59:24.884 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-03-16T20:59:24.890 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-03-16T20:59:24.891 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-03-16T20:59:24.892 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-03-16T20:59:24.892 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-03-16T20:59:24.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:24 smithi186 ceph-mon[36391]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-03-16T20:59:24.893 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-03-16T20:59:24.893 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-03-16T20:59:24.894 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-03-16T20:59:24.903 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-03-16T20:59:24.909 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-03-16T20:59:24.910 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-03-16T20:59:24.910 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-03-16T20:59:24.911 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-03-16T20:59:24.911 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-03-16T20:59:24.912 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-03-16T20:59:24.912 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-03-16T20:59:24.913 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-03-16T20:59:24.913 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-03-16T20:59:24.914 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-03-16T20:59:24.914 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-03-16T20:59:24.914 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-03-16T20:59:24.915 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-03-16T20:59:24.915 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-03-16T20:59:24.916 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-03-16T20:59:24.916 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-03-16T20:59:24.916 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-03-16T20:59:24.916 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-03-16T20:59:24.918 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-03-16T20:59:24.918 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-03-16T20:59:24.919 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-03-16T20:59:24.919 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-03-16T20:59:24.919 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-03-16T20:59:24.920 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-03-16T20:59:24.920 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-03-16T20:59:24.921 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-03-16T20:59:24.921 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-03-16T20:59:24.922 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-03-16T20:59:24.922 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-03-16T20:59:24.922 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-03-16T20:59:24.923 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-03-16T20:59:24.923 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-03-16T20:59:24.924 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-03-16T20:59:24.924 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-03-16T20:59:24.925 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-03-16T20:59:24.925 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-03-16T20:59:24.925 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-03-16T20:59:24.926 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-03-16T20:59:24.926 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-03-16T20:59:24.927 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-03-16T20:59:24.928 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-03-16T20:59:24.928 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-03-16T20:59:24.928 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-03-16T20:59:24.929 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-03-16T20:59:24.929 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-03-16T20:59:24.930 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-03-16T20:59:24.930 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-03-16T20:59:24.931 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-03-16T20:59:24.931 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-03-16T20:59:24.931 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-03-16T20:59:24.932 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-03-16T20:59:24.932 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-03-16T20:59:24.932 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-03-16T20:59:24.933 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-03-16T20:59:24.933 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-03-16T20:59:24.933 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-03-16T20:59:24.934 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-03-16T20:59:24.935 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-03-16T20:59:24.935 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-03-16T20:59:24.935 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-03-16T20:59:24.936 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-03-16T20:59:24.936 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-03-16T20:59:24.936 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-03-16T20:59:24.937 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-03-16T20:59:24.937 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-03-16T20:59:24.938 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-03-16T20:59:24.938 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-03-16T20:59:24.938 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-03-16T20:59:24.938 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-03-16T20:59:24.939 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-03-16T20:59:24.940 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-03-16T20:59:24.940 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-03-16T20:59:24.941 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-03-16T20:59:24.942 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-03-16T20:59:24.942 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-03-16T20:59:24.943 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-03-16T20:59:24.943 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-03-16T20:59:24.943 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-03-16T20:59:24.943 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-03-16T20:59:24.943 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-03-16T20:59:24.944 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-03-16T20:59:24.944 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-03-16T20:59:24.944 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-03-16T20:59:24.944 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-03-16T20:59:24.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:24 smithi008 ceph-mon[31434]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-03-16T20:59:25.009 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-03-16T20:59:25.054 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-03-16T20:59:25.054 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-03-16T20:59:25.055 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-03-16T20:59:25.055 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-03-16T20:59:25.056 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-03-16T20:59:25.056 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-03-16T20:59:25.057 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-03-16T20:59:25.058 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-03-16T20:59:25.058 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-03-16T20:59:25.059 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-03-16T20:59:25.060 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-03-16T20:59:25.060 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-03-16T20:59:25.070 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-03-16T20:59:25.075 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-03-16T20:59:25.076 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-03-16T20:59:25.076 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-03-16T20:59:25.077 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-03-16T20:59:25.077 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-03-16T20:59:25.077 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-03-16T20:59:25.078 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-03-16T20:59:25.078 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-03-16T20:59:25.079 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-03-16T20:59:25.080 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-03-16T20:59:25.081 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-03-16T20:59:25.081 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-03-16T20:59:25.082 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-03-16T20:59:25.082 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-03-16T20:59:25.084 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-03-16T20:59:25.084 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-03-16T20:59:25.097 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-03-16T20:59:25.105 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-03-16T20:59:25.105 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-03-16T20:59:25.106 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-03-16T20:59:25.106 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-03-16T20:59:25.109 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-03-16T20:59:25.111 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-03-16T20:59:25.112 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-03-16T20:59:25.112 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-03-16T20:59:25.112 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-03-16T20:59:25.113 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-03-16T20:59:25.113 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-03-16T20:59:25.114 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-03-16T20:59:25.114 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-03-16T20:59:25.114 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-03-16T20:59:25.114 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-03-16T20:59:25.116 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-03-16T20:59:25.116 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-03-16T20:59:25.117 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-03-16T20:59:25.117 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-03-16T20:59:25.126 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-03-16T20:59:25.132 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-03-16T20:59:25.134 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-03-16T20:59:25.136 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-03-16T20:59:25.138 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-03-16T20:59:25.139 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-03-16T20:59:25.139 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-03-16T20:59:25.140 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-03-16T20:59:25.140 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-03-16T20:59:25.140 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-03-16T20:59:25.141 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-03-16T20:59:25.141 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-03-16T20:59:25.141 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-03-16T20:59:25.142 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-03-16T20:59:25.142 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-03-16T20:59:25.143 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-03-16T20:59:25.143 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-03-16T20:59:25.144 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-03-16T20:59:25.145 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-03-16T20:59:25.145 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-03-16T20:59:25.145 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-03-16T20:59:25.146 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-03-16T20:59:25.146 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-03-16T20:59:25.146 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-03-16T20:59:25.147 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-03-16T20:59:25.148 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-03-16T20:59:25.148 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-03-16T20:59:25.149 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-03-16T20:59:25.149 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-03-16T20:59:25.149 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-03-16T20:59:25.150 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-03-16T20:59:25.150 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-03-16T20:59:25.165 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-03-16T20:59:25.177 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-03-16T20:59:25.178 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-03-16T20:59:25.180 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-03-16T20:59:25.181 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-03-16T20:59:25.183 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-03-16T20:59:25.185 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-03-16T20:59:25.187 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-03-16T20:59:25.188 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-03-16T20:59:25.190 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-03-16T20:59:25.191 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-03-16T20:59:25.192 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-03-16T20:59:25.194 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-03-16T20:59:25.195 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-03-16T20:59:25.196 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-03-16T20:59:25.196 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-03-16T20:59:25.199 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-03-16T20:59:25.200 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-03-16T20:59:25.200 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-03-16T20:59:25.201 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-03-16T20:59:25.203 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-03-16T20:59:25.205 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-03-16T20:59:25.205 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-03-16T20:59:25.206 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-03-16T20:59:25.206 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-03-16T20:59:25.206 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-03-16T20:59:25.209 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-03-16T20:59:25.212 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-03-16T20:59:25.212 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-03-16T20:59:25.212 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-03-16T20:59:25.215 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-03-16T20:59:25.217 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-03-16T20:59:25.217 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-03-16T20:59:25.219 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-03-16T20:59:25.220 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-03-16T20:59:25.221 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-03-16T20:59:25.223 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-03-16T20:59:25.224 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-03-16T20:59:25.226 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-03-16T20:59:25.226 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-03-16T20:59:25.227 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-03-16T20:59:25.227 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-03-16T20:59:25.227 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-03-16T20:59:25.227 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-03-16T20:59:25.228 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-03-16T20:59:25.228 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-03-16T20:59:25.228 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-03-16T20:59:25.229 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-03-16T20:59:25.229 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-03-16T20:59:25.229 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-03-16T20:59:25.230 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-03-16T20:59:25.230 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-03-16T20:59:25.231 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-03-16T20:59:25.231 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-03-16T20:59:25.232 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-03-16T20:59:25.233 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-03-16T20:59:25.234 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-03-16T20:59:25.235 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-03-16T20:59:25.235 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-03-16T20:59:25.235 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-03-16T20:59:25.236 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-03-16T20:59:25.236 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-03-16T20:59:25.237 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-03-16T20:59:25.237 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-03-16T20:59:25.237 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-03-16T20:59:25.238 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-03-16T20:59:25.238 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-03-16T20:59:25.238 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-03-16T20:59:25.238 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-03-16T20:59:25.239 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-03-16T20:59:25.239 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-03-16T20:59:25.239 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-03-16T20:59:25.240 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-03-16T20:59:25.241 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-03-16T20:59:25.241 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-03-16T20:59:25.242 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-03-16T20:59:25.242 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-03-16T20:59:25.243 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-03-16T20:59:25.244 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-03-16T20:59:25.244 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-03-16T20:59:25.245 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-03-16T20:59:25.246 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-03-16T20:59:25.247 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-03-16T20:59:25.248 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-03-16T20:59:25.248 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-03-16T20:59:25.249 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-03-16T20:59:25.250 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-03-16T20:59:25.250 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-03-16T20:59:25.251 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-03-16T20:59:25.251 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-03-16T20:59:25.252 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-03-16T20:59:25.252 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-03-16T20:59:25.272 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-03-16T20:59:25.283 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-03-16T20:59:25.283 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-03-16T20:59:25.284 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-03-16T20:59:25.285 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-03-16T20:59:25.285 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-03-16T20:59:25.285 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-03-16T20:59:25.288 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-03-16T20:59:25.290 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-03-16T20:59:25.292 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-03-16T20:59:25.294 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-03-16T20:59:25.294 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-03-16T20:59:25.294 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-03-16T20:59:25.297 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-03-16T20:59:25.298 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-03-16T20:59:25.298 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-03-16T20:59:25.299 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-03-16T20:59:25.299 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-03-16T20:59:25.300 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-03-16T20:59:25.300 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-03-16T20:59:25.300 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-03-16T20:59:25.300 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-03-16T20:59:25.307 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-03-16T20:59:25.313 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-03-16T20:59:25.313 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-03-16T20:59:25.313 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-03-16T20:59:25.317 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-03-16T20:59:25.319 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-03-16T20:59:25.320 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-03-16T20:59:25.320 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-03-16T20:59:25.320 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-03-16T20:59:25.321 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-03-16T20:59:25.321 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-03-16T20:59:25.321 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-03-16T20:59:25.321 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-03-16T20:59:25.322 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-03-16T20:59:25.323 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-03-16T20:59:25.323 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-03-16T20:59:25.324 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-03-16T20:59:25.324 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-03-16T20:59:25.325 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-03-16T20:59:25.325 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-03-16T20:59:25.325 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-03-16T20:59:25.326 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-03-16T20:59:25.326 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-03-16T20:59:25.330 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-03-16T20:59:25.330 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-03-16T20:59:25.330 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-03-16T20:59:25.330 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-03-16T20:59:25.330 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-03-16T20:59:25.331 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-03-16T20:59:25.331 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-03-16T20:59:25.331 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-03-16T20:59:25.331 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-03-16T20:59:25.331 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-03-16T20:59:25.332 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-03-16T20:59:25.333 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-03-16T20:59:25.333 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-03-16T20:59:25.334 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-03-16T20:59:25.334 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-03-16T20:59:25.334 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-03-16T20:59:25.335 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-03-16T20:59:25.336 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-03-16T20:59:25.337 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-03-16T20:59:25.337 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-03-16T20:59:25.338 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-03-16T20:59:25.338 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-03-16T20:59:25.338 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-03-16T20:59:25.339 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-03-16T20:59:25.339 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-03-16T20:59:25.339 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-03-16T20:59:25.339 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-03-16T20:59:25.339 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-03-16T20:59:25.339 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-03-16T20:59:25.340 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-03-16T20:59:25.340 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-03-16T20:59:25.340 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-03-16T20:59:25.342 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-03-16T20:59:25.342 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-03-16T20:59:25.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-03-16T20:59:25.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-03-16T20:59:25.368 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-03-16T20:59:25.370 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-03-16T20:59:25.373 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-03-16T20:59:25.373 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-03-16T20:59:25.373 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-03-16T20:59:25.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-03-16T20:59:25.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-03-16T20:59:25.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-03-16T20:59:25.375 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-03-16T20:59:25.375 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-03-16T20:59:25.375 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-03-16T20:59:25.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-03-16T20:59:25.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-03-16T20:59:25.385 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-03-16T20:59:25.385 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-03-16T20:59:25.386 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-03-16T20:59:25.388 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-03-16T20:59:25.390 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-03-16T20:59:25.391 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-03-16T20:59:25.393 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-03-16T20:59:25.394 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-03-16T20:59:25.396 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-03-16T20:59:25.397 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-03-16T20:59:25.397 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-03-16T20:59:25.397 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-03-16T20:59:25.400 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-03-16T20:59:25.402 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-03-16T20:59:25.402 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-03-16T20:59:25.404 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-03-16T20:59:25.406 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-03-16T20:59:25.406 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-03-16T20:59:25.406 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-03-16T20:59:25.409 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-03-16T20:59:25.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-03-16T20:59:25.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-03-16T20:59:25.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-03-16T20:59:25.412 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-03-16T20:59:25.412 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-03-16T20:59:25.412 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-03-16T20:59:25.413 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-03-16T20:59:25.413 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-03-16T20:59:25.413 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-03-16T20:59:25.414 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-03-16T20:59:25.414 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-03-16T20:59:25.414 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-03-16T20:59:25.415 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-03-16T20:59:25.415 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-03-16T20:59:25.416 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-03-16T20:59:25.416 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-03-16T20:59:25.416 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-03-16T20:59:25.417 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-03-16T20:59:25.417 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-03-16T20:59:25.417 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-03-16T20:59:25.417 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-03-16T20:59:25.418 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-03-16T20:59:25.419 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-03-16T20:59:25.419 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-03-16T20:59:25.420 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-03-16T20:59:25.420 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-03-16T20:59:25.420 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-03-16T20:59:25.421 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-03-16T20:59:25.421 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-03-16T20:59:25.421 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-03-16T20:59:25.421 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-03-16T20:59:25.423 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-03-16T20:59:25.423 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-03-16T20:59:25.423 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-03-16T20:59:25.424 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-03-16T20:59:25.425 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-03-16T20:59:25.425 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-03-16T20:59:25.438 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-03-16T20:59:25.444 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-03-16T20:59:25.445 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-03-16T20:59:25.445 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-03-16T20:59:25.445 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-03-16T20:59:25.446 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-03-16T20:59:25.446 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-03-16T20:59:25.446 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-03-16T20:59:25.446 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-03-16T20:59:25.447 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-03-16T20:59:25.448 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-03-16T20:59:25.448 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-03-16T20:59:25.448 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-03-16T20:59:25.449 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-03-16T20:59:25.449 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-03-16T20:59:25.450 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-03-16T20:59:25.450 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-03-16T20:59:25.450 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-03-16T20:59:25.451 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-03-16T20:59:25.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-03-16T20:59:25.465 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-03-16T20:59:25.465 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-03-16T20:59:25.465 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-03-16T20:59:25.466 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-03-16T20:59:25.466 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-03-16T20:59:25.467 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-03-16T20:59:25.467 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-03-16T20:59:25.467 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-03-16T20:59:25.467 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-03-16T20:59:25.467 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-03-16T20:59:25.468 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-03-16T20:59:25.469 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-03-16T20:59:25.469 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-03-16T20:59:25.469 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-03-16T20:59:25.470 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-03-16T20:59:25.470 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-03-16T20:59:25.471 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-03-16T20:59:25.471 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-03-16T20:59:25.471 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-03-16T20:59:25.472 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-03-16T20:59:25.472 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-03-16T20:59:25.482 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-03-16T20:59:25.486 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-03-16T20:59:25.486 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-03-16T20:59:25.486 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-03-16T20:59:25.487 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-03-16T20:59:25.487 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-03-16T20:59:25.487 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-03-16T20:59:25.488 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-03-16T20:59:25.488 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-03-16T20:59:25.493 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-03-16T20:59:25.496 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-03-16T20:59:25.496 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-03-16T20:59:25.497 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-03-16T20:59:25.497 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-03-16T20:59:25.498 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-03-16T20:59:25.498 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-03-16T20:59:25.499 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-03-16T20:59:25.500 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-03-16T20:59:25.500 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-03-16T20:59:25.504 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-03-16T20:59:25.507 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-03-16T20:59:25.507 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-03-16T20:59:25.509 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-03-16T20:59:25.511 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-03-16T20:59:25.511 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-03-16T20:59:25.512 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-03-16T20:59:25.512 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-03-16T20:59:25.515 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-03-16T20:59:25.517 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-03-16T20:59:25.517 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-03-16T20:59:25.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-03-16T20:59:25.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-03-16T20:59:25.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-03-16T20:59:25.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-03-16T20:59:25.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-03-16T20:59:25.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-03-16T20:59:25.524 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-03-16T20:59:25.527 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-03-16T20:59:25.527 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-03-16T20:59:25.528 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-03-16T20:59:25.528 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-03-16T20:59:25.529 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-03-16T20:59:25.529 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-03-16T20:59:25.529 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-03-16T20:59:25.529 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-03-16T20:59:25.530 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-03-16T20:59:25.530 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-03-16T20:59:25.530 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-03-16T20:59:25.533 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-03-16T20:59:25.534 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-03-16T20:59:25.534 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-03-16T20:59:25.536 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-03-16T20:59:25.537 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-03-16T20:59:25.538 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-03-16T20:59:25.538 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-03-16T20:59:25.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-03-16T20:59:25.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-03-16T20:59:25.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-03-16T20:59:25.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-03-16T20:59:25.540 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-03-16T20:59:25.540 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-03-16T20:59:25.540 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-03-16T20:59:25.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-03-16T20:59:25.551 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-03-16T20:59:25.553 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-03-16T20:59:25.555 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-03-16T20:59:25.555 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-03-16T20:59:25.555 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-03-16T20:59:25.556 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-03-16T20:59:25.556 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-03-16T20:59:25.556 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-03-16T20:59:25.560 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-03-16T20:59:25.563 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-03-16T20:59:25.565 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-03-16T20:59:25.566 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-03-16T20:59:25.567 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-03-16T20:59:25.567 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-03-16T20:59:25.569 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-03-16T20:59:25.571 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-03-16T20:59:25.571 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-03-16T20:59:25.572 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-03-16T20:59:25.572 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-03-16T20:59:25.573 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-03-16T20:59:25.573 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-03-16T20:59:25.573 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-03-16T20:59:25.573 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-03-16T20:59:25.574 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-03-16T20:59:25.574 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-03-16T20:59:25.574 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-03-16T20:59:25.575 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-03-16T20:59:25.576 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-03-16T20:59:25.576 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-03-16T20:59:25.577 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-03-16T20:59:25.577 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-03-16T20:59:25.577 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-03-16T20:59:25.578 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-03-16T20:59:25.578 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-03-16T20:59:25.578 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-03-16T20:59:25.579 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-03-16T20:59:25.579 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-03-16T20:59:25.580 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-03-16T20:59:25.581 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-03-16T20:59:25.581 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-03-16T20:59:25.582 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-03-16T20:59:25.582 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-03-16T20:59:25.582 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-03-16T20:59:25.582 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-03-16T20:59:25.583 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-03-16T20:59:25.584 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-03-16T20:59:25.584 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-03-16T20:59:25.585 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-03-16T20:59:25.585 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-03-16T20:59:25.586 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-03-16T20:59:25.586 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-03-16T20:59:25.587 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-03-16T20:59:25.587 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-03-16T20:59:25.587 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-03-16T20:59:25.588 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-03-16T20:59:25.588 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-03-16T20:59:25.588 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-03-16T20:59:25.589 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-03-16T20:59:25.589 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-03-16T20:59:25.591 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-03-16T20:59:25.619 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-03-16T20:59:25.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-03-16T20:59:25.636 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-03-16T20:59:25.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-03-16T20:59:25.640 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-03-16T20:59:25.642 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-03-16T20:59:25.644 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-03-16T20:59:25.645 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-03-16T20:59:25.645 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-03-16T20:59:25.646 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-03-16T20:59:25.650 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-03-16T20:59:25.653 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-03-16T20:59:25.653 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-03-16T20:59:25.654 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-03-16T20:59:25.654 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-03-16T20:59:25.655 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-03-16T20:59:25.655 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-03-16T20:59:25.660 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-03-16T20:59:25.660 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-03-16T20:59:25.662 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-03-16T20:59:25.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-03-16T20:59:25.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-03-16T20:59:25.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-03-16T20:59:25.665 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-03-16T20:59:25.665 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-03-16T20:59:25.665 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-03-16T20:59:25.665 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-03-16T20:59:25.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-03-16T20:59:25.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-03-16T20:59:25.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-03-16T20:59:25.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-03-16T20:59:25.668 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-03-16T20:59:25.673 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-03-16T20:59:25.677 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-03-16T20:59:25.678 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-03-16T20:59:25.679 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-03-16T20:59:25.680 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-03-16T20:59:25.681 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-03-16T20:59:25.681 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-03-16T20:59:25.682 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-03-16T20:59:25.683 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-03-16T20:59:25.683 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-03-16T20:59:25.684 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-03-16T20:59:25.684 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-03-16T20:59:25.684 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-03-16T20:59:25.685 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-03-16T20:59:25.685 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-03-16T20:59:25.685 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-03-16T20:59:25.686 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-03-16T20:59:25.686 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-03-16T20:59:25.686 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-03-16T20:59:25.687 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-03-16T20:59:25.689 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-03-16T20:59:25.689 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-03-16T20:59:25.690 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-03-16T20:59:25.690 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-03-16T20:59:25.691 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-03-16T20:59:25.692 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-03-16T20:59:25.692 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-03-16T20:59:25.693 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-03-16T20:59:25.693 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-03-16T20:59:25.694 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-03-16T20:59:25.694 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-03-16T20:59:25.694 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-03-16T20:59:25.695 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-03-16T20:59:25.695 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-03-16T20:59:25.695 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-03-16T20:59:25.696 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-03-16T20:59:25.696 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-03-16T20:59:25.697 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-03-16T20:59:25.698 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-03-16T20:59:25.698 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-03-16T20:59:25.707 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-03-16T20:59:25.713 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-03-16T20:59:25.713 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-03-16T20:59:25.713 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-03-16T20:59:25.714 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-03-16T20:59:25.714 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-03-16T20:59:25.714 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-03-16T20:59:25.715 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-03-16T20:59:25.715 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-03-16T20:59:25.715 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-03-16T20:59:25.716 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-03-16T20:59:25.718 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-03-16T20:59:25.719 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-03-16T20:59:25.720 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-03-16T20:59:25.721 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-03-16T20:59:25.721 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-03-16T20:59:25.721 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-03-16T20:59:25.722 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-03-16T20:59:25.722 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-03-16T20:59:25.722 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-03-16T20:59:25.723 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-03-16T20:59:25.723 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-03-16T20:59:25.723 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-03-16T20:59:25.724 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-03-16T20:59:25.725 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-03-16T20:59:25.725 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-03-16T20:59:25.726 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-03-16T20:59:25.726 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-03-16T20:59:25.726 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-03-16T20:59:25.727 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-03-16T20:59:25.733 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-03-16T20:59:25.739 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-03-16T20:59:25.739 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-03-16T20:59:25.739 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-03-16T20:59:25.740 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-03-16T20:59:25.740 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-03-16T20:59:25.740 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-03-16T20:59:25.740 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-03-16T20:59:25.742 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-03-16T20:59:25.742 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-03-16T20:59:25.742 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-03-16T20:59:25.742 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-03-16T20:59:25.743 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-03-16T20:59:25.744 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-03-16T20:59:25.745 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-03-16T20:59:25.751 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-03-16T20:59:25.754 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-03-16T20:59:25.754 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-03-16T20:59:25.754 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-03-16T20:59:25.755 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-03-16T20:59:25.755 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-03-16T20:59:25.755 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-03-16T20:59:25.756 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-03-16T20:59:25.756 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-03-16T20:59:25.756 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-03-16T20:59:25.757 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-03-16T20:59:25.757 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-03-16T20:59:25.758 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-03-16T20:59:25.758 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-03-16T20:59:25.759 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-03-16T20:59:25.759 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-03-16T20:59:25.759 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-03-16T20:59:25.760 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-03-16T20:59:25.760 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-03-16T20:59:25.760 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-03-16T20:59:25.760 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-03-16T20:59:26.225 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-03-16T20:59:26.228 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-03-16T20:59:26.229 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-03-16T20:59:26.229 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-03-16T20:59:26.229 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-03-16T20:59:26.230 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-03-16T20:59:26.231 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-03-16T20:59:26.231 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-03-16T20:59:26.231 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-03-16T20:59:26.232 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-03-16T20:59:26.246 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-03-16T20:59:26.254 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-03-16T20:59:26.254 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-03-16T20:59:26.255 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-03-16T20:59:26.255 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-03-16T20:59:26.255 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-03-16T20:59:26.256 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-03-16T20:59:26.256 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-03-16T20:59:26.256 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-03-16T20:59:26.256 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-03-16T20:59:26.257 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-03-16T20:59:26.257 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-03-16T20:59:26.257 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-03-16T20:59:26.257 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-03-16T20:59:26.257 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-03-16T20:59:26.258 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-03-16T20:59:26.258 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-03-16T20:59:26.260 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-03-16T20:59:26.260 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-03-16T20:59:26.260 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-03-16T20:59:26.303 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-03-16T20:59:26.330 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-03-16T20:59:26.331 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-03-16T20:59:26.331 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-03-16T20:59:26.332 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-03-16T20:59:26.332 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-03-16T20:59:26.332 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-03-16T20:59:26.333 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-03-16T20:59:26.334 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-03-16T20:59:26.334 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-03-16T20:59:26.334 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-03-16T20:59:26.335 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-03-16T20:59:26.335 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-03-16T20:59:26.335 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-03-16T20:59:26.336 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-03-16T20:59:26.336 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-03-16T20:59:26.336 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-03-16T20:59:26.337 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-03-16T20:59:26.362 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-03-16T20:59:26.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-03-16T20:59:26.375 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-03-16T20:59:26.375 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-03-16T20:59:26.378 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-03-16T20:59:26.385 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-03-16T20:59:26.385 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-03-16T20:59:26.394 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-03-16T20:59:26.396 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-03-16T20:59:26.397 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-03-16T20:59:26.400 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-03-16T20:59:26.407 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-03-16T20:59:26.407 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-03-16T20:59:26.407 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-03-16T20:59:26.407 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-03-16T20:59:26.408 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-03-16T20:59:26.408 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-03-16T20:59:26.408 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-03-16T20:59:26.408 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-03-16T20:59:26.408 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-03-16T20:59:26.410 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-03-16T20:59:26.410 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-03-16T20:59:26.410 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-03-16T20:59:26.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-03-16T20:59:26.412 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-03-16T20:59:26.412 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-03-16T20:59:26.412 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-03-16T20:59:26.434 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-03-16T20:59:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f449a000640 1 -- 172.21.15.8:0/2116163023 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556c53dc0600 con 0x556c541d01f0 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f449a000640 10 client.25904 handle_command_reply: tid=0 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 1 client.25904 shutdown 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 1 -- 172.21.15.8:0/2116163023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 msgr2=0x556c541651f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c541651f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f44a0036040 tx=0x7f44a0005900 comp rx=0 tx=0).stop 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 1 -- 172.21.15.8:0/2116163023 shutdown_connections 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c541d01f0 0x556c541d2610 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c54163570 0x556c5415ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c5415ad60 0x556c5415c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 1 --2- 172.21.15.8:0/2116163023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c54159ff0 0x556c541651f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 1 -- 172.21.15.8:0/2116163023 >> 172.21.15.8:0/2116163023 conn(0x556c541214b0 msgr2=0x556c54153d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f449a000640 0 client.25904 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 1 -- 172.21.15.8:0/2116163023 shutdown_connections 2024-03-16T20:59:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 1 -- 172.21.15.8:0/2116163023 wait complete. 2024-03-16T20:59:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.447+0000 7f44b9fce740 20 client.25904 trim_cache size 0 max 16384 2024-03-16T20:59:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T20:59:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T20:59:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T20:59:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T20:59:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 -- 172.21.15.8:0/3805090227 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f44940a1b90 msgr2=0x7f44940a4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f44940a1b90 0x7f44940a4050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44b0110060 tx=0x7f44a002df90 comp rx=0 tx=0).stop 2024-03-16T20:59:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 -- 172.21.15.8:0/3805090227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44b0074240 msgr2=0x7f44b019fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44b0074240 0x7f44b019fe10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9f0 tx=0x7f449c00eeb0 comp rx=0 tx=0).stop 2024-03-16T20:59:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 -- 172.21.15.8:0/3805090227 shutdown_connections 2024-03-16T20:59:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f44940a1b90 0x7f44940a4050 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44b010db10 0x7f44b0199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44b0074240 0x7f44b019fe10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 --2- 172.21.15.8:0/3805090227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44b0073920 0x7f44b019f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 -- 172.21.15.8:0/3805090227 >> 172.21.15.8:0/3805090227 conn(0x7f44b00fce40 msgr2=0x7f44b00fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 -- 172.21.15.8:0/3805090227 shutdown_connections 2024-03-16T20:59:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:26.448+0000 7f44b5c00640 1 -- 172.21.15.8:0/3805090227 wait complete. 2024-03-16T20:59:26.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-03-16T20:59:26.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-03-16T20:59:26.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-03-16T20:59:26.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-03-16T20:59:26.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-03-16T20:59:26.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-03-16T20:59:26.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-03-16T20:59:26.462 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-03-16T20:59:26.477 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-03-16T20:59:26.489 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-03-16T20:59:26.489 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-03-16T20:59:26.489 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-03-16T20:59:26.490 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-03-16T20:59:26.490 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-03-16T20:59:26.490 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-03-16T20:59:26.490 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-03-16T20:59:26.491 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-03-16T20:59:26.491 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-03-16T20:59:26.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-03-16T20:59:26.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-03-16T20:59:26.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-03-16T20:59:26.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-03-16T20:59:26.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-03-16T20:59:26.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-03-16T20:59:26.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-03-16T20:59:26.493 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-03-16T20:59:26.493 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-03-16T20:59:26.493 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-03-16T20:59:26.493 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-03-16T20:59:26.507 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-03-16T20:59:26.514 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-03-16T20:59:26.514 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-03-16T20:59:26.514 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-03-16T20:59:26.515 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-03-16T20:59:26.515 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-03-16T20:59:26.515 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-03-16T20:59:26.515 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-03-16T20:59:26.516 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-03-16T20:59:26.516 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-03-16T20:59:26.517 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-03-16T20:59:26.517 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-03-16T20:59:26.517 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-03-16T20:59:26.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-03-16T20:59:26.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-03-16T20:59:26.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-03-16T20:59:26.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-03-16T20:59:26.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-03-16T20:59:26.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-03-16T20:59:26.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-03-16T20:59:26.521 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-03-16T20:59:26.522 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-03-16T20:59:26.522 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-03-16T20:59:26.523 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-03-16T20:59:26.523 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-03-16T20:59:26.524 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-03-16T20:59:26.524 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-03-16T20:59:26.524 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-03-16T20:59:26.525 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-03-16T20:59:26.525 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-03-16T20:59:26.526 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-03-16T20:59:26.526 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-03-16T20:59:26.527 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-03-16T20:59:26.527 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-03-16T20:59:26.528 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-03-16T20:59:26.528 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-03-16T20:59:26.528 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-03-16T20:59:26.529 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-03-16T20:59:26.530 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-03-16T20:59:26.530 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-03-16T20:59:26.531 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-03-16T20:59:26.531 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-03-16T20:59:26.531 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-03-16T20:59:26.531 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-03-16T20:59:26.532 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-03-16T20:59:26.532 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-03-16T20:59:26.532 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-03-16T20:59:26.532 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-03-16T20:59:26.533 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-03-16T20:59:26.533 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-03-16T20:59:26.533 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-03-16T20:59:26.534 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-03-16T20:59:26.534 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-03-16T20:59:26.534 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-03-16T20:59:26.534 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-03-16T20:59:26.535 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-03-16T20:59:26.535 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-03-16T20:59:26.535 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-03-16T20:59:26.566 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-03-16T20:59:26.580 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-03-16T20:59:26.581 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-03-16T20:59:26.581 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-03-16T20:59:26.582 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-03-16T20:59:26.582 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-03-16T20:59:26.582 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-03-16T20:59:26.583 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-03-16T20:59:26.586 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-03-16T20:59:26.589 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-03-16T20:59:26.589 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-03-16T20:59:26.589 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-03-16T20:59:26.590 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-03-16T20:59:26.590 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-03-16T20:59:26.590 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-03-16T20:59:26.591 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-03-16T20:59:26.595 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-03-16T20:59:26.597 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-03-16T20:59:26.599 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-03-16T20:59:26.599 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-03-16T20:59:26.600 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-03-16T20:59:26.600 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-03-16T20:59:26.603 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-03-16T20:59:26.603 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-03-16T20:59:26.604 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-03-16T20:59:26.604 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-03-16T20:59:26.604 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-03-16T20:59:26.605 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-03-16T20:59:26.605 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-03-16T20:59:26.605 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-03-16T20:59:26.605 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-03-16T20:59:26.606 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-03-16T20:59:26.607 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-03-16T20:59:26.607 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-03-16T20:59:26.607 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-03-16T20:59:26.608 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-03-16T20:59:26.608 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-03-16T20:59:26.615 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-03-16T20:59:26.618 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-03-16T20:59:26.620 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-03-16T20:59:26.620 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-03-16T20:59:26.620 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-03-16T20:59:26.621 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-03-16T20:59:26.621 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-03-16T20:59:26.622 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-03-16T20:59:26.622 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-03-16T20:59:26.626 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-03-16T20:59:26.628 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-03-16T20:59:26.629 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-03-16T20:59:26.629 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-03-16T20:59:26.631 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-03-16T20:59:26.633 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-03-16T20:59:26.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-03-16T20:59:26.636 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-03-16T20:59:26.636 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-03-16T20:59:26.637 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-03-16T20:59:26.637 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-03-16T20:59:26.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-03-16T20:59:26.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-03-16T20:59:26.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-03-16T20:59:26.642 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-03-16T20:59:26.645 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-03-16T20:59:26.645 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-03-16T20:59:26.645 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-03-16T20:59:26.646 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-03-16T20:59:26.646 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-03-16T20:59:26.646 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-03-16T20:59:26.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-03-16T20:59:26.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-03-16T20:59:26.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-03-16T20:59:26.648 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-03-16T20:59:26.649 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-03-16T20:59:26.650 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-03-16T20:59:26.650 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-03-16T20:59:26.651 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-03-16T20:59:26.651 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-03-16T20:59:26.652 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-03-16T20:59:26.653 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-03-16T20:59:26.653 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-03-16T20:59:26.653 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-03-16T20:59:26.654 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-03-16T20:59:26.654 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-03-16T20:59:26.655 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-03-16T20:59:26.656 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-03-16T20:59:26.656 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-03-16T20:59:26.657 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-03-16T20:59:26.657 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-03-16T20:59:26.657 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-03-16T20:59:26.658 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-03-16T20:59:26.658 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-03-16T20:59:26.658 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-03-16T20:59:26.658 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-03-16T20:59:26.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-03-16T20:59:26.671 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-03-16T20:59:26.672 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-03-16T20:59:26.674 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-03-16T20:59:26.676 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-03-16T20:59:26.678 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-03-16T20:59:26.679 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-03-16T20:59:26.680 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-03-16T20:59:26.680 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-03-16T20:59:26.680 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-03-16T20:59:26.681 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-03-16T20:59:26.681 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-03-16T20:59:26.681 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-03-16T20:59:26.682 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-03-16T20:59:26.682 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-03-16T20:59:26.682 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-03-16T20:59:26.682 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-03-16T20:59:26.683 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-03-16T20:59:26.684 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-03-16T20:59:26.684 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-03-16T20:59:26.684 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-03-16T20:59:26.685 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-03-16T20:59:26.685 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-03-16T20:59:26.685 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-03-16T20:59:26.686 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-03-16T20:59:26.686 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-03-16T20:59:26.686 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-03-16T20:59:26.686 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-03-16T20:59:26.686 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-03-16T20:59:26.688 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-03-16T20:59:26.688 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-03-16T20:59:26.689 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-03-16T20:59:26.689 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-03-16T20:59:26.689 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-03-16T20:59:26.700 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-03-16T20:59:26.705 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-03-16T20:59:26.707 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-03-16T20:59:26.709 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-03-16T20:59:26.709 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-03-16T20:59:26.709 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-03-16T20:59:26.710 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-03-16T20:59:26.710 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-03-16T20:59:26.710 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-03-16T20:59:26.711 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-03-16T20:59:26.711 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-03-16T20:59:26.711 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-03-16T20:59:26.712 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-03-16T20:59:26.713 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-03-16T20:59:26.715 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-03-16T20:59:26.716 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-03-16T20:59:26.716 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-03-16T20:59:26.717 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-03-16T20:59:26.717 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-03-16T20:59:26.717 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-03-16T20:59:26.717 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-03-16T20:59:26.718 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-03-16T20:59:26.718 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-03-16T20:59:26.719 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-03-16T20:59:26.720 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-03-16T20:59:26.720 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-03-16T20:59:26.721 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-03-16T20:59:26.721 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-03-16T20:59:26.721 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-03-16T20:59:26.722 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-03-16T20:59:26.722 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-03-16T20:59:26.722 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-03-16T20:59:26.723 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-03-16T20:59:26.723 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-03-16T20:59:26.724 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-03-16T20:59:26.724 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-03-16T20:59:26.724 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-03-16T20:59:26.725 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-03-16T20:59:26.725 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-03-16T20:59:26.726 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-03-16T20:59:26.726 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-03-16T20:59:26.748 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-03-16T20:59:26.761 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-03-16T20:59:26.763 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-03-16T20:59:26.764 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-03-16T20:59:26.765 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-03-16T20:59:26.765 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-03-16T20:59:26.765 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-03-16T20:59:26.766 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-03-16T20:59:26.766 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-03-16T20:59:26.767 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-03-16T20:59:26.767 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-03-16T20:59:26.767 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-03-16T20:59:26.774 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-03-16T20:59:26.779 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-03-16T20:59:26.780 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-03-16T20:59:26.780 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-03-16T20:59:26.783 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-03-16T20:59:26.785 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-03-16T20:59:26.786 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-03-16T20:59:26.786 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-03-16T20:59:26.786 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-03-16T20:59:26.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-03-16T20:59:26.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-03-16T20:59:26.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-03-16T20:59:26.788 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-03-16T20:59:26.788 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-03-16T20:59:26.789 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-03-16T20:59:26.789 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-03-16T20:59:26.789 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-03-16T20:59:26.790 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-03-16T20:59:26.791 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-03-16T20:59:26.791 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-03-16T20:59:26.792 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-03-16T20:59:26.792 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-03-16T20:59:26.792 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-03-16T20:59:26.793 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-03-16T20:59:26.793 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-03-16T20:59:26.794 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-03-16T20:59:26.794 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-03-16T20:59:26.794 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-03-16T20:59:26.795 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-03-16T20:59:26.795 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-03-16T20:59:26.795 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-03-16T20:59:26.795 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-03-16T20:59:26.797 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-03-16T20:59:26.797 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-03-16T20:59:26.798 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-03-16T20:59:26.820 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-03-16T20:59:26.833 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-03-16T20:59:26.835 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-03-16T20:59:26.838 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-03-16T20:59:26.840 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-03-16T20:59:26.841 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-03-16T20:59:26.841 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-03-16T20:59:26.842 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-03-16T20:59:26.843 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-03-16T20:59:26.845 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-03-16T20:59:26.845 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-03-16T20:59:26.846 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-03-16T20:59:26.846 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-03-16T20:59:26.847 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-03-16T20:59:26.847 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-03-16T20:59:26.847 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-03-16T20:59:26.848 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-03-16T20:59:26.848 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-03-16T20:59:26.848 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-03-16T20:59:26.849 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-03-16T20:59:26.850 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-03-16T20:59:26.851 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-03-16T20:59:26.851 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-03-16T20:59:26.852 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-03-16T20:59:26.852 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-03-16T20:59:26.852 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-03-16T20:59:26.852 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-03-16T20:59:26.853 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-03-16T20:59:26.853 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-03-16T20:59:26.853 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-03-16T20:59:26.854 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-03-16T20:59:26.855 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-03-16T20:59:26.855 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-03-16T20:59:26.856 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-03-16T20:59:26.856 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-03-16T20:59:26.857 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-03-16T20:59:26.857 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-03-16T20:59:26.857 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-03-16T20:59:26.858 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-03-16T20:59:26.859 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-03-16T20:59:26.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:26 smithi170 ceph-mon[35947]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-03-16T20:59:26.888 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-03-16T20:59:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:26 smithi186 ceph-mon[36391]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-03-16T20:59:26.907 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-03-16T20:59:26.908 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-03-16T20:59:26.908 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-03-16T20:59:26.908 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-03-16T20:59:26.911 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-03-16T20:59:26.914 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-03-16T20:59:26.916 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-03-16T20:59:26.916 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-03-16T20:59:26.917 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-03-16T20:59:26.917 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-03-16T20:59:26.921 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-03-16T20:59:26.924 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-03-16T20:59:26.926 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-03-16T20:59:26.927 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-03-16T20:59:26.928 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-03-16T20:59:26.930 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-03-16T20:59:26.933 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-03-16T20:59:26.933 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-03-16T20:59:26.934 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-03-16T20:59:26.934 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-03-16T20:59:26.935 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-03-16T20:59:26.935 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-03-16T20:59:26.935 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-03-16T20:59:26.936 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-03-16T20:59:26.936 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-03-16T20:59:26.936 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-03-16T20:59:26.936 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-03-16T20:59:26.936 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-03-16T20:59:26.937 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-03-16T20:59:26.938 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-03-16T20:59:26.939 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-03-16T20:59:26.939 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-03-16T20:59:26.939 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-03-16T20:59:26.940 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-03-16T20:59:26.940 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-03-16T20:59:26.940 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-03-16T20:59:26.941 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-03-16T20:59:26.941 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-03-16T20:59:26.941 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-03-16T20:59:26.943 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-03-16T20:59:26.943 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-03-16T20:59:26.944 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-03-16T20:59:26.944 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-03-16T20:59:26.944 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-03-16T20:59:26.946 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-03-16T20:59:26.946 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-03-16T20:59:26.947 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-03-16T20:59:26.947 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-03-16T20:59:26.948 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-03-16T20:59:26.949 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-03-16T20:59:26.949 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-03-16T20:59:26.950 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-03-16T20:59:26.951 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-03-16T20:59:26.951 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-03-16T20:59:26.952 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-03-16T20:59:26.953 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-03-16T20:59:26.953 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-03-16T20:59:26.954 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-03-16T20:59:26.954 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-03-16T20:59:26.955 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-03-16T20:59:26.955 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-03-16T20:59:26.955 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-03-16T20:59:26.956 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-03-16T20:59:26.956 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-03-16T20:59:26.956 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-03-16T20:59:26.957 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-03-16T20:59:26.957 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-03-16T20:59:26.957 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-03-16T20:59:26.958 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-03-16T20:59:26.963 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-03-16T20:59:26.963 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-03-16T20:59:26.963 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-03-16T20:59:26.963 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-03-16T20:59:26.963 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-03-16T20:59:26.963 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-03-16T20:59:26.963 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-03-16T20:59:26.963 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-03-16T20:59:26.963 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-03-16T20:59:26.964 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-03-16T20:59:26.964 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-03-16T20:59:26.964 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-03-16T20:59:26.964 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-03-16T20:59:26.964 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-03-16T20:59:26.965 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-03-16T20:59:26.965 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-03-16T20:59:26.965 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-03-16T20:59:26.965 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-03-16T20:59:26.966 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-03-16T20:59:26.966 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-03-16T20:59:26.966 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-03-16T20:59:26.967 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-03-16T20:59:26.967 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-03-16T20:59:26.968 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-03-16T20:59:26.968 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-03-16T20:59:26.968 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-03-16T20:59:26.968 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-03-16T20:59:26.969 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-03-16T20:59:26.969 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-03-16T20:59:26.969 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-03-16T20:59:26.970 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-03-16T20:59:26.970 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-03-16T20:59:26.970 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-03-16T20:59:26.971 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-03-16T20:59:26.971 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-03-16T20:59:26.971 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-03-16T20:59:26.971 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-03-16T20:59:26.972 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-03-16T20:59:26.972 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-03-16T20:59:26.972 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-03-16T20:59:26.973 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-03-16T20:59:26.973 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-03-16T20:59:26.974 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-03-16T20:59:26.974 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-03-16T20:59:26.974 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-03-16T20:59:26.975 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-03-16T20:59:26.975 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-03-16T20:59:26.975 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-03-16T20:59:26.975 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-03-16T20:59:26.976 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-03-16T20:59:26.976 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-03-16T20:59:26.976 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-03-16T20:59:26.976 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-03-16T20:59:26.977 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-03-16T20:59:26.977 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-03-16T20:59:26.977 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-03-16T20:59:26.978 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-03-16T20:59:26.979 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-03-16T20:59:26.979 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-03-16T20:59:26.979 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-03-16T20:59:26.979 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-03-16T20:59:26.980 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-03-16T20:59:26.980 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-03-16T20:59:26.980 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-03-16T20:59:26.980 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-03-16T20:59:26.981 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-03-16T20:59:26.981 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-03-16T20:59:26.981 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-03-16T20:59:26.981 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-03-16T20:59:26.982 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-03-16T20:59:26.982 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-03-16T20:59:26.982 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-03-16T20:59:26.982 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-03-16T20:59:26.983 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-03-16T20:59:26.983 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-03-16T20:59:26.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:26 smithi008 ceph-mon[31434]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-03-16T20:59:27.079 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-03-16T20:59:27.128 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-03-16T20:59:27.129 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-03-16T20:59:27.129 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-03-16T20:59:27.129 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-03-16T20:59:27.129 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-03-16T20:59:27.130 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-03-16T20:59:27.130 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-03-16T20:59:27.130 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-03-16T20:59:27.130 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-03-16T20:59:27.130 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-03-16T20:59:27.131 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-03-16T20:59:27.131 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-03-16T20:59:27.131 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-03-16T20:59:27.132 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-03-16T20:59:27.132 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-03-16T20:59:27.133 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-03-16T20:59:27.133 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-03-16T20:59:27.134 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-03-16T20:59:27.134 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-03-16T20:59:27.134 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-03-16T20:59:27.135 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-03-16T20:59:27.136 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-03-16T20:59:27.136 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-03-16T20:59:27.136 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-03-16T20:59:27.136 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-03-16T20:59:27.136 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-03-16T20:59:27.136 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-03-16T20:59:27.137 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-03-16T20:59:27.137 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-03-16T20:59:27.138 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-03-16T20:59:27.138 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-03-16T20:59:27.138 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-03-16T20:59:27.139 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-03-16T20:59:27.139 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-03-16T20:59:27.140 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-03-16T20:59:27.140 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-03-16T20:59:27.140 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-03-16T20:59:27.160 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-03-16T20:59:27.171 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-03-16T20:59:27.171 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-03-16T20:59:27.174 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-03-16T20:59:27.176 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-03-16T20:59:27.178 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-03-16T20:59:27.180 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-03-16T20:59:27.180 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-03-16T20:59:27.181 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-03-16T20:59:27.181 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-03-16T20:59:27.185 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-03-16T20:59:27.188 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-03-16T20:59:27.188 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-03-16T20:59:27.189 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-03-16T20:59:27.189 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-03-16T20:59:27.190 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-03-16T20:59:27.190 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-03-16T20:59:27.190 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-03-16T20:59:27.190 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-03-16T20:59:27.191 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-03-16T20:59:27.191 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-03-16T20:59:27.191 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-03-16T20:59:27.192 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-03-16T20:59:27.193 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-03-16T20:59:27.202 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-03-16T20:59:27.210 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-03-16T20:59:27.211 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-03-16T20:59:27.211 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-03-16T20:59:27.211 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-03-16T20:59:27.212 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-03-16T20:59:27.212 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-03-16T20:59:27.212 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-03-16T20:59:27.213 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-03-16T20:59:27.213 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-03-16T20:59:27.213 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-03-16T20:59:27.213 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-03-16T20:59:27.214 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-03-16T20:59:27.215 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-03-16T20:59:27.215 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-03-16T20:59:27.215 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-03-16T20:59:27.216 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-03-16T20:59:27.216 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-03-16T20:59:27.217 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-03-16T20:59:27.217 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-03-16T20:59:27.218 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-03-16T20:59:27.218 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-03-16T20:59:27.218 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-03-16T20:59:27.219 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-03-16T20:59:27.219 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-03-16T20:59:27.220 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-03-16T20:59:27.238 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-03-16T20:59:27.248 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-03-16T20:59:27.248 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-03-16T20:59:27.251 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-03-16T20:59:27.253 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-03-16T20:59:27.254 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-03-16T20:59:27.254 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-03-16T20:59:27.255 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-03-16T20:59:27.255 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-03-16T20:59:27.255 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-03-16T20:59:27.256 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-03-16T20:59:27.256 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-03-16T20:59:27.256 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-03-16T20:59:27.257 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-03-16T20:59:27.258 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-03-16T20:59:27.258 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-03-16T20:59:27.259 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-03-16T20:59:27.259 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-03-16T20:59:27.259 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-03-16T20:59:27.259 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-03-16T20:59:27.260 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-03-16T20:59:27.260 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-03-16T20:59:27.260 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-03-16T20:59:27.261 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-03-16T20:59:27.261 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-03-16T20:59:27.261 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-03-16T20:59:27.261 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-03-16T20:59:27.262 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-03-16T20:59:27.262 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-03-16T20:59:27.262 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-03-16T20:59:27.262 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-03-16T20:59:27.263 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-03-16T20:59:27.263 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-03-16T20:59:27.263 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-03-16T20:59:27.264 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-03-16T20:59:27.264 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-03-16T20:59:27.264 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-03-16T20:59:27.265 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-03-16T20:59:27.265 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-03-16T20:59:27.265 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-03-16T20:59:27.265 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-03-16T20:59:27.265 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-03-16T20:59:27.266 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-03-16T20:59:27.266 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-03-16T20:59:27.266 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-03-16T20:59:27.267 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-03-16T20:59:27.267 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-03-16T20:59:27.267 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-03-16T20:59:27.268 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-03-16T20:59:27.294 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-03-16T20:59:27.319 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-03-16T20:59:27.320 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-03-16T20:59:27.320 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-03-16T20:59:27.320 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-03-16T20:59:27.320 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-03-16T20:59:27.325 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-03-16T20:59:27.330 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-03-16T20:59:27.331 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-03-16T20:59:27.331 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-03-16T20:59:27.331 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-03-16T20:59:27.332 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-03-16T20:59:27.332 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-03-16T20:59:27.338 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-03-16T20:59:27.342 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-03-16T20:59:27.342 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-03-16T20:59:27.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-03-16T20:59:27.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-03-16T20:59:27.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-03-16T20:59:27.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-03-16T20:59:27.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-03-16T20:59:27.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-03-16T20:59:27.345 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-03-16T20:59:27.345 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-03-16T20:59:27.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-03-16T20:59:27.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-03-16T20:59:27.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-03-16T20:59:27.347 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-03-16T20:59:27.347 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-03-16T20:59:27.347 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-03-16T20:59:27.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-03-16T20:59:27.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-03-16T20:59:27.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-03-16T20:59:27.349 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-03-16T20:59:27.349 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-03-16T20:59:27.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-03-16T20:59:27.351 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-03-16T20:59:27.351 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-03-16T20:59:27.351 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-03-16T20:59:27.352 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-03-16T20:59:27.352 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-03-16T20:59:27.353 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-03-16T20:59:27.353 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-03-16T20:59:27.353 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-03-16T20:59:27.354 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-03-16T20:59:27.354 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-03-16T20:59:27.355 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-03-16T20:59:27.355 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-03-16T20:59:27.355 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-03-16T20:59:27.355 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-03-16T20:59:27.356 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-03-16T20:59:27.358 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-03-16T20:59:27.358 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-03-16T20:59:27.359 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-03-16T20:59:27.359 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-03-16T20:59:27.359 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-03-16T20:59:27.360 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-03-16T20:59:27.361 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-03-16T20:59:27.389 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-03-16T20:59:27.403 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-03-16T20:59:27.405 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-03-16T20:59:27.407 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-03-16T20:59:27.408 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-03-16T20:59:27.408 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-03-16T20:59:27.412 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-03-16T20:59:27.414 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-03-16T20:59:27.415 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-03-16T20:59:27.415 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-03-16T20:59:27.415 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-03-16T20:59:27.416 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-03-16T20:59:27.416 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-03-16T20:59:27.416 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-03-16T20:59:27.416 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-03-16T20:59:27.417 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-03-16T20:59:27.417 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-03-16T20:59:27.417 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-03-16T20:59:27.418 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-03-16T20:59:27.419 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-03-16T20:59:27.420 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-03-16T20:59:27.420 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-03-16T20:59:27.421 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-03-16T20:59:27.421 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-03-16T20:59:27.422 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-03-16T20:59:27.422 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-03-16T20:59:27.422 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-03-16T20:59:27.423 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-03-16T20:59:27.423 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-03-16T20:59:27.424 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-03-16T20:59:27.424 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-03-16T20:59:27.425 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-03-16T20:59:27.425 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-03-16T20:59:27.439 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-03-16T20:59:27.453 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-03-16T20:59:27.453 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-03-16T20:59:27.454 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-03-16T20:59:27.454 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-03-16T20:59:27.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-03-16T20:59:27.462 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-03-16T20:59:27.463 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-03-16T20:59:27.463 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-03-16T20:59:27.463 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-03-16T20:59:27.464 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-03-16T20:59:27.464 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-03-16T20:59:27.464 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-03-16T20:59:27.465 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/digsig.txt 2024-03-16T20:59:27.473 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-03-16T20:59:27.473 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-03-16T20:59:27.479 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-03-16T20:59:27.480 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-03-16T20:59:27.481 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-03-16T20:59:27.481 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-03-16T20:59:27.481 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dontdiff 2024-03-16T20:59:27.482 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/driver-model/ 2024-03-16T20:59:27.485 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-03-16T20:59:27.487 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-03-16T20:59:27.487 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-03-16T20:59:27.487 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-03-16T20:59:27.488 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-03-16T20:59:27.488 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-03-16T20:59:27.488 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-03-16T20:59:27.489 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-03-16T20:59:27.489 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-03-16T20:59:27.489 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-03-16T20:59:27.490 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/ 2024-03-16T20:59:27.495 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-03-16T20:59:27.498 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-03-16T20:59:27.499 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-03-16T20:59:27.499 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-03-16T20:59:27.500 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-03-16T20:59:27.500 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-03-16T20:59:27.500 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-03-16T20:59:27.501 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-03-16T20:59:27.501 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-03-16T20:59:27.503 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-03-16T20:59:27.503 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-03-16T20:59:27.503 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-03-16T20:59:27.504 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-03-16T20:59:27.504 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-03-16T20:59:27.505 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-03-16T20:59:27.505 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-03-16T20:59:27.511 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-03-16T20:59:27.517 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-03-16T20:59:27.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/edac.txt 2024-03-16T20:59:27.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-03-16T20:59:27.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/eisa.txt 2024-03-16T20:59:27.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-03-16T20:59:27.520 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/extcon/ 2024-03-16T20:59:27.524 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-03-16T20:59:27.526 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-03-16T20:59:27.527 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-03-16T20:59:27.529 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-03-16T20:59:27.529 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-03-16T20:59:27.530 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/ 2024-03-16T20:59:27.534 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-03-16T20:59:27.536 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-03-16T20:59:27.537 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-03-16T20:59:27.537 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-03-16T20:59:27.537 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-03-16T20:59:27.538 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-03-16T20:59:27.538 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-03-16T20:59:27.538 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-03-16T20:59:27.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-03-16T20:59:27.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-03-16T20:59:27.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-03-16T20:59:27.540 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-03-16T20:59:27.540 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-03-16T20:59:27.541 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-03-16T20:59:27.541 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-03-16T20:59:27.542 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-03-16T20:59:27.542 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-03-16T20:59:27.543 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-03-16T20:59:27.543 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-03-16T20:59:27.544 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-03-16T20:59:27.545 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-03-16T20:59:27.545 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-03-16T20:59:27.546 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-03-16T20:59:27.546 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-03-16T20:59:27.546 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-03-16T20:59:27.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-03-16T20:59:27.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-03-16T20:59:27.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-03-16T20:59:27.548 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-03-16T20:59:27.548 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-03-16T20:59:27.548 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-03-16T20:59:27.549 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-03-16T20:59:27.549 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-03-16T20:59:27.550 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-03-16T20:59:27.550 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-03-16T20:59:27.550 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ 2024-03-16T20:59:27.566 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-03-16T20:59:27.584 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-03-16T20:59:27.584 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-03-16T20:59:27.584 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-03-16T20:59:27.585 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-03-16T20:59:27.585 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-03-16T20:59:27.585 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-03-16T20:59:27.586 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-03-16T20:59:27.586 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-03-16T20:59:27.587 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-03-16T20:59:27.587 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-03-16T20:59:27.588 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-03-16T20:59:27.588 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-03-16T20:59:27.589 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-03-16T20:59:27.590 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-03-16T20:59:27.600 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-03-16T20:59:27.607 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-03-16T20:59:27.608 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-03-16T20:59:27.608 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-03-16T20:59:27.608 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-03-16T20:59:27.609 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-03-16T20:59:27.610 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-03-16T20:59:27.610 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-03-16T20:59:27.615 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-03-16T20:59:27.619 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-03-16T20:59:27.620 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-03-16T20:59:27.621 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-03-16T20:59:27.621 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-03-16T20:59:27.622 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-03-16T20:59:27.622 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-03-16T20:59:27.624 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-03-16T20:59:27.626 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-03-16T20:59:27.627 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-03-16T20:59:27.628 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-03-16T20:59:27.628 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-03-16T20:59:27.629 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-03-16T20:59:27.629 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-03-16T20:59:27.630 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-03-16T20:59:27.630 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-03-16T20:59:27.631 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-03-16T20:59:27.632 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-03-16T20:59:27.632 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-03-16T20:59:27.633 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-03-16T20:59:27.633 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-03-16T20:59:27.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-03-16T20:59:27.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-03-16T20:59:27.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-03-16T20:59:27.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-03-16T20:59:27.635 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-03-16T20:59:27.635 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-03-16T20:59:27.635 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-03-16T20:59:27.636 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-03-16T20:59:27.636 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-03-16T20:59:27.636 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-03-16T20:59:27.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-03-16T20:59:27.639 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-03-16T20:59:27.639 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-03-16T20:59:27.639 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-03-16T20:59:27.640 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-03-16T20:59:27.640 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-03-16T20:59:27.641 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-03-16T20:59:27.641 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-03-16T20:59:27.641 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-03-16T20:59:27.642 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-03-16T20:59:27.642 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-03-16T20:59:27.642 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-03-16T20:59:27.643 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-03-16T20:59:27.652 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-03-16T20:59:27.658 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-03-16T20:59:27.659 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-03-16T20:59:27.659 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-03-16T20:59:27.659 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-03-16T20:59:27.659 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-03-16T20:59:27.660 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-03-16T20:59:27.660 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-03-16T20:59:27.660 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-03-16T20:59:27.661 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-03-16T20:59:27.661 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-03-16T20:59:27.661 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-03-16T20:59:27.662 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-03-16T20:59:27.663 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-03-16T20:59:27.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-03-16T20:59:27.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-03-16T20:59:27.665 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-03-16T20:59:27.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-03-16T20:59:27.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-03-16T20:59:27.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-03-16T20:59:27.668 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-03-16T20:59:27.674 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-03-16T20:59:27.677 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-03-16T20:59:27.677 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-03-16T20:59:27.678 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-03-16T20:59:27.678 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-03-16T20:59:27.680 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-03-16T20:59:27.680 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-03-16T20:59:27.681 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-03-16T20:59:27.682 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-03-16T20:59:27.682 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-03-16T20:59:27.683 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-03-16T20:59:27.684 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-03-16T20:59:27.685 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-03-16T20:59:27.686 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-03-16T20:59:27.687 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-03-16T20:59:27.687 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-03-16T20:59:27.687 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-03-16T20:59:27.688 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-03-16T20:59:27.688 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-03-16T20:59:27.688 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-03-16T20:59:27.689 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-03-16T20:59:27.689 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-03-16T20:59:27.689 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-03-16T20:59:27.690 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-03-16T20:59:27.691 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-03-16T20:59:27.694 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-03-16T20:59:27.694 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-03-16T20:59:27.695 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-03-16T20:59:27.701 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-03-16T20:59:27.702 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-03-16T20:59:27.703 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-03-16T20:59:27.703 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/ 2024-03-16T20:59:27.705 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-03-16T20:59:27.707 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-03-16T20:59:27.707 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-03-16T20:59:27.708 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-03-16T20:59:27.708 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-03-16T20:59:27.708 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-03-16T20:59:27.709 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-03-16T20:59:27.709 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-03-16T20:59:27.709 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-03-16T20:59:27.710 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-03-16T20:59:27.710 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-03-16T20:59:27.710 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/frv/ 2024-03-16T20:59:27.716 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-03-16T20:59:27.720 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-03-16T20:59:27.721 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-03-16T20:59:27.721 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-03-16T20:59:27.722 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-03-16T20:59:27.722 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-03-16T20:59:27.723 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-03-16T20:59:27.724 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-03-16T20:59:27.724 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-03-16T20:59:27.724 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-03-16T20:59:27.726 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-03-16T20:59:27.727 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/gcov.txt 2024-03-16T20:59:27.727 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-03-16T20:59:27.729 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/gpio/ 2024-03-16T20:59:27.731 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-03-16T20:59:27.732 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-03-16T20:59:27.732 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-03-16T20:59:27.733 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-03-16T20:59:27.733 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-03-16T20:59:27.734 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-03-16T20:59:27.734 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-03-16T20:59:27.734 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hid/ 2024-03-16T20:59:27.738 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-03-16T20:59:27.741 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-03-16T20:59:27.741 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-03-16T20:59:27.742 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-03-16T20:59:27.742 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-03-16T20:59:27.742 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/highuid.txt 2024-03-16T20:59:27.743 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hsi.txt 2024-03-16T20:59:27.743 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-03-16T20:59:27.743 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ 2024-03-16T20:59:27.748 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-03-16T20:59:27.751 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-03-16T20:59:27.751 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-03-16T20:59:27.752 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-03-16T20:59:27.752 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-03-16T20:59:27.752 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-03-16T20:59:27.753 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-03-16T20:59:27.753 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-03-16T20:59:27.753 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-03-16T20:59:27.754 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-03-16T20:59:27.754 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-03-16T20:59:27.754 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-03-16T20:59:27.755 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-03-16T20:59:27.755 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-03-16T20:59:27.756 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-03-16T20:59:27.756 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-03-16T20:59:27.756 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-03-16T20:59:27.757 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-03-16T20:59:27.757 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-03-16T20:59:27.757 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-03-16T20:59:27.758 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-03-16T20:59:27.758 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-03-16T20:59:27.758 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-03-16T20:59:27.759 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-03-16T20:59:27.760 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-03-16T20:59:27.760 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-03-16T20:59:27.760 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-03-16T20:59:27.761 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-03-16T20:59:27.761 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-03-16T20:59:27.762 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-03-16T20:59:27.762 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-03-16T20:59:27.762 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-03-16T20:59:27.763 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-03-16T20:59:27.763 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-03-16T20:59:27.764 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-03-16T20:59:27.765 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-03-16T20:59:27.765 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-03-16T20:59:27.766 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-03-16T20:59:27.766 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-03-16T20:59:27.766 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-03-16T20:59:27.767 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-03-16T20:59:27.767 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-03-16T20:59:27.768 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-03-16T20:59:27.768 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-03-16T20:59:27.768 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-03-16T20:59:27.769 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-03-16T20:59:27.769 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-03-16T20:59:27.769 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-03-16T20:59:27.769 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-03-16T20:59:27.770 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-03-16T20:59:27.770 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-03-16T20:59:27.770 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-03-16T20:59:27.771 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-03-16T20:59:27.771 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-03-16T20:59:27.772 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-03-16T20:59:27.772 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-03-16T20:59:27.772 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-03-16T20:59:27.773 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-03-16T20:59:27.773 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-03-16T20:59:27.773 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-03-16T20:59:27.774 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-03-16T20:59:27.774 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-03-16T20:59:27.774 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-03-16T20:59:27.775 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-03-16T20:59:27.775 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-03-16T20:59:27.775 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-03-16T20:59:27.776 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-03-16T20:59:27.776 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-03-16T20:59:27.776 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-03-16T20:59:27.777 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-03-16T20:59:27.777 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-03-16T20:59:27.778 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-03-16T20:59:27.782 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-03-16T20:59:27.782 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-03-16T20:59:27.782 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-03-16T20:59:27.782 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-03-16T20:59:27.782 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-03-16T20:59:27.782 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-03-16T20:59:27.783 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-03-16T20:59:27.784 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-03-16T20:59:27.784 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-03-16T20:59:27.785 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-03-16T20:59:27.785 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-03-16T20:59:27.786 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-03-16T20:59:27.786 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-03-16T20:59:27.786 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-03-16T20:59:27.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-03-16T20:59:27.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-03-16T20:59:27.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-03-16T20:59:27.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-03-16T20:59:27.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-03-16T20:59:27.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-03-16T20:59:27.788 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-03-16T20:59:27.788 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-03-16T20:59:27.788 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-03-16T20:59:27.789 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-03-16T20:59:27.790 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-03-16T20:59:27.791 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-03-16T20:59:27.791 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-03-16T20:59:27.792 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-03-16T20:59:27.792 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-03-16T20:59:27.792 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-03-16T20:59:27.792 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-03-16T20:59:27.793 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-03-16T20:59:27.793 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-03-16T20:59:27.793 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-03-16T20:59:27.793 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-03-16T20:59:27.793 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-03-16T20:59:27.794 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-03-16T20:59:27.794 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-03-16T20:59:27.794 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-03-16T20:59:27.795 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-03-16T20:59:27.795 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-03-16T20:59:27.796 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-03-16T20:59:27.797 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-03-16T20:59:27.797 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-03-16T20:59:27.797 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-03-16T20:59:27.797 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-03-16T20:59:27.797 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-03-16T20:59:27.798 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-03-16T20:59:27.798 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-03-16T20:59:27.798 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-03-16T20:59:27.798 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-03-16T20:59:27.798 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-03-16T20:59:27.798 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-03-16T20:59:27.798 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-03-16T20:59:27.800 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-03-16T20:59:27.800 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-03-16T20:59:27.800 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-03-16T20:59:27.800 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-03-16T20:59:27.800 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-03-16T20:59:27.800 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-03-16T20:59:27.800 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-03-16T20:59:27.800 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-03-16T20:59:27.801 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-03-16T20:59:27.801 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-03-16T20:59:27.801 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-03-16T20:59:27.801 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/ 2024-03-16T20:59:28.339 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-03-16T20:59:28.340 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-03-16T20:59:28.342 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-03-16T20:59:28.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-03-16T20:59:28.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-03-16T20:59:28.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-03-16T20:59:28.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-03-16T20:59:28.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-03-16T20:59:28.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-03-16T20:59:28.345 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-03-16T20:59:28.345 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-03-16T20:59:28.345 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-03-16T20:59:28.346 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-03-16T20:59:28.347 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-03-16T20:59:28.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-03-16T20:59:28.348 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-03-16T20:59:28.349 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-03-16T20:59:28.349 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-03-16T20:59:28.349 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-03-16T20:59:28.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-03-16T20:59:28.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-03-16T20:59:28.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-03-16T20:59:28.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-03-16T20:59:28.362 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-03-16T20:59:28.363 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-03-16T20:59:28.363 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-03-16T20:59:28.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-03-16T20:59:28.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-03-16T20:59:28.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-03-16T20:59:28.376 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-03-16T20:59:28.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-03-16T20:59:28.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-03-16T20:59:28.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/summary 2024-03-16T20:59:28.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-03-16T20:59:28.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-03-16T20:59:28.382 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-03-16T20:59:28.382 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2o/ 2024-03-16T20:59:28.387 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2o/README 2024-03-16T20:59:28.392 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-03-16T20:59:28.393 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/ 2024-03-16T20:59:28.395 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-03-16T20:59:28.397 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-03-16T20:59:28.398 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-03-16T20:59:28.398 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/README 2024-03-16T20:59:28.398 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-03-16T20:59:28.399 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-03-16T20:59:28.399 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-03-16T20:59:28.399 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-03-16T20:59:28.400 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-03-16T20:59:28.400 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-03-16T20:59:28.400 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-03-16T20:59:28.400 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-03-16T20:59:28.401 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ide/ 2024-03-16T20:59:28.411 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-03-16T20:59:28.418 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-03-16T20:59:28.418 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-03-16T20:59:28.419 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-03-16T20:59:28.419 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-03-16T20:59:28.420 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-03-16T20:59:28.420 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-03-16T20:59:28.420 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/infiniband/ 2024-03-16T20:59:28.426 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-03-16T20:59:28.430 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-03-16T20:59:28.430 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-03-16T20:59:28.431 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-03-16T20:59:28.431 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-03-16T20:59:28.431 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/init.txt 2024-03-16T20:59:28.432 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/initrd.txt 2024-03-16T20:59:28.432 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/ 2024-03-16T20:59:28.439 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-03-16T20:59:28.444 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-03-16T20:59:28.444 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-03-16T20:59:28.445 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-03-16T20:59:28.445 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-03-16T20:59:28.446 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-03-16T20:59:28.446 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-03-16T20:59:28.446 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-03-16T20:59:28.446 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-03-16T20:59:28.447 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-03-16T20:59:28.448 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-03-16T20:59:28.448 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-03-16T20:59:28.449 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-03-16T20:59:28.449 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-03-16T20:59:28.450 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-03-16T20:59:28.451 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-03-16T20:59:28.451 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-03-16T20:59:28.451 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/input.txt 2024-03-16T20:59:28.452 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-03-16T20:59:28.452 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-03-16T20:59:28.453 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-03-16T20:59:28.453 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-03-16T20:59:28.453 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-03-16T20:59:28.454 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-03-16T20:59:28.455 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-03-16T20:59:28.455 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-03-16T20:59:28.456 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-03-16T20:59:28.456 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-03-16T20:59:28.457 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-03-16T20:59:28.457 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-03-16T20:59:28.457 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-03-16T20:59:28.458 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-03-16T20:59:28.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-03-16T20:59:28.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-03-16T20:59:28.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ioctl/ 2024-03-16T20:59:28.481 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-03-16T20:59:28.491 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-03-16T20:59:28.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-03-16T20:59:28.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-03-16T20:59:28.493 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-03-16T20:59:28.493 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-03-16T20:59:28.493 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/iostats.txt 2024-03-16T20:59:28.494 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-03-16T20:59:28.494 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-03-16T20:59:28.494 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/ 2024-03-16T20:59:28.500 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-03-16T20:59:28.503 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-03-16T20:59:28.503 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-03-16T20:59:28.504 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-03-16T20:59:28.505 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-03-16T20:59:28.506 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-03-16T20:59:28.506 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README 2024-03-16T20:59:28.508 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-03-16T20:59:28.509 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-03-16T20:59:28.510 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-03-16T20:59:28.511 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-03-16T20:59:28.512 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-03-16T20:59:28.513 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-03-16T20:59:28.513 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-03-16T20:59:28.514 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-03-16T20:59:28.515 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-03-16T20:59:28.516 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-03-16T20:59:28.517 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-03-16T20:59:28.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-03-16T20:59:28.518 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-03-16T20:59:28.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-03-16T20:59:28.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-03-16T20:59:28.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-03-16T20:59:28.519 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-03-16T20:59:28.520 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-03-16T20:59:28.520 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-03-16T20:59:28.525 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-03-16T20:59:28.528 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-03-16T20:59:28.529 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-03-16T20:59:28.530 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-03-16T20:59:28.531 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-03-16T20:59:28.531 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/java.txt 2024-03-16T20:59:28.531 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kasan.txt 2024-03-16T20:59:28.532 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kbuild/ 2024-03-16T20:59:28.534 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-03-16T20:59:28.536 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-03-16T20:59:28.536 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-03-16T20:59:28.537 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-03-16T20:59:28.537 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-03-16T20:59:28.538 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-03-16T20:59:28.538 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-03-16T20:59:28.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kdump/ 2024-03-16T20:59:28.543 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-03-16T20:59:28.546 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-03-16T20:59:28.546 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-03-16T20:59:28.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-03-16T20:59:28.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-03-16T20:59:28.554 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-03-16T20:59:28.554 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-03-16T20:59:28.556 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-03-16T20:59:28.556 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-03-16T20:59:28.559 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-03-16T20:59:28.560 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-03-16T20:59:28.561 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kobject.txt 2024-03-16T20:59:28.561 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-03-16T20:59:28.562 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kref.txt 2024-03-16T20:59:28.562 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-03-16T20:59:28.563 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/ 2024-03-16T20:59:28.566 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-03-16T20:59:28.569 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-03-16T20:59:28.569 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-03-16T20:59:28.569 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-03-16T20:59:28.570 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-03-16T20:59:28.570 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-03-16T20:59:28.571 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-03-16T20:59:28.571 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-03-16T20:59:28.571 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-03-16T20:59:28.572 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-03-16T20:59:28.572 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-03-16T20:59:28.574 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-03-16T20:59:28.577 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ldm.txt 2024-03-16T20:59:28.578 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/ 2024-03-16T20:59:28.586 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-03-16T20:59:28.597 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-03-16T20:59:28.597 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-03-16T20:59:28.598 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-03-16T20:59:28.598 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-03-16T20:59:28.598 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-03-16T20:59:28.599 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-03-16T20:59:28.599 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-03-16T20:59:28.599 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-03-16T20:59:28.600 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-03-16T20:59:28.600 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-03-16T20:59:28.601 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-03-16T20:59:28.601 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/locking/ 2024-03-16T20:59:28.616 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-03-16T20:59:28.628 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-03-16T20:59:28.629 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-03-16T20:59:28.629 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-03-16T20:59:28.630 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-03-16T20:59:28.631 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-03-16T20:59:28.631 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-03-16T20:59:28.631 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-03-16T20:59:28.632 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-03-16T20:59:28.632 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-03-16T20:59:28.632 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-03-16T20:59:28.633 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/logo.gif 2024-03-16T20:59:28.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/logo.txt 2024-03-16T20:59:28.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/lzo.txt 2024-03-16T20:59:28.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/m68k/ 2024-03-16T20:59:28.647 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-03-16T20:59:28.653 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-03-16T20:59:28.653 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-03-16T20:59:28.653 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-03-16T20:59:28.654 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-03-16T20:59:28.654 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/md.txt 2024-03-16T20:59:28.654 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-03-16T20:59:28.655 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-03-16T20:59:28.659 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-03-16T20:59:28.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:28 smithi170 ceph-mon[35947]: pgmap v52: 97 pgs: 97 active+clean; 57 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-03-16T20:59:28.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:28 smithi186 ceph-mon[36391]: pgmap v52: 97 pgs: 97 active+clean; 57 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-03-16T20:59:28.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:28 smithi008 ceph-mon[31434]: pgmap v52: 97 pgs: 97 active+clean; 57 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 4.7 MiB/s wr, 16 op/s 2024-03-16T20:59:30.798 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:30 smithi008 ceph-mon[31434]: pgmap v53: 97 pgs: 97 active+clean; 57 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-03-16T20:59:30.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:30 smithi170 ceph-mon[35947]: pgmap v53: 97 pgs: 97 active+clean; 57 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-03-16T20:59:30.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:30 smithi186 ceph-mon[36391]: pgmap v53: 97 pgs: 97 active+clean; 57 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.7 MiB/s wr, 13 op/s 2024-03-16T20:59:32.110 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-03-16T20:59:32.113 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-03-16T20:59:32.115 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/metag/ 2024-03-16T20:59:32.116 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-03-16T20:59:32.118 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-03-16T20:59:32.118 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mic/ 2024-03-16T20:59:32.121 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-03-16T20:59:32.124 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-03-16T20:59:32.124 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-03-16T20:59:32.126 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-03-16T20:59:32.128 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-03-16T20:59:32.128 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-03-16T20:59:32.129 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-03-16T20:59:32.129 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-03-16T20:59:32.130 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-03-16T20:59:32.130 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-03-16T20:59:32.130 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mips/ 2024-03-16T20:59:32.137 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-03-16T20:59:32.141 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-03-16T20:59:32.142 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-03-16T20:59:32.144 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-03-16T20:59:32.146 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-03-16T20:59:32.147 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-03-16T20:59:32.147 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-03-16T20:59:32.147 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-03-16T20:59:32.148 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-03-16T20:59:32.148 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-03-16T20:59:32.148 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-03-16T20:59:32.149 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-03-16T20:59:32.149 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-03-16T20:59:32.149 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-03-16T20:59:32.158 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-03-16T20:59:32.164 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-03-16T20:59:32.165 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-03-16T20:59:32.165 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-03-16T20:59:32.166 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-03-16T20:59:32.166 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-03-16T20:59:32.166 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-03-16T20:59:32.166 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mmc/ 2024-03-16T20:59:32.173 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-03-16T20:59:32.177 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-03-16T20:59:32.178 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-03-16T20:59:32.178 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-03-16T20:59:32.179 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mn10300/ 2024-03-16T20:59:32.182 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-03-16T20:59:32.183 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-03-16T20:59:32.184 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-03-16T20:59:32.184 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mono.txt 2024-03-16T20:59:32.185 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mtd/ 2024-03-16T20:59:32.188 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-03-16T20:59:32.189 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-03-16T20:59:32.191 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-03-16T20:59:32.192 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-03-16T20:59:32.193 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/namespaces/ 2024-03-16T20:59:32.195 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-03-16T20:59:32.196 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-03-16T20:59:32.196 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/netlabel/ 2024-03-16T20:59:32.198 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-03-16T20:59:32.200 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-03-16T20:59:32.200 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-03-16T20:59:32.201 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-03-16T20:59:32.201 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-03-16T20:59:32.201 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ 2024-03-16T20:59:32.205 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-03-16T20:59:32.207 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-03-16T20:59:32.207 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-03-16T20:59:32.208 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-03-16T20:59:32.208 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-03-16T20:59:32.209 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-03-16T20:59:32.209 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-03-16T20:59:32.209 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-03-16T20:59:32.210 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-03-16T20:59:32.210 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-03-16T20:59:32.211 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-03-16T20:59:32.211 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-03-16T20:59:32.212 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-03-16T20:59:32.212 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-03-16T20:59:32.215 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-03-16T20:59:32.216 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-03-16T20:59:32.216 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-03-16T20:59:32.217 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-03-16T20:59:32.217 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-03-16T20:59:32.217 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-03-16T20:59:32.222 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-03-16T20:59:32.222 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-03-16T20:59:32.225 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-03-16T20:59:32.227 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-03-16T20:59:32.227 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-03-16T20:59:32.228 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-03-16T20:59:32.228 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-03-16T20:59:32.229 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-03-16T20:59:32.229 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-03-16T20:59:32.230 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-03-16T20:59:32.230 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-03-16T20:59:32.230 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-03-16T20:59:32.231 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-03-16T20:59:32.231 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-03-16T20:59:32.232 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-03-16T20:59:32.232 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-03-16T20:59:32.232 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-03-16T20:59:32.234 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-03-16T20:59:32.234 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-03-16T20:59:32.235 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-03-16T20:59:32.235 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-03-16T20:59:32.236 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-03-16T20:59:32.236 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-03-16T20:59:32.237 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-03-16T20:59:32.238 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-03-16T20:59:32.238 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-03-16T20:59:32.239 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-03-16T20:59:32.240 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-03-16T20:59:32.240 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-03-16T20:59:32.241 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-03-16T20:59:32.241 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-03-16T20:59:32.242 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-03-16T20:59:32.242 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-03-16T20:59:32.243 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-03-16T20:59:32.244 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-03-16T20:59:32.245 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-03-16T20:59:32.245 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-03-16T20:59:32.246 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-03-16T20:59:32.246 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-03-16T20:59:32.249 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-03-16T20:59:32.249 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-03-16T20:59:32.251 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-03-16T20:59:32.251 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-03-16T20:59:32.252 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-03-16T20:59:32.252 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-03-16T20:59:32.253 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-03-16T20:59:32.254 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-03-16T20:59:32.254 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-03-16T20:59:32.255 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-03-16T20:59:32.255 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-03-16T20:59:32.256 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-03-16T20:59:32.256 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-03-16T20:59:32.256 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-03-16T20:59:32.256 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-03-16T20:59:32.257 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-03-16T20:59:32.258 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-03-16T20:59:32.270 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-03-16T20:59:32.279 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-03-16T20:59:32.279 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-03-16T20:59:32.280 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-03-16T20:59:32.280 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-03-16T20:59:32.280 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-03-16T20:59:32.280 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-03-16T20:59:32.281 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-03-16T20:59:32.282 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-03-16T20:59:32.282 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-03-16T20:59:32.282 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-03-16T20:59:32.283 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-03-16T20:59:32.284 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-03-16T20:59:32.285 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-03-16T20:59:32.285 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-03-16T20:59:32.286 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-03-16T20:59:32.287 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-03-16T20:59:32.288 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-03-16T20:59:32.288 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-03-16T20:59:32.288 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-03-16T20:59:32.289 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-03-16T20:59:32.289 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-03-16T20:59:32.290 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-03-16T20:59:32.290 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-03-16T20:59:32.290 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-03-16T20:59:32.290 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-03-16T20:59:32.292 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-03-16T20:59:32.292 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-03-16T20:59:32.293 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-03-16T20:59:32.293 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-03-16T20:59:32.293 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-03-16T20:59:32.294 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-03-16T20:59:32.294 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-03-16T20:59:32.295 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-03-16T20:59:32.295 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-03-16T20:59:32.295 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-03-16T20:59:32.295 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-03-16T20:59:32.295 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-03-16T20:59:32.296 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-03-16T20:59:32.296 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-03-16T20:59:32.296 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-03-16T20:59:32.309 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-03-16T20:59:32.316 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-03-16T20:59:32.316 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-03-16T20:59:32.317 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-03-16T20:59:32.317 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-03-16T20:59:32.318 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-03-16T20:59:32.318 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-03-16T20:59:32.318 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-03-16T20:59:32.319 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-03-16T20:59:32.319 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-03-16T20:59:32.319 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-03-16T20:59:32.320 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-03-16T20:59:32.321 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-03-16T20:59:32.321 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-03-16T20:59:32.321 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-03-16T20:59:32.322 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-03-16T20:59:32.322 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-03-16T20:59:32.323 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-03-16T20:59:32.324 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/nfc/ 2024-03-16T20:59:32.335 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-03-16T20:59:32.338 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-03-16T20:59:32.339 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/nios2/ 2024-03-16T20:59:32.341 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/nios2/README 2024-03-16T20:59:32.342 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-03-16T20:59:32.342 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/numastat.txt 2024-03-16T20:59:32.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-03-16T20:59:32.343 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/padata.txt 2024-03-16T20:59:32.344 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/parisc/ 2024-03-16T20:59:32.347 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-03-16T20:59:32.349 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-03-16T20:59:32.349 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/parisc/registers 2024-03-16T20:59:32.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-03-16T20:59:32.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/parport.txt 2024-03-16T20:59:32.350 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-03-16T20:59:32.353 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-03-16T20:59:32.356 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-03-16T20:59:32.356 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-03-16T20:59:32.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-03-16T20:59:32.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-03-16T20:59:32.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-03-16T20:59:32.358 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-03-16T20:59:32.358 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-03-16T20:59:32.359 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/phy.txt 2024-03-16T20:59:32.360 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/phy/ 2024-03-16T20:59:32.363 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-03-16T20:59:32.367 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-03-16T20:59:32.367 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-03-16T20:59:32.368 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/platform/ 2024-03-16T20:59:32.371 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-03-16T20:59:32.372 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pnp.txt 2024-03-16T20:59:32.373 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/ 2024-03-16T20:59:32.374 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-03-16T20:59:32.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-03-16T20:59:32.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-03-16T20:59:32.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-03-16T20:59:32.377 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-03-16T20:59:32.378 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-03-16T20:59:32.378 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-03-16T20:59:32.378 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-03-16T20:59:32.378 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-03-16T20:59:32.379 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-03-16T20:59:32.379 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-03-16T20:59:32.380 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-03-16T20:59:32.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-03-16T20:59:32.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-03-16T20:59:32.386 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-03-16T20:59:32.391 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-03-16T20:59:32.392 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-03-16T20:59:32.394 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-03-16T20:59:32.394 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-03-16T20:59:32.395 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-03-16T20:59:32.395 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-03-16T20:59:32.395 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-03-16T20:59:32.396 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-03-16T20:59:32.396 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/states.txt 2024-03-16T20:59:32.397 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-03-16T20:59:32.398 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-03-16T20:59:32.399 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-03-16T20:59:32.400 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-03-16T20:59:32.401 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-03-16T20:59:32.402 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-03-16T20:59:32.402 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-03-16T20:59:32.403 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/power/video.txt 2024-03-16T20:59:32.403 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/ 2024-03-16T20:59:32.413 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-03-16T20:59:32.418 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-03-16T20:59:32.418 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-03-16T20:59:32.419 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-03-16T20:59:32.419 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-03-16T20:59:32.419 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-03-16T20:59:32.420 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-03-16T20:59:32.420 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-03-16T20:59:32.421 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-03-16T20:59:32.422 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-03-16T20:59:32.423 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-03-16T20:59:32.424 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-03-16T20:59:32.425 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-03-16T20:59:32.426 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pps/ 2024-03-16T20:59:32.434 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-03-16T20:59:32.439 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/prctl/ 2024-03-16T20:59:32.441 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-03-16T20:59:32.444 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-03-16T20:59:32.444 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-03-16T20:59:32.444 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-03-16T20:59:32.444 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-03-16T20:59:32.444 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-03-16T20:59:32.445 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-03-16T20:59:32.445 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-03-16T20:59:32.445 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-03-16T20:59:32.446 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pti/ 2024-03-16T20:59:32.451 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-03-16T20:59:32.455 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ptp/ 2024-03-16T20:59:32.456 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-03-16T20:59:32.458 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-03-16T20:59:32.458 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-03-16T20:59:32.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-03-16T20:59:32.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-03-16T20:59:32.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/pwm.txt 2024-03-16T20:59:32.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-03-16T20:59:32.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/rapidio/ 2024-03-16T20:59:32.466 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-03-16T20:59:32.471 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-03-16T20:59:32.471 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-03-16T20:59:32.471 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-03-16T20:59:32.472 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-03-16T20:59:32.472 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-03-16T20:59:32.472 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-03-16T20:59:32.473 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-03-16T20:59:32.473 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-03-16T20:59:32.473 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/rtc.txt 2024-03-16T20:59:32.474 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/ 2024-03-16T20:59:32.480 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-03-16T20:59:32.483 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-03-16T20:59:32.483 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-03-16T20:59:32.484 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-03-16T20:59:32.484 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/DASD 2024-03-16T20:59:32.484 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-03-16T20:59:32.486 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-03-16T20:59:32.487 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-03-16T20:59:32.487 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-03-16T20:59:32.488 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-03-16T20:59:32.488 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-03-16T20:59:32.488 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-03-16T20:59:32.489 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-03-16T20:59:32.489 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-03-16T20:59:32.490 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scheduler/ 2024-03-16T20:59:32.497 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-03-16T20:59:32.505 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-03-16T20:59:32.505 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-03-16T20:59:32.505 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-03-16T20:59:32.506 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-03-16T20:59:32.506 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-03-16T20:59:32.506 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-03-16T20:59:32.507 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-03-16T20:59:32.507 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-03-16T20:59:32.508 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-03-16T20:59:32.508 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ 2024-03-16T20:59:32.516 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-03-16T20:59:32.521 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-03-16T20:59:32.521 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-03-16T20:59:32.521 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-03-16T20:59:32.524 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-03-16T20:59:32.524 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-03-16T20:59:32.524 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-03-16T20:59:32.529 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-03-16T20:59:32.530 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-03-16T20:59:32.531 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-03-16T20:59:32.532 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-03-16T20:59:32.534 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-03-16T20:59:32.535 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-03-16T20:59:32.536 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-03-16T20:59:32.536 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-03-16T20:59:32.536 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-03-16T20:59:32.537 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-03-16T20:59:32.537 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-03-16T20:59:32.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-03-16T20:59:32.539 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-03-16T20:59:32.540 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-03-16T20:59:32.541 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-03-16T20:59:32.542 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-03-16T20:59:32.543 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-03-16T20:59:32.544 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-03-16T20:59:32.544 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-03-16T20:59:32.545 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-03-16T20:59:32.545 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-03-16T20:59:32.545 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-03-16T20:59:32.546 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-03-16T20:59:32.546 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-03-16T20:59:32.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-03-16T20:59:32.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-03-16T20:59:32.547 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-03-16T20:59:32.548 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-03-16T20:59:32.549 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-03-16T20:59:32.549 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-03-16T20:59:32.550 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-03-16T20:59:32.550 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-03-16T20:59:32.551 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-03-16T20:59:32.551 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-03-16T20:59:32.552 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-03-16T20:59:32.552 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-03-16T20:59:32.553 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-03-16T20:59:32.553 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-03-16T20:59:32.554 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-03-16T20:59:32.554 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-03-16T20:59:32.554 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-03-16T20:59:32.555 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-03-16T20:59:32.556 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-03-16T20:59:32.557 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-03-16T20:59:32.578 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-03-16T20:59:32.585 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-03-16T20:59:32.585 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-03-16T20:59:32.586 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-03-16T20:59:32.587 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-03-16T20:59:32.587 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-03-16T20:59:32.588 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-03-16T20:59:32.588 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-03-16T20:59:32.588 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/ 2024-03-16T20:59:32.593 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-03-16T20:59:32.595 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-03-16T20:59:32.596 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-03-16T20:59:32.596 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-03-16T20:59:32.596 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-03-16T20:59:32.597 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-03-16T20:59:32.597 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-03-16T20:59:32.597 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-03-16T20:59:32.598 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-03-16T20:59:32.598 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-03-16T20:59:32.598 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-03-16T20:59:32.599 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-03-16T20:59:32.602 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-03-16T20:59:32.604 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-03-16T20:59:32.605 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/serial/ 2024-03-16T20:59:32.610 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-03-16T20:59:32.611 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-03-16T20:59:32.611 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/serial/driver 2024-03-16T20:59:32.612 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-03-16T20:59:32.612 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-03-16T20:59:32.613 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-03-16T20:59:32.613 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-03-16T20:59:32.613 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-03-16T20:59:32.614 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-03-16T20:59:32.614 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sh/ 2024-03-16T20:59:32.619 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-03-16T20:59:32.622 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-03-16T20:59:32.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-03-16T20:59:32.623 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/ 2024-03-16T20:59:32.625 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-03-16T20:59:32.627 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-03-16T20:59:32.629 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-03-16T20:59:32.629 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-03-16T20:59:32.631 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-03-16T20:59:32.631 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-03-16T20:59:32.632 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-03-16T20:59:32.632 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-03-16T20:59:32.633 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-03-16T20:59:32.633 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-03-16T20:59:32.634 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-03-16T20:59:32.635 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-03-16T20:59:32.636 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-03-16T20:59:32.636 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-03-16T20:59:32.637 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-03-16T20:59:32.637 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-03-16T20:59:32.637 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-03-16T20:59:32.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-03-16T20:59:32.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-03-16T20:59:32.638 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-03-16T20:59:32.639 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-03-16T20:59:32.640 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-03-16T20:59:32.640 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-03-16T20:59:32.642 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-03-16T20:59:32.643 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-03-16T20:59:32.644 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-03-16T20:59:32.644 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-03-16T20:59:32.650 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-03-16T20:59:32.652 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-03-16T20:59:32.653 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-03-16T20:59:32.653 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-03-16T20:59:32.654 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-03-16T20:59:32.655 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-03-16T20:59:32.656 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-03-16T20:59:32.656 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-03-16T20:59:32.656 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-03-16T20:59:32.656 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-03-16T20:59:32.657 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-03-16T20:59:32.660 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-03-16T20:59:32.663 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-03-16T20:59:32.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-03-16T20:59:32.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-03-16T20:59:32.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-03-16T20:59:32.664 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-03-16T20:59:32.665 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-03-16T20:59:32.665 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-03-16T20:59:32.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-03-16T20:59:32.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-03-16T20:59:32.666 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-03-16T20:59:32.667 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-03-16T20:59:32.668 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-03-16T20:59:32.671 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-03-16T20:59:32.671 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-03-16T20:59:32.672 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-03-16T20:59:32.672 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-03-16T20:59:32.673 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-03-16T20:59:32.673 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-03-16T20:59:32.674 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-03-16T20:59:32.674 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-03-16T20:59:32.675 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-03-16T20:59:32.676 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-03-16T20:59:32.676 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-03-16T20:59:32.677 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sparse.txt 2024-03-16T20:59:32.678 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/ 2024-03-16T20:59:32.683 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-03-16T20:59:32.686 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-03-16T20:59:32.686 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-03-16T20:59:32.687 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-03-16T20:59:32.689 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-03-16T20:59:32.690 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-03-16T20:59:32.690 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-03-16T20:59:32.691 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-03-16T20:59:32.691 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-03-16T20:59:32.691 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/spidev 2024-03-16T20:59:32.691 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-03-16T20:59:32.691 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-03-16T20:59:32.691 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-03-16T20:59:32.692 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-03-16T20:59:32.693 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-03-16T20:59:32.693 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/svga.txt 2024-03-16T20:59:32.694 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sysctl/ 2024-03-16T20:59:32.699 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-03-16T20:59:32.704 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sysctl/README 2024-03-16T20:59:32.704 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-03-16T20:59:32.705 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-03-16T20:59:32.705 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-03-16T20:59:32.706 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-03-16T20:59:32.706 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-03-16T20:59:32.708 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-03-16T20:59:32.709 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-03-16T20:59:32.710 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-03-16T20:59:32.710 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/target/ 2024-03-16T20:59:32.717 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-03-16T20:59:32.722 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-03-16T20:59:32.723 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-03-16T20:59:32.724 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/thermal/ 2024-03-16T20:59:32.726 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-03-16T20:59:32.728 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-03-16T20:59:32.729 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-03-16T20:59:32.729 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-03-16T20:59:32.729 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-03-16T20:59:32.730 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-03-16T20:59:32.730 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-03-16T20:59:32.731 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-03-16T20:59:32.731 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/ 2024-03-16T20:59:32.738 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-03-16T20:59:32.744 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-03-16T20:59:32.744 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-03-16T20:59:32.744 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-03-16T20:59:32.745 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-03-16T20:59:32.745 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-03-16T20:59:32.745 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-03-16T20:59:32.746 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-03-16T20:59:32.746 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-03-16T20:59:32.746 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-03-16T20:59:32.747 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-03-16T20:59:32.747 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/tpm/ 2024-03-16T20:59:32.756 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-03-16T20:59:32.763 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/ 2024-03-16T20:59:32.765 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-03-16T20:59:32.767 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-03-16T20:59:32.768 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-03-16T20:59:32.768 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-03-16T20:59:32.768 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-03-16T20:59:32.769 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-03-16T20:59:32.769 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-03-16T20:59:32.772 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-03-16T20:59:32.772 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-03-16T20:59:32.773 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-03-16T20:59:32.773 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-03-16T20:59:32.779 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-03-16T20:59:32.784 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-03-16T20:59:32.784 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-03-16T20:59:32.785 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-03-16T20:59:32.785 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-03-16T20:59:32.786 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-03-16T20:59:32.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-03-16T20:59:32.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/unicode.txt 2024-03-16T20:59:32.787 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/unshare.txt 2024-03-16T20:59:32.788 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/ 2024-03-16T20:59:32.794 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-03-16T20:59:32.800 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-03-16T20:59:32.801 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-03-16T20:59:32.801 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-03-16T20:59:32.801 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-03-16T20:59:32.802 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-03-16T20:59:32.802 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-03-16T20:59:32.802 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-03-16T20:59:32.803 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-03-16T20:59:32.803 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-03-16T20:59:32.803 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-03-16T20:59:32.803 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-03-16T20:59:32.805 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-03-16T20:59:32.805 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-03-16T20:59:32.806 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-03-16T20:59:32.808 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-03-16T20:59:32.809 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-03-16T20:59:32.810 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-03-16T20:59:32.810 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-03-16T20:59:32.812 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-03-16T20:59:32.812 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-03-16T20:59:32.813 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-03-16T20:59:32.814 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-03-16T20:59:32.814 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-03-16T20:59:32.814 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-03-16T20:59:32.814 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-03-16T20:59:32.815 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-03-16T20:59:32.815 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-03-16T20:59:32.815 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-03-16T20:59:32.815 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-03-16T20:59:32.817 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-03-16T20:59:32.817 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-03-16T20:59:32.818 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-03-16T20:59:32.818 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-03-16T20:59:32.819 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-03-16T20:59:32.819 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-03-16T20:59:32.820 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vDSO/ 2024-03-16T20:59:32.835 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-03-16T20:59:32.840 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-03-16T20:59:32.841 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-03-16T20:59:32.841 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-03-16T20:59:32.842 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-03-16T20:59:32.842 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vfio.txt 2024-03-16T20:59:32.843 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-03-16T20:59:32.844 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video-output.txt 2024-03-16T20:59:32.845 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/ 2024-03-16T20:59:32.849 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-03-16T20:59:32.854 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-03-16T20:59:32.854 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-03-16T20:59:32.854 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-03-16T20:59:32.855 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-03-16T20:59:32.855 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-03-16T20:59:32.856 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-03-16T20:59:32.856 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-03-16T20:59:32.856 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-03-16T20:59:32.857 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-03-16T20:59:32.858 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-03-16T20:59:32.858 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-03-16T20:59:32.859 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-03-16T20:59:32.859 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-03-16T20:59:32.859 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-03-16T20:59:32.859 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-03-16T20:59:32.860 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-03-16T20:59:32.860 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-03-16T20:59:32.860 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-03-16T20:59:32.862 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-03-16T20:59:32.862 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-03-16T20:59:32.863 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-03-16T20:59:32.863 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-03-16T20:59:32.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:32 smithi170 ceph-mon[35947]: pgmap v54: 97 pgs: 97 active+clean; 92 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.6 MiB/s wr, 206 op/s 2024-03-16T20:59:32.889 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-03-16T20:59:32.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:32 smithi186 ceph-mon[36391]: pgmap v54: 97 pgs: 97 active+clean; 92 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.6 MiB/s wr, 206 op/s 2024-03-16T20:59:32.921 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-03-16T20:59:32.922 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-03-16T20:59:32.923 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-03-16T20:59:32.924 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-03-16T20:59:32.925 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-03-16T20:59:32.925 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-03-16T20:59:32.926 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-03-16T20:59:32.926 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-03-16T20:59:32.927 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-03-16T20:59:32.928 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-03-16T20:59:32.928 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-03-16T20:59:32.928 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-03-16T20:59:32.929 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-03-16T20:59:32.930 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-03-16T20:59:32.930 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-03-16T20:59:32.930 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-03-16T20:59:32.931 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-03-16T20:59:32.931 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-03-16T20:59:32.933 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-03-16T20:59:32.948 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-03-16T20:59:32.958 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-03-16T20:59:32.959 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-03-16T20:59:32.959 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-03-16T20:59:32.959 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-03-16T20:59:32.960 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-03-16T20:59:32.960 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-03-16T20:59:32.961 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-03-16T20:59:32.961 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-03-16T20:59:32.961 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-03-16T20:59:32.961 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-03-16T20:59:32.974 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-03-16T20:59:32.983 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-03-16T20:59:32.984 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-03-16T20:59:32.984 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-03-16T20:59:32.985 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-03-16T20:59:32.987 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-03-16T20:59:32.987 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-03-16T20:59:32.987 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-03-16T20:59:32.987 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-03-16T20:59:32.988 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-03-16T20:59:32.988 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-03-16T20:59:32.989 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-03-16T20:59:32.989 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-03-16T20:59:32.989 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-03-16T20:59:32.990 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-03-16T20:59:32.991 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-03-16T20:59:32.991 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-03-16T20:59:32.992 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-03-16T20:59:32.992 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-03-16T20:59:32.993 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-03-16T20:59:32.993 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-03-16T20:59:32.995 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-03-16T20:59:32.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:32 smithi008 ceph-mon[31434]: pgmap v54: 97 pgs: 97 active+clean; 92 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.6 MiB/s wr, 206 op/s 2024-03-16T20:59:32.996 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-03-16T20:59:32.998 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-03-16T20:59:32.998 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/ 2024-03-16T20:59:33.309 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-03-16T20:59:33.310 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-03-16T20:59:33.312 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-03-16T20:59:33.314 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-03-16T20:59:33.316 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-03-16T20:59:33.317 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-03-16T20:59:33.320 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-03-16T20:59:33.321 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-03-16T20:59:33.322 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-03-16T20:59:33.322 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-03-16T20:59:33.323 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-03-16T20:59:33.323 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-03-16T20:59:33.323 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-03-16T20:59:33.324 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-03-16T20:59:33.324 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-03-16T20:59:33.325 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-03-16T20:59:33.326 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-03-16T20:59:33.326 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-03-16T20:59:33.327 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-03-16T20:59:33.327 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-03-16T20:59:33.327 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-03-16T20:59:33.328 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-03-16T20:59:33.328 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-03-16T20:59:33.330 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-03-16T20:59:33.342 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-03-16T20:59:33.352 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/ 2024-03-16T20:59:33.355 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-03-16T20:59:33.356 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-03-16T20:59:33.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-03-16T20:59:33.357 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/balance 2024-03-16T20:59:33.358 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-03-16T20:59:33.359 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-03-16T20:59:33.359 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-03-16T20:59:33.359 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-03-16T20:59:33.360 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-03-16T20:59:33.361 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-03-16T20:59:33.361 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/numa 2024-03-16T20:59:33.362 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-03-16T20:59:33.363 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-03-16T20:59:33.364 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-03-16T20:59:33.364 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-03-16T20:59:33.365 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-03-16T20:59:33.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-03-16T20:59:33.366 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-03-16T20:59:33.367 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-03-16T20:59:33.367 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-03-16T20:59:33.367 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-03-16T20:59:33.368 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-03-16T20:59:33.368 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-03-16T20:59:33.368 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-03-16T20:59:33.381 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-03-16T20:59:33.389 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/ 2024-03-16T20:59:33.392 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-03-16T20:59:33.394 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-03-16T20:59:33.396 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-03-16T20:59:33.397 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-03-16T20:59:33.398 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-03-16T20:59:33.398 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-03-16T20:59:33.398 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-03-16T20:59:33.399 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-03-16T20:59:33.399 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-03-16T20:59:33.403 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-03-16T20:59:33.405 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-03-16T20:59:33.405 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-03-16T20:59:33.406 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-03-16T20:59:33.406 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-03-16T20:59:33.407 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-03-16T20:59:33.407 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-03-16T20:59:33.408 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/ 2024-03-16T20:59:33.414 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-03-16T20:59:33.416 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-03-16T20:59:33.416 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-03-16T20:59:33.416 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-03-16T20:59:33.417 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-03-16T20:59:33.419 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-03-16T20:59:33.421 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-03-16T20:59:33.421 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-03-16T20:59:33.422 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-03-16T20:59:33.422 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-03-16T20:59:33.422 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-03-16T20:59:33.423 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-03-16T20:59:33.423 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-03-16T20:59:33.423 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/wimax/ 2024-03-16T20:59:33.434 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-03-16T20:59:33.436 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-03-16T20:59:33.436 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-03-16T20:59:33.439 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/ 2024-03-16T20:59:33.441 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-03-16T20:59:33.443 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-03-16T20:59:33.443 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-03-16T20:59:33.443 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-03-16T20:59:33.444 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-03-16T20:59:33.444 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-03-16T20:59:33.444 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-03-16T20:59:33.448 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-03-16T20:59:33.450 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-03-16T20:59:33.451 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-03-16T20:59:33.451 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-03-16T20:59:33.452 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-03-16T20:59:33.452 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-03-16T20:59:33.452 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-03-16T20:59:33.456 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-03-16T20:59:33.458 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-03-16T20:59:33.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-03-16T20:59:33.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-03-16T20:59:33.459 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-03-16T20:59:33.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-03-16T20:59:33.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-03-16T20:59:33.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-03-16T20:59:33.460 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-03-16T20:59:33.461 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-03-16T20:59:33.466 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/xtensa/ 2024-03-16T20:59:33.469 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-03-16T20:59:33.472 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-03-16T20:59:33.472 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/xz.txt 2024-03-16T20:59:33.473 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-03-16T20:59:33.476 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-03-16T20:59:33.479 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-03-16T20:59:33.479 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-03-16T20:59:33.480 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-03-16T20:59:33.480 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-03-16T20:59:33.480 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-03-16T20:59:33.480 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-03-16T20:59:33.484 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-03-16T20:59:33.486 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-03-16T20:59:33.487 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-03-16T20:59:33.489 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-03-16T20:59:33.490 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-03-16T20:59:33.491 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-03-16T20:59:33.491 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-03-16T20:59:33.491 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-03-16T20:59:33.492 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-03-16T20:59:33.495 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-03-16T20:59:33.497 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-03-16T20:59:33.497 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-03-16T20:59:33.498 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-03-16T20:59:33.498 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-03-16T20:59:33.499 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-03-16T20:59:33.499 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-03-16T20:59:33.499 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-03-16T20:59:33.499 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-03-16T20:59:33.504 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-03-16T20:59:33.507 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-03-16T20:59:33.508 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-03-16T20:59:33.508 INFO:tasks.workunit.client.0.smithi008.stdout:linux-4.0.5/Documentation/zorro.txt 2024-03-16T20:59:34.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:34 smithi170 ceph-mon[35947]: pgmap v55: 97 pgs: 97 active+clean; 92 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.6 MiB/s wr, 200 op/s 2024-03-16T20:59:34.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:34 smithi186 ceph-mon[36391]: pgmap v55: 97 pgs: 97 active+clean; 92 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.6 MiB/s wr, 200 op/s 2024-03-16T20:59:34.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:34 smithi008 ceph-mon[31434]: pgmap v55: 97 pgs: 97 active+clean; 92 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.6 MiB/s wr, 200 op/s 2024-03-16T20:59:36.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:36 smithi170 ceph-mon[35947]: pgmap v56: 97 pgs: 97 active+clean; 92 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.6 MiB/s wr, 200 op/s 2024-03-16T20:59:36.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:36 smithi186 ceph-mon[36391]: pgmap v56: 97 pgs: 97 active+clean; 92 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.6 MiB/s wr, 200 op/s 2024-03-16T20:59:36.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:36 smithi008 ceph-mon[31434]: pgmap v56: 97 pgs: 97 active+clean; 92 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.6 MiB/s wr, 200 op/s 2024-03-16T20:59:38.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:38 smithi170 ceph-mon[35947]: pgmap v57: 97 pgs: 97 active+clean; 95 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.9 MiB/s wr, 213 op/s 2024-03-16T20:59:38.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:38 smithi186 ceph-mon[36391]: pgmap v57: 97 pgs: 97 active+clean; 95 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.9 MiB/s wr, 213 op/s 2024-03-16T20:59:38.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:38 smithi008 ceph-mon[31434]: pgmap v57: 97 pgs: 97 active+clean; 95 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.9 MiB/s wr, 213 op/s 2024-03-16T20:59:39.054 INFO:tasks.workunit.client.0.smithi008.stderr:+ tar cf doc.tar linux-4.0.5 2024-03-16T20:59:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.594+0000 7f158be00640 1 -- 172.21.15.8:0/2790735372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c10b930 msgr2=0x7f158c10dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.594+0000 7f158be00640 1 --2- 172.21.15.8:0/2790735372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c10b930 0x7f158c10dd80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1584009ca0 tx=0x7f158402c100 comp rx=0 tx=0).stop 2024-03-16T20:59:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.594+0000 7f158be00640 1 -- 172.21.15.8:0/2790735372 shutdown_connections 2024-03-16T20:59:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.594+0000 7f158be00640 1 --2- 172.21.15.8:0/2790735372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c10b930 0x7f158c10dd80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.594+0000 7f158be00640 1 --2- 172.21.15.8:0/2790735372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f158c102e80 0x7f158c10b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.594+0000 7f158be00640 1 --2- 172.21.15.8:0/2790735372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c102560 0x7f158c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.594+0000 7f158be00640 1 -- 172.21.15.8:0/2790735372 >> 172.21.15.8:0/2790735372 conn(0x7f158c0fbd00 msgr2=0x7f158c0fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.594+0000 7f158be00640 1 -- 172.21.15.8:0/2790735372 shutdown_connections 2024-03-16T20:59:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.594+0000 7f158be00640 1 -- 172.21.15.8:0/2790735372 wait complete. 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.595+0000 7f158be00640 1 Processor -- start 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.595+0000 7f158be00640 1 -- start start 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c102560 0x7f158c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c102e80 0x7f158c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f158c10b930 0x7f158c199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158be00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c19a050 con 0x7f158c102560 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c19a1c0 con 0x7f158c10b930 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c19a380 con 0x7f158c102e80 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f158c10b930 0x7f158c199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c102e80 0x7f158c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f158c10b930 0x7f158c199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36004/0 (socket says 172.21.15.8:36004) 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158b400640 1 -- 172.21.15.8:0/3933010561 learned_addr learned my addr 172.21.15.8:0/3933010561 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158aa00640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c102560 0x7f158c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158b400640 1 -- 172.21.15.8:0/3933010561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c102e80 msgr2=0x7f158c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158b400640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c102e80 0x7f158c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158b400640 1 -- 172.21.15.8:0/3933010561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c102560 msgr2=0x7f158c19f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.596+0000 7f158b400640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c102560 0x7f158c19f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.597+0000 7f158b400640 1 -- 172.21.15.8:0/3933010561 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1584009900 con 0x7f158c10b930 2024-03-16T20:59:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.597+0000 7f158b400640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f158c10b930 0x7f158c199a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1584037040 tx=0x7f1584032990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.597+0000 7f1583400640 1 -- 172.21.15.8:0/3933010561 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584034650 con 0x7f158c10b930 2024-03-16T20:59:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.597+0000 7f158be00640 1 -- 172.21.15.8:0/3933010561 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c19a600 con 0x7f158c10b930 2024-03-16T20:59:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.597+0000 7f1583400640 1 -- 172.21.15.8:0/3933010561 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1584003e70 con 0x7f158c10b930 2024-03-16T20:59:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.597+0000 7f1583400640 1 -- 172.21.15.8:0/3933010561 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584004720 con 0x7f158c10b930 2024-03-16T20:59:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.597+0000 7f158be00640 1 -- 172.21.15.8:0/3933010561 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c1a68f0 con 0x7f158c10b930 2024-03-16T20:59:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.600+0000 7f1583400640 1 -- 172.21.15.8:0/3933010561 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f158403b040 con 0x7f158c10b930 2024-03-16T20:59:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.601+0000 7f15947f5740 1 Processor -- start 2024-03-16T20:59:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.601+0000 7f15947f5740 1 -- start start 2024-03-16T20:59:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.601+0000 7f15947f5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d13425d60 0x558d13424ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.601+0000 7f15947f5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d13425470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.601+0000 7f15947f5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d1342e570 0x558d13430960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.601+0000 7f15947f5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d133e0620 con 0x558d13425d60 2024-03-16T20:59:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.601+0000 7f15947f5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d133928c0 con 0x558d1342e570 2024-03-16T20:59:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.601+0000 7f15947f5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1338fdf0 con 0x558d13424ff0 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.601+0000 7f158a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d13425d60 0x558d13424ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.601+0000 7f158aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d13425470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f158aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d13425470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40594/0 (socket says 172.21.15.8:40594) 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f158aa00640 1 -- 172.21.15.8:0/1435362679 learned_addr learned my addr 172.21.15.8:0/1435362679 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f158a000640 1 --2- 172.21.15.8:0/1435362679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d1342e570 0x558d13430960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f158aa00640 1 -- 172.21.15.8:0/1435362679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d1342e570 msgr2=0x558d13430960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f158aa00640 1 --2- 172.21.15.8:0/1435362679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d1342e570 0x558d13430960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f158aa00640 1 -- 172.21.15.8:0/1435362679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d13425d60 msgr2=0x558d13424ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f158aa00640 1 --2- 172.21.15.8:0/1435362679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d13425d60 0x558d13424ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f158aa00640 1 -- 172.21.15.8:0/1435362679 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d1330cb00 con 0x558d13424ff0 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f158a000640 1 --2- 172.21.15.8:0/1435362679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d1342e570 0x558d13430960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f1583400640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15700a1c10 0x7f15700a40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f1583400640 1 -- 172.21.15.8:0/3933010561 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f15840effe0 con 0x7f158c10b930 2024-03-16T20:59:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f158aa00640 1 --2- 172.21.15.8:0/1435362679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d13425470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f157c009c90 tx=0x7f157c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ea7a1d184445256 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.602+0000 7f158a000640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15700a1c10 0x7f15700a40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.603+0000 7f1577e00640 1 -- 172.21.15.8:0/1435362679 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c005220 con 0x558d13424ff0 2024-03-16T20:59:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.603+0000 7f1577e00640 1 -- 172.21.15.8:0/1435362679 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f157c004ca0 con 0x558d13424ff0 2024-03-16T20:59:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.603+0000 7f1577e00640 1 -- 172.21.15.8:0/1435362679 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c019810 con 0x558d13424ff0 2024-03-16T20:59:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.603+0000 7f15947f5740 1 -- 172.21.15.8:0/1435362679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 msgr2=0x558d13425470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.603+0000 7f15947f5740 1 --2- 172.21.15.8:0/1435362679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d13425470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f157c009c90 tx=0x7f157c011810 comp rx=0 tx=0).stop 2024-03-16T20:59:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.603+0000 7f158a000640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15700a1c10 0x7f15700a40d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x558d13420e70 tx=0x7f1578015040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.603+0000 7f15947f5740 1 -- 172.21.15.8:0/1435362679 shutdown_connections 2024-03-16T20:59:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.603+0000 7f15947f5740 1 --2- 172.21.15.8:0/1435362679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d1342e570 0x558d13430960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.603+0000 7f15947f5740 1 --2- 172.21.15.8:0/1435362679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d13425470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.603+0000 7f15947f5740 1 --2- 172.21.15.8:0/1435362679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d13425d60 0x558d13424ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.604+0000 7f15947f5740 1 -- 172.21.15.8:0/1435362679 >> 172.21.15.8:0/1435362679 conn(0x558d133ec4b0 msgr2=0x558d1341fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.604+0000 7f15947f5740 1 -- 172.21.15.8:0/1435362679 shutdown_connections 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.604+0000 7f15947f5740 1 -- 172.21.15.8:0/1435362679 wait complete. 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.604+0000 7f15947f5740 1 -- start start 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.604+0000 7f15947f5740 1 Processor -- start 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f15947f5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d1342b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f15947f5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f15947f5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d1342e570 0x558d1342c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f15947f5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1338b5d0 con 0x558d1342e570 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f15947f5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d13330b50 con 0x558d13425d60 2024-03-16T20:59:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f15947f5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d133307f0 con 0x558d13424ff0 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f15947f5740 10 client.0 _ll_register_callbacks cb 0x558d13344550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f158a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f158aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d1342b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f158a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36018/0 (socket says 172.21.15.8:36018) 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f158b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d1342e570 0x558d1342c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f158a000640 1 -- 172.21.15.8:0/2542302123 learned_addr learned my addr 172.21.15.8:0/2542302123 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f158a000640 1 -- 172.21.15.8:0/2542302123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 msgr2=0x558d1342b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f158a000640 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d1342b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f158a000640 1 -- 172.21.15.8:0/2542302123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d1342e570 msgr2=0x558d1342c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f158a000640 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d1342e570 0x558d1342c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f158a000640 1 -- 172.21.15.8:0/2542302123 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c0098f0 con 0x558d13425d60 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.605+0000 7f158b400640 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d1342e570 0x558d1342c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.606+0000 7f158a000640 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342baf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1578021930 tx=0x7f1578005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90a19330fd08ff10 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.606+0000 7f1574c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.606+0000 7f1574c00640 1 -- 172.21.15.8:0/2542302123 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157801f910 con 0x558d13425d60 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.606+0000 7f1574c00640 1 -- 172.21.15.8:0/2542302123 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f157801fa70 con 0x558d13425d60 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.606+0000 7f15947f5740 1 -- 172.21.15.8:0/2542302123 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d1335dcd0 con 0x558d13425d60 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.606+0000 7f1574c00640 1 -- 172.21.15.8:0/2542302123 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f157801fc30 con 0x558d13425d60 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.606+0000 7f15947f5740 10 client.25916 fetch_fsmap learned FSMap version 25 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.606+0000 7f15947f5740 1 -- 172.21.15.8:0/2542302123 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x558d13389c50 con 0x558d13425d60 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.607+0000 7f1574c00640 1 -- 172.21.15.8:0/2542302123 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x558d1335dcd0 con 0x558d13425d60 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.607+0000 7f1574c00640 1 -- 172.21.15.8:0/2542302123 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f157802a4c0 con 0x558d13425d60 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.607+0000 7f15947f5740 10 client.25916 fetch_fsmap finished waiting for FSMap version 25 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.607+0000 7f15947f5740 10 client.25916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.607+0000 7f15947f5740 20 client.25916 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.607+0000 7f15947f5740 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558d1343e6a0 0x558d13440ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.607+0000 7f15947f5740 4 client.25916 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.607+0000 7f15947f5740 1 -- 172.21.15.8:0/2542302123 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d13381ce0 con 0x558d1343e6a0 2024-03-16T20:59:39.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.607+0000 7f158aa00640 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558d1343e6a0 0x558d13440ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.608+0000 7f158aa00640 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558d1343e6a0 0x558d13440ac0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70f269eb32479b07 server_cookie=6a069c5e87ef43d1 in_seq=0 out_seq=0 2024-03-16T20:59:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.608+0000 7f1574c00640 10 client.25916 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f1574c00640 1 -- 172.21.15.8:0/2542302123 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x558d13381ce0 con 0x558d1343e6a0 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f1574c00640 10 client.25916 handle_command_reply: tid=0 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 1 client.25916 shutdown 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 1 -- 172.21.15.8:0/2542302123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 msgr2=0x558d1342baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342baf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1578021930 tx=0x7f1578005f90 comp rx=0 tx=0).stop 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 1 -- 172.21.15.8:0/2542302123 shutdown_connections 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558d1343e6a0 0x558d13440ac0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d1342e570 0x558d1342c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342baf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f1574c00640 0 client.25916 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 1 --2- 172.21.15.8:0/2542302123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d1342b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 1 -- 172.21.15.8:0/2542302123 >> 172.21.15.8:0/2542302123 conn(0x558d133ec4b0 msgr2=0x558d13421a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 1 -- 172.21.15.8:0/2542302123 shutdown_connections 2024-03-16T20:59:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 1 -- 172.21.15.8:0/2542302123 wait complete. 2024-03-16T20:59:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.609+0000 7f15947f5740 20 client.25916 trim_cache size 0 max 16384 2024-03-16T20:59:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.625+0000 7f15947f5740 1 Processor -- start 2024-03-16T20:59:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.625+0000 7f15947f5740 1 -- start start 2024-03-16T20:59:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.625+0000 7f15947f5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d1342dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.625+0000 7f15947f5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.625+0000 7f15947f5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d1342e570 0x558d134398a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.625+0000 7f15947f5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d130d3e60 con 0x558d1342e570 2024-03-16T20:59:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.625+0000 7f15947f5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d13420ce0 con 0x558d13425d60 2024-03-16T20:59:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.625+0000 7f15947f5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1341f550 con 0x558d13424ff0 2024-03-16T20:59:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d1342dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36030/0 (socket says 172.21.15.8:36030) 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158a000640 1 -- 172.21.15.8:0/3220615646 learned_addr learned my addr 172.21.15.8:0/3220615646 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d1342dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:40610/0 (socket says 172.21.15.8:40610) 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158b400640 1 --2- 172.21.15.8:0/3220615646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d1342e570 0x558d134398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158a000640 1 -- 172.21.15.8:0/3220615646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 msgr2=0x558d1342dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158a000640 1 --2- 172.21.15.8:0/3220615646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d1342dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158a000640 1 -- 172.21.15.8:0/3220615646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d1342e570 msgr2=0x558d134398a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158a000640 1 --2- 172.21.15.8:0/3220615646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d1342e570 0x558d134398a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158a000640 1 -- 172.21.15.8:0/3220615646 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d13326530 con 0x558d13425d60 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158aa00640 1 --2- 172.21.15.8:0/3220615646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d1342dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.626+0000 7f158a000640 1 --2- 172.21.15.8:0/3220615646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342be50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f157801b040 tx=0x7f1578009ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a67bccfa79b027df server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.627+0000 7f1577400640 1 -- 172.21.15.8:0/3220615646 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157802ac60 con 0x558d13425d60 2024-03-16T20:59:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.627+0000 7f1577400640 1 -- 172.21.15.8:0/3220615646 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1578004540 con 0x558d13425d60 2024-03-16T20:59:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.627+0000 7f1577400640 1 -- 172.21.15.8:0/3220615646 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157801f9c0 con 0x558d13425d60 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.627+0000 7f15947f5740 1 -- 172.21.15.8:0/3220615646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 msgr2=0x558d1342be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.627+0000 7f15947f5740 1 --2- 172.21.15.8:0/3220615646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342be50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f157801b040 tx=0x7f1578009ad0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.627+0000 7f15947f5740 1 -- 172.21.15.8:0/3220615646 shutdown_connections 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.627+0000 7f15947f5740 1 --2- 172.21.15.8:0/3220615646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d1342e570 0x558d134398a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.627+0000 7f15947f5740 1 --2- 172.21.15.8:0/3220615646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13425d60 0x558d1342be50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.627+0000 7f15947f5740 1 --2- 172.21.15.8:0/3220615646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d13424ff0 0x558d1342dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.627+0000 7f15947f5740 1 -- 172.21.15.8:0/3220615646 >> 172.21.15.8:0/3220615646 conn(0x558d133ec4b0 msgr2=0x558d13424510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.628+0000 7f15947f5740 1 -- 172.21.15.8:0/3220615646 shutdown_connections 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.628+0000 7f15947f5740 1 -- 172.21.15.8:0/3220615646 wait complete. 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.628+0000 7f15947f5740 1 -- start start 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.628+0000 7f15947f5740 1 Processor -- start 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f15947f5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13424ff0 0x558d13428830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f15947f5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d13425d60 0x558d13428d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f15947f5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d1342e570 0x558d134292b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f15947f5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1342ed80 con 0x558d13425d60 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f15947f5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1342eef0 con 0x558d13424ff0 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f15947f5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1342f0b0 con 0x558d1342e570 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f15947f5740 10 client.0 _ll_register_callbacks cb 0x7f15780217f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f158aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13424ff0 0x558d13428830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f158a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d13425d60 0x558d13428d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f158aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13424ff0 0x558d13428830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36032/0 (socket says 172.21.15.8:36032) 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f158aa00640 1 -- 172.21.15.8:0/1278566913 learned_addr learned my addr 172.21.15.8:0/1278566913 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f158b400640 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d1342e570 0x558d134292b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f158aa00640 1 -- 172.21.15.8:0/1278566913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d1342e570 msgr2=0x558d134292b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f158aa00640 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d1342e570 0x558d134292b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f158aa00640 1 -- 172.21.15.8:0/1278566913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d13425d60 msgr2=0x558d13428d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f158aa00640 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d13425d60 0x558d13428d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f158aa00640 1 -- 172.21.15.8:0/1278566913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d1330cb00 con 0x558d13424ff0 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f158aa00640 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13424ff0 0x558d13428830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f157c009380 tx=0x7f157c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0da5d9c3d451a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.629+0000 7f1574c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.630+0000 7f1574c00640 1 -- 172.21.15.8:0/1278566913 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c02d800 con 0x558d13424ff0 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.630+0000 7f1574c00640 1 -- 172.21.15.8:0/1278566913 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f157c029040 con 0x558d13424ff0 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.630+0000 7f15947f5740 1 -- 172.21.15.8:0/1278566913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d1308b600 con 0x558d13424ff0 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.630+0000 7f1574c00640 1 -- 172.21.15.8:0/1278566913 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f157c02d960 con 0x558d13424ff0 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.630+0000 7f15947f5740 10 client.25922 fetch_fsmap learned FSMap version 25 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.630+0000 7f15947f5740 1 -- 172.21.15.8:0/1278566913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x558d13389c50 con 0x558d13424ff0 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.631+0000 7f1574c00640 1 -- 172.21.15.8:0/1278566913 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x558d1308b600 con 0x558d13424ff0 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.631+0000 7f1574c00640 1 -- 172.21.15.8:0/1278566913 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f157c021040 con 0x558d13424ff0 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.631+0000 7f15947f5740 10 client.25922 fetch_fsmap finished waiting for FSMap version 25 2024-03-16T20:59:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.631+0000 7f15947f5740 10 client.25922 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.631+0000 7f15947f5740 20 client.25922 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.631+0000 7f15947f5740 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558d1349a910 0x558d1349cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.631+0000 7f15947f5740 4 client.25922 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T20:59:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.631+0000 7f15947f5740 1 -- 172.21.15.8:0/1278566913 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558d130dc1b0 con 0x558d1349a910 2024-03-16T20:59:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.631+0000 7f158a000640 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558d1349a910 0x558d1349cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.632+0000 7f158a000640 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558d1349a910 0x558d1349cd30 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98b7eb35c28907ce server_cookie=ca1fd41c36c103e9 in_seq=0 out_seq=0 2024-03-16T20:59:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:39.632+0000 7f1574c00640 10 client.25922 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:39.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:39 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:59:39.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:39 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:59:39.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:39 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:59:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f1574c00640 1 -- 172.21.15.8:0/1278566913 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558d130dc1b0 con 0x558d1349a910 2024-03-16T20:59:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f1574c00640 10 client.25922 handle_command_reply: tid=0 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f15947f5740 1 client.25922 shutdown 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f15947f5740 1 -- 172.21.15.8:0/1278566913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13424ff0 msgr2=0x558d13428830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f15947f5740 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13424ff0 0x558d13428830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f157c009380 tx=0x7f157c009c00 comp rx=0 tx=0).stop 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f15947f5740 1 -- 172.21.15.8:0/1278566913 shutdown_connections 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f15947f5740 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558d1342e570 0x558d134292b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f15947f5740 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558d1349a910 0x558d1349cd30 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f15947f5740 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d13425d60 0x558d13428d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f15947f5740 1 --2- 172.21.15.8:0/1278566913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d13424ff0 0x558d13428830 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f1574c00640 0 client.25922 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f15947f5740 1 -- 172.21.15.8:0/1278566913 >> 172.21.15.8:0/1278566913 conn(0x558d133ec4b0 msgr2=0x558d134210c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f15947f5740 1 -- 172.21.15.8:0/1278566913 shutdown_connections 2024-03-16T20:59:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.233+0000 7f15947f5740 1 -- 172.21.15.8:0/1278566913 wait complete. 2024-03-16T20:59:40.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f15947f5740 20 client.25922 trim_cache size 0 max 16384 2024-03-16T20:59:40.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T20:59:40.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T20:59:40.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T20:59:40.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T20:59:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f158be00640 1 -- 172.21.15.8:0/3933010561 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15700a1c10 msgr2=0x7f15700a40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f158be00640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15700a1c10 0x7f15700a40d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x558d13420e70 tx=0x7f1578015040 comp rx=0 tx=0).stop 2024-03-16T20:59:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f158be00640 1 -- 172.21.15.8:0/3933010561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f158c10b930 msgr2=0x7f158c199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f158be00640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f158c10b930 0x7f158c199a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1584037040 tx=0x7f1584032990 comp rx=0 tx=0).stop 2024-03-16T20:59:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f158be00640 1 -- 172.21.15.8:0/3933010561 shutdown_connections 2024-03-16T20:59:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f158be00640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15700a1c10 0x7f15700a40d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f158be00640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f158c10b930 0x7f158c199a00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f158be00640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c102e80 0x7f158c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f158be00640 1 --2- 172.21.15.8:0/3933010561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f158c102560 0x7f158c19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f158be00640 1 -- 172.21.15.8:0/3933010561 >> 172.21.15.8:0/3933010561 conn(0x7f158c0fbd00 msgr2=0x7f158c1000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:40.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.234+0000 7f158be00640 1 -- 172.21.15.8:0/3933010561 shutdown_connections 2024-03-16T20:59:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:40.235+0000 7f158be00640 1 -- 172.21.15.8:0/3933010561 wait complete. 2024-03-16T20:59:40.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:40 smithi170 ceph-mon[35947]: pgmap v58: 97 pgs: 97 active+clean; 95 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 3.2 MiB/s wr, 204 op/s 2024-03-16T20:59:40.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:40 smithi186 ceph-mon[36391]: pgmap v58: 97 pgs: 97 active+clean; 95 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 3.2 MiB/s wr, 204 op/s 2024-03-16T20:59:40.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:40 smithi008 ceph-mon[31434]: pgmap v58: 97 pgs: 97 active+clean; 95 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 3.2 MiB/s wr, 204 op/s 2024-03-16T20:59:41.012 INFO:tasks.workunit.client.0.smithi008.stderr:+ tar xf doc.tar 2024-03-16T20:59:42.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:42 smithi170 ceph-mon[35947]: pgmap v59: 97 pgs: 97 active+clean; 84 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 728 op/s 2024-03-16T20:59:42.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:42 smithi186 ceph-mon[36391]: pgmap v59: 97 pgs: 97 active+clean; 84 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 728 op/s 2024-03-16T20:59:42.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:42 smithi008 ceph-mon[31434]: pgmap v59: 97 pgs: 97 active+clean; 84 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 728 op/s 2024-03-16T20:59:44.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:44 smithi170 ceph-mon[35947]: pgmap v60: 97 pgs: 97 active+clean; 84 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 532 KiB/s wr, 535 op/s 2024-03-16T20:59:44.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:44 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:59:44.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:44 smithi186 ceph-mon[36391]: pgmap v60: 97 pgs: 97 active+clean; 84 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 532 KiB/s wr, 535 op/s 2024-03-16T20:59:44.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:44 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:59:44.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:44 smithi008 ceph-mon[31434]: pgmap v60: 97 pgs: 97 active+clean; 84 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 532 KiB/s wr, 535 op/s 2024-03-16T20:59:44.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:44 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T20:59:46.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:46 smithi170 ceph-mon[35947]: pgmap v61: 97 pgs: 97 active+clean; 84 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 532 KiB/s wr, 535 op/s 2024-03-16T20:59:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:46 smithi186 ceph-mon[36391]: pgmap v61: 97 pgs: 97 active+clean; 84 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 532 KiB/s wr, 535 op/s 2024-03-16T20:59:46.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:46 smithi008 ceph-mon[31434]: pgmap v61: 97 pgs: 97 active+clean; 84 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 532 KiB/s wr, 535 op/s 2024-03-16T20:59:48.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T20:59:48.739 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T20:59:48.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:48 smithi008 ceph-mon[31434]: pgmap v62: 97 pgs: 97 active+clean; 92 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.2 MiB/s wr, 542 op/s 2024-03-16T20:59:48.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:48 smithi170 ceph-mon[35947]: pgmap v62: 97 pgs: 97 active+clean; 92 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.2 MiB/s wr, 542 op/s 2024-03-16T20:59:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:48 smithi186 ceph-mon[36391]: pgmap v62: 97 pgs: 97 active+clean; 92 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.2 MiB/s wr, 542 op/s 2024-03-16T20:59:48.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.964+0000 7f2969600640 1 -- 172.21.15.8:0/4094055979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29641015d0 msgr2=0x7f29641019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:48.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.964+0000 7f2969600640 1 --2- 172.21.15.8:0/4094055979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29641015d0 0x7f29641019b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2954009930 tx=0x7f295402bc30 comp rx=0 tx=0).stop 2024-03-16T20:59:48.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.964+0000 7f2969600640 1 -- 172.21.15.8:0/4094055979 shutdown_connections 2024-03-16T20:59:48.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.964+0000 7f2969600640 1 --2- 172.21.15.8:0/4094055979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29641066a0 0x7f296410e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.964+0000 7f2969600640 1 --2- 172.21.15.8:0/4094055979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2964101f80 0x7f2964105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.964+0000 7f2969600640 1 --2- 172.21.15.8:0/4094055979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29641015d0 0x7f29641019b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.964+0000 7f2969600640 1 -- 172.21.15.8:0/4094055979 >> 172.21.15.8:0/4094055979 conn(0x7f29640fce90 msgr2=0x7f29640ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:48.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.964+0000 7f2969600640 1 -- 172.21.15.8:0/4094055979 shutdown_connections 2024-03-16T20:59:48.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.964+0000 7f2969600640 1 -- 172.21.15.8:0/4094055979 wait complete. 2024-03-16T20:59:48.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.965+0000 7f2969600640 1 Processor -- start 2024-03-16T20:59:48.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.965+0000 7f2969600640 1 -- start start 2024-03-16T20:59:48.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2969600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29641015d0 0x7f2964199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2969600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29641066a0 0x7f296419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2969600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296419e5e0 0x7f296419ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2969600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419efd0 con 0x7f296419e5e0 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2969600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419f140 con 0x7f29641066a0 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2969600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419f2b0 con 0x7f29641015d0 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2963e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29641015d0 0x7f2964199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2968c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296419e5e0 0x7f296419ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2963e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29641015d0 0x7f2964199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46908/0 (socket says 172.21.15.8:46908) 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2963e00640 1 -- 172.21.15.8:0/3881705399 learned_addr learned my addr 172.21.15.8:0/3881705399 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f295be00640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29641066a0 0x7f296419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2963e00640 1 -- 172.21.15.8:0/3881705399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29641066a0 msgr2=0x7f296419a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2963e00640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29641066a0 0x7f296419a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2963e00640 1 -- 172.21.15.8:0/3881705399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296419e5e0 msgr2=0x7f296419ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:48.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2963e00640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296419e5e0 0x7f296419ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.966+0000 7f2963e00640 1 -- 172.21.15.8:0/3881705399 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2954009560 con 0x7f29641015d0 2024-03-16T20:59:48.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.967+0000 7f2963e00640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29641015d0 0x7f2964199d20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2954000c00 tx=0x7f295402ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:48.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.967+0000 7f2961600640 1 -- 172.21.15.8:0/3881705399 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954004250 con 0x7f29641015d0 2024-03-16T20:59:48.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.967+0000 7f2961600640 1 -- 172.21.15.8:0/3881705399 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f29540043b0 con 0x7f29641015d0 2024-03-16T20:59:48.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.967+0000 7f2961600640 1 -- 172.21.15.8:0/3881705399 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954003c30 con 0x7f29641015d0 2024-03-16T20:59:48.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.967+0000 7f2969600640 1 -- 172.21.15.8:0/3881705399 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29641a6890 con 0x7f29641015d0 2024-03-16T20:59:48.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.967+0000 7f2969600640 1 -- 172.21.15.8:0/3881705399 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29641a6d10 con 0x7f29641015d0 2024-03-16T20:59:48.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.971+0000 7f2961600640 1 -- 172.21.15.8:0/3881705399 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f2954004e10 con 0x7f29641015d0 2024-03-16T20:59:48.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.971+0000 7f296d84f740 1 Processor -- start 2024-03-16T20:59:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.971+0000 7f296d84f740 1 -- start start 2024-03-16T20:59:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f296d84f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7497170 0x5581a7495ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f296d84f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 0x5581a7496910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f296d84f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a749f800 0x5581a74a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f296d84f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a7405150 con 0x5581a7497170 2024-03-16T20:59:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f296d84f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a7402680 con 0x5581a7496490 2024-03-16T20:59:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f296d84f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a73fde60 con 0x5581a749f800 2024-03-16T20:59:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f2963e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 0x5581a7496910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f295be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a749f800 0x5581a74a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f2963e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 0x5581a7496910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36888/0 (socket says 172.21.15.8:36888) 2024-03-16T20:59:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f2963e00640 1 -- 172.21.15.8:0/3999083175 learned_addr learned my addr 172.21.15.8:0/3999083175 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f2968c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7497170 0x5581a7495ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f295be00640 1 -- 172.21.15.8:0/3999083175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 msgr2=0x5581a7496910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f295be00640 1 --2- 172.21.15.8:0/3999083175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 0x5581a7496910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f2961600640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f29480a1ba0 0x7f29480a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f295be00640 1 -- 172.21.15.8:0/3999083175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7497170 msgr2=0x5581a7495ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f295be00640 1 --2- 172.21.15.8:0/3999083175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7497170 0x5581a7495ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.972+0000 7f295be00640 1 -- 172.21.15.8:0/3999083175 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581a73b7060 con 0x5581a749f800 2024-03-16T20:59:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.973+0000 7f2961600640 1 -- 172.21.15.8:0/3881705399 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f29540efdd0 con 0x7f29641015d0 2024-03-16T20:59:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.973+0000 7f295be00640 1 --2- 172.21.15.8:0/3999083175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a749f800 0x5581a74a1bf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2964069220 tx=0x7f294c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2f626d7911e35c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.973+0000 7f2968c00640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f29480a1ba0 0x7f29480a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.973+0000 7f2959200640 1 -- 172.21.15.8:0/3999083175 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c004030 con 0x5581a749f800 2024-03-16T20:59:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.973+0000 7f2959200640 1 -- 172.21.15.8:0/3999083175 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f294c015070 con 0x5581a749f800 2024-03-16T20:59:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.973+0000 7f2959200640 1 -- 172.21.15.8:0/3999083175 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c003ea0 con 0x5581a749f800 2024-03-16T20:59:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.974+0000 7f296d84f740 1 -- 172.21.15.8:0/3999083175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a749f800 msgr2=0x5581a74a1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.974+0000 7f2968c00640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f29480a1ba0 0x7f29480a4060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f295c005c40 tx=0x7f295c004a40 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.974+0000 7f296d84f740 1 --2- 172.21.15.8:0/3999083175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a749f800 0x5581a74a1bf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2964069220 tx=0x7f294c0107a0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.974+0000 7f296d84f740 1 -- 172.21.15.8:0/3999083175 shutdown_connections 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.974+0000 7f296d84f740 1 --2- 172.21.15.8:0/3999083175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a749f800 0x5581a74a1bf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.974+0000 7f296d84f740 1 --2- 172.21.15.8:0/3999083175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 0x5581a7496910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.974+0000 7f296d84f740 1 --2- 172.21.15.8:0/3999083175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7497170 0x5581a7495ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.974+0000 7f296d84f740 1 -- 172.21.15.8:0/3999083175 >> 172.21.15.8:0/3999083175 conn(0x5581a745d5a0 msgr2=0x5581a7490ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.974+0000 7f296d84f740 1 -- 172.21.15.8:0/3999083175 shutdown_connections 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.974+0000 7f296d84f740 1 -- 172.21.15.8:0/3999083175 wait complete. 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.975+0000 7f296d84f740 1 -- start start 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.975+0000 7f296d84f740 1 Processor -- start 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.975+0000 7f296d84f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7496490 0x5581a749c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.975+0000 7f296d84f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 0x5581a749ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.975+0000 7f296d84f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 0x5581a749d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.975+0000 7f296d84f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a73a2ec0 con 0x5581a7496490 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.975+0000 7f296d84f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a73a2b60 con 0x5581a749f800 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.975+0000 7f296d84f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a716c1c0 con 0x5581a7497170 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.975+0000 7f296d84f740 10 client.0 _ll_register_callbacks cb 0x5581a73b6960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f295be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 0x5581a749ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f2968c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 0x5581a749d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f295be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 0x5581a749ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46934/0 (socket says 172.21.15.8:46934) 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f295be00640 1 -- 172.21.15.8:0/1854024826 learned_addr learned my addr 172.21.15.8:0/1854024826 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f2963e00640 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7496490 0x5581a749c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f295be00640 1 -- 172.21.15.8:0/1854024826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 msgr2=0x5581a749d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f295be00640 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 0x5581a749d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f295be00640 1 -- 172.21.15.8:0/1854024826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7496490 msgr2=0x5581a749c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:48.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f295be00640 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7496490 0x5581a749c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f295be00640 1 -- 172.21.15.8:0/1854024826 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c00b820 con 0x5581a7497170 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f295be00640 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 0x5581a749ccc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f294c011010 tx=0x7f294c003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7755ddc56f4fee3e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.976+0000 7f2951600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.977+0000 7f2951600640 1 -- 172.21.15.8:0/1854024826 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c01f070 con 0x5581a7497170 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.977+0000 7f2951600640 1 -- 172.21.15.8:0/1854024826 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f294c017070 con 0x5581a7497170 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.977+0000 7f296d84f740 1 -- 172.21.15.8:0/1854024826 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581a70fd7e0 con 0x5581a7497170 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.977+0000 7f2951600640 1 -- 172.21.15.8:0/1854024826 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f294c005240 con 0x5581a7497170 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.977+0000 7f296d84f740 10 client.25945 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.977+0000 7f296d84f740 1 -- 172.21.15.8:0/1854024826 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5581a73fc4e0 con 0x5581a7497170 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.977+0000 7f2951600640 1 -- 172.21.15.8:0/1854024826 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5581a70fd7e0 con 0x5581a7497170 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.977+0000 7f2951600640 1 -- 172.21.15.8:0/1854024826 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f294c004830 con 0x5581a7497170 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.977+0000 7f296d84f740 10 client.25945 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.977+0000 7f296d84f740 10 client.25945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:48.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.978+0000 7f296d84f740 20 client.25945 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:48.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.978+0000 7f296d84f740 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5581a74af950 0x5581a74b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:48.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.978+0000 7f296d84f740 4 client.25945 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:48.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.978+0000 7f296d84f740 1 -- 172.21.15.8:0/1854024826 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581a713a720 con 0x5581a74af950 2024-03-16T20:59:48.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.978+0000 7f2963e00640 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5581a74af950 0x5581a74b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:48.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.978+0000 7f2963e00640 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5581a74af950 0x5581a74b1d70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6416e27ea485e2fa server_cookie=26ac8e96fad9279e in_seq=0 out_seq=0 2024-03-16T20:59:48.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.978+0000 7f2951600640 10 client.25945 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:48.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f2951600640 1 -- 172.21.15.8:0/1854024826 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5581a713a720 con 0x5581a74af950 2024-03-16T20:59:48.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f2951600640 10 client.25945 handle_command_reply: tid=0 2024-03-16T20:59:48.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f296d84f740 1 client.25945 shutdown 2024-03-16T20:59:48.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f296d84f740 1 -- 172.21.15.8:0/1854024826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 msgr2=0x5581a749ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:48.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f296d84f740 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 0x5581a749ccc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f294c011010 tx=0x7f294c003820 comp rx=0 tx=0).stop 2024-03-16T20:59:48.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f296d84f740 1 -- 172.21.15.8:0/1854024826 shutdown_connections 2024-03-16T20:59:48.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f296d84f740 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 0x5581a749d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f296d84f740 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 0x5581a749ccc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f296d84f740 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5581a74af950 0x5581a74b1d70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f296d84f740 1 --2- 172.21.15.8:0/1854024826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7496490 0x5581a749c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:48.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f296d84f740 1 -- 172.21.15.8:0/1854024826 >> 172.21.15.8:0/1854024826 conn(0x5581a745d5a0 msgr2=0x5581a7492c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:48.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.979+0000 7f2951600640 0 client.25945 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:48.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.980+0000 7f296d84f740 1 -- 172.21.15.8:0/1854024826 shutdown_connections 2024-03-16T20:59:48.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.980+0000 7f296d84f740 1 -- 172.21.15.8:0/1854024826 wait complete. 2024-03-16T20:59:48.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.980+0000 7f296d84f740 20 client.25945 trim_cache size 0 max 16384 2024-03-16T20:59:49.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f296d84f740 1 Processor -- start 2024-03-16T20:59:49.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f296d84f740 1 -- start start 2024-03-16T20:59:49.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f296d84f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7496490 0x5581a7492e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f296d84f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 0x5581a74aac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f296d84f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 0x5581a74ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f296d84f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a74a2550 con 0x5581a7496490 2024-03-16T20:59:49.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f296d84f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a74ac440 con 0x5581a749f800 2024-03-16T20:59:49.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f296d84f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a7495710 con 0x5581a7497170 2024-03-16T20:59:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f2968c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 0x5581a74ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f2968c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 0x5581a74ab1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36898/0 (socket says 172.21.15.8:36898) 2024-03-16T20:59:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f2968c00640 1 -- 172.21.15.8:0/920939585 learned_addr learned my addr 172.21.15.8:0/920939585 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f295be00640 1 --2- 172.21.15.8:0/920939585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 0x5581a74aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.998+0000 7f2963e00640 1 --2- 172.21.15.8:0/920939585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7496490 0x5581a7492e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.999+0000 7f2968c00640 1 -- 172.21.15.8:0/920939585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 msgr2=0x5581a74aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.999+0000 7f2968c00640 1 --2- 172.21.15.8:0/920939585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 0x5581a74aac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.999+0000 7f2968c00640 1 -- 172.21.15.8:0/920939585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7496490 msgr2=0x5581a7492e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.999+0000 7f2968c00640 1 --2- 172.21.15.8:0/920939585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7496490 0x5581a7492e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.999+0000 7f2968c00640 1 -- 172.21.15.8:0/920939585 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581a7398950 con 0x5581a749f800 2024-03-16T20:59:49.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:48.999+0000 7f2968c00640 1 --2- 172.21.15.8:0/920939585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 0x5581a74ab1b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f295c00f960 tx=0x7f295c013030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e409c9e06d25b6cb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:49.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.000+0000 7f2953e00640 1 -- 172.21.15.8:0/920939585 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c022050 con 0x5581a749f800 2024-03-16T20:59:49.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.000+0000 7f2953e00640 1 -- 172.21.15.8:0/920939585 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f295c023040 con 0x5581a749f800 2024-03-16T20:59:49.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.000+0000 7f2953e00640 1 -- 172.21.15.8:0/920939585 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c01d750 con 0x5581a749f800 2024-03-16T20:59:49.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.000+0000 7f296d84f740 1 -- 172.21.15.8:0/920939585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 msgr2=0x5581a74ab1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.000+0000 7f296d84f740 1 --2- 172.21.15.8:0/920939585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 0x5581a74ab1b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f295c00f960 tx=0x7f295c013030 comp rx=0 tx=0).stop 2024-03-16T20:59:49.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.000+0000 7f296d84f740 1 -- 172.21.15.8:0/920939585 shutdown_connections 2024-03-16T20:59:49.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.000+0000 7f296d84f740 1 --2- 172.21.15.8:0/920939585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a749f800 0x5581a74ab1b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.000+0000 7f296d84f740 1 --2- 172.21.15.8:0/920939585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a7497170 0x5581a74aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.000+0000 7f296d84f740 1 --2- 172.21.15.8:0/920939585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7496490 0x5581a7492e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.000+0000 7f296d84f740 1 -- 172.21.15.8:0/920939585 >> 172.21.15.8:0/920939585 conn(0x5581a745d5a0 msgr2=0x5581a748ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:49.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.001+0000 7f296d84f740 1 -- 172.21.15.8:0/920939585 shutdown_connections 2024-03-16T20:59:49.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.001+0000 7f296d84f740 1 -- 172.21.15.8:0/920939585 wait complete. 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.001+0000 7f296d84f740 1 -- start start 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.001+0000 7f296d84f740 1 Processor -- start 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f296d84f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 0x5581a74a7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f296d84f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7497170 0x5581a74a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f296d84f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a749f800 0x5581a74a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f296d84f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a74a60a0 con 0x5581a7497170 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f296d84f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a74a6210 con 0x5581a7496490 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f296d84f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a74a63d0 con 0x5581a749f800 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f296d84f740 10 client.0 _ll_register_callbacks cb 0x7f294c00ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f2963e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 0x5581a74a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f2963e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 0x5581a74a7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36910/0 (socket says 172.21.15.8:36910) 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f2963e00640 1 -- 172.21.15.8:0/2722173206 learned_addr learned my addr 172.21.15.8:0/2722173206 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f2968c00640 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a749f800 0x5581a74a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f295be00640 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7497170 0x5581a74a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f2963e00640 1 -- 172.21.15.8:0/2722173206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a749f800 msgr2=0x5581a74a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f2963e00640 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a749f800 0x5581a74a5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f2963e00640 1 -- 172.21.15.8:0/2722173206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7497170 msgr2=0x5581a74a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f2963e00640 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7497170 0x5581a74a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.002+0000 7f2963e00640 1 -- 172.21.15.8:0/2722173206 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295c00f6a0 con 0x5581a7496490 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.003+0000 7f2963e00640 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 0x5581a74a7280 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2954006010 tx=0x7f29540f8040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40037f56cb2d5ac3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.003+0000 7f2951600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.003+0000 7f2951600640 1 -- 172.21.15.8:0/2722173206 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29540bc620 con 0x5581a7496490 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.003+0000 7f2951600640 1 -- 172.21.15.8:0/2722173206 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f29540bd1e0 con 0x5581a7496490 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.003+0000 7f296d84f740 1 -- 172.21.15.8:0/2722173206 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f294c015070 con 0x5581a7496490 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.003+0000 7f2951600640 1 -- 172.21.15.8:0/2722173206 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29540bc440 con 0x5581a7496490 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.003+0000 7f296d84f740 10 client.25940 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.003+0000 7f296d84f740 1 -- 172.21.15.8:0/2722173206 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5581a73be430 con 0x5581a7496490 2024-03-16T20:59:49.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.003+0000 7f2951600640 1 -- 172.21.15.8:0/2722173206 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f294c015070 con 0x5581a7496490 2024-03-16T20:59:49.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.004+0000 7f2951600640 1 -- 172.21.15.8:0/2722173206 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f295403c070 con 0x5581a7496490 2024-03-16T20:59:49.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.004+0000 7f296d84f740 10 client.25940 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:49.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.004+0000 7f296d84f740 10 client.25940 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:49.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.004+0000 7f296d84f740 20 client.25940 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:49.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.004+0000 7f296d84f740 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5581a750c430 0x5581a750e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.004+0000 7f296d84f740 4 client.25940 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T20:59:49.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.004+0000 7f296d84f740 1 -- 172.21.15.8:0/2722173206 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5581a7189890 con 0x5581a750c430 2024-03-16T20:59:49.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.004+0000 7f295be00640 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5581a750c430 0x5581a750e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.004+0000 7f295be00640 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5581a750c430 0x5581a750e850 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45192d6bdb86710c server_cookie=3d41c26fdb824682 in_seq=0 out_seq=0 2024-03-16T20:59:49.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.004+0000 7f2951600640 10 client.25940 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:49.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f2951600640 1 -- 172.21.15.8:0/2722173206 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5581a7189890 con 0x5581a750c430 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f2951600640 10 client.25940 handle_command_reply: tid=0 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 1 client.25940 shutdown 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 1 -- 172.21.15.8:0/2722173206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 msgr2=0x5581a74a7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 0x5581a74a7280 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2954006010 tx=0x7f29540f8040 comp rx=0 tx=0).stop 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 1 -- 172.21.15.8:0/2722173206 shutdown_connections 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5581a749f800 0x5581a74a5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5581a750c430 0x5581a750e850 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5581a7497170 0x5581a74a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 1 --2- 172.21.15.8:0/2722173206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5581a7496490 0x5581a74a7280 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 1 -- 172.21.15.8:0/2722173206 >> 172.21.15.8:0/2722173206 conn(0x5581a745d5a0 msgr2=0x5581a74b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f2951600640 0 client.25940 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 1 -- 172.21.15.8:0/2722173206 shutdown_connections 2024-03-16T20:59:49.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 1 -- 172.21.15.8:0/2722173206 wait complete. 2024-03-16T20:59:49.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.005+0000 7f296d84f740 20 client.25940 trim_cache size 0 max 16384 2024-03-16T20:59:49.015 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:59:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T20:59:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T20:59:49.015 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:59:49.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 -- 172.21.15.8:0/3881705399 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f29480a1ba0 msgr2=0x7f29480a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f29480a1ba0 0x7f29480a4060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f295c005c40 tx=0x7f295c004a40 comp rx=0 tx=0).stop 2024-03-16T20:59:49.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 -- 172.21.15.8:0/3881705399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29641015d0 msgr2=0x7f2964199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29641015d0 0x7f2964199d20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2954000c00 tx=0x7f295402ce50 comp rx=0 tx=0).stop 2024-03-16T20:59:49.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 -- 172.21.15.8:0/3881705399 shutdown_connections 2024-03-16T20:59:49.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f29480a1ba0 0x7f29480a4060 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296419e5e0 0x7f296419ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29641066a0 0x7f296419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 --2- 172.21.15.8:0/3881705399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29641015d0 0x7f2964199d20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 -- 172.21.15.8:0/3881705399 >> 172.21.15.8:0/3881705399 conn(0x7f29640fce90 msgr2=0x7f29640fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:49.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 -- 172.21.15.8:0/3881705399 shutdown_connections 2024-03-16T20:59:49.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.006+0000 7f2969600640 1 -- 172.21.15.8:0/3881705399 wait complete. 2024-03-16T20:59:49.029 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T20:59:49.029 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T20:59:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.233+0000 7fc801000640 1 -- 172.21.15.8:0/2515804980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7fc101e60 msgr2=0x7fc7fc10e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.233+0000 7fc801000640 1 --2- 172.21.15.8:0/2515804980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7fc101e60 0x7fc7fc10e320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009cd0 tx=0x7fc7f402c0e0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.233+0000 7fc801000640 1 -- 172.21.15.8:0/2515804980 shutdown_connections 2024-03-16T20:59:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.233+0000 7fc801000640 1 --2- 172.21.15.8:0/2515804980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7fc101e60 0x7fc7fc10e320 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.233+0000 7fc801000640 1 --2- 172.21.15.8:0/2515804980 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7fc1014a0 0x7fc7fc101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.233+0000 7fc801000640 1 --2- 172.21.15.8:0/2515804980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc107560 0x7fc7fc107940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.233+0000 7fc801000640 1 -- 172.21.15.8:0/2515804980 >> 172.21.15.8:0/2515804980 conn(0x7fc7fc0fcf90 msgr2=0x7fc7fc0ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.233+0000 7fc801000640 1 -- 172.21.15.8:0/2515804980 shutdown_connections 2024-03-16T20:59:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.233+0000 7fc801000640 1 -- 172.21.15.8:0/2515804980 wait complete. 2024-03-16T20:59:49.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.234+0000 7fc801000640 1 Processor -- start 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.234+0000 7fc801000640 1 -- start start 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.234+0000 7fc801000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7fc1014a0 0x7fc7fc108330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.234+0000 7fc801000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc101e60 0x7fc7fc108870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc801000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7fc107560 0x7fc7fc108db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc801000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc1aa360 con 0x7fc7fc1014a0 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc801000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc1aa4a0 con 0x7fc7fc101e60 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc801000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc1aa5e0 con 0x7fc7fc107560 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc7f3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc101e60 0x7fc7fc108870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc7fa800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7fc107560 0x7fc7fc108db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc7f3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc101e60 0x7fc7fc108870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36926/0 (socket says 172.21.15.8:36926) 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc7f3e00640 1 -- 172.21.15.8:0/388932018 learned_addr learned my addr 172.21.15.8:0/388932018 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc7f9e00640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7fc1014a0 0x7fc7fc108330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc7fa800640 1 -- 172.21.15.8:0/388932018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc101e60 msgr2=0x7fc7fc108870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc7fa800640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc101e60 0x7fc7fc108870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc7fa800640 1 -- 172.21.15.8:0/388932018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7fc1014a0 msgr2=0x7fc7fc108330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc7fa800640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7fc1014a0 0x7fc7fc108330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc7fa800640 1 -- 172.21.15.8:0/388932018 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f4009900 con 0x7fc7fc107560 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.235+0000 7fc7f3e00640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc101e60 0x7fc7fc108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.236+0000 7fc7fa800640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7fc107560 0x7fc7fc108db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4037040 tx=0x7fc7f4032ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.236+0000 7fc7f2a00640 1 -- 172.21.15.8:0/388932018 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40329b0 con 0x7fc7fc107560 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.236+0000 7fc7f2a00640 1 -- 172.21.15.8:0/388932018 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc7f4003e70 con 0x7fc7fc107560 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.236+0000 7fc801000640 1 -- 172.21.15.8:0/388932018 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7fc1aa830 con 0x7fc7fc107560 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.236+0000 7fc7f2a00640 1 -- 172.21.15.8:0/388932018 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40047c0 con 0x7fc7fc107560 2024-03-16T20:59:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.236+0000 7fc801000640 1 -- 172.21.15.8:0/388932018 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7fc1aad00 con 0x7fc7fc107560 2024-03-16T20:59:49.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.237+0000 7fc801000640 1 -- 172.21.15.8:0/388932018 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7fc102bc0 con 0x7fc7fc107560 2024-03-16T20:59:49.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.239+0000 7fc7f2a00640 1 -- 172.21.15.8:0/388932018 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fc7f400a040 con 0x7fc7fc107560 2024-03-16T20:59:49.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.240+0000 7fc7f2a00640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc7e00a1c20 0x7fc7e00a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.240+0000 7fc7f2a00640 1 -- 172.21.15.8:0/388932018 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc7f40efde0 con 0x7fc7fc107560 2024-03-16T20:59:49.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.241+0000 7fc7f9e00640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc7e00a1c20 0x7fc7e00a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.241+0000 7fc7f9e00640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc7e00a1c20 0x7fc7e00a40e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009bd0 tx=0x7fc7ec005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.246+0000 7fc7f2a00640 1 -- 172.21.15.8:0/388932018 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc7f40b8d90 con 0x7fc7fc107560 2024-03-16T20:59:49.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.495+0000 7fc801000640 1 -- 172.21.15.8:0/388932018 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7fc109860 con 0x7fc7fc107560 2024-03-16T20:59:49.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.496+0000 7fc7f2a00640 1 -- 172.21.15.8:0/388932018 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11390 (secure 0 0 0) 0x7fc7f40bc450 con 0x7fc7fc107560 2024-03-16T20:59:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T20:59:49.502 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T20:59:42.873912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T20:59:49.502 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2024-03-16T20:59:49.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 -- 172.21.15.8:0/388932018 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc7e00a1c20 msgr2=0x7fc7e00a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc7e00a1c20 0x7fc7e00a40e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009bd0 tx=0x7fc7ec005f90 comp rx=0 tx=0).stop 2024-03-16T20:59:49.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 -- 172.21.15.8:0/388932018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7fc107560 msgr2=0x7fc7fc108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7fc107560 0x7fc7fc108db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4037040 tx=0x7fc7f4032ee0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 -- 172.21.15.8:0/388932018 shutdown_connections 2024-03-16T20:59:49.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc7e00a1c20 0x7fc7e00a40e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7fc107560 0x7fc7fc108db0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7fc101e60 0x7fc7fc108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 --2- 172.21.15.8:0/388932018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7fc1014a0 0x7fc7fc108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 -- 172.21.15.8:0/388932018 >> 172.21.15.8:0/388932018 conn(0x7fc7fc0fcf90 msgr2=0x7fc7fc0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:49.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 -- 172.21.15.8:0/388932018 shutdown_connections 2024-03-16T20:59:49.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.499+0000 7fc801000640 1 -- 172.21.15.8:0/388932018 wait complete. 2024-03-16T20:59:49.526 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:59:49.526 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T20:59:49.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.747+0000 7f455da00640 1 -- 172.21.15.8:0/3161068752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f455810d9d0 msgr2=0x7f455810ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.747+0000 7f455da00640 1 --2- 172.21.15.8:0/3161068752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f455810d9d0 0x7f455810ddb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4548009930 tx=0x7f454802bcd0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.747+0000 7f455da00640 1 -- 172.21.15.8:0/3161068752 shutdown_connections 2024-03-16T20:59:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.747+0000 7f455da00640 1 --2- 172.21.15.8:0/3161068752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45581083d0 0x7f4558114820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.747+0000 7f455da00640 1 --2- 172.21.15.8:0/3161068752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4558107a30 0x7f4558107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.747+0000 7f455da00640 1 --2- 172.21.15.8:0/3161068752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f455810d9d0 0x7f455810ddb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.747+0000 7f455da00640 1 -- 172.21.15.8:0/3161068752 >> 172.21.15.8:0/3161068752 conn(0x7f4558077310 msgr2=0x7f4558106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.747+0000 7f455da00640 1 -- 172.21.15.8:0/3161068752 shutdown_connections 2024-03-16T20:59:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.747+0000 7f455da00640 1 -- 172.21.15.8:0/3161068752 wait complete. 2024-03-16T20:59:49.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.748+0000 7f455da00640 1 Processor -- start 2024-03-16T20:59:49.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.749+0000 7f455da00640 1 -- start start 2024-03-16T20:59:49.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.749+0000 7f455da00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4558107a30 0x7f455819e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.749+0000 7f455da00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45581083d0 0x7f455819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.749+0000 7f455da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f455810d9d0 0x7f45581a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.749+0000 7f455da00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45581a3030 con 0x7f45581083d0 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.749+0000 7f455da00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45581a31a0 con 0x7f455810d9d0 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.749+0000 7f455da00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45581a3360 con 0x7f4558107a30 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.749+0000 7f4557e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4558107a30 0x7f455819e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.749+0000 7f4557e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4558107a30 0x7f455819e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46996/0 (socket says 172.21.15.8:46996) 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.749+0000 7f4557e00640 1 -- 172.21.15.8:0/1125180595 learned_addr learned my addr 172.21.15.8:0/1125180595 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.749+0000 7f4557400640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45581083d0 0x7f455819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.750+0000 7f455d000640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f455810d9d0 0x7f45581a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.750+0000 7f4557e00640 1 -- 172.21.15.8:0/1125180595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f455810d9d0 msgr2=0x7f45581a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.750+0000 7f4557e00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f455810d9d0 0x7f45581a2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.750+0000 7f4557e00640 1 -- 172.21.15.8:0/1125180595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45581083d0 msgr2=0x7f455819e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.750+0000 7f4557e00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45581083d0 0x7f455819e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.750+0000 7f4557e00640 1 -- 172.21.15.8:0/1125180595 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4548009560 con 0x7f4558107a30 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.750+0000 7f4557400640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45581083d0 0x7f455819e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:49.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.750+0000 7f455d000640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f455810d9d0 0x7f45581a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.750+0000 7f4557e00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4558107a30 0x7f455819e170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4548000c00 tx=0x7f454802c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.751+0000 7f4554c00640 1 -- 172.21.15.8:0/1125180595 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454802dc70 con 0x7f4558107a30 2024-03-16T20:59:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.751+0000 7f4554c00640 1 -- 172.21.15.8:0/1125180595 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f454802ddd0 con 0x7f4558107a30 2024-03-16T20:59:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.751+0000 7f455da00640 1 -- 172.21.15.8:0/1125180595 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45581a35e0 con 0x7f4558107a30 2024-03-16T20:59:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.751+0000 7f4554c00640 1 -- 172.21.15.8:0/1125180595 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548003da0 con 0x7f4558107a30 2024-03-16T20:59:49.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.751+0000 7f455da00640 1 -- 172.21.15.8:0/1125180595 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45581aaec0 con 0x7f4558107a30 2024-03-16T20:59:49.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.754+0000 7f4554c00640 1 -- 172.21.15.8:0/1125180595 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f4548004e10 con 0x7f4558107a30 2024-03-16T20:59:49.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.754+0000 7f4561da7740 1 Processor -- start 2024-03-16T20:59:49.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.754+0000 7f4561da7740 1 -- start start 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.754+0000 7f4561da7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 0x55c3eedda1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f4561da7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 0x55c3eede2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f4561da7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eede56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f4561da7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eed48210 con 0x55c3eedda710 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f4561da7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eed45740 con 0x55c3eedd9df0 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f4561da7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eed40f20 con 0x55c3eede32f0 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f455d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 0x55c3eedda1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f455d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 0x55c3eedda1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36956/0 (socket says 172.21.15.8:36956) 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f455d000640 1 -- 172.21.15.8:0/456965820 learned_addr learned my addr 172.21.15.8:0/456965820 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f4557e00640 1 --2- 172.21.15.8:0/456965820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 0x55c3eede2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f4557400640 1 --2- 172.21.15.8:0/456965820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eede56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f455d000640 1 -- 172.21.15.8:0/456965820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 msgr2=0x55c3eede56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f455d000640 1 --2- 172.21.15.8:0/456965820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eede56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f455d000640 1 -- 172.21.15.8:0/456965820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 msgr2=0x55c3eede2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f455d000640 1 --2- 172.21.15.8:0/456965820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 0x55c3eede2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f455d000640 1 -- 172.21.15.8:0/456965820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3eed02df0 con 0x55c3eedd9df0 2024-03-16T20:59:49.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.755+0000 7f4554c00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f453c0a1c20 0x7f453c0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.756+0000 7f455d000640 1 --2- 172.21.15.8:0/456965820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 0x55c3eedda1d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4550009f20 tx=0x7f4550010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a32f012a3958835 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:49.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.756+0000 7f4554c00640 1 -- 172.21.15.8:0/1125180595 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f45480efe20 con 0x7f4558107a30 2024-03-16T20:59:49.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.756+0000 7f4557e00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f453c0a1c20 0x7f453c0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.756+0000 7f454d600640 1 -- 172.21.15.8:0/456965820 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455001b660 con 0x55c3eedd9df0 2024-03-16T20:59:49.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.756+0000 7f454d600640 1 -- 172.21.15.8:0/456965820 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f455001bcc0 con 0x55c3eedd9df0 2024-03-16T20:59:49.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.756+0000 7f454d600640 1 -- 172.21.15.8:0/456965820 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4550012e20 con 0x55c3eedd9df0 2024-03-16T20:59:49.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.757+0000 7f4561da7740 1 -- 172.21.15.8:0/456965820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 msgr2=0x55c3eedda1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.757+0000 7f4557e00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f453c0a1c20 0x7f453c0a40e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55c3eedd98c0 tx=0x7f45480f3890 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:49.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.757+0000 7f4561da7740 1 --2- 172.21.15.8:0/456965820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 0x55c3eedda1d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4550009f20 tx=0x7f4550010800 comp rx=0 tx=0).stop 2024-03-16T20:59:49.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.757+0000 7f4561da7740 1 -- 172.21.15.8:0/456965820 shutdown_connections 2024-03-16T20:59:49.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.757+0000 7f4561da7740 1 --2- 172.21.15.8:0/456965820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eede56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.757+0000 7f4561da7740 1 --2- 172.21.15.8:0/456965820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 0x55c3eede2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.757+0000 7f4561da7740 1 --2- 172.21.15.8:0/456965820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 0x55c3eedda1d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.757+0000 7f4561da7740 1 -- 172.21.15.8:0/456965820 >> 172.21.15.8:0/456965820 conn(0x55c3eedd4520 msgr2=0x55c3eedd4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:49.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.757+0000 7f4561da7740 1 -- 172.21.15.8:0/456965820 shutdown_connections 2024-03-16T20:59:49.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.757+0000 7f4561da7740 1 -- 172.21.15.8:0/456965820 wait complete. 2024-03-16T20:59:49.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.757+0000 7f4561da7740 1 -- start start 2024-03-16T20:59:49.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.758+0000 7f4561da7740 1 Processor -- start 2024-03-16T20:59:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.758+0000 7f4561da7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eedd9df0 0x55c3eede02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.758+0000 7f4561da7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.758+0000 7f4561da7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eede32f0 0x55c3eede0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.758+0000 7f4561da7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eece6150 con 0x55c3eede32f0 2024-03-16T20:59:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.758+0000 7f4561da7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eece5df0 con 0x55c3eedda710 2024-03-16T20:59:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.758+0000 7f4561da7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eeaaf1c0 con 0x55c3eedd9df0 2024-03-16T20:59:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.758+0000 7f4561da7740 10 client.0 _ll_register_callbacks cb 0x55c3eed352b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.758+0000 7f4557400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.758+0000 7f4557400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36972/0 (socket says 172.21.15.8:36972) 2024-03-16T20:59:49.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.758+0000 7f4557400640 1 -- 172.21.15.8:0/4075091254 learned_addr learned my addr 172.21.15.8:0/4075091254 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f455d000640 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eedd9df0 0x55c3eede02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f455d000640 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eede32f0 0x55c3eede0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f4557400640 1 -- 172.21.15.8:0/4075091254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eedd9df0 msgr2=0x55c3eede02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f4557400640 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eedd9df0 0x55c3eede02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f4557400640 1 -- 172.21.15.8:0/4075091254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eede32f0 msgr2=0x55c3eede0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f4557400640 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eede32f0 0x55c3eede0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f4557400640 1 -- 172.21.15.8:0/4075091254 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4550009b50 con 0x55c3eedda710 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f455d000640 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eede32f0 0x55c3eede0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f4557400640 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede07f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f454400bfa0 tx=0x7f45440128e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f8edacf39750d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f4542000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f4542000640 1 -- 172.21.15.8:0/4075091254 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544004500 con 0x55c3eedda710 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f4542000640 1 -- 172.21.15.8:0/4075091254 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f45440035f0 con 0x55c3eedda710 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.759+0000 7f4561da7740 1 -- 172.21.15.8:0/4075091254 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3eea407e0 con 0x55c3eedda710 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.760+0000 7f4542000640 1 -- 172.21.15.8:0/4075091254 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45440037b0 con 0x55c3eedda710 2024-03-16T20:59:49.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.760+0000 7f4561da7740 10 client.25958 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.760+0000 7f4561da7740 1 -- 172.21.15.8:0/4075091254 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c3eed3f5a0 con 0x55c3eedda710 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.760+0000 7f4542000640 1 -- 172.21.15.8:0/4075091254 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55c3eea407e0 con 0x55c3eedda710 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.760+0000 7f4542000640 1 -- 172.21.15.8:0/4075091254 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f4544010d10 con 0x55c3eedda710 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.760+0000 7f4561da7740 10 client.25958 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.760+0000 7f4561da7740 10 client.25958 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.760+0000 7f4561da7740 20 client.25958 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.760+0000 7f4561da7740 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c3eedf34f0 0x55c3eedf5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.760+0000 7f4561da7740 4 client.25958 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.760+0000 7f4561da7740 1 -- 172.21.15.8:0/4075091254 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3eea7d720 con 0x55c3eedf34f0 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.761+0000 7f455d000640 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c3eedf34f0 0x55c3eedf5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.761+0000 7f455d000640 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c3eedf34f0 0x55c3eedf5910 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3159a2bd225d99b server_cookie=6093f0509ebe5414 in_seq=0 out_seq=0 2024-03-16T20:59:49.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.761+0000 7f4542000640 10 client.25958 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:59:49.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4542000640 1 -- 172.21.15.8:0/4075091254 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55c3eea7d720 con 0x55c3eedf34f0 2024-03-16T20:59:49.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4542000640 10 client.25958 handle_command_reply: tid=0 2024-03-16T20:59:49.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4561da7740 1 client.25958 shutdown 2024-03-16T20:59:49.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4561da7740 1 -- 172.21.15.8:0/4075091254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 msgr2=0x55c3eede07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4561da7740 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede07f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f454400bfa0 tx=0x7f45440128e0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4561da7740 1 -- 172.21.15.8:0/4075091254 shutdown_connections 2024-03-16T20:59:49.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4561da7740 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c3eedf34f0 0x55c3eedf5910 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4561da7740 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eede32f0 0x55c3eede0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4561da7740 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede07f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4561da7740 1 --2- 172.21.15.8:0/4075091254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eedd9df0 0x55c3eede02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4561da7740 1 -- 172.21.15.8:0/4075091254 >> 172.21.15.8:0/4075091254 conn(0x55c3eedd4520 msgr2=0x55c3eedd6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:49.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4542000640 0 client.25958 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:59:49.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4561da7740 1 -- 172.21.15.8:0/4075091254 shutdown_connections 2024-03-16T20:59:49.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.763+0000 7f4561da7740 1 -- 172.21.15.8:0/4075091254 wait complete. 2024-03-16T20:59:49.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.764+0000 7f4561da7740 20 client.25958 trim_cache size 0 max 16384 2024-03-16T20:59:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.777+0000 7f4561da7740 1 Processor -- start 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.777+0000 7f4561da7740 1 -- start start 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4561da7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 0x55c3eede29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4561da7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 0x55c3eedcf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4561da7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eedee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4561da7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eede5fc0 con 0x55c3eedda710 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4561da7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eede56e0 con 0x55c3eedd9df0 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4561da7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eedd5750 con 0x55c3eede32f0 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4557400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 0x55c3eedcf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f455d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 0x55c3eede29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4557400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 0x55c3eedcf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40362/0 (socket says 172.21.15.8:40362) 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4557400640 1 -- 172.21.15.8:0/1949892418 learned_addr learned my addr 172.21.15.8:0/1949892418 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f455d000640 1 --2- 172.21.15.8:0/1949892418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eedee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4557400640 1 -- 172.21.15.8:0/1949892418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 msgr2=0x55c3eedee6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4557400640 1 --2- 172.21.15.8:0/1949892418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eedee6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4557400640 1 -- 172.21.15.8:0/1949892418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 msgr2=0x55c3eede29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4557400640 1 --2- 172.21.15.8:0/1949892418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 0x55c3eede29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f4557400640 1 -- 172.21.15.8:0/1949892418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3eecdbab0 con 0x55c3eedda710 2024-03-16T20:59:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.778+0000 7f455d000640 1 --2- 172.21.15.8:0/1949892418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 0x55c3eede29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.779+0000 7f4557400640 1 --2- 172.21.15.8:0/1949892418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 0x55c3eedcf550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f45440056c0 tx=0x7f45440056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cce9cb90e07c81 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.779+0000 7f454cc00640 1 -- 172.21.15.8:0/1949892418 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544004500 con 0x55c3eedda710 2024-03-16T20:59:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.779+0000 7f454cc00640 1 -- 172.21.15.8:0/1949892418 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f454401bc80 con 0x55c3eedda710 2024-03-16T20:59:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.779+0000 7f454cc00640 1 -- 172.21.15.8:0/1949892418 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544003e90 con 0x55c3eedda710 2024-03-16T20:59:49.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.780+0000 7f4561da7740 1 -- 172.21.15.8:0/1949892418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 msgr2=0x55c3eedcf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.780+0000 7f4561da7740 1 --2- 172.21.15.8:0/1949892418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 0x55c3eedcf550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f45440056c0 tx=0x7f45440056f0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.780+0000 7f4561da7740 1 -- 172.21.15.8:0/1949892418 shutdown_connections 2024-03-16T20:59:49.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.780+0000 7f4561da7740 1 --2- 172.21.15.8:0/1949892418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eedee6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.780+0000 7f4561da7740 1 --2- 172.21.15.8:0/1949892418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedda710 0x55c3eedcf550 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.780+0000 7f4561da7740 1 --2- 172.21.15.8:0/1949892418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedd9df0 0x55c3eede29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.780+0000 7f4561da7740 1 -- 172.21.15.8:0/1949892418 >> 172.21.15.8:0/1949892418 conn(0x55c3eedd4520 msgr2=0x55c3eedd6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.780+0000 7f4561da7740 1 -- 172.21.15.8:0/1949892418 shutdown_connections 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.780+0000 7f4561da7740 1 -- 172.21.15.8:0/1949892418 wait complete. 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.780+0000 7f4561da7740 1 -- start start 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.780+0000 7f4561da7740 1 Processor -- start 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f4561da7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedd9df0 0x55c3eedeae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f4561da7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f4561da7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eede7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f4561da7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eede7c60 con 0x55c3eedd9df0 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f4561da7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eede7dd0 con 0x55c3eedda710 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f4561da7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3eede7f90 con 0x55c3eede32f0 2024-03-16T20:59:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f4561da7740 10 client.0 _ll_register_callbacks cb 0x7f454400b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f455d000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedd9df0 0x55c3eedeae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f4557400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f4557400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36990/0 (socket says 172.21.15.8:36990) 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f4557400640 1 -- 172.21.15.8:0/4141111042 learned_addr learned my addr 172.21.15.8:0/4141111042 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.781+0000 7f455d000640 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eede7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.782+0000 7f4557400640 1 -- 172.21.15.8:0/4141111042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 msgr2=0x55c3eede7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.782+0000 7f4557400640 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eede7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.782+0000 7f4557400640 1 -- 172.21.15.8:0/4141111042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedd9df0 msgr2=0x55c3eedeae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.782+0000 7f4557400640 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedd9df0 0x55c3eedeae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.782+0000 7f4557400640 1 -- 172.21.15.8:0/4141111042 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3eed3f5a0 con 0x55c3eedda710 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.782+0000 7f455d000640 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eede7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.782+0000 7f4557400640 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede71e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4544000c00 tx=0x7f454400b5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=797dd79403b2d1a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.782+0000 7f4542000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:49.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.782+0000 7f4542000640 1 -- 172.21.15.8:0/4141111042 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544003c10 con 0x55c3eedda710 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.782+0000 7f4561da7740 1 -- 172.21.15.8:0/4141111042 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3eedcfc30 con 0x55c3eedda710 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.782+0000 7f4542000640 1 -- 172.21.15.8:0/4141111042 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4544003d70 con 0x55c3eedda710 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.783+0000 7f4542000640 1 -- 172.21.15.8:0/4141111042 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45440035f0 con 0x55c3eedda710 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.783+0000 7f4561da7740 10 client.25964 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.783+0000 7f4561da7740 1 -- 172.21.15.8:0/4141111042 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c3eed01650 con 0x55c3eedda710 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.783+0000 7f4542000640 1 -- 172.21.15.8:0/4141111042 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55c3eedcfc30 con 0x55c3eedda710 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.783+0000 7f4542000640 1 -- 172.21.15.8:0/4141111042 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f4544010a10 con 0x55c3eedda710 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.783+0000 7f4561da7740 10 client.25964 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.783+0000 7f4561da7740 10 client.25964 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.783+0000 7f4561da7740 20 client.25964 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.783+0000 7f4561da7740 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c3eee50040 0x55c3eee52460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.783+0000 7f4561da7740 4 client.25964 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.783+0000 7f4561da7740 1 -- 172.21.15.8:0/4141111042 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f455001bcc0 con 0x55c3eee50040 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.784+0000 7f455d000640 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c3eee50040 0x55c3eee52460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:49.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.784+0000 7f455d000640 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c3eee50040 0x55c3eee52460 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=385da1d834e34f33 server_cookie=772d04827c53d7b6 in_seq=0 out_seq=0 2024-03-16T20:59:49.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.784+0000 7f4542000640 10 client.25964 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T20:59:49.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4542000640 1 -- 172.21.15.8:0/4141111042 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f455001bcc0 con 0x55c3eee50040 2024-03-16T20:59:49.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4542000640 10 client.25964 handle_command_reply: tid=0 2024-03-16T20:59:49.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 1 client.25964 shutdown 2024-03-16T20:59:49.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 1 -- 172.21.15.8:0/4141111042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 msgr2=0x55c3eede71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede71e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4544000c00 tx=0x7f454400b5a0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 1 -- 172.21.15.8:0/4141111042 shutdown_connections 2024-03-16T20:59:49.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c3eee50040 0x55c3eee52460 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c3eede32f0 0x55c3eede7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c3eedda710 0x55c3eede71e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 1 --2- 172.21.15.8:0/4141111042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c3eedd9df0 0x55c3eedeae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4542000640 0 client.25964 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T20:59:49.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 1 -- 172.21.15.8:0/4141111042 >> 172.21.15.8:0/4141111042 conn(0x55c3eedd4520 msgr2=0x55c3eedd5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:49.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 1 -- 172.21.15.8:0/4141111042 shutdown_connections 2024-03-16T20:59:49.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 1 -- 172.21.15.8:0/4141111042 wait complete. 2024-03-16T20:59:49.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.786+0000 7f4561da7740 20 client.25964 trim_cache size 0 max 16384 2024-03-16T20:59:49.796 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 -- 172.21.15.8:0/1125180595 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f453c0a1c20 msgr2=0x7f453c0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f453c0a1c20 0x7f453c0a40e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55c3eedd98c0 tx=0x7f45480f3890 comp rx=0 tx=0).stop 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 -- 172.21.15.8:0/1125180595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4558107a30 msgr2=0x7f455819e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4558107a30 0x7f455819e170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4548000c00 tx=0x7f454802c7d0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 -- 172.21.15.8:0/1125180595 shutdown_connections 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f453c0a1c20 0x7f453c0a40e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f455810d9d0 0x7f45581a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45581083d0 0x7f455819e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 --2- 172.21.15.8:0/1125180595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4558107a30 0x7f455819e170 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 -- 172.21.15.8:0/1125180595 >> 172.21.15.8:0/1125180595 conn(0x7f4558077310 msgr2=0x7f4558078280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 -- 172.21.15.8:0/1125180595 shutdown_connections 2024-03-16T20:59:49.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:49.787+0000 7f455da00640 1 -- 172.21.15.8:0/1125180595 wait complete. 2024-03-16T20:59:49.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:49 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/388932018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:59:49.810 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:59:49.810 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T20:59:49.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:49 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/388932018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:59:49.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:49 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/388932018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T20:59:50.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.008+0000 7f6ca7e00640 1 -- 172.21.15.8:0/2870465799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8100ab0 msgr2=0x7f6ca810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.008+0000 7f6ca7e00640 1 --2- 172.21.15.8:0/2870465799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8100ab0 0x7f6ca810d770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009860 tx=0x7f6c9002bb70 comp rx=0 tx=0).stop 2024-03-16T20:59:50.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.008+0000 7f6ca7e00640 1 -- 172.21.15.8:0/2870465799 shutdown_connections 2024-03-16T20:59:50.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.008+0000 7f6ca7e00640 1 --2- 172.21.15.8:0/2870465799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca810dcb0 0x7f6ca81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.008+0000 7f6ca7e00640 1 --2- 172.21.15.8:0/2870465799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8100ab0 0x7f6ca810d770 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.008+0000 7f6ca7e00640 1 --2- 172.21.15.8:0/2870465799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca8100100 0x7f6ca81004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.008+0000 7f6ca7e00640 1 -- 172.21.15.8:0/2870465799 >> 172.21.15.8:0/2870465799 conn(0x7f6ca80fbd40 msgr2=0x7f6ca80fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.008+0000 7f6ca7e00640 1 -- 172.21.15.8:0/2870465799 shutdown_connections 2024-03-16T20:59:50.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.008+0000 7f6ca7e00640 1 -- 172.21.15.8:0/2870465799 wait complete. 2024-03-16T20:59:50.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.009+0000 7f6ca7e00640 1 Processor -- start 2024-03-16T20:59:50.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.009+0000 7f6ca7e00640 1 -- start start 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8100100 0x7f6ca819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8100ab0 0x7f6ca819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca810dcb0 0x7f6ca8199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca7e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca819a110 con 0x7f6ca8100ab0 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca819a280 con 0x7f6ca810dcb0 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca7e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca819a440 con 0x7f6ca8100100 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8100100 0x7f6ca819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6c9e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8100ab0 0x7f6ca819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8100100 0x7f6ca819f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47056/0 (socket says 172.21.15.8:47056) 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca810dcb0 0x7f6ca8199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca6a00640 1 -- 172.21.15.8:0/3514147663 learned_addr learned my addr 172.21.15.8:0/3514147663 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca6a00640 1 -- 172.21.15.8:0/3514147663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca810dcb0 msgr2=0x7f6ca8199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca810dcb0 0x7f6ca8199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca6a00640 1 -- 172.21.15.8:0/3514147663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8100ab0 msgr2=0x7f6ca819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8100ab0 0x7f6ca819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.010+0000 7f6ca6a00640 1 -- 172.21.15.8:0/3514147663 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c98009560 con 0x7f6ca8100100 2024-03-16T20:59:50.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.011+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8100100 0x7f6ca819f910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800e9c0 tx=0x7f6c9800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.011+0000 7f6c9fe00640 1 -- 172.21.15.8:0/3514147663 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800cde0 con 0x7f6ca8100100 2024-03-16T20:59:50.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.011+0000 7f6ca7e00640 1 -- 172.21.15.8:0/3514147663 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c90009490 con 0x7f6ca8100100 2024-03-16T20:59:50.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.011+0000 7f6c9fe00640 1 -- 172.21.15.8:0/3514147663 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6c980035f0 con 0x7f6ca8100100 2024-03-16T20:59:50.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.011+0000 7f6c9fe00640 1 -- 172.21.15.8:0/3514147663 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98010650 con 0x7f6ca8100100 2024-03-16T20:59:50.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.011+0000 7f6ca7e00640 1 -- 172.21.15.8:0/3514147663 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca81a67d0 con 0x7f6ca8100100 2024-03-16T20:59:50.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.014+0000 7f6c9fe00640 1 -- 172.21.15.8:0/3514147663 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f6c98003b60 con 0x7f6ca8100100 2024-03-16T20:59:50.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.014+0000 7f6cb0464740 1 Processor -- start 2024-03-16T20:59:50.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6cb0464740 1 -- start start 2024-03-16T20:59:50.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188fa5df0 0x55d188fa61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188faedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188faf2f0 0x55d188fb16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6cb0464740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188f14210 con 0x55d188fa5df0 2024-03-16T20:59:50.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6cb0464740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188f11740 con 0x55d188faf2f0 2024-03-16T20:59:50.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6cb0464740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188f0cf20 con 0x55d188fa6710 2024-03-16T20:59:50.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6ca6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188faedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6ca7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188fa5df0 0x55d188fa61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6ca6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188faedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47066/0 (socket says 172.21.15.8:47066) 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6ca6a00640 1 -- 172.21.15.8:0/2701494482 learned_addr learned my addr 172.21.15.8:0/2701494482 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6ca7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188fa5df0 0x55d188fa61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40398/0 (socket says 172.21.15.8:40398) 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.015+0000 7f6c9e000640 1 --2- 172.21.15.8:0/2701494482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188faf2f0 0x55d188fb16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.016+0000 7f6ca6a00640 1 -- 172.21.15.8:0/2701494482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188faf2f0 msgr2=0x55d188fb16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.016+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/2701494482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188faf2f0 0x55d188fb16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.016+0000 7f6ca6a00640 1 -- 172.21.15.8:0/2701494482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188fa5df0 msgr2=0x55d188fa61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.016+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/2701494482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188fa5df0 0x55d188fa61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.016+0000 7f6ca6a00640 1 -- 172.21.15.8:0/2701494482 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d188ecedf0 con 0x55d188fa6710 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.016+0000 7f6c9fe00640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c8c0a1ba0 0x7f6c8c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.016+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/2701494482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188faedb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6c980cb290 tx=0x7f6c980d1ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4dc574b48604928 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.016+0000 7f6c97e00640 1 -- 172.21.15.8:0/2701494482 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98096ad0 con 0x55d188fa6710 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.016+0000 7f6c9fe00640 1 -- 172.21.15.8:0/3514147663 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6c98014070 con 0x7f6ca8100100 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.017+0000 7f6c97e00640 1 -- 172.21.15.8:0/2701494482 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6c9809a600 con 0x55d188fa6710 2024-03-16T20:59:50.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.017+0000 7f6c97e00640 1 -- 172.21.15.8:0/2701494482 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9809af30 con 0x55d188fa6710 2024-03-16T20:59:50.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.017+0000 7f6ca7400640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c8c0a1ba0 0x7f6c8c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.017+0000 7f6cb0464740 1 -- 172.21.15.8:0/2701494482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 msgr2=0x55d188faedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.017+0000 7f6cb0464740 1 --2- 172.21.15.8:0/2701494482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188faedb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6c980cb290 tx=0x7f6c980d1ea0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.017+0000 7f6ca7400640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c8c0a1ba0 0x7f6c8c0a4060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ca81022e0 tx=0x7f6ca0009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.017+0000 7f6cb0464740 1 -- 172.21.15.8:0/2701494482 shutdown_connections 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.017+0000 7f6cb0464740 1 --2- 172.21.15.8:0/2701494482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188faf2f0 0x55d188fb16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.017+0000 7f6cb0464740 1 --2- 172.21.15.8:0/2701494482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188faedb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.017+0000 7f6cb0464740 1 --2- 172.21.15.8:0/2701494482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188fa5df0 0x55d188fa61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.017+0000 7f6cb0464740 1 -- 172.21.15.8:0/2701494482 >> 172.21.15.8:0/2701494482 conn(0x55d188fa0520 msgr2=0x55d188fa0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.018+0000 7f6cb0464740 1 -- 172.21.15.8:0/2701494482 shutdown_connections 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.018+0000 7f6cb0464740 1 -- 172.21.15.8:0/2701494482 wait complete. 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.018+0000 7f6cb0464740 1 -- start start 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.018+0000 7f6cb0464740 1 Processor -- start 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d188fac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 0x55d188fac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188faf2f0 0x55d188facd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6cb0464740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188eb2150 con 0x55d188faf2f0 2024-03-16T20:59:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6cb0464740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188eb1df0 con 0x55d188fa6710 2024-03-16T20:59:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6cb0464740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188c7b1c0 con 0x55d188fa5df0 2024-03-16T20:59:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6cb0464740 10 client.0 _ll_register_callbacks cb 0x55d188f012b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6ca6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d188fac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6c9e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 0x55d188fac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6ca6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d188fac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47082/0 (socket says 172.21.15.8:47082) 2024-03-16T20:59:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6c9e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 0x55d188fac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37026/0 (socket says 172.21.15.8:37026) 2024-03-16T20:59:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6ca6a00640 1 -- 172.21.15.8:0/4179180265 learned_addr learned my addr 172.21.15.8:0/4179180265 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.019+0000 7f6ca7400640 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188faf2f0 0x55d188facd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.020+0000 7f6ca6a00640 1 -- 172.21.15.8:0/4179180265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 msgr2=0x55d188fac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.020+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 0x55d188fac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.020+0000 7f6ca6a00640 1 -- 172.21.15.8:0/4179180265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188faf2f0 msgr2=0x55d188facd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.020+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188faf2f0 0x55d188facd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.020+0000 7f6ca6a00640 1 -- 172.21.15.8:0/4179180265 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca81a67d0 con 0x55d188fa5df0 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.020+0000 7f6c9e000640 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 0x55d188fac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.020+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d188fac2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6c980a2aa0 tx=0x7f6c980cb2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6fd5d208be755c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.020+0000 7f6c94c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.020+0000 7f6c94c00640 1 -- 172.21.15.8:0/4179180265 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98003960 con 0x55d188fa5df0 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.020+0000 7f6c94c00640 1 -- 172.21.15.8:0/4179180265 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6c980d8040 con 0x55d188fa5df0 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.020+0000 7f6cb0464740 1 -- 172.21.15.8:0/4179180265 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d188c0c7e0 con 0x55d188fa5df0 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.021+0000 7f6c94c00640 1 -- 172.21.15.8:0/4179180265 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c980d1680 con 0x55d188fa5df0 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.021+0000 7f6cb0464740 10 client.25987 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.021+0000 7f6cb0464740 1 -- 172.21.15.8:0/4179180265 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d188f0b5a0 con 0x55d188fa5df0 2024-03-16T20:59:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.021+0000 7f6c94c00640 1 -- 172.21.15.8:0/4179180265 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55d188c0c7e0 con 0x55d188fa5df0 2024-03-16T20:59:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.021+0000 7f6c94c00640 1 -- 172.21.15.8:0/4179180265 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f6c9801f060 con 0x55d188fa5df0 2024-03-16T20:59:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.021+0000 7f6cb0464740 10 client.25987 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.021+0000 7f6cb0464740 10 client.25987 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T20:59:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.021+0000 7f6cb0464740 20 client.25987 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.021+0000 7f6cb0464740 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55d188fbefd0 0x55d188fc13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.021+0000 7f6cb0464740 4 client.25987 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.021+0000 7f6cb0464740 1 -- 172.21.15.8:0/4179180265 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d188c49720 con 0x55d188fbefd0 2024-03-16T20:59:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.022+0000 7f6c9e000640 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55d188fbefd0 0x55d188fc13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.022+0000 7f6c9e000640 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55d188fbefd0 0x55d188fc13e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90a497520905139d server_cookie=31b3ed54f075cfda in_seq=0 out_seq=0 2024-03-16T20:59:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.022+0000 7f6c94c00640 10 client.25987 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:59:50.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.024+0000 7f6c94c00640 1 -- 172.21.15.8:0/4179180265 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d188c49720 con 0x55d188fbefd0 2024-03-16T20:59:50.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.024+0000 7f6c94c00640 10 client.25987 handle_command_reply: tid=0 2024-03-16T20:59:50.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.024+0000 7f6cb0464740 1 client.25987 shutdown 2024-03-16T20:59:50.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6cb0464740 1 -- 172.21.15.8:0/4179180265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 msgr2=0x55d188fac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6cb0464740 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d188fac2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6c980a2aa0 tx=0x7f6c980cb2c0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6cb0464740 1 -- 172.21.15.8:0/4179180265 shutdown_connections 2024-03-16T20:59:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6cb0464740 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55d188fbefd0 0x55d188fc13e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6cb0464740 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188faf2f0 0x55d188facd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6cb0464740 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 0x55d188fac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6cb0464740 1 --2- 172.21.15.8:0/4179180265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d188fac2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6cb0464740 1 -- 172.21.15.8:0/4179180265 >> 172.21.15.8:0/4179180265 conn(0x55d188fa0520 msgr2=0x55d188fa2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6c94c00640 0 client.25987 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:59:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6cb0464740 1 -- 172.21.15.8:0/4179180265 shutdown_connections 2024-03-16T20:59:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6cb0464740 1 -- 172.21.15.8:0/4179180265 wait complete. 2024-03-16T20:59:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.025+0000 7f6cb0464740 20 client.25987 trim_cache size 0 max 16384 2024-03-16T20:59:50.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.045+0000 7f6cb0464740 1 Processor -- start 2024-03-16T20:59:50.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.045+0000 7f6cb0464740 1 -- start start 2024-03-16T20:59:50.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.045+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188fa5df0 0x55d188faea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.045+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188f9b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.045+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188faf2f0 0x55d188fac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.045+0000 7f6cb0464740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188fa5cb0 con 0x55d188fa5df0 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.045+0000 7f6cb0464740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188fbbdd0 con 0x55d188faf2f0 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.045+0000 7f6cb0464740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188fa5110 con 0x55d188fa6710 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.046+0000 7f6c9e000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188f9b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.046+0000 7f6c9e000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188f9b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47084/0 (socket says 172.21.15.8:47084) 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.046+0000 7f6c9e000640 1 -- 172.21.15.8:0/3373842128 learned_addr learned my addr 172.21.15.8:0/3373842128 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.046+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/3373842128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188fa5df0 0x55d188faea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.046+0000 7f6ca7400640 1 --2- 172.21.15.8:0/3373842128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188faf2f0 0x55d188fac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.046+0000 7f6c9e000640 1 -- 172.21.15.8:0/3373842128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188faf2f0 msgr2=0x55d188fac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.046+0000 7f6c9e000640 1 --2- 172.21.15.8:0/3373842128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188faf2f0 0x55d188fac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.046+0000 7f6c9e000640 1 -- 172.21.15.8:0/3373842128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188fa5df0 msgr2=0x55d188faea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.046+0000 7f6c9e000640 1 --2- 172.21.15.8:0/3373842128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188fa5df0 0x55d188faea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.046+0000 7f6c9e000640 1 -- 172.21.15.8:0/3373842128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d188ea7ab0 con 0x55d188fa6710 2024-03-16T20:59:50.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.047+0000 7f6c9e000640 1 --2- 172.21.15.8:0/3373842128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188f9b550 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6c9002c0b0 tx=0x7f6c90005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f21c9d4ea0e10cf server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.047+0000 7f6c97400640 1 -- 172.21.15.8:0/3373842128 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90045040 con 0x55d188fa6710 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.047+0000 7f6c97400640 1 -- 172.21.15.8:0/3373842128 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6c9004c070 con 0x55d188fa6710 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.047+0000 7f6c97400640 1 -- 172.21.15.8:0/3373842128 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90032840 con 0x55d188fa6710 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.048+0000 7f6cb0464740 1 -- 172.21.15.8:0/3373842128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 msgr2=0x55d188f9b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.048+0000 7f6cb0464740 1 --2- 172.21.15.8:0/3373842128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188f9b550 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6c9002c0b0 tx=0x7f6c90005f90 comp rx=0 tx=0).stop 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.048+0000 7f6cb0464740 1 -- 172.21.15.8:0/3373842128 shutdown_connections 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.048+0000 7f6cb0464740 1 --2- 172.21.15.8:0/3373842128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188faf2f0 0x55d188fac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.048+0000 7f6cb0464740 1 --2- 172.21.15.8:0/3373842128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa6710 0x55d188f9b550 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.048+0000 7f6cb0464740 1 --2- 172.21.15.8:0/3373842128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188fa5df0 0x55d188faea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.048+0000 7f6cb0464740 1 -- 172.21.15.8:0/3373842128 >> 172.21.15.8:0/3373842128 conn(0x55d188fa0520 msgr2=0x55d188f9f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.048+0000 7f6cb0464740 1 -- 172.21.15.8:0/3373842128 shutdown_connections 2024-03-16T20:59:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.048+0000 7f6cb0464740 1 -- 172.21.15.8:0/3373842128 wait complete. 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.048+0000 7f6cb0464740 1 -- start start 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.048+0000 7f6cb0464740 1 Processor -- start 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d189012ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 0x55d189013530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6cb0464740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188faf2f0 0x55d188fb4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6cb0464740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188fb71c0 con 0x55d188faf2f0 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6cb0464740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188fb7330 con 0x55d188fa6710 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6cb0464740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d188fb4670 con 0x55d188fa5df0 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6cb0464740 10 client.0 _ll_register_callbacks cb 0x7f6c9809e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6ca6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d189012ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6ca6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d189012ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47100/0 (socket says 172.21.15.8:47100) 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6ca6a00640 1 -- 172.21.15.8:0/1875567726 learned_addr learned my addr 172.21.15.8:0/1875567726 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6c9e000640 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 0x55d189013530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6ca7400640 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188faf2f0 0x55d188fb4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6ca6a00640 1 -- 172.21.15.8:0/1875567726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 msgr2=0x55d189013530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 0x55d189013530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6ca6a00640 1 -- 172.21.15.8:0/1875567726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188faf2f0 msgr2=0x55d188fb4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188faf2f0 0x55d188fb4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.049+0000 7f6ca6a00640 1 -- 172.21.15.8:0/1875567726 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca8110c80 con 0x55d188fa5df0 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.050+0000 7f6c9e000640 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 0x55d189013530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.050+0000 7f6ca6a00640 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d189012ff0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c98098ae0 tx=0x7f6c980d1ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=115c7731d5b95dea server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.050+0000 7f6c94c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.050+0000 7f6c94c00640 1 -- 172.21.15.8:0/1875567726 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c980a2d40 con 0x55d188fa5df0 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.050+0000 7f6c94c00640 1 -- 172.21.15.8:0/1875567726 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6c980d8070 con 0x55d188fa5df0 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.050+0000 7f6cb0464740 1 -- 172.21.15.8:0/1875567726 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d188f9bc30 con 0x55d188fa5df0 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.050+0000 7f6c94c00640 1 -- 172.21.15.8:0/1875567726 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c980d1680 con 0x55d188fa5df0 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.050+0000 7f6cb0464740 10 client.25993 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.050+0000 7f6cb0464740 1 -- 172.21.15.8:0/1875567726 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d188ecd650 con 0x55d188fa5df0 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.051+0000 7f6c94c00640 1 -- 172.21.15.8:0/1875567726 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6c980b7080 con 0x55d188fa5df0 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.051+0000 7f6c94c00640 1 -- 172.21.15.8:0/1875567726 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f6c9801f070 con 0x55d188fa5df0 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.051+0000 7f6cb0464740 10 client.25993 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.051+0000 7f6cb0464740 10 client.25993 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T20:59:50.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.051+0000 7f6cb0464740 20 client.25993 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:50.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.051+0000 7f6cb0464740 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55d189023710 0x55d189025b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.051+0000 7f6cb0464740 4 client.25993 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:59:50.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.051+0000 7f6cb0464740 1 -- 172.21.15.8:0/1875567726 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f6c9809a600 con 0x55d189023710 2024-03-16T20:59:50.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.051+0000 7f6c9e000640 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55d189023710 0x55d189025b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.052+0000 7f6c9e000640 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55d189023710 0x55d189025b00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fda98b0415295322 server_cookie=93023a3da274b09d in_seq=0 out_seq=0 2024-03-16T20:59:50.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.052+0000 7f6c94c00640 10 client.25993 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T20:59:50.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6c94c00640 1 -- 172.21.15.8:0/1875567726 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f6c9809a600 con 0x55d189023710 2024-03-16T20:59:50.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6c94c00640 10 client.25993 handle_command_reply: tid=0 2024-03-16T20:59:50.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 1 client.25993 shutdown 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 1 -- 172.21.15.8:0/1875567726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 msgr2=0x55d189012ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d189012ff0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c98098ae0 tx=0x7f6c980d1ea0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 1 -- 172.21.15.8:0/1875567726 shutdown_connections 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55d189023710 0x55d189025b00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d188faf2f0 0x55d188fb4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d188fa6710 0x55d189013530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 1 --2- 172.21.15.8:0/1875567726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d188fa5df0 0x55d189012ff0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 1 -- 172.21.15.8:0/1875567726 >> 172.21.15.8:0/1875567726 conn(0x55d188fa0520 msgr2=0x55d188fc5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6c94c00640 0 client.25993 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 1 -- 172.21.15.8:0/1875567726 shutdown_connections 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 1 -- 172.21.15.8:0/1875567726 wait complete. 2024-03-16T20:59:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.054+0000 7f6cb0464740 20 client.25993 trim_cache size 0 max 16384 2024-03-16T20:59:50.063 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:59:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.055+0000 7f6ca7e00640 1 -- 172.21.15.8:0/3514147663 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c8c0a1ba0 msgr2=0x7f6c8c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.055+0000 7f6ca7e00640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c8c0a1ba0 0x7f6c8c0a4060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ca81022e0 tx=0x7f6ca0009500 comp rx=0 tx=0).stop 2024-03-16T20:59:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.055+0000 7f6ca7e00640 1 -- 172.21.15.8:0/3514147663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8100100 msgr2=0x7f6ca819f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.055+0000 7f6ca7e00640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8100100 0x7f6ca819f910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800e9c0 tx=0x7f6c9800ee80 comp rx=0 tx=0).stop 2024-03-16T20:59:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.055+0000 7f6ca7e00640 1 -- 172.21.15.8:0/3514147663 shutdown_connections 2024-03-16T20:59:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.055+0000 7f6ca7e00640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c8c0a1ba0 0x7f6c8c0a4060 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.055+0000 7f6ca7e00640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca810dcb0 0x7f6ca8199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.055+0000 7f6ca7e00640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ca8100ab0 0x7f6ca819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.055+0000 7f6ca7e00640 1 --2- 172.21.15.8:0/3514147663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca8100100 0x7f6ca819f910 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.055+0000 7f6ca7e00640 1 -- 172.21.15.8:0/3514147663 >> 172.21.15.8:0/3514147663 conn(0x7f6ca80fbd40 msgr2=0x7f6ca810efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.055+0000 7f6ca7e00640 1 -- 172.21.15.8:0/3514147663 shutdown_connections 2024-03-16T20:59:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.056+0000 7f6ca7e00640 1 -- 172.21.15.8:0/3514147663 wait complete. 2024-03-16T20:59:50.083 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T20:59:50.083 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T20:59:50.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.297+0000 7f695ec00640 1 -- 172.21.15.8:0/2058911471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6958103050 msgr2=0x7f695810b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.297+0000 7f695ec00640 1 --2- 172.21.15.8:0/2058911471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6958103050 0x7f695810b530 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6944009900 tx=0x7f694402bcc0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.297+0000 7f695ec00640 1 -- 172.21.15.8:0/2058911471 shutdown_connections 2024-03-16T20:59:50.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.297+0000 7f695ec00640 1 --2- 172.21.15.8:0/2058911471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f695810bb00 0x7f695810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.297+0000 7f695ec00640 1 --2- 172.21.15.8:0/2058911471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6958103050 0x7f695810b530 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.297+0000 7f695ec00640 1 --2- 172.21.15.8:0/2058911471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6958102730 0x7f6958102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.297+0000 7f695ec00640 1 -- 172.21.15.8:0/2058911471 >> 172.21.15.8:0/2058911471 conn(0x7f6958076770 msgr2=0x7f6958076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.298+0000 7f695ec00640 1 -- 172.21.15.8:0/2058911471 shutdown_connections 2024-03-16T20:59:50.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.298+0000 7f695ec00640 1 -- 172.21.15.8:0/2058911471 wait complete. 2024-03-16T20:59:50.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.298+0000 7f695ec00640 1 Processor -- start 2024-03-16T20:59:50.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f695ec00640 1 -- start start 2024-03-16T20:59:50.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f695ec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6958102730 0x7f6958199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f695ec00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6958103050 0x7f695819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f695ec00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f695810bb00 0x7f695819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f695ec00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695819ede0 con 0x7f6958102730 2024-03-16T20:59:50.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f695ec00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695819ef50 con 0x7f6958103050 2024-03-16T20:59:50.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f695ec00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695819f110 con 0x7f695810bb00 2024-03-16T20:59:50.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f6957e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6958102730 0x7f6958199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f6957e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6958102730 0x7f6958199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40442/0 (socket says 172.21.15.8:40442) 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f6957e00640 1 -- 172.21.15.8:0/3198434245 learned_addr learned my addr 172.21.15.8:0/3198434245 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f6957400640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6958103050 0x7f695819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.299+0000 7f695cc00640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f695810bb00 0x7f695819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.300+0000 7f6957400640 1 -- 172.21.15.8:0/3198434245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f695810bb00 msgr2=0x7f695819e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.300+0000 7f6957400640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f695810bb00 0x7f695819e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.300+0000 7f6957400640 1 -- 172.21.15.8:0/3198434245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6958102730 msgr2=0x7f6958199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.300+0000 7f6957400640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6958102730 0x7f6958199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.300+0000 7f6957400640 1 -- 172.21.15.8:0/3198434245 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6948009840 con 0x7f6958103050 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.300+0000 7f6957400640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6958103050 0x7f695819a460 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f694402c200 tx=0x7f69440043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.300+0000 7f6954c00640 1 -- 172.21.15.8:0/3198434245 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694402cb50 con 0x7f6958103050 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.300+0000 7f6954c00640 1 -- 172.21.15.8:0/3198434245 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f694402ccb0 con 0x7f6958103050 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.300+0000 7f6954c00640 1 -- 172.21.15.8:0/3198434245 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944003a80 con 0x7f6958103050 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.300+0000 7f695ec00640 1 -- 172.21.15.8:0/3198434245 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6944009560 con 0x7f6958103050 2024-03-16T20:59:50.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.301+0000 7f695ec00640 1 -- 172.21.15.8:0/3198434245 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69581a6a90 con 0x7f6958103050 2024-03-16T20:59:50.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.304+0000 7f6961992740 1 Processor -- start 2024-03-16T20:59:50.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.304+0000 7f6954c00640 1 -- 172.21.15.8:0/3198434245 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f69440053a0 con 0x7f6958103050 2024-03-16T20:59:50.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.304+0000 7f6961992740 1 -- start start 2024-03-16T20:59:50.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6961992740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c2c40 0x559f583c3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6961992740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 0x559f583cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6961992740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583cc140 0x559f583ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6961992740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f58331210 con 0x559f583c2c40 2024-03-16T20:59:50.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6961992740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f5832e740 con 0x559f583c3560 2024-03-16T20:59:50.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6961992740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f58329f20 con 0x559f583cc140 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6957e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 0x559f583cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6957e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 0x559f583cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37046/0 (socket says 172.21.15.8:37046) 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6957e00640 1 -- 172.21.15.8:0/4085058835 learned_addr learned my addr 172.21.15.8:0/4085058835 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6957400640 1 --2- 172.21.15.8:0/4085058835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583cc140 0x559f583ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f695cc00640 1 --2- 172.21.15.8:0/4085058835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c2c40 0x559f583c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6957e00640 1 -- 172.21.15.8:0/4085058835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583cc140 msgr2=0x559f583ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6957e00640 1 --2- 172.21.15.8:0/4085058835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583cc140 0x559f583ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6957e00640 1 -- 172.21.15.8:0/4085058835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c2c40 msgr2=0x559f583c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.305+0000 7f6957e00640 1 --2- 172.21.15.8:0/4085058835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c2c40 0x559f583c3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.306+0000 7f6957e00640 1 -- 172.21.15.8:0/4085058835 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f582ebdf0 con 0x559f583c3560 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.306+0000 7f6957e00640 1 --2- 172.21.15.8:0/4085058835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 0x559f583cbc00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6948011810 tx=0x7f6948011cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b8a402c94cfad0a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.306+0000 7f6954c00640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f693c0a1c20 0x7f693c0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.306+0000 7f694d200640 1 -- 172.21.15.8:0/4085058835 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800fba0 con 0x559f583c3560 2024-03-16T20:59:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.306+0000 7f6954c00640 1 -- 172.21.15.8:0/3198434245 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f69440ef6d0 con 0x7f6958103050 2024-03-16T20:59:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.306+0000 7f694d200640 1 -- 172.21.15.8:0/4085058835 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f694800fd00 con 0x559f583c3560 2024-03-16T20:59:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.306+0000 7f694d200640 1 -- 172.21.15.8:0/4085058835 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948018790 con 0x559f583c3560 2024-03-16T20:59:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.306+0000 7f695cc00640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f693c0a1c20 0x7f693c0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.307+0000 7f6961992740 1 -- 172.21.15.8:0/4085058835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 msgr2=0x559f583cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.307+0000 7f6961992740 1 --2- 172.21.15.8:0/4085058835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 0x559f583cbc00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6948011810 tx=0x7f6948011cd0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.307+0000 7f695cc00640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f693c0a1c20 0x7f693c0a40e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f695806aba0 tx=0x7f6950005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.307+0000 7f6961992740 1 -- 172.21.15.8:0/4085058835 shutdown_connections 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.307+0000 7f6961992740 1 --2- 172.21.15.8:0/4085058835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583cc140 0x559f583ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.307+0000 7f6961992740 1 --2- 172.21.15.8:0/4085058835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 0x559f583cbc00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.307+0000 7f6961992740 1 --2- 172.21.15.8:0/4085058835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c2c40 0x559f583c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.307+0000 7f6961992740 1 -- 172.21.15.8:0/4085058835 >> 172.21.15.8:0/4085058835 conn(0x559f583bd370 msgr2=0x559f583bd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.307+0000 7f6961992740 1 -- 172.21.15.8:0/4085058835 shutdown_connections 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.307+0000 7f6961992740 1 -- 172.21.15.8:0/4085058835 wait complete. 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.308+0000 7f6961992740 1 -- start start 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.308+0000 7f6961992740 1 Processor -- start 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.308+0000 7f6961992740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 0x559f583c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.308+0000 7f6961992740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c3560 0x559f583c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.308+0000 7f6961992740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583cc140 0x559f583c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.308+0000 7f6961992740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f582cf150 con 0x559f583c3560 2024-03-16T20:59:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.308+0000 7f6961992740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f582cedf0 con 0x559f583cc140 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.308+0000 7f6961992740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f580981c0 con 0x559f583c2c40 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.308+0000 7f6961992740 10 client.0 _ll_register_callbacks cb 0x559f5831e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f695cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583cc140 0x559f583c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f6957e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 0x559f583c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f695cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583cc140 0x559f583c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37050/0 (socket says 172.21.15.8:37050) 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f695cc00640 1 -- 172.21.15.8:0/3856703611 learned_addr learned my addr 172.21.15.8:0/3856703611 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f6957400640 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c3560 0x559f583c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f695cc00640 1 -- 172.21.15.8:0/3856703611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 msgr2=0x559f583c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f695cc00640 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 0x559f583c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f695cc00640 1 -- 172.21.15.8:0/3856703611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c3560 msgr2=0x559f583c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f695cc00640 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c3560 0x559f583c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f695cc00640 1 -- 172.21.15.8:0/3856703611 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6948011440 con 0x559f583cc140 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f6957400640 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c3560 0x559f583c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f6957e00640 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 0x559f583c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f695cc00640 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583cc140 0x559f583c9b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6950004610 tx=0x7f6950004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55d72797e9759896 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.309+0000 7f6941600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.310+0000 7f6941600640 1 -- 172.21.15.8:0/3856703611 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950017070 con 0x559f583cc140 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.310+0000 7f6941600640 1 -- 172.21.15.8:0/3856703611 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6950009e20 con 0x559f583cc140 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.310+0000 7f6961992740 1 -- 172.21.15.8:0/3856703611 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f580297e0 con 0x559f583cc140 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.310+0000 7f6941600640 1 -- 172.21.15.8:0/3856703611 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f695001f610 con 0x559f583cc140 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.310+0000 7f6961992740 10 client.25994 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.310+0000 7f6961992740 1 -- 172.21.15.8:0/3856703611 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559f583285a0 con 0x559f583cc140 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.310+0000 7f6941600640 1 -- 172.21.15.8:0/3856703611 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x559f580297e0 con 0x559f583cc140 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.310+0000 7f6941600640 1 -- 172.21.15.8:0/3856703611 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f6950032b60 con 0x559f583cc140 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.311+0000 7f6961992740 10 client.25994 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.311+0000 7f6961992740 10 client.25994 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.311+0000 7f6961992740 20 client.25994 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.311+0000 7f6961992740 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559f583dc170 0x559f583de590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.311+0000 7f6961992740 4 client.25994 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.311+0000 7f6961992740 1 -- 172.21.15.8:0/3856703611 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f58066720 con 0x559f583dc170 2024-03-16T20:59:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.311+0000 7f6957e00640 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559f583dc170 0x559f583de590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.312+0000 7f6957e00640 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559f583dc170 0x559f583de590 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e58bc862e1fb329 server_cookie=79a73ea93f6a9e87 in_seq=0 out_seq=0 2024-03-16T20:59:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.312+0000 7f6941600640 10 client.25994 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.312+0000 7f6941600640 1 -- 172.21.15.8:0/3856703611 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x559f58066720 con 0x559f583dc170 2024-03-16T20:59:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.312+0000 7f6941600640 10 client.25994 handle_command_reply: tid=0 2024-03-16T20:59:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.312+0000 7f6961992740 1 client.25994 shutdown 2024-03-16T20:59:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6961992740 1 -- 172.21.15.8:0/3856703611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583cc140 msgr2=0x559f583c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6961992740 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583cc140 0x559f583c9b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6950004610 tx=0x7f6950004730 comp rx=0 tx=0).stop 2024-03-16T20:59:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6961992740 1 -- 172.21.15.8:0/3856703611 shutdown_connections 2024-03-16T20:59:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6961992740 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583cc140 0x559f583c9b90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6961992740 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559f583dc170 0x559f583de590 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6961992740 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c3560 0x559f583c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6961992740 1 --2- 172.21.15.8:0/3856703611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 0x559f583c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6941600640 0 client.25994 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6961992740 1 -- 172.21.15.8:0/3856703611 >> 172.21.15.8:0/3856703611 conn(0x559f583bd370 msgr2=0x559f583bf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6961992740 1 -- 172.21.15.8:0/3856703611 shutdown_connections 2024-03-16T20:59:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6961992740 1 -- 172.21.15.8:0/3856703611 wait complete. 2024-03-16T20:59:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.313+0000 7f6961992740 20 client.25994 trim_cache size 0 max 16384 2024-03-16T20:59:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.328+0000 7f6961992740 1 Processor -- start 2024-03-16T20:59:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.328+0000 7f6961992740 1 -- start start 2024-03-16T20:59:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6961992740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c2c40 0x559f583cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6961992740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c3560 0x559f583c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6961992740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583cc140 0x559f583bc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6961992740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f583da9a0 con 0x559f583c3560 2024-03-16T20:59:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6961992740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f583b8c40 con 0x559f583c2c40 2024-03-16T20:59:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6961992740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f583be370 con 0x559f583cc140 2024-03-16T20:59:50.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6957e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c2c40 0x559f583cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6957e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c2c40 0x559f583cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37060/0 (socket says 172.21.15.8:37060) 2024-03-16T20:59:50.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6957e00640 1 -- 172.21.15.8:0/571924852 learned_addr learned my addr 172.21.15.8:0/571924852 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:50.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f695cc00640 1 --2- 172.21.15.8:0/571924852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583cc140 0x559f583bc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6957400640 1 --2- 172.21.15.8:0/571924852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c3560 0x559f583c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6957e00640 1 -- 172.21.15.8:0/571924852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583cc140 msgr2=0x559f583bc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6957e00640 1 --2- 172.21.15.8:0/571924852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583cc140 0x559f583bc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6957e00640 1 -- 172.21.15.8:0/571924852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c3560 msgr2=0x559f583c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6957e00640 1 --2- 172.21.15.8:0/571924852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c3560 0x559f583c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.329+0000 7f6957e00640 1 -- 172.21.15.8:0/571924852 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f582c4ab0 con 0x559f583c2c40 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.330+0000 7f6957e00640 1 --2- 172.21.15.8:0/571924852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c2c40 0x559f583cb840 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f694800fcd0 tx=0x7f6948011cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce08b8b6050dea70 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.330+0000 7f6943e00640 1 -- 172.21.15.8:0/571924852 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694802b350 con 0x559f583c2c40 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.330+0000 7f6943e00640 1 -- 172.21.15.8:0/571924852 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6948009d80 con 0x559f583c2c40 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.330+0000 7f6943e00640 1 -- 172.21.15.8:0/571924852 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694802b780 con 0x559f583c2c40 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.330+0000 7f6961992740 1 -- 172.21.15.8:0/571924852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c2c40 msgr2=0x559f583cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.330+0000 7f6961992740 1 --2- 172.21.15.8:0/571924852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c2c40 0x559f583cb840 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f694800fcd0 tx=0x7f6948011cd0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.331+0000 7f6961992740 1 -- 172.21.15.8:0/571924852 shutdown_connections 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.331+0000 7f6961992740 1 --2- 172.21.15.8:0/571924852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583cc140 0x559f583bc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.331+0000 7f6961992740 1 --2- 172.21.15.8:0/571924852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583c3560 0x559f583c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.331+0000 7f6961992740 1 --2- 172.21.15.8:0/571924852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c2c40 0x559f583cb840 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.331+0000 7f6961992740 1 -- 172.21.15.8:0/571924852 >> 172.21.15.8:0/571924852 conn(0x559f583bd370 msgr2=0x559f583bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.331+0000 7f6961992740 1 -- 172.21.15.8:0/571924852 shutdown_connections 2024-03-16T20:59:50.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.331+0000 7f6961992740 1 -- 172.21.15.8:0/571924852 wait complete. 2024-03-16T20:59:50.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.331+0000 7f6961992740 1 -- start start 2024-03-16T20:59:50.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.331+0000 7f6961992740 1 Processor -- start 2024-03-16T20:59:50.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6961992740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 0x559f583cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6961992740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 0x559f583cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6961992740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583cc140 0x559f583d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6961992740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f5843f250 con 0x559f583cc140 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6961992740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f5843f390 con 0x559f583c3560 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6961992740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f5843f4d0 con 0x559f583c2c40 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6961992740 10 client.0 _ll_register_callbacks cb 0x7f6950009970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6957e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 0x559f583cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6957e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 0x559f583cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47132/0 (socket says 172.21.15.8:47132) 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6957e00640 1 -- 172.21.15.8:0/620150510 learned_addr learned my addr 172.21.15.8:0/620150510 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6957400640 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 0x559f583cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f695cc00640 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583cc140 0x559f583d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6957e00640 1 -- 172.21.15.8:0/620150510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 msgr2=0x559f583cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6957e00640 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 0x559f583cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6957e00640 1 -- 172.21.15.8:0/620150510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583cc140 msgr2=0x559f583d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6957e00640 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583cc140 0x559f583d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f6957e00640 1 -- 172.21.15.8:0/620150510 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f582ebdf0 con 0x559f583c2c40 2024-03-16T20:59:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.332+0000 7f695cc00640 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583cc140 0x559f583d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.333+0000 7f6957e00640 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 0x559f583cf5e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6948014040 tx=0x7f6948019eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=599e811003dde126 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.333+0000 7f6941600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.333+0000 7f6941600640 1 -- 172.21.15.8:0/620150510 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694803a070 con 0x559f583c2c40 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.333+0000 7f6941600640 1 -- 172.21.15.8:0/620150510 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6948029070 con 0x559f583c2c40 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.333+0000 7f6961992740 1 -- 172.21.15.8:0/620150510 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f694800fd00 con 0x559f583c2c40 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.333+0000 7f6941600640 1 -- 172.21.15.8:0/620150510 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6948004c10 con 0x559f583c2c40 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.333+0000 7f6961992740 10 client.26011 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.333+0000 7f6961992740 1 -- 172.21.15.8:0/620150510 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559f582ea650 con 0x559f583c2c40 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.333+0000 7f6941600640 1 -- 172.21.15.8:0/620150510 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f694800fd00 con 0x559f583c2c40 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.334+0000 7f6941600640 1 -- 172.21.15.8:0/620150510 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f694803d030 con 0x559f583c2c40 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.334+0000 7f6961992740 10 client.26011 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.334+0000 7f6961992740 10 client.26011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.334+0000 7f6961992740 20 client.26011 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.334+0000 7f6961992740 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559f58440850 0x559f58442c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:50.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.334+0000 7f6961992740 4 client.26011 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.334+0000 7f6961992740 1 -- 172.21.15.8:0/620150510 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559f580b5890 con 0x559f58440850 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.334+0000 7f6957400640 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559f58440850 0x559f58442c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.334+0000 7f6957400640 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559f58440850 0x559f58442c70 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca085c602db33379 server_cookie=a5bfb02b0091a4a3 in_seq=0 out_seq=0 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.334+0000 7f6941600640 10 client.26011 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6941600640 1 -- 172.21.15.8:0/620150510 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559f580b5890 con 0x559f58440850 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6941600640 10 client.26011 handle_command_reply: tid=0 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 1 client.26011 shutdown 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 1 -- 172.21.15.8:0/620150510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 msgr2=0x559f583cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 0x559f583cf5e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6948014040 tx=0x7f6948019eb0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 1 -- 172.21.15.8:0/620150510 shutdown_connections 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559f58440850 0x559f58442c70 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f583cc140 0x559f583d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6941600640 0 client.26011 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:50.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559f583c3560 0x559f583cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 1 --2- 172.21.15.8:0/620150510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f583c2c40 0x559f583cf5e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 1 -- 172.21.15.8:0/620150510 >> 172.21.15.8:0/620150510 conn(0x559f583bd370 msgr2=0x559f583bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 1 -- 172.21.15.8:0/620150510 shutdown_connections 2024-03-16T20:59:50.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 1 -- 172.21.15.8:0/620150510 wait complete. 2024-03-16T20:59:50.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.335+0000 7f6961992740 20 client.26011 trim_cache size 0 max 16384 2024-03-16T20:59:50.345 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T20:59:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 -- 172.21.15.8:0/3198434245 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f693c0a1c20 msgr2=0x7f693c0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f693c0a1c20 0x7f693c0a40e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f695806aba0 tx=0x7f6950005f90 comp rx=0 tx=0).stop 2024-03-16T20:59:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 -- 172.21.15.8:0/3198434245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6958103050 msgr2=0x7f695819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6958103050 0x7f695819a460 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f694402c200 tx=0x7f69440043b0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 -- 172.21.15.8:0/3198434245 shutdown_connections 2024-03-16T20:59:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f693c0a1c20 0x7f693c0a40e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f695810bb00 0x7f695819e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6958103050 0x7f695819a460 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 --2- 172.21.15.8:0/3198434245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6958102730 0x7f6958199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:50.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 -- 172.21.15.8:0/3198434245 >> 172.21.15.8:0/3198434245 conn(0x7f6958076770 msgr2=0x7f6958101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:50.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 -- 172.21.15.8:0/3198434245 shutdown_connections 2024-03-16T20:59:50.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:50.336+0000 7f695ec00640 1 -- 172.21.15.8:0/3198434245 wait complete. 2024-03-16T20:59:50.744 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:50 smithi008 ceph-mon[31434]: pgmap v63: 97 pgs: 97 active+clean; 92 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 942 KiB/s wr, 530 op/s 2024-03-16T20:59:50.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:50 smithi170 ceph-mon[35947]: pgmap v63: 97 pgs: 97 active+clean; 92 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 942 KiB/s wr, 530 op/s 2024-03-16T20:59:50.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:50 smithi186 ceph-mon[36391]: pgmap v63: 97 pgs: 97 active+clean; 92 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 942 KiB/s wr, 530 op/s 2024-03-16T20:59:51.364 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T20:59:51.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T20:59:51.365 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T20:59:51.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.597+0000 7fecdb000640 1 -- 172.21.15.8:0/2915986240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecd4101460 msgr2=0x7fecd41018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.597+0000 7fecdb000640 1 --2- 172.21.15.8:0/2915986240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecd4101460 0x7fecd41018e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009930 tx=0x7fecc002bc30 comp rx=0 tx=0).stop 2024-03-16T20:59:51.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.597+0000 7fecdb000640 1 -- 172.21.15.8:0/2915986240 shutdown_connections 2024-03-16T20:59:51.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.597+0000 7fecdb000640 1 --2- 172.21.15.8:0/2915986240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd4101e20 0x7fecd410e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.597+0000 7fecdb000640 1 --2- 172.21.15.8:0/2915986240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecd4101460 0x7fecd41018e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.597+0000 7fecdb000640 1 --2- 172.21.15.8:0/2915986240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecd4107500 0x7fecd41078e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.597+0000 7fecdb000640 1 -- 172.21.15.8:0/2915986240 >> 172.21.15.8:0/2915986240 conn(0x7fecd40fcf50 msgr2=0x7fecd40ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.597+0000 7fecdb000640 1 -- 172.21.15.8:0/2915986240 shutdown_connections 2024-03-16T20:59:51.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.597+0000 7fecdb000640 1 -- 172.21.15.8:0/2915986240 wait complete. 2024-03-16T20:59:51.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.598+0000 7fecdb000640 1 Processor -- start 2024-03-16T20:59:51.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.599+0000 7fecdb000640 1 -- start start 2024-03-16T20:59:51.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.599+0000 7fecdb000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecd4101460 0x7fecd419d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.599+0000 7fecdb000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd4101e20 0x7fecd419ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.599+0000 7fecdb000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecd4107500 0x7fecd4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.599+0000 7fecdb000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41980b0 con 0x7fecd4107500 2024-03-16T20:59:51.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.599+0000 7fecdb000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4198220 con 0x7fecd4101e20 2024-03-16T20:59:51.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.599+0000 7fecdb000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41983e0 con 0x7fecd4101460 2024-03-16T20:59:51.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.599+0000 7fecd3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecd4101460 0x7fecd419d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd4101e20 0x7fecd419ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecd4101460 0x7fecd419d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47150/0 (socket says 172.21.15.8:47150) 2024-03-16T20:59:51.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd3e00640 1 -- 172.21.15.8:0/2318906412 learned_addr learned my addr 172.21.15.8:0/2318906412 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:51.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd9000640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecd4107500 0x7fecd4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd3e00640 1 -- 172.21.15.8:0/2318906412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd4101e20 msgr2=0x7fecd419ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd3e00640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd4101e20 0x7fecd419ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd3e00640 1 -- 172.21.15.8:0/2318906412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecd4107500 msgr2=0x7fecd4197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd3e00640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecd4107500 0x7fecd4197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd3e00640 1 -- 172.21.15.8:0/2318906412 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc0009560 con 0x7fecd4101460 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd3400640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd4101e20 0x7fecd419ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd9000640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecd4107500 0x7fecd4197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.600+0000 7fecd3e00640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecd4101460 0x7fecd419d8b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e9f0 tx=0x7fecc400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.601+0000 7fecd0c00640 1 -- 172.21.15.8:0/2318906412 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4009700 con 0x7fecd4101460 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.601+0000 7fecd0c00640 1 -- 172.21.15.8:0/2318906412 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fecc400cd80 con 0x7fecd4101460 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.601+0000 7fecd0c00640 1 -- 172.21.15.8:0/2318906412 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40189c0 con 0x7fecd4101460 2024-03-16T20:59:51.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.601+0000 7fecdb000640 1 -- 172.21.15.8:0/2318906412 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd41986c0 con 0x7fecd4101460 2024-03-16T20:59:51.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.601+0000 7fecdb000640 1 -- 172.21.15.8:0/2318906412 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd41a4950 con 0x7fecd4101460 2024-03-16T20:59:51.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.605+0000 7fecd0c00640 1 -- 172.21.15.8:0/2318906412 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fecc4018b20 con 0x7fecd4101460 2024-03-16T20:59:51.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecddd8b740 1 Processor -- start 2024-03-16T20:59:51.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecddd8b740 1 -- start start 2024-03-16T20:59:51.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3350 0x55a3300b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3c70 0x55a3300bc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300bc850 0x55a3300bec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecddd8b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a33006a300 con 0x55a3300bc850 2024-03-16T20:59:51.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecddd8b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a33001ce50 con 0x55a3300b3350 2024-03-16T20:59:51.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecddd8b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a33001a380 con 0x55a3300b3c70 2024-03-16T20:59:51.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecd3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3c70 0x55a3300bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecd9000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3350 0x55a3300b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecd3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3c70 0x55a3300bc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47164/0 (socket says 172.21.15.8:47164) 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.606+0000 7fecd3e00640 1 -- 172.21.15.8:0/1686330667 learned_addr learned my addr 172.21.15.8:0/1686330667 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.607+0000 7fecd3400640 1 --2- 172.21.15.8:0/1686330667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300bc850 0x55a3300bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.607+0000 7fecd9000640 1 -- 172.21.15.8:0/1686330667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3c70 msgr2=0x55a3300bc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.607+0000 7fecd9000640 1 --2- 172.21.15.8:0/1686330667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3c70 0x55a3300bc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.607+0000 7fecd9000640 1 -- 172.21.15.8:0/1686330667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300bc850 msgr2=0x55a3300bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.607+0000 7fecd9000640 1 --2- 172.21.15.8:0/1686330667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300bc850 0x55a3300bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.607+0000 7fecd9000640 1 -- 172.21.15.8:0/1686330667 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a32ffdec80 con 0x55a3300b3350 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.607+0000 7fecd3400640 1 --2- 172.21.15.8:0/1686330667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300bc850 0x55a3300bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.607+0000 7fecd0c00640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fecb80a1c20 0x7fecb80a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.607+0000 7fecd9000640 1 --2- 172.21.15.8:0/1686330667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3350 0x55a3300b3730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feccc009f90 tx=0x7feccc010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9454a229af74c1d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecd0c00640 1 -- 172.21.15.8:0/2318906412 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fecc4014070 con 0x7fecd4101460 2024-03-16T20:59:51.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecc9600640 1 -- 172.21.15.8:0/1686330667 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc004d20 con 0x55a3300b3350 2024-03-16T20:59:51.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecc9600640 1 -- 172.21.15.8:0/1686330667 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7feccc015070 con 0x55a3300b3350 2024-03-16T20:59:51.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecc9600640 1 -- 172.21.15.8:0/1686330667 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0054b0 con 0x55a3300b3350 2024-03-16T20:59:51.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecd3e00640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fecb80a1c20 0x7fecb80a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecddd8b740 1 -- 172.21.15.8:0/1686330667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3350 msgr2=0x55a3300b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecddd8b740 1 --2- 172.21.15.8:0/1686330667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3350 0x55a3300b3730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feccc009f90 tx=0x7feccc010860 comp rx=0 tx=0).stop 2024-03-16T20:59:51.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecd3e00640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fecb80a1c20 0x7fecb80a40e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fecc409a6b0 tx=0x7fecc40d3530 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecddd8b740 1 -- 172.21.15.8:0/1686330667 shutdown_connections 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecddd8b740 1 --2- 172.21.15.8:0/1686330667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300bc850 0x55a3300bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecddd8b740 1 --2- 172.21.15.8:0/1686330667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3c70 0x55a3300bc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecddd8b740 1 --2- 172.21.15.8:0/1686330667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3350 0x55a3300b3730 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.608+0000 7fecddd8b740 1 -- 172.21.15.8:0/1686330667 >> 172.21.15.8:0/1686330667 conn(0x55a3300ada80 msgr2=0x55a3300ade60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.609+0000 7fecddd8b740 1 -- 172.21.15.8:0/1686330667 shutdown_connections 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.609+0000 7fecddd8b740 1 -- 172.21.15.8:0/1686330667 wait complete. 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.609+0000 7fecddd8b740 1 -- start start 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.609+0000 7fecddd8b740 1 Processor -- start 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3350 0x55a3300b9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 0x55a3300b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300bc850 0x55a3300ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecddd8b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a330015b60 con 0x55a3300b3c70 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecddd8b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32ffbafd0 con 0x55a3300bc850 2024-03-16T20:59:51.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecddd8b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32ffbac70 con 0x55a3300b3350 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecddd8b740 10 client.0 _ll_register_callbacks cb 0x55a32fd26c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecd9000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3350 0x55a3300b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecd3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 0x55a3300b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecd9000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3350 0x55a3300b9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47174/0 (socket says 172.21.15.8:47174) 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecd9000640 1 -- 172.21.15.8:0/2979474167 learned_addr learned my addr 172.21.15.8:0/2979474167 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecd9000640 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300bc850 0x55a3300ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecd3400640 1 -- 172.21.15.8:0/2979474167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3350 msgr2=0x55a3300b9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecd3400640 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3350 0x55a3300b9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecd3400640 1 -- 172.21.15.8:0/2979474167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300bc850 msgr2=0x55a3300ba2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecd3400640 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300bc850 0x55a3300ba2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.610+0000 7fecd3400640 1 -- 172.21.15.8:0/2979474167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc009bf0 con 0x55a3300b3c70 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.611+0000 7fecd3400640 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 0x55a3300b9d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fecc0036040 tx=0x7fecc002ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e84d9e70dea3d71 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.611+0000 7fecbe000640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T20:59:51.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.611+0000 7fecbe000640 1 -- 172.21.15.8:0/2979474167 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0004250 con 0x55a3300b3c70 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.611+0000 7fecddd8b740 1 -- 172.21.15.8:0/2979474167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a32fd15860 con 0x55a3300b3c70 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.611+0000 7fecbe000640 1 -- 172.21.15.8:0/2979474167 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fecc00043b0 con 0x55a3300b3c70 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.612+0000 7fecbe000640 1 -- 172.21.15.8:0/2979474167 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecc0004e10 con 0x55a3300b3c70 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.612+0000 7fecddd8b740 10 client.15852 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.612+0000 7fecddd8b740 1 -- 172.21.15.8:0/2979474167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a3300141e0 con 0x55a3300b3c70 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.612+0000 7fecbe000640 1 -- 172.21.15.8:0/2979474167 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a32fd15860 con 0x55a3300b3c70 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.612+0000 7fecbe000640 1 -- 172.21.15.8:0/2979474167 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fecc003c040 con 0x55a3300b3c70 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.612+0000 7fecddd8b740 10 client.15852 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.612+0000 7fecddd8b740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.612+0000 7fecddd8b740 20 client.15852 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.612+0000 7fecddd8b740 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a3300ccd30 0x55a3300cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.612+0000 7fecddd8b740 4 client.15852 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.612+0000 7fecddd8b740 1 -- 172.21.15.8:0/2979474167 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a32fd66410 con 0x55a3300ccd30 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.613+0000 7fecd9000640 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a3300ccd30 0x55a3300cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.613+0000 7fecd9000640 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a3300ccd30 0x55a3300cf150 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=badff8caa110988f server_cookie=18b287daff20b14a in_seq=0 out_seq=0 2024-03-16T20:59:51.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.613+0000 7fecbe000640 10 client.15852 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.614+0000 7fecbe000640 1 -- 172.21.15.8:0/2979474167 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a32fd66410 con 0x55a3300ccd30 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.614+0000 7fecbe000640 10 client.15852 handle_command_reply: tid=0 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.614+0000 7fecddd8b740 1 client.15852 shutdown 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecddd8b740 1 -- 172.21.15.8:0/2979474167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 msgr2=0x55a3300b9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecddd8b740 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 0x55a3300b9d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fecc0036040 tx=0x7fecc002ce10 comp rx=0 tx=0).stop 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecddd8b740 1 -- 172.21.15.8:0/2979474167 shutdown_connections 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecddd8b740 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300bc850 0x55a3300ba2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecddd8b740 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a3300ccd30 0x55a3300cf150 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecddd8b740 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 0x55a3300b9d80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecddd8b740 1 --2- 172.21.15.8:0/2979474167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300b3350 0x55a3300b9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecbe000640 0 client.15852 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecddd8b740 1 -- 172.21.15.8:0/2979474167 >> 172.21.15.8:0/2979474167 conn(0x55a3300ada80 msgr2=0x55a3300af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecddd8b740 1 -- 172.21.15.8:0/2979474167 shutdown_connections 2024-03-16T20:59:51.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecddd8b740 1 -- 172.21.15.8:0/2979474167 wait complete. 2024-03-16T20:59:51.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.615+0000 7fecddd8b740 20 client.15852 trim_cache size 0 max 16384 2024-03-16T20:59:51.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.633+0000 7fecddd8b740 1 Processor -- start 2024-03-16T20:59:51.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.633+0000 7fecddd8b740 1 -- start start 2024-03-16T20:59:51.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.633+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3350 0x55a3300ba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.633+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 0x55a3300af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.633+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300bc850 0x55a3300c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.633+0000 7fecddd8b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32fd5e0c0 con 0x55a3300b3c70 2024-03-16T20:59:51.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.633+0000 7fecddd8b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3300cf7b0 con 0x55a3300b3350 2024-03-16T20:59:51.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.633+0000 7fecddd8b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3300a4f60 con 0x55a3300bc850 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.633+0000 7fecd3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 0x55a3300af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.633+0000 7fecd3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 0x55a3300af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40512/0 (socket says 172.21.15.8:40512) 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.634+0000 7fecd3400640 1 -- 172.21.15.8:0/3566964490 learned_addr learned my addr 172.21.15.8:0/3566964490 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.634+0000 7fecd9000640 1 --2- 172.21.15.8:0/3566964490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3350 0x55a3300ba0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.634+0000 7fecd9000640 1 --2- 172.21.15.8:0/3566964490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300bc850 0x55a3300c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.634+0000 7fecd3400640 1 -- 172.21.15.8:0/3566964490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300bc850 msgr2=0x55a3300c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.634+0000 7fecd3400640 1 --2- 172.21.15.8:0/3566964490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300bc850 0x55a3300c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.634+0000 7fecd3400640 1 -- 172.21.15.8:0/3566964490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3350 msgr2=0x55a3300ba0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.634+0000 7fecd3400640 1 --2- 172.21.15.8:0/3566964490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3350 0x55a3300ba0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.634+0000 7fecd3400640 1 -- 172.21.15.8:0/3566964490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a32ffb0a90 con 0x55a3300b3c70 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.634+0000 7fecd3400640 1 --2- 172.21.15.8:0/3566964490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 0x55a3300af5c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fecc002c170 tx=0x7fecc0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488b58f346cd6040 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecc8c00640 1 -- 172.21.15.8:0/3566964490 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc002ccb0 con 0x55a3300b3c70 2024-03-16T20:59:51.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecc8c00640 1 -- 172.21.15.8:0/3566964490 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fecc002c5d0 con 0x55a3300b3c70 2024-03-16T20:59:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecc8c00640 1 -- 172.21.15.8:0/3566964490 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0005570 con 0x55a3300b3c70 2024-03-16T20:59:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecddd8b740 1 -- 172.21.15.8:0/3566964490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 msgr2=0x55a3300af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecddd8b740 1 --2- 172.21.15.8:0/3566964490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 0x55a3300af5c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fecc002c170 tx=0x7fecc0005fd0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecddd8b740 1 -- 172.21.15.8:0/3566964490 shutdown_connections 2024-03-16T20:59:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecddd8b740 1 --2- 172.21.15.8:0/3566964490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300bc850 0x55a3300c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecddd8b740 1 --2- 172.21.15.8:0/3566964490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3c70 0x55a3300af5c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecddd8b740 1 --2- 172.21.15.8:0/3566964490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3350 0x55a3300ba0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecddd8b740 1 -- 172.21.15.8:0/3566964490 >> 172.21.15.8:0/3566964490 conn(0x55a3300ada80 msgr2=0x55a3300aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecddd8b740 1 -- 172.21.15.8:0/3566964490 shutdown_connections 2024-03-16T20:59:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.635+0000 7fecddd8b740 1 -- 172.21.15.8:0/3566964490 wait complete. 2024-03-16T20:59:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.636+0000 7fecddd8b740 1 -- start start 2024-03-16T20:59:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.636+0000 7fecddd8b740 1 Processor -- start 2024-03-16T20:59:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.636+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3350 0x55a3300c4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.636+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3c70 0x55a3300c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.636+0000 7fecddd8b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300bc850 0x55a3300c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.636+0000 7fecddd8b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3300c11a0 con 0x55a3300b3350 2024-03-16T20:59:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.636+0000 7fecddd8b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3300c1310 con 0x55a3300b3c70 2024-03-16T20:59:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.636+0000 7fecddd8b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3300c14d0 con 0x55a3300bc850 2024-03-16T20:59:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.636+0000 7fecddd8b740 10 client.0 _ll_register_callbacks cb 0x7feccc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.637+0000 7fecd3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3c70 0x55a3300c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.637+0000 7fecd9000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3350 0x55a3300c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.637+0000 7fecd3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3c70 0x55a3300c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37120/0 (socket says 172.21.15.8:37120) 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.637+0000 7fecd3400640 1 -- 172.21.15.8:0/1363667632 learned_addr learned my addr 172.21.15.8:0/1363667632 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.637+0000 7fecd9000640 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300bc850 0x55a3300c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.637+0000 7fecd3400640 1 -- 172.21.15.8:0/1363667632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300bc850 msgr2=0x55a3300c0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.637+0000 7fecd3400640 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300bc850 0x55a3300c0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.637+0000 7fecd3400640 1 -- 172.21.15.8:0/1363667632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3350 msgr2=0x55a3300c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.637+0000 7fecd3400640 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3350 0x55a3300c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.637+0000 7fecd3400640 1 -- 172.21.15.8:0/1363667632 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3300141e0 con 0x55a3300b3c70 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.637+0000 7fecd9000640 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300bc850 0x55a3300c0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.638+0000 7fecd3400640 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3c70 0x55a3300c0720 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fecc0000c00 tx=0x7fecc002ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2310175e5e9c826f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.638+0000 7fecbe000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.638+0000 7fecbe000640 1 -- 172.21.15.8:0/1363667632 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0003ca0 con 0x55a3300b3c70 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.638+0000 7fecbe000640 1 -- 172.21.15.8:0/1363667632 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fecc0000e40 con 0x55a3300b3c70 2024-03-16T20:59:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.638+0000 7fecddd8b740 1 -- 172.21.15.8:0/1363667632 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feccc015070 con 0x55a3300b3c70 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.638+0000 7fecbe000640 1 -- 172.21.15.8:0/1363667632 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecc0003e00 con 0x55a3300b3c70 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.638+0000 7fecddd8b740 10 client.26018 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.638+0000 7fecddd8b740 1 -- 172.21.15.8:0/1363667632 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a32ffd66a0 con 0x55a3300b3c70 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.638+0000 7fecbe000640 1 -- 172.21.15.8:0/1363667632 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7feccc015070 con 0x55a3300b3c70 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.639+0000 7fecbe000640 1 -- 172.21.15.8:0/1363667632 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fecc003c040 con 0x55a3300b3c70 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.639+0000 7fecddd8b740 10 client.26018 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.639+0000 7fecddd8b740 10 client.26018 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.639+0000 7fecddd8b740 20 client.26018 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.639+0000 7fecddd8b740 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a330129760 0x55a33012bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.639+0000 7fecddd8b740 4 client.26018 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.639+0000 7fecddd8b740 1 -- 172.21.15.8:0/1363667632 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a32fd527b0 con 0x55a330129760 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.639+0000 7fecd9000640 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a330129760 0x55a33012bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.640+0000 7fecd9000640 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a330129760 0x55a33012bb80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=392b5d6cb7588673 server_cookie=5f2d5e37ba58604 in_seq=0 out_seq=0 2024-03-16T20:59:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.640+0000 7fecbe000640 10 client.26018 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:51.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.640+0000 7fecbe000640 1 -- 172.21.15.8:0/1363667632 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a32fd527b0 con 0x55a330129760 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.640+0000 7fecbe000640 10 client.26018 handle_command_reply: tid=0 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.640+0000 7fecddd8b740 1 client.26018 shutdown 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecddd8b740 1 -- 172.21.15.8:0/1363667632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3c70 msgr2=0x55a3300c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecddd8b740 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3c70 0x55a3300c0720 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fecc0000c00 tx=0x7fecc002ccb0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecddd8b740 1 -- 172.21.15.8:0/1363667632 shutdown_connections 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecddd8b740 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3300bc850 0x55a3300c0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecddd8b740 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3300b3c70 0x55a3300c0720 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecddd8b740 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a330129760 0x55a33012bb80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecddd8b740 1 --2- 172.21.15.8:0/1363667632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3300b3350 0x55a3300c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecbe000640 0 client.26018 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecddd8b740 1 -- 172.21.15.8:0/1363667632 >> 172.21.15.8:0/1363667632 conn(0x55a3300ada80 msgr2=0x55a3300af540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecddd8b740 1 -- 172.21.15.8:0/1363667632 shutdown_connections 2024-03-16T20:59:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecddd8b740 1 -- 172.21.15.8:0/1363667632 wait complete. 2024-03-16T20:59:51.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.641+0000 7fecddd8b740 20 client.26018 trim_cache size 0 max 16384 2024-03-16T20:59:51.650 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:59:51.650 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T20:59:51.650 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "40fbab30-9417-4774-9ed8-8dbcca541466", 2024-03-16T20:59:51.650 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T20:59:51.650 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:59:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 -- 172.21.15.8:0/2318906412 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fecb80a1c20 msgr2=0x7fecb80a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fecb80a1c20 0x7fecb80a40e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fecc409a6b0 tx=0x7fecc40d3530 comp rx=0 tx=0).stop 2024-03-16T20:59:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 -- 172.21.15.8:0/2318906412 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecd4101460 msgr2=0x7fecd419d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecd4101460 0x7fecd419d8b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e9f0 tx=0x7fecc400eeb0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 -- 172.21.15.8:0/2318906412 shutdown_connections 2024-03-16T20:59:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fecb80a1c20 0x7fecb80a40e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecd4107500 0x7fecd4197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd4101e20 0x7fecd419ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 --2- 172.21.15.8:0/2318906412 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecd4101460 0x7fecd419d8b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 -- 172.21.15.8:0/2318906412 >> 172.21.15.8:0/2318906412 conn(0x7fecd40fcf50 msgr2=0x7fecd40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 -- 172.21.15.8:0/2318906412 shutdown_connections 2024-03-16T20:59:51.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.642+0000 7fecdb000640 1 -- 172.21.15.8:0/2318906412 wait complete. 2024-03-16T20:59:51.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T20:59:51.667 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T20:59:51.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.890+0000 7f7cbd600640 1 -- 172.21.15.8:0/2824111496 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac032360 con 0x7f7cc0103690 2024-03-16T20:59:51.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.890+0000 7f7cc5a00640 1 -- 172.21.15.8:0/2824111496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cc0103690 msgr2=0x7f7cc0103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.890+0000 7f7cc5a00640 1 --2- 172.21.15.8:0/2824111496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cc0103690 0x7f7cc0103b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009890 tx=0x7f7cac02bb70 comp rx=0 tx=0).stop 2024-03-16T20:59:51.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.890+0000 7f7cc5a00640 1 -- 172.21.15.8:0/2824111496 shutdown_connections 2024-03-16T20:59:51.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.890+0000 7f7cc5a00640 1 --2- 172.21.15.8:0/2824111496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc0104050 0x7f7cc0110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.890+0000 7f7cc5a00640 1 --2- 172.21.15.8:0/2824111496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cc0103690 0x7f7cc0103b10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.890+0000 7f7cc5a00640 1 --2- 172.21.15.8:0/2824111496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc01096a0 0x7f7cc0109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.890+0000 7f7cc5a00640 1 -- 172.21.15.8:0/2824111496 >> 172.21.15.8:0/2824111496 conn(0x7f7cc00ff160 msgr2=0x7f7cc0101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.891+0000 7f7cc5a00640 1 -- 172.21.15.8:0/2824111496 shutdown_connections 2024-03-16T20:59:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.891+0000 7f7cc5a00640 1 -- 172.21.15.8:0/2824111496 wait complete. 2024-03-16T20:59:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.892+0000 7f7cc5a00640 1 Processor -- start 2024-03-16T20:59:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.892+0000 7f7cc5a00640 1 -- start start 2024-03-16T20:59:51.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.892+0000 7f7cc5a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc0103690 0x7f7cc0199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.892+0000 7f7cc5a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc0104050 0x7f7cc019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.892+0000 7f7cc5a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cc01096a0 0x7f7cc019e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.892+0000 7f7cc5a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc019ed30 con 0x7f7cc01096a0 2024-03-16T20:59:51.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.892+0000 7f7cc5a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc019eea0 con 0x7f7cc0103690 2024-03-16T20:59:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.892+0000 7f7cc5a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc019f060 con 0x7f7cc0104050 2024-03-16T20:59:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbe000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc0104050 0x7f7cc019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc0103690 0x7f7cc0199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbe000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc0104050 0x7f7cc019a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47202/0 (socket says 172.21.15.8:47202) 2024-03-16T20:59:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc0103690 0x7f7cc0199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37140/0 (socket says 172.21.15.8:37140) 2024-03-16T20:59:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbe000640 1 -- 172.21.15.8:0/3779769094 learned_addr learned my addr 172.21.15.8:0/3779769094 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbf400640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cc01096a0 0x7f7cc019e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbe000640 1 -- 172.21.15.8:0/3779769094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc0103690 msgr2=0x7f7cc0199e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbe000640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc0103690 0x7f7cc0199e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbe000640 1 -- 172.21.15.8:0/3779769094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cc01096a0 msgr2=0x7f7cc019e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbe000640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cc01096a0 0x7f7cc019e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbe000640 1 -- 172.21.15.8:0/3779769094 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8009840 con 0x7f7cc0104050 2024-03-16T20:59:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.893+0000 7f7cbf400640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cc01096a0 0x7f7cc019e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T20:59:51.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.894+0000 7f7cbe000640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc0104050 0x7f7cc019a3b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009860 tx=0x7f7cac004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.894+0000 7f7cb7400640 1 -- 172.21.15.8:0/3779769094 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac034950 con 0x7f7cc0104050 2024-03-16T20:59:51.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.894+0000 7f7cc5a00640 1 -- 172.21.15.8:0/3779769094 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac009490 con 0x7f7cc0104050 2024-03-16T20:59:51.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.894+0000 7f7cc5a00640 1 -- 172.21.15.8:0/3779769094 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc01a69e0 con 0x7f7cc0104050 2024-03-16T20:59:51.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.894+0000 7f7cb7400640 1 -- 172.21.15.8:0/3779769094 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7cac02ca10 con 0x7f7cc0104050 2024-03-16T20:59:51.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.894+0000 7f7cb7400640 1 -- 172.21.15.8:0/3779769094 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac032620 con 0x7f7cc0104050 2024-03-16T20:59:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.898+0000 7f7cc8773740 1 Processor -- start 2024-03-16T20:59:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.898+0000 7f7cc8773740 1 -- start start 2024-03-16T20:59:51.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.898+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cdfa0 0x558af57cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.898+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cd2c0 0x558af57cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.898+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af57d8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.898+0000 7f7cc8773740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af573c150 con 0x558af57cdfa0 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.898+0000 7f7cc8773740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af5739680 con 0x558af57cd2c0 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.898+0000 7f7cc8773740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af5734e60 con 0x558af57d6630 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.899+0000 7f7cbea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cd2c0 0x558af57cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.899+0000 7f7cbea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cd2c0 0x558af57cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37152/0 (socket says 172.21.15.8:37152) 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.899+0000 7f7cbf400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cdfa0 0x558af57cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.899+0000 7f7cbea00640 1 -- 172.21.15.8:0/2195179820 learned_addr learned my addr 172.21.15.8:0/2195179820 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.899+0000 7f7cb7400640 1 -- 172.21.15.8:0/3779769094 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7cac03b040 con 0x7f7cc0104050 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.899+0000 7f7cbea00640 1 -- 172.21.15.8:0/2195179820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 msgr2=0x558af57d8a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.899+0000 7f7cbea00640 1 --2- 172.21.15.8:0/2195179820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af57d8a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.899+0000 7f7cbea00640 1 -- 172.21.15.8:0/2195179820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cdfa0 msgr2=0x558af57cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.899+0000 7f7cbea00640 1 --2- 172.21.15.8:0/2195179820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cdfa0 0x558af57cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.899+0000 7f7cbea00640 1 -- 172.21.15.8:0/2195179820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558af56ee060 con 0x558af57cd2c0 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.900+0000 7f7cbea00640 1 --2- 172.21.15.8:0/2195179820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cd2c0 0x558af57cd740 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009c50 tx=0x7f7cb0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33e2ad0efe156bdb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.900+0000 7f7cabe00640 1 -- 172.21.15.8:0/2195179820 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0019630 con 0x558af57cd2c0 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.900+0000 7f7cabe00640 1 -- 172.21.15.8:0/2195179820 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7cb0019c90 con 0x558af57cd2c0 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.900+0000 7f7cabe00640 1 -- 172.21.15.8:0/2195179820 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000ec70 con 0x558af57cd2c0 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.901+0000 7f7cb7400640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7ca40a1c20 0x7f7ca40a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.901+0000 7f7cc8773740 1 -- 172.21.15.8:0/2195179820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cd2c0 msgr2=0x558af57cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.901+0000 7f7cc8773740 1 --2- 172.21.15.8:0/2195179820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cd2c0 0x558af57cd740 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009c50 tx=0x7f7cb0011810 comp rx=0 tx=0).stop 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.901+0000 7f7cb7400640 1 -- 172.21.15.8:0/3779769094 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7cac0eefb0 con 0x7f7cc0104050 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.901+0000 7f7cc8773740 1 -- 172.21.15.8:0/2195179820 shutdown_connections 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.901+0000 7f7cc8773740 1 --2- 172.21.15.8:0/2195179820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af57d8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.901+0000 7f7cc8773740 1 --2- 172.21.15.8:0/2195179820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cd2c0 0x558af57cd740 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.901+0000 7f7cc8773740 1 --2- 172.21.15.8:0/2195179820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cdfa0 0x558af57cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.901+0000 7f7cc8773740 1 -- 172.21.15.8:0/2195179820 >> 172.21.15.8:0/2195179820 conn(0x558af57945a0 msgr2=0x558af57c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.901+0000 7f7cbf400640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7ca40a1c20 0x7f7ca40a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.901+0000 7f7cc8773740 1 -- 172.21.15.8:0/2195179820 shutdown_connections 2024-03-16T20:59:51.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.902+0000 7f7cc8773740 1 -- 172.21.15.8:0/2195179820 wait complete. 2024-03-16T20:59:51.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.903+0000 7f7cbf400640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7ca40a1c20 0x7f7ca40a40e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8005fd0 tx=0x7f7cb8009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.903+0000 7f7cc8773740 1 -- start start 2024-03-16T20:59:51.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.903+0000 7f7cc8773740 1 Processor -- start 2024-03-16T20:59:51.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57cdfa0 0x558af57d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57d6630 0x558af57d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cc8773740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af56d9ec0 con 0x558af57cd2c0 2024-03-16T20:59:51.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cc8773740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af56d9b60 con 0x558af57d6630 2024-03-16T20:59:51.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cc8773740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af54a31c0 con 0x558af57cdfa0 2024-03-16T20:59:51.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cc8773740 10 client.0 _ll_register_callbacks cb 0x558af56ed960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cbea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cbe000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57cdfa0 0x558af57d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cbf400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57d6630 0x558af57d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cbe000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57cdfa0 0x558af57d3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47232/0 (socket says 172.21.15.8:47232) 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.904+0000 7f7cbe000640 1 -- 172.21.15.8:0/1837121801 learned_addr learned my addr 172.21.15.8:0/1837121801 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.905+0000 7f7cbe000640 1 -- 172.21.15.8:0/1837121801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57d6630 msgr2=0x558af57d4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.905+0000 7f7cbe000640 1 --2- 172.21.15.8:0/1837121801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57d6630 0x558af57d4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.905+0000 7f7cbe000640 1 -- 172.21.15.8:0/1837121801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 msgr2=0x558af57d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.905+0000 7f7cbe000640 1 --2- 172.21.15.8:0/1837121801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.905+0000 7f7cbe000640 1 -- 172.21.15.8:0/1837121801 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb00098b0 con 0x558af57cdfa0 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.905+0000 7f7cbe000640 1 --2- 172.21.15.8:0/1837121801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57cdfa0 0x558af57d3b00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0b8690 tx=0x7f7cac0bbb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f6cb54ff6351d7b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.905+0000 7f7ca8c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:51.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.905+0000 7f7ca8c00640 1 -- 172.21.15.8:0/1837121801 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0c41d0 con 0x558af57cdfa0 2024-03-16T20:59:51.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.905+0000 7f7ca8c00640 1 -- 172.21.15.8:0/1837121801 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7cac0bbcc0 con 0x558af57cdfa0 2024-03-16T20:59:51.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.905+0000 7f7cc8773740 1 -- 172.21.15.8:0/1837121801 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558af54347e0 con 0x558af57cdfa0 2024-03-16T20:59:51.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.905+0000 7f7ca8c00640 1 -- 172.21.15.8:0/1837121801 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cac0ecb60 con 0x558af57cdfa0 2024-03-16T20:59:51.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.906+0000 7f7cc8773740 10 client.26038 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:51.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.906+0000 7f7cc8773740 1 -- 172.21.15.8:0/1837121801 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558af57334e0 con 0x558af57cdfa0 2024-03-16T20:59:51.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.906+0000 7f7ca8c00640 1 -- 172.21.15.8:0/1837121801 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x558af54347e0 con 0x558af57cdfa0 2024-03-16T20:59:51.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.906+0000 7f7ca8c00640 1 -- 172.21.15.8:0/1837121801 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f7cac0bb110 con 0x558af57cdfa0 2024-03-16T20:59:51.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.906+0000 7f7cc8773740 10 client.26038 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:51.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.906+0000 7f7cc8773740 10 client.26038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:51.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.906+0000 7f7cc8773740 20 client.26038 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:51.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.906+0000 7f7cc8773740 1 --2- 172.21.15.8:0/1837121801 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558af57e63a0 0x558af57e87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.906+0000 7f7cc8773740 4 client.26038 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:51.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.906+0000 7f7cc8773740 1 -- 172.21.15.8:0/1837121801 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558af5471720 con 0x558af57e63a0 2024-03-16T20:59:51.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.906+0000 7f7cbea00640 1 --2- 172.21.15.8:0/1837121801 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558af57e63a0 0x558af57e87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.907+0000 7f7cbea00640 1 --2- 172.21.15.8:0/1837121801 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558af57e63a0 0x558af57e87c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa3331a56536c61d server_cookie=dd0727de0d7bd507 in_seq=0 out_seq=0 2024-03-16T20:59:51.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.907+0000 7f7ca8c00640 10 client.26038 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:51.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7ca8c00640 1 -- 172.21.15.8:0/1837121801 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x558af5471720 con 0x558af57e63a0 2024-03-16T20:59:51.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7ca8c00640 10 client.26038 handle_command_reply: tid=0 2024-03-16T20:59:51.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7cc8773740 1 client.26038 shutdown 2024-03-16T20:59:51.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7cc8773740 1 -- 172.21.15.8:0/1837121801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57cdfa0 msgr2=0x558af57d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7cc8773740 1 --2- 172.21.15.8:0/1837121801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57cdfa0 0x558af57d3b00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0b8690 tx=0x7f7cac0bbb50 comp rx=0 tx=0).stop 2024-03-16T20:59:51.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7cc8773740 1 -- 172.21.15.8:0/1837121801 shutdown_connections 2024-03-16T20:59:51.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7cc8773740 1 --2- 172.21.15.8:0/1837121801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57d6630 0x558af57d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7cc8773740 1 --2- 172.21.15.8:0/1837121801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57cdfa0 0x558af57d3b00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7cc8773740 1 --2- 172.21.15.8:0/1837121801 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558af57e63a0 0x558af57e87c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7cc8773740 1 --2- 172.21.15.8:0/1837121801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7cc8773740 1 -- 172.21.15.8:0/1837121801 >> 172.21.15.8:0/1837121801 conn(0x558af57945a0 msgr2=0x558af57c9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.909+0000 7f7ca8c00640 0 client.26038 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:51.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.910+0000 7f7cc8773740 1 -- 172.21.15.8:0/1837121801 shutdown_connections 2024-03-16T20:59:51.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.910+0000 7f7cc8773740 1 -- 172.21.15.8:0/1837121801 wait complete. 2024-03-16T20:59:51.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.910+0000 7f7cc8773740 20 client.26038 trim_cache size 0 max 16384 2024-03-16T20:59:51.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.931+0000 7f7cc8773740 1 Processor -- start 2024-03-16T20:59:51.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.931+0000 7f7cc8773740 1 -- start start 2024-03-16T20:59:51.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.931+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.931+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 0x558af57d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af57c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cc8773740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af57c2d70 con 0x558af57cd2c0 2024-03-16T20:59:51.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cc8773740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af57ccb30 con 0x558af57cdfa0 2024-03-16T20:59:51.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cc8773740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af57e32e0 con 0x558af57d6630 2024-03-16T20:59:51.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cbf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af57c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cbea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cbe000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 0x558af57d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cbf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af57c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47238/0 (socket says 172.21.15.8:47238) 2024-03-16T20:59:51.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cbf400640 1 -- 172.21.15.8:0/3913773458 learned_addr learned my addr 172.21.15.8:0/3913773458 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:51.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cbea00640 1 -- 172.21.15.8:0/3913773458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 msgr2=0x558af57c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cbea00640 1 --2- 172.21.15.8:0/3913773458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af57c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cbea00640 1 -- 172.21.15.8:0/3913773458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 msgr2=0x558af57d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cbea00640 1 --2- 172.21.15.8:0/3913773458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 0x558af57d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cbea00640 1 -- 172.21.15.8:0/3913773458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558af56cf950 con 0x558af57cd2c0 2024-03-16T20:59:51.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.932+0000 7f7cbe000640 1 --2- 172.21.15.8:0/3913773458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 0x558af57d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:51.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.933+0000 7f7cbea00640 1 --2- 172.21.15.8:0/3913773458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d5cf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0011d10 tx=0x7f7cb000e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9867391ce049e3b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.933+0000 7f7cab400640 1 -- 172.21.15.8:0/3913773458 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb002a2e0 con 0x558af57cd2c0 2024-03-16T20:59:51.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.933+0000 7f7cab400640 1 -- 172.21.15.8:0/3913773458 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7cb0009e00 con 0x558af57cd2c0 2024-03-16T20:59:51.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.933+0000 7f7cab400640 1 -- 172.21.15.8:0/3913773458 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0019430 con 0x558af57cd2c0 2024-03-16T20:59:51.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.934+0000 7f7cc8773740 1 -- 172.21.15.8:0/3913773458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 msgr2=0x558af57d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.934+0000 7f7cc8773740 1 --2- 172.21.15.8:0/3913773458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d5cf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0011d10 tx=0x7f7cb000e7b0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.934+0000 7f7cc8773740 1 -- 172.21.15.8:0/3913773458 shutdown_connections 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.934+0000 7f7cc8773740 1 --2- 172.21.15.8:0/3913773458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af57c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.934+0000 7f7cc8773740 1 --2- 172.21.15.8:0/3913773458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 0x558af57d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.934+0000 7f7cc8773740 1 --2- 172.21.15.8:0/3913773458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d5cf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.934+0000 7f7cc8773740 1 -- 172.21.15.8:0/3913773458 >> 172.21.15.8:0/3913773458 conn(0x558af57945a0 msgr2=0x558af57c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.935+0000 7f7cc8773740 1 -- 172.21.15.8:0/3913773458 shutdown_connections 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.935+0000 7f7cc8773740 1 -- 172.21.15.8:0/3913773458 wait complete. 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.935+0000 7f7cc8773740 1 -- start start 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.935+0000 7f7cc8773740 1 Processor -- start 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 0x558af57d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cc8773740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af5840c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cc8773740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af57d0de0 con 0x558af57cd2c0 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cc8773740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af5841190 con 0x558af57cdfa0 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cc8773740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558af58412d0 con 0x558af57d6630 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cc8773740 10 client.0 _ll_register_callbacks cb 0x7f7cac034ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cbe000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 0x558af57d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cbf400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af5840c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cbe000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 0x558af57d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37172/0 (socket says 172.21.15.8:37172) 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cbe000640 1 -- 172.21.15.8:0/3046851522 learned_addr learned my addr 172.21.15.8:0/3046851522 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cbea00640 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cbe000640 1 -- 172.21.15.8:0/3046851522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 msgr2=0x558af5840c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cbe000640 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af5840c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cbe000640 1 -- 172.21.15.8:0/3046851522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 msgr2=0x558af57d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:51.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cbe000640 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cbe000640 1 -- 172.21.15.8:0/3046851522 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558af57334e0 con 0x558af57cdfa0 2024-03-16T20:59:51.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.936+0000 7f7cbf400640 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af5840c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T20:59:51.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.937+0000 7f7cbe000640 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 0x558af57d0710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7cac003fd0 tx=0x7f7cac005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bb5dcce7290d373 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:51.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.937+0000 7f7ca8c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T20:59:51.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.937+0000 7f7ca8c00640 1 -- 172.21.15.8:0/3046851522 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0b7d50 con 0x558af57cdfa0 2024-03-16T20:59:51.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.937+0000 7f7ca8c00640 1 -- 172.21.15.8:0/3046851522 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7cac0bbcc0 con 0x558af57cdfa0 2024-03-16T20:59:51.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.937+0000 7f7cc8773740 1 -- 172.21.15.8:0/3046851522 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7cb0019c90 con 0x558af57cdfa0 2024-03-16T20:59:51.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.937+0000 7f7ca8c00640 1 -- 172.21.15.8:0/3046851522 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cac0ecb60 con 0x558af57cdfa0 2024-03-16T20:59:51.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.937+0000 7f7cc8773740 10 client.26036 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:51.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.937+0000 7f7cc8773740 1 -- 172.21.15.8:0/3046851522 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558af56ee060 con 0x558af57cdfa0 2024-03-16T20:59:51.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.938+0000 7f7ca8c00640 1 -- 172.21.15.8:0/3046851522 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7cb0019c90 con 0x558af57cdfa0 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.938+0000 7f7ca8c00640 1 -- 172.21.15.8:0/3046851522 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f7cac09ad20 con 0x558af57cdfa0 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.939+0000 7f7cc8773740 10 client.26036 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.939+0000 7f7cc8773740 10 client.26036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.939+0000 7f7cc8773740 20 client.26036 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.939+0000 7f7cc8773740 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558af58424e0 0x558af5844900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.939+0000 7f7cc8773740 4 client.26036 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.939+0000 7f7cc8773740 1 -- 172.21.15.8:0/3046851522 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558af54c0890 con 0x558af58424e0 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.939+0000 7f7cbea00640 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558af58424e0 0x558af5844900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.939+0000 7f7cbea00640 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558af58424e0 0x558af5844900 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47ebaa9862977d4 server_cookie=a480b271e8865f3c in_seq=0 out_seq=0 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.939+0000 7f7ca8c00640 10 client.26036 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.940+0000 7f7ca8c00640 1 -- 172.21.15.8:0/3046851522 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x558af54c0890 con 0x558af58424e0 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.940+0000 7f7ca8c00640 10 client.26036 handle_command_reply: tid=0 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.940+0000 7f7cc8773740 1 client.26036 shutdown 2024-03-16T20:59:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7cc8773740 1 -- 172.21.15.8:0/3046851522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 msgr2=0x558af57d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7cc8773740 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 0x558af57d0710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7cac003fd0 tx=0x7f7cac005f90 comp rx=0 tx=0).stop 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7cc8773740 1 -- 172.21.15.8:0/3046851522 shutdown_connections 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7cc8773740 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558af57d6630 0x558af5840c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7cc8773740 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558af57cdfa0 0x558af57d0710 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7cc8773740 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558af58424e0 0x558af5844900 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7cc8773740 1 --2- 172.21.15.8:0/3046851522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558af57cd2c0 0x558af57d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7ca8c00640 0 client.26036 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7cc8773740 1 -- 172.21.15.8:0/3046851522 >> 172.21.15.8:0/3046851522 conn(0x558af57945a0 msgr2=0x558af57c6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7cc8773740 1 -- 172.21.15.8:0/3046851522 shutdown_connections 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7cc8773740 1 -- 172.21.15.8:0/3046851522 wait complete. 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.941+0000 7f7cc8773740 20 client.26036 trim_cache size 0 max 16384 2024-03-16T20:59:51.949 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T20:59:51.950 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (606 inodes in the stack)", 2024-03-16T20:59:51.950 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T20:59:51.950 INFO:teuthology.orchestra.run.smithi008.stdout: "40fbab30-9417-4774-9ed8-8dbcca541466": { 2024-03-16T20:59:51.950 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T20:59:51.950 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "40fbab30-9417-4774-9ed8-8dbcca541466", 2024-03-16T20:59:51.950 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T20:59:51.950 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T20:59:51.950 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T20:59:51.950 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T20:59:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.942+0000 7f7cc5a00640 1 -- 172.21.15.8:0/3779769094 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7ca40a1c20 msgr2=0x7f7ca40a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.942+0000 7f7cc5a00640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7ca40a1c20 0x7f7ca40a40e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8005fd0 tx=0x7f7cb8009500 comp rx=0 tx=0).stop 2024-03-16T20:59:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.942+0000 7f7cc5a00640 1 -- 172.21.15.8:0/3779769094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc0104050 msgr2=0x7f7cc019a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.942+0000 7f7cc5a00640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc0104050 0x7f7cc019a3b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009860 tx=0x7f7cac004530 comp rx=0 tx=0).stop 2024-03-16T20:59:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.942+0000 7f7cc5a00640 1 -- 172.21.15.8:0/3779769094 shutdown_connections 2024-03-16T20:59:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.942+0000 7f7cc5a00640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7ca40a1c20 0x7f7ca40a40e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.942+0000 7f7cc5a00640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cc01096a0 0x7f7cc019e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.942+0000 7f7cc5a00640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cc0104050 0x7f7cc019a3b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.942+0000 7f7cc5a00640 1 --2- 172.21.15.8:0/3779769094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc0103690 0x7f7cc0199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.942+0000 7f7cc5a00640 1 -- 172.21.15.8:0/3779769094 >> 172.21.15.8:0/3779769094 conn(0x7f7cc00ff160 msgr2=0x7f7cc00ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.943+0000 7f7cc5a00640 1 -- 172.21.15.8:0/3779769094 shutdown_connections 2024-03-16T20:59:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T20:59:51.943+0000 7f7cc5a00640 1 -- 172.21.15.8:0/3779769094 wait complete. 2024-03-16T20:59:51.970 INFO:tasks.cephfs.filesystem:scrub status for tag:40fbab30-9417-4774-9ed8-8dbcca541466 - {'path': '/', 'tag': '40fbab30-9417-4774-9ed8-8dbcca541466', 'options': 'recursive,force'} 2024-03-16T20:59:52.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:52 smithi170 ceph-mon[35947]: pgmap v64: 97 pgs: 97 active+clean; 103 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 544 op/s 2024-03-16T20:59:52.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:52 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T20:59:52.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:52 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:52.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:52 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T20:59:52.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:52 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T20:59:52.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:52 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T20:59:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:52 smithi186 ceph-mon[36391]: pgmap v64: 97 pgs: 97 active+clean; 103 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 544 op/s 2024-03-16T20:59:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:52 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T20:59:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:52 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:52 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T20:59:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:52 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T20:59:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:52 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T20:59:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:52 smithi008 ceph-mon[31434]: pgmap v64: 97 pgs: 97 active+clean; 103 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 544 op/s 2024-03-16T20:59:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:52 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T20:59:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:52 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:52 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T20:59:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:52 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T20:59:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:52 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T20:59:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.403+0000 7f6d63000640 1 -- 172.21.15.8:0/3125087016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d5c104090 msgr2=0x7f6d5c1105a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.403+0000 7f6d63000640 1 --2- 172.21.15.8:0/3125087016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d5c104090 0x7f6d5c1105a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009ca0 tx=0x7f6d5402c100 comp rx=0 tx=0).stop 2024-03-16T20:59:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.403+0000 7f6d63000640 1 -- 172.21.15.8:0/3125087016 shutdown_connections 2024-03-16T20:59:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.403+0000 7f6d63000640 1 --2- 172.21.15.8:0/3125087016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d5c104090 0x7f6d5c1105a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.403+0000 7f6d63000640 1 --2- 172.21.15.8:0/3125087016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d5c1036d0 0x7f6d5c103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.403+0000 7f6d63000640 1 --2- 172.21.15.8:0/3125087016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d5c1096e0 0x7f6d5c109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.403+0000 7f6d63000640 1 -- 172.21.15.8:0/3125087016 >> 172.21.15.8:0/3125087016 conn(0x7f6d5c0ff1a0 msgr2=0x7f6d5c1015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.403+0000 7f6d63000640 1 -- 172.21.15.8:0/3125087016 shutdown_connections 2024-03-16T20:59:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.403+0000 7f6d63000640 1 -- 172.21.15.8:0/3125087016 wait complete. 2024-03-16T20:59:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.404+0000 7f6d63000640 1 Processor -- start 2024-03-16T20:59:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.404+0000 7f6d63000640 1 -- start start 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d63000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d5c1036d0 0x7f6d5c199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d63000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d5c104090 0x7f6d5c19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d63000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d5c1096e0 0x7f6d5c19e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d63000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c19ec20 con 0x7f6d5c1036d0 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d63000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c19ed90 con 0x7f6d5c1096e0 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d63000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c19ef50 con 0x7f6d5c104090 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d5b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d5c104090 0x7f6d5c19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d5c1036d0 0x7f6d5c199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d61000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d5c1096e0 0x7f6d5c19e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d5b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d5c104090 0x7f6d5c19a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47270/0 (socket says 172.21.15.8:47270) 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d5b400640 1 -- 172.21.15.8:0/1266529320 learned_addr learned my addr 172.21.15.8:0/1266529320 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d5b400640 1 -- 172.21.15.8:0/1266529320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d5c1096e0 msgr2=0x7f6d5c19e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d5b400640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d5c1096e0 0x7f6d5c19e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d5b400640 1 -- 172.21.15.8:0/1266529320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d5c1036d0 msgr2=0x7f6d5c199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d5b400640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d5c1036d0 0x7f6d5c199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.405+0000 7f6d5b400640 1 -- 172.21.15.8:0/1266529320 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54009900 con 0x7f6d5c104090 2024-03-16T20:59:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.406+0000 7f6d5b400640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d5c104090 0x7f6d5c19a2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800e9f0 tx=0x7f6d4800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.406+0000 7f6d58c00640 1 -- 172.21.15.8:0/1266529320 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48009700 con 0x7f6d5c104090 2024-03-16T20:59:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.406+0000 7f6d58c00640 1 -- 172.21.15.8:0/1266529320 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6d4800cd80 con 0x7f6d5c104090 2024-03-16T20:59:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.406+0000 7f6d63000640 1 -- 172.21.15.8:0/1266529320 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c19f230 con 0x7f6d5c104090 2024-03-16T20:59:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.406+0000 7f6d58c00640 1 -- 172.21.15.8:0/1266529320 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d480189c0 con 0x7f6d5c104090 2024-03-16T20:59:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.406+0000 7f6d63000640 1 -- 172.21.15.8:0/1266529320 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c1a6ab0 con 0x7f6d5c104090 2024-03-16T20:59:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.410+0000 7f6d65dc3740 1 Processor -- start 2024-03-16T20:59:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.411+0000 7f6d65dc3740 1 -- start start 2024-03-16T20:59:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.411+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ebf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.411+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.411+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec9330 0x55a2c7ecb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.411+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7e7b620 con 0x55a2c7ec0b20 2024-03-16T20:59:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.411+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7e2d8c0 con 0x55a2c7ec9330 2024-03-16T20:59:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.411+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7e2adf0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.412+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.412+0000 7f6d61000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ebf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.412+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47280/0 (socket says 172.21.15.8:47280) 2024-03-16T20:59:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.412+0000 7f6d5be00640 1 -- 172.21.15.8:0/4002238840 learned_addr learned my addr 172.21.15.8:0/4002238840 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.412+0000 7f6d58c00640 1 -- 172.21.15.8:0/1266529320 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f6d48018b20 con 0x7f6d5c104090 2024-03-16T20:59:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.412+0000 7f6d5be00640 1 -- 172.21.15.8:0/4002238840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec9330 msgr2=0x55a2c7ecb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.412+0000 7f6d5be00640 1 --2- 172.21.15.8:0/4002238840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec9330 0x55a2c7ecb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.412+0000 7f6d5be00640 1 -- 172.21.15.8:0/4002238840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 msgr2=0x55a2c7ebf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.412+0000 7f6d5be00640 1 --2- 172.21.15.8:0/4002238840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ebf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.412+0000 7f6d5be00640 1 -- 172.21.15.8:0/4002238840 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2c7da7b00 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.412+0000 7f6d5be00640 1 --2- 172.21.15.8:0/4002238840 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec0230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009c70 tx=0x7f6d4c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15b1d5b7c5c54718 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.413+0000 7f6d51600640 1 -- 172.21.15.8:0/4002238840 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c004230 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.413+0000 7f6d51600640 1 -- 172.21.15.8:0/4002238840 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6d4c004390 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.413+0000 7f6d51600640 1 -- 172.21.15.8:0/4002238840 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c019830 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.413+0000 7f6d65dc3740 1 -- 172.21.15.8:0/4002238840 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 msgr2=0x55a2c7ec0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.413+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/4002238840 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec0230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009c70 tx=0x7f6d4c011810 comp rx=0 tx=0).stop 2024-03-16T20:59:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.413+0000 7f6d65dc3740 1 -- 172.21.15.8:0/4002238840 shutdown_connections 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.413+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/4002238840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec9330 0x55a2c7ecb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.413+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/4002238840 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec0230 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.413+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/4002238840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ebf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.413+0000 7f6d58c00640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6d400a1c40 0x7f6d400a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.413+0000 7f6d65dc3740 1 -- 172.21.15.8:0/4002238840 >> 172.21.15.8:0/4002238840 conn(0x55a2c7e874b0 msgr2=0x55a2c7ebaaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.414+0000 7f6d65dc3740 1 -- 172.21.15.8:0/4002238840 shutdown_connections 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.414+0000 7f6d58c00640 1 -- 172.21.15.8:0/1266529320 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6d48014070 con 0x7f6d5c104090 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.414+0000 7f6d65dc3740 1 -- 172.21.15.8:0/4002238840 wait complete. 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.414+0000 7f6d61000640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6d400a1c40 0x7f6d400a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.414+0000 7f6d65dc3740 1 -- start start 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.415+0000 7f6d65dc3740 1 Processor -- start 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.415+0000 7f6d61000640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6d400a1c40 0x7f6d400a4100 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d54004af0 tx=0x7f6d54005c50 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.415+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.415+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ec6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.415+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec9330 0x55a2c7ec6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.415+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7e265d0 con 0x55a2c7ec9330 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.415+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7dcbb50 con 0x55a2c7ec0b20 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.415+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7dcb7f0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.415+0000 7f6d65dc3740 10 client.0 _ll_register_callbacks cb 0x55a2c7ddf550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.415+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d5b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ec6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47294/0 (socket says 172.21.15.8:47294) 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d5be00640 1 -- 172.21.15.8:0/236203625 learned_addr learned my addr 172.21.15.8:0/236203625 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d61000640 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec9330 0x55a2c7ec6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d5be00640 1 -- 172.21.15.8:0/236203625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec0b20 msgr2=0x55a2c7ec6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d5be00640 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ec6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d5be00640 1 -- 172.21.15.8:0/236203625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec9330 msgr2=0x55a2c7ec6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d5be00640 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec9330 0x55a2c7ec6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d5be00640 1 -- 172.21.15.8:0/236203625 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c0098d0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d5be00640 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec63f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c000c00 tx=0x7f6d4c004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9801254a866c4e7f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d46000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.416+0000 7f6d46000640 1 -- 172.21.15.8:0/236203625 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c005260 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d46000640 1 -- 172.21.15.8:0/236203625 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6d4c0053c0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d65dc3740 1 -- 172.21.15.8:0/236203625 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2c7df8cd0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d46000640 1 -- 172.21.15.8:0/236203625 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d4c005580 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d65dc3740 10 client.26056 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d65dc3740 1 -- 172.21.15.8:0/236203625 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a2c7e24c50 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d46000640 1 -- 172.21.15.8:0/236203625 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a2c7df8cd0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d46000640 1 -- 172.21.15.8:0/236203625 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f6d4c004bb0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d65dc3740 10 client.26056 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d65dc3740 10 client.26056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d65dc3740 20 client.26056 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2c7ed92c0 0x55a2c7edb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d65dc3740 4 client.26056 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.417+0000 7f6d65dc3740 1 -- 172.21.15.8:0/236203625 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2c7e1cce0 con 0x55a2c7ed92c0 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.418+0000 7f6d5b400640 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2c7ed92c0 0x55a2c7edb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.418+0000 7f6d5b400640 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2c7ed92c0 0x55a2c7edb6e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe0e9850682d0f81 server_cookie=87494b911cdd613a in_seq=0 out_seq=0 2024-03-16T20:59:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.418+0000 7f6d46000640 10 client.26056 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.420+0000 7f6d46000640 1 -- 172.21.15.8:0/236203625 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a2c7e1cce0 con 0x55a2c7ed92c0 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.420+0000 7f6d46000640 10 client.26056 handle_command_reply: tid=0 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.420+0000 7f6d65dc3740 1 client.26056 shutdown 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.420+0000 7f6d65dc3740 1 -- 172.21.15.8:0/236203625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 msgr2=0x55a2c7ec63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.420+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec63f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c000c00 tx=0x7f6d4c004470 comp rx=0 tx=0).stop 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.421+0000 7f6d65dc3740 1 -- 172.21.15.8:0/236203625 shutdown_connections 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.421+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2c7ed92c0 0x55a2c7edb6e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.421+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec9330 0x55a2c7ec6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.421+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ec6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.421+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/236203625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec63f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.421+0000 7f6d65dc3740 1 -- 172.21.15.8:0/236203625 >> 172.21.15.8:0/236203625 conn(0x55a2c7e874b0 msgr2=0x55a2c7ebc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.421+0000 7f6d46000640 0 client.26056 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.421+0000 7f6d65dc3740 1 -- 172.21.15.8:0/236203625 shutdown_connections 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.421+0000 7f6d65dc3740 1 -- 172.21.15.8:0/236203625 wait complete. 2024-03-16T20:59:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.421+0000 7f6d65dc3740 20 client.26056 trim_cache size 0 max 16384 2024-03-16T20:59:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.437+0000 7f6d65dc3740 1 Processor -- start 2024-03-16T20:59:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.437+0000 7f6d65dc3740 1 -- start start 2024-03-16T20:59:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ec6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ec9330 0x55a2c7eb9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7b6ee60 con 0x55a2c7ec0b20 2024-03-16T20:59:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7ed5ec0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7ec1280 con 0x55a2c7ec9330 2024-03-16T20:59:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37210/0 (socket says 172.21.15.8:37210) 2024-03-16T20:59:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d5be00640 1 -- 172.21.15.8:0/845535609 learned_addr learned my addr 172.21.15.8:0/845535609 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d5b400640 1 --2- 172.21.15.8:0/845535609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ec6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d61000640 1 --2- 172.21.15.8:0/845535609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ec9330 0x55a2c7eb9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d5be00640 1 -- 172.21.15.8:0/845535609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ec9330 msgr2=0x55a2c7eb9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d5be00640 1 --2- 172.21.15.8:0/845535609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ec9330 0x55a2c7eb9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d5be00640 1 -- 172.21.15.8:0/845535609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 msgr2=0x55a2c7ec6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d5be00640 1 --2- 172.21.15.8:0/845535609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ec6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.438+0000 7f6d5be00640 1 -- 172.21.15.8:0/845535609 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2c7dc1530 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.439+0000 7f6d5be00640 1 --2- 172.21.15.8:0/845535609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec8b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c011850 tx=0x7f6d4c004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32f947b74bc25921 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.439+0000 7f6d50c00640 1 -- 172.21.15.8:0/845535609 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c011dc0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.439+0000 7f6d50c00640 1 -- 172.21.15.8:0/845535609 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6d4c019a50 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.439+0000 7f6d50c00640 1 -- 172.21.15.8:0/845535609 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0038c0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.440+0000 7f6d65dc3740 1 -- 172.21.15.8:0/845535609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ebfdb0 msgr2=0x55a2c7ec8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.440+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/845535609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec8b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c011850 tx=0x7f6d4c004f90 comp rx=0 tx=0).stop 2024-03-16T20:59:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.440+0000 7f6d65dc3740 1 -- 172.21.15.8:0/845535609 shutdown_connections 2024-03-16T20:59:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.440+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/845535609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ec9330 0x55a2c7eb9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.440+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/845535609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7ec6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.440+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/845535609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec8b20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.440+0000 7f6d65dc3740 1 -- 172.21.15.8:0/845535609 >> 172.21.15.8:0/845535609 conn(0x55a2c7e874b0 msgr2=0x55a2c7eb94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.440+0000 7f6d65dc3740 1 -- 172.21.15.8:0/845535609 shutdown_connections 2024-03-16T20:59:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.440+0000 7f6d65dc3740 1 -- 172.21.15.8:0/845535609 wait complete. 2024-03-16T20:59:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.440+0000 7f6d65dc3740 1 -- start start 2024-03-16T20:59:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d65dc3740 1 Processor -- start 2024-03-16T20:59:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7eca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d65dc3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec9330 0x55a2c7ed0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7ed06b0 con 0x55a2c7ec0b20 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7ed0820 con 0x55a2c7ec9330 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d65dc3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c7ed09e0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d65dc3740 10 client.0 _ll_register_callbacks cb 0x7f6d4c004310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d61000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec9330 0x55a2c7ed0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d61000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec9330 0x55a2c7ed0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37214/0 (socket says 172.21.15.8:37214) 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47322/0 (socket says 172.21.15.8:47322) 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d5be00640 1 -- 172.21.15.8:0/951226705 learned_addr learned my addr 172.21.15.8:0/951226705 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.441+0000 7f6d5b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7eca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.442+0000 7f6d5be00640 1 -- 172.21.15.8:0/951226705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec9330 msgr2=0x55a2c7ed0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.442+0000 7f6d5be00640 1 --2- 172.21.15.8:0/951226705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec9330 0x55a2c7ed0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.442+0000 7f6d5be00640 1 -- 172.21.15.8:0/951226705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 msgr2=0x55a2c7eca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.442+0000 7f6d5be00640 1 --2- 172.21.15.8:0/951226705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7eca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.442+0000 7f6d5be00640 1 -- 172.21.15.8:0/951226705 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2c7e24c50 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.442+0000 7f6d5be00640 1 --2- 172.21.15.8:0/951226705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec9cb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c000c00 tx=0x7f6d4c004280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c7fd7b328559346 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.442+0000 7f6d46000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.442+0000 7f6d46000640 1 -- 172.21.15.8:0/951226705 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c011dc0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.442+0000 7f6d46000640 1 -- 172.21.15.8:0/951226705 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6d4c005470 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.442+0000 7f6d65dc3740 1 -- 172.21.15.8:0/951226705 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2c7e4bd30 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d46000640 1 -- 172.21.15.8:0/951226705 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d4c0195d0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d65dc3740 10 client.26062 fetch_fsmap learned FSMap version 26 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d65dc3740 1 -- 172.21.15.8:0/951226705 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a2c7de72c0 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d46000640 1 -- 172.21.15.8:0/951226705 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a2c7e4bd30 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d46000640 1 -- 172.21.15.8:0/951226705 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f6d4c004540 con 0x55a2c7ebfdb0 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d65dc3740 10 client.26062 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T20:59:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d65dc3740 10 client.26062 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T20:59:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d65dc3740 20 client.26062 populate_metadata read hostname 'smithi008' 2024-03-16T20:59:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/951226705 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2c7f35300 0x55a2c7f37720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T20:59:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d65dc3740 4 client.26062 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T20:59:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d65dc3740 1 -- 172.21.15.8:0/951226705 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a2c7b26600 con 0x55a2c7f35300 2024-03-16T20:59:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.443+0000 7f6d5b400640 1 --2- 172.21.15.8:0/951226705 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2c7f35300 0x55a2c7f37720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T20:59:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.444+0000 7f6d5b400640 1 --2- 172.21.15.8:0/951226705 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2c7f35300 0x55a2c7f37720 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d0c2c99e058746f server_cookie=d9ead13826f3d3da in_seq=0 out_seq=0 2024-03-16T20:59:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:53.444+0000 7f6d46000640 10 client.26062 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:53.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:53 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:53.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:53 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:53 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:53.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:53 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:53.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:53 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:53.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:53 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:54.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:54 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:54.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:54 smithi170 ceph-mon[35947]: pgmap v65: 97 pgs: 97 active+clean; 103 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 20 op/s 2024-03-16T20:59:54.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:54 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:54.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:54 smithi186 ceph-mon[36391]: pgmap v65: 97 pgs: 97 active+clean; 103 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 20 op/s 2024-03-16T20:59:54.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:54 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T20:59:54.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:54 smithi008 ceph-mon[31434]: pgmap v65: 97 pgs: 97 active+clean; 103 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 20 op/s 2024-03-16T20:59:56.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:56 smithi170 ceph-mon[35947]: pgmap v66: 97 pgs: 97 active+clean; 103 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 20 op/s 2024-03-16T20:59:56.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:56 smithi186 ceph-mon[36391]: pgmap v66: 97 pgs: 97 active+clean; 103 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 20 op/s 2024-03-16T20:59:56.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:56 smithi008 ceph-mon[31434]: pgmap v66: 97 pgs: 97 active+clean; 103 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 20 op/s 2024-03-16T20:59:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.170+0000 7f6d46000640 1 -- 172.21.15.8:0/951226705 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a2c7b26600 con 0x55a2c7f35300 2024-03-16T20:59:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.170+0000 7f6d46000640 10 client.26062 handle_command_reply: tid=0 2024-03-16T20:59:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.170+0000 7f6d65dc3740 1 client.26062 shutdown 2024-03-16T20:59:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.170+0000 7f6d65dc3740 1 -- 172.21.15.8:0/951226705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 msgr2=0x55a2c7ec9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.170+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/951226705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec9cb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c000c00 tx=0x7f6d4c004280 comp rx=0 tx=0).stop 2024-03-16T20:59:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.171+0000 7f6d65dc3740 1 -- 172.21.15.8:0/951226705 shutdown_connections 2024-03-16T20:59:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.171+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/951226705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2c7ec9330 0x55a2c7ed0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.171+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/951226705 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a2c7f35300 0x55a2c7f37720 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.171+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/951226705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a2c7ec0b20 0x55a2c7eca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.171+0000 7f6d65dc3740 1 --2- 172.21.15.8:0/951226705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a2c7ebfdb0 0x55a2c7ec9cb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.171+0000 7f6d65dc3740 1 -- 172.21.15.8:0/951226705 >> 172.21.15.8:0/951226705 conn(0x55a2c7e874b0 msgr2=0x55a2c7eb9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.171+0000 7f6d46000640 0 client.26062 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T20:59:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.172+0000 7f6d65dc3740 1 -- 172.21.15.8:0/951226705 shutdown_connections 2024-03-16T20:59:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.172+0000 7f6d65dc3740 1 -- 172.21.15.8:0/951226705 wait complete. 2024-03-16T20:59:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.173+0000 7f6d65dc3740 20 client.26062 trim_cache size 0 max 16384 2024-03-16T20:59:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T20:59:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T20:59:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T20:59:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T20:59:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.175+0000 7f6d63000640 1 -- 172.21.15.8:0/1266529320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6d400a1c40 msgr2=0x7f6d400a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.175+0000 7f6d63000640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6d400a1c40 0x7f6d400a4100 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d54004af0 tx=0x7f6d54005c50 comp rx=0 tx=0).stop 2024-03-16T20:59:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.175+0000 7f6d63000640 1 -- 172.21.15.8:0/1266529320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d5c104090 msgr2=0x7f6d5c19a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T20:59:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.175+0000 7f6d63000640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d5c104090 0x7f6d5c19a2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800e9f0 tx=0x7f6d4800eeb0 comp rx=0 tx=0).stop 2024-03-16T20:59:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.176+0000 7f6d63000640 1 -- 172.21.15.8:0/1266529320 shutdown_connections 2024-03-16T20:59:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.176+0000 7f6d63000640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6d400a1c40 0x7f6d400a4100 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.176+0000 7f6d63000640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d5c1096e0 0x7f6d5c19e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.176+0000 7f6d63000640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d5c104090 0x7f6d5c19a2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.176+0000 7f6d63000640 1 --2- 172.21.15.8:0/1266529320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d5c1036d0 0x7f6d5c199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T20:59:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.176+0000 7f6d63000640 1 -- 172.21.15.8:0/1266529320 >> 172.21.15.8:0/1266529320 conn(0x7f6d5c0ff1a0 msgr2=0x7f6d5c0ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T20:59:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.176+0000 7f6d63000640 1 -- 172.21.15.8:0/1266529320 shutdown_connections 2024-03-16T20:59:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T20:59:57.176+0000 7f6d63000640 1 -- 172.21.15.8:0/1266529320 wait complete. 2024-03-16T20:59:57.740 INFO:tasks.workunit.client.0.smithi008.stderr:+ sync 2024-03-16T20:59:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:58 smithi170 ceph-mon[35947]: pgmap v67: 97 pgs: 97 active+clean; 120 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 305 op/s 2024-03-16T20:59:58.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:58 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T20:59:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:58 smithi186 ceph-mon[36391]: pgmap v67: 97 pgs: 97 active+clean; 120 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 305 op/s 2024-03-16T20:59:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:58 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T20:59:58.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:58 smithi008 ceph-mon[31434]: pgmap v67: 97 pgs: 97 active+clean; 120 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 305 op/s 2024-03-16T20:59:58.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:58 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T20:59:59.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:59 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T20:59:59.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 20:59:59 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T20:59:59.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:59 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T20:59:59.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 20:59:59 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:00:00.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:59 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:00:00.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 20:59:59 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:00:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:00 smithi186 ceph-mon[36391]: pgmap v68: 97 pgs: 97 active+clean; 120 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 298 op/s 2024-03-16T21:00:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:00 smithi186 ceph-mon[36391]: overall HEALTH_OK 2024-03-16T21:00:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:00 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:00:00.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:00 smithi008 ceph-mon[31434]: pgmap v68: 97 pgs: 97 active+clean; 120 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 298 op/s 2024-03-16T21:00:00.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:00 smithi008 ceph-mon[31434]: overall HEALTH_OK 2024-03-16T21:00:00.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:00 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:00:01.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:00 smithi170 ceph-mon[35947]: pgmap v68: 97 pgs: 97 active+clean; 120 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 298 op/s 2024-03-16T21:00:01.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:00 smithi170 ceph-mon[35947]: overall HEALTH_OK 2024-03-16T21:00:01.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:00 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:00:01.380 INFO:tasks.workunit.client.0.smithi008.stderr:+ tar c linux-4.0.5 2024-03-16T21:00:01.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:01 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:00:01.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:01 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:00:01.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:01 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:00:01.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:01 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:00:01.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:01 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:00:01.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:01 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:00:02.029 INFO:tasks.workunit.client.0.smithi008.stderr:+ rm -rf linux-4.0.5 2024-03-16T21:00:02.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:01 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:00:02.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:01 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:00:02.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:01 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:00:02.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:02 smithi186 ceph-mon[36391]: pgmap v69: 97 pgs: 97 active+clean; 160 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.8 MiB/s wr, 1.45k op/s 2024-03-16T21:00:02.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:02 smithi008 ceph-mon[31434]: pgmap v69: 97 pgs: 97 active+clean; 160 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.8 MiB/s wr, 1.45k op/s 2024-03-16T21:00:03.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:02 smithi170 ceph-mon[35947]: pgmap v69: 97 pgs: 97 active+clean; 160 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.8 MiB/s wr, 1.45k op/s 2024-03-16T21:00:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:04 smithi186 ceph-mon[36391]: pgmap v70: 97 pgs: 97 active+clean; 160 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 1.43k op/s 2024-03-16T21:00:04.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:04 smithi008 ceph-mon[31434]: pgmap v70: 97 pgs: 97 active+clean; 160 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 1.43k op/s 2024-03-16T21:00:05.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:04 smithi170 ceph-mon[35947]: pgmap v70: 97 pgs: 97 active+clean; 160 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 1.43k op/s 2024-03-16T21:00:06.919 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:06 smithi170 ceph-mon[35947]: pgmap v71: 97 pgs: 97 active+clean; 160 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 1.43k op/s 2024-03-16T21:00:06.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:06 smithi008 ceph-mon[31434]: pgmap v71: 97 pgs: 97 active+clean; 160 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 1.43k op/s 2024-03-16T21:00:07.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:06 smithi186 ceph-mon[36391]: pgmap v71: 97 pgs: 97 active+clean; 160 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 1.43k op/s 2024-03-16T21:00:08.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:08 smithi008 ceph-mon[31434]: pgmap v72: 97 pgs: 97 active+clean; 158 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.5 MiB/s wr, 1.60k op/s 2024-03-16T21:00:09.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:08 smithi170 ceph-mon[35947]: pgmap v72: 97 pgs: 97 active+clean; 158 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.5 MiB/s wr, 1.60k op/s 2024-03-16T21:00:09.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:08 smithi186 ceph-mon[36391]: pgmap v72: 97 pgs: 97 active+clean; 158 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.5 MiB/s wr, 1.60k op/s 2024-03-16T21:00:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.338+0000 7f19a2a00640 1 -- 172.21.15.8:0/1757520472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f199c06a630 msgr2=0x7f199c10e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.338+0000 7f19a2a00640 1 --2- 172.21.15.8:0/1757520472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f199c06a630 0x7f199c10e360 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1994009860 tx=0x7f199402bb70 comp rx=0 tx=0).stop 2024-03-16T21:00:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.338+0000 7f19a2a00640 1 -- 172.21.15.8:0/1757520472 shutdown_connections 2024-03-16T21:00:10.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.338+0000 7f19a2a00640 1 --2- 172.21.15.8:0/1757520472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f199c06a630 0x7f199c10e360 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.338+0000 7f19a2a00640 1 --2- 172.21.15.8:0/1757520472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199c069c90 0x7f199c06a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.338+0000 7f19a2a00640 1 --2- 172.21.15.8:0/1757520472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c1075a0 0x7f199c107980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.338+0000 7f19a2a00640 1 -- 172.21.15.8:0/1757520472 >> 172.21.15.8:0/1757520472 conn(0x7f199c0773d0 msgr2=0x7f199c0777e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.338+0000 7f19a2a00640 1 -- 172.21.15.8:0/1757520472 shutdown_connections 2024-03-16T21:00:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.338+0000 7f19a2a00640 1 -- 172.21.15.8:0/1757520472 wait complete. 2024-03-16T21:00:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.339+0000 7f19a2a00640 1 Processor -- start 2024-03-16T21:00:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f19a2a00640 1 -- start start 2024-03-16T21:00:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f19a2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199c069c90 0x7f199c19d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f19a2a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c06a630 0x7f199c19dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f19a2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f199c1075a0 0x7f199c197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f19a2a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c197f50 con 0x7f199c069c90 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f19a2a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c1980c0 con 0x7f199c1075a0 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f19a2a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c198280 con 0x7f199c06a630 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f199b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c06a630 0x7f199c19dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f19a0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f199c1075a0 0x7f199c197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f199b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c06a630 0x7f199c19dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38592/0 (socket says 172.21.15.8:38592) 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f19a0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f199c1075a0 0x7f199c197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:38242/0 (socket says 172.21.15.8:38242) 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f199b400640 1 -- 172.21.15.8:0/2000278720 learned_addr learned my addr 172.21.15.8:0/2000278720 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.340+0000 7f199be00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199c069c90 0x7f199c19d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f19a0a00640 1 -- 172.21.15.8:0/2000278720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c06a630 msgr2=0x7f199c19dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f19a0a00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c06a630 0x7f199c19dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f19a0a00640 1 -- 172.21.15.8:0/2000278720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199c069c90 msgr2=0x7f199c19d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f19a0a00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199c069c90 0x7f199c19d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f19a0a00640 1 -- 172.21.15.8:0/2000278720 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1994009490 con 0x7f199c1075a0 2024-03-16T21:00:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f199b400640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c06a630 0x7f199c19dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f19a0a00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f199c1075a0 0x7f199c197900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1994037040 tx=0x7f1994034ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f1998c00640 1 -- 172.21.15.8:0/2000278720 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940349d0 con 0x7f199c1075a0 2024-03-16T21:00:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f19a2a00640 1 -- 172.21.15.8:0/2000278720 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c198500 con 0x7f199c1075a0 2024-03-16T21:00:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f1998c00640 1 -- 172.21.15.8:0/2000278720 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f199402ca10 con 0x7f199c1075a0 2024-03-16T21:00:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f1998c00640 1 -- 172.21.15.8:0/2000278720 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940035f0 con 0x7f199c1075a0 2024-03-16T21:00:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.341+0000 7f19a2a00640 1 -- 172.21.15.8:0/2000278720 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c1a47f0 con 0x7f199c1075a0 2024-03-16T21:00:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.345+0000 7f19a567f740 1 Processor -- start 2024-03-16T21:00:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.345+0000 7f1998c00640 1 -- 172.21.15.8:0/2000278720 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f1994032620 con 0x7f199c1075a0 2024-03-16T21:00:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.346+0000 7f19a567f740 1 -- start start 2024-03-16T21:00:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.346+0000 7f19a567f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.346+0000 7f19a567f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 0x55deea98c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.346+0000 7f19a567f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea995330 0x55deea997720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.346+0000 7f19a567f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea947620 con 0x55deea98bdb0 2024-03-16T21:00:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.346+0000 7f19a567f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea8f98c0 con 0x55deea98cb20 2024-03-16T21:00:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.346+0000 7f19a567f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea8f6df0 con 0x55deea995330 2024-03-16T21:00:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.346+0000 7f199b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.346+0000 7f199b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:38256/0 (socket says 172.21.15.8:38256) 2024-03-16T21:00:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.346+0000 7f199b400640 1 -- 172.21.15.8:0/2449262877 learned_addr learned my addr 172.21.15.8:0/2449262877 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.347+0000 7f199be00640 1 --2- 172.21.15.8:0/2449262877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 0x55deea98c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.347+0000 7f199b400640 1 --2- 172.21.15.8:0/2449262877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea995330 0x55deea997720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.347+0000 7f199b400640 1 -- 172.21.15.8:0/2449262877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea995330 msgr2=0x55deea997720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.347+0000 7f199b400640 1 --2- 172.21.15.8:0/2449262877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea995330 0x55deea997720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.347+0000 7f199b400640 1 -- 172.21.15.8:0/2449262877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 msgr2=0x55deea98c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.347+0000 7f199b400640 1 --2- 172.21.15.8:0/2449262877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 0x55deea98c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.347+0000 7f199b400640 1 -- 172.21.15.8:0/2449262877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55deea873b00 con 0x55deea98cb20 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.347+0000 7f199be00640 1 --2- 172.21.15.8:0/2449262877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 0x55deea98c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.347+0000 7f199b400640 1 --2- 172.21.15.8:0/2449262877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98b870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1988013c80 tx=0x7f1988009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a70b02c6eb9d5b0f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.347+0000 7f1998c00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19800a1c40 0x7f19800a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.348+0000 7f1998c00640 1 -- 172.21.15.8:0/2000278720 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f19940ef690 con 0x7f199c1075a0 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.348+0000 7f1991200640 1 -- 172.21.15.8:0/2449262877 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988013d70 con 0x55deea98cb20 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.348+0000 7f1991200640 1 -- 172.21.15.8:0/2449262877 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1988013120 con 0x55deea98cb20 2024-03-16T21:00:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.348+0000 7f1991200640 1 -- 172.21.15.8:0/2449262877 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988003ab0 con 0x55deea98cb20 2024-03-16T21:00:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.348+0000 7f199be00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19800a1c40 0x7f19800a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.348+0000 7f199be00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19800a1c40 0x7f19800a4100 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55deea98d280 tx=0x7f198c010040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.348+0000 7f19a567f740 1 -- 172.21.15.8:0/2449262877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 msgr2=0x55deea98b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.348+0000 7f19a567f740 1 --2- 172.21.15.8:0/2449262877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98b870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1988013c80 tx=0x7f1988009570 comp rx=0 tx=0).stop 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.349+0000 7f19a567f740 1 -- 172.21.15.8:0/2449262877 shutdown_connections 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.349+0000 7f19a567f740 1 --2- 172.21.15.8:0/2449262877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea995330 0x55deea997720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.349+0000 7f19a567f740 1 --2- 172.21.15.8:0/2449262877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 0x55deea98c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.349+0000 7f19a567f740 1 --2- 172.21.15.8:0/2449262877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98b870 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.349+0000 7f19a567f740 1 -- 172.21.15.8:0/2449262877 >> 172.21.15.8:0/2449262877 conn(0x55deea9534b0 msgr2=0x55deea986aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.349+0000 7f19a567f740 1 -- 172.21.15.8:0/2449262877 shutdown_connections 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.349+0000 7f19a567f740 1 -- 172.21.15.8:0/2449262877 wait complete. 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.349+0000 7f19a567f740 1 -- start start 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f19a567f740 1 Processor -- start 2024-03-16T21:00:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f19a567f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 0x55deea9922b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f19a567f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea9927f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f19a567f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea995330 0x55deea992d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f19a567f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea8f25d0 con 0x55deea98bdb0 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f19a567f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea897b50 con 0x55deea98cb20 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f19a567f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea8977f0 con 0x55deea995330 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f19a567f740 10 client.0 _ll_register_callbacks cb 0x55deea8ab550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f199b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea9927f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f199be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 0x55deea9922b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f199b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea9927f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:38264/0 (socket says 172.21.15.8:38264) 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f199b400640 1 -- 172.21.15.8:0/1750267921 learned_addr learned my addr 172.21.15.8:0/1750267921 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.350+0000 7f19a0a00640 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea995330 0x55deea992d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.351+0000 7f199b400640 1 -- 172.21.15.8:0/1750267921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea995330 msgr2=0x55deea992d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.351+0000 7f199b400640 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea995330 0x55deea992d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.351+0000 7f199b400640 1 -- 172.21.15.8:0/1750267921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 msgr2=0x55deea9922b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.351+0000 7f199b400640 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 0x55deea9922b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.351+0000 7f199b400640 1 -- 172.21.15.8:0/1750267921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198801b040 con 0x55deea98cb20 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.351+0000 7f199be00640 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 0x55deea9922b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.351+0000 7f199b400640 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea9927f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1988013380 tx=0x7f1988003730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a50673c2011d793 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.351+0000 7f1985600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.352+0000 7f1985600640 1 -- 172.21.15.8:0/1750267921 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988005240 con 0x55deea98cb20 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.352+0000 7f1985600640 1 -- 172.21.15.8:0/1750267921 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f19880053a0 con 0x55deea98cb20 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.352+0000 7f19a567f740 1 -- 172.21.15.8:0/1750267921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55deea8c4cd0 con 0x55deea98cb20 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.352+0000 7f1985600640 1 -- 172.21.15.8:0/1750267921 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1988005560 con 0x55deea98cb20 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.352+0000 7f19a567f740 10 client.26063 fetch_fsmap learned FSMap version 27 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.352+0000 7f19a567f740 1 -- 172.21.15.8:0/1750267921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55deea8f0c50 con 0x55deea98cb20 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.352+0000 7f1985600640 1 -- 172.21.15.8:0/1750267921 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55deea8c4cd0 con 0x55deea98cb20 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.353+0000 7f1985600640 1 -- 172.21.15.8:0/1750267921 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 27) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f1988020830 con 0x55deea98cb20 2024-03-16T21:00:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.353+0000 7f19a567f740 10 client.26063 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T21:00:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.353+0000 7f19a567f740 10 client.26063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.353+0000 7f19a567f740 20 client.26063 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.353+0000 7f19a567f740 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55deea9a95a0 0x55deea9ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.353+0000 7f19a567f740 4 client.26063 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.353+0000 7f19a567f740 1 -- 172.21.15.8:0/1750267921 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55deea8e8ce0 con 0x55deea9a95a0 2024-03-16T21:00:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.353+0000 7f199be00640 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55deea9a95a0 0x55deea9ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.354+0000 7f199be00640 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55deea9a95a0 0x55deea9ab9c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a27a4b998c29150 server_cookie=1bb01b329ed353cc in_seq=0 out_seq=0 2024-03-16T21:00:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.354+0000 7f1985600640 10 client.26063 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.356+0000 7f1985600640 1 -- 172.21.15.8:0/1750267921 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55deea8e8ce0 con 0x55deea9a95a0 2024-03-16T21:00:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.356+0000 7f1985600640 10 client.26063 handle_command_reply: tid=0 2024-03-16T21:00:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.356+0000 7f19a567f740 1 client.26063 shutdown 2024-03-16T21:00:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.356+0000 7f19a567f740 1 -- 172.21.15.8:0/1750267921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 msgr2=0x55deea9927f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.356+0000 7f19a567f740 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea9927f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1988013380 tx=0x7f1988003730 comp rx=0 tx=0).stop 2024-03-16T21:00:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.357+0000 7f19a567f740 1 -- 172.21.15.8:0/1750267921 shutdown_connections 2024-03-16T21:00:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.357+0000 7f19a567f740 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea995330 0x55deea992d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.357+0000 7f19a567f740 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea9927f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.357+0000 7f19a567f740 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55deea9a95a0 0x55deea9ab9c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.357+0000 7f19a567f740 1 --2- 172.21.15.8:0/1750267921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98bdb0 0x55deea9922b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.357+0000 7f1985600640 0 client.26063 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.357+0000 7f19a567f740 1 -- 172.21.15.8:0/1750267921 >> 172.21.15.8:0/1750267921 conn(0x55deea9534b0 msgr2=0x55deea9887f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.357+0000 7f19a567f740 1 -- 172.21.15.8:0/1750267921 shutdown_connections 2024-03-16T21:00:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.357+0000 7f19a567f740 1 -- 172.21.15.8:0/1750267921 wait complete. 2024-03-16T21:00:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.357+0000 7f19a567f740 20 client.26063 trim_cache size 0 max 16384 2024-03-16T21:00:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.374+0000 7f19a567f740 1 Processor -- start 2024-03-16T21:00:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.374+0000 7f19a567f740 1 -- start start 2024-03-16T21:00:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.374+0000 7f19a567f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea98bdb0 0x55deea9949e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.374+0000 7f19a567f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98cb20 0x55deea992b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.374+0000 7f19a567f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea995330 0x55deea985bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.374+0000 7f19a567f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea63ae60 con 0x55deea98cb20 2024-03-16T21:00:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.374+0000 7f19a567f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea98bc10 con 0x55deea995330 2024-03-16T21:00:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.374+0000 7f19a567f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea982370 con 0x55deea98bdb0 2024-03-16T21:00:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.375+0000 7f19a0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea995330 0x55deea985bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.375+0000 7f199b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98cb20 0x55deea992b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.375+0000 7f19a0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea995330 0x55deea985bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:38278/0 (socket says 172.21.15.8:38278) 2024-03-16T21:00:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.375+0000 7f19a0a00640 1 -- 172.21.15.8:0/2283156124 learned_addr learned my addr 172.21.15.8:0/2283156124 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.375+0000 7f199be00640 1 --2- 172.21.15.8:0/2283156124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea98bdb0 0x55deea9949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.375+0000 7f19a0a00640 1 -- 172.21.15.8:0/2283156124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea98bdb0 msgr2=0x55deea9949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.375+0000 7f19a0a00640 1 --2- 172.21.15.8:0/2283156124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea98bdb0 0x55deea9949e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.375+0000 7f19a0a00640 1 -- 172.21.15.8:0/2283156124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98cb20 msgr2=0x55deea992b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.375+0000 7f19a0a00640 1 --2- 172.21.15.8:0/2283156124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98cb20 0x55deea992b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.375+0000 7f19a0a00640 1 -- 172.21.15.8:0/2283156124 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55deea88d530 con 0x55deea995330 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.375+0000 7f19a0a00640 1 --2- 172.21.15.8:0/2283156124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea995330 0x55deea985bc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1994005820 tx=0x7f19940b8040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd059da783501e97 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.376+0000 7f1987e00640 1 -- 172.21.15.8:0/2283156124 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940bcb00 con 0x55deea995330 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.376+0000 7f1987e00640 1 -- 172.21.15.8:0/2283156124 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f19940bc400 con 0x55deea995330 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.376+0000 7f1987e00640 1 -- 172.21.15.8:0/2283156124 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940bc660 con 0x55deea995330 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.377+0000 7f19a567f740 1 -- 172.21.15.8:0/2283156124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea995330 msgr2=0x55deea985bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.377+0000 7f19a567f740 1 --2- 172.21.15.8:0/2283156124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea995330 0x55deea985bc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1994005820 tx=0x7f19940b8040 comp rx=0 tx=0).stop 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.377+0000 7f19a567f740 1 -- 172.21.15.8:0/2283156124 shutdown_connections 2024-03-16T21:00:10.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.377+0000 7f19a567f740 1 --2- 172.21.15.8:0/2283156124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea995330 0x55deea985bc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.377+0000 7f19a567f740 1 --2- 172.21.15.8:0/2283156124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea98cb20 0x55deea992b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.377+0000 7f19a567f740 1 --2- 172.21.15.8:0/2283156124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea98bdb0 0x55deea9949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.377+0000 7f19a567f740 1 -- 172.21.15.8:0/2283156124 >> 172.21.15.8:0/2283156124 conn(0x55deea9534b0 msgr2=0x55deea9854b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.377+0000 7f19a567f740 1 -- 172.21.15.8:0/2283156124 shutdown_connections 2024-03-16T21:00:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.377+0000 7f19a567f740 1 -- 172.21.15.8:0/2283156124 wait complete. 2024-03-16T21:00:10.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.377+0000 7f19a567f740 1 -- start start 2024-03-16T21:00:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.378+0000 7f19a567f740 1 Processor -- start 2024-03-16T21:00:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.378+0000 7f19a567f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea98bdb0 0x55deea98ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.378+0000 7f19a567f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.378+0000 7f19a567f740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea995330 0x55deea99b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.378+0000 7f19a567f740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea98fb10 con 0x55deea995330 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.378+0000 7f19a567f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea99b700 con 0x55deea98cb20 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.378+0000 7f19a567f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deea99b8c0 con 0x55deea98bdb0 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.378+0000 7f19a567f740 10 client.0 _ll_register_callbacks cb 0x7f1988013770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f199be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea98bdb0 0x55deea98ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f199b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f199b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:38282/0 (socket says 172.21.15.8:38282) 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f199be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea98bdb0 0x55deea98ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38620/0 (socket says 172.21.15.8:38620) 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f199b400640 1 -- 172.21.15.8:0/3070401831 learned_addr learned my addr 172.21.15.8:0/3070401831 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f19a0a00640 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea995330 0x55deea99b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f199b400640 1 -- 172.21.15.8:0/3070401831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea98bdb0 msgr2=0x55deea98ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f199b400640 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea98bdb0 0x55deea98ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f199b400640 1 -- 172.21.15.8:0/3070401831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea995330 msgr2=0x55deea99b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f199b400640 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea995330 0x55deea99b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f199b400640 1 -- 172.21.15.8:0/3070401831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c1a47f0 con 0x55deea98cb20 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f19a0a00640 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea995330 0x55deea99b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f199b400640 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98f460 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1988003700 tx=0x7f1988003690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6e3e2495aaf481 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.379+0000 7f1985600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.380+0000 7f1985600640 1 -- 172.21.15.8:0/3070401831 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988020670 con 0x55deea98cb20 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.380+0000 7f1985600640 1 -- 172.21.15.8:0/3070401831 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1988000e40 con 0x55deea98cb20 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.380+0000 7f19a567f740 1 -- 172.21.15.8:0/3070401831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55deea917d30 con 0x55deea98cb20 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.380+0000 7f1985600640 1 -- 172.21.15.8:0/3070401831 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19880207d0 con 0x55deea98cb20 2024-03-16T21:00:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.380+0000 7f19a567f740 10 client.26069 fetch_fsmap learned FSMap version 27 2024-03-16T21:00:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.380+0000 7f19a567f740 1 -- 172.21.15.8:0/3070401831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55deea8b32c0 con 0x55deea98cb20 2024-03-16T21:00:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.380+0000 7f1985600640 1 -- 172.21.15.8:0/3070401831 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1988043020 con 0x55deea98cb20 2024-03-16T21:00:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.381+0000 7f1985600640 1 -- 172.21.15.8:0/3070401831 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 27) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f198803f610 con 0x55deea98cb20 2024-03-16T21:00:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.381+0000 7f19a567f740 10 client.26069 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T21:00:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.381+0000 7f19a567f740 10 client.26069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.381+0000 7f19a567f740 20 client.26069 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.381+0000 7f19a567f740 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55deeaa09d10 0x55deeaa0c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.381+0000 7f19a567f740 4 client.26069 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T21:00:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.381+0000 7f19a567f740 1 -- 172.21.15.8:0/3070401831 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55deea5f2600 con 0x55deeaa09d10 2024-03-16T21:00:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.381+0000 7f199be00640 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55deeaa09d10 0x55deeaa0c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.382+0000 7f199be00640 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55deeaa09d10 0x55deeaa0c130 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c08db7252db235b2 server_cookie=e149f831f966cc08 in_seq=0 out_seq=0 2024-03-16T21:00:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.382+0000 7f1985600640 10 client.26069 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f1985600640 1 -- 172.21.15.8:0/3070401831 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55deea5f2600 con 0x55deeaa09d10 2024-03-16T21:00:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f1985600640 10 client.26069 handle_command_reply: tid=0 2024-03-16T21:00:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f19a567f740 1 client.26069 shutdown 2024-03-16T21:00:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f19a567f740 1 -- 172.21.15.8:0/3070401831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 msgr2=0x55deea98f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f19a567f740 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98f460 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1988003700 tx=0x7f1988003690 comp rx=0 tx=0).stop 2024-03-16T21:00:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f19a567f740 1 -- 172.21.15.8:0/3070401831 shutdown_connections 2024-03-16T21:00:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f19a567f740 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55deeaa09d10 0x55deeaa0c130 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f19a567f740 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55deea995330 0x55deea99b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f1985600640 0 client.26069 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f19a567f740 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55deea98cb20 0x55deea98f460 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f19a567f740 1 --2- 172.21.15.8:0/3070401831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55deea98bdb0 0x55deea98ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f19a567f740 1 -- 172.21.15.8:0/3070401831 >> 172.21.15.8:0/3070401831 conn(0x55deea9534b0 msgr2=0x55deea985d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.657+0000 7f19a567f740 1 -- 172.21.15.8:0/3070401831 shutdown_connections 2024-03-16T21:00:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.658+0000 7f19a567f740 1 -- 172.21.15.8:0/3070401831 wait complete. 2024-03-16T21:00:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.658+0000 7f19a567f740 20 client.26069 trim_cache size 0 max 16384 2024-03-16T21:00:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T21:00:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T21:00:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T21:00:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T21:00:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.658+0000 7f19a2a00640 1 -- 172.21.15.8:0/2000278720 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19800a1c40 msgr2=0x7f19800a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.659+0000 7f19a2a00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19800a1c40 0x7f19800a4100 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55deea98d280 tx=0x7f198c010040 comp rx=0 tx=0).stop 2024-03-16T21:00:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.659+0000 7f19a2a00640 1 -- 172.21.15.8:0/2000278720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f199c1075a0 msgr2=0x7f199c197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.659+0000 7f19a2a00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f199c1075a0 0x7f199c197900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1994037040 tx=0x7f1994034ef0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.659+0000 7f19a2a00640 1 -- 172.21.15.8:0/2000278720 shutdown_connections 2024-03-16T21:00:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.659+0000 7f19a2a00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19800a1c40 0x7f19800a4100 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.659+0000 7f19a2a00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f199c1075a0 0x7f199c197900 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.659+0000 7f19a2a00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c06a630 0x7f199c19dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.659+0000 7f19a2a00640 1 --2- 172.21.15.8:0/2000278720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f199c069c90 0x7f199c19d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.659+0000 7f19a2a00640 1 -- 172.21.15.8:0/2000278720 >> 172.21.15.8:0/2000278720 conn(0x7f199c0773d0 msgr2=0x7f199c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.659+0000 7f19a2a00640 1 -- 172.21.15.8:0/2000278720 shutdown_connections 2024-03-16T21:00:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:10.659+0000 7f19a2a00640 1 -- 172.21.15.8:0/2000278720 wait complete. 2024-03-16T21:00:10.944 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:10 smithi186 ceph-mon[36391]: pgmap v73: 97 pgs: 97 active+clean; 158 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.8 MiB/s wr, 1.32k op/s 2024-03-16T21:00:10.944 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:10 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:10 smithi008 ceph-mon[31434]: pgmap v73: 97 pgs: 97 active+clean; 158 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.8 MiB/s wr, 1.32k op/s 2024-03-16T21:00:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:10 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:11.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:10 smithi170 ceph-mon[35947]: pgmap v73: 97 pgs: 97 active+clean; 158 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.8 MiB/s wr, 1.32k op/s 2024-03-16T21:00:11.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:10 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:12 smithi008 ceph-mon[31434]: pgmap v74: 97 pgs: 97 active+clean; 166 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.5 MiB/s wr, 1.44k op/s 2024-03-16T21:00:13.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:12 smithi170 ceph-mon[35947]: pgmap v74: 97 pgs: 97 active+clean; 166 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.5 MiB/s wr, 1.44k op/s 2024-03-16T21:00:13.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:12 smithi186 ceph-mon[36391]: pgmap v74: 97 pgs: 97 active+clean; 166 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.5 MiB/s wr, 1.44k op/s 2024-03-16T21:00:13.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:13 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:14.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:13 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:14.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:13 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:14.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:14 smithi008 ceph-mon[31434]: pgmap v75: 97 pgs: 97 active+clean; 166 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 293 op/s 2024-03-16T21:00:15.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:14 smithi170 ceph-mon[35947]: pgmap v75: 97 pgs: 97 active+clean; 166 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 293 op/s 2024-03-16T21:00:15.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:14 smithi186 ceph-mon[36391]: pgmap v75: 97 pgs: 97 active+clean; 166 MiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 293 op/s 2024-03-16T21:00:15.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:15 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:16.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:15 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:16.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:15 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:16.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:16 smithi008 ceph-mon[31434]: pgmap v76: 97 pgs: 97 active+clean; 164 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 335 op/s 2024-03-16T21:00:17.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:16 smithi170 ceph-mon[35947]: pgmap v76: 97 pgs: 97 active+clean; 164 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 335 op/s 2024-03-16T21:00:17.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:16 smithi186 ceph-mon[36391]: pgmap v76: 97 pgs: 97 active+clean; 164 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 335 op/s 2024-03-16T21:00:18.204 INFO:tasks.workunit.client.0.smithi008.stderr:+ tar xf doc.tar 2024-03-16T21:00:18.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:18 smithi008 ceph-mon[31434]: pgmap v77: 97 pgs: 97 active+clean; 159 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 561 op/s 2024-03-16T21:00:19.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:18 smithi170 ceph-mon[35947]: pgmap v77: 97 pgs: 97 active+clean; 159 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 561 op/s 2024-03-16T21:00:19.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:18 smithi186 ceph-mon[36391]: pgmap v77: 97 pgs: 97 active+clean; 159 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 561 op/s 2024-03-16T21:00:20.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:20 smithi008 ceph-mon[31434]: pgmap v78: 97 pgs: 97 active+clean; 159 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 389 op/s 2024-03-16T21:00:21.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:20 smithi170 ceph-mon[35947]: pgmap v78: 97 pgs: 97 active+clean; 159 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 389 op/s 2024-03-16T21:00:21.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:20 smithi186 ceph-mon[36391]: pgmap v78: 97 pgs: 97 active+clean; 159 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 389 op/s 2024-03-16T21:00:21.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:00:21.973 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:00:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.204+0000 7fd96b000640 1 -- 172.21.15.8:0/3012519454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9641015d0 msgr2=0x7fd9641019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.204+0000 7fd96b000640 1 --2- 172.21.15.8:0/3012519454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9641015d0 0x7fd9641019b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd958009930 tx=0x7fd95802bc20 comp rx=0 tx=0).stop 2024-03-16T21:00:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.204+0000 7fd96b000640 1 -- 172.21.15.8:0/3012519454 shutdown_connections 2024-03-16T21:00:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.204+0000 7fd96b000640 1 --2- 172.21.15.8:0/3012519454 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9641066a0 0x7fd96410e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.204+0000 7fd96b000640 1 --2- 172.21.15.8:0/3012519454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd964101f80 0x7fd964105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.204+0000 7fd96b000640 1 --2- 172.21.15.8:0/3012519454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9641015d0 0x7fd9641019b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.204+0000 7fd96b000640 1 -- 172.21.15.8:0/3012519454 >> 172.21.15.8:0/3012519454 conn(0x7fd9640fce90 msgr2=0x7fd9640ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.204+0000 7fd96b000640 1 -- 172.21.15.8:0/3012519454 shutdown_connections 2024-03-16T21:00:22.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.204+0000 7fd96b000640 1 -- 172.21.15.8:0/3012519454 wait complete. 2024-03-16T21:00:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.205+0000 7fd96b000640 1 Processor -- start 2024-03-16T21:00:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.205+0000 7fd96b000640 1 -- start start 2024-03-16T21:00:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.205+0000 7fd96b000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9641015d0 0x7fd9640737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.205+0000 7fd96b000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9641066a0 0x7fd964073d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.205+0000 7fd96b000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964074270 0x7fd9641a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.205+0000 7fd96b000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641a6320 con 0x7fd964074270 2024-03-16T21:00:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.205+0000 7fd96b000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641a6490 con 0x7fd9641066a0 2024-03-16T21:00:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.205+0000 7fd96b000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641a6650 con 0x7fd9641015d0 2024-03-16T21:00:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.206+0000 7fd969c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9641015d0 0x7fd9640737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.206+0000 7fd969200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9641066a0 0x7fd964073d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.206+0000 7fd969c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9641015d0 0x7fd9640737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58962/0 (socket says 172.21.15.8:58962) 2024-03-16T21:00:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.206+0000 7fd969c00640 1 -- 172.21.15.8:0/920466755 learned_addr learned my addr 172.21.15.8:0/920466755 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.206+0000 7fd96a600640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964074270 0x7fd9641a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.206+0000 7fd969c00640 1 -- 172.21.15.8:0/920466755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9641066a0 msgr2=0x7fd964073d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.206+0000 7fd969c00640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9641066a0 0x7fd964073d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.206+0000 7fd969c00640 1 -- 172.21.15.8:0/920466755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964074270 msgr2=0x7fd9641a5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.206+0000 7fd969c00640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964074270 0x7fd9641a5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.206+0000 7fd969c00640 1 -- 172.21.15.8:0/920466755 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd954009490 con 0x7fd9641015d0 2024-03-16T21:00:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.206+0000 7fd969c00640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9641015d0 0x7fd9640737f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd958009230 tx=0x7fd958004c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.207+0000 7fd962000640 1 -- 172.21.15.8:0/920466755 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9580044d0 con 0x7fd9641015d0 2024-03-16T21:00:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.207+0000 7fd962000640 1 -- 172.21.15.8:0/920466755 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd958005310 con 0x7fd9641015d0 2024-03-16T21:00:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.207+0000 7fd96b000640 1 -- 172.21.15.8:0/920466755 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd958009560 con 0x7fd9641015d0 2024-03-16T21:00:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.207+0000 7fd962000640 1 -- 172.21.15.8:0/920466755 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958003e60 con 0x7fd9641015d0 2024-03-16T21:00:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.207+0000 7fd96b000640 1 -- 172.21.15.8:0/920466755 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9641a6bf0 con 0x7fd9641015d0 2024-03-16T21:00:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.210+0000 7fd962000640 1 -- 172.21.15.8:0/920466755 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fd9580035f0 con 0x7fd9641015d0 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.210+0000 7fd96f414740 1 Processor -- start 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.210+0000 7fd96f414740 1 -- start start 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd96f414740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd34fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd96f414740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd350490 0x563fcd350910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd96f414740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd359800 0x563fcd35bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd96f414740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd2bf150 con 0x563fcd359800 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd96f414740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd2bc680 con 0x563fcd351170 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd96f414740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd2b7e60 con 0x563fcd350490 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd96a600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd34fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd96a600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd34fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36218/0 (socket says 172.21.15.8:36218) 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd96a600640 1 -- 172.21.15.8:0/940765246 learned_addr learned my addr 172.21.15.8:0/940765246 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd969c00640 1 --2- 172.21.15.8:0/940765246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd350490 0x563fcd350910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd969200640 1 --2- 172.21.15.8:0/940765246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd359800 0x563fcd35bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd96a600640 1 -- 172.21.15.8:0/940765246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd350490 msgr2=0x563fcd350910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.211+0000 7fd96a600640 1 --2- 172.21.15.8:0/940765246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd350490 0x563fcd350910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.212+0000 7fd96a600640 1 -- 172.21.15.8:0/940765246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd359800 msgr2=0x563fcd35bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.212+0000 7fd96a600640 1 --2- 172.21.15.8:0/940765246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd359800 0x563fcd35bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.212+0000 7fd96a600640 1 -- 172.21.15.8:0/940765246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fcd271060 con 0x563fcd351170 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.212+0000 7fd962000640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd94c0a1ba0 0x7fd94c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.212+0000 7fd962000640 1 -- 172.21.15.8:0/920466755 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd9580ef6f0 con 0x7fd9641015d0 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.212+0000 7fd96a600640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd94c0a1ba0 0x7fd94c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.212+0000 7fd96a600640 1 --2- 172.21.15.8:0/940765246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd34fec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009f70 tx=0x7fd95c010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=693c4bb2462baba4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.212+0000 7fd952a00640 1 -- 172.21.15.8:0/940765246 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c012b30 con 0x563fcd351170 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.213+0000 7fd952a00640 1 -- 172.21.15.8:0/940765246 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd95c01ce30 con 0x563fcd351170 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.213+0000 7fd952a00640 1 -- 172.21.15.8:0/940765246 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c01b370 con 0x563fcd351170 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.213+0000 7fd96f414740 1 -- 172.21.15.8:0/940765246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 msgr2=0x563fcd34fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.213+0000 7fd96a600640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd94c0a1ba0 0x7fd94c0a4060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd95c01f000 tx=0x7fd95c022000 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.213+0000 7fd96f414740 1 --2- 172.21.15.8:0/940765246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd34fec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009f70 tx=0x7fd95c010800 comp rx=0 tx=0).stop 2024-03-16T21:00:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.214+0000 7fd96f414740 1 -- 172.21.15.8:0/940765246 shutdown_connections 2024-03-16T21:00:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.214+0000 7fd96f414740 1 --2- 172.21.15.8:0/940765246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd359800 0x563fcd35bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.214+0000 7fd96f414740 1 --2- 172.21.15.8:0/940765246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd350490 0x563fcd350910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.214+0000 7fd96f414740 1 --2- 172.21.15.8:0/940765246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd34fec0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.214+0000 7fd96f414740 1 -- 172.21.15.8:0/940765246 >> 172.21.15.8:0/940765246 conn(0x563fcd3175a0 msgr2=0x563fcd34aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.214+0000 7fd96f414740 1 -- 172.21.15.8:0/940765246 shutdown_connections 2024-03-16T21:00:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.214+0000 7fd96f414740 1 -- 172.21.15.8:0/940765246 wait complete. 2024-03-16T21:00:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.214+0000 7fd96f414740 1 -- start start 2024-03-16T21:00:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.214+0000 7fd96f414740 1 Processor -- start 2024-03-16T21:00:22.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd96f414740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd350490 0x563fcd3567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd96f414740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd351170 0x563fcd356d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd96f414740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd359800 0x563fcd357240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd96f414740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd25cec0 con 0x563fcd359800 2024-03-16T21:00:22.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd96f414740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd25cb60 con 0x563fcd350490 2024-03-16T21:00:22.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd96f414740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd0261c0 con 0x563fcd351170 2024-03-16T21:00:22.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd96f414740 10 client.0 _ll_register_callbacks cb 0x563fcd270960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:22.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd969c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd350490 0x563fcd3567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd969200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd351170 0x563fcd356d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd969c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd350490 0x563fcd3567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36228/0 (socket says 172.21.15.8:36228) 2024-03-16T21:00:22.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd969200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd351170 0x563fcd356d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58972/0 (socket says 172.21.15.8:58972) 2024-03-16T21:00:22.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd969c00640 1 -- 172.21.15.8:0/2700818193 learned_addr learned my addr 172.21.15.8:0/2700818193 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:22.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.215+0000 7fd96a600640 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd359800 0x563fcd357240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.216+0000 7fd969200640 1 -- 172.21.15.8:0/2700818193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd350490 msgr2=0x563fcd3567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:22.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.216+0000 7fd969200640 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd350490 0x563fcd3567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.216+0000 7fd969200640 1 -- 172.21.15.8:0/2700818193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd359800 msgr2=0x563fcd357240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:22.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.216+0000 7fd969200640 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd359800 0x563fcd357240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.216+0000 7fd969200640 1 -- 172.21.15.8:0/2700818193 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c009bd0 con 0x563fcd351170 2024-03-16T21:00:22.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.216+0000 7fd96a600640 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd359800 0x563fcd357240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:22.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.216+0000 7fd969200640 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd351170 0x563fcd356d00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd954012810 tx=0x7fd954012cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e3eb27c137758f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:22.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.216+0000 7fd947400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:00:22.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.216+0000 7fd947400640 1 -- 172.21.15.8:0/2700818193 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954017070 con 0x563fcd351170 2024-03-16T21:00:22.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.216+0000 7fd947400640 1 -- 172.21.15.8:0/2700818193 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd95400f920 con 0x563fcd351170 2024-03-16T21:00:22.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.216+0000 7fd96f414740 1 -- 172.21.15.8:0/2700818193 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fccfb77e0 con 0x563fcd351170 2024-03-16T21:00:22.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.217+0000 7fd947400640 1 -- 172.21.15.8:0/2700818193 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95400fae0 con 0x563fcd351170 2024-03-16T21:00:22.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.217+0000 7fd96f414740 10 client.26092 fetch_fsmap learned FSMap version 29 2024-03-16T21:00:22.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.217+0000 7fd96f414740 1 -- 172.21.15.8:0/2700818193 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x563fcd2b64e0 con 0x563fcd351170 2024-03-16T21:00:22.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.217+0000 7fd947400640 1 -- 172.21.15.8:0/2700818193 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x563fccfb77e0 con 0x563fcd351170 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.217+0000 7fd947400640 1 -- 172.21.15.8:0/2700818193 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 29) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fd95401c420 con 0x563fcd351170 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.217+0000 7fd96f414740 10 client.26092 fetch_fsmap finished waiting for FSMap version 29 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.217+0000 7fd96f414740 10 client.26092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.217+0000 7fd96f414740 20 client.26092 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.217+0000 7fd96f414740 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563fcd369af0 0x563fcd36bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.217+0000 7fd96f414740 4 client.26092 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.217+0000 7fd96f414740 1 -- 172.21.15.8:0/2700818193 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fccff4720 con 0x563fcd369af0 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.218+0000 7fd969c00640 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563fcd369af0 0x563fcd36bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.218+0000 7fd969c00640 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563fcd369af0 0x563fcd36bf10 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa8e462b3b32d58 server_cookie=a4041cbe83e87fff in_seq=0 out_seq=0 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.218+0000 7fd947400640 10 client.26092 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.219+0000 7fd947400640 1 -- 172.21.15.8:0/2700818193 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563fccff4720 con 0x563fcd369af0 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.219+0000 7fd947400640 10 client.26092 handle_command_reply: tid=0 2024-03-16T21:00:22.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 1 client.26092 shutdown 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 1 -- 172.21.15.8:0/2700818193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd351170 msgr2=0x563fcd356d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd351170 0x563fcd356d00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd954012810 tx=0x7fd954012cd0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 1 -- 172.21.15.8:0/2700818193 shutdown_connections 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563fcd369af0 0x563fcd36bf10 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd359800 0x563fcd357240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd351170 0x563fcd356d00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 1 --2- 172.21.15.8:0/2700818193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd350490 0x563fcd3567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 1 -- 172.21.15.8:0/2700818193 >> 172.21.15.8:0/2700818193 conn(0x563fcd3175a0 msgr2=0x563fcd34cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd947400640 0 client.26092 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 1 -- 172.21.15.8:0/2700818193 shutdown_connections 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 1 -- 172.21.15.8:0/2700818193 wait complete. 2024-03-16T21:00:22.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.220+0000 7fd96f414740 20 client.26092 trim_cache size 0 max 16384 2024-03-16T21:00:22.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd96f414740 1 Processor -- start 2024-03-16T21:00:22.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd96f414740 1 -- start start 2024-03-16T21:00:22.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd96f414740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 0x563fcd358ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd96f414740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd357060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd96f414740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 0x563fcd364c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd96f414740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd35c5a0 con 0x563fcd350490 2024-03-16T21:00:22.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd96f414740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd34f740 con 0x563fcd351170 2024-03-16T21:00:22.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd96f414740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd34a7d0 con 0x563fcd359800 2024-03-16T21:00:22.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd96a600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 0x563fcd364c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd969c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 0x563fcd358ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd969200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd357060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd96a600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 0x563fcd364c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58974/0 (socket says 172.21.15.8:58974) 2024-03-16T21:00:22.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.244+0000 7fd96a600640 1 -- 172.21.15.8:0/3385931596 learned_addr learned my addr 172.21.15.8:0/3385931596 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:22.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.245+0000 7fd969200640 1 -- 172.21.15.8:0/3385931596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 msgr2=0x563fcd364c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.245+0000 7fd969200640 1 --2- 172.21.15.8:0/3385931596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 0x563fcd364c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.245+0000 7fd969200640 1 -- 172.21.15.8:0/3385931596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 msgr2=0x563fcd358ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.245+0000 7fd969200640 1 --2- 172.21.15.8:0/3385931596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 0x563fcd358ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.245+0000 7fd969200640 1 -- 172.21.15.8:0/3385931596 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fcd252950 con 0x563fcd351170 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.245+0000 7fd969200640 1 --2- 172.21.15.8:0/3385931596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd357060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd954001eb0 tx=0x7fd954005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=419d805e90387f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.245+0000 7fd952000640 1 -- 172.21.15.8:0/3385931596 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954017040 con 0x563fcd351170 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.245+0000 7fd952000640 1 -- 172.21.15.8:0/3385931596 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd954005110 con 0x563fcd351170 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.246+0000 7fd952000640 1 -- 172.21.15.8:0/3385931596 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400fd40 con 0x563fcd351170 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.246+0000 7fd96f414740 1 -- 172.21.15.8:0/3385931596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 msgr2=0x563fcd357060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.246+0000 7fd96f414740 1 --2- 172.21.15.8:0/3385931596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd357060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd954001eb0 tx=0x7fd954005db0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.246+0000 7fd96f414740 1 -- 172.21.15.8:0/3385931596 shutdown_connections 2024-03-16T21:00:22.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.246+0000 7fd96f414740 1 --2- 172.21.15.8:0/3385931596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 0x563fcd364c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.246+0000 7fd96f414740 1 --2- 172.21.15.8:0/3385931596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd357060 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.246+0000 7fd96f414740 1 --2- 172.21.15.8:0/3385931596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 0x563fcd358ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.246+0000 7fd96f414740 1 -- 172.21.15.8:0/3385931596 >> 172.21.15.8:0/3385931596 conn(0x563fcd3175a0 msgr2=0x563fcd349f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.246+0000 7fd96f414740 1 -- 172.21.15.8:0/3385931596 shutdown_connections 2024-03-16T21:00:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.246+0000 7fd96f414740 1 -- 172.21.15.8:0/3385931596 wait complete. 2024-03-16T21:00:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.247+0000 7fd96f414740 1 -- start start 2024-03-16T21:00:22.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.247+0000 7fd96f414740 1 Processor -- start 2024-03-16T21:00:22.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.247+0000 7fd96f414740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 0x563fcd3614c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.247+0000 7fd96f414740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd35d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.247+0000 7fd96f414740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 0x563fcd35ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.247+0000 7fd96f414740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd35e4a0 con 0x563fcd350490 2024-03-16T21:00:22.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.247+0000 7fd96f414740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd35e610 con 0x563fcd351170 2024-03-16T21:00:22.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.247+0000 7fd96f414740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcd3c53d0 con 0x563fcd359800 2024-03-16T21:00:22.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.247+0000 7fd96f414740 10 client.0 _ll_register_callbacks cb 0x7fd954012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:22.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd969c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 0x563fcd3614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd96a600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 0x563fcd35ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd969200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd35d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd969c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 0x563fcd3614c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39726/0 (socket says 172.21.15.8:39726) 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd969c00640 1 -- 172.21.15.8:0/1523872933 learned_addr learned my addr 172.21.15.8:0/1523872933 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd96a600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 0x563fcd35ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58982/0 (socket says 172.21.15.8:58982) 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd969200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd35d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36256/0 (socket says 172.21.15.8:36256) 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd96a600640 1 -- 172.21.15.8:0/1523872933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 msgr2=0x563fcd35d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd96a600640 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd35d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd96a600640 1 -- 172.21.15.8:0/1523872933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 msgr2=0x563fcd3614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd96a600640 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 0x563fcd3614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd96a600640 1 -- 172.21.15.8:0/1523872933 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563fcd2b64e0 con 0x563fcd359800 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.248+0000 7fd969c00640 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 0x563fcd3614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.249+0000 7fd96a600640 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 0x563fcd35ddd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x563fcd34a690 tx=0x7fd95c009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37fe5e735a16544 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.249+0000 7fd947400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.249+0000 7fd947400640 1 -- 172.21.15.8:0/1523872933 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c02c040 con 0x563fcd359800 2024-03-16T21:00:22.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.249+0000 7fd947400640 1 -- 172.21.15.8:0/1523872933 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd95c005bd0 con 0x563fcd359800 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.249+0000 7fd96f414740 1 -- 172.21.15.8:0/1523872933 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd95c01ce30 con 0x563fcd359800 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.249+0000 7fd947400640 1 -- 172.21.15.8:0/1523872933 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95c01b370 con 0x563fcd359800 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.249+0000 7fd96f414740 10 client.26098 fetch_fsmap learned FSMap version 29 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.249+0000 7fd96f414740 1 -- 172.21.15.8:0/1523872933 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x563fcd278430 con 0x563fcd359800 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.249+0000 7fd947400640 1 -- 172.21.15.8:0/1523872933 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd95c01ce30 con 0x563fcd359800 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.250+0000 7fd947400640 1 -- 172.21.15.8:0/1523872933 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 29) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fd95c024030 con 0x563fcd359800 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.250+0000 7fd96f414740 10 client.26098 fetch_fsmap finished waiting for FSMap version 29 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.250+0000 7fd96f414740 10 client.26098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.250+0000 7fd96f414740 20 client.26098 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.250+0000 7fd96f414740 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563fcd3c6a30 0x563fcd3c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.250+0000 7fd96f414740 4 client.26098 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.250+0000 7fd96f414740 1 -- 172.21.15.8:0/1523872933 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563fcd043890 con 0x563fcd3c6a30 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.250+0000 7fd969c00640 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563fcd3c6a30 0x563fcd3c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.251+0000 7fd969c00640 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563fcd3c6a30 0x563fcd3c8e50 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=569122b94aba5584 server_cookie=85c6ffc9806c6183 in_seq=0 out_seq=0 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.251+0000 7fd947400640 10 client.26098 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:22.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.251+0000 7fd947400640 1 -- 172.21.15.8:0/1523872933 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563fcd043890 con 0x563fcd3c6a30 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.251+0000 7fd947400640 10 client.26098 handle_command_reply: tid=0 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.251+0000 7fd96f414740 1 client.26098 shutdown 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd96f414740 1 -- 172.21.15.8:0/1523872933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 msgr2=0x563fcd35ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd96f414740 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 0x563fcd35ddd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x563fcd34a690 tx=0x7fd95c009f00 comp rx=0 tx=0).stop 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd96f414740 1 -- 172.21.15.8:0/1523872933 shutdown_connections 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd96f414740 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563fcd359800 0x563fcd35ddd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd96f414740 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fcd351170 0x563fcd35d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd96f414740 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563fcd3c6a30 0x563fcd3c8e50 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd96f414740 1 --2- 172.21.15.8:0/1523872933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fcd350490 0x563fcd3614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd96f414740 1 -- 172.21.15.8:0/1523872933 >> 172.21.15.8:0/1523872933 conn(0x563fcd3175a0 msgr2=0x563fcd34c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd947400640 0 client.26098 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:22.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd96f414740 1 -- 172.21.15.8:0/1523872933 shutdown_connections 2024-03-16T21:00:22.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd96f414740 1 -- 172.21.15.8:0/1523872933 wait complete. 2024-03-16T21:00:22.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.252+0000 7fd96f414740 20 client.26098 trim_cache size 0 max 16384 2024-03-16T21:00:22.261 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:00:22.261 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:00:22.261 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:00:22.261 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:00:22.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 -- 172.21.15.8:0/920466755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd94c0a1ba0 msgr2=0x7fd94c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd94c0a1ba0 0x7fd94c0a4060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd95c01f000 tx=0x7fd95c022000 comp rx=0 tx=0).stop 2024-03-16T21:00:22.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 -- 172.21.15.8:0/920466755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9641015d0 msgr2=0x7fd9640737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9641015d0 0x7fd9640737f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd958009230 tx=0x7fd958004c20 comp rx=0 tx=0).stop 2024-03-16T21:00:22.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 -- 172.21.15.8:0/920466755 shutdown_connections 2024-03-16T21:00:22.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd94c0a1ba0 0x7fd94c0a4060 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964074270 0x7fd9641a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9641066a0 0x7fd964073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 --2- 172.21.15.8:0/920466755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9641015d0 0x7fd9640737f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 -- 172.21.15.8:0/920466755 >> 172.21.15.8:0/920466755 conn(0x7fd9640fce90 msgr2=0x7fd9640ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:22.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 -- 172.21.15.8:0/920466755 shutdown_connections 2024-03-16T21:00:22.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.253+0000 7fd96b000640 1 -- 172.21.15.8:0/920466755 wait complete. 2024-03-16T21:00:22.277 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:00:22.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:00:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.502+0000 7fbec7c00640 1 -- 172.21.15.8:0/3527175893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbec01063f0 msgr2=0x7fbec0069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.502+0000 7fbec7c00640 1 --2- 172.21.15.8:0/3527175893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbec01063f0 0x7fbec0069ac0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009860 tx=0x7fbeb402bb70 comp rx=0 tx=0).stop 2024-03-16T21:00:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.502+0000 7fbec7c00640 1 -- 172.21.15.8:0/3527175893 shutdown_connections 2024-03-16T21:00:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.502+0000 7fbec7c00640 1 --2- 172.21.15.8:0/3527175893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbec006a6e0 0x7fbec0103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.502+0000 7fbec7c00640 1 --2- 172.21.15.8:0/3527175893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec0106860 0x7fbec006a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.502+0000 7fbec7c00640 1 --2- 172.21.15.8:0/3527175893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbec01063f0 0x7fbec0069ac0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.502+0000 7fbec7c00640 1 -- 172.21.15.8:0/3527175893 >> 172.21.15.8:0/3527175893 conn(0x7fbec00773d0 msgr2=0x7fbec00777e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.502+0000 7fbec7c00640 1 -- 172.21.15.8:0/3527175893 shutdown_connections 2024-03-16T21:00:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.502+0000 7fbec7c00640 1 -- 172.21.15.8:0/3527175893 wait complete. 2024-03-16T21:00:22.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.503+0000 7fbec7c00640 1 Processor -- start 2024-03-16T21:00:22.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.503+0000 7fbec7c00640 1 -- start start 2024-03-16T21:00:22.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbec7c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbec01063f0 0x7fbec019e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbec7c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbec0106860 0x7fbec019e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbec7c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec01a2b40 0x7fbec01a2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbec7c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec01a3530 con 0x7fbec01a2b40 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbec7c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec01a36a0 con 0x7fbec01063f0 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbec7c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec01a3810 con 0x7fbec0106860 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbebfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbec0106860 0x7fbec019e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbec5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbec01063f0 0x7fbec019e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbec5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbec01063f0 0x7fbec019e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36280/0 (socket says 172.21.15.8:36280) 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbec5200640 1 -- 172.21.15.8:0/3773473445 learned_addr learned my addr 172.21.15.8:0/3773473445 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbebfe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbec0106860 0x7fbec019e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59008/0 (socket says 172.21.15.8:59008) 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.504+0000 7fbec5c00640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec01a2b40 0x7fbec01a2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbebfe00640 1 -- 172.21.15.8:0/3773473445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbec01063f0 msgr2=0x7fbec019e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbebfe00640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbec01063f0 0x7fbec019e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbebfe00640 1 -- 172.21.15.8:0/3773473445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec01a2b40 msgr2=0x7fbec01a2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbebfe00640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec01a2b40 0x7fbec01a2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbebfe00640 1 -- 172.21.15.8:0/3773473445 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb4009490 con 0x7fbec0106860 2024-03-16T21:00:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbec5200640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbec01063f0 0x7fbec019e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbec5c00640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec01a2b40 0x7fbec01a2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbebfe00640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbec0106860 0x7fbec019e7c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00e9f0 tx=0x7fbeac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbebd600640 1 -- 172.21.15.8:0/3773473445 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac00ccc0 con 0x7fbec0106860 2024-03-16T21:00:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbebd600640 1 -- 172.21.15.8:0/3773473445 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbeac00ce20 con 0x7fbec0106860 2024-03-16T21:00:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbec7c00640 1 -- 172.21.15.8:0/3773473445 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec01aadf0 con 0x7fbec0106860 2024-03-16T21:00:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbebd600640 1 -- 172.21.15.8:0/3773473445 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac0189c0 con 0x7fbec0106860 2024-03-16T21:00:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.505+0000 7fbec7c00640 1 -- 172.21.15.8:0/3773473445 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec01ab260 con 0x7fbec0106860 2024-03-16T21:00:22.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.507+0000 7fbec7c00640 1 -- 172.21.15.8:0/3773473445 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec01009d0 con 0x7fbec0106860 2024-03-16T21:00:22.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.509+0000 7fbebd600640 1 -- 172.21.15.8:0/3773473445 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fbeac018b20 con 0x7fbec0106860 2024-03-16T21:00:22.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.511+0000 7fbebd600640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbea80a1c20 0x7fbea80a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:22.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.511+0000 7fbebd600640 1 -- 172.21.15.8:0/3773473445 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbeac014070 con 0x7fbec0106860 2024-03-16T21:00:22.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.512+0000 7fbec5200640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbea80a1c20 0x7fbea80a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:22.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.512+0000 7fbec5200640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbea80a1c20 0x7fbea80a40e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4005e00 tx=0x7fbeb402e040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:22.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.515+0000 7fbebd600640 1 -- 172.21.15.8:0/3773473445 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fbeac053280 con 0x7fbec0106860 2024-03-16T21:00:22.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.766+0000 7fbec7c00640 1 -- 172.21.15.8:0/3773473445 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbec0068730 con 0x7fbec0106860 2024-03-16T21:00:22.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.767+0000 7fbebd600640 1 -- 172.21.15.8:0/3773473445 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11396 (secure 0 0 0) 0x7fbeac096970 con 0x7fbec0106860 2024-03-16T21:00:22.772 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:00:22.772 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:00:21.828404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:00:22.772 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 30 2024-03-16T21:00:22.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.770+0000 7fbec7c00640 1 -- 172.21.15.8:0/3773473445 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbea80a1c20 msgr2=0x7fbea80a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.770+0000 7fbec7c00640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbea80a1c20 0x7fbea80a40e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4005e00 tx=0x7fbeb402e040 comp rx=0 tx=0).stop 2024-03-16T21:00:22.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.770+0000 7fbec7c00640 1 -- 172.21.15.8:0/3773473445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbec0106860 msgr2=0x7fbec019e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:22.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.770+0000 7fbec7c00640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbec0106860 0x7fbec019e7c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00e9f0 tx=0x7fbeac00eeb0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.770+0000 7fbec7c00640 1 -- 172.21.15.8:0/3773473445 shutdown_connections 2024-03-16T21:00:22.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.770+0000 7fbec7c00640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbea80a1c20 0x7fbea80a40e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.770+0000 7fbec7c00640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbec01a2b40 0x7fbec01a2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.770+0000 7fbec7c00640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbec0106860 0x7fbec019e7c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.770+0000 7fbec7c00640 1 --2- 172.21.15.8:0/3773473445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbec01063f0 0x7fbec019e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:22.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.770+0000 7fbec7c00640 1 -- 172.21.15.8:0/3773473445 >> 172.21.15.8:0/3773473445 conn(0x7fbec00773d0 msgr2=0x7fbec00fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:22.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.771+0000 7fbec7c00640 1 -- 172.21.15.8:0/3773473445 shutdown_connections 2024-03-16T21:00:22.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:22.771+0000 7fbec7c00640 1 -- 172.21.15.8:0/3773473445 wait complete. 2024-03-16T21:00:22.794 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:00:22.795 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:00:22.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:22 smithi008 ceph-mon[31434]: pgmap v79: 97 pgs: 97 active+clean; 169 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 505 op/s 2024-03-16T21:00:23.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.007+0000 7fbf32600640 1 -- 172.21.15.8:0/692840201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf2c103f50 msgr2=0x7fbf2c110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.007+0000 7fbf32600640 1 --2- 172.21.15.8:0/692840201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf2c103f50 0x7fbf2c110410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009ca0 tx=0x7fbf2402c100 comp rx=0 tx=0).stop 2024-03-16T21:00:23.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.007+0000 7fbf32600640 1 -- 172.21.15.8:0/692840201 shutdown_connections 2024-03-16T21:00:23.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.007+0000 7fbf32600640 1 --2- 172.21.15.8:0/692840201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf2c103f50 0x7fbf2c110410 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.007+0000 7fbf32600640 1 --2- 172.21.15.8:0/692840201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf2c103590 0x7fbf2c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.007+0000 7fbf32600640 1 --2- 172.21.15.8:0/692840201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf2c109650 0x7fbf2c109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.007+0000 7fbf32600640 1 -- 172.21.15.8:0/692840201 >> 172.21.15.8:0/692840201 conn(0x7fbf2c0ff000 msgr2=0x7fbf2c101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.007+0000 7fbf32600640 1 -- 172.21.15.8:0/692840201 shutdown_connections 2024-03-16T21:00:23.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.007+0000 7fbf32600640 1 -- 172.21.15.8:0/692840201 wait complete. 2024-03-16T21:00:23.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.008+0000 7fbf32600640 1 Processor -- start 2024-03-16T21:00:23.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.009+0000 7fbf32600640 1 -- start start 2024-03-16T21:00:23.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.009+0000 7fbf32600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf2c103590 0x7fbf2c199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.009+0000 7fbf32600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf2c103f50 0x7fbf2c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.009+0000 7fbf32600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf2c109650 0x7fbf2c19e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.009+0000 7fbf32600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c19ed90 con 0x7fbf2c103f50 2024-03-16T21:00:23.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.009+0000 7fbf32600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c19ef00 con 0x7fbf2c109650 2024-03-16T21:00:23.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.009+0000 7fbf32600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c19f0c0 con 0x7fbf2c103590 2024-03-16T21:00:23.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.009+0000 7fbf2be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf2c103f50 0x7fbf2c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.009+0000 7fbf31c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf2c109650 0x7fbf2c19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.009+0000 7fbf2be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf2c103f50 0x7fbf2c19a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39764/0 (socket says 172.21.15.8:39764) 2024-03-16T21:00:23.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.010+0000 7fbf2be00640 1 -- 172.21.15.8:0/3854874755 learned_addr learned my addr 172.21.15.8:0/3854874755 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.010+0000 7fbf31200640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf2c103590 0x7fbf2c199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.010+0000 7fbf31c00640 1 -- 172.21.15.8:0/3854874755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf2c103590 msgr2=0x7fbf2c199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.010+0000 7fbf31c00640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf2c103590 0x7fbf2c199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.010+0000 7fbf31c00640 1 -- 172.21.15.8:0/3854874755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf2c103f50 msgr2=0x7fbf2c19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.010+0000 7fbf31c00640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf2c103f50 0x7fbf2c19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.010+0000 7fbf31c00640 1 -- 172.21.15.8:0/3854874755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf24009900 con 0x7fbf2c109650 2024-03-16T21:00:23.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.010+0000 7fbf2be00640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf2c103f50 0x7fbf2c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:23.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.010+0000 7fbf31c00640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf2c109650 0x7fbf2c19e790 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009bf0 tx=0x7fbf240329e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.011+0000 7fbf29600640 1 -- 172.21.15.8:0/3854874755 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf24032600 con 0x7fbf2c109650 2024-03-16T21:00:23.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.011+0000 7fbf29600640 1 -- 172.21.15.8:0/3854874755 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbf24003e70 con 0x7fbf2c109650 2024-03-16T21:00:23.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.011+0000 7fbf29600640 1 -- 172.21.15.8:0/3854874755 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf24004770 con 0x7fbf2c109650 2024-03-16T21:00:23.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.011+0000 7fbf32600640 1 -- 172.21.15.8:0/3854874755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c19f340 con 0x7fbf2c109650 2024-03-16T21:00:23.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.011+0000 7fbf32600640 1 -- 172.21.15.8:0/3854874755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c1a6c20 con 0x7fbf2c109650 2024-03-16T21:00:23.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.014+0000 7fbf36a0b740 1 Processor -- start 2024-03-16T21:00:23.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.014+0000 7fbf29600640 1 -- 172.21.15.8:0/3854874755 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fbf2403b040 con 0x7fbf2c109650 2024-03-16T21:00:23.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.015+0000 7fbf36a0b740 1 -- start start 2024-03-16T21:00:23.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.015+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5ae61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.015+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5aeedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.015+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5af16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.015+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a5a54210 con 0x5595a5ae6710 2024-03-16T21:00:23.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.015+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a5a51740 con 0x5595a5ae5df0 2024-03-16T21:00:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.015+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a5a4cf20 con 0x5595a5aef2f0 2024-03-16T21:00:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.015+0000 7fbf31200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5aeedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.015+0000 7fbf2be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5ae61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.015+0000 7fbf2be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5ae61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36304/0 (socket says 172.21.15.8:36304) 2024-03-16T21:00:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.015+0000 7fbf2be00640 1 -- 172.21.15.8:0/3465196568 learned_addr learned my addr 172.21.15.8:0/3465196568 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.016+0000 7fbf2be00640 1 --2- 172.21.15.8:0/3465196568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5af16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.016+0000 7fbf31200640 1 -- 172.21.15.8:0/3465196568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 msgr2=0x5595a5af16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.016+0000 7fbf31200640 1 --2- 172.21.15.8:0/3465196568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5af16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.016+0000 7fbf31200640 1 -- 172.21.15.8:0/3465196568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 msgr2=0x5595a5ae61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.016+0000 7fbf31200640 1 --2- 172.21.15.8:0/3465196568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5ae61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.016+0000 7fbf31200640 1 -- 172.21.15.8:0/3465196568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595a5a0edf0 con 0x5595a5ae6710 2024-03-16T21:00:23.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.016+0000 7fbf31200640 1 --2- 172.21.15.8:0/3465196568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5aeedb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009c20 tx=0x7fbf20011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4511aefe83aa1e83 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.016+0000 7fbf29600640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbf140a1c20 0x7fbf140a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.017+0000 7fbf1e000640 1 -- 172.21.15.8:0/3465196568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20004050 con 0x5595a5ae6710 2024-03-16T21:00:23.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.017+0000 7fbf29600640 1 -- 172.21.15.8:0/3854874755 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbf240eff10 con 0x7fbf2c109650 2024-03-16T21:00:23.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.017+0000 7fbf1e000640 1 -- 172.21.15.8:0/3465196568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbf20005520 con 0x5595a5ae6710 2024-03-16T21:00:23.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.017+0000 7fbf1e000640 1 -- 172.21.15.8:0/3465196568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20004d90 con 0x5595a5ae6710 2024-03-16T21:00:23.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.017+0000 7fbf2be00640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbf140a1c20 0x7fbf140a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.017+0000 7fbf36a0b740 1 -- 172.21.15.8:0/3465196568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 msgr2=0x5595a5aeedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.017+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/3465196568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5aeedb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009c20 tx=0x7fbf20011810 comp rx=0 tx=0).stop 2024-03-16T21:00:23.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.017+0000 7fbf2be00640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbf140a1c20 0x7fbf140a40e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5595a5ae16b0 tx=0x7fbf18005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.017+0000 7fbf36a0b740 1 -- 172.21.15.8:0/3465196568 shutdown_connections 2024-03-16T21:00:23.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.017+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/3465196568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5af16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.017+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/3465196568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5aeedb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.018+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/3465196568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5ae61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.018+0000 7fbf36a0b740 1 -- 172.21.15.8:0/3465196568 >> 172.21.15.8:0/3465196568 conn(0x5595a5ae0520 msgr2=0x5595a5ae0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.018+0000 7fbf36a0b740 1 -- 172.21.15.8:0/3465196568 shutdown_connections 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.018+0000 7fbf36a0b740 1 -- 172.21.15.8:0/3465196568 wait complete. 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.018+0000 7fbf36a0b740 1 -- start start 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.018+0000 7fbf36a0b740 1 Processor -- start 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5ae6710 0x5595a5aec820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5aef2f0 0x5595a5aecd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a59f2150 con 0x5595a5aef2f0 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a59f1df0 con 0x5595a5ae5df0 2024-03-16T21:00:23.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a57bb1c0 con 0x5595a5ae6710 2024-03-16T21:00:23.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf36a0b740 10 client.0 _ll_register_callbacks cb 0x5595a5a412b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:23.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf31200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf31200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aec2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36316/0 (socket says 172.21.15.8:36316) 2024-03-16T21:00:23.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf31200640 1 -- 172.21.15.8:0/4173690547 learned_addr learned my addr 172.21.15.8:0/4173690547 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf31c00640 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5aef2f0 0x5595a5aecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.019+0000 7fbf2be00640 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5ae6710 0x5595a5aec820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.020+0000 7fbf31200640 1 -- 172.21.15.8:0/4173690547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5ae6710 msgr2=0x5595a5aec820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.020+0000 7fbf31200640 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5ae6710 0x5595a5aec820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.020+0000 7fbf31200640 1 -- 172.21.15.8:0/4173690547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5aef2f0 msgr2=0x5595a5aecd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.020+0000 7fbf31200640 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5aef2f0 0x5595a5aecd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.020+0000 7fbf31200640 1 -- 172.21.15.8:0/4173690547 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf20009850 con 0x5595a5ae5df0 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.020+0000 7fbf31200640 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aec2e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbf2001b040 tx=0x7fbf20005690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c089f9a642a8028 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.020+0000 7fbf12a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.020+0000 7fbf12a00640 1 -- 172.21.15.8:0/4173690547 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20004f20 con 0x5595a5ae5df0 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.020+0000 7fbf12a00640 1 -- 172.21.15.8:0/4173690547 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbf200046c0 con 0x5595a5ae5df0 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.020+0000 7fbf36a0b740 1 -- 172.21.15.8:0/4173690547 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595a574c7e0 con 0x5595a5ae5df0 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf12a00640 1 -- 172.21.15.8:0/4173690547 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf20005080 con 0x5595a5ae5df0 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf36a0b740 10 client.26105 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf36a0b740 1 -- 172.21.15.8:0/4173690547 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5595a5a4b5a0 con 0x5595a5ae5df0 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf12a00640 1 -- 172.21.15.8:0/4173690547 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5595a574c7e0 con 0x5595a5ae5df0 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf12a00640 1 -- 172.21.15.8:0/4173690547 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fbf20021040 con 0x5595a5ae5df0 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf36a0b740 10 client.26105 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:23.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf36a0b740 10 client.26105 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf36a0b740 20 client.26105 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5595a5aff2a0 0x5595a5b016c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf36a0b740 4 client.26105 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf36a0b740 1 -- 172.21.15.8:0/4173690547 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595a5789720 con 0x5595a5aff2a0 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.021+0000 7fbf2be00640 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5595a5aff2a0 0x5595a5b016c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.022+0000 7fbf2be00640 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5595a5aff2a0 0x5595a5b016c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33742a6e514b8785 server_cookie=a3c6f6e127db3539 in_seq=0 out_seq=0 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.022+0000 7fbf12a00640 10 client.26105 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf12a00640 1 -- 172.21.15.8:0/4173690547 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5595a5789720 con 0x5595a5aff2a0 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf12a00640 10 client.26105 handle_command_reply: tid=0 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf36a0b740 1 client.26105 shutdown 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf36a0b740 1 -- 172.21.15.8:0/4173690547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 msgr2=0x5595a5aec2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aec2e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbf2001b040 tx=0x7fbf20005690 comp rx=0 tx=0).stop 2024-03-16T21:00:23.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf36a0b740 1 -- 172.21.15.8:0/4173690547 shutdown_connections 2024-03-16T21:00:23.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5595a5aff2a0 0x5595a5b016c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5aef2f0 0x5595a5aecd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5ae6710 0x5595a5aec820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/4173690547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aec2e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf36a0b740 1 -- 172.21.15.8:0/4173690547 >> 172.21.15.8:0/4173690547 conn(0x5595a5ae0520 msgr2=0x5595a5ae2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.023+0000 7fbf12a00640 0 client.26105 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:00:23.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.024+0000 7fbf36a0b740 1 -- 172.21.15.8:0/4173690547 shutdown_connections 2024-03-16T21:00:23.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.024+0000 7fbf36a0b740 1 -- 172.21.15.8:0/4173690547 wait complete. 2024-03-16T21:00:23.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.024+0000 7fbf36a0b740 20 client.26105 trim_cache size 0 max 16384 2024-03-16T21:00:23.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.037+0000 7fbf36a0b740 1 Processor -- start 2024-03-16T21:00:23.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.037+0000 7fbf36a0b740 1 -- start start 2024-03-16T21:00:23.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aeea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5aecb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5afa670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a5b01d70 con 0x5595a5ae6710 2024-03-16T21:00:23.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a5af1ce0 con 0x5595a5ae5df0 2024-03-16T21:00:23.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a5ae1520 con 0x5595a5aef2f0 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf31200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aeea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf31200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aeea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36318/0 (socket says 172.21.15.8:36318) 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf31200640 1 -- 172.21.15.8:0/2740913953 learned_addr learned my addr 172.21.15.8:0/2740913953 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf31c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5afa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf2be00640 1 --2- 172.21.15.8:0/2740913953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5aecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf31200640 1 -- 172.21.15.8:0/2740913953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 msgr2=0x5595a5afa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf31200640 1 --2- 172.21.15.8:0/2740913953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5afa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf31200640 1 -- 172.21.15.8:0/2740913953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 msgr2=0x5595a5aecb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.038+0000 7fbf31200640 1 --2- 172.21.15.8:0/2740913953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5aecb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.039+0000 7fbf31200640 1 -- 172.21.15.8:0/2740913953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595a59e7ab0 con 0x5595a5ae5df0 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.039+0000 7fbf31c00640 1 --2- 172.21.15.8:0/2740913953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5afa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:23.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.039+0000 7fbf31200640 1 --2- 172.21.15.8:0/2740913953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aeea10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbf20000c00 tx=0x7fbf20005b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32eb36f995204826 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.039+0000 7fbf1d600640 1 -- 172.21.15.8:0/2740913953 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20004850 con 0x5595a5ae5df0 2024-03-16T21:00:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.039+0000 7fbf1d600640 1 -- 172.21.15.8:0/2740913953 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbf20023430 con 0x5595a5ae5df0 2024-03-16T21:00:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.039+0000 7fbf1d600640 1 -- 172.21.15.8:0/2740913953 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20023dd0 con 0x5595a5ae5df0 2024-03-16T21:00:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.040+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2740913953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 msgr2=0x5595a5aeea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.040+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/2740913953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aeea10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbf20000c00 tx=0x7fbf20005b90 comp rx=0 tx=0).stop 2024-03-16T21:00:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.040+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2740913953 shutdown_connections 2024-03-16T21:00:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.040+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/2740913953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5afa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.040+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/2740913953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5aecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.040+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/2740913953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5aeea10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.040+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2740913953 >> 172.21.15.8:0/2740913953 conn(0x5595a5ae0520 msgr2=0x5595a5adf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.040+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2740913953 shutdown_connections 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.040+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2740913953 wait complete. 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.040+0000 7fbf36a0b740 1 -- start start 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.040+0000 7fbf36a0b740 1 Processor -- start 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5b53d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5b542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf36a0b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5ae90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a5ae9670 con 0x5595a5ae6710 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a5ae97e0 con 0x5595a5ae5df0 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf36a0b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a5ae99a0 con 0x5595a5aef2f0 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf36a0b740 10 client.0 _ll_register_callbacks cb 0x7fbf18013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:23.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf31200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5b53d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf31200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5b53d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36334/0 (socket says 172.21.15.8:36334) 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf2be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5b542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf31200640 1 -- 172.21.15.8:0/2263912733 learned_addr learned my addr 172.21.15.8:0/2263912733 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.041+0000 7fbf31c00640 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5ae90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf31c00640 1 -- 172.21.15.8:0/2263912733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 msgr2=0x5595a5b53d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf31c00640 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5b53d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf31c00640 1 -- 172.21.15.8:0/2263912733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 msgr2=0x5595a5b542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf31c00640 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5b542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf31c00640 1 -- 172.21.15.8:0/2263912733 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c1a6c20 con 0x5595a5aef2f0 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf2be00640 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5b542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf31c00640 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5ae90b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbf240ed740 tx=0x7fbf240bc640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7351b63c25e11fe0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf12a00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:00:23.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf12a00640 1 -- 172.21.15.8:0/2263912733 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf240c0d70 con 0x5595a5aef2f0 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf12a00640 1 -- 172.21.15.8:0/2263912733 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbf240c53c0 con 0x5595a5aef2f0 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2263912733 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf20005520 con 0x5595a5aef2f0 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf12a00640 1 -- 172.21.15.8:0/2263912733 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf240ed8b0 con 0x5595a5aef2f0 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf36a0b740 10 client.26122 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.042+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2263912733 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5595a5a4b5a0 con 0x5595a5aef2f0 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.043+0000 7fbf12a00640 1 -- 172.21.15.8:0/2263912733 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fbf240db030 con 0x5595a5aef2f0 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.043+0000 7fbf12a00640 1 -- 172.21.15.8:0/2263912733 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fbf240c5050 con 0x5595a5aef2f0 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.043+0000 7fbf36a0b740 10 client.26122 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.043+0000 7fbf36a0b740 10 client.26122 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.043+0000 7fbf36a0b740 20 client.26122 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.043+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5595a5b5bb70 0x5595a5b5df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.043+0000 7fbf36a0b740 4 client.26122 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.043+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2263912733 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5595a57d8890 con 0x5595a5b5bb70 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.043+0000 7fbf31200640 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5595a5b5bb70 0x5595a5b5df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf31200640 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5595a5b5bb70 0x5595a5b5df90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf9972c308185acd server_cookie=1afc60e6f28a951b in_seq=0 out_seq=0 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf12a00640 10 client.26122 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf12a00640 1 -- 172.21.15.8:0/2263912733 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5595a57d8890 con 0x5595a5b5bb70 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf12a00640 10 client.26122 handle_command_reply: tid=0 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf36a0b740 1 client.26122 shutdown 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2263912733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 msgr2=0x5595a5ae90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5ae90b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbf240ed740 tx=0x7fbf240bc640 comp rx=0 tx=0).stop 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2263912733 shutdown_connections 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5595a5b5bb70 0x5595a5b5df90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595a5aef2f0 0x5595a5ae90b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5595a5ae6710 0x5595a5b542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf36a0b740 1 --2- 172.21.15.8:0/2263912733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5595a5ae5df0 0x5595a5b53d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf12a00640 0 client.26122 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2263912733 >> 172.21.15.8:0/2263912733 conn(0x5595a5ae0520 msgr2=0x5595a5ae16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2263912733 shutdown_connections 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.044+0000 7fbf36a0b740 1 -- 172.21.15.8:0/2263912733 wait complete. 2024-03-16T21:00:23.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf36a0b740 20 client.26122 trim_cache size 0 max 16384 2024-03-16T21:00:23.054 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:00:23.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf32600640 1 -- 172.21.15.8:0/3854874755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbf140a1c20 msgr2=0x7fbf140a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf32600640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbf140a1c20 0x7fbf140a40e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5595a5ae16b0 tx=0x7fbf18005f90 comp rx=0 tx=0).stop 2024-03-16T21:00:23.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf32600640 1 -- 172.21.15.8:0/3854874755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf2c109650 msgr2=0x7fbf2c19e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf32600640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf2c109650 0x7fbf2c19e790 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009bf0 tx=0x7fbf240329e0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf32600640 1 -- 172.21.15.8:0/3854874755 shutdown_connections 2024-03-16T21:00:23.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf32600640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fbf140a1c20 0x7fbf140a40e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf32600640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf2c109650 0x7fbf2c19e790 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf32600640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf2c103f50 0x7fbf2c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf32600640 1 --2- 172.21.15.8:0/3854874755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf2c103590 0x7fbf2c199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf32600640 1 -- 172.21.15.8:0/3854874755 >> 172.21.15.8:0/3854874755 conn(0x7fbf2c0ff000 msgr2=0x7fbf2c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.045+0000 7fbf32600640 1 -- 172.21.15.8:0/3854874755 shutdown_connections 2024-03-16T21:00:23.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.046+0000 7fbf32600640 1 -- 172.21.15.8:0/3854874755 wait complete. 2024-03-16T21:00:23.067 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:00:23.067 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:00:23.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:22 smithi170 ceph-mon[35947]: pgmap v79: 97 pgs: 97 active+clean; 169 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 505 op/s 2024-03-16T21:00:23.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:22 smithi186 ceph-mon[36391]: pgmap v79: 97 pgs: 97 active+clean; 169 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 505 op/s 2024-03-16T21:00:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.290+0000 7f9cc5400640 1 -- 172.21.15.8:0/1683176272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cc01074f0 msgr2=0x7f9cc01078d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.290+0000 7f9cc5400640 1 --2- 172.21.15.8:0/1683176272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cc01074f0 0x7f9cc01078d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009860 tx=0x7f9cb002bb70 comp rx=0 tx=0).stop 2024-03-16T21:00:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.290+0000 7f9cc5400640 1 -- 172.21.15.8:0/1683176272 shutdown_connections 2024-03-16T21:00:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.290+0000 7f9cc5400640 1 --2- 172.21.15.8:0/1683176272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc00690b0 0x7f9cc010e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.290+0000 7f9cc5400640 1 --2- 172.21.15.8:0/1683176272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc00686f0 0x7f9cc0068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.290+0000 7f9cc5400640 1 --2- 172.21.15.8:0/1683176272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cc01074f0 0x7f9cc01078d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.290+0000 7f9cc5400640 1 -- 172.21.15.8:0/1683176272 >> 172.21.15.8:0/1683176272 conn(0x7f9cc00774f0 msgr2=0x7f9cc0077900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.291+0000 7f9cc5400640 1 -- 172.21.15.8:0/1683176272 shutdown_connections 2024-03-16T21:00:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.291+0000 7f9cc5400640 1 -- 172.21.15.8:0/1683176272 wait complete. 2024-03-16T21:00:23.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.292+0000 7f9cc5400640 1 Processor -- start 2024-03-16T21:00:23.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.292+0000 7f9cc5400640 1 -- start start 2024-03-16T21:00:23.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cc5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc00686f0 0x7f9cc0199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cc5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc00690b0 0x7f9cc019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cc5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cc01074f0 0x7f9cc019e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cc5400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc019ec20 con 0x7f9cc00686f0 2024-03-16T21:00:23.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cc5400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc019ed90 con 0x7f9cc01074f0 2024-03-16T21:00:23.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cc5400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc019ef50 con 0x7f9cc00690b0 2024-03-16T21:00:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cbe800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc00686f0 0x7f9cc0199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cbe800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc00686f0 0x7f9cc0199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39812/0 (socket says 172.21.15.8:39812) 2024-03-16T21:00:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cbe800640 1 -- 172.21.15.8:0/1582953954 learned_addr learned my addr 172.21.15.8:0/1582953954 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cbde00640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc00690b0 0x7f9cc019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cbf200640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cc01074f0 0x7f9cc019e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cbe800640 1 -- 172.21.15.8:0/1582953954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc00690b0 msgr2=0x7f9cc019a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cbe800640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc00690b0 0x7f9cc019a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cbe800640 1 -- 172.21.15.8:0/1582953954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cc01074f0 msgr2=0x7f9cc019e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.293+0000 7f9cbe800640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cc01074f0 0x7f9cc019e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.294+0000 7f9cbe800640 1 -- 172.21.15.8:0/1582953954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac009560 con 0x7f9cc00686f0 2024-03-16T21:00:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.294+0000 7f9cbe800640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc00686f0 0x7f9cc0199d60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9cb002c0b0 tx=0x7f9cb0034440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.294+0000 7f9cb7400640 1 -- 172.21.15.8:0/1582953954 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0034a40 con 0x7f9cc00686f0 2024-03-16T21:00:23.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.294+0000 7f9cb7400640 1 -- 172.21.15.8:0/1582953954 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9cb002ca10 con 0x7f9cc00686f0 2024-03-16T21:00:23.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.294+0000 7f9cc5400640 1 -- 172.21.15.8:0/1582953954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb0009490 con 0x7f9cc00686f0 2024-03-16T21:00:23.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.294+0000 7f9cb7400640 1 -- 172.21.15.8:0/1582953954 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00035f0 con 0x7f9cc00686f0 2024-03-16T21:00:23.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.295+0000 7f9cc5400640 1 -- 172.21.15.8:0/1582953954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc01a68d0 con 0x7f9cc00686f0 2024-03-16T21:00:23.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.298+0000 7f9cb7400640 1 -- 172.21.15.8:0/1582953954 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f9cb0032740 con 0x7f9cc00686f0 2024-03-16T21:00:23.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.298+0000 7f9cc81d6740 1 Processor -- start 2024-03-16T21:00:23.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cc81d6740 1 -- start start 2024-03-16T21:00:23.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf7560 0x5574ebaffc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebb00140 0x5574ebb02530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574eba65210 con 0x5574ebb00140 2024-03-16T21:00:23.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574eba62740 con 0x5574ebaf6c40 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574eba5df20 con 0x5574ebaf7560 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cbf200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cbf200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36360/0 (socket says 172.21.15.8:36360) 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cbf200640 1 -- 172.21.15.8:0/3400931083 learned_addr learned my addr 172.21.15.8:0/3400931083 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cbde00640 1 --2- 172.21.15.8:0/3400931083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebb00140 0x5574ebb02530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.299+0000 7f9cbe800640 1 --2- 172.21.15.8:0/3400931083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf7560 0x5574ebaffc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.300+0000 7f9cb7400640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9ca40a1ba0 0x7f9ca40a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.300+0000 7f9cbf200640 1 -- 172.21.15.8:0/3400931083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf7560 msgr2=0x5574ebaffc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.300+0000 7f9cbf200640 1 --2- 172.21.15.8:0/3400931083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf7560 0x5574ebaffc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.300+0000 7f9cbf200640 1 -- 172.21.15.8:0/3400931083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebb00140 msgr2=0x5574ebb02530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.300+0000 7f9cbf200640 1 --2- 172.21.15.8:0/3400931083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebb00140 0x5574ebb02530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.300+0000 7f9cbf200640 1 -- 172.21.15.8:0/3400931083 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574eba1fdf0 con 0x5574ebaf6c40 2024-03-16T21:00:23.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.300+0000 7f9cb7400640 1 -- 172.21.15.8:0/1582953954 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9cb00ef850 con 0x7f9cc00686f0 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.300+0000 7f9cbf200640 1 --2- 172.21.15.8:0/3400931083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf7020 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80039f0 tx=0x7f9cb8003df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aaceec0942bdeef server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.300+0000 7f9cbf200640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9ca40a1ba0 0x7f9ca40a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.301+0000 7f9cab400640 1 -- 172.21.15.8:0/3400931083 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8011780 con 0x5574ebaf6c40 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.301+0000 7f9cab400640 1 -- 172.21.15.8:0/3400931083 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9cb801ce00 con 0x5574ebaf6c40 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.301+0000 7f9cab400640 1 -- 172.21.15.8:0/3400931083 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8010d10 con 0x5574ebaf6c40 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.302+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3400931083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 msgr2=0x5574ebaf7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.302+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/3400931083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf7020 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80039f0 tx=0x7f9cb8003df0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.302+0000 7f9cbf200640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9ca40a1ba0 0x7f9ca40a4060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9cb801f000 tx=0x7f9cb8020000 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.302+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3400931083 shutdown_connections 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.302+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/3400931083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebb00140 0x5574ebb02530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.302+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/3400931083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf7560 0x5574ebaffc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.302+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/3400931083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf7020 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.302+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3400931083 >> 172.21.15.8:0/3400931083 conn(0x5574ebaf1370 msgr2=0x5574ebaf1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.302+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3400931083 shutdown_connections 2024-03-16T21:00:23.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.302+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3400931083 wait complete. 2024-03-16T21:00:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.303+0000 7f9cc81d6740 1 -- start start 2024-03-16T21:00:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.303+0000 7f9cc81d6740 1 Processor -- start 2024-03-16T21:00:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.303+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf6c40 0x5574ebafd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebaf7560 0x5574ebafd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebb00140 0x5574ebafdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574eba03150 con 0x5574ebaf7560 2024-03-16T21:00:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574eba02df0 con 0x5574ebb00140 2024-03-16T21:00:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574eb7cc1c0 con 0x5574ebaf6c40 2024-03-16T21:00:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cc81d6740 10 client.0 _ll_register_callbacks cb 0x5574eba522b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:23.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cbe800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf6c40 0x5574ebafd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cbe800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf6c40 0x5574ebafd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59136/0 (socket says 172.21.15.8:59136) 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cbe800640 1 -- 172.21.15.8:0/332524499 learned_addr learned my addr 172.21.15.8:0/332524499 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cbde00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebaf7560 0x5574ebafd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cbf200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebb00140 0x5574ebafdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cbe800640 1 -- 172.21.15.8:0/332524499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebb00140 msgr2=0x5574ebafdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cbe800640 1 --2- 172.21.15.8:0/332524499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebb00140 0x5574ebafdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cbe800640 1 -- 172.21.15.8:0/332524499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebaf7560 msgr2=0x5574ebafd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cbe800640 1 --2- 172.21.15.8:0/332524499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebaf7560 0x5574ebafd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.304+0000 7f9cbe800640 1 -- 172.21.15.8:0/332524499 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb8009c90 con 0x5574ebaf6c40 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.305+0000 7f9cbe800640 1 --2- 172.21.15.8:0/332524499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf6c40 0x5574ebafd1a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00ed0e0 tx=0x7f9cb0005b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28a1f09a1cef077e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.305+0000 7f9c9fe00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.305+0000 7f9c9fe00640 1 -- 172.21.15.8:0/332524499 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00bc0a0 con 0x5574ebaf6c40 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.305+0000 7f9c9fe00640 1 -- 172.21.15.8:0/332524499 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9cb00bcc60 con 0x5574ebaf6c40 2024-03-16T21:00:23.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.305+0000 7f9cc81d6740 1 -- 172.21.15.8:0/332524499 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574eb75d7e0 con 0x5574ebaf6c40 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.305+0000 7f9c9fe00640 1 -- 172.21.15.8:0/332524499 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cb00bbec0 con 0x5574ebaf6c40 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.305+0000 7f9cc81d6740 10 client.26134 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.305+0000 7f9cc81d6740 1 -- 172.21.15.8:0/332524499 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5574eba5c5a0 con 0x5574ebaf6c40 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.305+0000 7f9c9fe00640 1 -- 172.21.15.8:0/332524499 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5574eb75d7e0 con 0x5574ebaf6c40 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.305+0000 7f9c9fe00640 1 -- 172.21.15.8:0/332524499 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f9cb00ed1f0 con 0x5574ebaf6c40 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.306+0000 7f9cc81d6740 10 client.26134 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.306+0000 7f9cc81d6740 10 client.26134 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.306+0000 7f9cc81d6740 20 client.26134 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.306+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/332524499 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5574ebb10100 0x5574ebb12520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.306+0000 7f9cc81d6740 4 client.26134 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.306+0000 7f9cc81d6740 1 -- 172.21.15.8:0/332524499 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574eb79a720 con 0x5574ebb10100 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.306+0000 7f9cbde00640 1 --2- 172.21.15.8:0/332524499 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5574ebb10100 0x5574ebb12520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.306+0000 7f9cbde00640 1 --2- 172.21.15.8:0/332524499 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5574ebb10100 0x5574ebb12520 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f80ef6f1dcb50889 server_cookie=df9300c759e7c5fd in_seq=0 out_seq=0 2024-03-16T21:00:23.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.307+0000 7f9c9fe00640 10 client.26134 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.307+0000 7f9c9fe00640 1 -- 172.21.15.8:0/332524499 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5574eb79a720 con 0x5574ebb10100 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.307+0000 7f9c9fe00640 10 client.26134 handle_command_reply: tid=0 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.307+0000 7f9cc81d6740 1 client.26134 shutdown 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9cc81d6740 1 -- 172.21.15.8:0/332524499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf6c40 msgr2=0x5574ebafd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/332524499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf6c40 0x5574ebafd1a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00ed0e0 tx=0x7f9cb0005b10 comp rx=0 tx=0).stop 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9cc81d6740 1 -- 172.21.15.8:0/332524499 shutdown_connections 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/332524499 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5574ebb10100 0x5574ebb12520 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/332524499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebb00140 0x5574ebafdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/332524499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebaf7560 0x5574ebafd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/332524499 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf6c40 0x5574ebafd1a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9cc81d6740 1 -- 172.21.15.8:0/332524499 >> 172.21.15.8:0/332524499 conn(0x5574ebaf1370 msgr2=0x5574ebaf30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9c9fe00640 0 client.26134 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:00:23.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9cc81d6740 1 -- 172.21.15.8:0/332524499 shutdown_connections 2024-03-16T21:00:23.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9cc81d6740 1 -- 172.21.15.8:0/332524499 wait complete. 2024-03-16T21:00:23.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.308+0000 7f9cc81d6740 20 client.26134 trim_cache size 0 max 16384 2024-03-16T21:00:23.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cc81d6740 1 Processor -- start 2024-03-16T21:00:23.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cc81d6740 1 -- start start 2024-03-16T21:00:23.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf7560 0x5574ebafbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebb00140 0x5574ebafda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574ebaf8020 con 0x5574ebb00140 2024-03-16T21:00:23.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574ebafc010 con 0x5574ebaf6c40 2024-03-16T21:00:23.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574ebaf25a0 con 0x5574ebaf7560 2024-03-16T21:00:23.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cbe800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cbf200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebb00140 0x5574ebafda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cbe800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaff8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36374/0 (socket says 172.21.15.8:36374) 2024-03-16T21:00:23.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cbe800640 1 -- 172.21.15.8:0/1344673717 learned_addr learned my addr 172.21.15.8:0/1344673717 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.322+0000 7f9cbde00640 1 --2- 172.21.15.8:0/1344673717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf7560 0x5574ebafbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.323+0000 7f9cbe800640 1 -- 172.21.15.8:0/1344673717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf7560 msgr2=0x5574ebafbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.323+0000 7f9cbe800640 1 --2- 172.21.15.8:0/1344673717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf7560 0x5574ebafbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.323+0000 7f9cbe800640 1 -- 172.21.15.8:0/1344673717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebb00140 msgr2=0x5574ebafda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.323+0000 7f9cbe800640 1 --2- 172.21.15.8:0/1344673717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebb00140 0x5574ebafda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.323+0000 7f9cbe800640 1 -- 172.21.15.8:0/1344673717 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574eb9f8ab0 con 0x5574ebaf6c40 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.323+0000 7f9cbe800640 1 --2- 172.21.15.8:0/1344673717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaff8d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0000c00 tx=0x7f9cb00b88e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea5eaf4fb3181e05 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.323+0000 7f9caaa00640 1 -- 172.21.15.8:0/1344673717 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00bbec0 con 0x5574ebaf6c40 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.323+0000 7f9caaa00640 1 -- 172.21.15.8:0/1344673717 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9cb00bc0a0 con 0x5574ebaf6c40 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.323+0000 7f9caaa00640 1 -- 172.21.15.8:0/1344673717 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb002cb80 con 0x5574ebaf6c40 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.324+0000 7f9cc81d6740 1 -- 172.21.15.8:0/1344673717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 msgr2=0x5574ebaff8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.324+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/1344673717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaff8d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0000c00 tx=0x7f9cb00b88e0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.324+0000 7f9cc81d6740 1 -- 172.21.15.8:0/1344673717 shutdown_connections 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.324+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/1344673717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebb00140 0x5574ebafda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.324+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/1344673717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebaf7560 0x5574ebafbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.324+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/1344673717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaff8d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.324+0000 7f9cc81d6740 1 -- 172.21.15.8:0/1344673717 >> 172.21.15.8:0/1344673717 conn(0x5574ebaf1370 msgr2=0x5574ebaf3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.324+0000 7f9cc81d6740 1 -- 172.21.15.8:0/1344673717 shutdown_connections 2024-03-16T21:00:23.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.324+0000 7f9cc81d6740 1 -- 172.21.15.8:0/1344673717 wait complete. 2024-03-16T21:00:23.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.325+0000 7f9cc81d6740 1 -- start start 2024-03-16T21:00:23.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.325+0000 7f9cc81d6740 1 Processor -- start 2024-03-16T21:00:23.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.325+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.325+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebaf7560 0x5574ebafa170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.325+0000 7f9cc81d6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebb00140 0x5574ebb6a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.325+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574ebafaa40 con 0x5574ebaf7560 2024-03-16T21:00:23.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.325+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574ebb6af30 con 0x5574ebaf6c40 2024-03-16T21:00:23.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.325+0000 7f9cc81d6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574ebb6b070 con 0x5574ebb00140 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.325+0000 7f9cc81d6740 10 client.0 _ll_register_callbacks cb 0x7f9cb00097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.325+0000 7f9cbe800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cbde00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebaf7560 0x5574ebafa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cbe800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36390/0 (socket says 172.21.15.8:36390) 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cbf200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebb00140 0x5574ebb6a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cbe800640 1 -- 172.21.15.8:0/3585797944 learned_addr learned my addr 172.21.15.8:0/3585797944 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cbe800640 1 -- 172.21.15.8:0/3585797944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebb00140 msgr2=0x5574ebb6a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cbe800640 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebb00140 0x5574ebb6a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cbe800640 1 -- 172.21.15.8:0/3585797944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebaf7560 msgr2=0x5574ebafa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cbe800640 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebaf7560 0x5574ebafa170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cbe800640 1 -- 172.21.15.8:0/3585797944 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574eba5c5a0 con 0x5574ebaf6c40 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cbde00640 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebaf7560 0x5574ebafa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cbe800640 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf9c30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00bc210 tx=0x7f9cb00c4d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56969fc81b4ee73a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9c9fe00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:23.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9c9fe00640 1 -- 172.21.15.8:0/3585797944 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00bc9c0 con 0x5574ebaf6c40 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9c9fe00640 1 -- 172.21.15.8:0/3585797944 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9cb00bcc60 con 0x5574ebaf6c40 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.326+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3585797944 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9cb801ce00 con 0x5574ebaf6c40 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9c9fe00640 1 -- 172.21.15.8:0/3585797944 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cb00bbec0 con 0x5574ebaf6c40 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9cc81d6740 10 client.26129 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3585797944 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5574eba1e650 con 0x5574ebaf6c40 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9c9fe00640 1 -- 172.21.15.8:0/3585797944 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9cb801ce00 con 0x5574ebaf6c40 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9c9fe00640 1 -- 172.21.15.8:0/3585797944 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f9cb00bb9b0 con 0x5574ebaf6c40 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9cc81d6740 10 client.26129 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9cc81d6740 10 client.26129 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9cc81d6740 20 client.26129 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5574ebb6c250 0x5574ebb6e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9cc81d6740 4 client.26129 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:00:23.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3585797944 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5574eb7e9890 con 0x5574ebb6c250 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.327+0000 7f9cbde00640 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5574ebb6c250 0x5574ebb6e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.328+0000 7f9cbde00640 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5574ebb6c250 0x5574ebb6e640 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e532922d2172de0 server_cookie=7343a6036f8385fd in_seq=0 out_seq=0 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.328+0000 7f9c9fe00640 10 client.26129 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.328+0000 7f9c9fe00640 1 -- 172.21.15.8:0/3585797944 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5574eb7e9890 con 0x5574ebb6c250 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.328+0000 7f9c9fe00640 10 client.26129 handle_command_reply: tid=0 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.328+0000 7f9cc81d6740 1 client.26129 shutdown 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3585797944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 msgr2=0x5574ebaf9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf9c30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00bc210 tx=0x7f9cb00c4d00 comp rx=0 tx=0).stop 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3585797944 shutdown_connections 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5574ebb6c250 0x5574ebb6e640 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5574ebb00140 0x5574ebb6a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5574ebaf7560 0x5574ebafa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9cc81d6740 1 --2- 172.21.15.8:0/3585797944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5574ebaf6c40 0x5574ebaf9c30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3585797944 >> 172.21.15.8:0/3585797944 conn(0x5574ebaf1370 msgr2=0x5574ebaf0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9c9fe00640 0 client.26129 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:00:23.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3585797944 shutdown_connections 2024-03-16T21:00:23.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9cc81d6740 1 -- 172.21.15.8:0/3585797944 wait complete. 2024-03-16T21:00:23.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.329+0000 7f9cc81d6740 20 client.26129 trim_cache size 0 max 16384 2024-03-16T21:00:23.338 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:00:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 -- 172.21.15.8:0/1582953954 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9ca40a1ba0 msgr2=0x7f9ca40a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9ca40a1ba0 0x7f9ca40a4060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9cb801f000 tx=0x7f9cb8020000 comp rx=0 tx=0).stop 2024-03-16T21:00:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 -- 172.21.15.8:0/1582953954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc00686f0 msgr2=0x7f9cc0199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc00686f0 0x7f9cc0199d60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9cb002c0b0 tx=0x7f9cb0034440 comp rx=0 tx=0).stop 2024-03-16T21:00:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 -- 172.21.15.8:0/1582953954 shutdown_connections 2024-03-16T21:00:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9ca40a1ba0 0x7f9ca40a4060 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9cc01074f0 0x7f9cc019e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc00690b0 0x7f9cc019a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 --2- 172.21.15.8:0/1582953954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc00686f0 0x7f9cc0199d60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 -- 172.21.15.8:0/1582953954 >> 172.21.15.8:0/1582953954 conn(0x7f9cc00774f0 msgr2=0x7f9cc010c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 -- 172.21.15.8:0/1582953954 shutdown_connections 2024-03-16T21:00:23.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.330+0000 7f9cc5400640 1 -- 172.21.15.8:0/1582953954 wait complete. 2024-03-16T21:00:23.354 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:00:23.354 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:00:23.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.572+0000 7fdf71c00640 1 -- 172.21.15.8:0/2193972773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf6c102520 msgr2=0x7fdf6c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.572+0000 7fdf71c00640 1 --2- 172.21.15.8:0/2193972773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf6c102520 0x7fdf6c102900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009900 tx=0x7fdf5c02bcd0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.572+0000 7fdf71c00640 1 -- 172.21.15.8:0/2193972773 shutdown_connections 2024-03-16T21:00:23.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.572+0000 7fdf71c00640 1 --2- 172.21.15.8:0/2193972773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf6c10b940 0x7fdf6c10dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.572+0000 7fdf71c00640 1 --2- 172.21.15.8:0/2193972773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf6c102e40 0x7fdf6c10b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.572+0000 7fdf71c00640 1 --2- 172.21.15.8:0/2193972773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf6c102520 0x7fdf6c102900 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.572+0000 7fdf71c00640 1 -- 172.21.15.8:0/2193972773 >> 172.21.15.8:0/2193972773 conn(0x7fdf6c0fbd40 msgr2=0x7fdf6c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.572+0000 7fdf71c00640 1 -- 172.21.15.8:0/2193972773 shutdown_connections 2024-03-16T21:00:23.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.572+0000 7fdf71c00640 1 -- 172.21.15.8:0/2193972773 wait complete. 2024-03-16T21:00:23.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.573+0000 7fdf71c00640 1 Processor -- start 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.573+0000 7fdf71c00640 1 -- start start 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.573+0000 7fdf71c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf6c102520 0x7fdf6c19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.573+0000 7fdf71c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf6c102e40 0x7fdf6c19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.573+0000 7fdf71c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf6c10b940 0x7fdf6c199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.573+0000 7fdf71c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c19a0c0 con 0x7fdf6c102520 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.573+0000 7fdf71c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c19a230 con 0x7fdf6c102e40 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.573+0000 7fdf71c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c19a3f0 con 0x7fdf6c10b940 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf6be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf6c102520 0x7fdf6c19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf6b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf6c102e40 0x7fdf6c19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf6b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf6c102e40 0x7fdf6c19fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36406/0 (socket says 172.21.15.8:36406) 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf71200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf6c10b940 0x7fdf6c199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf6b400640 1 -- 172.21.15.8:0/1494038016 learned_addr learned my addr 172.21.15.8:0/1494038016 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf71200640 1 -- 172.21.15.8:0/1494038016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf6c102e40 msgr2=0x7fdf6c19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf71200640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf6c102e40 0x7fdf6c19fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf71200640 1 -- 172.21.15.8:0/1494038016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf6c102520 msgr2=0x7fdf6c19f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf71200640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf6c102520 0x7fdf6c19f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf71200640 1 -- 172.21.15.8:0/1494038016 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf64009840 con 0x7fdf6c10b940 2024-03-16T21:00:23.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf6b400640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf6c102e40 0x7fdf6c19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:23.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.574+0000 7fdf71200640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf6c10b940 0x7fdf6c199a70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400ec50 tx=0x7fdf6400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.575+0000 7fdf68c00640 1 -- 172.21.15.8:0/1494038016 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64003b70 con 0x7fdf6c10b940 2024-03-16T21:00:23.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.575+0000 7fdf68c00640 1 -- 172.21.15.8:0/1494038016 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fdf6400ce70 con 0x7fdf6c10b940 2024-03-16T21:00:23.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.575+0000 7fdf68c00640 1 -- 172.21.15.8:0/1494038016 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64010810 con 0x7fdf6c10b940 2024-03-16T21:00:23.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.575+0000 7fdf71c00640 1 -- 172.21.15.8:0/1494038016 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c009560 con 0x7fdf6c10b940 2024-03-16T21:00:23.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.575+0000 7fdf71c00640 1 -- 172.21.15.8:0/1494038016 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c1a6780 con 0x7fdf6c10b940 2024-03-16T21:00:23.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.578+0000 7fdf68c00640 1 -- 172.21.15.8:0/1494038016 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fdf64004020 con 0x7fdf6c10b940 2024-03-16T21:00:23.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.578+0000 7fdf75e7e740 1 Processor -- start 2024-03-16T21:00:23.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.579+0000 7fdf75e7e740 1 -- start start 2024-03-16T21:00:23.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.579+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e1df0 0x560d878e21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.579+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e2710 0x560d878eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.579+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.579+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d87850210 con 0x560d878e1df0 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.579+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8784d740 con 0x560d878eb2f0 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.579+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d87848f20 con 0x560d878e2710 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.579+0000 7fdf6be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e2710 0x560d878eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf6b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e1df0 0x560d878e21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf6be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e2710 0x560d878eadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59186/0 (socket says 172.21.15.8:59186) 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf6be00640 1 -- 172.21.15.8:0/2731991024 learned_addr learned my addr 172.21.15.8:0/2731991024 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf6b400640 1 --2- 172.21.15.8:0/2731991024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf6be00640 1 -- 172.21.15.8:0/2731991024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 msgr2=0x560d878ed6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf6be00640 1 --2- 172.21.15.8:0/2731991024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878ed6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf6be00640 1 -- 172.21.15.8:0/2731991024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e1df0 msgr2=0x560d878e21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf6be00640 1 --2- 172.21.15.8:0/2731991024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e1df0 0x560d878e21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf6be00640 1 -- 172.21.15.8:0/2731991024 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d8780adf0 con 0x560d878e2710 2024-03-16T21:00:23.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf6b400640 1 --2- 172.21.15.8:0/2731991024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e1df0 0x560d878e21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:23.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf68c00640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdf500a1c20 0x7fdf500a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf6be00640 1 --2- 172.21.15.8:0/2731991024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e2710 0x560d878eadb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009230 tx=0x7fdf5c02c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=808d12455922a4c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.580+0000 7fdf68c00640 1 -- 172.21.15.8:0/1494038016 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdf64014070 con 0x7fdf6c10b940 2024-03-16T21:00:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.581+0000 7fdf6b400640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdf500a1c20 0x7fdf500a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.581+0000 7fdf61600640 1 -- 172.21.15.8:0/2731991024 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c0046c0 con 0x560d878e2710 2024-03-16T21:00:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.581+0000 7fdf61600640 1 -- 172.21.15.8:0/2731991024 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fdf5c004820 con 0x560d878e2710 2024-03-16T21:00:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.581+0000 7fdf61600640 1 -- 172.21.15.8:0/2731991024 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c005070 con 0x560d878e2710 2024-03-16T21:00:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2731991024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e2710 msgr2=0x560d878eadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/2731991024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e2710 0x560d878eadb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009230 tx=0x7fdf5c02c670 comp rx=0 tx=0).stop 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf6b400640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdf500a1c20 0x7fdf500a40e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009740 tx=0x7fdf58009550 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2731991024 shutdown_connections 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/2731991024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/2731991024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e2710 0x560d878eadb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/2731991024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e1df0 0x560d878e21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2731991024 >> 172.21.15.8:0/2731991024 conn(0x560d878dc520 msgr2=0x560d878dc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2731991024 shutdown_connections 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2731991024 wait complete. 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf75e7e740 1 -- start start 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.582+0000 7fdf75e7e740 1 Processor -- start 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878e8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878e8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d877ee150 con 0x560d878e2710 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d877eddf0 con 0x560d878eb2f0 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d875b71c0 con 0x560d878e1df0 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf75e7e740 10 client.0 _ll_register_callbacks cb 0x560d8783d2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf6be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf71200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878e8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf6be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59190/0 (socket says 172.21.15.8:59190) 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf6be00640 1 -- 172.21.15.8:0/2984630385 learned_addr learned my addr 172.21.15.8:0/2984630385 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.583+0000 7fdf6b400640 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.584+0000 7fdf6be00640 1 -- 172.21.15.8:0/2984630385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 msgr2=0x560d878e8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.584+0000 7fdf6be00640 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878e8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.584+0000 7fdf6be00640 1 -- 172.21.15.8:0/2984630385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 msgr2=0x560d878e8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.584+0000 7fdf6be00640 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878e8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.584+0000 7fdf6be00640 1 -- 172.21.15.8:0/2984630385 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c10ea60 con 0x560d878e1df0 2024-03-16T21:00:23.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.584+0000 7fdf6be00640 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8310 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c02c210 tx=0x7fdf5c005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af99d563faac9c38 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.584+0000 7fdf56000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:00:23.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.584+0000 7fdf56000640 1 -- 172.21.15.8:0/2984630385 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c0046c0 con 0x560d878e1df0 2024-03-16T21:00:23.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.584+0000 7fdf56000640 1 -- 172.21.15.8:0/2984630385 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdf5c005220 con 0x560d878e1df0 2024-03-16T21:00:23.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.584+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2984630385 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d875487e0 con 0x560d878e1df0 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.584+0000 7fdf56000640 1 -- 172.21.15.8:0/2984630385 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf5c0053e0 con 0x560d878e1df0 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.585+0000 7fdf75e7e740 10 client.26152 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.585+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2984630385 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560d878475a0 con 0x560d878e1df0 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.585+0000 7fdf56000640 1 -- 172.21.15.8:0/2984630385 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x560d875487e0 con 0x560d878e1df0 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.585+0000 7fdf56000640 1 -- 172.21.15.8:0/2984630385 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fdf5c052070 con 0x560d878e1df0 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.585+0000 7fdf75e7e740 10 client.26152 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.585+0000 7fdf75e7e740 10 client.26152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.585+0000 7fdf75e7e740 20 client.26152 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.585+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560d878faf30 0x560d878fd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.585+0000 7fdf75e7e740 4 client.26152 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.585+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2984630385 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d87585720 con 0x560d878faf30 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.586+0000 7fdf6b400640 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560d878faf30 0x560d878fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.586+0000 7fdf6b400640 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560d878faf30 0x560d878fd350 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=162dbb9fd03b74a7 server_cookie=616c1ef47d19bc5a in_seq=0 out_seq=0 2024-03-16T21:00:23.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.586+0000 7fdf56000640 10 client.26152 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:23.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf56000640 1 -- 172.21.15.8:0/2984630385 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560d87585720 con 0x560d878faf30 2024-03-16T21:00:23.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf56000640 10 client.26152 handle_command_reply: tid=0 2024-03-16T21:00:23.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf75e7e740 1 client.26152 shutdown 2024-03-16T21:00:23.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2984630385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 msgr2=0x560d878e8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8310 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c02c210 tx=0x7fdf5c005850 comp rx=0 tx=0).stop 2024-03-16T21:00:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2984630385 shutdown_connections 2024-03-16T21:00:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878e8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560d878faf30 0x560d878fd350 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878e8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/2984630385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8310 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf56000640 0 client.26152 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2984630385 >> 172.21.15.8:0/2984630385 conn(0x560d878dc520 msgr2=0x560d878de270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.588+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2984630385 shutdown_connections 2024-03-16T21:00:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.589+0000 7fdf75e7e740 1 -- 172.21.15.8:0/2984630385 wait complete. 2024-03-16T21:00:23.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.589+0000 7fdf75e7e740 20 client.26152 trim_cache size 0 max 16384 2024-03-16T21:00:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.602+0000 7fdf75e7e740 1 Processor -- start 2024-03-16T21:00:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf75e7e740 1 -- start start 2024-03-16T21:00:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878dde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d875487e0 con 0x560d878e2710 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d878dd520 con 0x560d878eb2f0 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d878ed6e0 con 0x560d878e1df0 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf6be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf6be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59200/0 (socket says 172.21.15.8:59200) 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf6be00640 1 -- 172.21.15.8:0/4126090185 learned_addr learned my addr 172.21.15.8:0/4126090185 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf71200640 1 --2- 172.21.15.8:0/4126090185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf6b400640 1 --2- 172.21.15.8:0/4126090185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878dde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf6be00640 1 -- 172.21.15.8:0/4126090185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 msgr2=0x560d878de3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.603+0000 7fdf6be00640 1 --2- 172.21.15.8:0/4126090185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878de3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.604+0000 7fdf6be00640 1 -- 172.21.15.8:0/4126090185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 msgr2=0x560d878dde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.604+0000 7fdf6be00640 1 --2- 172.21.15.8:0/4126090185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878dde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.604+0000 7fdf6be00640 1 -- 172.21.15.8:0/4126090185 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d877e3ab0 con 0x560d878e1df0 2024-03-16T21:00:23.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.604+0000 7fdf6b400640 1 --2- 172.21.15.8:0/4126090185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878dde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:23.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.604+0000 7fdf6be00640 1 --2- 172.21.15.8:0/4126090185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8bb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c02c8e0 tx=0x7fdf5c004500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b05ff77a9763fb04 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.604+0000 7fdf60c00640 1 -- 172.21.15.8:0/4126090185 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c0046c0 con 0x560d878e1df0 2024-03-16T21:00:23.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.604+0000 7fdf60c00640 1 -- 172.21.15.8:0/4126090185 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fdf5c04e070 con 0x560d878e1df0 2024-03-16T21:00:23.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.604+0000 7fdf60c00640 1 -- 172.21.15.8:0/4126090185 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c0548f0 con 0x560d878e1df0 2024-03-16T21:00:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.605+0000 7fdf75e7e740 1 -- 172.21.15.8:0/4126090185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 msgr2=0x560d878e8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.605+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/4126090185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8bb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c02c8e0 tx=0x7fdf5c004500 comp rx=0 tx=0).stop 2024-03-16T21:00:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.605+0000 7fdf75e7e740 1 -- 172.21.15.8:0/4126090185 shutdown_connections 2024-03-16T21:00:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.605+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/4126090185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d878de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.605+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/4126090185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878dde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.605+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/4126090185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e8bb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.605+0000 7fdf75e7e740 1 -- 172.21.15.8:0/4126090185 >> 172.21.15.8:0/4126090185 conn(0x560d878dc520 msgr2=0x560d878dd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.605+0000 7fdf75e7e740 1 -- 172.21.15.8:0/4126090185 shutdown_connections 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.605+0000 7fdf75e7e740 1 -- 172.21.15.8:0/4126090185 wait complete. 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.605+0000 7fdf75e7e740 1 -- start start 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf75e7e740 1 Processor -- start 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878e5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf75e7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d87955800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d878e5c30 con 0x560d878e2710 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d87955d40 con 0x560d878eb2f0 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf75e7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d87955e80 con 0x560d878e1df0 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf75e7e740 10 client.0 _ll_register_callbacks cb 0x7fdf5c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf6b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf71200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d87955800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf6be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf71200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d87955800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36448/0 (socket says 172.21.15.8:36448) 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.606+0000 7fdf71200640 1 -- 172.21.15.8:0/186049469 learned_addr learned my addr 172.21.15.8:0/186049469 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf71200640 1 -- 172.21.15.8:0/186049469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 msgr2=0x560d878e4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf71200640 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf71200640 1 -- 172.21.15.8:0/186049469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 msgr2=0x560d878e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf71200640 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf71200640 1 -- 172.21.15.8:0/186049469 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d878475a0 con 0x560d878eb2f0 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf6be00640 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf71200640 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d87955800 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdf64097480 tx=0x7fdf6409a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=372d3f5e1a822711 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf56000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf56000640 1 -- 172.21.15.8:0/186049469 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640b7070 con 0x560d878eb2f0 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf56000640 1 -- 172.21.15.8:0/186049469 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdf6409ec00 con 0x560d878eb2f0 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf75e7e740 1 -- 172.21.15.8:0/186049469 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf5c004820 con 0x560d878eb2f0 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.607+0000 7fdf56000640 1 -- 172.21.15.8:0/186049469 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf640cba60 con 0x560d878eb2f0 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.608+0000 7fdf75e7e740 10 client.26147 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.608+0000 7fdf75e7e740 1 -- 172.21.15.8:0/186049469 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560d87809650 con 0x560d878eb2f0 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.608+0000 7fdf56000640 1 -- 172.21.15.8:0/186049469 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fdf5c004820 con 0x560d878eb2f0 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.608+0000 7fdf56000640 1 -- 172.21.15.8:0/186049469 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fdf640cbd20 con 0x560d878eb2f0 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.608+0000 7fdf75e7e740 10 client.26147 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.608+0000 7fdf75e7e740 10 client.26147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.608+0000 7fdf75e7e740 20 client.26147 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.608+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560d879575f0 0x560d87959a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.608+0000 7fdf75e7e740 4 client.26147 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:00:23.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.608+0000 7fdf75e7e740 1 -- 172.21.15.8:0/186049469 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560d875d4890 con 0x560d879575f0 2024-03-16T21:00:23.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.608+0000 7fdf6be00640 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560d879575f0 0x560d87959a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.609+0000 7fdf6be00640 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560d879575f0 0x560d87959a10 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5083ee0cc93c1b server_cookie=45a216b9127c8a80 in_seq=0 out_seq=0 2024-03-16T21:00:23.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.609+0000 7fdf56000640 10 client.26147 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf56000640 1 -- 172.21.15.8:0/186049469 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560d875d4890 con 0x560d879575f0 2024-03-16T21:00:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf56000640 10 client.26147 handle_command_reply: tid=0 2024-03-16T21:00:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf75e7e740 1 client.26147 shutdown 2024-03-16T21:00:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf75e7e740 1 -- 172.21.15.8:0/186049469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 msgr2=0x560d87955800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d87955800 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdf64097480 tx=0x7fdf6409a410 comp rx=0 tx=0).stop 2024-03-16T21:00:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf75e7e740 1 -- 172.21.15.8:0/186049469 shutdown_connections 2024-03-16T21:00:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560d878eb2f0 0x560d87955800 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560d879575f0 0x560d87959a10 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560d878e2710 0x560d878e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf75e7e740 1 --2- 172.21.15.8:0/186049469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d878e1df0 0x560d878e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf75e7e740 1 -- 172.21.15.8:0/186049469 >> 172.21.15.8:0/186049469 conn(0x560d878dc520 msgr2=0x560d878dd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.610+0000 7fdf56000640 0 client.26147 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:23.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.611+0000 7fdf75e7e740 1 -- 172.21.15.8:0/186049469 shutdown_connections 2024-03-16T21:00:23.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.611+0000 7fdf75e7e740 1 -- 172.21.15.8:0/186049469 wait complete. 2024-03-16T21:00:23.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.611+0000 7fdf75e7e740 20 client.26147 trim_cache size 0 max 16384 2024-03-16T21:00:23.619 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:00:23.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.611+0000 7fdf71c00640 1 -- 172.21.15.8:0/1494038016 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdf500a1c20 msgr2=0x7fdf500a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.611+0000 7fdf71c00640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdf500a1c20 0x7fdf500a40e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009740 tx=0x7fdf58009550 comp rx=0 tx=0).stop 2024-03-16T21:00:23.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.611+0000 7fdf71c00640 1 -- 172.21.15.8:0/1494038016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf6c10b940 msgr2=0x7fdf6c199a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.611+0000 7fdf71c00640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf6c10b940 0x7fdf6c199a70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400ec50 tx=0x7fdf6400c6a0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.612+0000 7fdf71c00640 1 -- 172.21.15.8:0/1494038016 shutdown_connections 2024-03-16T21:00:23.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.612+0000 7fdf71c00640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdf500a1c20 0x7fdf500a40e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.612+0000 7fdf71c00640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf6c10b940 0x7fdf6c199a70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.612+0000 7fdf71c00640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf6c102e40 0x7fdf6c19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.612+0000 7fdf71c00640 1 --2- 172.21.15.8:0/1494038016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf6c102520 0x7fdf6c19f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.612+0000 7fdf71c00640 1 -- 172.21.15.8:0/1494038016 >> 172.21.15.8:0/1494038016 conn(0x7fdf6c0fbd40 msgr2=0x7fdf6c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.612+0000 7fdf71c00640 1 -- 172.21.15.8:0/1494038016 shutdown_connections 2024-03-16T21:00:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:23.612+0000 7fdf71c00640 1 -- 172.21.15.8:0/1494038016 wait complete. 2024-03-16T21:00:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.806+0000 7f80be200640 1 -- 172.21.15.8:0/3664958321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80b8108480 msgr2=0x7f80b8114990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.806+0000 7f80be200640 1 --2- 172.21.15.8:0/3664958321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80b8108480 0x7f80b8114990 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009ca0 tx=0x7f80b002c100 comp rx=0 tx=0).stop 2024-03-16T21:00:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.806+0000 7f80be200640 1 -- 172.21.15.8:0/3664958321 shutdown_connections 2024-03-16T21:00:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.806+0000 7f80be200640 1 --2- 172.21.15.8:0/3664958321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80b8108480 0x7f80b8114990 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.806+0000 7f80be200640 1 --2- 172.21.15.8:0/3664958321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80b8107ac0 0x7f80b8107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.806+0000 7f80be200640 1 --2- 172.21.15.8:0/3664958321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80b810dad0 0x7f80b810deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.806+0000 7f80be200640 1 -- 172.21.15.8:0/3664958321 >> 172.21.15.8:0/3664958321 conn(0x7f80b8075a60 msgr2=0x7f80b8077e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.806+0000 7f80be200640 1 -- 172.21.15.8:0/3664958321 shutdown_connections 2024-03-16T21:00:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.806+0000 7f80be200640 1 -- 172.21.15.8:0/3664958321 wait complete. 2024-03-16T21:00:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.807+0000 7f80be200640 1 Processor -- start 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.807+0000 7f80be200640 1 -- start start 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.807+0000 7f80be200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80b8107ac0 0x7f80b819e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.807+0000 7f80be200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80b8108480 0x7f80b819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80be200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80b810dad0 0x7f80b81a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80be200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b81a2fc0 con 0x7f80b8108480 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80be200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b81a3130 con 0x7f80b8107ac0 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80be200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b81a32f0 con 0x7f80b810dad0 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80b7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80b8107ac0 0x7f80b819e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80b7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80b8107ac0 0x7f80b819e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36464/0 (socket says 172.21.15.8:36464) 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80b7400640 1 -- 172.21.15.8:0/517994361 learned_addr learned my addr 172.21.15.8:0/517994361 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80afe00640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80b8108480 0x7f80b819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80b7e00640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80b810dad0 0x7f80b81a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80b7400640 1 -- 172.21.15.8:0/517994361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80b810dad0 msgr2=0x7f80b81a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80b7400640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80b810dad0 0x7f80b81a29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80b7400640 1 -- 172.21.15.8:0/517994361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80b8108480 msgr2=0x7f80b819e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80b7400640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80b8108480 0x7f80b819e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.808+0000 7f80b7400640 1 -- 172.21.15.8:0/517994361 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b0009900 con 0x7f80b8107ac0 2024-03-16T21:00:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.809+0000 7f80b7400640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80b8107ac0 0x7f80b819e150 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f80a800e9f0 tx=0x7f80a800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.809+0000 7f80b4c00640 1 -- 172.21.15.8:0/517994361 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8009700 con 0x7f80b8107ac0 2024-03-16T21:00:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.809+0000 7f80b4c00640 1 -- 172.21.15.8:0/517994361 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f80a800cd80 con 0x7f80b8107ac0 2024-03-16T21:00:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.809+0000 7f80b4c00640 1 -- 172.21.15.8:0/517994361 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80189c0 con 0x7f80b8107ac0 2024-03-16T21:00:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.809+0000 7f80be200640 1 -- 172.21.15.8:0/517994361 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b81a35d0 con 0x7f80b8107ac0 2024-03-16T21:00:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.809+0000 7f80be200640 1 -- 172.21.15.8:0/517994361 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b81aae50 con 0x7f80b8107ac0 2024-03-16T21:00:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.812+0000 7f80b4c00640 1 -- 172.21.15.8:0/517994361 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f80a8018b20 con 0x7f80b8107ac0 2024-03-16T21:00:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.813+0000 7f80c0fff740 1 Processor -- start 2024-03-16T21:00:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.813+0000 7f80c0fff740 1 -- start start 2024-03-16T21:00:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.813+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bbe870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.813+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbedb0 0x55f492bbf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.813+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492bca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.813+0000 7f80c0fff740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f492b7a620 con 0x55f492bbedb0 2024-03-16T21:00:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.813+0000 7f80c0fff740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f492b2c8c0 con 0x55f492bbfb20 2024-03-16T21:00:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.813+0000 7f80c0fff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f492b29df0 con 0x55f492bc8330 2024-03-16T21:00:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bbe870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bbe870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36476/0 (socket says 172.21.15.8:36476) 2024-03-16T21:00:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b7e00640 1 -- 172.21.15.8:0/2253255897 learned_addr learned my addr 172.21.15.8:0/2253255897 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b7400640 1 --2- 172.21.15.8:0/2253255897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbedb0 0x55f492bbf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80afe00640 1 --2- 172.21.15.8:0/2253255897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492bca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b4c00640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f809c0a1cc0 0x7f809c0a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b7e00640 1 -- 172.21.15.8:0/2253255897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 msgr2=0x55f492bca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b7e00640 1 --2- 172.21.15.8:0/2253255897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492bca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b7e00640 1 -- 172.21.15.8:0/2253255897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbedb0 msgr2=0x55f492bbf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b7e00640 1 --2- 172.21.15.8:0/2253255897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbedb0 0x55f492bbf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b4c00640 1 -- 172.21.15.8:0/517994361 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f80a8014070 con 0x7f80b8107ac0 2024-03-16T21:00:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b7e00640 1 -- 172.21.15.8:0/2253255897 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f492aa6b00 con 0x55f492bbfb20 2024-03-16T21:00:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80afe00640 1 --2- 172.21.15.8:0/2253255897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492bca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.814+0000 7f80b7e00640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f809c0a1cc0 0x7f809c0a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.815+0000 7f80b7e00640 1 --2- 172.21.15.8:0/2253255897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bbe870 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f80b0037040 tx=0x7f80b0032ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71cf808c94c4cb19 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.815+0000 7f80a7e00640 1 -- 172.21.15.8:0/2253255897 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0034800 con 0x55f492bbfb20 2024-03-16T21:00:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.815+0000 7f80a7e00640 1 -- 172.21.15.8:0/2253255897 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f80b0003e70 con 0x55f492bbfb20 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.815+0000 7f80a7e00640 1 -- 172.21.15.8:0/2253255897 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b004a470 con 0x55f492bbfb20 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.816+0000 7f80c0fff740 1 -- 172.21.15.8:0/2253255897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 msgr2=0x55f492bbe870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.816+0000 7f80b7e00640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f809c0a1cc0 0x7f809c0a4180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f80b004d000 tx=0x7f80b004a000 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.816+0000 7f80c0fff740 1 --2- 172.21.15.8:0/2253255897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bbe870 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f80b0037040 tx=0x7f80b0032ef0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.816+0000 7f80c0fff740 1 -- 172.21.15.8:0/2253255897 shutdown_connections 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.816+0000 7f80c0fff740 1 --2- 172.21.15.8:0/2253255897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492bca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.816+0000 7f80c0fff740 1 --2- 172.21.15.8:0/2253255897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbedb0 0x55f492bbf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.816+0000 7f80c0fff740 1 --2- 172.21.15.8:0/2253255897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bbe870 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.816+0000 7f80c0fff740 1 -- 172.21.15.8:0/2253255897 >> 172.21.15.8:0/2253255897 conn(0x55f492b864b0 msgr2=0x55f492bb9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.816+0000 7f80c0fff740 1 -- 172.21.15.8:0/2253255897 shutdown_connections 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.816+0000 7f80c0fff740 1 -- 172.21.15.8:0/2253255897 wait complete. 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.816+0000 7f80c0fff740 1 -- start start 2024-03-16T21:00:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80c0fff740 1 Processor -- start 2024-03-16T21:00:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbedb0 0x55f492bc53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bc5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492bc5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80c0fff740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f492b255d0 con 0x55f492bbedb0 2024-03-16T21:00:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80c0fff740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f492acab50 con 0x55f492bbfb20 2024-03-16T21:00:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80c0fff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f492aca7f0 con 0x55f492bc8330 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80c0fff740 10 client.0 _ll_register_callbacks cb 0x55f492ade550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80afe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bc5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80b7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492bc5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80b7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbedb0 0x55f492bc53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80afe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bc5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36482/0 (socket says 172.21.15.8:36482) 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.817+0000 7f80afe00640 1 -- 172.21.15.8:0/1517119405 learned_addr learned my addr 172.21.15.8:0/1517119405 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.818+0000 7f80afe00640 1 -- 172.21.15.8:0/1517119405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 msgr2=0x55f492bc5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.818+0000 7f80afe00640 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492bc5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.818+0000 7f80afe00640 1 -- 172.21.15.8:0/1517119405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbedb0 msgr2=0x55f492bc53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.818+0000 7f80afe00640 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbedb0 0x55f492bc53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.818+0000 7f80afe00640 1 -- 172.21.15.8:0/1517119405 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b8115290 con 0x55f492bbfb20 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.818+0000 7f80b7e00640 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492bc5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.818+0000 7f80afe00640 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bc5900 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f80a0012700 tx=0x7f80a0012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ce3e684d8d806ea server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.818+0000 7f80a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.819+0000 7f80a4c00640 1 -- 172.21.15.8:0/1517119405 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0017070 con 0x55f492bbfb20 2024-03-16T21:00:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.819+0000 7f80a4c00640 1 -- 172.21.15.8:0/1517119405 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f80a000f920 con 0x55f492bbfb20 2024-03-16T21:00:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.819+0000 7f80c0fff740 1 -- 172.21.15.8:0/1517119405 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f492af7cd0 con 0x55f492bbfb20 2024-03-16T21:00:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.819+0000 7f80a4c00640 1 -- 172.21.15.8:0/1517119405 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80a000fae0 con 0x55f492bbfb20 2024-03-16T21:00:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.819+0000 7f80c0fff740 10 client.26159 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.819+0000 7f80c0fff740 1 -- 172.21.15.8:0/1517119405 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f492b23c50 con 0x55f492bbfb20 2024-03-16T21:00:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.819+0000 7f80a4c00640 1 -- 172.21.15.8:0/1517119405 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55f492af7cd0 con 0x55f492bbfb20 2024-03-16T21:00:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.819+0000 7f80a4c00640 1 -- 172.21.15.8:0/1517119405 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f80a001c420 con 0x55f492bbfb20 2024-03-16T21:00:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.820+0000 7f80c0fff740 10 client.26159 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.820+0000 7f80c0fff740 10 client.26159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.820+0000 7f80c0fff740 20 client.26159 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.820+0000 7f80c0fff740 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f492bd8500 0x55f492bda920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.820+0000 7f80c0fff740 4 client.26159 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.820+0000 7f80c0fff740 1 -- 172.21.15.8:0/1517119405 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f492b1bce0 con 0x55f492bd8500 2024-03-16T21:00:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.820+0000 7f80b7400640 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f492bd8500 0x55f492bda920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.820+0000 7f80b7400640 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f492bd8500 0x55f492bda920 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec05915f9303a857 server_cookie=1f56553a3c9484c in_seq=0 out_seq=0 2024-03-16T21:00:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.820+0000 7f80a4c00640 10 client.26159 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.821+0000 7f80a4c00640 1 -- 172.21.15.8:0/1517119405 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55f492b1bce0 con 0x55f492bd8500 2024-03-16T21:00:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.821+0000 7f80a4c00640 10 client.26159 handle_command_reply: tid=0 2024-03-16T21:00:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 1 client.26159 shutdown 2024-03-16T21:00:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 1 -- 172.21.15.8:0/1517119405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 msgr2=0x55f492bc5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bc5900 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f80a0012700 tx=0x7f80a0012bc0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 1 -- 172.21.15.8:0/1517119405 shutdown_connections 2024-03-16T21:00:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492bc5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbfb20 0x55f492bc5900 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f492bd8500 0x55f492bda920 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 1 --2- 172.21.15.8:0/1517119405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbedb0 0x55f492bc53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80a4c00640 0 client.26159 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 1 -- 172.21.15.8:0/1517119405 >> 172.21.15.8:0/1517119405 conn(0x55f492b864b0 msgr2=0x55f492bbb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 1 -- 172.21.15.8:0/1517119405 shutdown_connections 2024-03-16T21:00:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 1 -- 172.21.15.8:0/1517119405 wait complete. 2024-03-16T21:00:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.822+0000 7f80c0fff740 20 client.26159 trim_cache size 0 max 16384 2024-03-16T21:00:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.837+0000 7f80c0fff740 1 Processor -- start 2024-03-16T21:00:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.837+0000 7f80c0fff740 1 -- start start 2024-03-16T21:00:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bbedb0 0x55f492bc7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbfb20 0x55f492bb8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bc8330 0x55f492bd3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80c0fff740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49286de60 con 0x55f492bbfb20 2024-03-16T21:00:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80c0fff740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f492bd6bd0 con 0x55f492bc8330 2024-03-16T21:00:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80c0fff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f492bc51b0 con 0x55f492bbedb0 2024-03-16T21:00:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80b7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bbedb0 0x55f492bc7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80b7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bc8330 0x55f492bd3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80b7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bbedb0 0x55f492bc7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59256/0 (socket says 172.21.15.8:59256) 2024-03-16T21:00:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80afe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbfb20 0x55f492bb8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80b7400640 1 -- 172.21.15.8:0/3246358689 learned_addr learned my addr 172.21.15.8:0/3246358689 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80b7400640 1 -- 172.21.15.8:0/3246358689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bc8330 msgr2=0x55f492bd3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80b7400640 1 --2- 172.21.15.8:0/3246358689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bc8330 0x55f492bd3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80b7400640 1 -- 172.21.15.8:0/3246358689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbfb20 msgr2=0x55f492bb8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80b7400640 1 --2- 172.21.15.8:0/3246358689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbfb20 0x55f492bb8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.838+0000 7f80b7400640 1 -- 172.21.15.8:0/3246358689 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f492ac0530 con 0x55f492bbedb0 2024-03-16T21:00:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.839+0000 7f80b7400640 1 --2- 172.21.15.8:0/3246358689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bbedb0 0x55f492bc7af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f80a80cb1f0 tx=0x7f80a80cfd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8841eb9a9ea08178 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.839+0000 7f80a7400640 1 -- 172.21.15.8:0/3246358689 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8083ea0 con 0x55f492bbedb0 2024-03-16T21:00:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.839+0000 7f80a7400640 1 -- 172.21.15.8:0/3246358689 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f80a809e7c0 con 0x55f492bbedb0 2024-03-16T21:00:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.839+0000 7f80a7400640 1 -- 172.21.15.8:0/3246358689 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8096f20 con 0x55f492bbedb0 2024-03-16T21:00:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.840+0000 7f80c0fff740 1 -- 172.21.15.8:0/3246358689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bbedb0 msgr2=0x55f492bc7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.840+0000 7f80c0fff740 1 --2- 172.21.15.8:0/3246358689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bbedb0 0x55f492bc7af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f80a80cb1f0 tx=0x7f80a80cfd30 comp rx=0 tx=0).stop 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.840+0000 7f80c0fff740 1 -- 172.21.15.8:0/3246358689 shutdown_connections 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.840+0000 7f80c0fff740 1 --2- 172.21.15.8:0/3246358689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bc8330 0x55f492bd3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.840+0000 7f80c0fff740 1 --2- 172.21.15.8:0/3246358689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbfb20 0x55f492bb8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.840+0000 7f80c0fff740 1 --2- 172.21.15.8:0/3246358689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bbedb0 0x55f492bc7af0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.840+0000 7f80c0fff740 1 -- 172.21.15.8:0/3246358689 >> 172.21.15.8:0/3246358689 conn(0x55f492b864b0 msgr2=0x55f492bb84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.840+0000 7f80c0fff740 1 -- 172.21.15.8:0/3246358689 shutdown_connections 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.840+0000 7f80c0fff740 1 -- 172.21.15.8:0/3246358689 wait complete. 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.840+0000 7f80c0fff740 1 -- start start 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.840+0000 7f80c0fff740 1 Processor -- start 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbedb0 0x55f492bc2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbfb20 0x55f492bc2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80c0fff740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492c32db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80c0fff740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f492bc2f00 con 0x55f492bbfb20 2024-03-16T21:00:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80c0fff740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f492c33320 con 0x55f492bbedb0 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80c0fff740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f492c334e0 con 0x55f492bc8330 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80c0fff740 10 client.0 _ll_register_callbacks cb 0x7f80a0009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80b7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbedb0 0x55f492bc2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80b7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbedb0 0x55f492bc2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36512/0 (socket says 172.21.15.8:36512) 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80b7400640 1 -- 172.21.15.8:0/156348657 learned_addr learned my addr 172.21.15.8:0/156348657 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80b7e00640 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492c32db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.841+0000 7f80afe00640 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbfb20 0x55f492bc2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80b7400640 1 -- 172.21.15.8:0/156348657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 msgr2=0x55f492c32db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80b7400640 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492c32db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80b7400640 1 -- 172.21.15.8:0/156348657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbfb20 msgr2=0x55f492bc2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80b7400640 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbfb20 0x55f492bc2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80b7400640 1 -- 172.21.15.8:0/156348657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b81aae50 con 0x55f492bbedb0 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80b7400640 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbedb0 0x55f492bc2220 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f80a800cf10 tx=0x7f80a809a860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1ae56f0b2e58a2d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80a4c00640 1 -- 172.21.15.8:0/156348657 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8083ea0 con 0x55f492bbedb0 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80c0fff740 1 -- 172.21.15.8:0/156348657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f492b4ad30 con 0x55f492bbedb0 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80a4c00640 1 -- 172.21.15.8:0/156348657 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f80a80ba0b0 con 0x55f492bbedb0 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80a4c00640 1 -- 172.21.15.8:0/156348657 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80a80b31e0 con 0x55f492bbedb0 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80c0fff740 10 client.26165 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.842+0000 7f80c0fff740 1 -- 172.21.15.8:0/156348657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f492ae62c0 con 0x55f492bbedb0 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.843+0000 7f80a4c00640 1 -- 172.21.15.8:0/156348657 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55f492b4ad30 con 0x55f492bbedb0 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.843+0000 7f80a4c00640 1 -- 172.21.15.8:0/156348657 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f80a80814b0 con 0x55f492bbedb0 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.843+0000 7f80c0fff740 10 client.26165 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.843+0000 7f80c0fff740 10 client.26165 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.843+0000 7f80c0fff740 20 client.26165 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.843+0000 7f80c0fff740 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f492c34b30 0x55f492c36f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.843+0000 7f80c0fff740 4 client.26165 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T21:00:23.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.843+0000 7f80c0fff740 1 -- 172.21.15.8:0/156348657 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f492825600 con 0x55f492c34b30 2024-03-16T21:00:23.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.843+0000 7f80afe00640 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f492c34b30 0x55f492c36f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:23.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.844+0000 7f80afe00640 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f492c34b30 0x55f492c36f50 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6780d97eda8c4c7a server_cookie=b99e2fa91a204f16 in_seq=0 out_seq=0 2024-03-16T21:00:23.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:23.844+0000 7f80a4c00640 10 client.26165 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:23.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:23 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:23.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:23 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3773473445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:00:24.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:23 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:24.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:23 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3773473445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:00:24.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:23 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:00:24.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:23 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3773473445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:00:24.634 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:00:24.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:00:24.634 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:00:24.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.855+0000 7f73ae200640 1 -- 172.21.15.8:0/3924287238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a8112360 msgr2=0x7f73a8114750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:24.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.855+0000 7f73ae200640 1 --2- 172.21.15.8:0/3924287238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a8112360 0x7f73a8114750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009860 tx=0x7f73a002bc00 comp rx=0 tx=0).stop 2024-03-16T21:00:24.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.856+0000 7f73ae200640 1 -- 172.21.15.8:0/3924287238 shutdown_connections 2024-03-16T21:00:24.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.856+0000 7f73ae200640 1 --2- 172.21.15.8:0/3924287238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a8112360 0x7f73a8114750 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.856+0000 7f73ae200640 1 --2- 172.21.15.8:0/3924287238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73a80741b0 0x7f73a8111e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.856+0000 7f73ae200640 1 --2- 172.21.15.8:0/3924287238 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73a8073890 0x7f73a8073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.856+0000 7f73ae200640 1 -- 172.21.15.8:0/3924287238 >> 172.21.15.8:0/3924287238 conn(0x7f73a80fce60 msgr2=0x7f73a80ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:24.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.856+0000 7f73ae200640 1 -- 172.21.15.8:0/3924287238 shutdown_connections 2024-03-16T21:00:24.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.856+0000 7f73ae200640 1 -- 172.21.15.8:0/3924287238 wait complete. 2024-03-16T21:00:24.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.857+0000 7f73ae200640 1 Processor -- start 2024-03-16T21:00:24.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.857+0000 7f73ae200640 1 -- start start 2024-03-16T21:00:24.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.857+0000 7f73ae200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73a8073890 0x7f73a819e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.857+0000 7f73ae200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a80741b0 0x7f73a819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.857+0000 7f73ae200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73a8112360 0x7f73a81a2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f73ae200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a81a2f30 con 0x7f73a80741b0 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f73ae200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a81a30a0 con 0x7f73a8073890 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f73ae200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a81a3260 con 0x7f73a8112360 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f739fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a80741b0 0x7f73a819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f73ad800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73a8112360 0x7f73a81a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f739fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a80741b0 0x7f73a819e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39982/0 (socket says 172.21.15.8:39982) 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f739fe00640 1 -- 172.21.15.8:0/3241895005 learned_addr learned my addr 172.21.15.8:0/3241895005 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f73ace00640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73a8073890 0x7f73a819e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f73ad800640 1 -- 172.21.15.8:0/3241895005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73a8073890 msgr2=0x7f73a819e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f73ad800640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73a8073890 0x7f73a819e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f73ad800640 1 -- 172.21.15.8:0/3241895005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a80741b0 msgr2=0x7f73a819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:24.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f73ad800640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a80741b0 0x7f73a819e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f73ad800640 1 -- 172.21.15.8:0/3241895005 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7390009560 con 0x7f73a8112360 2024-03-16T21:00:24.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f739fe00640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a80741b0 0x7f73a819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:24.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.858+0000 7f73ace00640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73a8073890 0x7f73a819e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:24.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.859+0000 7f73ad800640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73a8112360 0x7f73a81a2930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f73a002c140 tx=0x7f73a0034670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:24.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.859+0000 7f73a6000640 1 -- 172.21.15.8:0/3241895005 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0005c90 con 0x7f73a8112360 2024-03-16T21:00:24.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.859+0000 7f73ae200640 1 -- 172.21.15.8:0/3241895005 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a0009490 con 0x7f73a8112360 2024-03-16T21:00:24.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.859+0000 7f73a6000640 1 -- 172.21.15.8:0/3241895005 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f73a002caa0 con 0x7f73a8112360 2024-03-16T21:00:24.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.859+0000 7f73a6000640 1 -- 172.21.15.8:0/3241895005 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a003d650 con 0x7f73a8112360 2024-03-16T21:00:24.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.859+0000 7f73ae200640 1 -- 172.21.15.8:0/3241895005 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a81aabe0 con 0x7f73a8112360 2024-03-16T21:00:24.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.862+0000 7f73a6000640 1 -- 172.21.15.8:0/3241895005 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f73a003b040 con 0x7f73a8112360 2024-03-16T21:00:24.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.862+0000 7f73b246a740 1 Processor -- start 2024-03-16T21:00:24.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.862+0000 7f73b246a740 1 -- start start 2024-03-16T21:00:24.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.863+0000 7f73b246a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fb24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:24.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.863+0000 7f73b246a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fbb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:24.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.863+0000 7f73b246a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fbb610 0x55c9d1fbda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:24.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.863+0000 7f73b246a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d1f6d300 con 0x55c9d1fb2a30 2024-03-16T21:00:24.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.863+0000 7f73b246a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d1f1fe50 con 0x55c9d1fb2110 2024-03-16T21:00:24.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.863+0000 7f73b246a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d1f1d380 con 0x55c9d1fbb610 2024-03-16T21:00:24.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.863+0000 7f739fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fb24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:24.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.863+0000 7f73ace00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fbb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:24.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.863+0000 7f739fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fb24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:36542/0 (socket says 172.21.15.8:36542) 2024-03-16T21:00:24.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.863+0000 7f739fe00640 1 -- 172.21.15.8:0/752012677 learned_addr learned my addr 172.21.15.8:0/752012677 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:24.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.864+0000 7f739fe00640 1 -- 172.21.15.8:0/752012677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fbb610 msgr2=0x55c9d1fbda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:24.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.864+0000 7f739fe00640 1 --2- 172.21.15.8:0/752012677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fbb610 0x55c9d1fbda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.864+0000 7f739fe00640 1 -- 172.21.15.8:0/752012677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fb2a30 msgr2=0x55c9d1fbb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:24.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.864+0000 7f739fe00640 1 --2- 172.21.15.8:0/752012677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fbb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.864+0000 7f739fe00640 1 -- 172.21.15.8:0/752012677 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9d1ee1c80 con 0x55c9d1fb2110 2024-03-16T21:00:24.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.864+0000 7f73a6000640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f738c0a1ba0 0x7f738c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:24.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.864+0000 7f739fe00640 1 --2- 172.21.15.8:0/752012677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fb24f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7390013760 tx=0x7f7390013c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98a61a171f5ff96b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:24.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.864+0000 7f73a6000640 1 -- 172.21.15.8:0/3241895005 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f73a00eef90 con 0x7f73a8112360 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.864+0000 7f739e000640 1 -- 172.21.15.8:0/752012677 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390013e70 con 0x55c9d1fb2110 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.864+0000 7f73ace00640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f738c0a1ba0 0x7f738c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.865+0000 7f739e000640 1 -- 172.21.15.8:0/752012677 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f739000f9a0 con 0x55c9d1fb2110 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.865+0000 7f739e000640 1 -- 172.21.15.8:0/752012677 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390003c00 con 0x55c9d1fb2110 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.865+0000 7f73b246a740 1 -- 172.21.15.8:0/752012677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 msgr2=0x55c9d1fb24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.865+0000 7f73ace00640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f738c0a1ba0 0x7f738c0a4060 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55c9d1fb1be0 tx=0x7f7398009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.865+0000 7f73b246a740 1 --2- 172.21.15.8:0/752012677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fb24f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7390013760 tx=0x7f7390013c20 comp rx=0 tx=0).stop 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.865+0000 7f73b246a740 1 -- 172.21.15.8:0/752012677 shutdown_connections 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.865+0000 7f73b246a740 1 --2- 172.21.15.8:0/752012677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fbb610 0x55c9d1fbda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.865+0000 7f73b246a740 1 --2- 172.21.15.8:0/752012677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fbb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.866+0000 7f73b246a740 1 --2- 172.21.15.8:0/752012677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fb24f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.866+0000 7f73b246a740 1 -- 172.21.15.8:0/752012677 >> 172.21.15.8:0/752012677 conn(0x55c9d1fac840 msgr2=0x55c9d1facc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:24.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.866+0000 7f73b246a740 1 -- 172.21.15.8:0/752012677 shutdown_connections 2024-03-16T21:00:24.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.866+0000 7f73b246a740 1 -- 172.21.15.8:0/752012677 wait complete. 2024-03-16T21:00:24.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.866+0000 7f73b246a740 1 -- start start 2024-03-16T21:00:24.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.866+0000 7f73b246a740 1 Processor -- start 2024-03-16T21:00:24.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f73b246a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fb85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:24.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f73b246a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:24.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f73b246a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fb9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:24.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f73b246a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d1f18b60 con 0x55c9d1fbb610 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f73b246a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d1ebdfd0 con 0x55c9d1fb2110 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f73b246a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d1ebdc70 con 0x55c9d1fb2a30 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f73b246a740 10 client.0 _ll_register_callbacks cb 0x55c9d1c29c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f739fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f73ace00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fb85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f73ad800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fb9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f739fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59304/0 (socket says 172.21.15.8:59304) 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.867+0000 7f739fe00640 1 -- 172.21.15.8:0/1118538219 learned_addr learned my addr 172.21.15.8:0/1118538219 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.868+0000 7f739fe00640 1 -- 172.21.15.8:0/1118538219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 msgr2=0x55c9d1fb85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.868+0000 7f739fe00640 1 --2- 172.21.15.8:0/1118538219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fb85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.868+0000 7f739fe00640 1 -- 172.21.15.8:0/1118538219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 msgr2=0x55c9d1fb9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.868+0000 7f739fe00640 1 --2- 172.21.15.8:0/1118538219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fb9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.868+0000 7f739fe00640 1 -- 172.21.15.8:0/1118538219 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7390013460 con 0x55c9d1fb2a30 2024-03-16T21:00:24.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.868+0000 7f739fe00640 1 --2- 172.21.15.8:0/1118538219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8b30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7390005df0 tx=0x7f7390005e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f809865692a6cfe server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.868+0000 7f7396a00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.868+0000 7f7396a00640 1 -- 172.21.15.8:0/1118538219 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390010840 con 0x55c9d1fb2a30 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.868+0000 7f7396a00640 1 -- 172.21.15.8:0/1118538219 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f73900109a0 con 0x55c9d1fb2a30 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.868+0000 7f73b246a740 1 -- 172.21.15.8:0/1118538219 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9d1c18860 con 0x55c9d1fb2a30 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.869+0000 7f7396a00640 1 -- 172.21.15.8:0/1118538219 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7390010b60 con 0x55c9d1fb2a30 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.869+0000 7f73b246a740 10 client.26185 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.869+0000 7f73b246a740 1 -- 172.21.15.8:0/1118538219 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c9d1f171e0 con 0x55c9d1fb2a30 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.869+0000 7f7396a00640 1 -- 172.21.15.8:0/1118538219 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55c9d1c18860 con 0x55c9d1fb2a30 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.869+0000 7f7396a00640 1 -- 172.21.15.8:0/1118538219 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f739001b410 con 0x55c9d1fb2a30 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.869+0000 7f73b246a740 10 client.26185 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.869+0000 7f73b246a740 10 client.26185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.869+0000 7f73b246a740 20 client.26185 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.869+0000 7f73b246a740 1 --2- 172.21.15.8:0/1118538219 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9d1fcb930 0x55c9d1fcdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:24.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.869+0000 7f73b246a740 4 client.26185 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:24.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.869+0000 7f73b246a740 1 -- 172.21.15.8:0/1118538219 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c9d1c69410 con 0x55c9d1fcb930 2024-03-16T21:00:24.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.870+0000 7f73ace00640 1 --2- 172.21.15.8:0/1118538219 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9d1fcb930 0x55c9d1fcdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:24.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.870+0000 7f7396a00640 10 client.26185 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:24.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:24.870+0000 7f73ace00640 1 --2- 172.21.15.8:0/1118538219 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9d1fcb930 0x55c9d1fcdd50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=565049e209056076 server_cookie=1f439b88a25f3a in_seq=0 out_seq=0 2024-03-16T21:00:24.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:24 smithi008 ceph-mon[31434]: pgmap v80: 97 pgs: 97 active+clean; 169 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 382 op/s 2024-03-16T21:00:25.062 INFO:tasks.workunit.client.0.smithi008.stderr:+ sync 2024-03-16T21:00:25.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:24 smithi170 ceph-mon[35947]: pgmap v80: 97 pgs: 97 active+clean; 169 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 382 op/s 2024-03-16T21:00:25.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:24 smithi186 ceph-mon[36391]: pgmap v80: 97 pgs: 97 active+clean; 169 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 382 op/s 2024-03-16T21:00:27.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:26 smithi170 ceph-mon[35947]: pgmap v81: 97 pgs: 97 active+clean; 169 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 382 op/s 2024-03-16T21:00:27.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:26 smithi186 ceph-mon[36391]: pgmap v81: 97 pgs: 97 active+clean; 169 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 382 op/s 2024-03-16T21:00:27.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:26 smithi008 ceph-mon[31434]: pgmap v81: 97 pgs: 97 active+clean; 169 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 382 op/s 2024-03-16T21:00:28.031 INFO:tasks.workunit.client.0.smithi008.stderr:+ tar c linux-4.0.5 2024-03-16T21:00:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.063+0000 7f80a4c00640 1 -- 172.21.15.8:0/156348657 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f492825600 con 0x55f492c34b30 2024-03-16T21:00:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.063+0000 7f80a4c00640 10 client.26165 handle_command_reply: tid=0 2024-03-16T21:00:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.063+0000 7f80c0fff740 1 client.26165 shutdown 2024-03-16T21:00:28.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.063+0000 7f7396a00640 1 -- 172.21.15.8:0/1118538219 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55c9d1c69410 con 0x55c9d1fcb930 2024-03-16T21:00:28.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.063+0000 7f7396a00640 10 client.26185 handle_command_reply: tid=0 2024-03-16T21:00:28.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 1 client.26185 shutdown 2024-03-16T21:00:28.069 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80c0fff740 1 -- 172.21.15.8:0/156348657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbedb0 msgr2=0x55f492bc2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.069 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80c0fff740 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbedb0 0x55f492bc2220 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f80a800cf10 tx=0x7f80a809a860 comp rx=0 tx=0).stop 2024-03-16T21:00:28.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 1 -- 172.21.15.8:0/1118538219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 msgr2=0x55c9d1fb8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 1 --2- 172.21.15.8:0/1118538219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8b30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7390005df0 tx=0x7f7390005e20 comp rx=0 tx=0).stop 2024-03-16T21:00:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80c0fff740 1 -- 172.21.15.8:0/156348657 shutdown_connections 2024-03-16T21:00:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80c0fff740 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f492bc8330 0x55f492c32db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80c0fff740 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f492c34b30 0x55f492c36f50 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80c0fff740 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f492bbfb20 0x55f492bc2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80c0fff740 1 --2- 172.21.15.8:0/156348657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f492bbedb0 0x55f492bc2220 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80c0fff740 1 -- 172.21.15.8:0/156348657 >> 172.21.15.8:0/156348657 conn(0x55f492b864b0 msgr2=0x55f492bb8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80a4c00640 0 client.26165 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:28.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 1 -- 172.21.15.8:0/1118538219 shutdown_connections 2024-03-16T21:00:28.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 1 --2- 172.21.15.8:0/1118538219 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9d1fcb930 0x55c9d1fcdd50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 1 --2- 172.21.15.8:0/1118538219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fb9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 1 --2- 172.21.15.8:0/1118538219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8b30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f7396a00640 0 client.26185 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:28.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 1 --2- 172.21.15.8:0/1118538219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fb85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 1 -- 172.21.15.8:0/1118538219 >> 172.21.15.8:0/1118538219 conn(0x55c9d1fac840 msgr2=0x55c9d1fae590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80c0fff740 1 -- 172.21.15.8:0/156348657 shutdown_connections 2024-03-16T21:00:28.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 1 -- 172.21.15.8:0/1118538219 shutdown_connections 2024-03-16T21:00:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80c0fff740 1 -- 172.21.15.8:0/156348657 wait complete. 2024-03-16T21:00:28.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 1 -- 172.21.15.8:0/1118538219 wait complete. 2024-03-16T21:00:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f80c0fff740 20 client.26165 trim_cache size 0 max 16384 2024-03-16T21:00:28.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.064+0000 7f73b246a740 20 client.26185 trim_cache size 0 max 16384 2024-03-16T21:00:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T21:00:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T21:00:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T21:00:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T21:00:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 -- 172.21.15.8:0/517994361 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f809c0a1cc0 msgr2=0x7f809c0a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f809c0a1cc0 0x7f809c0a4180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f80b004d000 tx=0x7f80b004a000 comp rx=0 tx=0).stop 2024-03-16T21:00:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 -- 172.21.15.8:0/517994361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80b8107ac0 msgr2=0x7f80b819e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80b8107ac0 0x7f80b819e150 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f80a800e9f0 tx=0x7f80a800eeb0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 -- 172.21.15.8:0/517994361 shutdown_connections 2024-03-16T21:00:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f809c0a1cc0 0x7f809c0a4180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80b810dad0 0x7f80b81a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80b8108480 0x7f80b819e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 --2- 172.21.15.8:0/517994361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80b8107ac0 0x7f80b819e150 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 -- 172.21.15.8:0/517994361 >> 172.21.15.8:0/517994361 conn(0x7f80b8075a60 msgr2=0x7f80b8075ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 -- 172.21.15.8:0/517994361 shutdown_connections 2024-03-16T21:00:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:28.065+0000 7f80be200640 1 -- 172.21.15.8:0/517994361 wait complete. 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73b246a740 1 Processor -- start 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73b246a740 1 -- start start 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73b246a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2110 0x55c9d1fbacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73b246a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73b246a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fc6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73b246a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d1c610c0 con 0x55c9d1fbb610 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73b246a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d1fa7f60 con 0x55c9d1fb2a30 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73b246a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d1fb3480 con 0x55c9d1fb2110 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f739fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73ad800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fc6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73ace00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2110 0x55c9d1fbacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73ace00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2110 0x55c9d1fbacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48490/0 (socket says 172.21.15.8:48490) 2024-03-16T21:00:28.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73ace00640 1 -- 172.21.15.8:0/3863109230 learned_addr learned my addr 172.21.15.8:0/3863109230 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:28.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f739fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43274/0 (socket says 172.21.15.8:43274) 2024-03-16T21:00:28.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.093+0000 7f73ad800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fc6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33114/0 (socket says 172.21.15.8:33114) 2024-03-16T21:00:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.094+0000 7f73ace00640 1 -- 172.21.15.8:0/3863109230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2a30 msgr2=0x55c9d1fb8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.094+0000 7f73ace00640 1 --2- 172.21.15.8:0/3863109230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.094+0000 7f73ace00640 1 -- 172.21.15.8:0/3863109230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 msgr2=0x55c9d1fc6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.094+0000 7f73ace00640 1 --2- 172.21.15.8:0/3863109230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fc6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.094+0000 7f73ace00640 1 -- 172.21.15.8:0/3863109230 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9d1eb3a90 con 0x55c9d1fb2110 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.094+0000 7f739fe00640 1 --2- 172.21.15.8:0/3863109230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.094+0000 7f73ad800640 1 --2- 172.21.15.8:0/3863109230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fc6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.094+0000 7f73ace00640 1 --2- 172.21.15.8:0/3863109230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2110 0x55c9d1fbacb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7398009fd0 tx=0x7f7398003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8be41190a4ec604e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.094+0000 7f739d600640 1 -- 172.21.15.8:0/3863109230 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398024040 con 0x55c9d1fb2110 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.094+0000 7f739d600640 1 -- 172.21.15.8:0/3863109230 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f739802ab80 con 0x55c9d1fb2110 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.094+0000 7f739d600640 1 -- 172.21.15.8:0/3863109230 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398016070 con 0x55c9d1fb2110 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.095+0000 7f73b246a740 1 -- 172.21.15.8:0/3863109230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2110 msgr2=0x55c9d1fbacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.095+0000 7f73b246a740 1 --2- 172.21.15.8:0/3863109230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2110 0x55c9d1fbacb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7398009fd0 tx=0x7f7398003f90 comp rx=0 tx=0).stop 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.095+0000 7f73b246a740 1 -- 172.21.15.8:0/3863109230 shutdown_connections 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.095+0000 7f73b246a740 1 --2- 172.21.15.8:0/3863109230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fc6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.095+0000 7f73b246a740 1 --2- 172.21.15.8:0/3863109230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fb8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.095+0000 7f73b246a740 1 --2- 172.21.15.8:0/3863109230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2110 0x55c9d1fbacb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.095+0000 7f73b246a740 1 -- 172.21.15.8:0/3863109230 >> 172.21.15.8:0/3863109230 conn(0x55c9d1fac840 msgr2=0x55c9d1fb85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.095+0000 7f73b246a740 1 -- 172.21.15.8:0/3863109230 shutdown_connections 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.095+0000 7f73b246a740 1 -- 172.21.15.8:0/3863109230 wait complete. 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.096+0000 7f73b246a740 1 -- start start 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.096+0000 7f73b246a740 1 Processor -- start 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.096+0000 7f73b246a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fc04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.096+0000 7f73b246a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fc09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.096+0000 7f73b246a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fc0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.096+0000 7f73b246a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d1fb6470 con 0x55c9d1fbb610 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.096+0000 7f73b246a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d1fb65e0 con 0x55c9d1fb2110 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.096+0000 7f73b246a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d20271f0 con 0x55c9d1fb2a30 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.096+0000 7f73b246a740 10 client.0 _ll_register_callbacks cb 0x7f739000feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f73ace00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fc04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f739fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fc09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f73ace00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fc04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43290/0 (socket says 172.21.15.8:43290) 2024-03-16T21:00:28.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f73ace00640 1 -- 172.21.15.8:0/2404149746 learned_addr learned my addr 172.21.15.8:0/2404149746 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:28.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f73ad800640 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fc0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f73ace00640 1 -- 172.21.15.8:0/2404149746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 msgr2=0x55c9d1fc09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f73ace00640 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fc09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f73ace00640 1 -- 172.21.15.8:0/2404149746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 msgr2=0x55c9d1fc0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f73ace00640 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fc0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f73ace00640 1 -- 172.21.15.8:0/2404149746 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9d1f171e0 con 0x55c9d1fb2110 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f73ace00640 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fc04a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f739801e5d0 tx=0x7f73980045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=393f2542dc52cc63 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.097+0000 7f7396a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.098+0000 7f7396a00640 1 -- 172.21.15.8:0/2404149746 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398016070 con 0x55c9d1fb2110 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.098+0000 7f7396a00640 1 -- 172.21.15.8:0/2404149746 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f739802a880 con 0x55c9d1fb2110 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.098+0000 7f73b246a740 1 -- 172.21.15.8:0/2404149746 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f739000f9a0 con 0x55c9d1fb2110 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.098+0000 7f7396a00640 1 -- 172.21.15.8:0/2404149746 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7398024040 con 0x55c9d1fb2110 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.098+0000 7f73b246a740 10 client.26183 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.098+0000 7f73b246a740 1 -- 172.21.15.8:0/2404149746 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f73a81aabe0 con 0x55c9d1fb2110 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.098+0000 7f7396a00640 1 -- 172.21.15.8:0/2404149746 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f739000f9a0 con 0x55c9d1fb2110 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.099+0000 7f7396a00640 1 -- 172.21.15.8:0/2404149746 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f7398005040 con 0x55c9d1fb2110 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.099+0000 7f73b246a740 10 client.26183 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:28.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.099+0000 7f73b246a740 10 client.26183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:28.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.099+0000 7f73b246a740 20 client.26183 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:28.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.099+0000 7f73b246a740 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9d2028970 0x55c9d202ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.099+0000 7f73b246a740 4 client.26183 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:00:28.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.099+0000 7f73b246a740 1 -- 172.21.15.8:0/2404149746 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c9d1c557b0 con 0x55c9d2028970 2024-03-16T21:00:28.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.099+0000 7f739fe00640 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9d2028970 0x55c9d202ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.100+0000 7f739fe00640 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9d2028970 0x55c9d202ad90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78a799e4a4346f34 server_cookie=90667a9fae617044 in_seq=0 out_seq=0 2024-03-16T21:00:28.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.100+0000 7f7396a00640 10 client.26183 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:28.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f7396a00640 1 -- 172.21.15.8:0/2404149746 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c9d1c557b0 con 0x55c9d2028970 2024-03-16T21:00:28.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f7396a00640 10 client.26183 handle_command_reply: tid=0 2024-03-16T21:00:28.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 1 client.26183 shutdown 2024-03-16T21:00:28.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 1 -- 172.21.15.8:0/2404149746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 msgr2=0x55c9d1fc04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fc04a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f739801e5d0 tx=0x7f73980045f0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 1 -- 172.21.15.8:0/2404149746 shutdown_connections 2024-03-16T21:00:28.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9d2028970 0x55c9d202ad90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9d1fbb610 0x55c9d1fc0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9d1fb2a30 0x55c9d1fc09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 1 --2- 172.21.15.8:0/2404149746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9d1fb2110 0x55c9d1fc04a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 1 -- 172.21.15.8:0/2404149746 >> 172.21.15.8:0/2404149746 conn(0x55c9d1fac840 msgr2=0x55c9d1fae400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f7396a00640 0 client.26183 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:28.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 1 -- 172.21.15.8:0/2404149746 shutdown_connections 2024-03-16T21:00:28.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 1 -- 172.21.15.8:0/2404149746 wait complete. 2024-03-16T21:00:28.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.102+0000 7f73b246a740 20 client.26183 trim_cache size 0 max 16384 2024-03-16T21:00:28.110 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:00:28.110 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:00:28.110 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "4c1df3d9-0c61-4bfa-a1a5-6b48ef337ce8", 2024-03-16T21:00:28.110 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:00:28.110 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:00:28.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.103+0000 7f73ae200640 1 -- 172.21.15.8:0/3241895005 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f738c0a1ba0 msgr2=0x7f738c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.103+0000 7f73ae200640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f738c0a1ba0 0x7f738c0a4060 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55c9d1fb1be0 tx=0x7f7398009500 comp rx=0 tx=0).stop 2024-03-16T21:00:28.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.103+0000 7f73ae200640 1 -- 172.21.15.8:0/3241895005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73a8112360 msgr2=0x7f73a81a2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.103+0000 7f73ae200640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73a8112360 0x7f73a81a2930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f73a002c140 tx=0x7f73a0034670 comp rx=0 tx=0).stop 2024-03-16T21:00:28.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.103+0000 7f73ae200640 1 -- 172.21.15.8:0/3241895005 shutdown_connections 2024-03-16T21:00:28.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.103+0000 7f73ae200640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f738c0a1ba0 0x7f738c0a4060 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.103+0000 7f73ae200640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73a8112360 0x7f73a81a2930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.103+0000 7f73ae200640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a80741b0 0x7f73a819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.103+0000 7f73ae200640 1 --2- 172.21.15.8:0/3241895005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73a8073890 0x7f73a819e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.103+0000 7f73ae200640 1 -- 172.21.15.8:0/3241895005 >> 172.21.15.8:0/3241895005 conn(0x7f73a80fce60 msgr2=0x7f73a80fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.104+0000 7f73ae200640 1 -- 172.21.15.8:0/3241895005 shutdown_connections 2024-03-16T21:00:28.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.104+0000 7f73ae200640 1 -- 172.21.15.8:0/3241895005 wait complete. 2024-03-16T21:00:28.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:00:28.125 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:00:28.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.323+0000 7f0fea000640 1 -- 172.21.15.8:0/766000939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe41096a0 msgr2=0x7f0fe4109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.323+0000 7f0fea000640 1 --2- 172.21.15.8:0/766000939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe41096a0 0x7f0fe4109a80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009cd0 tx=0x7f0fd402c0f0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.323+0000 7f0fea000640 1 -- 172.21.15.8:0/766000939 shutdown_connections 2024-03-16T21:00:28.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.323+0000 7f0fea000640 1 --2- 172.21.15.8:0/766000939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fe4104050 0x7f0fe4110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.323+0000 7f0fea000640 1 --2- 172.21.15.8:0/766000939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fe4103690 0x7f0fe4103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.323+0000 7f0fea000640 1 --2- 172.21.15.8:0/766000939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe41096a0 0x7f0fe4109a80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.323+0000 7f0fea000640 1 -- 172.21.15.8:0/766000939 >> 172.21.15.8:0/766000939 conn(0x7f0fe40ff1a0 msgr2=0x7f0fe41015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.324+0000 7f0fea000640 1 -- 172.21.15.8:0/766000939 shutdown_connections 2024-03-16T21:00:28.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.324+0000 7f0fea000640 1 -- 172.21.15.8:0/766000939 wait complete. 2024-03-16T21:00:28.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.325+0000 7f0fea000640 1 Processor -- start 2024-03-16T21:00:28.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.325+0000 7f0fea000640 1 -- start start 2024-03-16T21:00:28.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.325+0000 7f0fea000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fe4103690 0x7f0fe4199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.325+0000 7f0fea000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe4104050 0x7f0fe419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.325+0000 7f0fea000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fe41096a0 0x7f0fe419e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.325+0000 7f0fea000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe419edb0 con 0x7f0fe4104050 2024-03-16T21:00:28.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.325+0000 7f0fea000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe419ef20 con 0x7f0fe4103690 2024-03-16T21:00:28.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.325+0000 7f0fea000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe419f0e0 con 0x7f0fe41096a0 2024-03-16T21:00:28.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.325+0000 7f0fe3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fe4103690 0x7f0fe4199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.326+0000 7f0fe2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe4104050 0x7f0fe419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.326+0000 7f0fe3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fe4103690 0x7f0fe4199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43302/0 (socket says 172.21.15.8:43302) 2024-03-16T21:00:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.326+0000 7f0fe3400640 1 -- 172.21.15.8:0/3825014261 learned_addr learned my addr 172.21.15.8:0/3825014261 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.326+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fe41096a0 0x7f0fe419e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.326+0000 7f0fe3400640 1 -- 172.21.15.8:0/3825014261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fe41096a0 msgr2=0x7f0fe419e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.326+0000 7f0fe3400640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fe41096a0 0x7f0fe419e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.326+0000 7f0fe3400640 1 -- 172.21.15.8:0/3825014261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe4104050 msgr2=0x7f0fe419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.326+0000 7f0fe3400640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe4104050 0x7f0fe419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.326+0000 7f0fe3400640 1 -- 172.21.15.8:0/3825014261 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc009490 con 0x7f0fe4103690 2024-03-16T21:00:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.326+0000 7f0fe2a00640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe4104050 0x7f0fe419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:28.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.326+0000 7f0fe3400640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fe4103690 0x7f0fe4199ef0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0fd402c700 tx=0x7f0fd4034670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:28.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.327+0000 7f0fdbe00640 1 -- 172.21.15.8:0/3825014261 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4034e20 con 0x7f0fe4103690 2024-03-16T21:00:28.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.327+0000 7f0fdbe00640 1 -- 172.21.15.8:0/3825014261 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0fd4003e70 con 0x7f0fe4103690 2024-03-16T21:00:28.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.327+0000 7f0fea000640 1 -- 172.21.15.8:0/3825014261 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd4009900 con 0x7f0fe4103690 2024-03-16T21:00:28.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.327+0000 7f0fdbe00640 1 -- 172.21.15.8:0/3825014261 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4004830 con 0x7f0fe4103690 2024-03-16T21:00:28.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.327+0000 7f0fea000640 1 -- 172.21.15.8:0/3825014261 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe41a6a60 con 0x7f0fe4103690 2024-03-16T21:00:28.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.330+0000 7f0fdbe00640 1 -- 172.21.15.8:0/3825014261 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f0fd400a040 con 0x7f0fe4103690 2024-03-16T21:00:28.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.330+0000 7f0fecc47740 1 Processor -- start 2024-03-16T21:00:28.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.330+0000 7f0fecc47740 1 -- start start 2024-03-16T21:00:28.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.331+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134ffa0 0x55ca2134ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.331+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134f2c0 0x55ca2134f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.331+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca21358630 0x55ca2135aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.331+0000 7f0fecc47740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca212be150 con 0x55ca21358630 2024-03-16T21:00:28.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.331+0000 7f0fecc47740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca212bb680 con 0x55ca2134f2c0 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.331+0000 7f0fecc47740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca212b6e60 con 0x55ca2134ffa0 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.331+0000 7f0fe3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134ffa0 0x55ca2134ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.331+0000 7f0fe3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134ffa0 0x55ca2134ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48524/0 (socket says 172.21.15.8:48524) 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.331+0000 7f0fe3e00640 1 -- 172.21.15.8:0/2595533733 learned_addr learned my addr 172.21.15.8:0/2595533733 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.331+0000 7f0fe3400640 1 --2- 172.21.15.8:0/2595533733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134f2c0 0x55ca2134f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.332+0000 7f0fe3e00640 1 -- 172.21.15.8:0/2595533733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134f2c0 msgr2=0x55ca2134f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.332+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/2595533733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134f2c0 0x55ca2134f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.332+0000 7f0fe3e00640 1 -- 172.21.15.8:0/2595533733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca21358630 msgr2=0x55ca2135aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.332+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/2595533733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca21358630 0x55ca2135aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.332+0000 7f0fe3e00640 1 -- 172.21.15.8:0/2595533733 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca21270060 con 0x55ca2134ffa0 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.332+0000 7f0fdbe00640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fc80a1ba0 0x7f0fc80a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.332+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/2595533733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134ffa0 0x55ca2134ecf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009da0 tx=0x7f0fdc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2387555205c84772 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:28.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.332+0000 7f0fdbe00640 1 -- 172.21.15.8:0/3825014261 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0fd40effe0 con 0x7f0fe4103690 2024-03-16T21:00:28.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.332+0000 7f0fe3400640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fc80a1ba0 0x7f0fc80a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.333+0000 7f0fd3e00640 1 -- 172.21.15.8:0/2595533733 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0042f0 con 0x55ca2134ffa0 2024-03-16T21:00:28.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.333+0000 7f0fd3e00640 1 -- 172.21.15.8:0/2595533733 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0fdc004450 con 0x55ca2134ffa0 2024-03-16T21:00:28.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.333+0000 7f0fd3e00640 1 -- 172.21.15.8:0/2595533733 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc019910 con 0x55ca2134ffa0 2024-03-16T21:00:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.333+0000 7f0fecc47740 1 -- 172.21.15.8:0/2595533733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134ffa0 msgr2=0x55ca2134ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.333+0000 7f0fe3400640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fc80a1ba0 0x7f0fc80a4060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40ed920 tx=0x7f0fd40f3af0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.333+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2595533733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134ffa0 0x55ca2134ecf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009da0 tx=0x7f0fdc011810 comp rx=0 tx=0).stop 2024-03-16T21:00:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.334+0000 7f0fecc47740 1 -- 172.21.15.8:0/2595533733 shutdown_connections 2024-03-16T21:00:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.334+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2595533733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca21358630 0x55ca2135aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.334+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2595533733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134f2c0 0x55ca2134f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.334+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2595533733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134ffa0 0x55ca2134ecf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.334+0000 7f0fecc47740 1 -- 172.21.15.8:0/2595533733 >> 172.21.15.8:0/2595533733 conn(0x55ca213165a0 msgr2=0x55ca21349d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.334+0000 7f0fecc47740 1 -- 172.21.15.8:0/2595533733 shutdown_connections 2024-03-16T21:00:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.334+0000 7f0fecc47740 1 -- 172.21.15.8:0/2595533733 wait complete. 2024-03-16T21:00:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.334+0000 7f0fecc47740 1 -- start start 2024-03-16T21:00:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.334+0000 7f0fecc47740 1 Processor -- start 2024-03-16T21:00:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134f2c0 0x55ca213555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca21358630 0x55ca21356030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fecc47740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2125bec0 con 0x55ca2134f2c0 2024-03-16T21:00:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fecc47740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2125bb60 con 0x55ca2134ffa0 2024-03-16T21:00:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fecc47740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca210251c0 con 0x55ca21358630 2024-03-16T21:00:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fecc47740 10 client.0 _ll_register_callbacks cb 0x55ca2126f960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fe2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fe2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43312/0 (socket says 172.21.15.8:43312) 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fe2a00640 1 -- 172.21.15.8:0/2223695967 learned_addr learned my addr 172.21.15.8:0/2223695967 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134f2c0 0x55ca213555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.335+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca21358630 0x55ca21356030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.336+0000 7f0fe2a00640 1 -- 172.21.15.8:0/2223695967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca21358630 msgr2=0x55ca21356030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.336+0000 7f0fe2a00640 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca21358630 0x55ca21356030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.336+0000 7f0fe2a00640 1 -- 172.21.15.8:0/2223695967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134f2c0 msgr2=0x55ca213555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.336+0000 7f0fe2a00640 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134f2c0 0x55ca213555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.336+0000 7f0fe2a00640 1 -- 172.21.15.8:0/2223695967 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc009a50 con 0x55ca2134ffa0 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.336+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134f2c0 0x55ca213555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.336+0000 7f0fe2a00640 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355af0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc010680 tx=0x7f0fcc010b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3568dab9183c9e8f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.336+0000 7f0fd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.336+0000 7f0fd0c00640 1 -- 172.21.15.8:0/2223695967 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc00eab0 con 0x55ca2134ffa0 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.336+0000 7f0fd0c00640 1 -- 172.21.15.8:0/2223695967 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0fcc017070 con 0x55ca2134ffa0 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.336+0000 7f0fecc47740 1 -- 172.21.15.8:0/2223695967 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca20fb67e0 con 0x55ca2134ffa0 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fd0c00640 1 -- 172.21.15.8:0/2223695967 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fcc00ec10 con 0x55ca2134ffa0 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fecc47740 10 client.26195 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fecc47740 1 -- 172.21.15.8:0/2223695967 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ca212b54e0 con 0x55ca2134ffa0 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fd0c00640 1 -- 172.21.15.8:0/2223695967 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55ca20fb67e0 con 0x55ca2134ffa0 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fd0c00640 1 -- 172.21.15.8:0/2223695967 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f0fcc01b430 con 0x55ca2134ffa0 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fecc47740 10 client.26195 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fecc47740 10 client.26195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fecc47740 20 client.26195 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ca213687f0 0x55ca2136ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fecc47740 4 client.26195 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fecc47740 1 -- 172.21.15.8:0/2223695967 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca20ff3720 con 0x55ca213687f0 2024-03-16T21:00:28.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.337+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ca213687f0 0x55ca2136ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.338+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ca213687f0 0x55ca2136ac10 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=843892cb2b7aa2d9 server_cookie=f8e489a06480bb55 in_seq=0 out_seq=0 2024-03-16T21:00:28.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.338+0000 7f0fd0c00640 10 client.26195 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fd0c00640 1 -- 172.21.15.8:0/2223695967 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ca20ff3720 con 0x55ca213687f0 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fd0c00640 10 client.26195 handle_command_reply: tid=0 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fecc47740 1 client.26195 shutdown 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fecc47740 1 -- 172.21.15.8:0/2223695967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 msgr2=0x55ca21355af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355af0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc010680 tx=0x7f0fcc010b40 comp rx=0 tx=0).stop 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fecc47740 1 -- 172.21.15.8:0/2223695967 shutdown_connections 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca21358630 0x55ca21356030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355af0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ca213687f0 0x55ca2136ac10 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2223695967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134f2c0 0x55ca213555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fecc47740 1 -- 172.21.15.8:0/2223695967 >> 172.21.15.8:0/2223695967 conn(0x55ca213165a0 msgr2=0x55ca2134ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.340+0000 7f0fd0c00640 0 client.26195 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.341+0000 7f0fecc47740 1 -- 172.21.15.8:0/2223695967 shutdown_connections 2024-03-16T21:00:28.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.341+0000 7f0fecc47740 1 -- 172.21.15.8:0/2223695967 wait complete. 2024-03-16T21:00:28.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.341+0000 7f0fecc47740 20 client.26195 trim_cache size 0 max 16384 2024-03-16T21:00:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.360+0000 7f0fecc47740 1 Processor -- start 2024-03-16T21:00:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.360+0000 7f0fecc47740 1 -- start start 2024-03-16T21:00:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.360+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134f2c0 0x55ca2134b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca21358630 0x55ca21348cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fecc47740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca21365250 con 0x55ca21358630 2024-03-16T21:00:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fecc47740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2134af40 con 0x55ca2134ffa0 2024-03-16T21:00:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fecc47740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2134e540 con 0x55ca2134f2c0 2024-03-16T21:00:28.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fe2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fe3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134f2c0 0x55ca2134b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fe2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43328/0 (socket says 172.21.15.8:43328) 2024-03-16T21:00:28.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fe2a00640 1 -- 172.21.15.8:0/2308972366 learned_addr learned my addr 172.21.15.8:0/2308972366 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:28.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/2308972366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca21358630 0x55ca21348cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fe2a00640 1 -- 172.21.15.8:0/2308972366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134f2c0 msgr2=0x55ca2134b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fe2a00640 1 --2- 172.21.15.8:0/2308972366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134f2c0 0x55ca2134b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fe2a00640 1 -- 172.21.15.8:0/2308972366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca21358630 msgr2=0x55ca21348cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fe2a00640 1 --2- 172.21.15.8:0/2308972366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca21358630 0x55ca21348cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.361+0000 7f0fe2a00640 1 -- 172.21.15.8:0/2308972366 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca21251950 con 0x55ca2134ffa0 2024-03-16T21:00:28.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.362+0000 7f0fe2a00640 1 --2- 172.21.15.8:0/2308972366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355e50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc010650 tx=0x7f0fcc005b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b65d933e996853d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:28.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.362+0000 7f0fd3400640 1 -- 172.21.15.8:0/2308972366 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc01ba00 con 0x55ca2134ffa0 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.362+0000 7f0fd3400640 1 -- 172.21.15.8:0/2308972366 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0fcc015070 con 0x55ca2134ffa0 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.362+0000 7f0fd3400640 1 -- 172.21.15.8:0/2308972366 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc0035f0 con 0x55ca2134ffa0 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.363+0000 7f0fecc47740 1 -- 172.21.15.8:0/2308972366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 msgr2=0x55ca21355e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.363+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2308972366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355e50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc010650 tx=0x7f0fcc005b90 comp rx=0 tx=0).stop 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.363+0000 7f0fecc47740 1 -- 172.21.15.8:0/2308972366 shutdown_connections 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.363+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2308972366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca21358630 0x55ca21348cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.363+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2308972366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2134ffa0 0x55ca21355e50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.363+0000 7f0fecc47740 1 --2- 172.21.15.8:0/2308972366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134f2c0 0x55ca2134b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.363+0000 7f0fecc47740 1 -- 172.21.15.8:0/2308972366 >> 172.21.15.8:0/2308972366 conn(0x55ca213165a0 msgr2=0x55ca213485a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.363+0000 7f0fecc47740 1 -- 172.21.15.8:0/2308972366 shutdown_connections 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.363+0000 7f0fecc47740 1 -- 172.21.15.8:0/2308972366 wait complete. 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.364+0000 7f0fecc47740 1 -- start start 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.364+0000 7f0fecc47740 1 Processor -- start 2024-03-16T21:00:28.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.364+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134f2c0 0x55ca21360060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.364+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134ffa0 0x55ca213526a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.364+0000 7f0fecc47740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca21358630 0x55ca21352be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.364+0000 7f0fecc47740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca21353120 con 0x55ca2134ffa0 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.364+0000 7f0fecc47740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca21353290 con 0x55ca21358630 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.364+0000 7f0fecc47740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca21353450 con 0x55ca2134f2c0 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.364+0000 7f0fecc47740 10 client.0 _ll_register_callbacks cb 0x7f0fcc00bdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.365+0000 7f0fe2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134ffa0 0x55ca213526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.365+0000 7f0fe3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134f2c0 0x55ca21360060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.365+0000 7f0fe2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134ffa0 0x55ca213526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33172/0 (socket says 172.21.15.8:33172) 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.365+0000 7f0fe2a00640 1 -- 172.21.15.8:0/561826679 learned_addr learned my addr 172.21.15.8:0/561826679 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.365+0000 7f0fe3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134f2c0 0x55ca21360060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48558/0 (socket says 172.21.15.8:48558) 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.365+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca21358630 0x55ca21352be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.365+0000 7f0fe2a00640 1 -- 172.21.15.8:0/561826679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134f2c0 msgr2=0x55ca21360060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.365+0000 7f0fe2a00640 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134f2c0 0x55ca21360060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.365+0000 7f0fe2a00640 1 -- 172.21.15.8:0/561826679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca21358630 msgr2=0x55ca21352be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.365+0000 7f0fe2a00640 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca21358630 0x55ca21352be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.365+0000 7f0fe2a00640 1 -- 172.21.15.8:0/561826679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca212b54e0 con 0x55ca2134ffa0 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.366+0000 7f0fe2a00640 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134ffa0 0x55ca213526a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc01b860 tx=0x7f0fcc00b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0101ed9247d6f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.366+0000 7f0fd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.366+0000 7f0fd0c00640 1 -- 172.21.15.8:0/561826679 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc01b9b0 con 0x55ca2134ffa0 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.366+0000 7f0fd0c00640 1 -- 172.21.15.8:0/561826679 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0fcc017040 con 0x55ca2134ffa0 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.366+0000 7f0fecc47740 1 -- 172.21.15.8:0/561826679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0fdc004450 con 0x55ca2134ffa0 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.366+0000 7f0fd0c00640 1 -- 172.21.15.8:0/561826679 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fcc01bb10 con 0x55ca2134ffa0 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.366+0000 7f0fecc47740 10 client.16038 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.366+0000 7f0fecc47740 1 -- 172.21.15.8:0/561826679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ca21277430 con 0x55ca2134ffa0 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.366+0000 7f0fd0c00640 1 -- 172.21.15.8:0/561826679 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0fdc004450 con 0x55ca2134ffa0 2024-03-16T21:00:28.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.367+0000 7f0fd0c00640 1 -- 172.21.15.8:0/561826679 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f0fcc02c580 con 0x55ca2134ffa0 2024-03-16T21:00:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.367+0000 7f0fecc47740 10 client.16038 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.367+0000 7f0fecc47740 10 client.16038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.367+0000 7f0fecc47740 20 client.16038 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.367+0000 7f0fecc47740 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ca213c5110 0x55ca213c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.367+0000 7f0fecc47740 4 client.16038 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:00:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.367+0000 7f0fecc47740 1 -- 172.21.15.8:0/561826679 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ca21042890 con 0x55ca213c5110 2024-03-16T21:00:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.367+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ca213c5110 0x55ca213c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.367+0000 7f0fe3e00640 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ca213c5110 0x55ca213c7530 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d38793f385f9f04 server_cookie=e7eec3c2b934ddc3 in_seq=0 out_seq=0 2024-03-16T21:00:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.367+0000 7f0fd0c00640 10 client.16038 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fd0c00640 1 -- 172.21.15.8:0/561826679 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x55ca21042890 con 0x55ca213c5110 2024-03-16T21:00:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fd0c00640 10 client.16038 handle_command_reply: tid=0 2024-03-16T21:00:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 1 client.16038 shutdown 2024-03-16T21:00:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 1 -- 172.21.15.8:0/561826679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134ffa0 msgr2=0x55ca213526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134ffa0 0x55ca213526a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc01b860 tx=0x7f0fcc00b490 comp rx=0 tx=0).stop 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 1 -- 172.21.15.8:0/561826679 shutdown_connections 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca21358630 0x55ca21352be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ca213c5110 0x55ca213c7530 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca2134ffa0 0x55ca213526a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 1 --2- 172.21.15.8:0/561826679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca2134f2c0 0x55ca21360060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 1 -- 172.21.15.8:0/561826679 >> 172.21.15.8:0/561826679 conn(0x55ca213165a0 msgr2=0x55ca21348e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fd0c00640 0 client.16038 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 1 -- 172.21.15.8:0/561826679 shutdown_connections 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 1 -- 172.21.15.8:0/561826679 wait complete. 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.370+0000 7f0fecc47740 20 client.16038 trim_cache size 0 max 16384 2024-03-16T21:00:28.377 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:00:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1318 inodes in the stack)", 2024-03-16T21:00:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:00:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: "4c1df3d9-0c61-4bfa-a1a5-6b48ef337ce8": { 2024-03-16T21:00:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:00:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "4c1df3d9-0c61-4bfa-a1a5-6b48ef337ce8", 2024-03-16T21:00:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:00:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:00:28.378 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:00:28.378 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:00:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 -- 172.21.15.8:0/3825014261 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fc80a1ba0 msgr2=0x7f0fc80a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fc80a1ba0 0x7f0fc80a4060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40ed920 tx=0x7f0fd40f3af0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 -- 172.21.15.8:0/3825014261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fe4103690 msgr2=0x7f0fe4199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fe4103690 0x7f0fe4199ef0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0fd402c700 tx=0x7f0fd4034670 comp rx=0 tx=0).stop 2024-03-16T21:00:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 -- 172.21.15.8:0/3825014261 shutdown_connections 2024-03-16T21:00:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fc80a1ba0 0x7f0fc80a4060 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fe41096a0 0x7f0fe419e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fe4104050 0x7f0fe419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 --2- 172.21.15.8:0/3825014261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fe4103690 0x7f0fe4199ef0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 -- 172.21.15.8:0/3825014261 >> 172.21.15.8:0/3825014261 conn(0x7f0fe40ff1a0 msgr2=0x7f0fe40ff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 -- 172.21.15.8:0/3825014261 shutdown_connections 2024-03-16T21:00:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:28.371+0000 7f0fea000640 1 -- 172.21.15.8:0/3825014261 wait complete. 2024-03-16T21:00:28.394 INFO:tasks.cephfs.filesystem:scrub status for tag:4c1df3d9-0c61-4bfa-a1a5-6b48ef337ce8 - {'path': '/', 'tag': '4c1df3d9-0c61-4bfa-a1a5-6b48ef337ce8', 'options': 'recursive,force'} 2024-03-16T21:00:28.966 INFO:tasks.workunit.client.0.smithi008.stderr:+ echo Ok 2024-03-16T21:00:28.966 INFO:tasks.workunit.client.0.smithi008.stdout:Ok 2024-03-16T21:00:28.969 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-16T21:00:28.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-16T21:00:29.050 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:28 smithi008 ceph-mon[31434]: pgmap v82: 97 pgs: 97 active+clean; 189 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 541 op/s 2024-03-16T21:00:29.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:28 smithi170 ceph-mon[35947]: pgmap v82: 97 pgs: 97 active+clean; 189 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 541 op/s 2024-03-16T21:00:29.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:28 smithi186 ceph-mon[36391]: pgmap v82: 97 pgs: 97 active+clean; 189 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 541 op/s 2024-03-16T21:00:30.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:29 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:00:30.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:29 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:00:30.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:29 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:00:30.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:29 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:00:30.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:29 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:00:30.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:29 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:00:30.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:29 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:00:30.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:29 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:00:30.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:29 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:00:31.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:30 smithi170 ceph-mon[35947]: pgmap v83: 97 pgs: 97 active+clean; 189 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 316 op/s 2024-03-16T21:00:31.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:30 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:00:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:30 smithi186 ceph-mon[36391]: pgmap v83: 97 pgs: 97 active+clean; 189 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 316 op/s 2024-03-16T21:00:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:30 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:00:31.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:30 smithi008 ceph-mon[31434]: pgmap v83: 97 pgs: 97 active+clean; 189 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 316 op/s 2024-03-16T21:00:31.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:30 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:00:33.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:32 smithi170 ceph-mon[35947]: pgmap v84: 97 pgs: 97 active+clean; 188 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 1.47k op/s 2024-03-16T21:00:33.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:32 smithi186 ceph-mon[36391]: pgmap v84: 97 pgs: 97 active+clean; 188 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 1.47k op/s 2024-03-16T21:00:33.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:32 smithi008 ceph-mon[31434]: pgmap v84: 97 pgs: 97 active+clean; 188 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 1.47k op/s 2024-03-16T21:00:34.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:33 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:00:34.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:33 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:00:34.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:33 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:00:35.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:34 smithi170 ceph-mon[35947]: pgmap v85: 97 pgs: 97 active+clean; 188 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 1.36k op/s 2024-03-16T21:00:35.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:34 smithi186 ceph-mon[36391]: pgmap v85: 97 pgs: 97 active+clean; 188 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 1.36k op/s 2024-03-16T21:00:35.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:34 smithi008 ceph-mon[31434]: pgmap v85: 97 pgs: 97 active+clean; 188 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 1.36k op/s 2024-03-16T21:00:37.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:36 smithi170 ceph-mon[35947]: pgmap v86: 97 pgs: 97 active+clean; 188 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 1.36k op/s 2024-03-16T21:00:37.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:36 smithi186 ceph-mon[36391]: pgmap v86: 97 pgs: 97 active+clean; 188 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 1.36k op/s 2024-03-16T21:00:37.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:36 smithi008 ceph-mon[31434]: pgmap v86: 97 pgs: 97 active+clean; 188 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 1.36k op/s 2024-03-16T21:00:39.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:38 smithi170 ceph-mon[35947]: pgmap v87: 97 pgs: 97 active+clean; 195 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 1.49k op/s 2024-03-16T21:00:39.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:38 smithi186 ceph-mon[36391]: pgmap v87: 97 pgs: 97 active+clean; 195 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 1.49k op/s 2024-03-16T21:00:39.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:38 smithi008 ceph-mon[31434]: pgmap v87: 97 pgs: 97 active+clean; 195 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 1.49k op/s 2024-03-16T21:00:41.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:40 smithi170 ceph-mon[35947]: pgmap v88: 97 pgs: 97 active+clean; 195 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 1.29k op/s 2024-03-16T21:00:41.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:40 smithi186 ceph-mon[36391]: pgmap v88: 97 pgs: 97 active+clean; 195 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 1.29k op/s 2024-03-16T21:00:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.223+0000 7fccbc800640 1 -- 172.21.15.8:0/3720504083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccb41096b0 msgr2=0x7fccb4109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.223+0000 7fccbc800640 1 --2- 172.21.15.8:0/3720504083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccb41096b0 0x7fccb4109a90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009860 tx=0x7fcca802bb70 comp rx=0 tx=0).stop 2024-03-16T21:00:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.223+0000 7fccbc800640 1 -- 172.21.15.8:0/3720504083 shutdown_connections 2024-03-16T21:00:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.223+0000 7fccbc800640 1 --2- 172.21.15.8:0/3720504083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccb4104060 0x7fccb4110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.223+0000 7fccbc800640 1 --2- 172.21.15.8:0/3720504083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccb41036a0 0x7fccb4103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.223+0000 7fccbc800640 1 --2- 172.21.15.8:0/3720504083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccb41096b0 0x7fccb4109a90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.223+0000 7fccbc800640 1 -- 172.21.15.8:0/3720504083 >> 172.21.15.8:0/3720504083 conn(0x7fccb40ff170 msgr2=0x7fccb4101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.223+0000 7fccbc800640 1 -- 172.21.15.8:0/3720504083 shutdown_connections 2024-03-16T21:00:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.223+0000 7fccbc800640 1 -- 172.21.15.8:0/3720504083 wait complete. 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.224+0000 7fccbc800640 1 Processor -- start 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.224+0000 7fccbc800640 1 -- start start 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.225+0000 7fccbc800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccb41036a0 0x7fccb4199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.225+0000 7fccbc800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccb4104060 0x7fccb419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.225+0000 7fccbc800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccb41096b0 0x7fccb419e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.225+0000 7fccbc800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb419ec60 con 0x7fccb41096b0 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.225+0000 7fccbc800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb419edd0 con 0x7fccb41036a0 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.225+0000 7fccbc800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb419ef90 con 0x7fccb4104060 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.225+0000 7fccb9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccb4104060 0x7fccb419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.225+0000 7fccb9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccb4104060 0x7fccb419a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59316/0 (socket says 172.21.15.8:59316) 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.225+0000 7fccb9400640 1 -- 172.21.15.8:0/62431252 learned_addr learned my addr 172.21.15.8:0/62431252 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.225+0000 7fccba800640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccb41096b0 0x7fccb419e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.225+0000 7fccb9e00640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccb41036a0 0x7fccb4199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.226+0000 7fccb9400640 1 -- 172.21.15.8:0/62431252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccb41036a0 msgr2=0x7fccb4199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.226+0000 7fccb9400640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccb41036a0 0x7fccb4199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.226+0000 7fccb9400640 1 -- 172.21.15.8:0/62431252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccb41096b0 msgr2=0x7fccb419e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.226+0000 7fccb9400640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccb41096b0 0x7fccb419e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.226+0000 7fccb9400640 1 -- 172.21.15.8:0/62431252 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca8009490 con 0x7fccb4104060 2024-03-16T21:00:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.226+0000 7fccb9400640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccb4104060 0x7fccb419a2e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcca400e9c0 tx=0x7fcca400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.226+0000 7fccaea00640 1 -- 172.21.15.8:0/62431252 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca400ccc0 con 0x7fccb4104060 2024-03-16T21:00:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.226+0000 7fccaea00640 1 -- 172.21.15.8:0/62431252 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcca400ce20 con 0x7fccb4104060 2024-03-16T21:00:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.226+0000 7fccaea00640 1 -- 172.21.15.8:0/62431252 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4010430 con 0x7fccb4104060 2024-03-16T21:00:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.226+0000 7fccbc800640 1 -- 172.21.15.8:0/62431252 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb419f270 con 0x7fccb4104060 2024-03-16T21:00:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.226+0000 7fccbc800640 1 -- 172.21.15.8:0/62431252 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb41a6af0 con 0x7fccb4104060 2024-03-16T21:00:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.229+0000 7fccbf419740 1 Processor -- start 2024-03-16T21:00:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccbf419740 1 -- start start 2024-03-16T21:00:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccaea00640 1 -- 172.21.15.8:0/62431252 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fcca40046c0 con 0x7fccb4104060 2024-03-16T21:00:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccbf419740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x558091334870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccbf419740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x558091335230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccbf419740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x558091340720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccbf419740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580912f0620 con 0x558091334db0 2024-03-16T21:00:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccbf419740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580912a28c0 con 0x55809133e330 2024-03-16T21:00:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccbf419740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55809129fdf0 con 0x558091335b20 2024-03-16T21:00:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccba800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x558091334870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccba800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x558091334870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59328/0 (socket says 172.21.15.8:59328) 2024-03-16T21:00:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccba800640 1 -- 172.21.15.8:0/440553569 learned_addr learned my addr 172.21.15.8:0/440553569 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.230+0000 7fccb9e00640 1 --2- 172.21.15.8:0/440553569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x558091335230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fccb9400640 1 --2- 172.21.15.8:0/440553569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x558091340720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fccba800640 1 -- 172.21.15.8:0/440553569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 msgr2=0x558091340720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fccba800640 1 --2- 172.21.15.8:0/440553569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x558091340720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fccba800640 1 -- 172.21.15.8:0/440553569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 msgr2=0x558091335230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fccba800640 1 --2- 172.21.15.8:0/440553569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x558091335230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fccba800640 1 -- 172.21.15.8:0/440553569 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55809121cb00 con 0x558091335b20 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fccb9400640 1 --2- 172.21.15.8:0/440553569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x558091340720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fccba800640 1 --2- 172.21.15.8:0/440553569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x558091334870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009f90 tx=0x7fccb0010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c58ff01fc37ee2be server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fccaea00640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcc9c0a1cc0 0x7fcc9c0a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fcca3000640 1 -- 172.21.15.8:0/440553569 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0011700 con 0x558091335b20 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fcca3000640 1 -- 172.21.15.8:0/440553569 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fccb0015070 con 0x558091335b20 2024-03-16T21:00:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.231+0000 7fcca3000640 1 -- 172.21.15.8:0/440553569 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0019d40 con 0x558091335b20 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.232+0000 7fccaea00640 1 -- 172.21.15.8:0/62431252 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcca4014070 con 0x7fccb4104060 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.232+0000 7fccb9e00640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcc9c0a1cc0 0x7fcc9c0a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.232+0000 7fccbf419740 1 -- 172.21.15.8:0/440553569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 msgr2=0x558091334870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.232+0000 7fccbf419740 1 --2- 172.21.15.8:0/440553569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x558091334870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009f90 tx=0x7fccb0010860 comp rx=0 tx=0).stop 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.232+0000 7fccbf419740 1 -- 172.21.15.8:0/440553569 shutdown_connections 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.232+0000 7fccbf419740 1 --2- 172.21.15.8:0/440553569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x558091340720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.232+0000 7fccbf419740 1 --2- 172.21.15.8:0/440553569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x558091335230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.232+0000 7fccbf419740 1 --2- 172.21.15.8:0/440553569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x558091334870 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.232+0000 7fccbf419740 1 -- 172.21.15.8:0/440553569 >> 172.21.15.8:0/440553569 conn(0x5580912fc4b0 msgr2=0x55809132faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.232+0000 7fccbf419740 1 -- 172.21.15.8:0/440553569 shutdown_connections 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.232+0000 7fccbf419740 1 -- 172.21.15.8:0/440553569 wait complete. 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.233+0000 7fccb9e00640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcc9c0a1cc0 0x7fcc9c0a4180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcca802c180 tx=0x7fcca80056d0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.233+0000 7fccbf419740 1 -- start start 2024-03-16T21:00:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.233+0000 7fccbf419740 1 Processor -- start 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccbf419740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x55809133b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccbf419740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x55809133b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccbf419740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x55809133be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccbf419740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55809129b5d0 con 0x558091334db0 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccbf419740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558091240b50 con 0x55809133e330 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccbf419740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580912407f0 con 0x558091335b20 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccbf419740 10 client.0 _ll_register_callbacks cb 0x558091254550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccb9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x55809133b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccba800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x55809133be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccb9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x55809133b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59340/0 (socket says 172.21.15.8:59340) 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccb9400640 1 -- 172.21.15.8:0/1033880019 learned_addr learned my addr 172.21.15.8:0/1033880019 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccb9e00640 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x55809133b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccba800640 1 -- 172.21.15.8:0/1033880019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 msgr2=0x55809133b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccba800640 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x55809133b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccba800640 1 -- 172.21.15.8:0/1033880019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 msgr2=0x55809133b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccba800640 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x55809133b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccba800640 1 -- 172.21.15.8:0/1033880019 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb0009bf0 con 0x55809133e330 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.234+0000 7fccb9400640 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x55809133b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.235+0000 7fccba800640 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x55809133be50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fccb0019840 tx=0x7fccb00194e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae0644fb031f2140 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.235+0000 7fcc97400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.235+0000 7fcc97400640 1 -- 172.21.15.8:0/1033880019 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0004c40 con 0x55809133e330 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.235+0000 7fccbf419740 1 -- 172.21.15.8:0/1033880019 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55809126dcd0 con 0x55809133e330 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.235+0000 7fcc97400640 1 -- 172.21.15.8:0/1033880019 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fccb0004da0 con 0x55809133e330 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.235+0000 7fcc97400640 1 -- 172.21.15.8:0/1033880019 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccb0019a40 con 0x55809133e330 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.235+0000 7fccbf419740 10 client.26213 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.235+0000 7fccbf419740 1 -- 172.21.15.8:0/1033880019 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558091299c50 con 0x55809133e330 2024-03-16T21:00:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.235+0000 7fcc97400640 1 -- 172.21.15.8:0/1033880019 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fccb0030020 con 0x55809133e330 2024-03-16T21:00:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.236+0000 7fcc97400640 1 -- 172.21.15.8:0/1033880019 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fccb0004280 con 0x55809133e330 2024-03-16T21:00:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.236+0000 7fccbf419740 10 client.26213 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.236+0000 7fccbf419740 10 client.26213 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.236+0000 7fccbf419740 20 client.26213 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.236+0000 7fccbf419740 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55809134e2e0 0x558091350700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.236+0000 7fccbf419740 4 client.26213 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.236+0000 7fccbf419740 1 -- 172.21.15.8:0/1033880019 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558091291ce0 con 0x55809134e2e0 2024-03-16T21:00:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.236+0000 7fccb9e00640 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55809134e2e0 0x558091350700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.237+0000 7fccb9e00640 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55809134e2e0 0x558091350700 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f2f740b4c4d9c8 server_cookie=8a0c5178b5428f7a in_seq=0 out_seq=0 2024-03-16T21:00:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.237+0000 7fcc97400640 10 client.26213 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fcc97400640 1 -- 172.21.15.8:0/1033880019 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x558091291ce0 con 0x55809134e2e0 2024-03-16T21:00:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fcc97400640 10 client.26213 handle_command_reply: tid=0 2024-03-16T21:00:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 1 client.26213 shutdown 2024-03-16T21:00:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 1 -- 172.21.15.8:0/1033880019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 msgr2=0x55809133be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x55809133be50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fccb0019840 tx=0x7fccb00194e0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 1 -- 172.21.15.8:0/1033880019 shutdown_connections 2024-03-16T21:00:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x55809133be50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x55809133b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55809134e2e0 0x558091350700 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 1 --2- 172.21.15.8:0/1033880019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x55809133b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fcc97400640 0 client.26213 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:41.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 1 -- 172.21.15.8:0/1033880019 >> 172.21.15.8:0/1033880019 conn(0x5580912fc4b0 msgr2=0x5580913317f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:41.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 1 -- 172.21.15.8:0/1033880019 shutdown_connections 2024-03-16T21:00:41.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 1 -- 172.21.15.8:0/1033880019 wait complete. 2024-03-16T21:00:41.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.238+0000 7fccbf419740 20 client.26213 trim_cache size 0 max 16384 2024-03-16T21:00:41.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:40 smithi008 ceph-mon[31434]: pgmap v88: 97 pgs: 97 active+clean; 195 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 1.29k op/s 2024-03-16T21:00:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.255+0000 7fccbf419740 1 Processor -- start 2024-03-16T21:00:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.255+0000 7fccbf419740 1 -- start start 2024-03-16T21:00:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.255+0000 7fccbf419740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x55809133db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.255+0000 7fccbf419740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x55809132f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.255+0000 7fccbf419740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x55809133bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.255+0000 7fccbf419740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558090fe3e60 con 0x558091334db0 2024-03-16T21:00:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.255+0000 7fccbf419740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55809132fda0 con 0x55809133e330 2024-03-16T21:00:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.255+0000 7fccbf419740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558091330aa0 con 0x558091335b20 2024-03-16T21:00:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.256+0000 7fccba800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x55809133bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.256+0000 7fccb9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x55809133db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.256+0000 7fccba800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x55809133bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44378/0 (socket says 172.21.15.8:44378) 2024-03-16T21:00:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.256+0000 7fccba800640 1 -- 172.21.15.8:0/3162677672 learned_addr learned my addr 172.21.15.8:0/3162677672 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.256+0000 7fccba800640 1 -- 172.21.15.8:0/3162677672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 msgr2=0x55809132f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.256+0000 7fccba800640 1 --2- 172.21.15.8:0/3162677672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x55809132f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.256+0000 7fccba800640 1 -- 172.21.15.8:0/3162677672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 msgr2=0x55809133db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.256+0000 7fccba800640 1 --2- 172.21.15.8:0/3162677672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x55809133db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.256+0000 7fccba800640 1 -- 172.21.15.8:0/3162677672 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558091236530 con 0x55809133e330 2024-03-16T21:00:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.256+0000 7fccba800640 1 --2- 172.21.15.8:0/3162677672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x55809133bc70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fccb0019810 tx=0x7fccb0009e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c27407f395b487b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.257+0000 7fcca2600640 1 -- 172.21.15.8:0/3162677672 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0010e10 con 0x55809133e330 2024-03-16T21:00:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.257+0000 7fcca2600640 1 -- 172.21.15.8:0/3162677672 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fccb0030070 con 0x55809133e330 2024-03-16T21:00:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.257+0000 7fcca2600640 1 -- 172.21.15.8:0/3162677672 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0004e20 con 0x55809133e330 2024-03-16T21:00:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.257+0000 7fccbf419740 1 -- 172.21.15.8:0/3162677672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 msgr2=0x55809133bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.257+0000 7fccbf419740 1 --2- 172.21.15.8:0/3162677672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x55809133bc70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fccb0019810 tx=0x7fccb0009e10 comp rx=0 tx=0).stop 2024-03-16T21:00:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.258+0000 7fccbf419740 1 -- 172.21.15.8:0/3162677672 shutdown_connections 2024-03-16T21:00:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.258+0000 7fccbf419740 1 --2- 172.21.15.8:0/3162677672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55809133e330 0x55809133bc70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.258+0000 7fccbf419740 1 --2- 172.21.15.8:0/3162677672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x55809132f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.258+0000 7fccbf419740 1 --2- 172.21.15.8:0/3162677672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558091334db0 0x55809133db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.258+0000 7fccbf419740 1 -- 172.21.15.8:0/3162677672 >> 172.21.15.8:0/3162677672 conn(0x5580912fc4b0 msgr2=0x55809132ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.258+0000 7fccbf419740 1 -- 172.21.15.8:0/3162677672 shutdown_connections 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.258+0000 7fccbf419740 1 -- 172.21.15.8:0/3162677672 wait complete. 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.258+0000 7fccbf419740 1 -- start start 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.258+0000 7fccbf419740 1 Processor -- start 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccbf419740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558091334db0 0x5580913a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccbf419740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x5580913a2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccbf419740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55809133e330 0x558091341e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccbf419740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580913424f0 con 0x55809133e330 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccbf419740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558091342660 con 0x558091334db0 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccbf419740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558091342820 con 0x558091335b20 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccbf419740 10 client.0 _ll_register_callbacks cb 0x7fccb0005bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccb9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x5580913a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccb9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x5580913a2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59350/0 (socket says 172.21.15.8:59350) 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccb9400640 1 -- 172.21.15.8:0/1253475891 learned_addr learned my addr 172.21.15.8:0/1253475891 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccb9e00640 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558091334db0 0x5580913a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccba800640 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55809133e330 0x558091341e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccb9400640 1 -- 172.21.15.8:0/1253475891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558091334db0 msgr2=0x5580913a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccb9400640 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558091334db0 0x5580913a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccb9400640 1 -- 172.21.15.8:0/1253475891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55809133e330 msgr2=0x558091341e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccb9400640 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55809133e330 0x558091341e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccb9400640 1 -- 172.21.15.8:0/1253475891 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558091299c50 con 0x558091335b20 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccb9e00640 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558091334db0 0x5580913a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.259+0000 7fccba800640 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55809133e330 0x558091341e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fccb9400640 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x5580913a2410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcca409a310 tx=0x7fcca4005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50423fbb19c475fa server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fcc97400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fcc97400640 1 -- 172.21.15.8:0/1253475891 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca409a610 con 0x558091335b20 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fccbf419740 1 -- 172.21.15.8:0/1253475891 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580912c0d30 con 0x558091335b20 2024-03-16T21:00:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fcc97400640 1 -- 172.21.15.8:0/1253475891 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcca409e760 con 0x558091335b20 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fcc97400640 1 -- 172.21.15.8:0/1253475891 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcca40a2db0 con 0x558091335b20 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fccbf419740 10 client.26224 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fccbf419740 1 -- 172.21.15.8:0/1253475891 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55809125c2c0 con 0x558091335b20 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fcc97400640 1 -- 172.21.15.8:0/1253475891 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5580912c0d30 con 0x558091335b20 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fcc97400640 1 -- 172.21.15.8:0/1253475891 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fcca401f060 con 0x558091335b20 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fccbf419740 10 client.26224 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fccbf419740 10 client.26224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fccbf419740 20 client.26224 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.260+0000 7fccbf419740 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5580913aae80 0x5580913ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.261+0000 7fccbf419740 4 client.26224 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.261+0000 7fccbf419740 1 -- 172.21.15.8:0/1253475891 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558090f9b600 con 0x5580913aae80 2024-03-16T21:00:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.261+0000 7fccb9e00640 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5580913aae80 0x5580913ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.261+0000 7fccb9e00640 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5580913aae80 0x5580913ad2a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe3b53ecd91c606c server_cookie=f323b7398f192ea8 in_seq=0 out_seq=0 2024-03-16T21:00:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.261+0000 7fcc97400640 10 client.26224 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.340+0000 7fcc97400640 1 -- 172.21.15.8:0/1253475891 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558090f9b600 con 0x5580913aae80 2024-03-16T21:00:41.345 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.340+0000 7fcc97400640 10 client.26224 handle_command_reply: tid=0 2024-03-16T21:00:41.345 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.340+0000 7fccbf419740 1 client.26224 shutdown 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fccbf419740 1 -- 172.21.15.8:0/1253475891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 msgr2=0x5580913a2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fccbf419740 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x5580913a2410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcca409a310 tx=0x7fcca4005740 comp rx=0 tx=0).stop 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fccbf419740 1 -- 172.21.15.8:0/1253475891 shutdown_connections 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fccbf419740 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5580913aae80 0x5580913ad2a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fccbf419740 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55809133e330 0x558091341e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fccbf419740 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558091335b20 0x5580913a2410 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fccbf419740 1 --2- 172.21.15.8:0/1253475891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558091334db0 0x5580913a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fcc97400640 0 client.26224 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fccbf419740 1 -- 172.21.15.8:0/1253475891 >> 172.21.15.8:0/1253475891 conn(0x5580912fc4b0 msgr2=0x558091330be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fccbf419740 1 -- 172.21.15.8:0/1253475891 shutdown_connections 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fccbf419740 1 -- 172.21.15.8:0/1253475891 wait complete. 2024-03-16T21:00:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.342+0000 7fccbf419740 20 client.26224 trim_cache size 0 max 16384 2024-03-16T21:00:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2024-03-16T21:00:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2024-03-16T21:00:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2024-03-16T21:00:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2024-03-16T21:00:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 -- 172.21.15.8:0/62431252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcc9c0a1cc0 msgr2=0x7fcc9c0a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcc9c0a1cc0 0x7fcc9c0a4180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcca802c180 tx=0x7fcca80056d0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 -- 172.21.15.8:0/62431252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccb4104060 msgr2=0x7fccb419a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccb4104060 0x7fccb419a2e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcca400e9c0 tx=0x7fcca400ee80 comp rx=0 tx=0).stop 2024-03-16T21:00:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 -- 172.21.15.8:0/62431252 shutdown_connections 2024-03-16T21:00:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcc9c0a1cc0 0x7fcc9c0a4180 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fccb41096b0 0x7fccb419e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccb4104060 0x7fccb419a2e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 --2- 172.21.15.8:0/62431252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccb41036a0 0x7fccb4199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 -- 172.21.15.8:0/62431252 >> 172.21.15.8:0/62431252 conn(0x7fccb40ff170 msgr2=0x7fccb40ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 -- 172.21.15.8:0/62431252 shutdown_connections 2024-03-16T21:00:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2024-03-16T21:00:41.343+0000 7fccbc800640 1 -- 172.21.15.8:0/62431252 wait complete. 2024-03-16T21:00:42.350 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-03-16T21:00:42.350 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-16T21:00:43.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:42 smithi170 ceph-mon[35947]: pgmap v89: 97 pgs: 97 active+clean; 193 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.42k op/s 2024-03-16T21:00:43.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:42 smithi186 ceph-mon[36391]: pgmap v89: 97 pgs: 97 active+clean; 193 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.42k op/s 2024-03-16T21:00:43.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:42 smithi008 ceph-mon[31434]: pgmap v89: 97 pgs: 97 active+clean; 193 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.42k op/s 2024-03-16T21:00:43.479 DEBUG:teuthology.parallel:result is None 2024-03-16T21:00:43.479 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-16T21:00:43.584 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-16T21:00:43.584 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-03-16T21:00:43.594 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi008.front.sepia.ceph.com 2024-03-16T21:00:43.611 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-03-16T21:00:43.638 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-03-16T21:00:43.638 INFO:teuthology.task.exec:Executing custom commands... 2024-03-16T21:00:43.638 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2024-03-16T21:00:43.638 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-03-16T21:00:43.760 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-03-16T21:00:45.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:44 smithi170 ceph-mon[35947]: pgmap v90: 97 pgs: 97 active+clean; 193 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 265 op/s 2024-03-16T21:00:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:44 smithi186 ceph-mon[36391]: pgmap v90: 97 pgs: 97 active+clean; 193 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 265 op/s 2024-03-16T21:00:45.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:44 smithi008 ceph-mon[31434]: pgmap v90: 97 pgs: 97 active+clean; 193 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 265 op/s 2024-03-16T21:00:47.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:46 smithi170 ceph-mon[35947]: pgmap v91: 97 pgs: 97 active+clean; 193 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 265 op/s 2024-03-16T21:00:47.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:46 smithi186 ceph-mon[36391]: pgmap v91: 97 pgs: 97 active+clean; 193 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 265 op/s 2024-03-16T21:00:47.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:46 smithi008 ceph-mon[31434]: pgmap v91: 97 pgs: 97 active+clean; 193 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 265 op/s 2024-03-16T21:00:49.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:48 smithi170 ceph-mon[35947]: pgmap v92: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 401 op/s 2024-03-16T21:00:49.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:48 smithi186 ceph-mon[36391]: pgmap v92: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 401 op/s 2024-03-16T21:00:49.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:48 smithi008 ceph-mon[31434]: pgmap v92: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 401 op/s 2024-03-16T21:00:51.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:50 smithi170 ceph-mon[35947]: pgmap v93: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 879 KiB/s wr, 264 op/s 2024-03-16T21:00:51.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:50 smithi186 ceph-mon[36391]: pgmap v93: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 879 KiB/s wr, 264 op/s 2024-03-16T21:00:51.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:50 smithi008 ceph-mon[31434]: pgmap v93: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 879 KiB/s wr, 264 op/s 2024-03-16T21:00:53.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:52 smithi170 ceph-mon[35947]: pgmap v94: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 892 KiB/s wr, 271 op/s 2024-03-16T21:00:53.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:52 smithi186 ceph-mon[36391]: pgmap v94: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 892 KiB/s wr, 271 op/s 2024-03-16T21:00:53.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:52 smithi008 ceph-mon[31434]: pgmap v94: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 892 KiB/s wr, 271 op/s 2024-03-16T21:00:55.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:54 smithi170 ceph-mon[35947]: pgmap v95: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 313 KiB/s wr, 142 op/s 2024-03-16T21:00:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:54 smithi186 ceph-mon[36391]: pgmap v95: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 313 KiB/s wr, 142 op/s 2024-03-16T21:00:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:54 smithi008 ceph-mon[31434]: pgmap v95: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 313 KiB/s wr, 142 op/s 2024-03-16T21:00:57.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:56 smithi170 ceph-mon[35947]: pgmap v96: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 313 KiB/s wr, 142 op/s 2024-03-16T21:00:57.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:56 smithi186 ceph-mon[36391]: pgmap v96: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 313 KiB/s wr, 142 op/s 2024-03-16T21:00:57.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:56 smithi008 ceph-mon[31434]: pgmap v96: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 313 KiB/s wr, 142 op/s 2024-03-16T21:00:58.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:00:58.395 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:00:58.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.628+0000 7fad07a00640 1 -- 172.21.15.8:0/1249171148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad0010de90 msgr2=0x7fad00110280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.628+0000 7fad07a00640 1 --2- 172.21.15.8:0/1249171148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad0010de90 0x7fad00110280 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7facf8009ca0 tx=0x7facf802c100 comp rx=0 tx=0).stop 2024-03-16T21:00:58.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.628+0000 7fad07a00640 1 -- 172.21.15.8:0/1249171148 shutdown_connections 2024-03-16T21:00:58.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.628+0000 7fad07a00640 1 --2- 172.21.15.8:0/1249171148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad0010de90 0x7fad00110280 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.628+0000 7fad07a00640 1 --2- 172.21.15.8:0/1249171148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad00068ff0 0x7fad0010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.628+0000 7fad07a00640 1 --2- 172.21.15.8:0/1249171148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad000686d0 0x7fad00068ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.628+0000 7fad07a00640 1 -- 172.21.15.8:0/1249171148 >> 172.21.15.8:0/1249171148 conn(0x7fad000774f0 msgr2=0x7fad00077900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:58.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.628+0000 7fad07a00640 1 -- 172.21.15.8:0/1249171148 shutdown_connections 2024-03-16T21:00:58.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.628+0000 7fad07a00640 1 -- 172.21.15.8:0/1249171148 wait complete. 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.629+0000 7fad07a00640 1 Processor -- start 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.629+0000 7fad07a00640 1 -- start start 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.630+0000 7fad07a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad000686d0 0x7fad00199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.630+0000 7fad07a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad00068ff0 0x7fad0019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.630+0000 7fad07a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad0010de90 0x7fad0019e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.630+0000 7fad07a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0019ec20 con 0x7fad00068ff0 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.630+0000 7fad07a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0019ed90 con 0x7fad0010de90 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.630+0000 7fad07a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0019ef50 con 0x7fad000686d0 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.630+0000 7fad05a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad0010de90 0x7fad0019e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.630+0000 7fad05000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad000686d0 0x7fad00199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.630+0000 7fad05a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad0010de90 0x7fad0019e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35414/0 (socket says 172.21.15.8:35414) 2024-03-16T21:00:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.630+0000 7fad05a00640 1 -- 172.21.15.8:0/2540054465 learned_addr learned my addr 172.21.15.8:0/2540054465 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:58.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.630+0000 7facffe00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad00068ff0 0x7fad0019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7fad05a00640 1 -- 172.21.15.8:0/2540054465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad000686d0 msgr2=0x7fad00199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7fad05a00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad000686d0 0x7fad00199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7fad05a00640 1 -- 172.21.15.8:0/2540054465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad00068ff0 msgr2=0x7fad0019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7fad05a00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad00068ff0 0x7fad0019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7fad05a00640 1 -- 172.21.15.8:0/2540054465 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0009490 con 0x7fad0010de90 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7fad05000640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad000686d0 0x7fad00199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7facffe00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad00068ff0 0x7fad0019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7fad05a00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad0010de90 0x7fad0019e620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7facf802c710 tx=0x7facf8032990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7facfd600640 1 -- 172.21.15.8:0/2540054465 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8034650 con 0x7fad0010de90 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7facfd600640 1 -- 172.21.15.8:0/2540054465 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7facf8003e70 con 0x7fad0010de90 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7fad07a00640 1 -- 172.21.15.8:0/2540054465 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf8009900 con 0x7fad0010de90 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7facfd600640 1 -- 172.21.15.8:0/2540054465 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8004800 con 0x7fad0010de90 2024-03-16T21:00:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.631+0000 7fad07a00640 1 -- 172.21.15.8:0/2540054465 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad001a68d0 con 0x7fad0010de90 2024-03-16T21:00:58.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.634+0000 7fad0a78e740 1 Processor -- start 2024-03-16T21:00:58.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7facfd600640 1 -- 172.21.15.8:0/2540054465 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7facf803b040 con 0x7fad0010de90 2024-03-16T21:00:58.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7fad0a78e740 1 -- start start 2024-03-16T21:00:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d414133cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d414134740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d41413fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7fad0a78e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4140a3150 con 0x55d414134fa0 2024-03-16T21:00:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7fad0a78e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4140a0680 con 0x55d4141342c0 2024-03-16T21:00:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7fad0a78e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41409be60 con 0x55d41413d630 2024-03-16T21:00:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7fad05000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d414134740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7fad05000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d414134740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35418/0 (socket says 172.21.15.8:35418) 2024-03-16T21:00:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7fad05000640 1 -- 172.21.15.8:0/3632931115 learned_addr learned my addr 172.21.15.8:0/3632931115 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.635+0000 7facffe00640 1 --2- 172.21.15.8:0/3632931115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d414133cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7facffe00640 1 --2- 172.21.15.8:0/3632931115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d41413fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7fad05000640 1 -- 172.21.15.8:0/3632931115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 msgr2=0x55d41413fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7fad05000640 1 --2- 172.21.15.8:0/3632931115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d41413fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7fad05000640 1 -- 172.21.15.8:0/3632931115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 msgr2=0x55d414133cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7fad05000640 1 --2- 172.21.15.8:0/3632931115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d414133cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7fad05000640 1 -- 172.21.15.8:0/3632931115 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d414055060 con 0x55d4141342c0 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7facffe00640 1 --2- 172.21.15.8:0/3632931115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d414133cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7facfd600640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7face40a1ba0 0x7face40a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7fad05000640 1 --2- 172.21.15.8:0/3632931115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d414134740 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7facf00117e0 tx=0x7facf0011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=241f504c772503f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7facfd600640 1 -- 172.21.15.8:0/2540054465 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7facf80f02a0 con 0x7fad0010de90 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7facf6000640 1 -- 172.21.15.8:0/3632931115 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000fc60 con 0x55d4141342c0 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.636+0000 7facffe00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7face40a1ba0 0x7face40a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.637+0000 7facf6000640 1 -- 172.21.15.8:0/3632931115 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7facf000fdc0 con 0x55d4141342c0 2024-03-16T21:00:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.637+0000 7facf6000640 1 -- 172.21.15.8:0/3632931115 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000e830 con 0x55d4141342c0 2024-03-16T21:00:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.637+0000 7fad0a78e740 1 -- 172.21.15.8:0/3632931115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 msgr2=0x55d414134740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.637+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3632931115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d414134740 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7facf00117e0 tx=0x7facf0011ca0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.637+0000 7facffe00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7face40a1ba0 0x7face40a4060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7facec005f60 tx=0x7facec014040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.637+0000 7fad0a78e740 1 -- 172.21.15.8:0/3632931115 shutdown_connections 2024-03-16T21:00:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.637+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3632931115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d41413fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.637+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3632931115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d414134740 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.637+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3632931115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d414133cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.637+0000 7fad0a78e740 1 -- 172.21.15.8:0/3632931115 >> 172.21.15.8:0/3632931115 conn(0x55d4140fb5a0 msgr2=0x55d41412ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.637+0000 7fad0a78e740 1 -- 172.21.15.8:0/3632931115 shutdown_connections 2024-03-16T21:00:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.638+0000 7fad0a78e740 1 -- 172.21.15.8:0/3632931115 wait complete. 2024-03-16T21:00:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.638+0000 7fad0a78e740 1 -- start start 2024-03-16T21:00:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.638+0000 7fad0a78e740 1 Processor -- start 2024-03-16T21:00:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d41413ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d41413b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad0a78e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d414040ec0 con 0x55d414134fa0 2024-03-16T21:00:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad0a78e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d414040b60 con 0x55d4141342c0 2024-03-16T21:00:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad0a78e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d413e0a1c0 con 0x55d41413d630 2024-03-16T21:00:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad0a78e740 10 client.0 _ll_register_callbacks cb 0x55d414054960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad05000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7facffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d41413ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad05000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35426/0 (socket says 172.21.15.8:35426) 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad05000640 1 -- 172.21.15.8:0/752215776 learned_addr learned my addr 172.21.15.8:0/752215776 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad05a00640 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d41413b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad05000640 1 -- 172.21.15.8:0/752215776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 msgr2=0x55d41413b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad05000640 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d41413b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad05000640 1 -- 172.21.15.8:0/752215776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 msgr2=0x55d41413ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad05000640 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d41413ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad05000640 1 -- 172.21.15.8:0/752215776 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf0011440 con 0x55d4141342c0 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.639+0000 7fad05a00640 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d41413b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.640+0000 7fad05000640 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413a600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7facf0005270 tx=0x7facf00052a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=692845260107e18 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.640+0000 7faceaa00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.640+0000 7faceaa00640 1 -- 172.21.15.8:0/752215776 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00048c0 con 0x55d4141342c0 2024-03-16T21:00:58.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.640+0000 7faceaa00640 1 -- 172.21.15.8:0/752215776 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7facf0004a20 con 0x55d4141342c0 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.640+0000 7fad0a78e740 1 -- 172.21.15.8:0/752215776 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d413d9b7e0 con 0x55d4141342c0 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.640+0000 7faceaa00640 1 -- 172.21.15.8:0/752215776 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7facf0004be0 con 0x55d4141342c0 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.640+0000 7fad0a78e740 10 client.26231 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.640+0000 7fad0a78e740 1 -- 172.21.15.8:0/752215776 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55d41409a4e0 con 0x55d4141342c0 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.641+0000 7faceaa00640 1 -- 172.21.15.8:0/752215776 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55d413d9b7e0 con 0x55d4141342c0 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.641+0000 7faceaa00640 1 -- 172.21.15.8:0/752215776 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7facf000e680 con 0x55d4141342c0 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.641+0000 7fad0a78e740 10 client.26231 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.641+0000 7fad0a78e740 10 client.26231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.641+0000 7fad0a78e740 20 client.26231 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.641+0000 7fad0a78e740 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d41414d6f0 0x55d41414fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.641+0000 7fad0a78e740 4 client.26231 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.641+0000 7fad0a78e740 1 -- 172.21.15.8:0/752215776 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d413dd8720 con 0x55d41414d6f0 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.641+0000 7facffe00640 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d41414d6f0 0x55d41414fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.642+0000 7facffe00640 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d41414d6f0 0x55d41414fb30 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d47e88c22ca3256 server_cookie=50b98095c26d46c3 in_seq=0 out_seq=0 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.642+0000 7faceaa00640 10 client.26231 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:58.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.642+0000 7faceaa00640 1 -- 172.21.15.8:0/752215776 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d413dd8720 con 0x55d41414d6f0 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.642+0000 7faceaa00640 10 client.26231 handle_command_reply: tid=0 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 1 client.26231 shutdown 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 1 -- 172.21.15.8:0/752215776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 msgr2=0x55d41413a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413a600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7facf0005270 tx=0x7facf00052a0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 1 -- 172.21.15.8:0/752215776 shutdown_connections 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d41413b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d41414d6f0 0x55d41414fb30 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d41413ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 1 --2- 172.21.15.8:0/752215776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413a600 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 1 -- 172.21.15.8:0/752215776 >> 172.21.15.8:0/752215776 conn(0x55d4140fb5a0 msgr2=0x55d414130a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7faceaa00640 0 client.26231 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 1 -- 172.21.15.8:0/752215776 shutdown_connections 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 1 -- 172.21.15.8:0/752215776 wait complete. 2024-03-16T21:00:58.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.643+0000 7fad0a78e740 20 client.26231 trim_cache size 0 max 16384 2024-03-16T21:00:58.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.661+0000 7fad0a78e740 1 Processor -- start 2024-03-16T21:00:58.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.661+0000 7fad0a78e740 1 -- start start 2024-03-16T21:00:58.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.661+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.661+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d41413aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.661+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d414148a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.661+0000 7fad0a78e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41412fb10 con 0x55d414134fa0 2024-03-16T21:00:58.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.661+0000 7fad0a78e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41414a2a0 con 0x55d4141342c0 2024-03-16T21:00:58.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.661+0000 7fad0a78e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41412e5b0 con 0x55d41413d630 2024-03-16T21:00:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7fad05000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7fad05000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35436/0 (socket says 172.21.15.8:35436) 2024-03-16T21:00:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7fad05000640 1 -- 172.21.15.8:0/3259560164 learned_addr learned my addr 172.21.15.8:0/3259560164 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7facffe00640 1 --2- 172.21.15.8:0/3259560164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d41413aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7fad05000640 1 -- 172.21.15.8:0/3259560164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 msgr2=0x55d414148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7fad05a00640 1 --2- 172.21.15.8:0/3259560164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d414148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7fad05000640 1 --2- 172.21.15.8:0/3259560164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d414148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7fad05000640 1 -- 172.21.15.8:0/3259560164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 msgr2=0x55d41413aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7fad05000640 1 --2- 172.21.15.8:0/3259560164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d41413aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7fad05000640 1 -- 172.21.15.8:0/3259560164 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d414036950 con 0x55d4141342c0 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7facffe00640 1 --2- 172.21.15.8:0/3259560164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d41413aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7fad05a00640 1 --2- 172.21.15.8:0/3259560164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d414148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7fad05000640 1 --2- 172.21.15.8:0/3259560164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413cd30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7facf0010010 tx=0x7facf000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4885087d89cdfdc3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.662+0000 7facf5600640 1 -- 172.21.15.8:0/3259560164 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000f8c0 con 0x55d4141342c0 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.663+0000 7facf5600640 1 -- 172.21.15.8:0/3259560164 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7facf0005310 con 0x55d4141342c0 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.663+0000 7facf5600640 1 -- 172.21.15.8:0/3259560164 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0019430 con 0x55d4141342c0 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.663+0000 7fad0a78e740 1 -- 172.21.15.8:0/3259560164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 msgr2=0x55d41413cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.663+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3259560164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413cd30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7facf0010010 tx=0x7facf000f790 comp rx=0 tx=0).stop 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.663+0000 7fad0a78e740 1 -- 172.21.15.8:0/3259560164 shutdown_connections 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.663+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3259560164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d41413d630 0x55d414148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.663+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3259560164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d414134fa0 0x55d41413aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.663+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3259560164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4141342c0 0x55d41413cd30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.663+0000 7fad0a78e740 1 -- 172.21.15.8:0/3259560164 >> 172.21.15.8:0/3259560164 conn(0x55d4140fb5a0 msgr2=0x55d4141309f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.663+0000 7fad0a78e740 1 -- 172.21.15.8:0/3259560164 shutdown_connections 2024-03-16T21:00:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.663+0000 7fad0a78e740 1 -- 172.21.15.8:0/3259560164 wait complete. 2024-03-16T21:00:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.664+0000 7fad0a78e740 1 -- start start 2024-03-16T21:00:58.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.664+0000 7fad0a78e740 1 Processor -- start 2024-03-16T21:00:58.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.664+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4141342c0 0x55d414137ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.664+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d414134fa0 0x55d414138020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.664+0000 7fad0a78e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d41413d630 0x55d41413e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.664+0000 7fad0a78e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41413e610 con 0x55d4141342c0 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.664+0000 7fad0a78e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41413e780 con 0x55d41413d630 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.664+0000 7fad0a78e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41413e940 con 0x55d414134fa0 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.664+0000 7fad0a78e740 10 client.0 _ll_register_callbacks cb 0x7facf000e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7fad05000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4141342c0 0x55d414137ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7facffe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d414134fa0 0x55d414138020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7fad05a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d41413d630 0x55d41413e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7facffe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d414134fa0 0x55d414138020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:32934/0 (socket says 172.21.15.8:32934) 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7fad05a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d41413d630 0x55d41413e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35442/0 (socket says 172.21.15.8:35442) 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7facffe00640 1 -- 172.21.15.8:0/3434332128 learned_addr learned my addr 172.21.15.8:0/3434332128 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7facffe00640 1 -- 172.21.15.8:0/3434332128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d41413d630 msgr2=0x55d41413e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7facffe00640 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d41413d630 0x55d41413e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7facffe00640 1 -- 172.21.15.8:0/3434332128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4141342c0 msgr2=0x55d414137ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7facffe00640 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4141342c0 0x55d414137ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7facffe00640 1 -- 172.21.15.8:0/3434332128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d41409a4e0 con 0x55d414134fa0 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7fad05000640 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4141342c0 0x55d414137ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7facffe00640 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d414134fa0 0x55d414138020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7facec009d70 tx=0x7facec009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28767944524d8675 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.665+0000 7faceaa00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7faceaa00640 1 -- 172.21.15.8:0/3434332128 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec029970 con 0x55d414134fa0 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7faceaa00640 1 -- 172.21.15.8:0/3434332128 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7facec029ad0 con 0x55d414134fa0 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7fad0a78e740 1 -- 172.21.15.8:0/3434332128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7facf000fdc0 con 0x55d414134fa0 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7faceaa00640 1 -- 172.21.15.8:0/3434332128 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7facec029c90 con 0x55d414134fa0 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7fad0a78e740 10 client.26239 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7fad0a78e740 1 -- 172.21.15.8:0/3434332128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55d41405c430 con 0x55d414134fa0 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7faceaa00640 1 -- 172.21.15.8:0/3434332128 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7facf000fdc0 con 0x55d414134fa0 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7faceaa00640 1 -- 172.21.15.8:0/3434332128 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7facec010550 con 0x55d414134fa0 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7fad0a78e740 10 client.26239 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7fad0a78e740 10 client.26239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7fad0a78e740 20 client.26239 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d4141a9fc0 0x55d4141ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7fad0a78e740 4 client.26239 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.666+0000 7fad0a78e740 1 -- 172.21.15.8:0/3434332128 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d413e27890 con 0x55d4141a9fc0 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.667+0000 7fad05000640 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d4141a9fc0 0x55d4141ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.667+0000 7fad05000640 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d4141a9fc0 0x55d4141ac3e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=660932a53394c39a server_cookie=794b177efcbc8c5f in_seq=0 out_seq=0 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.667+0000 7faceaa00640 10 client.26239 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.667+0000 7faceaa00640 1 -- 172.21.15.8:0/3434332128 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d413e27890 con 0x55d4141a9fc0 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.667+0000 7faceaa00640 10 client.26239 handle_command_reply: tid=0 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.667+0000 7fad0a78e740 1 client.26239 shutdown 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7fad0a78e740 1 -- 172.21.15.8:0/3434332128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d414134fa0 msgr2=0x55d414138020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d414134fa0 0x55d414138020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7facec009d70 tx=0x7facec009610 comp rx=0 tx=0).stop 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7fad0a78e740 1 -- 172.21.15.8:0/3434332128 shutdown_connections 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d41413d630 0x55d41413e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d414134fa0 0x55d414138020 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d4141a9fc0 0x55d4141ac3e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7fad0a78e740 1 --2- 172.21.15.8:0/3434332128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4141342c0 0x55d414137ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7fad0a78e740 1 -- 172.21.15.8:0/3434332128 >> 172.21.15.8:0/3434332128 conn(0x55d4140fb5a0 msgr2=0x55d41412ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7faceaa00640 0 client.26239 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7fad0a78e740 1 -- 172.21.15.8:0/3434332128 shutdown_connections 2024-03-16T21:00:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7fad0a78e740 1 -- 172.21.15.8:0/3434332128 wait complete. 2024-03-16T21:00:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.668+0000 7fad0a78e740 20 client.26239 trim_cache size 0 max 16384 2024-03-16T21:00:58.678 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:00:58.678 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:00:58.678 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:00:58.678 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:00:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 -- 172.21.15.8:0/2540054465 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7face40a1ba0 msgr2=0x7face40a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7face40a1ba0 0x7face40a4060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7facec005f60 tx=0x7facec014040 comp rx=0 tx=0).stop 2024-03-16T21:00:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 -- 172.21.15.8:0/2540054465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad0010de90 msgr2=0x7fad0019e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad0010de90 0x7fad0019e620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7facf802c710 tx=0x7facf8032990 comp rx=0 tx=0).stop 2024-03-16T21:00:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 -- 172.21.15.8:0/2540054465 shutdown_connections 2024-03-16T21:00:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7face40a1ba0 0x7face40a4060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad0010de90 0x7fad0019e620 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad00068ff0 0x7fad0019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 --2- 172.21.15.8:0/2540054465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad000686d0 0x7fad00199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 -- 172.21.15.8:0/2540054465 >> 172.21.15.8:0/2540054465 conn(0x7fad000774f0 msgr2=0x7fad0010f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 -- 172.21.15.8:0/2540054465 shutdown_connections 2024-03-16T21:00:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.669+0000 7fad07a00640 1 -- 172.21.15.8:0/2540054465 wait complete. 2024-03-16T21:00:58.692 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:00:58.692 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:00:58.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.906+0000 7f95fc200640 1 -- 172.21.15.8:0/1276482218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95f4074240 msgr2=0x7f95f410d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.906+0000 7f95fc200640 1 --2- 172.21.15.8:0/1276482218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95f4074240 0x7f95f410d780 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009900 tx=0x7f95e002bcc0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.906+0000 7f95fc200640 1 -- 172.21.15.8:0/1276482218 shutdown_connections 2024-03-16T21:00:58.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.906+0000 7f95fc200640 1 --2- 172.21.15.8:0/1276482218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95f410dcc0 0x7f95f4110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.906+0000 7f95fc200640 1 --2- 172.21.15.8:0/1276482218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95f4074240 0x7f95f410d780 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.906+0000 7f95fc200640 1 --2- 172.21.15.8:0/1276482218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f4073920 0x7f95f4073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.906+0000 7f95fc200640 1 -- 172.21.15.8:0/1276482218 >> 172.21.15.8:0/1276482218 conn(0x7f95f40fcf90 msgr2=0x7f95f40ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:58.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.906+0000 7f95fc200640 1 -- 172.21.15.8:0/1276482218 shutdown_connections 2024-03-16T21:00:58.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.906+0000 7f95fc200640 1 -- 172.21.15.8:0/1276482218 wait complete. 2024-03-16T21:00:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.907+0000 7f95fc200640 1 Processor -- start 2024-03-16T21:00:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.907+0000 7f95fc200640 1 -- start start 2024-03-16T21:00:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.908+0000 7f95fc200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95f4073920 0x7f95f4199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.908+0000 7f95fc200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95f4074240 0x7f95f419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.908+0000 7f95fc200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f410dcc0 0x7f95f419e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.908+0000 7f95fc200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f419ece0 con 0x7f95f410dcc0 2024-03-16T21:00:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.908+0000 7f95fc200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f419ee50 con 0x7f95f4074240 2024-03-16T21:00:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.908+0000 7f95fc200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f419f010 con 0x7f95f4073920 2024-03-16T21:00:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.908+0000 7f95fa200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f410dcc0 0x7f95f419e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.908+0000 7f95f9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95f4073920 0x7f95f4199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.908+0000 7f95f8e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95f4074240 0x7f95f419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.908+0000 7f95fa200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f410dcc0 0x7f95f419e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32850/0 (socket says 172.21.15.8:32850) 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.908+0000 7f95fa200640 1 -- 172.21.15.8:0/208112646 learned_addr learned my addr 172.21.15.8:0/208112646 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.909+0000 7f95fa200640 1 -- 172.21.15.8:0/208112646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95f4073920 msgr2=0x7f95f4199e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.909+0000 7f95fa200640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95f4073920 0x7f95f4199e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.909+0000 7f95fa200640 1 -- 172.21.15.8:0/208112646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95f4074240 msgr2=0x7f95f419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.909+0000 7f95fa200640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95f4074240 0x7f95f419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.909+0000 7f95fa200640 1 -- 172.21.15.8:0/208112646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e0009560 con 0x7f95f410dcc0 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.909+0000 7f95fa200640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f410dcc0 0x7f95f419e6e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00eb10 tx=0x7f95ec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.909+0000 7f95f2000640 1 -- 172.21.15.8:0/208112646 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec004b20 con 0x7f95f410dcc0 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.909+0000 7f95f2000640 1 -- 172.21.15.8:0/208112646 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f95ec004c80 con 0x7f95f410dcc0 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.909+0000 7f95fc200640 1 -- 172.21.15.8:0/208112646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f419f2f0 con 0x7f95f410dcc0 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.909+0000 7f95f2000640 1 -- 172.21.15.8:0/208112646 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec010760 con 0x7f95f410dcc0 2024-03-16T21:00:58.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.909+0000 7f95fc200640 1 -- 172.21.15.8:0/208112646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f41a6b70 con 0x7f95f410dcc0 2024-03-16T21:00:58.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.910+0000 7f95fc200640 1 -- 172.21.15.8:0/208112646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f4068730 con 0x7f95f410dcc0 2024-03-16T21:00:58.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.913+0000 7f95f2000640 1 -- 172.21.15.8:0/208112646 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f95ec0108c0 con 0x7f95f410dcc0 2024-03-16T21:00:58.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.914+0000 7f95f2000640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f95dc0a1c20 0x7f95dc0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:58.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.914+0000 7f95f2000640 1 -- 172.21.15.8:0/208112646 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f95ec014070 con 0x7f95f410dcc0 2024-03-16T21:00:58.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.914+0000 7f95f9800640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f95dc0a1c20 0x7f95dc0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:58.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.915+0000 7f95f9800640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f95dc0a1c20 0x7f95dc0a40e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009bd0 tx=0x7f95e8005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:58.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:58.917+0000 7f95f2000640 1 -- 172.21.15.8:0/208112646 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f95ec096d30 con 0x7f95f410dcc0 2024-03-16T21:00:59.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:58 smithi170 ceph-mon[35947]: pgmap v97: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 313 KiB/s wr, 145 op/s 2024-03-16T21:00:59.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:58 smithi186 ceph-mon[36391]: pgmap v97: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 313 KiB/s wr, 145 op/s 2024-03-16T21:00:59.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.160+0000 7f95fc200640 1 -- 172.21.15.8:0/208112646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95f4108e70 con 0x7f95f410dcc0 2024-03-16T21:00:59.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.161+0000 7f95f2000640 1 -- 172.21.15.8:0/208112646 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11396 (secure 0 0 0) 0x7f95ec09a3f0 con 0x7f95f410dcc0 2024-03-16T21:00:59.167 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:00:59.167 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:00:21.828404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:00:59.167 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 30 2024-03-16T21:00:59.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.163+0000 7f95fc200640 1 -- 172.21.15.8:0/208112646 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f95dc0a1c20 msgr2=0x7f95dc0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.164+0000 7f95fc200640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f95dc0a1c20 0x7f95dc0a40e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009bd0 tx=0x7f95e8005f90 comp rx=0 tx=0).stop 2024-03-16T21:00:59.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.164+0000 7f95fc200640 1 -- 172.21.15.8:0/208112646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f410dcc0 msgr2=0x7f95f419e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.164+0000 7f95fc200640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f410dcc0 0x7f95f419e6e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00eb10 tx=0x7f95ec00c2d0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.164+0000 7f95fc200640 1 -- 172.21.15.8:0/208112646 shutdown_connections 2024-03-16T21:00:59.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.164+0000 7f95fc200640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f95dc0a1c20 0x7f95dc0a40e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.164+0000 7f95fc200640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f410dcc0 0x7f95f419e6e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.164+0000 7f95fc200640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95f4074240 0x7f95f419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.164+0000 7f95fc200640 1 --2- 172.21.15.8:0/208112646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95f4073920 0x7f95f4199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.164+0000 7f95fc200640 1 -- 172.21.15.8:0/208112646 >> 172.21.15.8:0/208112646 conn(0x7f95f40fcf90 msgr2=0x7f95f40fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.164+0000 7f95fc200640 1 -- 172.21.15.8:0/208112646 shutdown_connections 2024-03-16T21:00:59.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.164+0000 7f95fc200640 1 -- 172.21.15.8:0/208112646 wait complete. 2024-03-16T21:00:59.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:58 smithi008 ceph-mon[31434]: pgmap v97: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 313 KiB/s wr, 145 op/s 2024-03-16T21:00:59.190 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:00:59.191 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:00:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.412+0000 7fb2f3200640 1 -- 172.21.15.8:0/771069133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2f4103f50 msgr2=0x7fb2f4110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.412+0000 7fb2f3200640 1 --2- 172.21.15.8:0/771069133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2f4103f50 0x7fb2f4110410 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009930 tx=0x7fb2ec02bc30 comp rx=0 tx=0).stop 2024-03-16T21:00:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.412+0000 7fb2f3200640 1 -- 172.21.15.8:0/771069133 shutdown_connections 2024-03-16T21:00:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.412+0000 7fb2f3200640 1 --2- 172.21.15.8:0/771069133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2f4103f50 0x7fb2f4110410 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.412+0000 7fb2f3200640 1 --2- 172.21.15.8:0/771069133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2f4103590 0x7fb2f4103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.412+0000 7fb2f3200640 1 --2- 172.21.15.8:0/771069133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f4109650 0x7fb2f4109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.412+0000 7fb2f3200640 1 -- 172.21.15.8:0/771069133 >> 172.21.15.8:0/771069133 conn(0x7fb2f40ff020 msgr2=0x7fb2f4101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.412+0000 7fb2f3200640 1 -- 172.21.15.8:0/771069133 shutdown_connections 2024-03-16T21:00:59.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.412+0000 7fb2f3200640 1 -- 172.21.15.8:0/771069133 wait complete. 2024-03-16T21:00:59.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.413+0000 7fb2f3200640 1 Processor -- start 2024-03-16T21:00:59.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.413+0000 7fb2f3200640 1 -- start start 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.414+0000 7fb2f3200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2f4103590 0x7fb2f419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.414+0000 7fb2f3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2f4103f50 0x7fb2f419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.414+0000 7fb2f3200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f4109650 0x7fb2f4199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.414+0000 7fb2f3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f419a060 con 0x7fb2f4103f50 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.414+0000 7fb2f3200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f419a1d0 con 0x7fb2f4109650 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.414+0000 7fb2f3200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f419a390 con 0x7fb2f4103590 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.414+0000 7fb2f1e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2f4103590 0x7fb2f419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.414+0000 7fb2f1e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2f4103590 0x7fb2f419f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:32972/0 (socket says 172.21.15.8:32972) 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.414+0000 7fb2f1e00640 1 -- 172.21.15.8:0/2403155990 learned_addr learned my addr 172.21.15.8:0/2403155990 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.414+0000 7fb2e9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2f4103f50 0x7fb2f419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.414+0000 7fb2f2800640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f4109650 0x7fb2f4199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.415+0000 7fb2f1e00640 1 -- 172.21.15.8:0/2403155990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f4109650 msgr2=0x7fb2f4199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.415+0000 7fb2f1e00640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f4109650 0x7fb2f4199a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.415+0000 7fb2f1e00640 1 -- 172.21.15.8:0/2403155990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2f4103f50 msgr2=0x7fb2f419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.415+0000 7fb2f1e00640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2f4103f50 0x7fb2f419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.415+0000 7fb2f1e00640 1 -- 172.21.15.8:0/2403155990 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec009560 con 0x7fb2f4103590 2024-03-16T21:00:59.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.415+0000 7fb2f1e00640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2f4103590 0x7fb2f419f860 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400ebc0 tx=0x7fb2e400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.415+0000 7fb2eb400640 1 -- 172.21.15.8:0/2403155990 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40099b0 con 0x7fb2f4103590 2024-03-16T21:00:59.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.415+0000 7fb2eb400640 1 -- 172.21.15.8:0/2403155990 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb2e400eec0 con 0x7fb2f4103590 2024-03-16T21:00:59.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.415+0000 7fb2eb400640 1 -- 172.21.15.8:0/2403155990 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4018c10 con 0x7fb2f4103590 2024-03-16T21:00:59.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.415+0000 7fb2f3200640 1 -- 172.21.15.8:0/2403155990 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f419a670 con 0x7fb2f4103590 2024-03-16T21:00:59.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.415+0000 7fb2f3200640 1 -- 172.21.15.8:0/2403155990 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f41a6900 con 0x7fb2f4103590 2024-03-16T21:00:59.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.418+0000 7fb2eb400640 1 -- 172.21.15.8:0/2403155990 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fb2e4010630 con 0x7fb2f4103590 2024-03-16T21:00:59.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.418+0000 7fb2fbbc5740 1 Processor -- start 2024-03-16T21:00:59.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2fbbc5740 1 -- start start 2024-03-16T21:00:59.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 0x55e89dd521d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 0x55e89dd5adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd5b2f0 0x55e89dd5d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89dcc0210 con 0x55e89dd5b2f0 2024-03-16T21:00:59.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89dcbd740 con 0x55e89dd51df0 2024-03-16T21:00:59.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89dcb8f20 con 0x55e89dd52710 2024-03-16T21:00:59.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2f1e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 0x55e89dd5adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2f2800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 0x55e89dd521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2f2800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 0x55e89dd521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35472/0 (socket says 172.21.15.8:35472) 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2f2800640 1 -- 172.21.15.8:0/3954236415 learned_addr learned my addr 172.21.15.8:0/3954236415 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.419+0000 7fb2e9400640 1 --2- 172.21.15.8:0/3954236415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd5b2f0 0x55e89dd5d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.420+0000 7fb2f2800640 1 -- 172.21.15.8:0/3954236415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 msgr2=0x55e89dd5adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.420+0000 7fb2f2800640 1 --2- 172.21.15.8:0/3954236415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 0x55e89dd5adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.420+0000 7fb2f2800640 1 -- 172.21.15.8:0/3954236415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd5b2f0 msgr2=0x55e89dd5d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.420+0000 7fb2f2800640 1 --2- 172.21.15.8:0/3954236415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd5b2f0 0x55e89dd5d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.420+0000 7fb2f2800640 1 -- 172.21.15.8:0/3954236415 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e89dc7adf0 con 0x55e89dd51df0 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.420+0000 7fb2f1e00640 1 --2- 172.21.15.8:0/3954236415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 0x55e89dd5adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.420+0000 7fb2eb400640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2d80a1c20 0x7fb2d80a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.420+0000 7fb2f2800640 1 --2- 172.21.15.8:0/3954236415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 0x55e89dd521d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009930 tx=0x7fb2ec005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4df46f689de7411 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.420+0000 7fb2eb400640 1 -- 172.21.15.8:0/2403155990 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb2e4014070 con 0x7fb2f4103590 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.420+0000 7fb2f1e00640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2d80a1c20 0x7fb2d80a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.420+0000 7fb2e3400640 1 -- 172.21.15.8:0/3954236415 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0048c0 con 0x55e89dd51df0 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.421+0000 7fb2e3400640 1 -- 172.21.15.8:0/3954236415 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb2ec004a20 con 0x55e89dd51df0 2024-03-16T21:00:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.421+0000 7fb2e3400640 1 -- 172.21.15.8:0/3954236415 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec005210 con 0x55e89dd51df0 2024-03-16T21:00:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.421+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/3954236415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 msgr2=0x55e89dd521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.421+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/3954236415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 0x55e89dd521d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009930 tx=0x7fb2ec005be0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.421+0000 7fb2f1e00640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2d80a1c20 0x7fb2d80a40e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55e89dd518c0 tx=0x7fb2e40d16b0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.421+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/3954236415 shutdown_connections 2024-03-16T21:00:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.421+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/3954236415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd5b2f0 0x55e89dd5d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.421+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/3954236415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 0x55e89dd5adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.421+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/3954236415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 0x55e89dd521d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.421+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/3954236415 >> 172.21.15.8:0/3954236415 conn(0x55e89dd4c520 msgr2=0x55e89dd4c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.422+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/3954236415 shutdown_connections 2024-03-16T21:00:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.422+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/3954236415 wait complete. 2024-03-16T21:00:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.422+0000 7fb2fbbc5740 1 -- start start 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.422+0000 7fb2fbbc5740 1 Processor -- start 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 0x55e89dd582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd52710 0x55e89dd58830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd5b2f0 0x55e89dd58d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89dc5e150 con 0x55e89dd52710 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89dc5ddf0 con 0x55e89dd51df0 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89da271c0 con 0x55e89dd5b2f0 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2fbbc5740 10 client.0 _ll_register_callbacks cb 0x55e89dcad2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2e9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd52710 0x55e89dd58830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2f2800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 0x55e89dd582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2e9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd52710 0x55e89dd58830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32898/0 (socket says 172.21.15.8:32898) 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2e9400640 1 -- 172.21.15.8:0/2843578139 learned_addr learned my addr 172.21.15.8:0/2843578139 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2f2800640 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd5b2f0 0x55e89dd58d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2e9400640 1 -- 172.21.15.8:0/2843578139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd5b2f0 msgr2=0x55e89dd58d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2e9400640 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd5b2f0 0x55e89dd58d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2e9400640 1 -- 172.21.15.8:0/2843578139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 msgr2=0x55e89dd582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2e9400640 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 0x55e89dd582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2e9400640 1 -- 172.21.15.8:0/2843578139 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f4110d10 con 0x55e89dd52710 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.423+0000 7fb2f2800640 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 0x55e89dd582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.424+0000 7fb2e9400640 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd52710 0x55e89dd58830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc012700 tx=0x7fb2dc012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d774a9fafe7610 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.424+0000 7fb2d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.424+0000 7fb2d7e00640 1 -- 172.21.15.8:0/2843578139 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc017070 con 0x55e89dd52710 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.424+0000 7fb2d7e00640 1 -- 172.21.15.8:0/2843578139 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb2dc00f920 con 0x55e89dd52710 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.424+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2843578139 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e89d9b87e0 con 0x55e89dd52710 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.424+0000 7fb2d7e00640 1 -- 172.21.15.8:0/2843578139 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2dc00fae0 con 0x55e89dd52710 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.424+0000 7fb2fbbc5740 10 client.16092 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.424+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2843578139 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e89dcb75a0 con 0x55e89dd52710 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.425+0000 7fb2d7e00640 1 -- 172.21.15.8:0/2843578139 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55e89d9b87e0 con 0x55e89dd52710 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.425+0000 7fb2d7e00640 1 -- 172.21.15.8:0/2843578139 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fb2dc01c420 con 0x55e89dd52710 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.425+0000 7fb2fbbc5740 10 client.16092 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.425+0000 7fb2fbbc5740 10 client.16092 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:00:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.425+0000 7fb2fbbc5740 20 client.16092 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.425+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e89dd6b420 0x55e89dd6d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.425+0000 7fb2fbbc5740 4 client.16092 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.425+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2843578139 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e89d9f5720 con 0x55e89dd6b420 2024-03-16T21:00:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.425+0000 7fb2f2800640 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e89dd6b420 0x55e89dd6d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.426+0000 7fb2f2800640 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e89dd6b420 0x55e89dd6d840 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4c1f52ba8864ae17 server_cookie=5aea30299e58cdff in_seq=0 out_seq=0 2024-03-16T21:00:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.426+0000 7fb2d7e00640 10 client.16092 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:00:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2d7e00640 1 -- 172.21.15.8:0/2843578139 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55e89d9f5720 con 0x55e89dd6b420 2024-03-16T21:00:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2d7e00640 10 client.16092 handle_command_reply: tid=0 2024-03-16T21:00:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2fbbc5740 1 client.16092 shutdown 2024-03-16T21:00:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2843578139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd52710 msgr2=0x55e89dd58830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd52710 0x55e89dd58830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc012700 tx=0x7fb2dc012bc0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2843578139 shutdown_connections 2024-03-16T21:00:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e89dd6b420 0x55e89dd6d840 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd5b2f0 0x55e89dd58d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd52710 0x55e89dd58830 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/2843578139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd51df0 0x55e89dd582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2d7e00640 0 client.16092 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:00:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.427+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2843578139 >> 172.21.15.8:0/2843578139 conn(0x55e89dd4c520 msgr2=0x55e89dd4e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.428+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2843578139 shutdown_connections 2024-03-16T21:00:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.428+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2843578139 wait complete. 2024-03-16T21:00:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.428+0000 7fb2fbbc5740 20 client.16092 trim_cache size 0 max 16384 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.441+0000 7fb2fbbc5740 1 Processor -- start 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2fbbc5740 1 -- start start 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd51df0 0x55e89dd58b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 0x55e89dd4de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd5b2f0 0x55e89dd4e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89dd69b40 con 0x55e89dd51df0 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89dd47df0 con 0x55e89dd5b2f0 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89dd4d520 con 0x55e89dd52710 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2f2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd51df0 0x55e89dd58b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2e9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 0x55e89dd4de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2e9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 0x55e89dd4de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:32996/0 (socket says 172.21.15.8:32996) 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2e9400640 1 -- 172.21.15.8:0/2898662176 learned_addr learned my addr 172.21.15.8:0/2898662176 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.442+0000 7fb2f2800640 1 --2- 172.21.15.8:0/2898662176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd5b2f0 0x55e89dd4e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.443+0000 7fb2e9400640 1 -- 172.21.15.8:0/2898662176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd5b2f0 msgr2=0x55e89dd4e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.443+0000 7fb2e9400640 1 --2- 172.21.15.8:0/2898662176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd5b2f0 0x55e89dd4e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.443+0000 7fb2e9400640 1 -- 172.21.15.8:0/2898662176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd51df0 msgr2=0x55e89dd58b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.443+0000 7fb2e9400640 1 --2- 172.21.15.8:0/2898662176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd51df0 0x55e89dd58b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.443+0000 7fb2e9400640 1 -- 172.21.15.8:0/2898662176 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e89dc53ab0 con 0x55e89dd52710 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.443+0000 7fb2f2800640 1 --2- 172.21.15.8:0/2898662176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd5b2f0 0x55e89dd4e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.443+0000 7fb2e9400640 1 --2- 172.21.15.8:0/2898662176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 0x55e89dd4de60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc001eb0 tx=0x7fb2dc009f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2591a44a6367006 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.443+0000 7fb2e2a00640 1 -- 172.21.15.8:0/2898662176 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc017040 con 0x55e89dd52710 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.443+0000 7fb2e2a00640 1 -- 172.21.15.8:0/2898662176 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb2dc00fe20 con 0x55e89dd52710 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.443+0000 7fb2e2a00640 1 -- 172.21.15.8:0/2898662176 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc005700 con 0x55e89dd52710 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.444+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2898662176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 msgr2=0x55e89dd4de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.444+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/2898662176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 0x55e89dd4de60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc001eb0 tx=0x7fb2dc009f20 comp rx=0 tx=0).stop 2024-03-16T21:00:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.444+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2898662176 shutdown_connections 2024-03-16T21:00:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.444+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/2898662176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd5b2f0 0x55e89dd4e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.444+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/2898662176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd52710 0x55e89dd4de60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.444+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/2898662176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd51df0 0x55e89dd58b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.444+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2898662176 >> 172.21.15.8:0/2898662176 conn(0x55e89dd4c520 msgr2=0x55e89dd4d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.444+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2898662176 shutdown_connections 2024-03-16T21:00:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.444+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/2898662176 wait complete. 2024-03-16T21:00:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.444+0000 7fb2fbbc5740 1 -- start start 2024-03-16T21:00:59.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.444+0000 7fb2fbbc5740 1 Processor -- start 2024-03-16T21:00:59.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.445+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd51df0 0x55e89dd62820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.445+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd52710 0x55e89dd62d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.445+0000 7fb2fbbc5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd5b2f0 0x55e89dd5eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.445+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89dd5f280 con 0x55e89dd5b2f0 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.445+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89dd5f3f0 con 0x55e89dd52710 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.445+0000 7fb2fbbc5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e89dd5f5b0 con 0x55e89dd51df0 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.445+0000 7fb2fbbc5740 10 client.0 _ll_register_callbacks cb 0x7fb2dc009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.445+0000 7fb2e9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd52710 0x55e89dd62d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.445+0000 7fb2e9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd52710 0x55e89dd62d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35506/0 (socket says 172.21.15.8:35506) 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.445+0000 7fb2e9400640 1 -- 172.21.15.8:0/829344306 learned_addr learned my addr 172.21.15.8:0/829344306 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.445+0000 7fb2f2800640 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd51df0 0x55e89dd62820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2f2800640 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd5b2f0 0x55e89dd5eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2e9400640 1 -- 172.21.15.8:0/829344306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd51df0 msgr2=0x55e89dd62820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2e9400640 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd51df0 0x55e89dd62820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2e9400640 1 -- 172.21.15.8:0/829344306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd5b2f0 msgr2=0x55e89dd5eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2e9400640 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd5b2f0 0x55e89dd5eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2e9400640 1 -- 172.21.15.8:0/829344306 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e89dcb75a0 con 0x55e89dd52710 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2f2800640 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd51df0 0x55e89dd62820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2e9400640 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd52710 0x55e89dd62d60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc01c920 tx=0x7fb2dc01c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db0c33648fd6b9ba server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2d7e00640 1 -- 172.21.15.8:0/829344306 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc005c50 con 0x55e89dd52710 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/829344306 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb2ec004a20 con 0x55e89dd52710 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.446+0000 7fb2d7e00640 1 -- 172.21.15.8:0/829344306 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb2dc000e40 con 0x55e89dd52710 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2d7e00640 1 -- 172.21.15.8:0/829344306 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2dc005690 con 0x55e89dd52710 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2fbbc5740 10 client.26261 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/829344306 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e89dc79650 con 0x55e89dd52710 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2d7e00640 1 -- 172.21.15.8:0/829344306 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb2ec004a20 con 0x55e89dd52710 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2d7e00640 1 -- 172.21.15.8:0/829344306 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fb2dc003710 con 0x55e89dd52710 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2fbbc5740 10 client.26261 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:59.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2fbbc5740 10 client.26261 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2fbbc5740 20 client.26261 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e89ddc7b40 0x55e89ddc9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2fbbc5740 4 client.26261 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/829344306 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e89da44890 con 0x55e89ddc7b40 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.447+0000 7fb2f2800640 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e89ddc7b40 0x55e89ddc9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2f2800640 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e89ddc7b40 0x55e89ddc9f60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=199d79b97ccf780c server_cookie=6c37a3ea40f7d6e3 in_seq=0 out_seq=0 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2d7e00640 10 client.26261 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2d7e00640 1 -- 172.21.15.8:0/829344306 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e89da44890 con 0x55e89ddc7b40 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2d7e00640 10 client.26261 handle_command_reply: tid=0 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2fbbc5740 1 client.26261 shutdown 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/829344306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd52710 msgr2=0x55e89dd62d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd52710 0x55e89dd62d60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc01c920 tx=0x7fb2dc01c650 comp rx=0 tx=0).stop 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/829344306 shutdown_connections 2024-03-16T21:00:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e89ddc7b40 0x55e89ddc9f60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e89dd5b2f0 0x55e89dd5eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e89dd52710 0x55e89dd62d60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2fbbc5740 1 --2- 172.21.15.8:0/829344306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e89dd51df0 0x55e89dd62820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/829344306 >> 172.21.15.8:0/829344306 conn(0x55e89dd4c520 msgr2=0x55e89dd4d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.448+0000 7fb2d7e00640 0 client.26261 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:00:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/829344306 shutdown_connections 2024-03-16T21:00:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2fbbc5740 1 -- 172.21.15.8:0/829344306 wait complete. 2024-03-16T21:00:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2fbbc5740 20 client.26261 trim_cache size 0 max 16384 2024-03-16T21:00:59.458 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:00:59.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2f3200640 1 -- 172.21.15.8:0/2403155990 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2d80a1c20 msgr2=0x7fb2d80a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2f3200640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2d80a1c20 0x7fb2d80a40e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55e89dd518c0 tx=0x7fb2e40d16b0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2f3200640 1 -- 172.21.15.8:0/2403155990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2f4103590 msgr2=0x7fb2f419f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2f3200640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2f4103590 0x7fb2f419f860 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400ebc0 tx=0x7fb2e400c6a0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2f3200640 1 -- 172.21.15.8:0/2403155990 shutdown_connections 2024-03-16T21:00:59.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2f3200640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2d80a1c20 0x7fb2d80a40e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2f3200640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f4109650 0x7fb2f4199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2f3200640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2f4103f50 0x7fb2f419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2f3200640 1 --2- 172.21.15.8:0/2403155990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2f4103590 0x7fb2f419f860 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.449+0000 7fb2f3200640 1 -- 172.21.15.8:0/2403155990 >> 172.21.15.8:0/2403155990 conn(0x7fb2f40ff020 msgr2=0x7fb2f41006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.450+0000 7fb2f3200640 1 -- 172.21.15.8:0/2403155990 shutdown_connections 2024-03-16T21:00:59.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.450+0000 7fb2f3200640 1 -- 172.21.15.8:0/2403155990 wait complete. 2024-03-16T21:00:59.473 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:00:59.473 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:00:59.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.682+0000 7f7b16600640 1 -- 172.21.15.8:0/3281810364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b10103f50 msgr2=0x7f7b10110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.682+0000 7f7b16600640 1 --2- 172.21.15.8:0/3281810364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b10103f50 0x7f7b10110410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7b08009890 tx=0x7f7b0802bb70 comp rx=0 tx=0).stop 2024-03-16T21:00:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.682+0000 7f7b16600640 1 -- 172.21.15.8:0/3281810364 shutdown_connections 2024-03-16T21:00:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.682+0000 7f7b16600640 1 --2- 172.21.15.8:0/3281810364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b10103f50 0x7f7b10110410 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.682+0000 7f7b16600640 1 --2- 172.21.15.8:0/3281810364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b10103590 0x7f7b10103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.682+0000 7f7b16600640 1 --2- 172.21.15.8:0/3281810364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b10109650 0x7f7b10109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.682+0000 7f7b16600640 1 -- 172.21.15.8:0/3281810364 >> 172.21.15.8:0/3281810364 conn(0x7f7b100ff020 msgr2=0x7f7b10101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.682+0000 7f7b16600640 1 -- 172.21.15.8:0/3281810364 shutdown_connections 2024-03-16T21:00:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.682+0000 7f7b16600640 1 -- 172.21.15.8:0/3281810364 wait complete. 2024-03-16T21:00:59.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.683+0000 7f7b16600640 1 Processor -- start 2024-03-16T21:00:59.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.683+0000 7f7b16600640 1 -- start start 2024-03-16T21:00:59.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.683+0000 7f7b16600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b10103590 0x7f7b1019f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.683+0000 7f7b16600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b10103f50 0x7f7b1019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.683+0000 7f7b16600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b10109650 0x7f7b10199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.683+0000 7f7b16600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1019a0a0 con 0x7f7b10103f50 2024-03-16T21:00:59.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.683+0000 7f7b16600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1019a210 con 0x7f7b10103590 2024-03-16T21:00:59.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.683+0000 7f7b16600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1019a3d0 con 0x7f7b10109650 2024-03-16T21:00:59.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b15200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b10103590 0x7f7b1019f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b15c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b10109650 0x7f7b10199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b15c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b10109650 0x7f7b10199a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33014/0 (socket says 172.21.15.8:33014) 2024-03-16T21:00:59.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b15200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b10103590 0x7f7b1019f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35526/0 (socket says 172.21.15.8:35526) 2024-03-16T21:00:59.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b15c00640 1 -- 172.21.15.8:0/2065897816 learned_addr learned my addr 172.21.15.8:0/2065897816 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b07e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b10103f50 0x7f7b1019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b15c00640 1 -- 172.21.15.8:0/2065897816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b10103590 msgr2=0x7f7b1019f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b15c00640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b10103590 0x7f7b1019f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b15c00640 1 -- 172.21.15.8:0/2065897816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b10103f50 msgr2=0x7f7b1019fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b15c00640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b10103f50 0x7f7b1019fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b15c00640 1 -- 172.21.15.8:0/2065897816 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b08009490 con 0x7f7b10109650 2024-03-16T21:00:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.684+0000 7f7b15c00640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b10109650 0x7f7b10199a50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7b08037040 tx=0x7f7b080045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.685+0000 7f7b0e000640 1 -- 172.21.15.8:0/2065897816 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b08034950 con 0x7f7b10109650 2024-03-16T21:00:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.685+0000 7f7b0e000640 1 -- 172.21.15.8:0/2065897816 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7b0802ca10 con 0x7f7b10109650 2024-03-16T21:00:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.685+0000 7f7b0e000640 1 -- 172.21.15.8:0/2065897816 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b080035f0 con 0x7f7b10109650 2024-03-16T21:00:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.685+0000 7f7b16600640 1 -- 172.21.15.8:0/2065897816 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1019a650 con 0x7f7b10109650 2024-03-16T21:00:59.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.685+0000 7f7b16600640 1 -- 172.21.15.8:0/2065897816 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1019a8d0 con 0x7f7b10109650 2024-03-16T21:00:59.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.688+0000 7f7b0e000640 1 -- 172.21.15.8:0/2065897816 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7b0803b040 con 0x7f7b10109650 2024-03-16T21:00:59.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.688+0000 7f7b1a98d740 1 Processor -- start 2024-03-16T21:00:59.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.688+0000 7f7b1a98d740 1 -- start start 2024-03-16T21:00:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.689+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632ba1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.689+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632ba710 0x5615632c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.689+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632c32f0 0x5615632c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.689+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561563228210 con 0x5615632c32f0 2024-03-16T21:00:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.689+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561563225740 con 0x5615632ba710 2024-03-16T21:00:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.689+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561563220f20 con 0x5615632b9df0 2024-03-16T21:00:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.689+0000 7f7b07e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632ba1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.689+0000 7f7b15200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632ba710 0x5615632c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.689+0000 7f7b07e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632ba1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33028/0 (socket says 172.21.15.8:33028) 2024-03-16T21:00:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.689+0000 7f7b07e00640 1 -- 172.21.15.8:0/2661558368 learned_addr learned my addr 172.21.15.8:0/2661558368 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.689+0000 7f7b07e00640 1 --2- 172.21.15.8:0/2661558368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632c32f0 0x5615632c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b15200640 1 -- 172.21.15.8:0/2661558368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 msgr2=0x5615632ba1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b15200640 1 --2- 172.21.15.8:0/2661558368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632ba1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b15200640 1 -- 172.21.15.8:0/2661558368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632c32f0 msgr2=0x5615632c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b15200640 1 --2- 172.21.15.8:0/2661558368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632c32f0 0x5615632c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b15200640 1 -- 172.21.15.8:0/2661558368 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615631e2df0 con 0x5615632ba710 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b07e00640 1 --2- 172.21.15.8:0/2661558368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632ba1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b15200640 1 --2- 172.21.15.8:0/2661558368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632ba710 0x5615632c2db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7b00005fd0 tx=0x7f7b00003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c65c90d0b4dfe9ba server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b0e000640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7af40a1c20 0x7f7af40a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b0e000640 1 -- 172.21.15.8:0/2065897816 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7b080ef0e0 con 0x7f7b10109650 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b06000640 1 -- 172.21.15.8:0/2661558368 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00004b20 con 0x5615632ba710 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b06000640 1 -- 172.21.15.8:0/2661558368 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7b00004c80 con 0x5615632ba710 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b06000640 1 -- 172.21.15.8:0/2661558368 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b000126b0 con 0x5615632ba710 2024-03-16T21:00:59.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.690+0000 7f7b07e00640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7af40a1c20 0x7f7af40a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.691+0000 7f7b1a98d740 1 -- 172.21.15.8:0/2661558368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632ba710 msgr2=0x5615632c2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.691+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/2661558368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632ba710 0x5615632c2db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7b00005fd0 tx=0x7f7b00003e00 comp rx=0 tx=0).stop 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.691+0000 7f7b07e00640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7af40a1c20 0x7f7af40a40e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5615632b56b0 tx=0x7f7af8009260 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.691+0000 7f7b1a98d740 1 -- 172.21.15.8:0/2661558368 shutdown_connections 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.691+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/2661558368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632c32f0 0x5615632c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.691+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/2661558368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632ba710 0x5615632c2db0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.691+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/2661558368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632ba1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.691+0000 7f7b1a98d740 1 -- 172.21.15.8:0/2661558368 >> 172.21.15.8:0/2661558368 conn(0x5615632b4520 msgr2=0x5615632b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.691+0000 7f7b1a98d740 1 -- 172.21.15.8:0/2661558368 shutdown_connections 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.691+0000 7f7b1a98d740 1 -- 172.21.15.8:0/2661558368 wait complete. 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.692+0000 7f7b1a98d740 1 -- start start 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.692+0000 7f7b1a98d740 1 Processor -- start 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.692+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632b9df0 0x5615632c0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.692+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632ba710 0x5615632c08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.692+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632c32f0 0x5615632c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615631c6150 con 0x5615632ba710 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615631c5df0 con 0x5615632b9df0 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561562f8f1c0 con 0x5615632c32f0 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b1a98d740 10 client.0 _ll_register_callbacks cb 0x5615632152b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b15200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632b9df0 0x5615632c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b07e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632ba710 0x5615632c08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b15c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632c32f0 0x5615632c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b15200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632b9df0 0x5615632c0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35546/0 (socket says 172.21.15.8:35546) 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b15200640 1 -- 172.21.15.8:0/367446326 learned_addr learned my addr 172.21.15.8:0/367446326 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b15c00640 1 -- 172.21.15.8:0/367446326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632b9df0 msgr2=0x5615632c0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b15c00640 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632b9df0 0x5615632c0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b15c00640 1 -- 172.21.15.8:0/367446326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632ba710 msgr2=0x5615632c08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b15c00640 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632ba710 0x5615632c08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b15c00640 1 -- 172.21.15.8:0/367446326 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b00009c10 con 0x5615632c32f0 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b15200640 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632b9df0 0x5615632c0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:59.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7b15c00640 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632c32f0 0x5615632c0e00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7b080ec910 tx=0x7f7b0802bb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbf76b19315673fe server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.693+0000 7f7afea00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7afea00640 1 -- 172.21.15.8:0/367446326 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b080bffd0 con 0x5615632c32f0 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7afea00640 1 -- 172.21.15.8:0/367446326 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7b080c4590 con 0x5615632c32f0 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7b1a98d740 1 -- 172.21.15.8:0/367446326 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561562f207e0 con 0x5615632c32f0 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7afea00640 1 -- 172.21.15.8:0/367446326 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b0802cb80 con 0x5615632c32f0 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7b1a98d740 10 client.26275 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7b1a98d740 1 -- 172.21.15.8:0/367446326 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56156321f5a0 con 0x5615632c32f0 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7afea00640 1 -- 172.21.15.8:0/367446326 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x561562f207e0 con 0x5615632c32f0 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7afea00640 1 -- 172.21.15.8:0/367446326 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f7b080bb2d0 con 0x5615632c32f0 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7b1a98d740 10 client.26275 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7b1a98d740 10 client.26275 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7b1a98d740 20 client.26275 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5615632d3060 0x5615632d5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7b1a98d740 4 client.26275 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.694+0000 7f7b1a98d740 1 -- 172.21.15.8:0/367446326 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561562f5d720 con 0x5615632d3060 2024-03-16T21:00:59.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.695+0000 7f7b15200640 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5615632d3060 0x5615632d5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.695+0000 7f7b15200640 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5615632d3060 0x5615632d5480 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f93d7b9c821f267 server_cookie=6d45e5f55ae2d1cc in_seq=0 out_seq=0 2024-03-16T21:00:59.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.695+0000 7f7afea00640 10 client.26275 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:00:59.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7afea00640 1 -- 172.21.15.8:0/367446326 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561562f5d720 con 0x5615632d3060 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7afea00640 10 client.26275 handle_command_reply: tid=0 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7b1a98d740 1 client.26275 shutdown 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7b1a98d740 1 -- 172.21.15.8:0/367446326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632c32f0 msgr2=0x5615632c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632c32f0 0x5615632c0e00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7b080ec910 tx=0x7f7b0802bb70 comp rx=0 tx=0).stop 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7b1a98d740 1 -- 172.21.15.8:0/367446326 shutdown_connections 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5615632d3060 0x5615632d5480 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632c32f0 0x5615632c0e00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632ba710 0x5615632c08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/367446326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632b9df0 0x5615632c0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7afea00640 0 client.26275 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7b1a98d740 1 -- 172.21.15.8:0/367446326 >> 172.21.15.8:0/367446326 conn(0x5615632b4520 msgr2=0x5615632b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7b1a98d740 1 -- 172.21.15.8:0/367446326 shutdown_connections 2024-03-16T21:00:59.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.696+0000 7f7b1a98d740 1 -- 172.21.15.8:0/367446326 wait complete. 2024-03-16T21:00:59.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.697+0000 7f7b1a98d740 20 client.26275 trim_cache size 0 max 16384 2024-03-16T21:00:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.710+0000 7f7b1a98d740 1 Processor -- start 2024-03-16T21:00:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.710+0000 7f7b1a98d740 1 -- start start 2024-03-16T21:00:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632ba710 0x5615632c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 0x5615632ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615632d5b00 con 0x5615632ba710 2024-03-16T21:00:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615632bb190 con 0x5615632c32f0 2024-03-16T21:00:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615632b4050 con 0x5615632b9df0 2024-03-16T21:00:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b15200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b15c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 0x5615632ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b15200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33056/0 (socket says 172.21.15.8:33056) 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b15c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 0x5615632ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35550/0 (socket says 172.21.15.8:35550) 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b15200640 1 -- 172.21.15.8:0/1602373528 learned_addr learned my addr 172.21.15.8:0/1602373528 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b07e00640 1 --2- 172.21.15.8:0/1602373528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632ba710 0x5615632c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b15200640 1 -- 172.21.15.8:0/1602373528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 msgr2=0x5615632ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b15200640 1 --2- 172.21.15.8:0/1602373528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 0x5615632ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b15200640 1 -- 172.21.15.8:0/1602373528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632ba710 msgr2=0x5615632c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b15200640 1 --2- 172.21.15.8:0/1602373528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632ba710 0x5615632c0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b15200640 1 -- 172.21.15.8:0/1602373528 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615631bbab0 con 0x5615632b9df0 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b15c00640 1 --2- 172.21.15.8:0/1602373528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 0x5615632ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.711+0000 7f7b07e00640 1 --2- 172.21.15.8:0/1602373528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632ba710 0x5615632c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.712+0000 7f7b15200640 1 --2- 172.21.15.8:0/1602373528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632c2ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7b000058f0 tx=0x7f7b000059d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=848c185800f664f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.712+0000 7f7b05600640 1 -- 172.21.15.8:0/1602373528 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00009aa0 con 0x5615632b9df0 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.712+0000 7f7b05600640 1 -- 172.21.15.8:0/1602373528 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7b0002e070 con 0x5615632b9df0 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.712+0000 7f7b05600640 1 -- 172.21.15.8:0/1602373528 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0002ac30 con 0x5615632b9df0 2024-03-16T21:00:59.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.713+0000 7f7b1a98d740 1 -- 172.21.15.8:0/1602373528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 msgr2=0x5615632c2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.713+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/1602373528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632c2ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7b000058f0 tx=0x7f7b000059d0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.713+0000 7f7b1a98d740 1 -- 172.21.15.8:0/1602373528 shutdown_connections 2024-03-16T21:00:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.713+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/1602373528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 0x5615632ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.713+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/1602373528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632ba710 0x5615632c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.713+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/1602373528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632b9df0 0x5615632c2ab0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.713+0000 7f7b1a98d740 1 -- 172.21.15.8:0/1602373528 >> 172.21.15.8:0/1602373528 conn(0x5615632b4520 msgr2=0x5615632b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.713+0000 7f7b1a98d740 1 -- 172.21.15.8:0/1602373528 shutdown_connections 2024-03-16T21:00:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.713+0000 7f7b1a98d740 1 -- 172.21.15.8:0/1602373528 wait complete. 2024-03-16T21:00:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.713+0000 7f7b1a98d740 1 -- start start 2024-03-16T21:00:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.713+0000 7f7b1a98d740 1 Processor -- start 2024-03-16T21:00:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632b9df0 0x5615632ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632ba710 0x5615632cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b1a98d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 0x5615632bd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615632bd820 con 0x5615632b9df0 2024-03-16T21:00:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615632bd990 con 0x5615632c32f0 2024-03-16T21:00:59.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b1a98d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615632bdb50 con 0x5615632ba710 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b1a98d740 10 client.0 _ll_register_callbacks cb 0x7f7b08032f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b15200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632b9df0 0x5615632ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b07e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632ba710 0x5615632cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b15200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632b9df0 0x5615632ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32978/0 (socket says 172.21.15.8:32978) 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b15c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 0x5615632bd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b15200640 1 -- 172.21.15.8:0/299619852 learned_addr learned my addr 172.21.15.8:0/299619852 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b15c00640 1 -- 172.21.15.8:0/299619852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632ba710 msgr2=0x5615632cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b15c00640 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632ba710 0x5615632cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b15c00640 1 -- 172.21.15.8:0/299619852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632b9df0 msgr2=0x5615632ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.714+0000 7f7b15c00640 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632b9df0 0x5615632ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.715+0000 7f7b15c00640 1 -- 172.21.15.8:0/299619852 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56156321f5a0 con 0x5615632c32f0 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.715+0000 7f7b07e00640 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632ba710 0x5615632cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.715+0000 7f7b15c00640 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 0x5615632bd120 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7b080d4b40 tx=0x7f7b0804d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40cb4760404a0acf server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.715+0000 7f7afea00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:00:59.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.715+0000 7f7afea00640 1 -- 172.21.15.8:0/299619852 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b080bbc50 con 0x5615632c32f0 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.715+0000 7f7afea00640 1 -- 172.21.15.8:0/299619852 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7b080cfe40 con 0x5615632c32f0 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.715+0000 7f7b1a98d740 1 -- 172.21.15.8:0/299619852 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b00004c80 con 0x5615632c32f0 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.715+0000 7f7afea00640 1 -- 172.21.15.8:0/299619852 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b0802c290 con 0x5615632c32f0 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.715+0000 7f7b1a98d740 10 client.26279 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.715+0000 7f7b1a98d740 1 -- 172.21.15.8:0/299619852 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5615631e2df0 con 0x5615632c32f0 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.715+0000 7f7afea00640 1 -- 172.21.15.8:0/299619852 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7b00004c80 con 0x5615632c32f0 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.716+0000 7f7afea00640 1 -- 172.21.15.8:0/299619852 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f7b080c20b0 con 0x5615632c32f0 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.716+0000 7f7b1a98d740 10 client.26279 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.716+0000 7f7b1a98d740 10 client.26279 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.716+0000 7f7b1a98d740 20 client.26279 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.716+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56156332f540 0x561563331960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.716+0000 7f7b1a98d740 4 client.26279 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.716+0000 7f7b1a98d740 1 -- 172.21.15.8:0/299619852 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561562fac890 con 0x56156332f540 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.716+0000 7f7b15200640 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56156332f540 0x561563331960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.716+0000 7f7b15200640 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56156332f540 0x561563331960 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb5bb0e8b40b7dca server_cookie=d9bc93026fc077c in_seq=0 out_seq=0 2024-03-16T21:00:59.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.716+0000 7f7afea00640 10 client.26279 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7afea00640 1 -- 172.21.15.8:0/299619852 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561562fac890 con 0x56156332f540 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7afea00640 10 client.26279 handle_command_reply: tid=0 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 1 client.26279 shutdown 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 1 -- 172.21.15.8:0/299619852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 msgr2=0x5615632bd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 0x5615632bd120 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7b080d4b40 tx=0x7f7b0804d000 comp rx=0 tx=0).stop 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 1 -- 172.21.15.8:0/299619852 shutdown_connections 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56156332f540 0x561563331960 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615632c32f0 0x5615632bd120 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615632ba710 0x5615632cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7afea00640 0 client.26279 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 1 --2- 172.21.15.8:0/299619852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5615632b9df0 0x5615632ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 1 -- 172.21.15.8:0/299619852 >> 172.21.15.8:0/299619852 conn(0x5615632b4520 msgr2=0x5615632b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 1 -- 172.21.15.8:0/299619852 shutdown_connections 2024-03-16T21:00:59.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 1 -- 172.21.15.8:0/299619852 wait complete. 2024-03-16T21:00:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.717+0000 7f7b1a98d740 20 client.26279 trim_cache size 0 max 16384 2024-03-16T21:00:59.727 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:00:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 -- 172.21.15.8:0/2065897816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7af40a1c20 msgr2=0x7f7af40a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7af40a1c20 0x7f7af40a40e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5615632b56b0 tx=0x7f7af8009260 comp rx=0 tx=0).stop 2024-03-16T21:00:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 -- 172.21.15.8:0/2065897816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b10109650 msgr2=0x7f7b10199a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b10109650 0x7f7b10199a50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7b08037040 tx=0x7f7b080045e0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 -- 172.21.15.8:0/2065897816 shutdown_connections 2024-03-16T21:00:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7af40a1c20 0x7f7af40a40e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b10109650 0x7f7b10199a50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b10103f50 0x7f7b1019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 --2- 172.21.15.8:0/2065897816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b10103590 0x7f7b1019f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 -- 172.21.15.8:0/2065897816 >> 172.21.15.8:0/2065897816 conn(0x7f7b100ff020 msgr2=0x7f7b101005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 -- 172.21.15.8:0/2065897816 shutdown_connections 2024-03-16T21:00:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.718+0000 7f7b16600640 1 -- 172.21.15.8:0/2065897816 wait complete. 2024-03-16T21:00:59.741 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:00:59.741 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:00:59.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.943+0000 7fca27200640 1 -- 172.21.15.8:0/1141685067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca281066a0 msgr2=0x7fca2810e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.943+0000 7fca27200640 1 --2- 172.21.15.8:0/1141685067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca281066a0 0x7fca2810e270 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fca20009c10 tx=0x7fca2002bee0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.943+0000 7fca27200640 1 -- 172.21.15.8:0/1141685067 shutdown_connections 2024-03-16T21:00:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.943+0000 7fca27200640 1 --2- 172.21.15.8:0/1141685067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca281066a0 0x7fca2810e270 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.943+0000 7fca27200640 1 --2- 172.21.15.8:0/1141685067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca28101f80 0x7fca28105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.943+0000 7fca27200640 1 --2- 172.21.15.8:0/1141685067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca281015d0 0x7fca281019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.943+0000 7fca27200640 1 -- 172.21.15.8:0/1141685067 >> 172.21.15.8:0/1141685067 conn(0x7fca280fce50 msgr2=0x7fca280ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.944+0000 7fca27200640 1 -- 172.21.15.8:0/1141685067 shutdown_connections 2024-03-16T21:00:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.944+0000 7fca27200640 1 -- 172.21.15.8:0/1141685067 wait complete. 2024-03-16T21:00:59.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.944+0000 7fca27200640 1 Processor -- start 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca27200640 1 -- start start 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca27200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca281015d0 0x7fca28199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca27200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca281066a0 0x7fca2819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca27200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca2819e560 0x7fca2819ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca27200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2819ef50 con 0x7fca281066a0 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca27200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2819f0c0 con 0x7fca281015d0 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca27200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2819f230 con 0x7fca2819e560 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca1d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca281066a0 0x7fca2819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca25e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca281015d0 0x7fca28199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca1d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca281066a0 0x7fca2819a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33010/0 (socket says 172.21.15.8:33010) 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca1d400640 1 -- 172.21.15.8:0/681436478 learned_addr learned my addr 172.21.15.8:0/681436478 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.945+0000 7fca26800640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca2819e560 0x7fca2819ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.946+0000 7fca25e00640 1 -- 172.21.15.8:0/681436478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca2819e560 msgr2=0x7fca2819ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.946+0000 7fca25e00640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca2819e560 0x7fca2819ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.946+0000 7fca25e00640 1 -- 172.21.15.8:0/681436478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca281066a0 msgr2=0x7fca2819a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.946+0000 7fca25e00640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca281066a0 0x7fca2819a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.946+0000 7fca25e00640 1 -- 172.21.15.8:0/681436478 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20009840 con 0x7fca281015d0 2024-03-16T21:00:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.946+0000 7fca26800640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca2819e560 0x7fca2819ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.946+0000 7fca25e00640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca281015d0 0x7fca28199d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fca1800e790 tx=0x7fca1800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.946+0000 7fca1d400640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca281066a0 0x7fca2819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.947+0000 7fca1f400640 1 -- 172.21.15.8:0/681436478 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1800ccc0 con 0x7fca281015d0 2024-03-16T21:00:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.947+0000 7fca1f400640 1 -- 172.21.15.8:0/681436478 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fca1800eea0 con 0x7fca281015d0 2024-03-16T21:00:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.947+0000 7fca27200640 1 -- 172.21.15.8:0/681436478 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca281a6810 con 0x7fca281015d0 2024-03-16T21:00:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.947+0000 7fca1f400640 1 -- 172.21.15.8:0/681436478 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18018780 con 0x7fca281015d0 2024-03-16T21:00:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.947+0000 7fca27200640 1 -- 172.21.15.8:0/681436478 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca281a6d10 con 0x7fca281015d0 2024-03-16T21:00:59.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.950+0000 7fca1f400640 1 -- 172.21.15.8:0/681436478 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fca18010430 con 0x7fca281015d0 2024-03-16T21:00:59.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.950+0000 7fca2ff92740 1 Processor -- start 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.950+0000 7fca2ff92740 1 -- start start 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.951+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 0x55d76a3321d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.951+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a332710 0x55d76a33adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.951+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a33b2f0 0x55d76a33d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.951+0000 7fca2ff92740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a2a0210 con 0x55d76a331df0 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.951+0000 7fca2ff92740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a29d740 con 0x55d76a332710 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.951+0000 7fca2ff92740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a298f20 con 0x55d76a33b2f0 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.951+0000 7fca26800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 0x55d76a3321d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.951+0000 7fca25e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a332710 0x55d76a33adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.951+0000 7fca26800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 0x55d76a3321d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33014/0 (socket says 172.21.15.8:33014) 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.951+0000 7fca1d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a33b2f0 0x55d76a33d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.951+0000 7fca26800640 1 -- 172.21.15.8:0/3958098366 learned_addr learned my addr 172.21.15.8:0/3958098366 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca1d400640 1 -- 172.21.15.8:0/3958098366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a332710 msgr2=0x55d76a33adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca1d400640 1 --2- 172.21.15.8:0/3958098366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a332710 0x55d76a33adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca1d400640 1 -- 172.21.15.8:0/3958098366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 msgr2=0x55d76a3321d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca1d400640 1 --2- 172.21.15.8:0/3958098366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 0x55d76a3321d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca1d400640 1 -- 172.21.15.8:0/3958098366 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d76a25adf0 con 0x55d76a33b2f0 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca26800640 1 --2- 172.21.15.8:0/3958098366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 0x55d76a3321d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca1f400640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca0c0a1c20 0x7fca0c0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca1d400640 1 --2- 172.21.15.8:0/3958098366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a33b2f0 0x55d76a33d6e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fca2810e720 tx=0x7fca100118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4d8de91c0ce73 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca1f400640 1 -- 172.21.15.8:0/681436478 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fca18014070 con 0x7fca281015d0 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca26800640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca0c0a1c20 0x7fca0c0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca17400640 1 -- 172.21.15.8:0/3958098366 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10004030 con 0x55d76a33b2f0 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca17400640 1 -- 172.21.15.8:0/3958098366 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fca10004190 con 0x55d76a33b2f0 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.952+0000 7fca17400640 1 -- 172.21.15.8:0/3958098366 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000f910 con 0x55d76a33b2f0 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.953+0000 7fca2ff92740 1 -- 172.21.15.8:0/3958098366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a33b2f0 msgr2=0x55d76a33d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.953+0000 7fca26800640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca0c0a1c20 0x7fca0c0a40e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca20009be0 tx=0x7fca20005fd0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.953+0000 7fca2ff92740 1 --2- 172.21.15.8:0/3958098366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a33b2f0 0x55d76a33d6e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fca2810e720 tx=0x7fca100118d0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.953+0000 7fca2ff92740 1 -- 172.21.15.8:0/3958098366 shutdown_connections 2024-03-16T21:00:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.953+0000 7fca2ff92740 1 --2- 172.21.15.8:0/3958098366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a33b2f0 0x55d76a33d6e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.953+0000 7fca2ff92740 1 --2- 172.21.15.8:0/3958098366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a332710 0x55d76a33adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.953+0000 7fca2ff92740 1 --2- 172.21.15.8:0/3958098366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 0x55d76a3321d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.953+0000 7fca2ff92740 1 -- 172.21.15.8:0/3958098366 >> 172.21.15.8:0/3958098366 conn(0x55d76a32c520 msgr2=0x55d76a32c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.953+0000 7fca2ff92740 1 -- 172.21.15.8:0/3958098366 shutdown_connections 2024-03-16T21:00:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.953+0000 7fca2ff92740 1 -- 172.21.15.8:0/3958098366 wait complete. 2024-03-16T21:00:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.954+0000 7fca2ff92740 1 -- start start 2024-03-16T21:00:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.954+0000 7fca2ff92740 1 Processor -- start 2024-03-16T21:00:59.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.954+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a3382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.954+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a332710 0x55d76a338830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.954+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 0x55d76a338d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.954+0000 7fca2ff92740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a23e150 con 0x55d76a332710 2024-03-16T21:00:59.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.954+0000 7fca2ff92740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a23ddf0 con 0x55d76a33b2f0 2024-03-16T21:00:59.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.954+0000 7fca2ff92740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a0071c0 con 0x55d76a331df0 2024-03-16T21:00:59.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.954+0000 7fca2ff92740 10 client.0 _ll_register_callbacks cb 0x55d76a28d2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:59.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca25e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a3382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca26800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 0x55d76a338d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca25e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a3382f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33114/0 (socket says 172.21.15.8:33114) 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca26800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 0x55d76a338d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35612/0 (socket says 172.21.15.8:35612) 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca25e00640 1 -- 172.21.15.8:0/211834800 learned_addr learned my addr 172.21.15.8:0/211834800 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca1d400640 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a332710 0x55d76a338830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca25e00640 1 -- 172.21.15.8:0/211834800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 msgr2=0x55d76a338d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca25e00640 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 0x55d76a338d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca25e00640 1 -- 172.21.15.8:0/211834800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a332710 msgr2=0x55d76a338830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca25e00640 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a332710 0x55d76a338830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca25e00640 1 -- 172.21.15.8:0/211834800 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca10009c50 con 0x55d76a331df0 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca26800640 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 0x55d76a338d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca25e00640 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a3382f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fca1809a3a0 tx=0x7fca1809a470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c37e7b4e3bb49fa server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.955+0000 7fca0be00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca0be00640 1 -- 172.21.15.8:0/211834800 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1800ce20 con 0x55d76a331df0 2024-03-16T21:00:59.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca0be00640 1 -- 172.21.15.8:0/211834800 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fca1809ada0 con 0x55d76a331df0 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca2ff92740 1 -- 172.21.15.8:0/211834800 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d769f987e0 con 0x55d76a331df0 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca0be00640 1 -- 172.21.15.8:0/211834800 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca1809a6a0 con 0x55d76a331df0 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca2ff92740 10 client.26293 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca2ff92740 1 -- 172.21.15.8:0/211834800 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55d76a2975a0 con 0x55d76a331df0 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca0be00640 1 -- 172.21.15.8:0/211834800 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55d769f987e0 con 0x55d76a331df0 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca0be00640 1 -- 172.21.15.8:0/211834800 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fca180cb440 con 0x55d76a331df0 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca2ff92740 10 client.26293 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca2ff92740 10 client.26293 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca2ff92740 20 client.26293 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca2ff92740 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d76a34b360 0x55d76a34d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca2ff92740 4 client.26293 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.956+0000 7fca2ff92740 1 -- 172.21.15.8:0/211834800 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d769fd5720 con 0x55d76a34b360 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.957+0000 7fca1d400640 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d76a34b360 0x55d76a34d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.957+0000 7fca1d400640 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d76a34b360 0x55d76a34d750 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3966f0c3c4f6a2d6 server_cookie=3daacd8bba8ed106 in_seq=0 out_seq=0 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.957+0000 7fca0be00640 10 client.26293 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca0be00640 1 -- 172.21.15.8:0/211834800 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d769fd5720 con 0x55d76a34b360 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca0be00640 10 client.26293 handle_command_reply: tid=0 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca2ff92740 1 client.26293 shutdown 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca2ff92740 1 -- 172.21.15.8:0/211834800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 msgr2=0x55d76a3382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca2ff92740 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a3382f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fca1809a3a0 tx=0x7fca1809a470 comp rx=0 tx=0).stop 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca2ff92740 1 -- 172.21.15.8:0/211834800 shutdown_connections 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca2ff92740 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 0x55d76a338d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca2ff92740 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d76a34b360 0x55d76a34d750 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca2ff92740 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a332710 0x55d76a338830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca2ff92740 1 --2- 172.21.15.8:0/211834800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a3382f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca2ff92740 1 -- 172.21.15.8:0/211834800 >> 172.21.15.8:0/211834800 conn(0x55d76a32c520 msgr2=0x55d76a32e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.958+0000 7fca0be00640 0 client.26293 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.959+0000 7fca2ff92740 1 -- 172.21.15.8:0/211834800 shutdown_connections 2024-03-16T21:00:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.959+0000 7fca2ff92740 1 -- 172.21.15.8:0/211834800 wait complete. 2024-03-16T21:00:59.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.959+0000 7fca2ff92740 20 client.26293 trim_cache size 0 max 16384 2024-03-16T21:00:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca2ff92740 1 Processor -- start 2024-03-16T21:00:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca2ff92740 1 -- start start 2024-03-16T21:00:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a338b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a332710 0x55d76a32b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a33b2f0 0x55d76a346670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca2ff92740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a32e850 con 0x55d76a33b2f0 2024-03-16T21:00:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca2ff92740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a32d750 con 0x55d76a332710 2024-03-16T21:00:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca2ff92740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a331170 con 0x55d76a331df0 2024-03-16T21:00:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca25e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a338b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca1d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a332710 0x55d76a32b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca26800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a33b2f0 0x55d76a346670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca25e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a338b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33120/0 (socket says 172.21.15.8:33120) 2024-03-16T21:00:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.973+0000 7fca25e00640 1 -- 172.21.15.8:0/1610757065 learned_addr learned my addr 172.21.15.8:0/1610757065 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.974+0000 7fca25e00640 1 -- 172.21.15.8:0/1610757065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a332710 msgr2=0x55d76a32b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.974+0000 7fca25e00640 1 --2- 172.21.15.8:0/1610757065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a332710 0x55d76a32b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.974+0000 7fca25e00640 1 -- 172.21.15.8:0/1610757065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a33b2f0 msgr2=0x55d76a346670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.974+0000 7fca25e00640 1 --2- 172.21.15.8:0/1610757065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a33b2f0 0x55d76a346670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.974+0000 7fca25e00640 1 -- 172.21.15.8:0/1610757065 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d76a233ab0 con 0x55d76a331df0 2024-03-16T21:00:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.974+0000 7fca1d400640 1 --2- 172.21.15.8:0/1610757065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a332710 0x55d76a32b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:00:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.974+0000 7fca25e00640 1 --2- 172.21.15.8:0/1610757065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a338b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fca18096b00 tx=0x7fca18098bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e6ffbb59a2f52ac server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.974+0000 7fca16a00640 1 -- 172.21.15.8:0/1610757065 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1809a1e0 con 0x55d76a331df0 2024-03-16T21:00:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.974+0000 7fca16a00640 1 -- 172.21.15.8:0/1610757065 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fca1809ada0 con 0x55d76a331df0 2024-03-16T21:00:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.974+0000 7fca16a00640 1 -- 172.21.15.8:0/1610757065 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca180a2ed0 con 0x55d76a331df0 2024-03-16T21:00:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.975+0000 7fca2ff92740 1 -- 172.21.15.8:0/1610757065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 msgr2=0x55d76a338b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.975+0000 7fca2ff92740 1 --2- 172.21.15.8:0/1610757065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a338b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fca18096b00 tx=0x7fca18098bb0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.975+0000 7fca2ff92740 1 -- 172.21.15.8:0/1610757065 shutdown_connections 2024-03-16T21:00:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.975+0000 7fca2ff92740 1 --2- 172.21.15.8:0/1610757065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a33b2f0 0x55d76a346670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.975+0000 7fca2ff92740 1 --2- 172.21.15.8:0/1610757065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a332710 0x55d76a32b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.975+0000 7fca2ff92740 1 --2- 172.21.15.8:0/1610757065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a331df0 0x55d76a338b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.975+0000 7fca2ff92740 1 -- 172.21.15.8:0/1610757065 >> 172.21.15.8:0/1610757065 conn(0x55d76a32c520 msgr2=0x55d76a32ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.975+0000 7fca2ff92740 1 -- 172.21.15.8:0/1610757065 shutdown_connections 2024-03-16T21:00:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.975+0000 7fca2ff92740 1 -- 172.21.15.8:0/1610757065 wait complete. 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca2ff92740 1 -- start start 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca2ff92740 1 Processor -- start 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 0x55d76a33ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a332710 0x55d76a33f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca2ff92740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 0x55d76a39fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca2ff92740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a3a0180 con 0x55d76a331df0 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca2ff92740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a3a02f0 con 0x55d76a33b2f0 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca2ff92740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76a3a04b0 con 0x55d76a332710 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca2ff92740 10 client.0 _ll_register_callbacks cb 0x7fca180d3220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca1d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a332710 0x55d76a33f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca1d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a332710 0x55d76a33f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33130/0 (socket says 172.21.15.8:33130) 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca1d400640 1 -- 172.21.15.8:0/3728482170 learned_addr learned my addr 172.21.15.8:0/3728482170 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.976+0000 7fca26800640 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 0x55d76a39fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.977+0000 7fca25e00640 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 0x55d76a33ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.977+0000 7fca1d400640 1 -- 172.21.15.8:0/3728482170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 msgr2=0x55d76a39fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.977+0000 7fca1d400640 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 0x55d76a39fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.977+0000 7fca1d400640 1 -- 172.21.15.8:0/3728482170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 msgr2=0x55d76a33ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.977+0000 7fca1d400640 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 0x55d76a33ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.977+0000 7fca1d400640 1 -- 172.21.15.8:0/3728482170 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d76a25adf0 con 0x55d76a332710 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.977+0000 7fca1d400640 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a332710 0x55d76a33f370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fca10003f40 tx=0x7fca10011e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8e21b4da5579962 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.977+0000 7fca0be00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.977+0000 7fca0be00640 1 -- 172.21.15.8:0/3728482170 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10029040 con 0x55d76a332710 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.977+0000 7fca2ff92740 1 -- 172.21.15.8:0/3728482170 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca10004190 con 0x55d76a332710 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.977+0000 7fca0be00640 1 -- 172.21.15.8:0/3728482170 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fca10005250 con 0x55d76a332710 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.978+0000 7fca0be00640 1 -- 172.21.15.8:0/3728482170 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca1002c340 con 0x55d76a332710 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.978+0000 7fca2ff92740 10 client.26299 fetch_fsmap learned FSMap version 30 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.978+0000 7fca2ff92740 1 -- 172.21.15.8:0/3728482170 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55d76a2975a0 con 0x55d76a332710 2024-03-16T21:00:59.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.978+0000 7fca0be00640 1 -- 172.21.15.8:0/3728482170 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fca10004190 con 0x55d76a332710 2024-03-16T21:00:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.978+0000 7fca0be00640 1 -- 172.21.15.8:0/3728482170 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fca10021040 con 0x55d76a332710 2024-03-16T21:00:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.978+0000 7fca2ff92740 10 client.26299 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:00:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.978+0000 7fca2ff92740 10 client.26299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:00:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.978+0000 7fca2ff92740 20 client.26299 populate_metadata read hostname 'smithi008' 2024-03-16T21:00:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.978+0000 7fca2ff92740 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d76a3a7db0 0x55d76a3aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:00:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.978+0000 7fca2ff92740 4 client.26299 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:00:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.978+0000 7fca2ff92740 1 -- 172.21.15.8:0/3728482170 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d76a024890 con 0x55d76a3a7db0 2024-03-16T21:00:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca25e00640 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d76a3a7db0 0x55d76a3aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:00:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca25e00640 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d76a3a7db0 0x55d76a3aa1d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36e29b0952d768d8 server_cookie=c64690206c29a6c4 in_seq=0 out_seq=0 2024-03-16T21:00:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca0be00640 10 client.26299 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:59.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca0be00640 1 -- 172.21.15.8:0/3728482170 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d76a024890 con 0x55d76a3a7db0 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca0be00640 10 client.26299 handle_command_reply: tid=0 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca2ff92740 1 client.26299 shutdown 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca2ff92740 1 -- 172.21.15.8:0/3728482170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a332710 msgr2=0x55d76a33f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca2ff92740 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a332710 0x55d76a33f370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fca10003f40 tx=0x7fca10011e50 comp rx=0 tx=0).stop 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca2ff92740 1 -- 172.21.15.8:0/3728482170 shutdown_connections 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca2ff92740 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d76a33b2f0 0x55d76a39fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca2ff92740 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d76a332710 0x55d76a33f370 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca2ff92740 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d76a3a7db0 0x55d76a3aa1d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca2ff92740 1 --2- 172.21.15.8:0/3728482170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d76a331df0 0x55d76a33ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca0be00640 0 client.26299 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.979+0000 7fca2ff92740 1 -- 172.21.15.8:0/3728482170 >> 172.21.15.8:0/3728482170 conn(0x55d76a32c520 msgr2=0x55d76a32b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.980+0000 7fca2ff92740 1 -- 172.21.15.8:0/3728482170 shutdown_connections 2024-03-16T21:00:59.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.980+0000 7fca2ff92740 1 -- 172.21.15.8:0/3728482170 wait complete. 2024-03-16T21:00:59.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.980+0000 7fca2ff92740 20 client.26299 trim_cache size 0 max 16384 2024-03-16T21:00:59.990 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.980+0000 7fca27200640 1 -- 172.21.15.8:0/681436478 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca0c0a1c20 msgr2=0x7fca0c0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.980+0000 7fca27200640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca0c0a1c20 0x7fca0c0a40e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca20009be0 tx=0x7fca20005fd0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.980+0000 7fca27200640 1 -- 172.21.15.8:0/681436478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca281015d0 msgr2=0x7fca28199d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.980+0000 7fca27200640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca281015d0 0x7fca28199d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fca1800e790 tx=0x7fca1800ec50 comp rx=0 tx=0).stop 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.981+0000 7fca27200640 1 -- 172.21.15.8:0/681436478 shutdown_connections 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.981+0000 7fca27200640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fca0c0a1c20 0x7fca0c0a40e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.981+0000 7fca27200640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca2819e560 0x7fca2819ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.981+0000 7fca27200640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca281066a0 0x7fca2819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.981+0000 7fca27200640 1 --2- 172.21.15.8:0/681436478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca281015d0 0x7fca28199d90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.981+0000 7fca27200640 1 -- 172.21.15.8:0/681436478 >> 172.21.15.8:0/681436478 conn(0x7fca280fce50 msgr2=0x7fca280fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.981+0000 7fca27200640 1 -- 172.21.15.8:0/681436478 shutdown_connections 2024-03-16T21:00:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:00:59.981+0000 7fca27200640 1 -- 172.21.15.8:0/681436478 wait complete. 2024-03-16T21:00:59.994 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:00:59 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/208112646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:01:00.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:00:59 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/208112646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:01:00.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:00:59 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/208112646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:01:01.006 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:01:01.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:01:01.006 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:01:01.103 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:00 smithi008 ceph-mon[31434]: pgmap v98: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-03-16T21:01:01.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:00 smithi170 ceph-mon[35947]: pgmap v98: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-03-16T21:01:01.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:00 smithi186 ceph-mon[36391]: pgmap v98: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-03-16T21:01:01.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.239+0000 7f413e600640 1 -- 172.21.15.8:0/3366735216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41380738a0 msgr2=0x7f4138073c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.239+0000 7f413e600640 1 --2- 172.21.15.8:0/3366735216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41380738a0 0x7f4138073c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f412c009900 tx=0x7f412c02bcd0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.239+0000 7f413e600640 1 -- 172.21.15.8:0/3366735216 shutdown_connections 2024-03-16T21:01:01.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.239+0000 7f413e600640 1 --2- 172.21.15.8:0/3366735216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f413810dc20 0x7f4138110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.239+0000 7f413e600640 1 --2- 172.21.15.8:0/3366735216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41380741c0 0x7f413810d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.239+0000 7f413e600640 1 --2- 172.21.15.8:0/3366735216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41380738a0 0x7f4138073c80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.239+0000 7f413e600640 1 -- 172.21.15.8:0/3366735216 >> 172.21.15.8:0/3366735216 conn(0x7f41380fce50 msgr2=0x7f41380ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.240+0000 7f413e600640 1 -- 172.21.15.8:0/3366735216 shutdown_connections 2024-03-16T21:01:01.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.240+0000 7f413e600640 1 -- 172.21.15.8:0/3366735216 wait complete. 2024-03-16T21:01:01.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.241+0000 7f413e600640 1 Processor -- start 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.241+0000 7f413e600640 1 -- start start 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.241+0000 7f413e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41380738a0 0x7f413819f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.241+0000 7f413e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41380741c0 0x7f413819fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.241+0000 7f413e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f413810dc20 0x7f4138199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.241+0000 7f413e600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413819a180 con 0x7f413810dc20 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.241+0000 7f413e600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413819a2f0 con 0x7f41380738a0 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.241+0000 7f413e600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413819a4b0 con 0x7f41380741c0 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.241+0000 7f413d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41380738a0 0x7f413819f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f413d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41380738a0 0x7f413819f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35648/0 (socket says 172.21.15.8:35648) 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f413d200640 1 -- 172.21.15.8:0/3569265759 learned_addr learned my addr 172.21.15.8:0/3569265759 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f4137e00640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41380741c0 0x7f413819fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f413dc00640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f413810dc20 0x7f4138199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f413d200640 1 -- 172.21.15.8:0/3569265759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41380741c0 msgr2=0x7f413819fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f413d200640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41380741c0 0x7f413819fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f413d200640 1 -- 172.21.15.8:0/3569265759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f413810dc20 msgr2=0x7f4138199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f413d200640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f413810dc20 0x7f4138199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f413d200640 1 -- 172.21.15.8:0/3569265759 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c009560 con 0x7f41380738a0 2024-03-16T21:01:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f413dc00640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f413810dc20 0x7f4138199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:01:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f413d200640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41380738a0 0x7f413819f930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f412c000c00 tx=0x7f412c004390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.242+0000 7f4135600640 1 -- 172.21.15.8:0/3569265759 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c02cb60 con 0x7f41380738a0 2024-03-16T21:01:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.243+0000 7f413e600640 1 -- 172.21.15.8:0/3569265759 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413819a730 con 0x7f41380738a0 2024-03-16T21:01:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.243+0000 7f4135600640 1 -- 172.21.15.8:0/3569265759 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f412c02ccc0 con 0x7f41380738a0 2024-03-16T21:01:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.243+0000 7f4135600640 1 -- 172.21.15.8:0/3569265759 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c003c30 con 0x7f41380738a0 2024-03-16T21:01:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.243+0000 7f413e600640 1 -- 172.21.15.8:0/3569265759 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41381a69d0 con 0x7f41380738a0 2024-03-16T21:01:01.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.246+0000 7f4135600640 1 -- 172.21.15.8:0/3569265759 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f412c004e10 con 0x7f41380738a0 2024-03-16T21:01:01.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.246+0000 7f414296e740 1 Processor -- start 2024-03-16T21:01:01.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f414296e740 1 -- start start 2024-03-16T21:01:01.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f414296e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 0x563bdef024f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f414296e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef0b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f414296e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef0da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f414296e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdeebd300 con 0x563bdef0b610 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f414296e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdee6fe50 con 0x563bdef02110 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f414296e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdee6d380 con 0x563bdef02a30 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f413dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 0x563bdef024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f413dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 0x563bdef024f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35660/0 (socket says 172.21.15.8:35660) 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f413dc00640 1 -- 172.21.15.8:0/118295093 learned_addr learned my addr 172.21.15.8:0/118295093 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f413d200640 1 --2- 172.21.15.8:0/118295093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef0b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.247+0000 7f4137e00640 1 --2- 172.21.15.8:0/118295093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef0da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f413dc00640 1 -- 172.21.15.8:0/118295093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 msgr2=0x563bdef0b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f413dc00640 1 --2- 172.21.15.8:0/118295093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef0b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f413dc00640 1 -- 172.21.15.8:0/118295093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 msgr2=0x563bdef0da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f413dc00640 1 --2- 172.21.15.8:0/118295093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef0da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f4135600640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41200a1ba0 0x7f41200a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f413dc00640 1 -- 172.21.15.8:0/118295093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563bdee31c80 con 0x563bdef02110 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f413d200640 1 --2- 172.21.15.8:0/118295093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef0b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f4135600640 1 -- 172.21.15.8:0/3569265759 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f412c0ef910 con 0x7f41380738a0 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f413dc00640 1 --2- 172.21.15.8:0/118295093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 0x563bdef024f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4130009fd0 tx=0x7f4130010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d277156c46661f3d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f413d200640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41200a1ba0 0x7f41200a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f412a000640 1 -- 172.21.15.8:0/118295093 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130011700 con 0x563bdef02110 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f412a000640 1 -- 172.21.15.8:0/118295093 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4130015070 con 0x563bdef02110 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.248+0000 7f412a000640 1 -- 172.21.15.8:0/118295093 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413001be80 con 0x563bdef02110 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.249+0000 7f414296e740 1 -- 172.21.15.8:0/118295093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 msgr2=0x563bdef024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.249+0000 7f414296e740 1 --2- 172.21.15.8:0/118295093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 0x563bdef024f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4130009fd0 tx=0x7f4130010860 comp rx=0 tx=0).stop 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.249+0000 7f413d200640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41200a1ba0 0x7f41200a4060 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x563bdef01be0 tx=0x7f412c0dc040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.249+0000 7f414296e740 1 -- 172.21.15.8:0/118295093 shutdown_connections 2024-03-16T21:01:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.249+0000 7f414296e740 1 --2- 172.21.15.8:0/118295093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef0da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.249+0000 7f414296e740 1 --2- 172.21.15.8:0/118295093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef0b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.249+0000 7f414296e740 1 --2- 172.21.15.8:0/118295093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 0x563bdef024f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.249+0000 7f414296e740 1 -- 172.21.15.8:0/118295093 >> 172.21.15.8:0/118295093 conn(0x563bdeefc840 msgr2=0x563bdeefcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.249+0000 7f414296e740 1 -- 172.21.15.8:0/118295093 shutdown_connections 2024-03-16T21:01:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.249+0000 7f414296e740 1 -- 172.21.15.8:0/118295093 wait complete. 2024-03-16T21:01:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.250+0000 7f414296e740 1 -- start start 2024-03-16T21:01:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.250+0000 7f414296e740 1 Processor -- start 2024-03-16T21:01:01.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.250+0000 7f414296e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 0x563bdef08630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.250+0000 7f414296e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef08b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.250+0000 7f414296e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef090b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.250+0000 7f414296e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdee68b60 con 0x563bdef0b610 2024-03-16T21:01:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.250+0000 7f414296e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdee0dfd0 con 0x563bdef02110 2024-03-16T21:01:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.250+0000 7f414296e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdee0dc70 con 0x563bdef02a30 2024-03-16T21:01:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.250+0000 7f414296e740 10 client.0 _ll_register_callbacks cb 0x563bdeb79c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f4137e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef08b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f4137e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef08b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33174/0 (socket says 172.21.15.8:33174) 2024-03-16T21:01:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f4137e00640 1 -- 172.21.15.8:0/2227986870 learned_addr learned my addr 172.21.15.8:0/2227986870 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f413dc00640 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f413dc00640 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 0x563bdef08630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f4137e00640 1 -- 172.21.15.8:0/2227986870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 msgr2=0x563bdef08630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f4137e00640 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 0x563bdef08630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f4137e00640 1 -- 172.21.15.8:0/2227986870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 msgr2=0x563bdef090b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f4137e00640 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef090b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f4137e00640 1 -- 172.21.15.8:0/2227986870 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4130009c30 con 0x563bdef02a30 2024-03-16T21:01:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f4137e00640 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef08b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4124012700 tx=0x7f4124012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e29039074aebc54 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.251+0000 7f411ea00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:01:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.252+0000 7f411ea00640 1 -- 172.21.15.8:0/2227986870 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124017070 con 0x563bdef02a30 2024-03-16T21:01:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.252+0000 7f411ea00640 1 -- 172.21.15.8:0/2227986870 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4124004050 con 0x563bdef02a30 2024-03-16T21:01:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.252+0000 7f414296e740 1 -- 172.21.15.8:0/2227986870 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563bdeb68860 con 0x563bdef02a30 2024-03-16T21:01:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.252+0000 7f411ea00640 1 -- 172.21.15.8:0/2227986870 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4124004210 con 0x563bdef02a30 2024-03-16T21:01:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.252+0000 7f414296e740 10 client.26311 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.252+0000 7f414296e740 1 -- 172.21.15.8:0/2227986870 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x563bdee671e0 con 0x563bdef02a30 2024-03-16T21:01:01.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.252+0000 7f411ea00640 1 -- 172.21.15.8:0/2227986870 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x563bdeb68860 con 0x563bdef02a30 2024-03-16T21:01:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.252+0000 7f411ea00640 1 -- 172.21.15.8:0/2227986870 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f4124003b00 con 0x563bdef02a30 2024-03-16T21:01:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.253+0000 7f414296e740 10 client.26311 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.253+0000 7f414296e740 10 client.26311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.253+0000 7f414296e740 20 client.26311 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.253+0000 7f414296e740 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563bdef1ba40 0x563bdef1de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.253+0000 7f414296e740 4 client.26311 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:01:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.253+0000 7f414296e740 1 -- 172.21.15.8:0/2227986870 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563bdebb9410 con 0x563bdef1ba40 2024-03-16T21:01:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.253+0000 7f413dc00640 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563bdef1ba40 0x563bdef1de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.253+0000 7f413dc00640 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563bdef1ba40 0x563bdef1de60 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1a788d515754ffd server_cookie=6b495284886d5e18 in_seq=0 out_seq=0 2024-03-16T21:01:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.253+0000 7f411ea00640 10 client.26311 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:01.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.254+0000 7f411ea00640 1 -- 172.21.15.8:0/2227986870 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563bdebb9410 con 0x563bdef1ba40 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.254+0000 7f411ea00640 10 client.26311 handle_command_reply: tid=0 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.254+0000 7f414296e740 1 client.26311 shutdown 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.254+0000 7f414296e740 1 -- 172.21.15.8:0/2227986870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 msgr2=0x563bdef08b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.254+0000 7f414296e740 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef08b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4124012700 tx=0x7f4124012bc0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.254+0000 7f414296e740 1 -- 172.21.15.8:0/2227986870 shutdown_connections 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.255+0000 7f414296e740 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563bdef1ba40 0x563bdef1de60 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.255+0000 7f414296e740 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.255+0000 7f414296e740 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef08b70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.255+0000 7f414296e740 1 --2- 172.21.15.8:0/2227986870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02110 0x563bdef08630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.255+0000 7f411ea00640 0 client.26311 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.255+0000 7f414296e740 1 -- 172.21.15.8:0/2227986870 >> 172.21.15.8:0/2227986870 conn(0x563bdeefc840 msgr2=0x563bdeefe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.255+0000 7f414296e740 1 -- 172.21.15.8:0/2227986870 shutdown_connections 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.255+0000 7f414296e740 1 -- 172.21.15.8:0/2227986870 wait complete. 2024-03-16T21:01:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.255+0000 7f414296e740 20 client.26311 trim_cache size 0 max 16384 2024-03-16T21:01:01.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f414296e740 1 Processor -- start 2024-03-16T21:01:01.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f414296e740 1 -- start start 2024-03-16T21:01:01.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f414296e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02110 0x563bdef0ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f414296e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02a30 0x563bdef16990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f414296e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef16ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f414296e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdef074a0 con 0x563bdef0b610 2024-03-16T21:01:01.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f414296e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdebb10c0 con 0x563bdef02a30 2024-03-16T21:01:01.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f414296e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdef18500 con 0x563bdef02110 2024-03-16T21:01:01.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f413dc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02110 0x563bdef0ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f4137e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02a30 0x563bdef16990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f413dc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02110 0x563bdef0ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33184/0 (socket says 172.21.15.8:33184) 2024-03-16T21:01:01.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.273+0000 7f413dc00640 1 -- 172.21.15.8:0/4275887209 learned_addr learned my addr 172.21.15.8:0/4275887209 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:01.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.274+0000 7f413dc00640 1 --2- 172.21.15.8:0/4275887209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef16ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.274+0000 7f413dc00640 1 -- 172.21.15.8:0/4275887209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02a30 msgr2=0x563bdef16990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.274+0000 7f413dc00640 1 --2- 172.21.15.8:0/4275887209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02a30 0x563bdef16990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.274+0000 7f413dc00640 1 -- 172.21.15.8:0/4275887209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 msgr2=0x563bdef16ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.274+0000 7f413dc00640 1 --2- 172.21.15.8:0/4275887209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef16ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.274+0000 7f413dc00640 1 -- 172.21.15.8:0/4275887209 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563bdee03a90 con 0x563bdef02110 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.274+0000 7f4137e00640 1 --2- 172.21.15.8:0/4275887209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02a30 0x563bdef16990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.274+0000 7f413dc00640 1 --2- 172.21.15.8:0/4275887209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02110 0x563bdef0ad60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4130009c00 tx=0x7f4130010fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5a1bd5de4aaf0bc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.274+0000 7f4129600640 1 -- 172.21.15.8:0/4275887209 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413001cb10 con 0x563bdef02110 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.275+0000 7f4129600640 1 -- 172.21.15.8:0/4275887209 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4130020040 con 0x563bdef02110 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.275+0000 7f4129600640 1 -- 172.21.15.8:0/4275887209 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413002bd10 con 0x563bdef02110 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.275+0000 7f414296e740 1 -- 172.21.15.8:0/4275887209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02110 msgr2=0x563bdef0ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.275+0000 7f414296e740 1 --2- 172.21.15.8:0/4275887209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02110 0x563bdef0ad60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4130009c00 tx=0x7f4130010fd0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.275+0000 7f414296e740 1 -- 172.21.15.8:0/4275887209 shutdown_connections 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.275+0000 7f414296e740 1 --2- 172.21.15.8:0/4275887209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef0b610 0x563bdef16ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.275+0000 7f414296e740 1 --2- 172.21.15.8:0/4275887209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef02a30 0x563bdef16990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.275+0000 7f414296e740 1 --2- 172.21.15.8:0/4275887209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02110 0x563bdef0ad60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.275+0000 7f414296e740 1 -- 172.21.15.8:0/4275887209 >> 172.21.15.8:0/4275887209 conn(0x563bdeefc840 msgr2=0x563bdeefe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.275+0000 7f414296e740 1 -- 172.21.15.8:0/4275887209 shutdown_connections 2024-03-16T21:01:01.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.275+0000 7f414296e740 1 -- 172.21.15.8:0/4275887209 wait complete. 2024-03-16T21:01:01.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.276+0000 7f414296e740 1 -- start start 2024-03-16T21:01:01.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.276+0000 7f414296e740 1 Processor -- start 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.276+0000 7f414296e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef02110 0x563bdef104a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.276+0000 7f414296e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.276+0000 7f414296e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef0b610 0x563bdef10f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.276+0000 7f414296e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdef066e0 con 0x563bdef02110 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.276+0000 7f414296e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdef77300 con 0x563bdef0b610 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.276+0000 7f414296e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bdef77470 con 0x563bdef02a30 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.276+0000 7f414296e740 10 client.0 _ll_register_callbacks cb 0x7f4124009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f4137e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef109e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f413dc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef02110 0x563bdef104a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f4137e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef109e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33194/0 (socket says 172.21.15.8:33194) 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f4137e00640 1 -- 172.21.15.8:0/205277897 learned_addr learned my addr 172.21.15.8:0/205277897 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f413dc00640 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef0b610 0x563bdef10f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f4137e00640 1 -- 172.21.15.8:0/205277897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef0b610 msgr2=0x563bdef10f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f4137e00640 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef0b610 0x563bdef10f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f4137e00640 1 -- 172.21.15.8:0/205277897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef02110 msgr2=0x563bdef104a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f4137e00640 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef02110 0x563bdef104a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f4137e00640 1 -- 172.21.15.8:0/205277897 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563bdee671e0 con 0x563bdef02a30 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f413dc00640 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef0b610 0x563bdef10f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f4137e00640 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef109e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x563bdef09c00 tx=0x7f41240255d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bab9ccc58d810e50 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.277+0000 7f411ea00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f411ea00640 1 -- 172.21.15.8:0/205277897 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124017030 con 0x563bdef02a30 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f411ea00640 1 -- 172.21.15.8:0/205277897 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f412402a070 con 0x563bdef02a30 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f414296e740 1 -- 172.21.15.8:0/205277897 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4130015070 con 0x563bdef02a30 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f411ea00640 1 -- 172.21.15.8:0/205277897 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f412400fd30 con 0x563bdef02a30 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f414296e740 10 client.26317 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f414296e740 1 -- 172.21.15.8:0/205277897 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f4130022040 con 0x563bdef02a30 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f411ea00640 1 -- 172.21.15.8:0/205277897 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4130015070 con 0x563bdef02a30 2024-03-16T21:01:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f411ea00640 1 -- 172.21.15.8:0/205277897 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f41240035f0 con 0x563bdef02a30 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f414296e740 10 client.26317 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f414296e740 10 client.26317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f414296e740 20 client.26317 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f414296e740 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563bdef78d80 0x563bdef7b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f414296e740 4 client.26317 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.278+0000 7f414296e740 1 -- 172.21.15.8:0/205277897 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x563bdeba57b0 con 0x563bdef78d80 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.279+0000 7f413dc00640 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563bdef78d80 0x563bdef7b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.279+0000 7f413dc00640 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563bdef78d80 0x563bdef7b1a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4336ccc0789efcb0 server_cookie=642b9a06446d46ba in_seq=0 out_seq=0 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.279+0000 7f411ea00640 10 client.26317 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.280+0000 7f411ea00640 1 -- 172.21.15.8:0/205277897 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563bdeba57b0 con 0x563bdef78d80 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.280+0000 7f411ea00640 10 client.26317 handle_command_reply: tid=0 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.280+0000 7f414296e740 1 client.26317 shutdown 2024-03-16T21:01:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f414296e740 1 -- 172.21.15.8:0/205277897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 msgr2=0x563bdef109e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f414296e740 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef109e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x563bdef09c00 tx=0x7f41240255d0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f414296e740 1 -- 172.21.15.8:0/205277897 shutdown_connections 2024-03-16T21:01:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f414296e740 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bdef0b610 0x563bdef10f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f414296e740 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563bdef02a30 0x563bdef109e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f414296e740 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563bdef78d80 0x563bdef7b1a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f414296e740 1 --2- 172.21.15.8:0/205277897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563bdef02110 0x563bdef104a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f411ea00640 0 client.26317 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f414296e740 1 -- 172.21.15.8:0/205277897 >> 172.21.15.8:0/205277897 conn(0x563bdeefc840 msgr2=0x563bdeefb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f414296e740 1 -- 172.21.15.8:0/205277897 shutdown_connections 2024-03-16T21:01:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f414296e740 1 -- 172.21.15.8:0/205277897 wait complete. 2024-03-16T21:01:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.281+0000 7f414296e740 20 client.26317 trim_cache size 0 max 16384 2024-03-16T21:01:01.291 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:01:01.291 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:01:01.291 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "56a2f2fb-1fee-421c-936e-7a56f96d58f0", 2024-03-16T21:01:01.291 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:01:01.291 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:01:01.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 -- 172.21.15.8:0/3569265759 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41200a1ba0 msgr2=0x7f41200a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41200a1ba0 0x7f41200a4060 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x563bdef01be0 tx=0x7f412c0dc040 comp rx=0 tx=0).stop 2024-03-16T21:01:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 -- 172.21.15.8:0/3569265759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41380738a0 msgr2=0x7f413819f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41380738a0 0x7f413819f930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f412c000c00 tx=0x7f412c004390 comp rx=0 tx=0).stop 2024-03-16T21:01:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 -- 172.21.15.8:0/3569265759 shutdown_connections 2024-03-16T21:01:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41200a1ba0 0x7f41200a4060 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f413810dc20 0x7f4138199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41380741c0 0x7f413819fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 --2- 172.21.15.8:0/3569265759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41380738a0 0x7f413819f930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 -- 172.21.15.8:0/3569265759 >> 172.21.15.8:0/3569265759 conn(0x7f41380fce50 msgr2=0x7f41380fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 -- 172.21.15.8:0/3569265759 shutdown_connections 2024-03-16T21:01:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.282+0000 7f413e600640 1 -- 172.21.15.8:0/3569265759 wait complete. 2024-03-16T21:01:01.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:01:01.306 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:01:01.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.527+0000 7f1965c00640 1 -- 172.21.15.8:0/3340212815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1960101010 msgr2=0x7f1960105000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.527+0000 7f1965c00640 1 --2- 172.21.15.8:0/3340212815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1960101010 0x7f1960105000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f194c009900 tx=0x7f194c02bc30 comp rx=0 tx=0).stop 2024-03-16T21:01:01.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.528+0000 7f1965c00640 1 -- 172.21.15.8:0/3340212815 shutdown_connections 2024-03-16T21:01:01.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.528+0000 7f1965c00640 1 --2- 172.21.15.8:0/3340212815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19601056e0 0x7f196010d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.528+0000 7f1965c00640 1 --2- 172.21.15.8:0/3340212815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1960101010 0x7f1960105000 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.528+0000 7f1965c00640 1 --2- 172.21.15.8:0/3340212815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1960100660 0x7f1960100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.528+0000 7f1965c00640 1 -- 172.21.15.8:0/3340212815 >> 172.21.15.8:0/3340212815 conn(0x7f1960077550 msgr2=0x7f1960077960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.528+0000 7f1965c00640 1 -- 172.21.15.8:0/3340212815 shutdown_connections 2024-03-16T21:01:01.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.528+0000 7f1965c00640 1 -- 172.21.15.8:0/3340212815 wait complete. 2024-03-16T21:01:01.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.529+0000 7f1965c00640 1 Processor -- start 2024-03-16T21:01:01.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.530+0000 7f1965c00640 1 -- start start 2024-03-16T21:01:01.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.530+0000 7f1965c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1960100660 0x7f1960199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.530+0000 7f1965c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19601056e0 0x7f196019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.530+0000 7f1965c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f196019e6b0 0x7f196019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.530+0000 7f1965c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196019f0a0 con 0x7f1960100660 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.530+0000 7f1965c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196019f210 con 0x7f19601056e0 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.530+0000 7f1965c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196019f380 con 0x7f196019e6b0 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.530+0000 7f195ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1960100660 0x7f1960199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1960100660 0x7f1960199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33092/0 (socket says 172.21.15.8:33092) 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195ea00640 1 -- 172.21.15.8:0/3746117694 learned_addr learned my addr 172.21.15.8:0/3746117694 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195e000640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19601056e0 0x7f196019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195f400640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f196019e6b0 0x7f196019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195ea00640 1 -- 172.21.15.8:0/3746117694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f196019e6b0 msgr2=0x7f196019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195ea00640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f196019e6b0 0x7f196019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195ea00640 1 -- 172.21.15.8:0/3746117694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19601056e0 msgr2=0x7f196019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195ea00640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19601056e0 0x7f196019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195ea00640 1 -- 172.21.15.8:0/3746117694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c009560 con 0x7f1960100660 2024-03-16T21:01:01.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195e000640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19601056e0 0x7f196019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:01.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195f400640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f196019e6b0 0x7f196019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:01.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.531+0000 7f195ea00640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1960100660 0x7f1960199e40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f195000e9f0 tx=0x7f195000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.532+0000 7f1957400640 1 -- 172.21.15.8:0/3746117694 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950009720 con 0x7f1960100660 2024-03-16T21:01:01.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.532+0000 7f1957400640 1 -- 172.21.15.8:0/3746117694 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f195000cd80 con 0x7f1960100660 2024-03-16T21:01:01.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.532+0000 7f1965c00640 1 -- 172.21.15.8:0/3746117694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19601a6960 con 0x7f1960100660 2024-03-16T21:01:01.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.532+0000 7f1957400640 1 -- 172.21.15.8:0/3746117694 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950010690 con 0x7f1960100660 2024-03-16T21:01:01.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.532+0000 7f1965c00640 1 -- 172.21.15.8:0/3746117694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19601a6d90 con 0x7f1960100660 2024-03-16T21:01:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.535+0000 7f196899c740 1 Processor -- start 2024-03-16T21:01:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.535+0000 7f1957400640 1 -- 172.21.15.8:0/3746117694 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f19500046c0 con 0x7f1960100660 2024-03-16T21:01:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.535+0000 7f196899c740 1 -- start start 2024-03-16T21:01:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.536+0000 7f196899c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e77135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.536+0000 7f196899c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e771362c0 0x557e77136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.536+0000 7f196899c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e7713f630 0x557e77141a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.536+0000 7f196899c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e770a5150 con 0x557e7713f630 2024-03-16T21:01:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.536+0000 7f196899c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e770a2680 con 0x557e77136fa0 2024-03-16T21:01:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.536+0000 7f196899c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e7709de60 con 0x557e771362c0 2024-03-16T21:01:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.536+0000 7f195ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e771362c0 0x557e77136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.536+0000 7f195f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e77135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.536+0000 7f195f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e77135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35738/0 (socket says 172.21.15.8:35738) 2024-03-16T21:01:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.536+0000 7f195f400640 1 -- 172.21.15.8:0/3577387407 learned_addr learned my addr 172.21.15.8:0/3577387407 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.536+0000 7f195e000640 1 --2- 172.21.15.8:0/3577387407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e7713f630 0x557e77141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f195f400640 1 -- 172.21.15.8:0/3577387407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e771362c0 msgr2=0x557e77136740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f195f400640 1 --2- 172.21.15.8:0/3577387407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e771362c0 0x557e77136740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f195f400640 1 -- 172.21.15.8:0/3577387407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e7713f630 msgr2=0x557e77141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f195f400640 1 --2- 172.21.15.8:0/3577387407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e7713f630 0x557e77141a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f195f400640 1 -- 172.21.15.8:0/3577387407 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e77057060 con 0x557e77136fa0 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f1957400640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19440a1ba0 0x7f19440a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f195f400640 1 --2- 172.21.15.8:0/3577387407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e77135cf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1958011790 tx=0x7f1958011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af13e1c248488a80 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f1957400640 1 -- 172.21.15.8:0/3746117694 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1950014070 con 0x7f1960100660 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f194be00640 1 -- 172.21.15.8:0/3577387407 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958011ea0 con 0x557e77136fa0 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f194be00640 1 -- 172.21.15.8:0/3577387407 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f195800fea0 con 0x557e77136fa0 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f194be00640 1 -- 172.21.15.8:0/3577387407 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958004890 con 0x557e77136fa0 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.537+0000 7f195ea00640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19440a1ba0 0x7f19440a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.538+0000 7f196899c740 1 -- 172.21.15.8:0/3577387407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 msgr2=0x557e77135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.538+0000 7f196899c740 1 --2- 172.21.15.8:0/3577387407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e77135cf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1958011790 tx=0x7f1958011c50 comp rx=0 tx=0).stop 2024-03-16T21:01:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.538+0000 7f195ea00640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19440a1ba0 0x7f19440a4060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f19500cb380 tx=0x7f19500d34f0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.538+0000 7f196899c740 1 -- 172.21.15.8:0/3577387407 shutdown_connections 2024-03-16T21:01:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.538+0000 7f196899c740 1 --2- 172.21.15.8:0/3577387407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e7713f630 0x557e77141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.538+0000 7f196899c740 1 --2- 172.21.15.8:0/3577387407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e771362c0 0x557e77136740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.538+0000 7f196899c740 1 --2- 172.21.15.8:0/3577387407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e77135cf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.538+0000 7f196899c740 1 -- 172.21.15.8:0/3577387407 >> 172.21.15.8:0/3577387407 conn(0x557e770fd5a0 msgr2=0x557e77130d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.538+0000 7f196899c740 1 -- 172.21.15.8:0/3577387407 shutdown_connections 2024-03-16T21:01:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.538+0000 7f196899c740 1 -- 172.21.15.8:0/3577387407 wait complete. 2024-03-16T21:01:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.539+0000 7f196899c740 1 -- start start 2024-03-16T21:01:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.539+0000 7f196899c740 1 Processor -- start 2024-03-16T21:01:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f196899c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e771362c0 0x557e7713c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f196899c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e77136fa0 0x557e7713cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f196899c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e7713f630 0x557e7713d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f196899c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e77042ec0 con 0x557e771362c0 2024-03-16T21:01:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f196899c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e77042b60 con 0x557e7713f630 2024-03-16T21:01:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f196899c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e76e0c1c0 con 0x557e77136fa0 2024-03-16T21:01:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f196899c740 10 client.0 _ll_register_callbacks cb 0x557e77056960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f195f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e771362c0 0x557e7713c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f195e000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e77136fa0 0x557e7713cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f195f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e771362c0 0x557e7713c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33118/0 (socket says 172.21.15.8:33118) 2024-03-16T21:01:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f195f400640 1 -- 172.21.15.8:0/1656738157 learned_addr learned my addr 172.21.15.8:0/1656738157 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f195f400640 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e7713f630 0x557e7713d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f195e000640 1 -- 172.21.15.8:0/1656738157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e7713f630 msgr2=0x557e7713d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.540+0000 7f195e000640 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e7713f630 0x557e7713d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.541+0000 7f195e000640 1 -- 172.21.15.8:0/1656738157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e771362c0 msgr2=0x557e7713c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.541+0000 7f195e000640 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e771362c0 0x557e7713c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.541+0000 7f195e000640 1 -- 172.21.15.8:0/1656738157 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1958011440 con 0x557e77136fa0 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.541+0000 7f195e000640 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e77136fa0 0x557e7713cb10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f194c036040 tx=0x7f194c02ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adb400a1d25dd432 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.541+0000 7f1948c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.541+0000 7f1948c00640 1 -- 172.21.15.8:0/1656738157 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c004040 con 0x557e77136fa0 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.541+0000 7f196899c740 1 -- 172.21.15.8:0/1656738157 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e76d9d7e0 con 0x557e77136fa0 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.541+0000 7f1948c00640 1 -- 172.21.15.8:0/1656738157 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f194c045070 con 0x557e77136fa0 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.542+0000 7f1948c00640 1 -- 172.21.15.8:0/1656738157 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f194c0041a0 con 0x557e77136fa0 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.542+0000 7f196899c740 10 client.26329 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.542+0000 7f196899c740 1 -- 172.21.15.8:0/1656738157 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x557e7709c4e0 con 0x557e77136fa0 2024-03-16T21:01:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.542+0000 7f1948c00640 1 -- 172.21.15.8:0/1656738157 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x557e76d9d7e0 con 0x557e77136fa0 2024-03-16T21:01:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.542+0000 7f1948c00640 1 -- 172.21.15.8:0/1656738157 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f194c03c040 con 0x557e77136fa0 2024-03-16T21:01:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.542+0000 7f196899c740 10 client.26329 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.542+0000 7f196899c740 10 client.26329 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.542+0000 7f196899c740 20 client.26329 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.542+0000 7f196899c740 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557e7714f700 0x557e77151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.542+0000 7f196899c740 4 client.26329 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:01:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.542+0000 7f196899c740 1 -- 172.21.15.8:0/1656738157 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e76dda720 con 0x557e7714f700 2024-03-16T21:01:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.543+0000 7f195f400640 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557e7714f700 0x557e77151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.543+0000 7f195f400640 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557e7714f700 0x557e77151b20 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e010487d19d99cd server_cookie=c373855c9ca5765 in_seq=0 out_seq=0 2024-03-16T21:01:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.543+0000 7f1948c00640 10 client.26329 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:01.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.544+0000 7f1948c00640 1 -- 172.21.15.8:0/1656738157 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x557e76dda720 con 0x557e7714f700 2024-03-16T21:01:01.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.544+0000 7f1948c00640 10 client.26329 handle_command_reply: tid=0 2024-03-16T21:01:01.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.544+0000 7f196899c740 1 client.26329 shutdown 2024-03-16T21:01:01.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.544+0000 7f196899c740 1 -- 172.21.15.8:0/1656738157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e77136fa0 msgr2=0x557e7713cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.544+0000 7f196899c740 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e77136fa0 0x557e7713cb10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f194c036040 tx=0x7f194c02ce60 comp rx=0 tx=0).stop 2024-03-16T21:01:01.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.544+0000 7f196899c740 1 -- 172.21.15.8:0/1656738157 shutdown_connections 2024-03-16T21:01:01.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.544+0000 7f196899c740 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e7713f630 0x557e7713d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.544+0000 7f196899c740 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e77136fa0 0x557e7713cb10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.545+0000 7f196899c740 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557e7714f700 0x557e77151b20 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.545+0000 7f196899c740 1 --2- 172.21.15.8:0/1656738157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e771362c0 0x557e7713c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.545+0000 7f1948c00640 0 client.26329 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:01.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.545+0000 7f196899c740 1 -- 172.21.15.8:0/1656738157 >> 172.21.15.8:0/1656738157 conn(0x557e770fd5a0 msgr2=0x557e77132a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.545+0000 7f196899c740 1 -- 172.21.15.8:0/1656738157 shutdown_connections 2024-03-16T21:01:01.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.545+0000 7f196899c740 1 -- 172.21.15.8:0/1656738157 wait complete. 2024-03-16T21:01:01.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.545+0000 7f196899c740 20 client.26329 trim_cache size 0 max 16384 2024-03-16T21:01:01.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.564+0000 7f196899c740 1 Processor -- start 2024-03-16T21:01:01.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.564+0000 7f196899c740 1 -- start start 2024-03-16T21:01:01.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.564+0000 7f196899c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e771362c0 0x557e7713ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.564+0000 7f196899c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e7713ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.564+0000 7f196899c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e7713f630 0x557e7714aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.564+0000 7f196899c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e77135540 con 0x557e771362c0 2024-03-16T21:01:01.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.564+0000 7f196899c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e771352f0 con 0x557e77136fa0 2024-03-16T21:01:01.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.564+0000 7f196899c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e77152180 con 0x557e7713f630 2024-03-16T21:01:01.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e7713ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e771362c0 0x557e7713ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e7713ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35764/0 (socket says 172.21.15.8:35764) 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195e000640 1 -- 172.21.15.8:0/814236926 learned_addr learned my addr 172.21.15.8:0/814236926 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195f400640 1 --2- 172.21.15.8:0/814236926 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e7713f630 0x557e7714aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195e000640 1 -- 172.21.15.8:0/814236926 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e7713f630 msgr2=0x557e7714aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195e000640 1 --2- 172.21.15.8:0/814236926 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e7713f630 0x557e7714aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195e000640 1 -- 172.21.15.8:0/814236926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e771362c0 msgr2=0x557e7713ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195e000640 1 --2- 172.21.15.8:0/814236926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e771362c0 0x557e7713ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195e000640 1 -- 172.21.15.8:0/814236926 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e77038950 con 0x557e77136fa0 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195f400640 1 --2- 172.21.15.8:0/814236926 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e7713f630 0x557e7714aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f195e000640 1 --2- 172.21.15.8:0/814236926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e7713ce70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f194c006010 tx=0x7f194c003a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b083cb947764091 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.565+0000 7f194b400640 1 -- 172.21.15.8:0/814236926 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c003f10 con 0x557e77136fa0 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.566+0000 7f194b400640 1 -- 172.21.15.8:0/814236926 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f194c043070 con 0x557e77136fa0 2024-03-16T21:01:01.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.566+0000 7f194b400640 1 -- 172.21.15.8:0/814236926 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c005510 con 0x557e77136fa0 2024-03-16T21:01:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.566+0000 7f196899c740 1 -- 172.21.15.8:0/814236926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 msgr2=0x557e7713ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.566+0000 7f196899c740 1 --2- 172.21.15.8:0/814236926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e7713ce70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f194c006010 tx=0x7f194c003a60 comp rx=0 tx=0).stop 2024-03-16T21:01:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.566+0000 7f196899c740 1 -- 172.21.15.8:0/814236926 shutdown_connections 2024-03-16T21:01:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.566+0000 7f196899c740 1 --2- 172.21.15.8:0/814236926 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e7713f630 0x557e7714aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.566+0000 7f196899c740 1 --2- 172.21.15.8:0/814236926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e77136fa0 0x557e7713ce70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.566+0000 7f196899c740 1 --2- 172.21.15.8:0/814236926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e771362c0 0x557e7713ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.566+0000 7f196899c740 1 -- 172.21.15.8:0/814236926 >> 172.21.15.8:0/814236926 conn(0x557e770fd5a0 msgr2=0x557e7712fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.567+0000 7f196899c740 1 -- 172.21.15.8:0/814236926 shutdown_connections 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.567+0000 7f196899c740 1 -- 172.21.15.8:0/814236926 wait complete. 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.567+0000 7f196899c740 1 -- start start 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.567+0000 7f196899c740 1 Processor -- start 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f196899c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e771362c0 0x557e77147190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f196899c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e77136fa0 0x557e77139810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f196899c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e7713f630 0x557e77139d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f196899c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e7713a290 con 0x557e77136fa0 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f196899c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e7713a400 con 0x557e771362c0 2024-03-16T21:01:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f196899c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e7713a5c0 con 0x557e7713f630 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f196899c740 10 client.0 _ll_register_callbacks cb 0x7f194c02cd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f195f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e771362c0 0x557e77147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f195e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e77136fa0 0x557e77139810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f195f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e771362c0 0x557e77147190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:35778/0 (socket says 172.21.15.8:35778) 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f195f400640 1 -- 172.21.15.8:0/3224800792 learned_addr learned my addr 172.21.15.8:0/3224800792 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f195f400640 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e7713f630 0x557e77139d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f195e000640 1 -- 172.21.15.8:0/3224800792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e7713f630 msgr2=0x557e77139d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f195e000640 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e7713f630 0x557e77139d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f195e000640 1 -- 172.21.15.8:0/3224800792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e771362c0 msgr2=0x557e77147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f195e000640 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e771362c0 0x557e77147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.568+0000 7f195e000640 1 -- 172.21.15.8:0/3224800792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e7709c4e0 con 0x557e77136fa0 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.569+0000 7f195e000640 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e77136fa0 0x557e77139810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x557e771373a0 tx=0x7f194c003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97feecf1632c6e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.569+0000 7f1948c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:01:01.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.569+0000 7f1948c00640 1 -- 172.21.15.8:0/3224800792 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c005350 con 0x557e77136fa0 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.569+0000 7f1948c00640 1 -- 172.21.15.8:0/3224800792 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f194c000e40 con 0x557e77136fa0 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.569+0000 7f196899c740 1 -- 172.21.15.8:0/3224800792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f195800fea0 con 0x557e77136fa0 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.569+0000 7f1948c00640 1 -- 172.21.15.8:0/3224800792 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f194c0054b0 con 0x557e77136fa0 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.569+0000 7f196899c740 10 client.16167 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.569+0000 7f196899c740 1 -- 172.21.15.8:0/3224800792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x557e7705e430 con 0x557e77136fa0 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.570+0000 7f1948c00640 1 -- 172.21.15.8:0/3224800792 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f194c069020 con 0x557e77136fa0 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.570+0000 7f1948c00640 1 -- 172.21.15.8:0/3224800792 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f194c03c050 con 0x557e77136fa0 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.570+0000 7f196899c740 10 client.16167 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.570+0000 7f196899c740 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.570+0000 7f196899c740 20 client.16167 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.570+0000 7f196899c740 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557e771ac1a0 0x557e771ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.570+0000 7f196899c740 4 client.16167 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:01:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.570+0000 7f196899c740 1 -- 172.21.15.8:0/3224800792 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557e76e29890 con 0x557e771ac1a0 2024-03-16T21:01:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.570+0000 7f195f400640 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557e771ac1a0 0x557e771ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f195f400640 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557e771ac1a0 0x557e771ae5c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa7ca7a031fa639 server_cookie=d4482a39ca7b4d01 in_seq=0 out_seq=0 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f1948c00640 10 client.16167 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f1948c00640 1 -- 172.21.15.8:0/3224800792 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557e76e29890 con 0x557e771ac1a0 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f1948c00640 10 client.16167 handle_command_reply: tid=0 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 1 client.16167 shutdown 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 1 -- 172.21.15.8:0/3224800792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e77136fa0 msgr2=0x557e77139810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e77136fa0 0x557e77139810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x557e771373a0 tx=0x7f194c003890 comp rx=0 tx=0).stop 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 1 -- 172.21.15.8:0/3224800792 shutdown_connections 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557e7713f630 0x557e77139d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557e771ac1a0 0x557e771ae5c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e77136fa0 0x557e77139810 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 1 --2- 172.21.15.8:0/3224800792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557e771362c0 0x557e77147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f1948c00640 0 client.16167 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 1 -- 172.21.15.8:0/3224800792 >> 172.21.15.8:0/3224800792 conn(0x557e770fd5a0 msgr2=0x557e77131df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 1 -- 172.21.15.8:0/3224800792 shutdown_connections 2024-03-16T21:01:01.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 1 -- 172.21.15.8:0/3224800792 wait complete. 2024-03-16T21:01:01.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.571+0000 7f196899c740 20 client.16167 trim_cache size 0 max 16384 2024-03-16T21:01:01.581 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:01:01.581 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:01:01.581 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:01:01.581 INFO:teuthology.orchestra.run.smithi008.stdout: "56a2f2fb-1fee-421c-936e-7a56f96d58f0": { 2024-03-16T21:01:01.581 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:01:01.581 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "56a2f2fb-1fee-421c-936e-7a56f96d58f0", 2024-03-16T21:01:01.581 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:01:01.582 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:01:01.582 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:01:01.582 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:01:01.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 -- 172.21.15.8:0/3746117694 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19440a1ba0 msgr2=0x7f19440a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19440a1ba0 0x7f19440a4060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f19500cb380 tx=0x7f19500d34f0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 -- 172.21.15.8:0/3746117694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1960100660 msgr2=0x7f1960199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:01.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1960100660 0x7f1960199e40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f195000e9f0 tx=0x7f195000edf0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 -- 172.21.15.8:0/3746117694 shutdown_connections 2024-03-16T21:01:01.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f19440a1ba0 0x7f19440a4060 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f196019e6b0 0x7f196019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19601056e0 0x7f196019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 --2- 172.21.15.8:0/3746117694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1960100660 0x7f1960199e40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:01.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 -- 172.21.15.8:0/3746117694 >> 172.21.15.8:0/3746117694 conn(0x7f1960077550 msgr2=0x7f19600698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:01.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 -- 172.21.15.8:0/3746117694 shutdown_connections 2024-03-16T21:01:01.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:01.572+0000 7f1965c00640 1 -- 172.21.15.8:0/3746117694 wait complete. 2024-03-16T21:01:01.595 INFO:tasks.cephfs.filesystem:scrub status for tag:56a2f2fb-1fee-421c-936e-7a56f96d58f0 - {'path': '/', 'tag': '56a2f2fb-1fee-421c-936e-7a56f96d58f0', 'options': 'recursive,force'} 2024-03-16T21:01:02.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:01 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:01:02.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:01 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:01:02.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:01 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:01:03.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:02 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:01:03.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:02 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:03.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:02 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:01:03.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:02 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:03.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:02 smithi170 ceph-mon[35947]: pgmap v99: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-03-16T21:01:03.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:02 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:01:03.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:02 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:03.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:02 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:01:03.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:02 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:03.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:02 smithi186 ceph-mon[36391]: pgmap v99: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-03-16T21:01:03.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:02 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:01:03.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:02 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:03.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:02 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:01:03.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:02 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:03.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:02 smithi008 ceph-mon[31434]: pgmap v99: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-03-16T21:01:04.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:03 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:01:04.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:03 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:01:04.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:03 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:01:04.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:03 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:01:04.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:03 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:01:04.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:03 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:01:04.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:03 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:01:04.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:03 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:01:04.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:03 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:01:04.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:03 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:01:04.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:03 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:01:04.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:03 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:01:05.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:04 smithi008 ceph-mon[31434]: pgmap v100: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-16T21:01:05.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:04 smithi170 ceph-mon[35947]: pgmap v100: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-16T21:01:05.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:04 smithi186 ceph-mon[36391]: pgmap v100: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-16T21:01:07.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:06 smithi008 ceph-mon[31434]: pgmap v101: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-16T21:01:07.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:06 smithi170 ceph-mon[35947]: pgmap v101: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-16T21:01:07.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:06 smithi186 ceph-mon[36391]: pgmap v101: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-16T21:01:09.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:08 smithi008 ceph-mon[31434]: pgmap v102: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-03-16T21:01:09.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:08 smithi170 ceph-mon[35947]: pgmap v102: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-03-16T21:01:09.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:08 smithi186 ceph-mon[36391]: pgmap v102: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-03-16T21:01:11.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:10 smithi008 ceph-mon[31434]: pgmap v103: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-03-16T21:01:11.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:10 smithi170 ceph-mon[35947]: pgmap v103: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-03-16T21:01:11.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:10 smithi186 ceph-mon[36391]: pgmap v103: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-03-16T21:01:13.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:12 smithi008 ceph-mon[31434]: pgmap v104: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-03-16T21:01:13.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:12 smithi170 ceph-mon[35947]: pgmap v104: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-03-16T21:01:13.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:12 smithi186 ceph-mon[36391]: pgmap v104: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-03-16T21:01:15.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:14 smithi008 ceph-mon[31434]: pgmap v105: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-03-16T21:01:15.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:14 smithi170 ceph-mon[35947]: pgmap v105: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-03-16T21:01:15.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:14 smithi186 ceph-mon[36391]: pgmap v105: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-03-16T21:01:17.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:16 smithi008 ceph-mon[31434]: pgmap v106: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-03-16T21:01:17.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:16 smithi170 ceph-mon[35947]: pgmap v106: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-03-16T21:01:17.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:16 smithi186 ceph-mon[36391]: pgmap v106: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-03-16T21:01:19.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:18 smithi008 ceph-mon[31434]: pgmap v107: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-16T21:01:19.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:18 smithi170 ceph-mon[35947]: pgmap v107: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-16T21:01:19.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:18 smithi186 ceph-mon[36391]: pgmap v107: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-16T21:01:21.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:20 smithi170 ceph-mon[35947]: pgmap v108: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-03-16T21:01:21.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:20 smithi186 ceph-mon[36391]: pgmap v108: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-03-16T21:01:21.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:20 smithi008 ceph-mon[31434]: pgmap v108: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-03-16T21:01:23.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:22 smithi170 ceph-mon[35947]: pgmap v109: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-03-16T21:01:23.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:22 smithi186 ceph-mon[36391]: pgmap v109: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-03-16T21:01:23.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:22 smithi008 ceph-mon[31434]: pgmap v109: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-03-16T21:01:25.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:25 smithi170 ceph-mon[35947]: pgmap v110: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:25.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:25 smithi186 ceph-mon[36391]: pgmap v110: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:25.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:25 smithi008 ceph-mon[31434]: pgmap v110: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:27.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:27 smithi170 ceph-mon[35947]: pgmap v111: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:27.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:27 smithi186 ceph-mon[36391]: pgmap v111: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:27.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:27 smithi008 ceph-mon[31434]: pgmap v111: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:29.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:29 smithi170 ceph-mon[35947]: pgmap v112: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:01:29.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:29 smithi186 ceph-mon[36391]: pgmap v112: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:01:29.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:29 smithi008 ceph-mon[31434]: pgmap v112: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:01:31.298 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:31 smithi008 ceph-mon[31434]: pgmap v113: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:31.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:31 smithi170 ceph-mon[35947]: pgmap v113: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:31.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:31 smithi186 ceph-mon[36391]: pgmap v113: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:31.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:01:31.596 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:01:31.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.826+0000 7fdf12a00640 1 -- 172.21.15.8:0/4105248333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf0c103690 msgr2=0x7fdf0c103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:31.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.826+0000 7fdf12a00640 1 --2- 172.21.15.8:0/4105248333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf0c103690 0x7fdf0c103b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009900 tx=0x7fdef802bc40 comp rx=0 tx=0).stop 2024-03-16T21:01:31.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.826+0000 7fdf12a00640 1 -- 172.21.15.8:0/4105248333 shutdown_connections 2024-03-16T21:01:31.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.826+0000 7fdf12a00640 1 --2- 172.21.15.8:0/4105248333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf0c104050 0x7fdf0c110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.826+0000 7fdf12a00640 1 --2- 172.21.15.8:0/4105248333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf0c103690 0x7fdf0c103b10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.826+0000 7fdf12a00640 1 --2- 172.21.15.8:0/4105248333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf0c1096a0 0x7fdf0c109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.826+0000 7fdf12a00640 1 -- 172.21.15.8:0/4105248333 >> 172.21.15.8:0/4105248333 conn(0x7fdf0c0ff1a0 msgr2=0x7fdf0c1015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:31.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.827+0000 7fdf12a00640 1 -- 172.21.15.8:0/4105248333 shutdown_connections 2024-03-16T21:01:31.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.827+0000 7fdf12a00640 1 -- 172.21.15.8:0/4105248333 wait complete. 2024-03-16T21:01:31.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.827+0000 7fdf12a00640 1 Processor -- start 2024-03-16T21:01:31.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.828+0000 7fdf12a00640 1 -- start start 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.828+0000 7fdf12a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf0c103690 0x7fdf0c199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.828+0000 7fdf12a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf0c104050 0x7fdf0c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.828+0000 7fdf12a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf0c1096a0 0x7fdf0c19e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.828+0000 7fdf12a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c19ed40 con 0x7fdf0c103690 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.828+0000 7fdf12a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c19eeb0 con 0x7fdf0c1096a0 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.828+0000 7fdf12a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c19f070 con 0x7fdf0c104050 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.828+0000 7fdf0be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf0c103690 0x7fdf0c199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.828+0000 7fdf0be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf0c103690 0x7fdf0c199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37586/0 (socket says 172.21.15.8:37586) 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.828+0000 7fdf0be00640 1 -- 172.21.15.8:0/2431496906 learned_addr learned my addr 172.21.15.8:0/2431496906 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.829+0000 7fdf10a00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf0c1096a0 0x7fdf0c19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.829+0000 7fdf0b400640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf0c104050 0x7fdf0c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.829+0000 7fdf0be00640 1 -- 172.21.15.8:0/2431496906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf0c104050 msgr2=0x7fdf0c19a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.829+0000 7fdf0be00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf0c104050 0x7fdf0c19a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.829+0000 7fdf0be00640 1 -- 172.21.15.8:0/2431496906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf0c1096a0 msgr2=0x7fdf0c19e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:31.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.829+0000 7fdf0be00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf0c1096a0 0x7fdf0c19e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.829+0000 7fdf0be00640 1 -- 172.21.15.8:0/2431496906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8009560 con 0x7fdf0c103690 2024-03-16T21:01:31.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.829+0000 7fdf0be00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf0c103690 0x7fdf0c199e80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00d950 tx=0x7fdefc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:31.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.830+0000 7fdf08c00640 1 -- 172.21.15.8:0/2431496906 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc009a30 con 0x7fdf0c103690 2024-03-16T21:01:31.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.830+0000 7fdf08c00640 1 -- 172.21.15.8:0/2431496906 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fdefc009b90 con 0x7fdf0c103690 2024-03-16T21:01:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.830+0000 7fdf12a00640 1 -- 172.21.15.8:0/2431496906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c19f350 con 0x7fdf0c103690 2024-03-16T21:01:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.830+0000 7fdf08c00640 1 -- 172.21.15.8:0/2431496906 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc004a00 con 0x7fdf0c103690 2024-03-16T21:01:31.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.830+0000 7fdf12a00640 1 -- 172.21.15.8:0/2431496906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c1a6bd0 con 0x7fdf0c103690 2024-03-16T21:01:31.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf157ad740 1 Processor -- start 2024-03-16T21:01:31.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf157ad740 1 -- start start 2024-03-16T21:01:31.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125f3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125fea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf08c00640 1 -- 172.21.15.8:0/2431496906 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fdefc009d00 con 0x7fdf0c103690 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf157ad740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561312562150 con 0x5613125f3fa0 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf157ad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131255f680 con 0x5613125fc630 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf157ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131255ae60 con 0x5613125f32c0 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf0be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf0b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf10a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf0b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125fea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45302/0 (socket says 172.21.15.8:45302) 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf0b400640 1 -- 172.21.15.8:0/124001680 learned_addr learned my addr 172.21.15.8:0/124001680 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.835+0000 7fdf0be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125f3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48598/0 (socket says 172.21.15.8:48598) 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.836+0000 7fdf0b400640 1 -- 172.21.15.8:0/124001680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 msgr2=0x5613125f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.836+0000 7fdf0b400640 1 --2- 172.21.15.8:0/124001680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.836+0000 7fdf0b400640 1 -- 172.21.15.8:0/124001680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 msgr2=0x5613125f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:31.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.836+0000 7fdf0b400640 1 --2- 172.21.15.8:0/124001680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.836+0000 7fdf0b400640 1 -- 172.21.15.8:0/124001680 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561312514060 con 0x5613125fc630 2024-03-16T21:01:31.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.836+0000 7fdf0b400640 1 --2- 172.21.15.8:0/124001680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125fea20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009230 tx=0x7fdef802c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ef4f654acddc983 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:31.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.836+0000 7fdf01200640 1 -- 172.21.15.8:0/124001680 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8004880 con 0x5613125fc630 2024-03-16T21:01:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.836+0000 7fdf01200640 1 -- 172.21.15.8:0/124001680 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fdef80049e0 con 0x5613125fc630 2024-03-16T21:01:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.836+0000 7fdf01200640 1 -- 172.21.15.8:0/124001680 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef80051d0 con 0x5613125fc630 2024-03-16T21:01:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf08c00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdef00a1ba0 0x7fdef00a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf08c00640 1 -- 172.21.15.8:0/2431496906 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdefc0cd130 con 0x7fdf0c103690 2024-03-16T21:01:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf10a00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdef00a1ba0 0x7fdef00a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf157ad740 1 -- 172.21.15.8:0/124001680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 msgr2=0x5613125fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf157ad740 1 --2- 172.21.15.8:0/124001680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125fea20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009230 tx=0x7fdef802c750 comp rx=0 tx=0).stop 2024-03-16T21:01:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf157ad740 1 -- 172.21.15.8:0/124001680 shutdown_connections 2024-03-16T21:01:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf157ad740 1 --2- 172.21.15.8:0/124001680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125fea20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf157ad740 1 --2- 172.21.15.8:0/124001680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf157ad740 1 --2- 172.21.15.8:0/124001680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf157ad740 1 -- 172.21.15.8:0/124001680 >> 172.21.15.8:0/124001680 conn(0x5613125ba5a0 msgr2=0x5613125edd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf157ad740 1 -- 172.21.15.8:0/124001680 shutdown_connections 2024-03-16T21:01:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.837+0000 7fdf157ad740 1 -- 172.21.15.8:0/124001680 wait complete. 2024-03-16T21:01:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.838+0000 7fdf10a00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdef00a1ba0 0x7fdef00a4060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf04005fd0 tx=0x7fdf04009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.838+0000 7fdf157ad740 1 -- start start 2024-03-16T21:01:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.838+0000 7fdf157ad740 1 Processor -- start 2024-03-16T21:01:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.838+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125f9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.838+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.838+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125f9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf157ad740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613124ffec0 con 0x5613125f3fa0 2024-03-16T21:01:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf157ad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613124ffb60 con 0x5613125fc630 2024-03-16T21:01:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf157ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613122c91c0 con 0x5613125f32c0 2024-03-16T21:01:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf157ad740 10 client.0 _ll_register_callbacks cb 0x561312513960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf0be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf10a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125f9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf0b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf0be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125f9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48600/0 (socket says 172.21.15.8:48600) 2024-03-16T21:01:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf0be00640 1 -- 172.21.15.8:0/1746059230 learned_addr learned my addr 172.21.15.8:0/1746059230 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf0be00640 1 -- 172.21.15.8:0/1746059230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 msgr2=0x5613125f9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf0be00640 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125f9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf0be00640 1 -- 172.21.15.8:0/1746059230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 msgr2=0x5613125f9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf0be00640 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf0be00640 1 -- 172.21.15.8:0/1746059230 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c110e60 con 0x5613125f32c0 2024-03-16T21:01:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf0b400640 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.839+0000 7fdf0be00640 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125f9560 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009610 tx=0x7fdefc005d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51e5bf06bd2b27a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.840+0000 7fdef5600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:01:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.840+0000 7fdef5600640 1 -- 172.21.15.8:0/1746059230 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc099870 con 0x5613125f32c0 2024-03-16T21:01:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.840+0000 7fdef5600640 1 -- 172.21.15.8:0/1746059230 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdefc09a430 con 0x5613125f32c0 2024-03-16T21:01:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.840+0000 7fdf157ad740 1 -- 172.21.15.8:0/1746059230 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56131225a7e0 con 0x5613125f32c0 2024-03-16T21:01:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.840+0000 7fdef5600640 1 -- 172.21.15.8:0/1746059230 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdefc099690 con 0x5613125f32c0 2024-03-16T21:01:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.840+0000 7fdf157ad740 10 client.26347 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:31.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.840+0000 7fdf157ad740 1 -- 172.21.15.8:0/1746059230 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5613125594e0 con 0x5613125f32c0 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.840+0000 7fdef5600640 1 -- 172.21.15.8:0/1746059230 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x56131225a7e0 con 0x5613125f32c0 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.841+0000 7fdef5600640 1 -- 172.21.15.8:0/1746059230 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fdefc004020 con 0x5613125f32c0 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.841+0000 7fdf157ad740 10 client.26347 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.841+0000 7fdf157ad740 10 client.26347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.841+0000 7fdf157ad740 20 client.26347 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.841+0000 7fdf157ad740 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56131260c700 0x56131260eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.841+0000 7fdf157ad740 4 client.26347 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.841+0000 7fdf157ad740 1 -- 172.21.15.8:0/1746059230 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561312297720 con 0x56131260c700 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.841+0000 7fdf0b400640 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56131260c700 0x56131260eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.842+0000 7fdf0b400640 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56131260c700 0x56131260eb40 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93afd23ba9699abb server_cookie=60fde0e9f37c2bba in_seq=0 out_seq=0 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.842+0000 7fdef5600640 10 client.26347 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:31.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.842+0000 7fdef5600640 1 -- 172.21.15.8:0/1746059230 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561312297720 con 0x56131260c700 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.842+0000 7fdef5600640 10 client.26347 handle_command_reply: tid=0 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.842+0000 7fdf157ad740 1 client.26347 shutdown 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdf157ad740 1 -- 172.21.15.8:0/1746059230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 msgr2=0x5613125f9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdf157ad740 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125f9560 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009610 tx=0x7fdefc005d90 comp rx=0 tx=0).stop 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdf157ad740 1 -- 172.21.15.8:0/1746059230 shutdown_connections 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdf157ad740 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125f9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdf157ad740 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56131260c700 0x56131260eb40 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdf157ad740 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdf157ad740 1 --2- 172.21.15.8:0/1746059230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125f9560 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdf157ad740 1 -- 172.21.15.8:0/1746059230 >> 172.21.15.8:0/1746059230 conn(0x5613125ba5a0 msgr2=0x5613125efa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdef5600640 0 client.26347 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdf157ad740 1 -- 172.21.15.8:0/1746059230 shutdown_connections 2024-03-16T21:01:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdf157ad740 1 -- 172.21.15.8:0/1746059230 wait complete. 2024-03-16T21:01:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.843+0000 7fdf157ad740 20 client.26347 trim_cache size 0 max 16384 2024-03-16T21:01:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf157ad740 1 Processor -- start 2024-03-16T21:01:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf157ad740 1 -- start start 2024-03-16T21:01:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125e9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125f3fa0 0x5613125fb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125fc630 0x561312607a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf157ad740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613125f4400 con 0x5613125fc630 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf157ad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613125f2320 con 0x5613125f3fa0 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf157ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613125eead0 con 0x5613125f32c0 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf0be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125e9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf0be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125e9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48604/0 (socket says 172.21.15.8:48604) 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf0be00640 1 -- 172.21.15.8:0/1646098562 learned_addr learned my addr 172.21.15.8:0/1646098562 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf0b400640 1 --2- 172.21.15.8:0/1646098562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125f3fa0 0x5613125fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.861+0000 7fdf10a00640 1 --2- 172.21.15.8:0/1646098562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125fc630 0x561312607a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.862+0000 7fdf0be00640 1 -- 172.21.15.8:0/1646098562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125f3fa0 msgr2=0x5613125fb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.862+0000 7fdf0be00640 1 --2- 172.21.15.8:0/1646098562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125f3fa0 0x5613125fb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.862+0000 7fdf0be00640 1 -- 172.21.15.8:0/1646098562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125fc630 msgr2=0x561312607a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.862+0000 7fdf0be00640 1 --2- 172.21.15.8:0/1646098562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125fc630 0x561312607a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.862+0000 7fdf0be00640 1 -- 172.21.15.8:0/1646098562 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613124f5950 con 0x5613125f32c0 2024-03-16T21:01:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.862+0000 7fdf0be00640 1 --2- 172.21.15.8:0/1646098562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125e9030 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0a1fa0 tx=0x7fdefc009740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e84f8d8b5c70cb9b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.862+0000 7fdef7e00640 1 -- 172.21.15.8:0/1646098562 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc099690 con 0x5613125f32c0 2024-03-16T21:01:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.862+0000 7fdef7e00640 1 -- 172.21.15.8:0/1646098562 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fdefc099870 con 0x5613125f32c0 2024-03-16T21:01:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.862+0000 7fdef7e00640 1 -- 172.21.15.8:0/1646098562 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0963a0 con 0x5613125f32c0 2024-03-16T21:01:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.863+0000 7fdf157ad740 1 -- 172.21.15.8:0/1646098562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 msgr2=0x5613125e9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.863+0000 7fdf157ad740 1 --2- 172.21.15.8:0/1646098562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125e9030 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0a1fa0 tx=0x7fdefc009740 comp rx=0 tx=0).stop 2024-03-16T21:01:31.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.863+0000 7fdf157ad740 1 -- 172.21.15.8:0/1646098562 shutdown_connections 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.863+0000 7fdf157ad740 1 --2- 172.21.15.8:0/1646098562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125fc630 0x561312607a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.863+0000 7fdf157ad740 1 --2- 172.21.15.8:0/1646098562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125f3fa0 0x5613125fb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.863+0000 7fdf157ad740 1 --2- 172.21.15.8:0/1646098562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x5613125e9030 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.863+0000 7fdf157ad740 1 -- 172.21.15.8:0/1646098562 >> 172.21.15.8:0/1646098562 conn(0x5613125ba5a0 msgr2=0x5613125fac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.863+0000 7fdf157ad740 1 -- 172.21.15.8:0/1646098562 shutdown_connections 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.863+0000 7fdf157ad740 1 -- 172.21.15.8:0/1646098562 wait complete. 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.863+0000 7fdf157ad740 1 -- start start 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf157ad740 1 Processor -- start 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x561312604070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf157ad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf157ad740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613125f7180 con 0x5613125f3fa0 2024-03-16T21:01:31.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf157ad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613125f72f0 con 0x5613125fc630 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf157ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613125f74b0 con 0x5613125f32c0 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf157ad740 10 client.0 _ll_register_callbacks cb 0x7fdefc0052b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf0be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x561312604070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf0be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x561312604070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48612/0 (socket says 172.21.15.8:48612) 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf0be00640 1 -- 172.21.15.8:0/3755385525 learned_addr learned my addr 172.21.15.8:0/3755385525 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf0b400640 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.864+0000 7fdf10a00640 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdf0be00640 1 -- 172.21.15.8:0/3755385525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 msgr2=0x5613125f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdf0be00640 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125f6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdf0be00640 1 -- 172.21.15.8:0/3755385525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 msgr2=0x5613125f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdf0be00640 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdf0be00640 1 -- 172.21.15.8:0/3755385525 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613125594e0 con 0x5613125f32c0 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdf0be00640 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x561312604070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdefc096700 tx=0x7fdefc00b530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55e02d708a0f12b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:31.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdef5600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdef5600640 1 -- 172.21.15.8:0/3755385525 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0d0520 con 0x5613125f32c0 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdef5600640 1 -- 172.21.15.8:0/3755385525 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdefc09a430 con 0x5613125f32c0 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdf157ad740 1 -- 172.21.15.8:0/3755385525 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613125f3c40 con 0x5613125f32c0 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdef5600640 1 -- 172.21.15.8:0/3755385525 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdefc095fd0 con 0x5613125f32c0 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdf157ad740 10 client.26353 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.865+0000 7fdf157ad740 1 -- 172.21.15.8:0/3755385525 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56131251b430 con 0x5613125f32c0 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.866+0000 7fdef5600640 1 -- 172.21.15.8:0/3755385525 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5613125f3c40 con 0x5613125f32c0 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.866+0000 7fdef5600640 1 -- 172.21.15.8:0/3755385525 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fdefc0d0040 con 0x5613125f32c0 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.866+0000 7fdf157ad740 10 client.26353 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.866+0000 7fdf157ad740 10 client.26353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.866+0000 7fdf157ad740 20 client.26353 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.866+0000 7fdf157ad740 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561312668fe0 0x56131266b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.866+0000 7fdf157ad740 4 client.26353 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:01:31.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.866+0000 7fdf157ad740 1 -- 172.21.15.8:0/3755385525 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7fdef80049e0 con 0x561312668fe0 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.866+0000 7fdf0b400640 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561312668fe0 0x56131266b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf0b400640 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561312668fe0 0x56131266b3d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=928b65b1b1579bab server_cookie=9c4fceaa05d52705 in_seq=0 out_seq=0 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdef5600640 10 client.26353 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdef5600640 1 -- 172.21.15.8:0/3755385525 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7fdef80049e0 con 0x561312668fe0 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdef5600640 10 client.26353 handle_command_reply: tid=0 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 1 client.26353 shutdown 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 1 -- 172.21.15.8:0/3755385525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 msgr2=0x561312604070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x561312604070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdefc096700 tx=0x7fdefc00b530 comp rx=0 tx=0).stop 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 1 -- 172.21.15.8:0/3755385525 shutdown_connections 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613125fc630 0x5613125f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561312668fe0 0x56131266b3d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5613125f3fa0 0x5613125f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 1 --2- 172.21.15.8:0/3755385525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613125f32c0 0x561312604070 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 1 -- 172.21.15.8:0/3755385525 >> 172.21.15.8:0/3755385525 conn(0x5613125ba5a0 msgr2=0x5613125ece30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:31.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdef5600640 0 client.26353 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:31.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 1 -- 172.21.15.8:0/3755385525 shutdown_connections 2024-03-16T21:01:31.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 1 -- 172.21.15.8:0/3755385525 wait complete. 2024-03-16T21:01:31.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.867+0000 7fdf157ad740 20 client.26353 trim_cache size 0 max 16384 2024-03-16T21:01:31.878 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:01:31.878 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:01:31.878 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:01:31.878 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:01:31.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 -- 172.21.15.8:0/2431496906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdef00a1ba0 msgr2=0x7fdef00a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:31.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdef00a1ba0 0x7fdef00a4060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf04005fd0 tx=0x7fdf04009500 comp rx=0 tx=0).stop 2024-03-16T21:01:31.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 -- 172.21.15.8:0/2431496906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf0c103690 msgr2=0x7fdf0c199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:31.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf0c103690 0x7fdf0c199e80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00d950 tx=0x7fdefc00de10 comp rx=0 tx=0).stop 2024-03-16T21:01:31.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 -- 172.21.15.8:0/2431496906 shutdown_connections 2024-03-16T21:01:31.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fdef00a1ba0 0x7fdef00a4060 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdf0c1096a0 0x7fdf0c19e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf0c104050 0x7fdf0c19a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 --2- 172.21.15.8:0/2431496906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf0c103690 0x7fdf0c199e80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:31.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 -- 172.21.15.8:0/2431496906 >> 172.21.15.8:0/2431496906 conn(0x7fdf0c0ff1a0 msgr2=0x7fdf0c0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:31.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 -- 172.21.15.8:0/2431496906 shutdown_connections 2024-03-16T21:01:31.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:31.868+0000 7fdf12a00640 1 -- 172.21.15.8:0/2431496906 wait complete. 2024-03-16T21:01:31.891 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:01:31.892 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:01:32.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.107+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2377359129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf0076340 msgr2=0x7f3bf0111de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.107+0000 7f3bf6a00640 1 --2- 172.21.15.8:0/2377359129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf0076340 0x7f3bf0111de0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009930 tx=0x7f3bdc02bc20 comp rx=0 tx=0).stop 2024-03-16T21:01:32.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.107+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2377359129 shutdown_connections 2024-03-16T21:01:32.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.107+0000 7f3bf6a00640 1 --2- 172.21.15.8:0/2377359129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bf0112320 0x7f3bf0114710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.107+0000 7f3bf6a00640 1 --2- 172.21.15.8:0/2377359129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf0076340 0x7f3bf0111de0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.107+0000 7f3bf6a00640 1 --2- 172.21.15.8:0/2377359129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bf0075a20 0x7f3bf0075e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.107+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2377359129 >> 172.21.15.8:0/2377359129 conn(0x7f3bf00ff150 msgr2=0x7f3bf0101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.107+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2377359129 shutdown_connections 2024-03-16T21:01:32.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.107+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2377359129 wait complete. 2024-03-16T21:01:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.108+0000 7f3bf6a00640 1 Processor -- start 2024-03-16T21:01:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.108+0000 7f3bf6a00640 1 -- start start 2024-03-16T21:01:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3bf6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bf0075a20 0x7f3bf019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3bf6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf0076340 0x7f3bf019e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3bf6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bf0112320 0x7f3bf01a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3bf6a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01a3110 con 0x7f3bf0075a20 2024-03-16T21:01:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3bf6a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01a3280 con 0x7f3bf0112320 2024-03-16T21:01:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3bf6a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01a3440 con 0x7f3bf0076340 2024-03-16T21:01:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3befe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bf0075a20 0x7f3bf019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3bef400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf0076340 0x7f3bf019e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3befe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bf0075a20 0x7f3bf019e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37642/0 (socket says 172.21.15.8:37642) 2024-03-16T21:01:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3bef400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf0076340 0x7f3bf019e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48630/0 (socket says 172.21.15.8:48630) 2024-03-16T21:01:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3befe00640 1 -- 172.21.15.8:0/2378803350 learned_addr learned my addr 172.21.15.8:0/2378803350 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.109+0000 7f3bf4a00640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bf0112320 0x7f3bf01a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.110+0000 7f3bef400640 1 -- 172.21.15.8:0/2378803350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bf0112320 msgr2=0x7f3bf01a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.110+0000 7f3bef400640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bf0112320 0x7f3bf01a2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.110+0000 7f3bef400640 1 -- 172.21.15.8:0/2378803350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bf0075a20 msgr2=0x7f3bf019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.110+0000 7f3bef400640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bf0075a20 0x7f3bf019e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.110+0000 7f3bef400640 1 -- 172.21.15.8:0/2378803350 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc009560 con 0x7f3bf0076340 2024-03-16T21:01:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.110+0000 7f3bef400640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf0076340 0x7f3bf019e790 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc036040 tx=0x7f3bdc02cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.110+0000 7f3becc00640 1 -- 172.21.15.8:0/2378803350 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc004250 con 0x7f3bf0076340 2024-03-16T21:01:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.110+0000 7f3becc00640 1 -- 172.21.15.8:0/2378803350 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3bdc0043b0 con 0x7f3bf0076340 2024-03-16T21:01:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.110+0000 7f3becc00640 1 -- 172.21.15.8:0/2378803350 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc003ab0 con 0x7f3bf0076340 2024-03-16T21:01:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.110+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2378803350 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf01a36c0 con 0x7f3bf0076340 2024-03-16T21:01:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.110+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2378803350 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf01a3970 con 0x7f3bf0076340 2024-03-16T21:01:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.112+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2378803350 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf0068730 con 0x7f3bf0076340 2024-03-16T21:01:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.114+0000 7f3becc00640 1 -- 172.21.15.8:0/2378803350 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f3bdc0053a0 con 0x7f3bf0076340 2024-03-16T21:01:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.115+0000 7f3becc00640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3bd40a1c20 0x7f3bd40a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.115+0000 7f3becc00640 1 -- 172.21.15.8:0/2378803350 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3bdc0efb10 con 0x7f3bf0076340 2024-03-16T21:01:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.115+0000 7f3befe00640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3bd40a1c20 0x7f3bd40a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.115+0000 7f3befe00640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3bd40a1c20 0x7f3bd40a40e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009fd0 tx=0x7f3be0009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.120+0000 7f3becc00640 1 -- 172.21.15.8:0/2378803350 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3bdc0b8ac0 con 0x7f3bf0076340 2024-03-16T21:01:32.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.364+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2378803350 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bf010d4b0 con 0x7f3bf0076340 2024-03-16T21:01:32.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.365+0000 7f3becc00640 1 -- 172.21.15.8:0/2378803350 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11396 (secure 0 0 0) 0x7f3bdc0bc180 con 0x7f3bf0076340 2024-03-16T21:01:32.370 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:01:32.370 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:00:21.828404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:01:32.370 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 30 2024-03-16T21:01:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2378803350 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3bd40a1c20 msgr2=0x7f3bd40a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3bd40a1c20 0x7f3bd40a40e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009fd0 tx=0x7f3be0009500 comp rx=0 tx=0).stop 2024-03-16T21:01:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2378803350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf0076340 msgr2=0x7f3bf019e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf0076340 0x7f3bf019e790 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc036040 tx=0x7f3bdc02cc90 comp rx=0 tx=0).stop 2024-03-16T21:01:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2378803350 shutdown_connections 2024-03-16T21:01:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3bd40a1c20 0x7f3bd40a40e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bf0112320 0x7f3bf01a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf0076340 0x7f3bf019e790 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 --2- 172.21.15.8:0/2378803350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bf0075a20 0x7f3bf019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2378803350 >> 172.21.15.8:0/2378803350 conn(0x7f3bf00ff150 msgr2=0x7f3bf01138c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2378803350 shutdown_connections 2024-03-16T21:01:32.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.368+0000 7f3bf6a00640 1 -- 172.21.15.8:0/2378803350 wait complete. 2024-03-16T21:01:32.394 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:01:32.394 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:01:32.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.610+0000 7f8032e00640 1 -- 172.21.15.8:0/1934727848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f802c076340 msgr2=0x7f802c111cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.610+0000 7f8032e00640 1 --2- 172.21.15.8:0/1934727848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f802c076340 0x7f802c111cd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8018009930 tx=0x7f801802bc20 comp rx=0 tx=0).stop 2024-03-16T21:01:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.611+0000 7f8032e00640 1 -- 172.21.15.8:0/1934727848 shutdown_connections 2024-03-16T21:01:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.611+0000 7f8032e00640 1 --2- 172.21.15.8:0/1934727848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f802c112210 0x7f802c114600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.611+0000 7f8032e00640 1 --2- 172.21.15.8:0/1934727848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f802c076340 0x7f802c111cd0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.611+0000 7f8032e00640 1 --2- 172.21.15.8:0/1934727848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f802c075a20 0x7f802c075e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.611+0000 7f8032e00640 1 -- 172.21.15.8:0/1934727848 >> 172.21.15.8:0/1934727848 conn(0x7f802c0ff000 msgr2=0x7f802c101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.611+0000 7f8032e00640 1 -- 172.21.15.8:0/1934727848 shutdown_connections 2024-03-16T21:01:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.611+0000 7f8032e00640 1 -- 172.21.15.8:0/1934727848 wait complete. 2024-03-16T21:01:32.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.612+0000 7f8032e00640 1 Processor -- start 2024-03-16T21:01:32.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.612+0000 7f8032e00640 1 -- start start 2024-03-16T21:01:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8032e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f802c075a20 0x7f802c19e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8032e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f802c076340 0x7f802c19e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8032e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f802c112210 0x7f802c1a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8032e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1a32f0 con 0x7f802c075a20 2024-03-16T21:01:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8032e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1a3460 con 0x7f802c076340 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8032e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1a3620 con 0x7f802c112210 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8031a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f802c075a20 0x7f802c19e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8031000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f802c076340 0x7f802c19e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8031000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f802c076340 0x7f802c19e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45370/0 (socket says 172.21.15.8:45370) 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8031a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f802c075a20 0x7f802c19e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37660/0 (socket says 172.21.15.8:37660) 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8031000640 1 -- 172.21.15.8:0/2940482275 learned_addr learned my addr 172.21.15.8:0/2940482275 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.613+0000 7f8032400640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f802c112210 0x7f802c1a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.614+0000 7f8031000640 1 -- 172.21.15.8:0/2940482275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f802c112210 msgr2=0x7f802c1a2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.614+0000 7f8031000640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f802c112210 0x7f802c1a2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.614+0000 7f8031000640 1 -- 172.21.15.8:0/2940482275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f802c075a20 msgr2=0x7f802c19e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.614+0000 7f8031000640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f802c075a20 0x7f802c19e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.614+0000 7f8031000640 1 -- 172.21.15.8:0/2940482275 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8018009560 con 0x7f802c076340 2024-03-16T21:01:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.614+0000 7f8031000640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f802c076340 0x7f802c19e970 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8018009230 tx=0x7f8018004c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.614+0000 7f802a000640 1 -- 172.21.15.8:0/2940482275 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80180044d0 con 0x7f802c076340 2024-03-16T21:01:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.614+0000 7f802a000640 1 -- 172.21.15.8:0/2940482275 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8018005310 con 0x7f802c076340 2024-03-16T21:01:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.614+0000 7f8032e00640 1 -- 172.21.15.8:0/2940482275 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c1a38a0 con 0x7f802c076340 2024-03-16T21:01:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.614+0000 7f802a000640 1 -- 172.21.15.8:0/2940482275 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018003e60 con 0x7f802c076340 2024-03-16T21:01:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.615+0000 7f8032e00640 1 -- 172.21.15.8:0/2940482275 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c1ab180 con 0x7f802c076340 2024-03-16T21:01:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.618+0000 7f8037025740 1 Processor -- start 2024-03-16T21:01:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.618+0000 7f802a000640 1 -- 172.21.15.8:0/2940482275 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f80180035f0 con 0x7f802c076340 2024-03-16T21:01:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.618+0000 7f8037025740 1 -- start start 2024-03-16T21:01:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.618+0000 7f8037025740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f5f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.618+0000 7f8037025740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f67db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.618+0000 7f8037025740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f682f0 0x55d4a4f6a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.618+0000 7f8037025740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4ecd210 con 0x55d4a4f682f0 2024-03-16T21:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.618+0000 7f8037025740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4eca740 con 0x55d4a4f5edf0 2024-03-16T21:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.618+0000 7f8037025740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4ec5f20 con 0x55d4a4f5f710 2024-03-16T21:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.618+0000 7f8032400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f5f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.618+0000 7f8031a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f67db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8032400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f5f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45380/0 (socket says 172.21.15.8:45380) 2024-03-16T21:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8031000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f682f0 0x55d4a4f6a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8031a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f67db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48650/0 (socket says 172.21.15.8:48650) 2024-03-16T21:01:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8032400640 1 -- 172.21.15.8:0/857986458 learned_addr learned my addr 172.21.15.8:0/857986458 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8032400640 1 -- 172.21.15.8:0/857986458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 msgr2=0x55d4a4f67db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8032400640 1 --2- 172.21.15.8:0/857986458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f67db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8032400640 1 -- 172.21.15.8:0/857986458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f682f0 msgr2=0x55d4a4f6a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8032400640 1 --2- 172.21.15.8:0/857986458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f682f0 0x55d4a4f6a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8032400640 1 -- 172.21.15.8:0/857986458 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4a4e87df0 con 0x55d4a4f5edf0 2024-03-16T21:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8031a00640 1 --2- 172.21.15.8:0/857986458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f67db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8032400640 1 --2- 172.21.15.8:0/857986458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f5f1d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8024009ba0 tx=0x7f8024011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2461f142a2c56d57 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f802a000640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80100a1c20 0x7f80100a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.619+0000 7f8022a00640 1 -- 172.21.15.8:0/857986458 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8024004230 con 0x55d4a4f5edf0 2024-03-16T21:01:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.620+0000 7f8022a00640 1 -- 172.21.15.8:0/857986458 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8024009e10 con 0x55d4a4f5edf0 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.620+0000 7f8022a00640 1 -- 172.21.15.8:0/857986458 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8024004cd0 con 0x55d4a4f5edf0 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.620+0000 7f802a000640 1 -- 172.21.15.8:0/2940482275 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f80180ef610 con 0x7f802c076340 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.620+0000 7f8031a00640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80100a1c20 0x7f80100a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.620+0000 7f8037025740 1 -- 172.21.15.8:0/857986458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5edf0 msgr2=0x55d4a4f5f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.620+0000 7f8037025740 1 --2- 172.21.15.8:0/857986458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f5f1d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8024009ba0 tx=0x7f8024011810 comp rx=0 tx=0).stop 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.620+0000 7f8031a00640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80100a1c20 0x7f80100a40e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55d4a4f5e8c0 tx=0x7f801c009680 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.620+0000 7f8037025740 1 -- 172.21.15.8:0/857986458 shutdown_connections 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.621+0000 7f8037025740 1 --2- 172.21.15.8:0/857986458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f682f0 0x55d4a4f6a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.621+0000 7f8037025740 1 --2- 172.21.15.8:0/857986458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f67db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.621+0000 7f8037025740 1 --2- 172.21.15.8:0/857986458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f5f1d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.621+0000 7f8037025740 1 -- 172.21.15.8:0/857986458 >> 172.21.15.8:0/857986458 conn(0x55d4a4f59520 msgr2=0x55d4a4f59900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.621+0000 7f8037025740 1 -- 172.21.15.8:0/857986458 shutdown_connections 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.621+0000 7f8037025740 1 -- 172.21.15.8:0/857986458 wait complete. 2024-03-16T21:01:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.621+0000 7f8037025740 1 -- start start 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.621+0000 7f8037025740 1 Processor -- start 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8037025740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f65380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8037025740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f658c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8037025740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 0x55d4a4f65e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8037025740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4e6b150 con 0x55d4a4f5edf0 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8037025740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4e6adf0 con 0x55d4a4f682f0 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8037025740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4c341c0 con 0x55d4a4f5f710 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8037025740 10 client.0 _ll_register_callbacks cb 0x55d4a4eba2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8031000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f658c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8032400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 0x55d4a4f65e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8031000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f658c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48652/0 (socket says 172.21.15.8:48652) 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8031000640 1 -- 172.21.15.8:0/1370180003 learned_addr learned my addr 172.21.15.8:0/1370180003 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8031a00640 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f65380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8031000640 1 -- 172.21.15.8:0/1370180003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 msgr2=0x55d4a4f65e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8031000640 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 0x55d4a4f65e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8031000640 1 -- 172.21.15.8:0/1370180003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f5edf0 msgr2=0x55d4a4f65380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8031000640 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f65380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8031000640 1 -- 172.21.15.8:0/1370180003 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8024009850 con 0x55d4a4f5f710 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.622+0000 7f8031a00640 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f65380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.623+0000 7f8031000640 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f658c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f80180bc0d0 tx=0x7f8018005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e712f94781181c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.623+0000 7f8017400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.623+0000 7f8017400640 1 -- 172.21.15.8:0/1370180003 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80180bc830 con 0x55d4a4f5f710 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.623+0000 7f8017400640 1 -- 172.21.15.8:0/1370180003 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f80180bc3d0 con 0x55d4a4f5f710 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.623+0000 7f8037025740 1 -- 172.21.15.8:0/1370180003 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4a4bc57e0 con 0x55d4a4f5f710 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.623+0000 7f8017400640 1 -- 172.21.15.8:0/1370180003 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80180bbf10 con 0x55d4a4f5f710 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.623+0000 7f8037025740 10 client.26371 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.623+0000 7f8037025740 1 -- 172.21.15.8:0/1370180003 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55d4a4ec45a0 con 0x55d4a4f5f710 2024-03-16T21:01:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.623+0000 7f8017400640 1 -- 172.21.15.8:0/1370180003 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55d4a4bc57e0 con 0x55d4a4f5f710 2024-03-16T21:01:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.624+0000 7f8017400640 1 -- 172.21.15.8:0/1370180003 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f80180bfff0 con 0x55d4a4f5f710 2024-03-16T21:01:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.624+0000 7f8037025740 10 client.26371 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.624+0000 7f8037025740 10 client.26371 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:01:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.624+0000 7f8037025740 20 client.26371 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.624+0000 7f8037025740 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d4a4f78090 0x55d4a4f7a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.624+0000 7f8037025740 4 client.26371 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:01:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.624+0000 7f8037025740 1 -- 172.21.15.8:0/1370180003 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4a4c02720 con 0x55d4a4f78090 2024-03-16T21:01:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.624+0000 7f8031a00640 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d4a4f78090 0x55d4a4f7a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.625+0000 7f8031a00640 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d4a4f78090 0x55d4a4f7a4b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=32017a2bb5f249aa server_cookie=4d215e165ecc0bb8 in_seq=0 out_seq=0 2024-03-16T21:01:32.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.625+0000 7f8017400640 10 client.26371 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:01:32.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.625+0000 7f8017400640 1 -- 172.21.15.8:0/1370180003 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d4a4c02720 con 0x55d4a4f78090 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8017400640 10 client.26371 handle_command_reply: tid=0 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 1 client.26371 shutdown 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 1 -- 172.21.15.8:0/1370180003 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 msgr2=0x55d4a4f658c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f658c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f80180bc0d0 tx=0x7f8018005b50 comp rx=0 tx=0).stop 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 1 -- 172.21.15.8:0/1370180003 shutdown_connections 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d4a4f78090 0x55d4a4f7a4b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 0x55d4a4f65e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5f710 0x55d4a4f658c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 1 --2- 172.21.15.8:0/1370180003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f65380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8017400640 0 client.26371 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 1 -- 172.21.15.8:0/1370180003 >> 172.21.15.8:0/1370180003 conn(0x55d4a4f59520 msgr2=0x55d4a4f5b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 1 -- 172.21.15.8:0/1370180003 shutdown_connections 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 1 -- 172.21.15.8:0/1370180003 wait complete. 2024-03-16T21:01:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.626+0000 7f8037025740 20 client.26371 trim_cache size 0 max 16384 2024-03-16T21:01:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8037025740 1 Processor -- start 2024-03-16T21:01:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8037025740 1 -- start start 2024-03-16T21:01:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8037025740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f67ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8037025740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f5f710 0x55d4a4f54550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8037025740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 0x55d4a4f73670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8037025740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4bc57e0 con 0x55d4a4f5f710 2024-03-16T21:01:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8037025740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4f5e210 con 0x55d4a4f682f0 2024-03-16T21:01:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8037025740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4f5a320 con 0x55d4a4f5edf0 2024-03-16T21:01:32.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8032400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 0x55d4a4f73670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8032400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 0x55d4a4f73670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45406/0 (socket says 172.21.15.8:45406) 2024-03-16T21:01:32.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8032400640 1 -- 172.21.15.8:0/2358741636 learned_addr learned my addr 172.21.15.8:0/2358741636 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:32.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8031000640 1 --2- 172.21.15.8:0/2358741636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f5f710 0x55d4a4f54550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8031a00640 1 --2- 172.21.15.8:0/2358741636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f67ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8032400640 1 -- 172.21.15.8:0/2358741636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 msgr2=0x55d4a4f67ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8032400640 1 --2- 172.21.15.8:0/2358741636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f67ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8032400640 1 -- 172.21.15.8:0/2358741636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f5f710 msgr2=0x55d4a4f54550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8032400640 1 --2- 172.21.15.8:0/2358741636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f5f710 0x55d4a4f54550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8032400640 1 -- 172.21.15.8:0/2358741636 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4a4e60ab0 con 0x55d4a4f682f0 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.641+0000 7f8032400640 1 --2- 172.21.15.8:0/2358741636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 0x55d4a4f73670 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8024009b40 tx=0x7f80240097c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89b6f69e6f18be1f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.642+0000 7f8022000640 1 -- 172.21.15.8:0/2358741636 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8024004040 con 0x55d4a4f682f0 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.642+0000 7f8022000640 1 -- 172.21.15.8:0/2358741636 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f80240046a0 con 0x55d4a4f682f0 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.642+0000 7f8022000640 1 -- 172.21.15.8:0/2358741636 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80240246b0 con 0x55d4a4f682f0 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.642+0000 7f8037025740 1 -- 172.21.15.8:0/2358741636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 msgr2=0x55d4a4f73670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.642+0000 7f8037025740 1 --2- 172.21.15.8:0/2358741636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 0x55d4a4f73670 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8024009b40 tx=0x7f80240097c0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.642+0000 7f8037025740 1 -- 172.21.15.8:0/2358741636 shutdown_connections 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.642+0000 7f8037025740 1 --2- 172.21.15.8:0/2358741636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f682f0 0x55d4a4f73670 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.642+0000 7f8037025740 1 --2- 172.21.15.8:0/2358741636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f5f710 0x55d4a4f54550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.642+0000 7f8037025740 1 --2- 172.21.15.8:0/2358741636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f67ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.642+0000 7f8037025740 1 -- 172.21.15.8:0/2358741636 >> 172.21.15.8:0/2358741636 conn(0x55d4a4f59520 msgr2=0x55d4a4f586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.642+0000 7f8037025740 1 -- 172.21.15.8:0/2358741636 shutdown_connections 2024-03-16T21:01:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.643+0000 7f8037025740 1 -- 172.21.15.8:0/2358741636 wait complete. 2024-03-16T21:01:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.643+0000 7f8037025740 1 -- start start 2024-03-16T21:01:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.643+0000 7f8037025740 1 Processor -- start 2024-03-16T21:01:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.643+0000 7f8037025740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f6d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.643+0000 7f8037025740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5f710 0x55d4a4f6d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8037025740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f682f0 0x55d4a4f6dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8037025740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4f632d0 con 0x55d4a4f682f0 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8037025740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4f63440 con 0x55d4a4f5f710 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8037025740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a4fd3980 con 0x55d4a4f5edf0 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8037025740 10 client.0 _ll_register_callbacks cb 0x7f8018009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8031a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f6d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8032400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f682f0 0x55d4a4f6dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8031000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5f710 0x55d4a4f6d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8031a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f6d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48666/0 (socket says 172.21.15.8:48666) 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8031a00640 1 -- 172.21.15.8:0/571542631 learned_addr learned my addr 172.21.15.8:0/571542631 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8031a00640 1 -- 172.21.15.8:0/571542631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5f710 msgr2=0x55d4a4f6d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8031a00640 1 --2- 172.21.15.8:0/571542631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5f710 0x55d4a4f6d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8031a00640 1 -- 172.21.15.8:0/571542631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f682f0 msgr2=0x55d4a4f6dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8031a00640 1 --2- 172.21.15.8:0/571542631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f682f0 0x55d4a4f6dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8031a00640 1 -- 172.21.15.8:0/571542631 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802401d040 con 0x55d4a4f5edf0 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8031a00640 1 --2- 172.21.15.8:0/571542631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f6d180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55d4a4f7acc0 tx=0x7f801c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2906a47f42193717 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.644+0000 7f8017400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8017400640 1 -- 172.21.15.8:0/571542631 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c023040 con 0x55d4a4f5edf0 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8017400640 1 -- 172.21.15.8:0/571542631 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f801c013b60 con 0x55d4a4f5edf0 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8037025740 1 -- 172.21.15.8:0/571542631 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4a4f54c30 con 0x55d4a4f5edf0 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8017400640 1 -- 172.21.15.8:0/571542631 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f801c013d20 con 0x55d4a4f5edf0 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8037025740 10 client.26377 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8037025740 1 -- 172.21.15.8:0/571542631 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55d4a4e86650 con 0x55d4a4f5edf0 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8017400640 1 -- 172.21.15.8:0/571542631 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55d4a4f54c30 con 0x55d4a4f5edf0 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8017400640 1 -- 172.21.15.8:0/571542631 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f801c01d530 con 0x55d4a4f5edf0 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8037025740 10 client.26377 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8037025740 10 client.26377 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8037025740 20 client.26377 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8037025740 1 --2- 172.21.15.8:0/571542631 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d4a4fd51f0 0x55d4a4fd7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8037025740 4 client.26377 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.645+0000 7f8037025740 1 -- 172.21.15.8:0/571542631 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f8024009e10 con 0x55d4a4fd51f0 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.646+0000 7f8031000640 1 --2- 172.21.15.8:0/571542631 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d4a4fd51f0 0x55d4a4fd7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.646+0000 7f8031000640 1 --2- 172.21.15.8:0/571542631 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d4a4fd51f0 0x55d4a4fd7610 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=adaf14824c1d7492 server_cookie=ba4c6d2df5f8e595 in_seq=0 out_seq=0 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.646+0000 7f8017400640 10 client.26377 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.646+0000 7f8017400640 1 -- 172.21.15.8:0/571542631 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f8024009e10 con 0x55d4a4fd51f0 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.646+0000 7f8017400640 10 client.26377 handle_command_reply: tid=0 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.646+0000 7f8037025740 1 client.26377 shutdown 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8037025740 1 -- 172.21.15.8:0/571542631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 msgr2=0x55d4a4f6d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8037025740 1 --2- 172.21.15.8:0/571542631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f6d180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55d4a4f7acc0 tx=0x7f801c004a40 comp rx=0 tx=0).stop 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8037025740 1 -- 172.21.15.8:0/571542631 shutdown_connections 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8037025740 1 --2- 172.21.15.8:0/571542631 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d4a4fd51f0 0x55d4a4fd7610 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8037025740 1 --2- 172.21.15.8:0/571542631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d4a4f682f0 0x55d4a4f6dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8037025740 1 --2- 172.21.15.8:0/571542631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4a4f5f710 0x55d4a4f6d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8037025740 1 --2- 172.21.15.8:0/571542631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d4a4f5edf0 0x55d4a4f6d180 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8017400640 0 client.26377 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:01:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8037025740 1 -- 172.21.15.8:0/571542631 >> 172.21.15.8:0/571542631 conn(0x55d4a4f59520 msgr2=0x55d4a4f65340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8037025740 1 -- 172.21.15.8:0/571542631 shutdown_connections 2024-03-16T21:01:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8037025740 1 -- 172.21.15.8:0/571542631 wait complete. 2024-03-16T21:01:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.647+0000 7f8037025740 20 client.26377 trim_cache size 0 max 16384 2024-03-16T21:01:32.657 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:01:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 -- 172.21.15.8:0/2940482275 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80100a1c20 msgr2=0x7f80100a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80100a1c20 0x7f80100a40e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55d4a4f5e8c0 tx=0x7f801c009680 comp rx=0 tx=0).stop 2024-03-16T21:01:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 -- 172.21.15.8:0/2940482275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f802c076340 msgr2=0x7f802c19e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f802c076340 0x7f802c19e970 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8018009230 tx=0x7f8018004c20 comp rx=0 tx=0).stop 2024-03-16T21:01:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 -- 172.21.15.8:0/2940482275 shutdown_connections 2024-03-16T21:01:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80100a1c20 0x7f80100a40e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f802c112210 0x7f802c1a2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f802c076340 0x7f802c19e970 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 --2- 172.21.15.8:0/2940482275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f802c075a20 0x7f802c19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 -- 172.21.15.8:0/2940482275 >> 172.21.15.8:0/2940482275 conn(0x7f802c0ff000 msgr2=0x7f802c1013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 -- 172.21.15.8:0/2940482275 shutdown_connections 2024-03-16T21:01:32.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.648+0000 7f8032e00640 1 -- 172.21.15.8:0/2940482275 wait complete. 2024-03-16T21:01:32.671 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:01:32.671 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:01:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 -- 172.21.15.8:0/93925105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9501096a0 msgr2=0x7fc950109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 --2- 172.21.15.8:0/93925105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9501096a0 0x7fc950109a80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc940009900 tx=0x7fc94002bc40 comp rx=0 tx=0).stop 2024-03-16T21:01:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 -- 172.21.15.8:0/93925105 shutdown_connections 2024-03-16T21:01:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 --2- 172.21.15.8:0/93925105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc950104050 0x7fc950110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 --2- 172.21.15.8:0/93925105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc950103690 0x7fc950103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 --2- 172.21.15.8:0/93925105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9501096a0 0x7fc950109a80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 -- 172.21.15.8:0/93925105 >> 172.21.15.8:0/93925105 conn(0x7fc9500ff140 msgr2=0x7fc950101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 -- 172.21.15.8:0/93925105 shutdown_connections 2024-03-16T21:01:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 -- 172.21.15.8:0/93925105 wait complete. 2024-03-16T21:01:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 Processor -- start 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 -- start start 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc950103690 0x7fc950199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc950104050 0x7fc95019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9501096a0 0x7fc95019e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95019ec80 con 0x7fc950103690 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95019edf0 con 0x7fc9501096a0 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.889+0000 7fc955e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95019efb0 con 0x7fc950104050 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc94f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9501096a0 0x7fc95019e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc94f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9501096a0 0x7fc95019e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45452/0 (socket says 172.21.15.8:45452) 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc94f400640 1 -- 172.21.15.8:0/1389964850 learned_addr learned my addr 172.21.15.8:0/1389964850 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc947e00640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc950104050 0x7fc95019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc94ea00640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc950103690 0x7fc950199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc94f400640 1 -- 172.21.15.8:0/1389964850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc950104050 msgr2=0x7fc95019a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc94f400640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc950104050 0x7fc95019a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc94f400640 1 -- 172.21.15.8:0/1389964850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc950103690 msgr2=0x7fc950199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc94f400640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc950103690 0x7fc950199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc94f400640 1 -- 172.21.15.8:0/1389964850 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc938009490 con 0x7fc9501096a0 2024-03-16T21:01:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc94f400640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9501096a0 0x7fc95019e680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc94800eb10 tx=0x7fc94800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.890+0000 7fc954a00640 1 -- 172.21.15.8:0/1389964850 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948004b20 con 0x7fc9501096a0 2024-03-16T21:01:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.891+0000 7fc955e00640 1 -- 172.21.15.8:0/1389964850 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc940009560 con 0x7fc9501096a0 2024-03-16T21:01:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.891+0000 7fc954a00640 1 -- 172.21.15.8:0/1389964850 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc948004c80 con 0x7fc9501096a0 2024-03-16T21:01:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.891+0000 7fc954a00640 1 -- 172.21.15.8:0/1389964850 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948010760 con 0x7fc9501096a0 2024-03-16T21:01:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.891+0000 7fc955e00640 1 -- 172.21.15.8:0/1389964850 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9501a6930 con 0x7fc9501096a0 2024-03-16T21:01:32.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.894+0000 7fc954a00640 1 -- 172.21.15.8:0/1389964850 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fc948005020 con 0x7fc9501096a0 2024-03-16T21:01:32.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.894+0000 7fc958a02740 1 Processor -- start 2024-03-16T21:01:32.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.894+0000 7fc958a02740 1 -- start start 2024-03-16T21:01:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc958a02740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc958a02740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6d3560 0x55ad3c6dbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc958a02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6dc140 0x55ad3c6de530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc958a02740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c641210 con 0x55ad3c6d2c40 2024-03-16T21:01:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc958a02740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c63e740 con 0x55ad3c6d3560 2024-03-16T21:01:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc958a02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c639f20 con 0x55ad3c6dc140 2024-03-16T21:01:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc94ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6d3560 0x55ad3c6dbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc94ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6d3560 0x55ad3c6dbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45462/0 (socket says 172.21.15.8:45462) 2024-03-16T21:01:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc94ea00640 1 -- 172.21.15.8:0/1863148695 learned_addr learned my addr 172.21.15.8:0/1863148695 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc947e00640 1 --2- 172.21.15.8:0/1863148695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc947e00640 1 --2- 172.21.15.8:0/1863148695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6dc140 0x55ad3c6de530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc94ea00640 1 -- 172.21.15.8:0/1863148695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6dc140 msgr2=0x55ad3c6de530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc94ea00640 1 --2- 172.21.15.8:0/1863148695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6dc140 0x55ad3c6de530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc94ea00640 1 -- 172.21.15.8:0/1863148695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 msgr2=0x55ad3c6d3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc94ea00640 1 --2- 172.21.15.8:0/1863148695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc94ea00640 1 -- 172.21.15.8:0/1863148695 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad3c5fbdf0 con 0x55ad3c6d3560 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.895+0000 7fc947e00640 1 --2- 172.21.15.8:0/1863148695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.896+0000 7fc954a00640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9340a1ba0 0x7fc9340a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.896+0000 7fc94ea00640 1 --2- 172.21.15.8:0/1863148695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6d3560 0x55ad3c6dbc00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc940009230 tx=0x7fc94002c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12eada7d25b17430 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.896+0000 7fc954a00640 1 -- 172.21.15.8:0/1389964850 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc948014070 con 0x7fc9501096a0 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.896+0000 7fc947e00640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9340a1ba0 0x7fc9340a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.896+0000 7fc93fe00640 1 -- 172.21.15.8:0/1863148695 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940004780 con 0x55ad3c6d3560 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.896+0000 7fc93fe00640 1 -- 172.21.15.8:0/1863148695 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc9400048e0 con 0x55ad3c6d3560 2024-03-16T21:01:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.896+0000 7fc93fe00640 1 -- 172.21.15.8:0/1863148695 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940005190 con 0x55ad3c6d3560 2024-03-16T21:01:32.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.897+0000 7fc958a02740 1 -- 172.21.15.8:0/1863148695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6d3560 msgr2=0x55ad3c6dbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.897+0000 7fc947e00640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9340a1ba0 0x7fc9340a4060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55ad3c6ce500 tx=0x7fc938009770 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.897+0000 7fc958a02740 1 --2- 172.21.15.8:0/1863148695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6d3560 0x55ad3c6dbc00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc940009230 tx=0x7fc94002c6a0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.897+0000 7fc958a02740 1 -- 172.21.15.8:0/1863148695 shutdown_connections 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.897+0000 7fc958a02740 1 --2- 172.21.15.8:0/1863148695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6dc140 0x55ad3c6de530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.897+0000 7fc958a02740 1 --2- 172.21.15.8:0/1863148695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6d3560 0x55ad3c6dbc00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.897+0000 7fc958a02740 1 --2- 172.21.15.8:0/1863148695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.897+0000 7fc958a02740 1 -- 172.21.15.8:0/1863148695 >> 172.21.15.8:0/1863148695 conn(0x55ad3c6cd370 msgr2=0x55ad3c6cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.897+0000 7fc958a02740 1 -- 172.21.15.8:0/1863148695 shutdown_connections 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.897+0000 7fc958a02740 1 -- 172.21.15.8:0/1863148695 wait complete. 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.898+0000 7fc958a02740 1 -- start start 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.898+0000 7fc958a02740 1 Processor -- start 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.898+0000 7fc958a02740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.898+0000 7fc958a02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d3560 0x55ad3c6d9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.898+0000 7fc958a02740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c6d9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.898+0000 7fc958a02740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c5df150 con 0x55ad3c6d2c40 2024-03-16T21:01:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.898+0000 7fc958a02740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c5dedf0 con 0x55ad3c6dc140 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.898+0000 7fc958a02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c3a81c0 con 0x55ad3c6d3560 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.898+0000 7fc958a02740 10 client.0 _ll_register_callbacks cb 0x55ad3c62e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc94ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc94ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37716/0 (socket says 172.21.15.8:37716) 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc94ea00640 1 -- 172.21.15.8:0/1392967116 learned_addr learned my addr 172.21.15.8:0/1392967116 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc947e00640 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d3560 0x55ad3c6d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc94f400640 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c6d9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc94ea00640 1 -- 172.21.15.8:0/1392967116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d3560 msgr2=0x55ad3c6d9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc94ea00640 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d3560 0x55ad3c6d9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc94ea00640 1 -- 172.21.15.8:0/1392967116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 msgr2=0x55ad3c6d9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc94ea00640 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c6d9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc94ea00640 1 -- 172.21.15.8:0/1392967116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc950110e60 con 0x55ad3c6d2c40 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc94f400640 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c6d9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc94ea00640 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d9220 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc94002c250 tx=0x7fc94002c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29ef42858e6c627 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.899+0000 7fc93cc00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:01:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.900+0000 7fc93cc00640 1 -- 172.21.15.8:0/1392967116 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940005320 con 0x55ad3c6d2c40 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.900+0000 7fc93cc00640 1 -- 172.21.15.8:0/1392967116 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc940005480 con 0x55ad3c6d2c40 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.900+0000 7fc958a02740 1 -- 172.21.15.8:0/1392967116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad3c3397e0 con 0x55ad3c6d2c40 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.900+0000 7fc93cc00640 1 -- 172.21.15.8:0/1392967116 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc940005640 con 0x55ad3c6d2c40 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.900+0000 7fc958a02740 10 client.16221 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.900+0000 7fc958a02740 1 -- 172.21.15.8:0/1392967116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ad3c6385a0 con 0x55ad3c6d2c40 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.900+0000 7fc93cc00640 1 -- 172.21.15.8:0/1392967116 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55ad3c3397e0 con 0x55ad3c6d2c40 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.901+0000 7fc93cc00640 1 -- 172.21.15.8:0/1392967116 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fc940052070 con 0x55ad3c6d2c40 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.901+0000 7fc958a02740 10 client.16221 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.901+0000 7fc958a02740 10 client.16221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.901+0000 7fc958a02740 20 client.16221 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.901+0000 7fc958a02740 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55ad3c6ebe80 0x55ad3c6ee270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.901+0000 7fc958a02740 4 client.16221 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.901+0000 7fc958a02740 1 -- 172.21.15.8:0/1392967116 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad3c376720 con 0x55ad3c6ebe80 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.901+0000 7fc947e00640 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55ad3c6ebe80 0x55ad3c6ee270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.902+0000 7fc947e00640 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55ad3c6ebe80 0x55ad3c6ee270 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=610305c096d2d6e6 server_cookie=402dfe1896534503 in_seq=0 out_seq=0 2024-03-16T21:01:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.902+0000 7fc93cc00640 10 client.16221 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc93cc00640 1 -- 172.21.15.8:0/1392967116 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ad3c376720 con 0x55ad3c6ebe80 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc93cc00640 10 client.16221 handle_command_reply: tid=0 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 1 client.16221 shutdown 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 1 -- 172.21.15.8:0/1392967116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 msgr2=0x55ad3c6d9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d9220 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc94002c250 tx=0x7fc94002c3e0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 1 -- 172.21.15.8:0/1392967116 shutdown_connections 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55ad3c6ebe80 0x55ad3c6ee270 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c6d9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d3560 0x55ad3c6d9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 1 --2- 172.21.15.8:0/1392967116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d9220 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc93cc00640 0 client.16221 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:01:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 1 -- 172.21.15.8:0/1392967116 >> 172.21.15.8:0/1392967116 conn(0x55ad3c6cd370 msgr2=0x55ad3c6cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 1 -- 172.21.15.8:0/1392967116 shutdown_connections 2024-03-16T21:01:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 1 -- 172.21.15.8:0/1392967116 wait complete. 2024-03-16T21:01:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.903+0000 7fc958a02740 20 client.16221 trim_cache size 0 max 16384 2024-03-16T21:01:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.917+0000 7fc958a02740 1 Processor -- start 2024-03-16T21:01:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.917+0000 7fc958a02740 1 -- start start 2024-03-16T21:01:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.917+0000 7fc958a02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.917+0000 7fc958a02740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d3560 0x55ad3c6cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.917+0000 7fc958a02740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c6e7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.917+0000 7fc958a02740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c6d4e50 con 0x55ad3c6d3560 2024-03-16T21:01:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.917+0000 7fc958a02740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c6c8aa0 con 0x55ad3c6dc140 2024-03-16T21:01:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.917+0000 7fc958a02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c6c8cb0 con 0x55ad3c6d2c40 2024-03-16T21:01:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc94ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc94f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c6e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc94f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c6e7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45472/0 (socket says 172.21.15.8:45472) 2024-03-16T21:01:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc947e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d3560 0x55ad3c6cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc94f400640 1 -- 172.21.15.8:0/4254284464 learned_addr learned my addr 172.21.15.8:0/4254284464 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc94ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48714/0 (socket says 172.21.15.8:48714) 2024-03-16T21:01:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc94f400640 1 -- 172.21.15.8:0/4254284464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 msgr2=0x55ad3c6d9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc94f400640 1 --2- 172.21.15.8:0/4254284464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc94f400640 1 -- 172.21.15.8:0/4254284464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d3560 msgr2=0x55ad3c6cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc94f400640 1 --2- 172.21.15.8:0/4254284464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d3560 0x55ad3c6cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc94f400640 1 -- 172.21.15.8:0/4254284464 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad3c5d4ab0 con 0x55ad3c6dc140 2024-03-16T21:01:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.918+0000 7fc94f400640 1 --2- 172.21.15.8:0/4254284464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c6e7460 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc948097330 tx=0x7fc94800efd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1db2fd442d57a36b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.919+0000 7fc93f400640 1 -- 172.21.15.8:0/4254284464 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94809eab0 con 0x55ad3c6dc140 2024-03-16T21:01:32.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.919+0000 7fc93f400640 1 -- 172.21.15.8:0/4254284464 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc9480a3100 con 0x55ad3c6dc140 2024-03-16T21:01:32.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.919+0000 7fc93f400640 1 -- 172.21.15.8:0/4254284464 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9480cbe30 con 0x55ad3c6dc140 2024-03-16T21:01:32.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.919+0000 7fc958a02740 1 -- 172.21.15.8:0/4254284464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 msgr2=0x55ad3c6e7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.919+0000 7fc958a02740 1 --2- 172.21.15.8:0/4254284464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c6e7460 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc948097330 tx=0x7fc94800efd0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.919+0000 7fc958a02740 1 -- 172.21.15.8:0/4254284464 shutdown_connections 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.919+0000 7fc958a02740 1 --2- 172.21.15.8:0/4254284464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c6e7460 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.919+0000 7fc958a02740 1 --2- 172.21.15.8:0/4254284464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d3560 0x55ad3c6cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.919+0000 7fc958a02740 1 --2- 172.21.15.8:0/4254284464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6d9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.919+0000 7fc958a02740 1 -- 172.21.15.8:0/4254284464 >> 172.21.15.8:0/4254284464 conn(0x55ad3c6cd370 msgr2=0x55ad3c6cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.919+0000 7fc958a02740 1 -- 172.21.15.8:0/4254284464 shutdown_connections 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.920+0000 7fc958a02740 1 -- 172.21.15.8:0/4254284464 wait complete. 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.920+0000 7fc958a02740 1 -- start start 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.920+0000 7fc958a02740 1 Processor -- start 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc958a02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc958a02740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d3560 0x55ad3c6dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc958a02740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c7466e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc958a02740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c6e0710 con 0x55ad3c6d3560 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc958a02740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c746c20 con 0x55ad3c6dc140 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc958a02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad3c746de0 con 0x55ad3c6d2c40 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc958a02740 10 client.0 _ll_register_callbacks cb 0x7fc940009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc947e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d3560 0x55ad3c6dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc94ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc94f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c7466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc94ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6dfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48726/0 (socket says 172.21.15.8:48726) 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc94ea00640 1 -- 172.21.15.8:0/3119197174 learned_addr learned my addr 172.21.15.8:0/3119197174 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc947e00640 1 -- 172.21.15.8:0/3119197174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 msgr2=0x55ad3c6dfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc947e00640 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6dfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc947e00640 1 -- 172.21.15.8:0/3119197174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 msgr2=0x55ad3c7466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc947e00640 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c7466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc947e00640 1 -- 172.21.15.8:0/3119197174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9501a6930 con 0x55ad3c6d3560 2024-03-16T21:01:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc94f400640 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c7466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc947e00640 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d3560 0x55ad3c6dffb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55ad3c6da7f0 tx=0x7fc9380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd8a6761dcf326f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc93cc00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc93cc00640 1 -- 172.21.15.8:0/3119197174 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938027040 con 0x55ad3c6d3560 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc958a02740 1 -- 172.21.15.8:0/3119197174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9400048e0 con 0x55ad3c6d3560 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc93cc00640 1 -- 172.21.15.8:0/3119197174 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc9380035f0 con 0x55ad3c6d3560 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc93cc00640 1 -- 172.21.15.8:0/3119197174 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9380037b0 con 0x55ad3c6d3560 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc958a02740 10 client.16227 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc958a02740 1 -- 172.21.15.8:0/3119197174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ad3c5fa650 con 0x55ad3c6d3560 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.922+0000 7fc93cc00640 1 -- 172.21.15.8:0/3119197174 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc9400048e0 con 0x55ad3c6d3560 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.923+0000 7fc93cc00640 1 -- 172.21.15.8:0/3119197174 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fc93802dce0 con 0x55ad3c6d3560 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.923+0000 7fc958a02740 10 client.16227 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.923+0000 7fc958a02740 10 client.16227 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.923+0000 7fc958a02740 20 client.16227 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.923+0000 7fc958a02740 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55ad3c7486c0 0x55ad3c74aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.923+0000 7fc958a02740 4 client.16227 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:01:32.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.923+0000 7fc958a02740 1 -- 172.21.15.8:0/3119197174 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ad3c3c5890 con 0x55ad3c7486c0 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.923+0000 7fc94ea00640 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55ad3c7486c0 0x55ad3c74aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc94ea00640 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55ad3c7486c0 0x55ad3c74aae0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=77add9f68ecbe7c2 server_cookie=d326497020a8f373 in_seq=0 out_seq=0 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc93cc00640 10 client.16227 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc93cc00640 1 -- 172.21.15.8:0/3119197174 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ad3c3c5890 con 0x55ad3c7486c0 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc93cc00640 10 client.16227 handle_command_reply: tid=0 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 1 client.16227 shutdown 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 1 -- 172.21.15.8:0/3119197174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d3560 msgr2=0x55ad3c6dffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d3560 0x55ad3c6dffb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55ad3c6da7f0 tx=0x7fc9380046c0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 1 -- 172.21.15.8:0/3119197174 shutdown_connections 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55ad3c7486c0 0x55ad3c74aae0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad3c6dc140 0x55ad3c7466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad3c6d3560 0x55ad3c6dffb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 1 --2- 172.21.15.8:0/3119197174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad3c6d2c40 0x55ad3c6dfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc93cc00640 0 client.16227 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:01:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 1 -- 172.21.15.8:0/3119197174 >> 172.21.15.8:0/3119197174 conn(0x55ad3c6cd370 msgr2=0x55ad3c6cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 1 -- 172.21.15.8:0/3119197174 shutdown_connections 2024-03-16T21:01:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 1 -- 172.21.15.8:0/3119197174 wait complete. 2024-03-16T21:01:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.924+0000 7fc958a02740 20 client.16227 trim_cache size 0 max 16384 2024-03-16T21:01:32.934 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:01:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 -- 172.21.15.8:0/1389964850 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9340a1ba0 msgr2=0x7fc9340a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9340a1ba0 0x7fc9340a4060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55ad3c6ce500 tx=0x7fc938009770 comp rx=0 tx=0).stop 2024-03-16T21:01:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 -- 172.21.15.8:0/1389964850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9501096a0 msgr2=0x7fc95019e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9501096a0 0x7fc95019e680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc94800eb10 tx=0x7fc94800c2d0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 -- 172.21.15.8:0/1389964850 shutdown_connections 2024-03-16T21:01:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc9340a1ba0 0x7fc9340a4060 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9501096a0 0x7fc95019e680 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc950104050 0x7fc95019a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 --2- 172.21.15.8:0/1389964850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc950103690 0x7fc950199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:32.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 -- 172.21.15.8:0/1389964850 >> 172.21.15.8:0/1389964850 conn(0x7fc9500ff140 msgr2=0x7fc9500ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:32.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 -- 172.21.15.8:0/1389964850 shutdown_connections 2024-03-16T21:01:32.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:32.925+0000 7fc955e00640 1 -- 172.21.15.8:0/1389964850 wait complete. 2024-03-16T21:01:32.949 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:01:32.949 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:01:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.164+0000 7f94f2600640 1 -- 172.21.15.8:0/3052371559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94ec107560 msgr2=0x7f94ec107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.164+0000 7f94f2600640 1 --2- 172.21.15.8:0/3052371559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94ec107560 0x7f94ec107940 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009930 tx=0x7f94dc02bc20 comp rx=0 tx=0).stop 2024-03-16T21:01:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.164+0000 7f94f2600640 1 -- 172.21.15.8:0/3052371559 shutdown_connections 2024-03-16T21:01:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.164+0000 7f94f2600640 1 --2- 172.21.15.8:0/3052371559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ec101e60 0x7f94ec10e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.164+0000 7f94f2600640 1 --2- 172.21.15.8:0/3052371559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94ec1014a0 0x7f94ec101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.164+0000 7f94f2600640 1 --2- 172.21.15.8:0/3052371559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94ec107560 0x7f94ec107940 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.164+0000 7f94f2600640 1 -- 172.21.15.8:0/3052371559 >> 172.21.15.8:0/3052371559 conn(0x7f94ec0788f0 msgr2=0x7f94ec078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.164+0000 7f94f2600640 1 -- 172.21.15.8:0/3052371559 shutdown_connections 2024-03-16T21:01:33.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.164+0000 7f94f2600640 1 -- 172.21.15.8:0/3052371559 wait complete. 2024-03-16T21:01:33.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.165+0000 7f94f2600640 1 Processor -- start 2024-03-16T21:01:33.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.165+0000 7f94f2600640 1 -- start start 2024-03-16T21:01:33.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.166+0000 7f94f2600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94ec1014a0 0x7f94ec19f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.166+0000 7f94f2600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94ec101e60 0x7f94ec19fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.166+0000 7f94f2600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ec107560 0x7f94ec199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.166+0000 7f94f2600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec19a140 con 0x7f94ec101e60 2024-03-16T21:01:33.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.166+0000 7f94f2600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec19a2b0 con 0x7f94ec107560 2024-03-16T21:01:33.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.166+0000 7f94f2600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec19a470 con 0x7f94ec1014a0 2024-03-16T21:01:33.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.166+0000 7f94eaa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94ec101e60 0x7f94ec19fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.166+0000 7f94eb400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94ec1014a0 0x7f94ec19f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.166+0000 7f94eaa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94ec101e60 0x7f94ec19fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37754/0 (socket says 172.21.15.8:37754) 2024-03-16T21:01:33.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.166+0000 7f94eaa00640 1 -- 172.21.15.8:0/4263812320 learned_addr learned my addr 172.21.15.8:0/4263812320 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.166+0000 7f94ebe00640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ec107560 0x7f94ec199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.168+0000 7f94eb400640 1 -- 172.21.15.8:0/4263812320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ec107560 msgr2=0x7f94ec199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.168+0000 7f94eb400640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ec107560 0x7f94ec199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.168+0000 7f94eb400640 1 -- 172.21.15.8:0/4263812320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94ec101e60 msgr2=0x7f94ec19fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.168+0000 7f94eb400640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94ec101e60 0x7f94ec19fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.168+0000 7f94eb400640 1 -- 172.21.15.8:0/4263812320 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc009560 con 0x7f94ec1014a0 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.168+0000 7f94eaa00640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94ec101e60 0x7f94ec19fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.168+0000 7f94ebe00640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ec107560 0x7f94ec199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.168+0000 7f94eb400640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94ec1014a0 0x7f94ec19f940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f94dc036040 tx=0x7f94dc02cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.168+0000 7f94e3e00640 1 -- 172.21.15.8:0/4263812320 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc004250 con 0x7f94ec1014a0 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.168+0000 7f94e3e00640 1 -- 172.21.15.8:0/4263812320 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f94dc0043b0 con 0x7f94ec1014a0 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.168+0000 7f94e3e00640 1 -- 172.21.15.8:0/4263812320 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc003b20 con 0x7f94ec1014a0 2024-03-16T21:01:33.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.169+0000 7f94f2600640 1 -- 172.21.15.8:0/4263812320 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec19a6f0 con 0x7f94ec1014a0 2024-03-16T21:01:33.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.169+0000 7f94f2600640 1 -- 172.21.15.8:0/4263812320 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec1a69e0 con 0x7f94ec1014a0 2024-03-16T21:01:33.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.171+0000 7f94e3e00640 1 -- 172.21.15.8:0/4263812320 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f94dc003c80 con 0x7f94ec1014a0 2024-03-16T21:01:33.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.171+0000 7f94f5229740 1 Processor -- start 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.171+0000 7f94f5229740 1 -- start start 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.171+0000 7f94f5229740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 0x55a09d7bc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.171+0000 7f94f5229740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.171+0000 7f94f5229740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7c5140 0x55a09d7c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.171+0000 7f94f5229740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d72a210 con 0x55a09d7c5140 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94f5229740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d727740 con 0x55a09d7bc560 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94f5229740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d722f20 con 0x55a09d7bbc40 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94ebe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 0x55a09d7bc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94ebe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 0x55a09d7bc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48752/0 (socket says 172.21.15.8:48752) 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94ebe00640 1 -- 172.21.15.8:0/2939677785 learned_addr learned my addr 172.21.15.8:0/2939677785 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94eb400640 1 --2- 172.21.15.8:0/2939677785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94eaa00640 1 --2- 172.21.15.8:0/2939677785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7c5140 0x55a09d7c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94ebe00640 1 -- 172.21.15.8:0/2939677785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 msgr2=0x55a09d7c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:33.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94ebe00640 1 --2- 172.21.15.8:0/2939677785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94ebe00640 1 -- 172.21.15.8:0/2939677785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7c5140 msgr2=0x55a09d7c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:33.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94ebe00640 1 --2- 172.21.15.8:0/2939677785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7c5140 0x55a09d7c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.172+0000 7f94ebe00640 1 -- 172.21.15.8:0/2939677785 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09d6e4df0 con 0x55a09d7bbc40 2024-03-16T21:01:33.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94ebe00640 1 --2- 172.21.15.8:0/2939677785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 0x55a09d7bc020 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f94e40117e0 tx=0x7f94e4011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8740d9c1c82f4cb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:33.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94e0c00640 1 -- 172.21.15.8:0/2939677785 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4011310 con 0x55a09d7bbc40 2024-03-16T21:01:33.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94e0c00640 1 -- 172.21.15.8:0/2939677785 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f94e4003e70 con 0x55a09d7bbc40 2024-03-16T21:01:33.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94e0c00640 1 -- 172.21.15.8:0/2939677785 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4004690 con 0x55a09d7bbc40 2024-03-16T21:01:33.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94e3e00640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94d00a1c20 0x7f94d00a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94eb400640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94d00a1c20 0x7f94d00a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94e3e00640 1 -- 172.21.15.8:0/4263812320 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f94dc0efc00 con 0x7f94ec1014a0 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94f5229740 1 -- 172.21.15.8:0/2939677785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 msgr2=0x55a09d7bc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94f5229740 1 --2- 172.21.15.8:0/2939677785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 0x55a09d7bc020 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f94e40117e0 tx=0x7f94e4011ca0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94f5229740 1 -- 172.21.15.8:0/2939677785 shutdown_connections 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94f5229740 1 --2- 172.21.15.8:0/2939677785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7c5140 0x55a09d7c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94f5229740 1 --2- 172.21.15.8:0/2939677785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94f5229740 1 --2- 172.21.15.8:0/2939677785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 0x55a09d7bc020 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.173+0000 7f94f5229740 1 -- 172.21.15.8:0/2939677785 >> 172.21.15.8:0/2939677785 conn(0x55a09d7b6370 msgr2=0x55a09d7b6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.174+0000 7f94f5229740 1 -- 172.21.15.8:0/2939677785 shutdown_connections 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.174+0000 7f94f5229740 1 -- 172.21.15.8:0/2939677785 wait complete. 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.174+0000 7f94eb400640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94d00a1c20 0x7f94d00a40e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55a09d7bb710 tx=0x7f94dc0f3670 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.174+0000 7f94f5229740 1 -- start start 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.174+0000 7f94f5229740 1 Processor -- start 2024-03-16T21:01:33.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94f5229740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7bbc40 0x55a09d7c2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94f5229740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bc560 0x55a09d7c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94f5229740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7c5140 0x55a09d7c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94f5229740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d6c8150 con 0x55a09d7bbc40 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94f5229740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d6c7df0 con 0x55a09d7c5140 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94f5229740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d4911c0 con 0x55a09d7bc560 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94f5229740 10 client.0 _ll_register_callbacks cb 0x55a09d7172b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94ebe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7bbc40 0x55a09d7c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94eaa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bc560 0x55a09d7c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94eaa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bc560 0x55a09d7c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48758/0 (socket says 172.21.15.8:48758) 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94eaa00640 1 -- 172.21.15.8:0/3950648452 learned_addr learned my addr 172.21.15.8:0/3950648452 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.175+0000 7f94ebe00640 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7c5140 0x55a09d7c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.176+0000 7f94eaa00640 1 -- 172.21.15.8:0/3950648452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7c5140 msgr2=0x55a09d7c2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.176+0000 7f94eaa00640 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7c5140 0x55a09d7c2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.176+0000 7f94eaa00640 1 -- 172.21.15.8:0/3950648452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7bbc40 msgr2=0x55a09d7c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.176+0000 7f94eaa00640 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7bbc40 0x55a09d7c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.176+0000 7f94eaa00640 1 -- 172.21.15.8:0/3950648452 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e40114c0 con 0x55a09d7bc560 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.176+0000 7f94eaa00640 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bc560 0x55a09d7c2640 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f94d4010f10 tx=0x7f94d400f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=396e196c70d69d12 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.176+0000 7f94d9600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.176+0000 7f94d9600640 1 -- 172.21.15.8:0/3950648452 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4015070 con 0x55a09d7bc560 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.176+0000 7f94d9600640 1 -- 172.21.15.8:0/3950648452 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f94d4005020 con 0x55a09d7bc560 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.176+0000 7f94f5229740 1 -- 172.21.15.8:0/3950648452 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a09d4227e0 con 0x55a09d7bc560 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94d9600640 1 -- 172.21.15.8:0/3950648452 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94d400ae80 con 0x55a09d7bc560 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94f5229740 10 client.26407 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94f5229740 1 -- 172.21.15.8:0/3950648452 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55a09d7215a0 con 0x55a09d7bc560 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94d9600640 1 -- 172.21.15.8:0/3950648452 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a09d4227e0 con 0x55a09d7bc560 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94d9600640 1 -- 172.21.15.8:0/3950648452 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f94d4019530 con 0x55a09d7bc560 2024-03-16T21:01:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94f5229740 10 client.26407 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:33.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94f5229740 10 client.26407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:33.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94f5229740 20 client.26407 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:33.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94f5229740 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a09d7d5300 0x55a09d7d7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94f5229740 4 client.26407 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:01:33.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94f5229740 1 -- 172.21.15.8:0/3950648452 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a09d45f720 con 0x55a09d7d5300 2024-03-16T21:01:33.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.177+0000 7f94ebe00640 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a09d7d5300 0x55a09d7d7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94ebe00640 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a09d7d5300 0x55a09d7d7720 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dd3b2eb53c19101 server_cookie=e2a56b3b29b3eaac in_seq=0 out_seq=0 2024-03-16T21:01:33.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94d9600640 10 client.26407 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:33.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94d9600640 1 -- 172.21.15.8:0/3950648452 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a09d45f720 con 0x55a09d7d5300 2024-03-16T21:01:33.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94d9600640 10 client.26407 handle_command_reply: tid=0 2024-03-16T21:01:33.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94f5229740 1 client.26407 shutdown 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94f5229740 1 -- 172.21.15.8:0/3950648452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bc560 msgr2=0x55a09d7c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94f5229740 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bc560 0x55a09d7c2640 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f94d4010f10 tx=0x7f94d400f7f0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94f5229740 1 -- 172.21.15.8:0/3950648452 shutdown_connections 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94f5229740 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7c5140 0x55a09d7c2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94f5229740 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bc560 0x55a09d7c2640 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94f5229740 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a09d7d5300 0x55a09d7d7720 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94f5229740 1 --2- 172.21.15.8:0/3950648452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7bbc40 0x55a09d7c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94d9600640 0 client.26407 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94f5229740 1 -- 172.21.15.8:0/3950648452 >> 172.21.15.8:0/3950648452 conn(0x55a09d7b6370 msgr2=0x55a09d7b80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94f5229740 1 -- 172.21.15.8:0/3950648452 shutdown_connections 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.179+0000 7f94f5229740 1 -- 172.21.15.8:0/3950648452 wait complete. 2024-03-16T21:01:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.180+0000 7f94f5229740 20 client.26407 trim_cache size 0 max 16384 2024-03-16T21:01:33.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.193+0000 7f94f5229740 1 Processor -- start 2024-03-16T21:01:33.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.194+0000 7f94f5229740 1 -- start start 2024-03-16T21:01:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.194+0000 7f94f5229740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 0x55a09d7c4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.194+0000 7f94f5229740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.194+0000 7f94f5229740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7c5140 0x55a09d7b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.194+0000 7f94f5229740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d45f750 con 0x55a09d7c5140 2024-03-16T21:01:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.194+0000 7f94f5229740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d7baf60 con 0x55a09d7bc560 2024-03-16T21:01:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.194+0000 7f94f5229740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d7d39d0 con 0x55a09d7bbc40 2024-03-16T21:01:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.194+0000 7f94eaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.194+0000 7f94eaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7c29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45530/0 (socket says 172.21.15.8:45530) 2024-03-16T21:01:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.194+0000 7f94eaa00640 1 -- 172.21.15.8:0/254883612 learned_addr learned my addr 172.21.15.8:0/254883612 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.194+0000 7f94ebe00640 1 --2- 172.21.15.8:0/254883612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 0x55a09d7c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.195+0000 7f94ebe00640 1 --2- 172.21.15.8:0/254883612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7c5140 0x55a09d7b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.195+0000 7f94eaa00640 1 -- 172.21.15.8:0/254883612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 msgr2=0x55a09d7c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.195+0000 7f94eaa00640 1 --2- 172.21.15.8:0/254883612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 0x55a09d7c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.195+0000 7f94eaa00640 1 -- 172.21.15.8:0/254883612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7c5140 msgr2=0x55a09d7b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.195+0000 7f94eaa00640 1 --2- 172.21.15.8:0/254883612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7c5140 0x55a09d7b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.195+0000 7f94eaa00640 1 -- 172.21.15.8:0/254883612 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09d6bdab0 con 0x55a09d7bc560 2024-03-16T21:01:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.195+0000 7f94ebe00640 1 --2- 172.21.15.8:0/254883612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7c5140 0x55a09d7b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:01:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.195+0000 7f94eaa00640 1 --2- 172.21.15.8:0/254883612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7c29a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f94d4001eb0 tx=0x7f94d4010b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fecf4566b8719c48 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.195+0000 7f94dbe00640 1 -- 172.21.15.8:0/254883612 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4015040 con 0x55a09d7bc560 2024-03-16T21:01:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.195+0000 7f94dbe00640 1 -- 172.21.15.8:0/254883612 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f94d400fcf0 con 0x55a09d7bc560 2024-03-16T21:01:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.195+0000 7f94dbe00640 1 -- 172.21.15.8:0/254883612 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4022d90 con 0x55a09d7bc560 2024-03-16T21:01:33.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.196+0000 7f94f5229740 1 -- 172.21.15.8:0/254883612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 msgr2=0x55a09d7c29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:33.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.196+0000 7f94f5229740 1 --2- 172.21.15.8:0/254883612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7c29a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f94d4001eb0 tx=0x7f94d4010b00 comp rx=0 tx=0).stop 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.196+0000 7f94f5229740 1 -- 172.21.15.8:0/254883612 shutdown_connections 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.196+0000 7f94f5229740 1 --2- 172.21.15.8:0/254883612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7c5140 0x55a09d7b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.196+0000 7f94f5229740 1 --2- 172.21.15.8:0/254883612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7c29a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.196+0000 7f94f5229740 1 --2- 172.21.15.8:0/254883612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7bbc40 0x55a09d7c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.196+0000 7f94f5229740 1 -- 172.21.15.8:0/254883612 >> 172.21.15.8:0/254883612 conn(0x55a09d7b6370 msgr2=0x55a09d7b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.196+0000 7f94f5229740 1 -- 172.21.15.8:0/254883612 shutdown_connections 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.196+0000 7f94f5229740 1 -- 172.21.15.8:0/254883612 wait complete. 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.197+0000 7f94f5229740 1 -- start start 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.197+0000 7f94f5229740 1 Processor -- start 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.197+0000 7f94f5229740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7bbc40 0x55a09d7bf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.197+0000 7f94f5229740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.197+0000 7f94f5229740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7c5140 0x55a09d829b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.197+0000 7f94f5229740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d82a0c0 con 0x55a09d7bbc40 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.197+0000 7f94f5229740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d82a200 con 0x55a09d7bc560 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.197+0000 7f94f5229740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09d82a3c0 con 0x55a09d7c5140 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.197+0000 7f94f5229740 10 client.0 _ll_register_callbacks cb 0x7f94d400abc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94eaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94eaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7bf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45532/0 (socket says 172.21.15.8:45532) 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94eaa00640 1 -- 172.21.15.8:0/502214625 learned_addr learned my addr 172.21.15.8:0/502214625 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94ebe00640 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7bbc40 0x55a09d7bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94ebe00640 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7c5140 0x55a09d829b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94eaa00640 1 -- 172.21.15.8:0/502214625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7c5140 msgr2=0x55a09d829b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94eaa00640 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7c5140 0x55a09d829b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94eaa00640 1 -- 172.21.15.8:0/502214625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7bbc40 msgr2=0x55a09d7bf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94eaa00640 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7bbc40 0x55a09d7bf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94eaa00640 1 -- 172.21.15.8:0/502214625 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a09d7215a0 con 0x55a09d7bc560 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94eaa00640 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7bf5c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f94d4019d30 tx=0x7f94d4019d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d521677cb3a04c3e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.198+0000 7f94d9600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94d9600640 1 -- 172.21.15.8:0/502214625 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4015040 con 0x55a09d7bc560 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94f5229740 1 -- 172.21.15.8:0/502214625 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f94e4003e70 con 0x55a09d7bc560 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94d9600640 1 -- 172.21.15.8:0/502214625 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f94d4000e40 con 0x55a09d7bc560 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94d9600640 1 -- 172.21.15.8:0/502214625 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94d4019600 con 0x55a09d7bc560 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94f5229740 10 client.26411 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94f5229740 1 -- 172.21.15.8:0/502214625 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55a09d6e3650 con 0x55a09d7bc560 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94d9600640 1 -- 172.21.15.8:0/502214625 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f94e4003e70 con 0x55a09d7bc560 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94d9600640 1 -- 172.21.15.8:0/502214625 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f94d4033790 con 0x55a09d7bc560 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94f5229740 10 client.26411 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94f5229740 10 client.26411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94f5229740 20 client.26411 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:33.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94f5229740 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a09d831aa0 0x55a09d833ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:33.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94f5229740 4 client.26411 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:01:33.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.199+0000 7f94f5229740 1 -- 172.21.15.8:0/502214625 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a09d4ae890 con 0x55a09d831aa0 2024-03-16T21:01:33.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.200+0000 7f94ebe00640 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a09d831aa0 0x55a09d833ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:33.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.200+0000 7f94ebe00640 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a09d831aa0 0x55a09d833ec0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bb108ac989d6711 server_cookie=88a40aa770e1229f in_seq=0 out_seq=0 2024-03-16T21:01:33.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.200+0000 7f94d9600640 10 client.26411 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:33.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.200+0000 7f94d9600640 1 -- 172.21.15.8:0/502214625 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a09d4ae890 con 0x55a09d831aa0 2024-03-16T21:01:33.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.200+0000 7f94d9600640 10 client.26411 handle_command_reply: tid=0 2024-03-16T21:01:33.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.200+0000 7f94f5229740 1 client.26411 shutdown 2024-03-16T21:01:33.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.200+0000 7f94f5229740 1 -- 172.21.15.8:0/502214625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 msgr2=0x55a09d7bf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:33.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.200+0000 7f94f5229740 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7bf5c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f94d4019d30 tx=0x7f94d4019d60 comp rx=0 tx=0).stop 2024-03-16T21:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f5229740 1 -- 172.21.15.8:0/502214625 shutdown_connections 2024-03-16T21:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f5229740 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a09d7c5140 0x55a09d829b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f5229740 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a09d7bc560 0x55a09d7bf5c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f5229740 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a09d831aa0 0x55a09d833ec0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f5229740 1 --2- 172.21.15.8:0/502214625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a09d7bbc40 0x55a09d7bf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f5229740 1 -- 172.21.15.8:0/502214625 >> 172.21.15.8:0/502214625 conn(0x55a09d7b6370 msgr2=0x55a09d7b5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94d9600640 0 client.26411 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f5229740 1 -- 172.21.15.8:0/502214625 shutdown_connections 2024-03-16T21:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f5229740 1 -- 172.21.15.8:0/502214625 wait complete. 2024-03-16T21:01:33.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f5229740 20 client.26411 trim_cache size 0 max 16384 2024-03-16T21:01:33.211 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:01:33.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f2600640 1 -- 172.21.15.8:0/4263812320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94d00a1c20 msgr2=0x7f94d00a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:33.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f2600640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94d00a1c20 0x7f94d00a40e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55a09d7bb710 tx=0x7f94dc0f3670 comp rx=0 tx=0).stop 2024-03-16T21:01:33.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f2600640 1 -- 172.21.15.8:0/4263812320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94ec1014a0 msgr2=0x7f94ec19f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:33.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.201+0000 7f94f2600640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94ec1014a0 0x7f94ec19f940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f94dc036040 tx=0x7f94dc02cc10 comp rx=0 tx=0).stop 2024-03-16T21:01:33.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.202+0000 7f94f2600640 1 -- 172.21.15.8:0/4263812320 shutdown_connections 2024-03-16T21:01:33.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.202+0000 7f94f2600640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94d00a1c20 0x7f94d00a40e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.202+0000 7f94f2600640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94ec107560 0x7f94ec199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.202+0000 7f94f2600640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94ec101e60 0x7f94ec19fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.202+0000 7f94f2600640 1 --2- 172.21.15.8:0/4263812320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94ec1014a0 0x7f94ec19f940 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:33.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.202+0000 7f94f2600640 1 -- 172.21.15.8:0/4263812320 >> 172.21.15.8:0/4263812320 conn(0x7f94ec0788f0 msgr2=0x7f94ec0ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:33.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.202+0000 7f94f2600640 1 -- 172.21.15.8:0/4263812320 shutdown_connections 2024-03-16T21:01:33.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:33.202+0000 7f94f2600640 1 -- 172.21.15.8:0/4263812320 wait complete. 2024-03-16T21:01:33.222 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:33 smithi008 ceph-mon[31434]: pgmap v114: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:01:33.222 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:33 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2378803350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:01:33.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:33 smithi170 ceph-mon[35947]: pgmap v114: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:01:33.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:33 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2378803350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:01:33.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:33 smithi186 ceph-mon[36391]: pgmap v114: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:01:33.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:33 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2378803350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:01:34.225 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:01:34.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:01:34.225 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:01:34.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.462+0000 7f7d67200640 1 -- 172.21.15.8:0/113452654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d6810d9d0 msgr2=0x7f7d6810ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.462+0000 7f7d67200640 1 --2- 172.21.15.8:0/113452654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d6810d9d0 0x7f7d6810ddb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009900 tx=0x7f7d5802bcd0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.462+0000 7f7d67200640 1 -- 172.21.15.8:0/113452654 shutdown_connections 2024-03-16T21:01:34.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.462+0000 7f7d67200640 1 --2- 172.21.15.8:0/113452654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d681083d0 0x7f7d68114820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.462+0000 7f7d67200640 1 --2- 172.21.15.8:0/113452654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d68107a30 0x7f7d68107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.462+0000 7f7d67200640 1 --2- 172.21.15.8:0/113452654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d6810d9d0 0x7f7d6810ddb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.462+0000 7f7d67200640 1 -- 172.21.15.8:0/113452654 >> 172.21.15.8:0/113452654 conn(0x7f7d68077310 msgr2=0x7f7d68106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.463+0000 7f7d67200640 1 -- 172.21.15.8:0/113452654 shutdown_connections 2024-03-16T21:01:34.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.463+0000 7f7d67200640 1 -- 172.21.15.8:0/113452654 wait complete. 2024-03-16T21:01:34.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.464+0000 7f7d67200640 1 Processor -- start 2024-03-16T21:01:34.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.464+0000 7f7d67200640 1 -- start start 2024-03-16T21:01:34.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d67200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d68107a30 0x7f7d6819e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d67200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d681083d0 0x7f7d6819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d67200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d6810d9d0 0x7f7d681a2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d67200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d681a2f30 con 0x7f7d68107a30 2024-03-16T21:01:34.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d67200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d681a30a0 con 0x7f7d6810d9d0 2024-03-16T21:01:34.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d67200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d681a3260 con 0x7f7d681083d0 2024-03-16T21:01:34.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d68107a30 0x7f7d6819e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d68107a30 0x7f7d6819e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37822/0 (socket says 172.21.15.8:37822) 2024-03-16T21:01:34.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d65e00640 1 -- 172.21.15.8:0/3486436284 learned_addr learned my addr 172.21.15.8:0/3486436284 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:34.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d65400640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d681083d0 0x7f7d6819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d66800640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d6810d9d0 0x7f7d681a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d65e00640 1 -- 172.21.15.8:0/3486436284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d681083d0 msgr2=0x7f7d6819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d65e00640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d681083d0 0x7f7d6819e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d65e00640 1 -- 172.21.15.8:0/3486436284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d6810d9d0 msgr2=0x7f7d681a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d65e00640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d6810d9d0 0x7f7d681a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.465+0000 7f7d65e00640 1 -- 172.21.15.8:0/3486436284 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d58009560 con 0x7f7d68107a30 2024-03-16T21:01:34.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.466+0000 7f7d65e00640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d68107a30 0x7f7d6819e0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7d58000c00 tx=0x7f7d58004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.466+0000 7f7d5ea00640 1 -- 172.21.15.8:0/3486436284 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5802cb60 con 0x7f7d68107a30 2024-03-16T21:01:34.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.466+0000 7f7d5ea00640 1 -- 172.21.15.8:0/3486436284 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7d5802ccc0 con 0x7f7d68107a30 2024-03-16T21:01:34.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.466+0000 7f7d67200640 1 -- 172.21.15.8:0/3486436284 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d681a34e0 con 0x7f7d68107a30 2024-03-16T21:01:34.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.466+0000 7f7d5ea00640 1 -- 172.21.15.8:0/3486436284 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d58003bb0 con 0x7f7d68107a30 2024-03-16T21:01:34.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.466+0000 7f7d67200640 1 -- 172.21.15.8:0/3486436284 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d681aadc0 con 0x7f7d68107a30 2024-03-16T21:01:34.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.469+0000 7f7d5ea00640 1 -- 172.21.15.8:0/3486436284 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7d58003d10 con 0x7f7d68107a30 2024-03-16T21:01:34.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d6f9fe740 1 Processor -- start 2024-03-16T21:01:34.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d6f9fe740 1 -- start start 2024-03-16T21:01:34.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be45184f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518a30 0x555be45210d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be4523a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be44d3300 con 0x555be4518110 2024-03-16T21:01:34.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be4485e50 con 0x555be4521610 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be4483380 con 0x555be4518a30 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d65400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be4523a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518a30 0x555be45210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d66800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be45184f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d65400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be4523a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45564/0 (socket says 172.21.15.8:45564) 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.470+0000 7f7d65400640 1 -- 172.21.15.8:0/3722218168 learned_addr learned my addr 172.21.15.8:0/3722218168 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.471+0000 7f7d65400640 1 -- 172.21.15.8:0/3722218168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518a30 msgr2=0x555be45210d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.471+0000 7f7d65400640 1 --2- 172.21.15.8:0/3722218168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518a30 0x555be45210d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.471+0000 7f7d65400640 1 -- 172.21.15.8:0/3722218168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 msgr2=0x555be45184f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.471+0000 7f7d65400640 1 --2- 172.21.15.8:0/3722218168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be45184f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.471+0000 7f7d65400640 1 -- 172.21.15.8:0/3722218168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555be4447c80 con 0x555be4521610 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.471+0000 7f7d5ea00640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7d4c0a1ba0 0x7f7d4c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.471+0000 7f7d65400640 1 --2- 172.21.15.8:0/3722218168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be4523a00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009c90 tx=0x7f7d54011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53be65d8a3289694 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.471+0000 7f7d5ea00640 1 -- 172.21.15.8:0/3486436284 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7d580ef8f0 con 0x7f7d68107a30 2024-03-16T21:01:34.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.471+0000 7f7d66800640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7d4c0a1ba0 0x7f7d4c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.471+0000 7f7d53400640 1 -- 172.21.15.8:0/3722218168 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54019630 con 0x555be4521610 2024-03-16T21:01:34.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.472+0000 7f7d53400640 1 -- 172.21.15.8:0/3722218168 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7d54019c90 con 0x555be4521610 2024-03-16T21:01:34.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.472+0000 7f7d53400640 1 -- 172.21.15.8:0/3722218168 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400eca0 con 0x555be4521610 2024-03-16T21:01:34.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.472+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3722218168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 msgr2=0x555be4523a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.472+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3722218168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be4523a00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009c90 tx=0x7f7d54011810 comp rx=0 tx=0).stop 2024-03-16T21:01:34.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.472+0000 7f7d66800640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7d4c0a1ba0 0x7f7d4c0a4060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7d60005fd0 tx=0x7f7d60009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.472+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3722218168 shutdown_connections 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.472+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3722218168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be4523a00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.472+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3722218168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518a30 0x555be45210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.472+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3722218168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be45184f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.473+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3722218168 >> 172.21.15.8:0/3722218168 conn(0x555be4512840 msgr2=0x555be4512c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.473+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3722218168 shutdown_connections 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.473+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3722218168 wait complete. 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.473+0000 7f7d6f9fe740 1 -- start start 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.473+0000 7f7d6f9fe740 1 Processor -- start 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be451e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4518a30 0x555be451ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4521610 0x555be451f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be447eb60 con 0x555be4518110 2024-03-16T21:01:34.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be4423fd0 con 0x555be4518a30 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be4423c70 con 0x555be4521610 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d6f9fe740 10 client.0 _ll_register_callbacks cb 0x555be418fc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be451e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d65400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4518a30 0x555be451ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be451e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37828/0 (socket says 172.21.15.8:37828) 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d65e00640 1 -- 172.21.15.8:0/3065390719 learned_addr learned my addr 172.21.15.8:0/3065390719 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d65400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4518a30 0x555be451ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45580/0 (socket says 172.21.15.8:45580) 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d66800640 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4521610 0x555be451f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d65e00640 1 -- 172.21.15.8:0/3065390719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4521610 msgr2=0x555be451f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d65e00640 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4521610 0x555be451f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d65e00640 1 -- 172.21.15.8:0/3065390719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4518a30 msgr2=0x555be451ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.474+0000 7f7d65e00640 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4518a30 0x555be451ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.475+0000 7f7d65e00640 1 -- 172.21.15.8:0/3065390719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d540098f0 con 0x555be4518110 2024-03-16T21:01:34.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.475+0000 7f7d65e00640 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be451e670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d58005ec0 tx=0x7f7d58005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8031455244b94ebd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.475+0000 7f7d47e00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.475+0000 7f7d47e00640 1 -- 172.21.15.8:0/3065390719 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580bc140 con 0x555be4518110 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.475+0000 7f7d47e00640 1 -- 172.21.15.8:0/3065390719 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7d580bcd00 con 0x555be4518110 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.475+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3065390719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555be417e860 con 0x555be4518110 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.475+0000 7f7d47e00640 1 -- 172.21.15.8:0/3065390719 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d580bbf60 con 0x555be4518110 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.475+0000 7f7d6f9fe740 10 client.16254 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.475+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3065390719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555be447d1e0 con 0x555be4518110 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.476+0000 7f7d47e00640 1 -- 172.21.15.8:0/3065390719 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x555be417e860 con 0x555be4518110 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.476+0000 7f7d47e00640 1 -- 172.21.15.8:0/3065390719 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f7d5803c070 con 0x555be4518110 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.476+0000 7f7d6f9fe740 10 client.16254 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.476+0000 7f7d6f9fe740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.476+0000 7f7d6f9fe740 20 client.16254 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.476+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x555be45317d0 0x555be4533bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.476+0000 7f7d6f9fe740 4 client.16254 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:01:34.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.476+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3065390719 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555be41cf410 con 0x555be45317d0 2024-03-16T21:01:34.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.476+0000 7f7d65400640 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x555be45317d0 0x555be4533bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.477+0000 7f7d65400640 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x555be45317d0 0x555be4533bf0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6af0c6089ef14de5 server_cookie=a674e02d6c82cd96 in_seq=0 out_seq=0 2024-03-16T21:01:34.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.477+0000 7f7d47e00640 10 client.16254 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:34.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d47e00640 1 -- 172.21.15.8:0/3065390719 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x555be41cf410 con 0x555be45317d0 2024-03-16T21:01:34.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d47e00640 10 client.16254 handle_command_reply: tid=0 2024-03-16T21:01:34.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d6f9fe740 1 client.16254 shutdown 2024-03-16T21:01:34.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3065390719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 msgr2=0x555be451e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be451e670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d58005ec0 tx=0x7f7d58005c00 comp rx=0 tx=0).stop 2024-03-16T21:01:34.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3065390719 shutdown_connections 2024-03-16T21:01:34.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4521610 0x555be451f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4518a30 0x555be451ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x555be45317d0 0x555be4533bf0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3065390719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be451e670 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3065390719 >> 172.21.15.8:0/3065390719 conn(0x555be4512840 msgr2=0x555be4514590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d47e00640 0 client.16254 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3065390719 shutdown_connections 2024-03-16T21:01:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.478+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3065390719 wait complete. 2024-03-16T21:01:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.479+0000 7f7d6f9fe740 20 client.16254 trim_cache size 0 max 16384 2024-03-16T21:01:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.496+0000 7f7d6f9fe740 1 Processor -- start 2024-03-16T21:01:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d6f9fe740 1 -- start start 2024-03-16T21:01:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be4520da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518a30 0x555be451ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be451f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be45193b0 con 0x555be4518110 2024-03-16T21:01:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be41c70c0 con 0x555be4521610 2024-03-16T21:01:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be4513840 con 0x555be4518a30 2024-03-16T21:01:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be4520da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d65400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518a30 0x555be451ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be4520da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37832/0 (socket says 172.21.15.8:37832) 2024-03-16T21:01:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d65e00640 1 -- 172.21.15.8:0/3900680061 learned_addr learned my addr 172.21.15.8:0/3900680061 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.497+0000 7f7d66800640 1 --2- 172.21.15.8:0/3900680061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be451f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.498+0000 7f7d65e00640 1 -- 172.21.15.8:0/3900680061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518a30 msgr2=0x555be451ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.498+0000 7f7d65e00640 1 --2- 172.21.15.8:0/3900680061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518a30 0x555be451ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.498+0000 7f7d65e00640 1 -- 172.21.15.8:0/3900680061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 msgr2=0x555be451f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.498+0000 7f7d65e00640 1 --2- 172.21.15.8:0/3900680061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be451f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.498+0000 7f7d65e00640 1 -- 172.21.15.8:0/3900680061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555be4419a90 con 0x555be4518110 2024-03-16T21:01:34.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.498+0000 7f7d65400640 1 --2- 172.21.15.8:0/3900680061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518a30 0x555be451ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:34.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.498+0000 7f7d65e00640 1 --2- 172.21.15.8:0/3900680061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be4520da0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7d58006010 tx=0x7f7d5802bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9be345a85f55f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.498+0000 7f7d52a00640 1 -- 172.21.15.8:0/3900680061 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580ed4c0 con 0x555be4518110 2024-03-16T21:01:34.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.498+0000 7f7d52a00640 1 -- 172.21.15.8:0/3900680061 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7d580f5020 con 0x555be4518110 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.498+0000 7f7d52a00640 1 -- 172.21.15.8:0/3900680061 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580c4e30 con 0x555be4518110 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.499+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3900680061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 msgr2=0x555be4520da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.499+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3900680061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be4520da0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7d58006010 tx=0x7f7d5802bcd0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.499+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3900680061 shutdown_connections 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.499+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3900680061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be451f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.499+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3900680061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518a30 0x555be451ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.499+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/3900680061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518110 0x555be4520da0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.499+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3900680061 >> 172.21.15.8:0/3900680061 conn(0x555be4512840 msgr2=0x555be4514500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.499+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3900680061 shutdown_connections 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.499+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/3900680061 wait complete. 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.499+0000 7f7d6f9fe740 1 -- start start 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.499+0000 7f7d6f9fe740 1 Processor -- start 2024-03-16T21:01:34.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518110 0x555be451b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518a30 0x555be451bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d6f9fe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be4528810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be4528d50 con 0x555be4518a30 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be4528ec0 con 0x555be4521610 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d6f9fe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be4529080 con 0x555be4518110 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d6f9fe740 10 client.0 _ll_register_callbacks cb 0x7f7d58009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d65400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518a30 0x555be451bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518110 0x555be451b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d66800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be4528810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518110 0x555be451b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48808/0 (socket says 172.21.15.8:48808) 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.500+0000 7f7d65e00640 1 -- 172.21.15.8:0/4257192224 learned_addr learned my addr 172.21.15.8:0/4257192224 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d65e00640 1 -- 172.21.15.8:0/4257192224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 msgr2=0x555be4528810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d65e00640 1 --2- 172.21.15.8:0/4257192224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be4528810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d65e00640 1 -- 172.21.15.8:0/4257192224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518a30 msgr2=0x555be451bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d65e00640 1 --2- 172.21.15.8:0/4257192224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518a30 0x555be451bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d65e00640 1 -- 172.21.15.8:0/4257192224 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555be4447c80 con 0x555be4518110 2024-03-16T21:01:34.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d65e00640 1 --2- 172.21.15.8:0/4257192224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518110 0x555be451b6b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7d58005ab0 tx=0x7f7d580f5620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=706f25796051ca7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d47e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:01:34.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d47e00640 1 -- 172.21.15.8:0/4257192224 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580bbf60 con 0x555be4518110 2024-03-16T21:01:34.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d47e00640 1 -- 172.21.15.8:0/4257192224 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7d580bcd00 con 0x555be4518110 2024-03-16T21:01:34.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/4257192224 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d54019c90 con 0x555be4518110 2024-03-16T21:01:34.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d47e00640 1 -- 172.21.15.8:0/4257192224 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d580bc140 con 0x555be4518110 2024-03-16T21:01:34.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d6f9fe740 10 client.26431 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:34.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/4257192224 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555be447d1e0 con 0x555be4518110 2024-03-16T21:01:34.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.501+0000 7f7d47e00640 1 -- 172.21.15.8:0/4257192224 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7d54019c90 con 0x555be4518110 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.502+0000 7f7d47e00640 1 -- 172.21.15.8:0/4257192224 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f7d5803c070 con 0x555be4518110 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.502+0000 7f7d6f9fe740 10 client.26431 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.502+0000 7f7d6f9fe740 10 client.26431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.502+0000 7f7d6f9fe740 20 client.26431 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.502+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/4257192224 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x555be458dd90 0x555be4590180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.502+0000 7f7d6f9fe740 4 client.26431 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.502+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/4257192224 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555be41bb7b0 con 0x555be458dd90 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.502+0000 7f7d65400640 1 --2- 172.21.15.8:0/4257192224 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x555be458dd90 0x555be4590180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.502+0000 7f7d65400640 1 --2- 172.21.15.8:0/4257192224 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x555be458dd90 0x555be4590180 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d812b33e073e203 server_cookie=30dc4ff9dc9cc1af in_seq=0 out_seq=0 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.502+0000 7f7d47e00640 10 client.26431 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.503+0000 7f7d47e00640 1 -- 172.21.15.8:0/4257192224 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555be41bb7b0 con 0x555be458dd90 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.503+0000 7f7d47e00640 10 client.26431 handle_command_reply: tid=0 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.503+0000 7f7d6f9fe740 1 client.26431 shutdown 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.503+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/4257192224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518110 msgr2=0x555be451b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.503+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/4257192224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518110 0x555be451b6b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7d58005ab0 tx=0x7f7d580f5620 comp rx=0 tx=0).stop 2024-03-16T21:01:34.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.504+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/4257192224 shutdown_connections 2024-03-16T21:01:34.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.504+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/4257192224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555be4521610 0x555be4528810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.504+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/4257192224 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x555be458dd90 0x555be4590180 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.504+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/4257192224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555be4518a30 0x555be451bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.504+0000 7f7d6f9fe740 1 --2- 172.21.15.8:0/4257192224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555be4518110 0x555be451b6b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.504+0000 7f7d47e00640 0 client.26431 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:34.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.504+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/4257192224 >> 172.21.15.8:0/4257192224 conn(0x555be4512840 msgr2=0x555be4513c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.504+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/4257192224 shutdown_connections 2024-03-16T21:01:34.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.504+0000 7f7d6f9fe740 1 -- 172.21.15.8:0/4257192224 wait complete. 2024-03-16T21:01:34.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.504+0000 7f7d6f9fe740 20 client.26431 trim_cache size 0 max 16384 2024-03-16T21:01:34.512 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:01:34.513 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:01:34.513 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "0a71ac3e-0fe2-49a5-9165-6e45ec9b56e7", 2024-03-16T21:01:34.513 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:01:34.513 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:01:34.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 -- 172.21.15.8:0/3486436284 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7d4c0a1ba0 msgr2=0x7f7d4c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7d4c0a1ba0 0x7f7d4c0a4060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7d60005fd0 tx=0x7f7d60009500 comp rx=0 tx=0).stop 2024-03-16T21:01:34.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 -- 172.21.15.8:0/3486436284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d68107a30 msgr2=0x7f7d6819e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d68107a30 0x7f7d6819e0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7d58000c00 tx=0x7f7d58004390 comp rx=0 tx=0).stop 2024-03-16T21:01:34.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 -- 172.21.15.8:0/3486436284 shutdown_connections 2024-03-16T21:01:34.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7d4c0a1ba0 0x7f7d4c0a4060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d6810d9d0 0x7f7d681a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d681083d0 0x7f7d6819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 --2- 172.21.15.8:0/3486436284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d68107a30 0x7f7d6819e0c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 -- 172.21.15.8:0/3486436284 >> 172.21.15.8:0/3486436284 conn(0x7f7d68077310 msgr2=0x7f7d680782c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 -- 172.21.15.8:0/3486436284 shutdown_connections 2024-03-16T21:01:34.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.505+0000 7f7d67200640 1 -- 172.21.15.8:0/3486436284 wait complete. 2024-03-16T21:01:34.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:01:34.527 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:01:34.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.733+0000 7f2e37000640 1 -- 172.21.15.8:0/1850939086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e30108450 msgr2=0x7f2e30114960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.733+0000 7f2e37000640 1 --2- 172.21.15.8:0/1850939086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e30108450 0x7f2e30114960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009cd0 tx=0x7f2e2802c0e0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.734+0000 7f2e37000640 1 -- 172.21.15.8:0/1850939086 shutdown_connections 2024-03-16T21:01:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.734+0000 7f2e37000640 1 --2- 172.21.15.8:0/1850939086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e30108450 0x7f2e30114960 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.734+0000 7f2e37000640 1 --2- 172.21.15.8:0/1850939086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30107a90 0x7f2e30107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.734+0000 7f2e37000640 1 --2- 172.21.15.8:0/1850939086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e3010daa0 0x7f2e3010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.734+0000 7f2e37000640 1 -- 172.21.15.8:0/1850939086 >> 172.21.15.8:0/1850939086 conn(0x7f2e30075a30 msgr2=0x7f2e30077e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.734+0000 7f2e37000640 1 -- 172.21.15.8:0/1850939086 shutdown_connections 2024-03-16T21:01:34.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.734+0000 7f2e37000640 1 -- 172.21.15.8:0/1850939086 wait complete. 2024-03-16T21:01:34.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e37000640 1 Processor -- start 2024-03-16T21:01:34.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e37000640 1 -- start start 2024-03-16T21:01:34.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e37000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30107a90 0x7f2e3019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e37000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e30108450 0x7f2e3019e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e37000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e3010daa0 0x7f2e301a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e37000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301a30e0 con 0x7f2e30107a90 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e37000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301a3250 con 0x7f2e3010daa0 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e37000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301a3410 con 0x7f2e30108450 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e2fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30107a90 0x7f2e3019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e35000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e3010daa0 0x7f2e301a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e27400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e30108450 0x7f2e3019e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.735+0000 7f2e2fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30107a90 0x7f2e3019e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37848/0 (socket says 172.21.15.8:37848) 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.736+0000 7f2e2fe00640 1 -- 172.21.15.8:0/1995441105 learned_addr learned my addr 172.21.15.8:0/1995441105 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.736+0000 7f2e27400640 1 -- 172.21.15.8:0/1995441105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e3010daa0 msgr2=0x7f2e301a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.736+0000 7f2e27400640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e3010daa0 0x7f2e301a2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.736+0000 7f2e27400640 1 -- 172.21.15.8:0/1995441105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30107a90 msgr2=0x7f2e3019e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.736+0000 7f2e27400640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30107a90 0x7f2e3019e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.736+0000 7f2e27400640 1 -- 172.21.15.8:0/1995441105 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e28009900 con 0x7f2e30108450 2024-03-16T21:01:34.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.736+0000 7f2e2fe00640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30107a90 0x7f2e3019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:34.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.736+0000 7f2e27400640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e30108450 0x7f2e3019e760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800e9f0 tx=0x7f2e1800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.736+0000 7f2e2d600640 1 -- 172.21.15.8:0/1995441105 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800ccc0 con 0x7f2e30108450 2024-03-16T21:01:34.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.737+0000 7f2e37000640 1 -- 172.21.15.8:0/1995441105 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e301a36f0 con 0x7f2e30108450 2024-03-16T21:01:34.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.737+0000 7f2e2d600640 1 -- 172.21.15.8:0/1995441105 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2e1800ce20 con 0x7f2e30108450 2024-03-16T21:01:34.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.737+0000 7f2e2d600640 1 -- 172.21.15.8:0/1995441105 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e180189c0 con 0x7f2e30108450 2024-03-16T21:01:34.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.737+0000 7f2e37000640 1 -- 172.21.15.8:0/1995441105 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e301aaf70 con 0x7f2e30108450 2024-03-16T21:01:34.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.741+0000 7f2e39dc6740 1 Processor -- start 2024-03-16T21:01:34.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.741+0000 7f2e39dc6740 1 -- start start 2024-03-16T21:01:34.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e2d600640 1 -- 172.21.15.8:0/1995441105 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f2e18018b20 con 0x7f2e30108450 2024-03-16T21:01:34.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d8827bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827c2c0 0x561d8827c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 0x561d88287a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d881eb150 con 0x561d8827cfa0 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d881e8680 con 0x561d88285630 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d881e3e60 con 0x561d8827c2c0 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e35000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d8827bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e35000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d8827bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37854/0 (socket says 172.21.15.8:37854) 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e35000640 1 -- 172.21.15.8:0/861247839 learned_addr learned my addr 172.21.15.8:0/861247839 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e2fe00640 1 --2- 172.21.15.8:0/861247839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827c2c0 0x561d8827c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.742+0000 7f2e27400640 1 --2- 172.21.15.8:0/861247839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 0x561d88287a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e35000640 1 -- 172.21.15.8:0/861247839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827c2c0 msgr2=0x561d8827c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e35000640 1 --2- 172.21.15.8:0/861247839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827c2c0 0x561d8827c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e35000640 1 -- 172.21.15.8:0/861247839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 msgr2=0x561d88287a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e35000640 1 --2- 172.21.15.8:0/861247839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 0x561d88287a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e35000640 1 -- 172.21.15.8:0/861247839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d8819d060 con 0x561d8827cfa0 2024-03-16T21:01:34.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e2fe00640 1 --2- 172.21.15.8:0/861247839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827c2c0 0x561d8827c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:34.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e27400640 1 --2- 172.21.15.8:0/861247839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 0x561d88287a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:34.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e35000640 1 --2- 172.21.15.8:0/861247839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d8827bcf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e28004af0 tx=0x7f2e28005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df05671c3b6ca52 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e25600640 1 -- 172.21.15.8:0/861247839 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28032540 con 0x561d8827cfa0 2024-03-16T21:01:34.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e25600640 1 -- 172.21.15.8:0/861247839 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2e28034ab0 con 0x561d8827cfa0 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e25600640 1 -- 172.21.15.8:0/861247839 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28003b70 con 0x561d8827cfa0 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.743+0000 7f2e2d600640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2e140a1c20 0x7f2e140a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.744+0000 7f2e2d600640 1 -- 172.21.15.8:0/1995441105 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2e18014070 con 0x7f2e30108450 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.744+0000 7f2e2fe00640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2e140a1c20 0x7f2e140a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.744+0000 7f2e39dc6740 1 -- 172.21.15.8:0/861247839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 msgr2=0x561d8827bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.744+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/861247839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d8827bcf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e28004af0 tx=0x7f2e28005f80 comp rx=0 tx=0).stop 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.744+0000 7f2e39dc6740 1 -- 172.21.15.8:0/861247839 shutdown_connections 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.744+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/861247839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 0x561d88287a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.744+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/861247839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827c2c0 0x561d8827c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.744+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/861247839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d8827bcf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.744+0000 7f2e39dc6740 1 -- 172.21.15.8:0/861247839 >> 172.21.15.8:0/861247839 conn(0x561d882435a0 msgr2=0x561d88276d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.744+0000 7f2e39dc6740 1 -- 172.21.15.8:0/861247839 shutdown_connections 2024-03-16T21:01:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.744+0000 7f2e39dc6740 1 -- 172.21.15.8:0/861247839 wait complete. 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.745+0000 7f2e2fe00640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2e140a1c20 0x7f2e140a40e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x561d8827d4f0 tx=0x7f2e2000b480 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.745+0000 7f2e39dc6740 1 -- start start 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.745+0000 7f2e39dc6740 1 Processor -- start 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.745+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827c2c0 0x561d882825d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.745+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827cfa0 0x561d88282b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.745+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d88285630 0x561d88283050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.745+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d88188ec0 con 0x561d8827c2c0 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.745+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d88188b60 con 0x561d8827cfa0 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.745+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d87f521c0 con 0x561d88285630 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e39dc6740 10 client.0 _ll_register_callbacks cb 0x561d8819c960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e35000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d88285630 0x561d88283050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e2fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827c2c0 0x561d882825d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e27400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827cfa0 0x561d88282b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e35000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d88285630 0x561d88283050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48858/0 (socket says 172.21.15.8:48858) 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e35000640 1 -- 172.21.15.8:0/812744085 learned_addr learned my addr 172.21.15.8:0/812744085 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e35000640 1 -- 172.21.15.8:0/812744085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827cfa0 msgr2=0x561d88282b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e35000640 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827cfa0 0x561d88282b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e35000640 1 -- 172.21.15.8:0/812744085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827c2c0 msgr2=0x561d882825d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e35000640 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827c2c0 0x561d882825d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e35000640 1 -- 172.21.15.8:0/812744085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e30115260 con 0x561d88285630 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e27400640 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827cfa0 0x561d88282b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e35000640 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d88285630 0x561d88283050 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2e28032c30 tx=0x7f2e28032c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fe60dbd718853a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.746+0000 7f2e1e000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.747+0000 7f2e1e000640 1 -- 172.21.15.8:0/812744085 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28003970 con 0x561d88285630 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.747+0000 7f2e1e000640 1 -- 172.21.15.8:0/812744085 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2e2804e070 con 0x561d88285630 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.747+0000 7f2e39dc6740 1 -- 172.21.15.8:0/812744085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d87ee37e0 con 0x561d88285630 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.747+0000 7f2e1e000640 1 -- 172.21.15.8:0/812744085 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e28003ad0 con 0x561d88285630 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.747+0000 7f2e39dc6740 10 client.26443 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.747+0000 7f2e39dc6740 1 -- 172.21.15.8:0/812744085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x561d881e24e0 con 0x561d88285630 2024-03-16T21:01:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.747+0000 7f2e1e000640 1 -- 172.21.15.8:0/812744085 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x561d87ee37e0 con 0x561d88285630 2024-03-16T21:01:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.747+0000 7f2e1e000640 1 -- 172.21.15.8:0/812744085 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f2e28053510 con 0x561d88285630 2024-03-16T21:01:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.748+0000 7f2e39dc6740 10 client.26443 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.748+0000 7f2e39dc6740 10 client.26443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.748+0000 7f2e39dc6740 20 client.26443 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.748+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561d88295390 0x561d88297780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.748+0000 7f2e39dc6740 4 client.26443 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:01:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.748+0000 7f2e39dc6740 1 -- 172.21.15.8:0/812744085 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d87f20720 con 0x561d88295390 2024-03-16T21:01:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.748+0000 7f2e2fe00640 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561d88295390 0x561d88297780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.748+0000 7f2e2fe00640 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561d88295390 0x561d88297780 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b3e16b465b826 server_cookie=62200f53c51dd588 in_seq=0 out_seq=0 2024-03-16T21:01:34.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.748+0000 7f2e1e000640 10 client.26443 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:34.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e1e000640 1 -- 172.21.15.8:0/812744085 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561d87f20720 con 0x561d88295390 2024-03-16T21:01:34.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e1e000640 10 client.26443 handle_command_reply: tid=0 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e39dc6740 1 client.26443 shutdown 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e39dc6740 1 -- 172.21.15.8:0/812744085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d88285630 msgr2=0x561d88283050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d88285630 0x561d88283050 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2e28032c30 tx=0x7f2e28032c60 comp rx=0 tx=0).stop 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e39dc6740 1 -- 172.21.15.8:0/812744085 shutdown_connections 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d88285630 0x561d88283050 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827cfa0 0x561d88282b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561d88295390 0x561d88297780 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/812744085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827c2c0 0x561d882825d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e39dc6740 1 -- 172.21.15.8:0/812744085 >> 172.21.15.8:0/812744085 conn(0x561d882435a0 msgr2=0x561d88278a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.749+0000 7f2e1e000640 0 client.26443 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.750+0000 7f2e39dc6740 1 -- 172.21.15.8:0/812744085 shutdown_connections 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.750+0000 7f2e39dc6740 1 -- 172.21.15.8:0/812744085 wait complete. 2024-03-16T21:01:34.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.750+0000 7f2e39dc6740 20 client.26443 trim_cache size 0 max 16384 2024-03-16T21:01:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.767+0000 7f2e39dc6740 1 Processor -- start 2024-03-16T21:01:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.767+0000 7f2e39dc6740 1 -- start start 2024-03-16T21:01:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827c2c0 0x561d88282e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d88284400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 0x561d88290a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d87f20720 con 0x561d8827cfa0 2024-03-16T21:01:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d87ee37e0 con 0x561d88285630 2024-03-16T21:01:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8827bb30 con 0x561d8827c2c0 2024-03-16T21:01:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e27400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d88284400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e35000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 0x561d88290a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e27400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d88284400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37878/0 (socket says 172.21.15.8:37878) 2024-03-16T21:01:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e27400640 1 -- 172.21.15.8:0/3914855748 learned_addr learned my addr 172.21.15.8:0/3914855748 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e2fe00640 1 --2- 172.21.15.8:0/3914855748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827c2c0 0x561d88282e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e35000640 1 -- 172.21.15.8:0/3914855748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827c2c0 msgr2=0x561d88282e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e35000640 1 --2- 172.21.15.8:0/3914855748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827c2c0 0x561d88282e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e35000640 1 -- 172.21.15.8:0/3914855748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 msgr2=0x561d88284400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e35000640 1 --2- 172.21.15.8:0/3914855748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d88284400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e35000640 1 -- 172.21.15.8:0/3914855748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d8817e950 con 0x561d88285630 2024-03-16T21:01:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.768+0000 7f2e27400640 1 --2- 172.21.15.8:0/3914855748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d88284400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.769+0000 7f2e35000640 1 --2- 172.21.15.8:0/3914855748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 0x561d88290a40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009bf0 tx=0x7f2e28000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74de90bcac680c1c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.769+0000 7f2e24c00640 1 -- 172.21.15.8:0/3914855748 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28009540 con 0x561d88285630 2024-03-16T21:01:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.769+0000 7f2e24c00640 1 -- 172.21.15.8:0/3914855748 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2e28003e70 con 0x561d88285630 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.769+0000 7f2e24c00640 1 -- 172.21.15.8:0/3914855748 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e280042c0 con 0x561d88285630 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.769+0000 7f2e39dc6740 1 -- 172.21.15.8:0/3914855748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 msgr2=0x561d88290a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.769+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/3914855748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 0x561d88290a40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009bf0 tx=0x7f2e28000f40 comp rx=0 tx=0).stop 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.770+0000 7f2e39dc6740 1 -- 172.21.15.8:0/3914855748 shutdown_connections 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.770+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/3914855748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d88285630 0x561d88290a40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.770+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/3914855748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d8827cfa0 0x561d88284400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.770+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/3914855748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827c2c0 0x561d88282e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.770+0000 7f2e39dc6740 1 -- 172.21.15.8:0/3914855748 >> 172.21.15.8:0/3914855748 conn(0x561d882435a0 msgr2=0x561d88283cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.770+0000 7f2e39dc6740 1 -- 172.21.15.8:0/3914855748 shutdown_connections 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.770+0000 7f2e39dc6740 1 -- 172.21.15.8:0/3914855748 wait complete. 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.770+0000 7f2e39dc6740 1 -- start start 2024-03-16T21:01:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.770+0000 7f2e39dc6740 1 Processor -- start 2024-03-16T21:01:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827c2c0 0x561d88285e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827cfa0 0x561d88286380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e39dc6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d88285630 0x561d882868c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8828c6f0 con 0x561d88285630 2024-03-16T21:01:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8828c860 con 0x561d8827c2c0 2024-03-16T21:01:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e39dc6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8828ca20 con 0x561d8827cfa0 2024-03-16T21:01:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e39dc6740 10 client.0 _ll_register_callbacks cb 0x7f2e28009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:01:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e27400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827cfa0 0x561d88286380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e2fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827c2c0 0x561d88285e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e35000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d88285630 0x561d882868c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e27400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827cfa0 0x561d88286380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:48878/0 (socket says 172.21.15.8:48878) 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e27400640 1 -- 172.21.15.8:0/1701229077 learned_addr learned my addr 172.21.15.8:0/1701229077 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e27400640 1 -- 172.21.15.8:0/1701229077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827c2c0 msgr2=0x561d88285e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e27400640 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827c2c0 0x561d88285e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e27400640 1 -- 172.21.15.8:0/1701229077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d88285630 msgr2=0x561d882868c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e27400640 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d88285630 0x561d882868c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e27400640 1 -- 172.21.15.8:0/1701229077 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e301a36f0 con 0x561d8827cfa0 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.771+0000 7f2e2fe00640 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827c2c0 0x561d88285e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e27400640 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827cfa0 0x561d88286380 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2e1809a400 tx=0x7f2e180d3550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1106050f8054b818 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e1e000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e1e000640 1 -- 172.21.15.8:0/1701229077 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e180ba2b0 con 0x561d8827cfa0 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e1e000640 1 -- 172.21.15.8:0/1701229077 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2e1809a700 con 0x561d8827cfa0 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e39dc6740 1 -- 172.21.15.8:0/1701229077 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e28034ab0 con 0x561d8827cfa0 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e1e000640 1 -- 172.21.15.8:0/1701229077 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e1809a060 con 0x561d8827cfa0 2024-03-16T21:01:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e39dc6740 10 client.26449 fetch_fsmap learned FSMap version 30 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e39dc6740 1 -- 172.21.15.8:0/1701229077 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x561d881e24e0 con 0x561d8827cfa0 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e1e000640 1 -- 172.21.15.8:0/1701229077 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2e28034ab0 con 0x561d8827cfa0 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e1e000640 1 -- 172.21.15.8:0/1701229077 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f2e180d5040 con 0x561d8827cfa0 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e39dc6740 10 client.26449 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e39dc6740 10 client.26449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e39dc6740 20 client.26449 populate_metadata read hostname 'smithi008' 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.772+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561d882f17b0 0x561d882f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.773+0000 7f2e39dc6740 4 client.26449 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.773+0000 7f2e39dc6740 1 -- 172.21.15.8:0/1701229077 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561d87f6f890 con 0x561d882f17b0 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.773+0000 7f2e2fe00640 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561d882f17b0 0x561d882f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.773+0000 7f2e2fe00640 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561d882f17b0 0x561d882f3bd0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4284fb99c73191b3 server_cookie=b819a1b8d52d3482 in_seq=0 out_seq=0 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.773+0000 7f2e1e000640 10 client.26449 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e1e000640 1 -- 172.21.15.8:0/1701229077 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561d87f6f890 con 0x561d882f17b0 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e1e000640 10 client.26449 handle_command_reply: tid=0 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 1 client.26449 shutdown 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 1 -- 172.21.15.8:0/1701229077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827cfa0 msgr2=0x561d88286380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827cfa0 0x561d88286380 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2e1809a400 tx=0x7f2e180d3550 comp rx=0 tx=0).stop 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 1 -- 172.21.15.8:0/1701229077 shutdown_connections 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561d882f17b0 0x561d882f3bd0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d88285630 0x561d882868c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561d8827cfa0 0x561d88286380 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 1 --2- 172.21.15.8:0/1701229077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561d8827c2c0 0x561d88285e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e1e000640 0 client.26449 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 1 -- 172.21.15.8:0/1701229077 >> 172.21.15.8:0/1701229077 conn(0x561d882435a0 msgr2=0x561d88275e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 1 -- 172.21.15.8:0/1701229077 shutdown_connections 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 1 -- 172.21.15.8:0/1701229077 wait complete. 2024-03-16T21:01:34.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.774+0000 7f2e39dc6740 20 client.26449 trim_cache size 0 max 16384 2024-03-16T21:01:34.784 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:01:34.784 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:01:34.784 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:01:34.784 INFO:teuthology.orchestra.run.smithi008.stdout: "0a71ac3e-0fe2-49a5-9165-6e45ec9b56e7": { 2024-03-16T21:01:34.784 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:01:34.784 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "0a71ac3e-0fe2-49a5-9165-6e45ec9b56e7", 2024-03-16T21:01:34.784 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:01:34.784 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:01:34.784 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:01:34.784 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:01:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 -- 172.21.15.8:0/1995441105 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2e140a1c20 msgr2=0x7f2e140a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2e140a1c20 0x7f2e140a40e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x561d8827d4f0 tx=0x7f2e2000b480 comp rx=0 tx=0).stop 2024-03-16T21:01:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 -- 172.21.15.8:0/1995441105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e30108450 msgr2=0x7f2e3019e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:01:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e30108450 0x7f2e3019e760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800e9f0 tx=0x7f2e1800eeb0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 -- 172.21.15.8:0/1995441105 shutdown_connections 2024-03-16T21:01:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f2e140a1c20 0x7f2e140a40e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e3010daa0 0x7f2e301a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e30108450 0x7f2e3019e760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 --2- 172.21.15.8:0/1995441105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e30107a90 0x7f2e3019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:01:34.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 -- 172.21.15.8:0/1995441105 >> 172.21.15.8:0/1995441105 conn(0x7f2e30075a30 msgr2=0x7f2e30075f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:01:34.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 -- 172.21.15.8:0/1995441105 shutdown_connections 2024-03-16T21:01:34.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:01:34.775+0000 7f2e37000640 1 -- 172.21.15.8:0/1995441105 wait complete. 2024-03-16T21:01:34.797 INFO:tasks.cephfs.filesystem:scrub status for tag:0a71ac3e-0fe2-49a5-9165-6e45ec9b56e7 - {'path': '/', 'tag': '0a71ac3e-0fe2-49a5-9165-6e45ec9b56e7', 'options': 'recursive,force'} 2024-03-16T21:01:35.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:35 smithi170 ceph-mon[35947]: pgmap v115: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:35.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:35 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:01:35.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:35 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:35.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:35 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:01:35.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:35 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:35.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:35 smithi186 ceph-mon[36391]: pgmap v115: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:35.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:35 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:01:35.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:35 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:35.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:35 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:01:35.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:35 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:35.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:35 smithi008 ceph-mon[31434]: pgmap v115: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:35.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:35 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:01:35.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:35 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:35.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:35 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:01:35.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:35 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:01:37.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:37 smithi170 ceph-mon[35947]: pgmap v116: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-16T21:01:37.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:37 smithi186 ceph-mon[36391]: pgmap v116: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-16T21:01:37.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:37 smithi008 ceph-mon[31434]: pgmap v116: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-16T21:01:38.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:38 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:01:38.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:38 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:01:38.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:38 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:01:39.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:39 smithi170 ceph-mon[35947]: pgmap v117: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:01:39.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:39 smithi186 ceph-mon[36391]: pgmap v117: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:01:39.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:39 smithi008 ceph-mon[31434]: pgmap v117: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:01:41.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:41 smithi170 ceph-mon[35947]: pgmap v118: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:01:41.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:41 smithi186 ceph-mon[36391]: pgmap v118: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:01:41.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:41 smithi008 ceph-mon[31434]: pgmap v118: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:01:43.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:43 smithi170 ceph-mon[35947]: pgmap v119: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:01:43.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:43 smithi186 ceph-mon[36391]: pgmap v119: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:01:43.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:43 smithi008 ceph-mon[31434]: pgmap v119: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:01:45.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:45 smithi170 ceph-mon[35947]: pgmap v120: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:01:45.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:45 smithi186 ceph-mon[36391]: pgmap v120: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:01:45.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:45 smithi008 ceph-mon[31434]: pgmap v120: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:01:47.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:47 smithi170 ceph-mon[35947]: pgmap v121: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:01:47.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:47 smithi186 ceph-mon[36391]: pgmap v121: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:01:47.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:47 smithi008 ceph-mon[31434]: pgmap v121: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:01:49.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:49 smithi170 ceph-mon[35947]: pgmap v122: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-03-16T21:01:49.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:49 smithi186 ceph-mon[36391]: pgmap v122: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-03-16T21:01:49.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:49 smithi008 ceph-mon[31434]: pgmap v122: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-03-16T21:01:51.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:51 smithi170 ceph-mon[35947]: pgmap v123: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:51.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:51 smithi186 ceph-mon[36391]: pgmap v123: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:51.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:51 smithi008 ceph-mon[31434]: pgmap v123: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:53.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:53 smithi170 ceph-mon[35947]: pgmap v124: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:01:53.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:53 smithi186 ceph-mon[36391]: pgmap v124: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:01:53.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:53 smithi008 ceph-mon[31434]: pgmap v124: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:01:55.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:55 smithi170 ceph-mon[35947]: pgmap v125: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:55.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:55 smithi186 ceph-mon[36391]: pgmap v125: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:55.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:55 smithi008 ceph-mon[31434]: pgmap v125: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:57.367 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:57 smithi170 ceph-mon[35947]: pgmap v126: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:57.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:57 smithi186 ceph-mon[36391]: pgmap v126: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:57.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:57 smithi008 ceph-mon[31434]: pgmap v126: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:01:58.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:01:58 smithi008 ceph-mon[31434]: pgmap v127: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:01:58.617 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:01:58 smithi170 ceph-mon[35947]: pgmap v127: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:01:58.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:01:58 smithi186 ceph-mon[36391]: pgmap v127: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:00.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:00 smithi008 ceph-mon[31434]: pgmap v128: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:00.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:00 smithi170 ceph-mon[35947]: pgmap v128: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:00.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:00 smithi186 ceph-mon[36391]: pgmap v128: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:02.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:02 smithi008 ceph-mon[31434]: pgmap v129: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:02.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:02 smithi170 ceph-mon[35947]: pgmap v129: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:02.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:02 smithi186 ceph-mon[36391]: pgmap v129: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:03.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:03 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:02:03.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:03 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:02:03.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:03 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:02:04.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:04 smithi008 ceph-mon[31434]: pgmap v130: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:04.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:04 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:02:04.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:04 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:02:04.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:04 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:02:04.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:02:04.798 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:02:04.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:04 smithi170 ceph-mon[35947]: pgmap v130: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:04.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:04 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:02:04.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:04 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:02:04.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:04 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:02:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:04 smithi186 ceph-mon[36391]: pgmap v130: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:04 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:02:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:04 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:02:04.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:04 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:02:05.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.030+0000 7f7979400640 1 -- 172.21.15.8:0/1562095004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7974103690 msgr2=0x7f7974103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.030+0000 7f7979400640 1 --2- 172.21.15.8:0/1562095004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7974103690 0x7f7974103b10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7960009860 tx=0x7f796002bb70 comp rx=0 tx=0).stop 2024-03-16T21:02:05.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.031+0000 7f7979400640 1 -- 172.21.15.8:0/1562095004 shutdown_connections 2024-03-16T21:02:05.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.031+0000 7f7979400640 1 --2- 172.21.15.8:0/1562095004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7974104050 0x7f7974110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.031+0000 7f7979400640 1 --2- 172.21.15.8:0/1562095004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7974103690 0x7f7974103b10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.031+0000 7f7979400640 1 --2- 172.21.15.8:0/1562095004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79741096a0 0x7f7974109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.031+0000 7f7979400640 1 -- 172.21.15.8:0/1562095004 >> 172.21.15.8:0/1562095004 conn(0x7f79740ff140 msgr2=0x7f7974101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.031+0000 7f7979400640 1 -- 172.21.15.8:0/1562095004 shutdown_connections 2024-03-16T21:02:05.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.031+0000 7f7979400640 1 -- 172.21.15.8:0/1562095004 wait complete. 2024-03-16T21:02:05.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.032+0000 7f7979400640 1 Processor -- start 2024-03-16T21:02:05.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.032+0000 7f7979400640 1 -- start start 2024-03-16T21:02:05.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.032+0000 7f7979400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7974103690 0x7f7974199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.032+0000 7f7979400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7974104050 0x7f797419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.032+0000 7f7979400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79741096a0 0x7f797419e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.032+0000 7f7979400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797419ed40 con 0x7f7974104050 2024-03-16T21:02:05.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.032+0000 7f7979400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797419eeb0 con 0x7f7974103690 2024-03-16T21:02:05.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.032+0000 7f7979400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797419f070 con 0x7f79741096a0 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.032+0000 7f7972800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7974103690 0x7f7974199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.032+0000 7f7972800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7974103690 0x7f7974199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50560/0 (socket says 172.21.15.8:50560) 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.032+0000 7f7972800640 1 -- 172.21.15.8:0/3189041509 learned_addr learned my addr 172.21.15.8:0/3189041509 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.033+0000 7f7973200640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79741096a0 0x7f797419e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.033+0000 7f7971e00640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7974104050 0x7f797419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.033+0000 7f7972800640 1 -- 172.21.15.8:0/3189041509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79741096a0 msgr2=0x7f797419e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.033+0000 7f7972800640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79741096a0 0x7f797419e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.033+0000 7f7972800640 1 -- 172.21.15.8:0/3189041509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7974104050 msgr2=0x7f797419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.033+0000 7f7972800640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7974104050 0x7f797419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.033+0000 7f7972800640 1 -- 172.21.15.8:0/3189041509 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960009490 con 0x7f7974103690 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.033+0000 7f7972800640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7974103690 0x7f7974199ed0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f796400e9f0 tx=0x7f796400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.033+0000 7f796b400640 1 -- 172.21.15.8:0/3189041509 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964009700 con 0x7f7974103690 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.033+0000 7f796b400640 1 -- 172.21.15.8:0/3189041509 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f796400cd80 con 0x7f7974103690 2024-03-16T21:02:05.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.034+0000 7f7979400640 1 -- 172.21.15.8:0/3189041509 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797419f350 con 0x7f7974103690 2024-03-16T21:02:05.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.034+0000 7f796b400640 1 -- 172.21.15.8:0/3189041509 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79640189c0 con 0x7f7974103690 2024-03-16T21:02:05.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.034+0000 7f7979400640 1 -- 172.21.15.8:0/3189041509 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79741a6bd0 con 0x7f7974103690 2024-03-16T21:02:05.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.037+0000 7f797c1a7740 1 Processor -- start 2024-03-16T21:02:05.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.037+0000 7f796b400640 1 -- 172.21.15.8:0/3189041509 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7964018b20 con 0x7f7974103690 2024-03-16T21:02:05.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.037+0000 7f797c1a7740 1 -- start start 2024-03-16T21:02:05.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.037+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaafa0 0x56155eea9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.037+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaa2c0 0x56155eeaa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.037+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeb3630 0x56155eeb5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.037+0000 7f797c1a7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155ee19150 con 0x56155eeaa2c0 2024-03-16T21:02:05.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.037+0000 7f797c1a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155ee16680 con 0x56155eeaafa0 2024-03-16T21:02:05.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.037+0000 7f797c1a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155ee11e60 con 0x56155eeb3630 2024-03-16T21:02:05.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7973200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaafa0 0x56155eea9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7973200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaafa0 0x56155eea9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50568/0 (socket says 172.21.15.8:50568) 2024-03-16T21:02:05.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7973200640 1 -- 172.21.15.8:0/2641533505 learned_addr learned my addr 172.21.15.8:0/2641533505 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:05.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7972800640 1 --2- 172.21.15.8:0/2641533505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaa2c0 0x56155eeaa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7971e00640 1 --2- 172.21.15.8:0/2641533505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeb3630 0x56155eeb5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7973200640 1 -- 172.21.15.8:0/2641533505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeb3630 msgr2=0x56155eeb5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7973200640 1 --2- 172.21.15.8:0/2641533505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeb3630 0x56155eeb5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7973200640 1 -- 172.21.15.8:0/2641533505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaa2c0 msgr2=0x56155eeaa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7973200640 1 --2- 172.21.15.8:0/2641533505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaa2c0 0x56155eeaa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7973200640 1 -- 172.21.15.8:0/2641533505 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56155edcb060 con 0x56155eeaafa0 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7971e00640 1 --2- 172.21.15.8:0/2641533505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeb3630 0x56155eeb5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.038+0000 7f7973200640 1 --2- 172.21.15.8:0/2641533505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaafa0 0x56155eea9cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f796c00e580 tx=0x7f796c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f53abfb273178ec7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f795f400640 1 -- 172.21.15.8:0/2641533505 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c01b070 con 0x56155eeaafa0 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f795f400640 1 -- 172.21.15.8:0/2641533505 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f796c003e70 con 0x56155eeaafa0 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f795f400640 1 -- 172.21.15.8:0/2641533505 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c013040 con 0x56155eeaafa0 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f796b400640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79580a1c20 0x7f79580a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f796b400640 1 -- 172.21.15.8:0/3189041509 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7964014070 con 0x7f7974103690 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f7972800640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79580a1c20 0x7f79580a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f797c1a7740 1 -- 172.21.15.8:0/2641533505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaafa0 msgr2=0x56155eea9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f797c1a7740 1 --2- 172.21.15.8:0/2641533505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaafa0 0x56155eea9cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f796c00e580 tx=0x7f796c0095c0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f797c1a7740 1 -- 172.21.15.8:0/2641533505 shutdown_connections 2024-03-16T21:02:05.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f797c1a7740 1 --2- 172.21.15.8:0/2641533505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeb3630 0x56155eeb5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f797c1a7740 1 --2- 172.21.15.8:0/2641533505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaa2c0 0x56155eeaa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f797c1a7740 1 --2- 172.21.15.8:0/2641533505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaafa0 0x56155eea9cf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.039+0000 7f797c1a7740 1 -- 172.21.15.8:0/2641533505 >> 172.21.15.8:0/2641533505 conn(0x56155ee715a0 msgr2=0x56155eea4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.040+0000 7f797c1a7740 1 -- 172.21.15.8:0/2641533505 shutdown_connections 2024-03-16T21:02:05.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.040+0000 7f797c1a7740 1 -- 172.21.15.8:0/2641533505 wait complete. 2024-03-16T21:02:05.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.040+0000 7f7972800640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79580a1c20 0x7f79580a40e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f79640cb220 tx=0x7f7964018420 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.040+0000 7f797c1a7740 1 -- start start 2024-03-16T21:02:05.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.040+0000 7f797c1a7740 1 Processor -- start 2024-03-16T21:02:05.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaa2c0 0x56155eeb0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaafa0 0x56155eeb0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeb3630 0x56155eeb1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f797c1a7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155edb6ec0 con 0x56155eeaafa0 2024-03-16T21:02:05.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f797c1a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155edb6b60 con 0x56155eeaa2c0 2024-03-16T21:02:05.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f797c1a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155eb801c0 con 0x56155eeb3630 2024-03-16T21:02:05.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f797c1a7740 10 client.0 _ll_register_callbacks cb 0x56155edca960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:05.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f7971e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaafa0 0x56155eeb0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f7973200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaa2c0 0x56155eeb0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f7971e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaafa0 0x56155eeb0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56228/0 (socket says 172.21.15.8:56228) 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f7971e00640 1 -- 172.21.15.8:0/446069963 learned_addr learned my addr 172.21.15.8:0/446069963 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.041+0000 7f7973200640 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeb3630 0x56155eeb1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.042+0000 7f7971e00640 1 -- 172.21.15.8:0/446069963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeb3630 msgr2=0x56155eeb1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.042+0000 7f7971e00640 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeb3630 0x56155eeb1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.042+0000 7f7971e00640 1 -- 172.21.15.8:0/446069963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaa2c0 msgr2=0x56155eeb0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.042+0000 7f7971e00640 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaa2c0 0x56155eeb0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.042+0000 7f7971e00640 1 -- 172.21.15.8:0/446069963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c009d60 con 0x56155eeaafa0 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.042+0000 7f7971e00640 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaafa0 0x56155eeb0b40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7960005e00 tx=0x7f79600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d324ac4accdd224 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.042+0000 7f7953e00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.042+0000 7f7953e00640 1 -- 172.21.15.8:0/446069963 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960034850 con 0x56155eeaafa0 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.042+0000 7f7953e00640 1 -- 172.21.15.8:0/446069963 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f79600349b0 con 0x56155eeaafa0 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.042+0000 7f797c1a7740 1 -- 172.21.15.8:0/446069963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56155eb117e0 con 0x56155eeaafa0 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.043+0000 7f7953e00640 1 -- 172.21.15.8:0/446069963 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79600044e0 con 0x56155eeaafa0 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.043+0000 7f797c1a7740 10 client.16290 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:05.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.043+0000 7f797c1a7740 1 -- 172.21.15.8:0/446069963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56155ee104e0 con 0x56155eeaafa0 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.043+0000 7f7953e00640 1 -- 172.21.15.8:0/446069963 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x56155eb117e0 con 0x56155eeaafa0 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.043+0000 7f7953e00640 1 -- 172.21.15.8:0/446069963 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f7960003c30 con 0x56155eeaafa0 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.043+0000 7f797c1a7740 10 client.16290 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.043+0000 7f797c1a7740 10 client.16290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.043+0000 7f797c1a7740 20 client.16290 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.043+0000 7f797c1a7740 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56155eec3850 0x56155eec5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.043+0000 7f797c1a7740 4 client.16290 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.043+0000 7f797c1a7740 1 -- 172.21.15.8:0/446069963 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56155eb4e720 con 0x56155eec3850 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.044+0000 7f7973200640 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56155eec3850 0x56155eec5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.044+0000 7f7973200640 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56155eec3850 0x56155eec5c70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b12a73936f6ca60e server_cookie=dae45c9fa16c1745 in_seq=0 out_seq=0 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.044+0000 7f7953e00640 10 client.16290 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f7953e00640 1 -- 172.21.15.8:0/446069963 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56155eb4e720 con 0x56155eec3850 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f7953e00640 10 client.16290 handle_command_reply: tid=0 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 1 client.16290 shutdown 2024-03-16T21:02:05.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 1 -- 172.21.15.8:0/446069963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaafa0 msgr2=0x56155eeb0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaafa0 0x56155eeb0b40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7960005e00 tx=0x7f79600042f0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 1 -- 172.21.15.8:0/446069963 shutdown_connections 2024-03-16T21:02:05.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeb3630 0x56155eeb1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56155eec3850 0x56155eec5c70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaafa0 0x56155eeb0b40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 1 --2- 172.21.15.8:0/446069963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaa2c0 0x56155eeb0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 1 -- 172.21.15.8:0/446069963 >> 172.21.15.8:0/446069963 conn(0x56155ee715a0 msgr2=0x56155eea6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f7953e00640 0 client.16290 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:05.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 1 -- 172.21.15.8:0/446069963 shutdown_connections 2024-03-16T21:02:05.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 1 -- 172.21.15.8:0/446069963 wait complete. 2024-03-16T21:02:05.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.045+0000 7f797c1a7740 20 client.16290 trim_cache size 0 max 16384 2024-03-16T21:02:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.063+0000 7f797c1a7740 1 Processor -- start 2024-03-16T21:02:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.063+0000 7f797c1a7740 1 -- start start 2024-03-16T21:02:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.063+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaa2c0 0x56155eeb2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.063+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.063+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeb3630 0x56155eebea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.063+0000 7f797c1a7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155eea5b10 con 0x56155eeaa2c0 2024-03-16T21:02:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.063+0000 7f797c1a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155eec02a0 con 0x56155eeb3630 2024-03-16T21:02:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.063+0000 7f797c1a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155eea45b0 con 0x56155eeaafa0 2024-03-16T21:02:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.064+0000 7f7971e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.064+0000 7f7971e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46580/0 (socket says 172.21.15.8:46580) 2024-03-16T21:02:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.064+0000 7f7971e00640 1 -- 172.21.15.8:0/3918312669 learned_addr learned my addr 172.21.15.8:0/3918312669 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.064+0000 7f7973200640 1 --2- 172.21.15.8:0/3918312669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaa2c0 0x56155eeb2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.064+0000 7f7971e00640 1 -- 172.21.15.8:0/3918312669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeb3630 msgr2=0x56155eebea70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-16T21:02:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.064+0000 7f7971e00640 1 --2- 172.21.15.8:0/3918312669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeb3630 0x56155eebea70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.064+0000 7f7971e00640 1 -- 172.21.15.8:0/3918312669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaa2c0 msgr2=0x56155eeb2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.064+0000 7f7971e00640 1 --2- 172.21.15.8:0/3918312669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaa2c0 0x56155eeb2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.064+0000 7f7971e00640 1 -- 172.21.15.8:0/3918312669 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56155edac950 con 0x56155eeaafa0 2024-03-16T21:02:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.064+0000 7f7973200640 1 --2- 172.21.15.8:0/3918312669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaa2c0 0x56155eeb2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:02:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.064+0000 7f7971e00640 1 --2- 172.21.15.8:0/3918312669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb0ea0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7960009780 tx=0x7f796002bb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc09df74e83644e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f795ea00640 1 -- 172.21.15.8:0/3918312669 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960032b40 con 0x56155eeaafa0 2024-03-16T21:02:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f795ea00640 1 -- 172.21.15.8:0/3918312669 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7960032ca0 con 0x56155eeaafa0 2024-03-16T21:02:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f795ea00640 1 -- 172.21.15.8:0/3918312669 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796002c850 con 0x56155eeaafa0 2024-03-16T21:02:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f797c1a7740 1 -- 172.21.15.8:0/3918312669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 msgr2=0x56155eeb0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f797c1a7740 1 --2- 172.21.15.8:0/3918312669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb0ea0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7960009780 tx=0x7f796002bb70 comp rx=0 tx=0).stop 2024-03-16T21:02:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f797c1a7740 1 -- 172.21.15.8:0/3918312669 shutdown_connections 2024-03-16T21:02:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f797c1a7740 1 --2- 172.21.15.8:0/3918312669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeb3630 0x56155eebea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f797c1a7740 1 --2- 172.21.15.8:0/3918312669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb0ea0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f797c1a7740 1 --2- 172.21.15.8:0/3918312669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeaa2c0 0x56155eeb2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f797c1a7740 1 -- 172.21.15.8:0/3918312669 >> 172.21.15.8:0/3918312669 conn(0x56155ee715a0 msgr2=0x56155eea69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f797c1a7740 1 -- 172.21.15.8:0/3918312669 shutdown_connections 2024-03-16T21:02:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.065+0000 7f797c1a7740 1 -- 172.21.15.8:0/3918312669 wait complete. 2024-03-16T21:02:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.066+0000 7f797c1a7740 1 -- start start 2024-03-16T21:02:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.066+0000 7f797c1a7740 1 Processor -- start 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.066+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaa2c0 0x56155eeadf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.066+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f797c1a7740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeb3630 0x56155eeb4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f797c1a7740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155eeae670 con 0x56155eeb3630 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f797c1a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155eeb4fe0 con 0x56155eeaa2c0 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f797c1a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56155eeb51a0 con 0x56155eeaafa0 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f797c1a7740 10 client.0 _ll_register_callbacks cb 0x7f79600096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f7971e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f7971e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46584/0 (socket says 172.21.15.8:46584) 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f7971e00640 1 -- 172.21.15.8:0/1451232963 learned_addr learned my addr 172.21.15.8:0/1451232963 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f7973200640 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaa2c0 0x56155eeadf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f7973200640 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeb3630 0x56155eeb4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f7971e00640 1 -- 172.21.15.8:0/1451232963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaa2c0 msgr2=0x56155eeadf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f7971e00640 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaa2c0 0x56155eeadf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f7971e00640 1 -- 172.21.15.8:0/1451232963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeb3630 msgr2=0x56155eeb4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f7971e00640 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeb3630 0x56155eeb4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.067+0000 7f7971e00640 1 -- 172.21.15.8:0/1451232963 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56155ee104e0 con 0x56155eeaafa0 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.068+0000 7f7971e00640 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb4560 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7960005e00 tx=0x7f7960032980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b78b15863a3ad5d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.068+0000 7f7953e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.068+0000 7f7953e00640 1 -- 172.21.15.8:0/1451232963 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960034850 con 0x56155eeaafa0 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.068+0000 7f7953e00640 1 -- 172.21.15.8:0/1451232963 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7960000e40 con 0x56155eeaafa0 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.068+0000 7f797c1a7740 1 -- 172.21.15.8:0/1451232963 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f796c003e70 con 0x56155eeaafa0 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.068+0000 7f7953e00640 1 -- 172.21.15.8:0/1451232963 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79600044e0 con 0x56155eeaafa0 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.068+0000 7f797c1a7740 10 client.26467 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.068+0000 7f797c1a7740 1 -- 172.21.15.8:0/1451232963 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56155edd2430 con 0x56155eeaafa0 2024-03-16T21:02:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.068+0000 7f7953e00640 1 -- 172.21.15.8:0/1451232963 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f796c003e70 con 0x56155eeaafa0 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.069+0000 7f7953e00640 1 -- 172.21.15.8:0/1451232963 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f7960005450 con 0x56155eeaafa0 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.069+0000 7f797c1a7740 10 client.26467 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.069+0000 7f797c1a7740 10 client.26467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.069+0000 7f797c1a7740 20 client.26467 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.069+0000 7f797c1a7740 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56155ef1ff80 0x56155ef223a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.069+0000 7f797c1a7740 4 client.26467 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.069+0000 7f797c1a7740 1 -- 172.21.15.8:0/1451232963 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56155eb9d890 con 0x56155ef1ff80 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.069+0000 7f7973200640 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56155ef1ff80 0x56155ef223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f7973200640 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56155ef1ff80 0x56155ef223a0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69d05609b2417007 server_cookie=f929c364e512fbe9 in_seq=0 out_seq=0 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f7953e00640 10 client.26467 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f7953e00640 1 -- 172.21.15.8:0/1451232963 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56155eb9d890 con 0x56155ef1ff80 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f7953e00640 10 client.26467 handle_command_reply: tid=0 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 1 client.26467 shutdown 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 1 -- 172.21.15.8:0/1451232963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 msgr2=0x56155eeb4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb4560 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7960005e00 tx=0x7f7960032980 comp rx=0 tx=0).stop 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 1 -- 172.21.15.8:0/1451232963 shutdown_connections 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56155ef1ff80 0x56155ef223a0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56155eeb3630 0x56155eeb4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56155eeaafa0 0x56155eeb4560 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 1 --2- 172.21.15.8:0/1451232963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56155eeaa2c0 0x56155eeadf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f7953e00640 0 client.26467 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 1 -- 172.21.15.8:0/1451232963 >> 172.21.15.8:0/1451232963 conn(0x56155ee715a0 msgr2=0x56155eea6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 1 -- 172.21.15.8:0/1451232963 shutdown_connections 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 1 -- 172.21.15.8:0/1451232963 wait complete. 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.070+0000 7f797c1a7740 20 client.26467 trim_cache size 0 max 16384 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:02:05.079 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:02:05.080 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:02:05.080 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:02:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 -- 172.21.15.8:0/3189041509 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79580a1c20 msgr2=0x7f79580a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79580a1c20 0x7f79580a40e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f79640cb220 tx=0x7f7964018420 comp rx=0 tx=0).stop 2024-03-16T21:02:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 -- 172.21.15.8:0/3189041509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7974103690 msgr2=0x7f7974199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7974103690 0x7f7974199ed0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f796400e9f0 tx=0x7f796400eeb0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 -- 172.21.15.8:0/3189041509 shutdown_connections 2024-03-16T21:02:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79580a1c20 0x7f79580a40e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79741096a0 0x7f797419e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7974104050 0x7f797419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 --2- 172.21.15.8:0/3189041509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7974103690 0x7f7974199ed0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 -- 172.21.15.8:0/3189041509 >> 172.21.15.8:0/3189041509 conn(0x7f79740ff140 msgr2=0x7f79740ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 -- 172.21.15.8:0/3189041509 shutdown_connections 2024-03-16T21:02:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.071+0000 7f7979400640 1 -- 172.21.15.8:0/3189041509 wait complete. 2024-03-16T21:02:05.094 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:02:05.095 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:02:05.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.309+0000 7f783b200640 1 -- 172.21.15.8:0/4183624700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f783c1078b0 msgr2=0x7f783c107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.309+0000 7f783b200640 1 --2- 172.21.15.8:0/4183624700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f783c1078b0 0x7f783c107d30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7824009900 tx=0x7f782402bc30 comp rx=0 tx=0).stop 2024-03-16T21:02:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.309+0000 7f783b200640 1 -- 172.21.15.8:0/4183624700 shutdown_connections 2024-03-16T21:02:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.309+0000 7f783b200640 1 --2- 172.21.15.8:0/4183624700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f783c108270 0x7f783c114780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.309+0000 7f783b200640 1 --2- 172.21.15.8:0/4183624700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f783c1078b0 0x7f783c107d30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.310+0000 7f783b200640 1 --2- 172.21.15.8:0/4183624700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c10d8c0 0x7f783c10dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.310+0000 7f783b200640 1 -- 172.21.15.8:0/4183624700 >> 172.21.15.8:0/4183624700 conn(0x7f783c077010 msgr2=0x7f783c079430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.310+0000 7f783b200640 1 -- 172.21.15.8:0/4183624700 shutdown_connections 2024-03-16T21:02:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.310+0000 7f783b200640 1 -- 172.21.15.8:0/4183624700 wait complete. 2024-03-16T21:02:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.311+0000 7f783b200640 1 Processor -- start 2024-03-16T21:02:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.311+0000 7f783b200640 1 -- start start 2024-03-16T21:02:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.311+0000 7f783b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f783c1078b0 0x7f783c19dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.311+0000 7f783b200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f783c108270 0x7f783c19e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.311+0000 7f783b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c10d8c0 0x7f783c1a2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.311+0000 7f783b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c1a2e60 con 0x7f783c10d8c0 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.311+0000 7f783b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c1a2fd0 con 0x7f783c1078b0 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.311+0000 7f783b200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c1a3190 con 0x7f783c108270 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f7839e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f783c1078b0 0x7f783c19dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f7833e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f783c108270 0x7f783c19e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f7839e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f783c1078b0 0x7f783c19dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50624/0 (socket says 172.21.15.8:50624) 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f7839e00640 1 -- 172.21.15.8:0/2356566904 learned_addr learned my addr 172.21.15.8:0/2356566904 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f783a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c10d8c0 0x7f783c1a2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f7833e00640 1 -- 172.21.15.8:0/2356566904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f783c1078b0 msgr2=0x7f783c19dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f7833e00640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f783c1078b0 0x7f783c19dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f7833e00640 1 -- 172.21.15.8:0/2356566904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c10d8c0 msgr2=0x7f783c1a2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f7833e00640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c10d8c0 0x7f783c1a2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f7833e00640 1 -- 172.21.15.8:0/2356566904 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7824009560 con 0x7f783c108270 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f7839e00640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f783c1078b0 0x7f783c19dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.312+0000 7f783a800640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c10d8c0 0x7f783c1a2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.313+0000 7f7833e00640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f783c108270 0x7f783c19e4e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f782402c170 tx=0x7f782402cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.313+0000 7f7832a00640 1 -- 172.21.15.8:0/2356566904 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824004250 con 0x7f783c108270 2024-03-16T21:02:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.313+0000 7f7832a00640 1 -- 172.21.15.8:0/2356566904 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f78240043b0 con 0x7f783c108270 2024-03-16T21:02:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.313+0000 7f7832a00640 1 -- 172.21.15.8:0/2356566904 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824003b50 con 0x7f783c108270 2024-03-16T21:02:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.313+0000 7f783b200640 1 -- 172.21.15.8:0/2356566904 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783c1a3410 con 0x7f783c108270 2024-03-16T21:02:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.313+0000 7f783b200640 1 -- 172.21.15.8:0/2356566904 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783c1aacf0 con 0x7f783c108270 2024-03-16T21:02:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.314+0000 7f783b200640 1 -- 172.21.15.8:0/2356566904 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783c068650 con 0x7f783c108270 2024-03-16T21:02:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.316+0000 7f7832a00640 1 -- 172.21.15.8:0/2356566904 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7824003cb0 con 0x7f783c108270 2024-03-16T21:02:05.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.317+0000 7f7832a00640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f78200a1c20 0x7f78200a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.318+0000 7f7832a00640 1 -- 172.21.15.8:0/2356566904 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f78240efb30 con 0x7f783c108270 2024-03-16T21:02:05.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.318+0000 7f7839e00640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f78200a1c20 0x7f78200a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.318+0000 7f7839e00640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f78200a1c20 0x7f78200a40e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f782c011440 tx=0x7f782c005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.321+0000 7f7832a00640 1 -- 172.21.15.8:0/2356566904 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f78240b8ae0 con 0x7f783c108270 2024-03-16T21:02:05.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.567+0000 7f783b200640 1 -- 172.21.15.8:0/2356566904 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f783c117bc0 con 0x7f783c108270 2024-03-16T21:02:05.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.569+0000 7f7832a00640 1 -- 172.21.15.8:0/2356566904 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11396 (secure 0 0 0) 0x7f78240bc1a0 con 0x7f783c108270 2024-03-16T21:02:05.574 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:02:05.574 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:00:21.828404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:02:05.575 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 30 2024-03-16T21:02:05.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.572+0000 7f783b200640 1 -- 172.21.15.8:0/2356566904 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f78200a1c20 msgr2=0x7f78200a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.572+0000 7f783b200640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f78200a1c20 0x7f78200a40e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f782c011440 tx=0x7f782c005f90 comp rx=0 tx=0).stop 2024-03-16T21:02:05.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.572+0000 7f783b200640 1 -- 172.21.15.8:0/2356566904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f783c108270 msgr2=0x7f783c19e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.572+0000 7f783b200640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f783c108270 0x7f783c19e4e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f782402c170 tx=0x7f782402cc20 comp rx=0 tx=0).stop 2024-03-16T21:02:05.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.572+0000 7f783b200640 1 -- 172.21.15.8:0/2356566904 shutdown_connections 2024-03-16T21:02:05.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.572+0000 7f783b200640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f78200a1c20 0x7f78200a40e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.572+0000 7f783b200640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c10d8c0 0x7f783c1a2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.572+0000 7f783b200640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f783c108270 0x7f783c19e4e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.572+0000 7f783b200640 1 --2- 172.21.15.8:0/2356566904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f783c1078b0 0x7f783c19dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.572+0000 7f783b200640 1 -- 172.21.15.8:0/2356566904 >> 172.21.15.8:0/2356566904 conn(0x7f783c077010 msgr2=0x7f783c077530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.573+0000 7f783b200640 1 -- 172.21.15.8:0/2356566904 shutdown_connections 2024-03-16T21:02:05.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.573+0000 7f783b200640 1 -- 172.21.15.8:0/2356566904 wait complete. 2024-03-16T21:02:05.595 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:02:05.595 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:02:05.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.817+0000 7f7122800640 1 -- 172.21.15.8:0/3635714246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711c109650 msgr2=0x7f711c109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.817+0000 7f7122800640 1 --2- 172.21.15.8:0/3635714246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711c109650 0x7f711c109a30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7110009930 tx=0x7f711002bc20 comp rx=0 tx=0).stop 2024-03-16T21:02:05.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.817+0000 7f7122800640 1 -- 172.21.15.8:0/3635714246 shutdown_connections 2024-03-16T21:02:05.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.817+0000 7f7122800640 1 --2- 172.21.15.8:0/3635714246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c103f50 0x7f711c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.817+0000 7f7122800640 1 --2- 172.21.15.8:0/3635714246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f711c103590 0x7f711c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.817+0000 7f7122800640 1 --2- 172.21.15.8:0/3635714246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711c109650 0x7f711c109a30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.817+0000 7f7122800640 1 -- 172.21.15.8:0/3635714246 >> 172.21.15.8:0/3635714246 conn(0x7f711c0ff020 msgr2=0x7f711c101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.817+0000 7f7122800640 1 -- 172.21.15.8:0/3635714246 shutdown_connections 2024-03-16T21:02:05.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.817+0000 7f7122800640 1 -- 172.21.15.8:0/3635714246 wait complete. 2024-03-16T21:02:05.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.818+0000 7f7122800640 1 Processor -- start 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7122800640 1 -- start start 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7122800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711c103590 0x7f711c19f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7122800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f711c103f50 0x7f711c19fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7122800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c109650 0x7f711c199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7122800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c19a0d0 con 0x7f711c109650 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7122800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c19a240 con 0x7f711c103f50 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7122800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c19a400 con 0x7f711c103590 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7121400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711c103590 0x7f711c19f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7121400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711c103590 0x7f711c19f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46626/0 (socket says 172.21.15.8:46626) 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7121400640 1 -- 172.21.15.8:0/2508727218 learned_addr learned my addr 172.21.15.8:0/2508727218 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7121e00640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c109650 0x7f711c199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.819+0000 7f7120a00640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f711c103f50 0x7f711c19fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.820+0000 7f7121400640 1 -- 172.21.15.8:0/2508727218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f711c103f50 msgr2=0x7f711c19fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.820+0000 7f7121400640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f711c103f50 0x7f711c19fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.820+0000 7f7121400640 1 -- 172.21.15.8:0/2508727218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c109650 msgr2=0x7f711c199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.820+0000 7f7121400640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c109650 0x7f711c199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.820+0000 7f7121400640 1 -- 172.21.15.8:0/2508727218 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110009560 con 0x7f711c103590 2024-03-16T21:02:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.820+0000 7f7121400640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711c103590 0x7f711c19f8d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7110005ab0 tx=0x7f711002cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.820+0000 7f711a000640 1 -- 172.21.15.8:0/2508727218 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110004250 con 0x7f711c103590 2024-03-16T21:02:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.820+0000 7f711a000640 1 -- 172.21.15.8:0/2508727218 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f71100043b0 con 0x7f711c103590 2024-03-16T21:02:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.820+0000 7f7122800640 1 -- 172.21.15.8:0/2508727218 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c19a680 con 0x7f711c103590 2024-03-16T21:02:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.820+0000 7f711a000640 1 -- 172.21.15.8:0/2508727218 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110003be0 con 0x7f711c103590 2024-03-16T21:02:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.821+0000 7f7122800640 1 -- 172.21.15.8:0/2508727218 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c1a6970 con 0x7f711c103590 2024-03-16T21:02:05.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.824+0000 7f711a000640 1 -- 172.21.15.8:0/2508727218 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7110003d40 con 0x7f711c103590 2024-03-16T21:02:05.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.824+0000 7f7126bb2740 1 Processor -- start 2024-03-16T21:02:05.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.824+0000 7f7126bb2740 1 -- start start 2024-03-16T21:02:05.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.824+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d3611d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.824+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 0x556a4d369db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.824+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d36a2f0 0x556a4d36c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.824+0000 7f7126bb2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d2cf210 con 0x556a4d361710 2024-03-16T21:02:05.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.824+0000 7f7126bb2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d2cc740 con 0x556a4d360df0 2024-03-16T21:02:05.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.824+0000 7f7126bb2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d2c7f20 con 0x556a4d36a2f0 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.824+0000 7f7121e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d3611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.824+0000 7f7121400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 0x556a4d369db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.825+0000 7f7121e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d3611d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50652/0 (socket says 172.21.15.8:50652) 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.825+0000 7f7121e00640 1 -- 172.21.15.8:0/1760036170 learned_addr learned my addr 172.21.15.8:0/1760036170 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.825+0000 7f7120a00640 1 --2- 172.21.15.8:0/1760036170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d36a2f0 0x556a4d36c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.825+0000 7f7121e00640 1 -- 172.21.15.8:0/1760036170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d36a2f0 msgr2=0x556a4d36c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.825+0000 7f7121e00640 1 --2- 172.21.15.8:0/1760036170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d36a2f0 0x556a4d36c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.825+0000 7f7121e00640 1 -- 172.21.15.8:0/1760036170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 msgr2=0x556a4d369db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.825+0000 7f7121e00640 1 --2- 172.21.15.8:0/1760036170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 0x556a4d369db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.825+0000 7f7121e00640 1 -- 172.21.15.8:0/1760036170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a4d289df0 con 0x556a4d360df0 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.825+0000 7f7121e00640 1 --2- 172.21.15.8:0/1760036170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d3611d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f71140039f0 tx=0x7f7114003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3295a6dd33a60a11 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.825+0000 7f711a000640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f71040a1ba0 0x7f71040a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.825+0000 7f710e600640 1 -- 172.21.15.8:0/1760036170 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711401a470 con 0x556a4d360df0 2024-03-16T21:02:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.826+0000 7f710e600640 1 -- 172.21.15.8:0/1760036170 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7114011940 con 0x556a4d360df0 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.826+0000 7f710e600640 1 -- 172.21.15.8:0/1760036170 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114010ae0 con 0x556a4d360df0 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.826+0000 7f711a000640 1 -- 172.21.15.8:0/2508727218 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f71100efda0 con 0x7f711c103590 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.826+0000 7f7121400640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f71040a1ba0 0x7f71040a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.826+0000 7f7126bb2740 1 -- 172.21.15.8:0/1760036170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 msgr2=0x556a4d3611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.826+0000 7f7126bb2740 1 --2- 172.21.15.8:0/1760036170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d3611d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f71140039f0 tx=0x7f7114003eb0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.826+0000 7f7121400640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f71040a1ba0 0x7f71040a4060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x556a4d3608c0 tx=0x7f71100f3810 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.827+0000 7f7126bb2740 1 -- 172.21.15.8:0/1760036170 shutdown_connections 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.827+0000 7f7126bb2740 1 --2- 172.21.15.8:0/1760036170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d36a2f0 0x556a4d36c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.827+0000 7f7126bb2740 1 --2- 172.21.15.8:0/1760036170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 0x556a4d369db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.827+0000 7f7126bb2740 1 --2- 172.21.15.8:0/1760036170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d3611d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.827+0000 7f7126bb2740 1 -- 172.21.15.8:0/1760036170 >> 172.21.15.8:0/1760036170 conn(0x556a4d35b520 msgr2=0x556a4d35b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.827+0000 7f7126bb2740 1 -- 172.21.15.8:0/1760036170 shutdown_connections 2024-03-16T21:02:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.827+0000 7f7126bb2740 1 -- 172.21.15.8:0/1760036170 wait complete. 2024-03-16T21:02:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.827+0000 7f7126bb2740 1 -- start start 2024-03-16T21:02:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.827+0000 7f7126bb2740 1 Processor -- start 2024-03-16T21:02:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d367390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d361710 0x556a4d3678d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d36a2f0 0x556a4d367e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7126bb2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d26d150 con 0x556a4d36a2f0 2024-03-16T21:02:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7126bb2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d26cdf0 con 0x556a4d360df0 2024-03-16T21:02:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7126bb2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d0361c0 con 0x556a4d361710 2024-03-16T21:02:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7126bb2740 10 client.0 _ll_register_callbacks cb 0x556a4d2bc2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7120a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d361710 0x556a4d3678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7120a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d361710 0x556a4d3678d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46652/0 (socket says 172.21.15.8:46652) 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7120a00640 1 -- 172.21.15.8:0/1614282910 learned_addr learned my addr 172.21.15.8:0/1614282910 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7121e00640 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d367390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.828+0000 7f7121e00640 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d36a2f0 0x556a4d367e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7120a00640 1 -- 172.21.15.8:0/1614282910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 msgr2=0x556a4d367390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7120a00640 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d367390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7120a00640 1 -- 172.21.15.8:0/1614282910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d36a2f0 msgr2=0x556a4d367e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7120a00640 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d36a2f0 0x556a4d367e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7120a00640 1 -- 172.21.15.8:0/1614282910 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7114009c90 con 0x556a4d361710 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7121e00640 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d36a2f0 0x556a4d367e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7120a00640 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d361710 0x556a4d3678d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7108012700 tx=0x7f7108012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4d6ab855fd64fe6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7102a00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7102a00640 1 -- 172.21.15.8:0/1614282910 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108017070 con 0x556a4d361710 2024-03-16T21:02:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7102a00640 1 -- 172.21.15.8:0/1614282910 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f710800f920 con 0x556a4d361710 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7126bb2740 1 -- 172.21.15.8:0/1614282910 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a4cfc77e0 con 0x556a4d361710 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7102a00640 1 -- 172.21.15.8:0/1614282910 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f710800fae0 con 0x556a4d361710 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.829+0000 7f7126bb2740 10 client.26485 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.830+0000 7f7126bb2740 1 -- 172.21.15.8:0/1614282910 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x556a4d2c65a0 con 0x556a4d361710 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.830+0000 7f7102a00640 1 -- 172.21.15.8:0/1614282910 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x556a4cfc77e0 con 0x556a4d361710 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.830+0000 7f7102a00640 1 -- 172.21.15.8:0/1614282910 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f710801c420 con 0x556a4d361710 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.830+0000 7f7126bb2740 10 client.26485 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.830+0000 7f7126bb2740 10 client.26485 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.830+0000 7f7126bb2740 20 client.26485 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.830+0000 7f7126bb2740 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556a4d37a510 0x556a4d37c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.830+0000 7f7126bb2740 4 client.26485 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.830+0000 7f7126bb2740 1 -- 172.21.15.8:0/1614282910 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a4d004720 con 0x556a4d37a510 2024-03-16T21:02:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.830+0000 7f7121e00640 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556a4d37a510 0x556a4d37c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.831+0000 7f7121e00640 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556a4d37a510 0x556a4d37c930 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f14adb630deadd42 server_cookie=dfa8ce180845927e in_seq=0 out_seq=0 2024-03-16T21:02:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.831+0000 7f7102a00640 10 client.26485 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7102a00640 1 -- 172.21.15.8:0/1614282910 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556a4d004720 con 0x556a4d37a510 2024-03-16T21:02:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7102a00640 10 client.26485 handle_command_reply: tid=0 2024-03-16T21:02:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 1 client.26485 shutdown 2024-03-16T21:02:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 1 -- 172.21.15.8:0/1614282910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d361710 msgr2=0x556a4d3678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d361710 0x556a4d3678d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7108012700 tx=0x7f7108012bc0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 1 -- 172.21.15.8:0/1614282910 shutdown_connections 2024-03-16T21:02:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556a4d37a510 0x556a4d37c930 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d36a2f0 0x556a4d367e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d361710 0x556a4d3678d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 1 --2- 172.21.15.8:0/1614282910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d367390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 1 -- 172.21.15.8:0/1614282910 >> 172.21.15.8:0/1614282910 conn(0x556a4d35b520 msgr2=0x556a4d35d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7102a00640 0 client.26485 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 1 -- 172.21.15.8:0/1614282910 shutdown_connections 2024-03-16T21:02:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 1 -- 172.21.15.8:0/1614282910 wait complete. 2024-03-16T21:02:05.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.832+0000 7f7126bb2740 20 client.26485 trim_cache size 0 max 16384 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.846+0000 7f7126bb2740 1 Processor -- start 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.846+0000 7f7126bb2740 1 -- start start 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.846+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d360df0 0x556a4d369ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.846+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d361710 0x556a4d367a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.846+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d36a2f0 0x556a4d375670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.846+0000 7f7126bb2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d378c10 con 0x556a4d36a2f0 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.846+0000 7f7126bb2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d37cf90 con 0x556a4d361710 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.846+0000 7f7126bb2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d367180 con 0x556a4d360df0 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.847+0000 7f7121e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d360df0 0x556a4d369ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.847+0000 7f7120a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d361710 0x556a4d367a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.847+0000 7f7121e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d360df0 0x556a4d369ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46666/0 (socket says 172.21.15.8:46666) 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.847+0000 7f7121e00640 1 -- 172.21.15.8:0/3084652640 learned_addr learned my addr 172.21.15.8:0/3084652640 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:05.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.847+0000 7f7121e00640 1 --2- 172.21.15.8:0/3084652640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d36a2f0 0x556a4d375670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.847+0000 7f7120a00640 1 -- 172.21.15.8:0/3084652640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d360df0 msgr2=0x556a4d369ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.847+0000 7f7120a00640 1 --2- 172.21.15.8:0/3084652640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d360df0 0x556a4d369ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.847+0000 7f7120a00640 1 -- 172.21.15.8:0/3084652640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d36a2f0 msgr2=0x556a4d375670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.847+0000 7f7120a00640 1 --2- 172.21.15.8:0/3084652640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d36a2f0 0x556a4d375670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.847+0000 7f7120a00640 1 -- 172.21.15.8:0/3084652640 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a4d262ab0 con 0x556a4d361710 2024-03-16T21:02:05.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.847+0000 7f7120a00640 1 --2- 172.21.15.8:0/3084652640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d361710 0x556a4d367a60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f710801c8d0 tx=0x7f71080096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afa3508f57717955 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.848+0000 7f710dc00640 1 -- 172.21.15.8:0/3084652640 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108017040 con 0x556a4d361710 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.848+0000 7f710dc00640 1 -- 172.21.15.8:0/3084652640 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f710801de30 con 0x556a4d361710 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.848+0000 7f710dc00640 1 -- 172.21.15.8:0/3084652640 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108005790 con 0x556a4d361710 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.848+0000 7f7126bb2740 1 -- 172.21.15.8:0/3084652640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d361710 msgr2=0x556a4d367a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.848+0000 7f7126bb2740 1 --2- 172.21.15.8:0/3084652640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d361710 0x556a4d367a60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f710801c8d0 tx=0x7f71080096c0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.848+0000 7f7126bb2740 1 -- 172.21.15.8:0/3084652640 shutdown_connections 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.848+0000 7f7126bb2740 1 --2- 172.21.15.8:0/3084652640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d36a2f0 0x556a4d375670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.848+0000 7f7126bb2740 1 --2- 172.21.15.8:0/3084652640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d361710 0x556a4d367a60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.848+0000 7f7126bb2740 1 --2- 172.21.15.8:0/3084652640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d360df0 0x556a4d369ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.848+0000 7f7126bb2740 1 -- 172.21.15.8:0/3084652640 >> 172.21.15.8:0/3084652640 conn(0x556a4d35b520 msgr2=0x556a4d367350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.848+0000 7f7126bb2740 1 -- 172.21.15.8:0/3084652640 shutdown_connections 2024-03-16T21:02:05.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.849+0000 7f7126bb2740 1 -- 172.21.15.8:0/3084652640 wait complete. 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.849+0000 7f7126bb2740 1 -- start start 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.849+0000 7f7126bb2740 1 Processor -- start 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.849+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d3ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 0x556a4d3ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7126bb2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d36a2f0 0x556a4d36de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7126bb2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d36e410 con 0x556a4d361710 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7126bb2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d36e580 con 0x556a4d360df0 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7126bb2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4d36e740 con 0x556a4d36a2f0 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7126bb2740 10 client.0 _ll_register_callbacks cb 0x7f7108009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7121e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d3ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7120a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 0x556a4d3ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7120a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 0x556a4d3ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56316/0 (socket says 172.21.15.8:56316) 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7120a00640 1 -- 172.21.15.8:0/3902567669 learned_addr learned my addr 172.21.15.8:0/3902567669 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:05.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7121e00640 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d36a2f0 0x556a4d36de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7120a00640 1 -- 172.21.15.8:0/3902567669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d36a2f0 msgr2=0x556a4d36de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7120a00640 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d36a2f0 0x556a4d36de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7120a00640 1 -- 172.21.15.8:0/3902567669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 msgr2=0x556a4d3ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7120a00640 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d3ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7120a00640 1 -- 172.21.15.8:0/3902567669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a4d2c65a0 con 0x556a4d361710 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.850+0000 7f7121e00640 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d36a2f0 0x556a4d36de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.851+0000 7f7120a00640 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 0x556a4d3ce590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f710801c850 tx=0x7f710801c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61eafb158ca6c67 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.851+0000 7f7102a00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.851+0000 7f7102a00640 1 -- 172.21.15.8:0/3902567669 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108017030 con 0x556a4d361710 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.851+0000 7f7102a00640 1 -- 172.21.15.8:0/3902567669 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7108000e40 con 0x556a4d361710 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.851+0000 7f7126bb2740 1 -- 172.21.15.8:0/3902567669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7114011940 con 0x556a4d361710 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.851+0000 7f7102a00640 1 -- 172.21.15.8:0/3902567669 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f710800f920 con 0x556a4d361710 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.851+0000 7f7126bb2740 10 client.16317 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.851+0000 7f7126bb2740 1 -- 172.21.15.8:0/3902567669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x556a4d288650 con 0x556a4d361710 2024-03-16T21:02:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.851+0000 7f7102a00640 1 -- 172.21.15.8:0/3902567669 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7114011940 con 0x556a4d361710 2024-03-16T21:02:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.852+0000 7f7102a00640 1 -- 172.21.15.8:0/3902567669 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f7108003710 con 0x556a4d361710 2024-03-16T21:02:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.852+0000 7f7126bb2740 10 client.16317 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.852+0000 7f7126bb2740 10 client.16317 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:02:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.852+0000 7f7126bb2740 20 client.16317 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.852+0000 7f7126bb2740 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556a4d3d6cf0 0x556a4d3d9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.852+0000 7f7126bb2740 4 client.16317 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:02:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.852+0000 7f7126bb2740 1 -- 172.21.15.8:0/3902567669 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556a4d053890 con 0x556a4d3d6cf0 2024-03-16T21:02:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.852+0000 7f7121e00640 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556a4d3d6cf0 0x556a4d3d9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7121e00640 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556a4d3d6cf0 0x556a4d3d9110 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=de3a230e7cc20221 server_cookie=50a894f314f4c093 in_seq=0 out_seq=0 2024-03-16T21:02:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7102a00640 10 client.16317 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7102a00640 1 -- 172.21.15.8:0/3902567669 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556a4d053890 con 0x556a4d3d6cf0 2024-03-16T21:02:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7102a00640 10 client.16317 handle_command_reply: tid=0 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 1 client.16317 shutdown 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 1 -- 172.21.15.8:0/3902567669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 msgr2=0x556a4d3ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 0x556a4d3ce590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f710801c850 tx=0x7f710801c6c0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 1 -- 172.21.15.8:0/3902567669 shutdown_connections 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x556a4d3d6cf0 0x556a4d3d9110 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556a4d36a2f0 0x556a4d36de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556a4d361710 0x556a4d3ce590 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7102a00640 0 client.16317 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 1 --2- 172.21.15.8:0/3902567669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556a4d360df0 0x556a4d3ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 1 -- 172.21.15.8:0/3902567669 >> 172.21.15.8:0/3902567669 conn(0x556a4d35b520 msgr2=0x556a4d35a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 1 -- 172.21.15.8:0/3902567669 shutdown_connections 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 1 -- 172.21.15.8:0/3902567669 wait complete. 2024-03-16T21:02:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.853+0000 7f7126bb2740 20 client.16317 trim_cache size 0 max 16384 2024-03-16T21:02:05.863 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:02:05.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 -- 172.21.15.8:0/2508727218 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f71040a1ba0 msgr2=0x7f71040a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f71040a1ba0 0x7f71040a4060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x556a4d3608c0 tx=0x7f71100f3810 comp rx=0 tx=0).stop 2024-03-16T21:02:05.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 -- 172.21.15.8:0/2508727218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711c103590 msgr2=0x7f711c19f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:05.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711c103590 0x7f711c19f8d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7110005ab0 tx=0x7f711002cc10 comp rx=0 tx=0).stop 2024-03-16T21:02:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 -- 172.21.15.8:0/2508727218 shutdown_connections 2024-03-16T21:02:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f71040a1ba0 0x7f71040a4060 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c109650 0x7f711c199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f711c103f50 0x7f711c19fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 --2- 172.21.15.8:0/2508727218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711c103590 0x7f711c19f8d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 -- 172.21.15.8:0/2508727218 >> 172.21.15.8:0/2508727218 conn(0x7f711c0ff020 msgr2=0x7f711c1005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 -- 172.21.15.8:0/2508727218 shutdown_connections 2024-03-16T21:02:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:05.854+0000 7f7122800640 1 -- 172.21.15.8:0/2508727218 wait complete. 2024-03-16T21:02:05.876 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:02:05.877 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:02:06.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.081+0000 7f9fdfc00640 1 -- 172.21.15.8:0/2369932254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fd810a1c0 msgr2=0x7f9fd80ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.081+0000 7f9fdfc00640 1 --2- 172.21.15.8:0/2369932254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fd810a1c0 0x7f9fd80ff5c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009900 tx=0x7f9fc802bc30 comp rx=0 tx=0).stop 2024-03-16T21:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.081+0000 7f9fdfc00640 1 -- 172.21.15.8:0/2369932254 shutdown_connections 2024-03-16T21:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.081+0000 7f9fdfc00640 1 --2- 172.21.15.8:0/2369932254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fd80ffcf0 0x7f9fd8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.081+0000 7f9fdfc00640 1 --2- 172.21.15.8:0/2369932254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fd810a1c0 0x7f9fd80ff5c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.081+0000 7f9fdfc00640 1 --2- 172.21.15.8:0/2369932254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fd8109810 0x7f9fd8109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.081+0000 7f9fdfc00640 1 -- 172.21.15.8:0/2369932254 >> 172.21.15.8:0/2369932254 conn(0x7f9fd8076540 msgr2=0x7f9fd80fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.082+0000 7f9fdfc00640 1 -- 172.21.15.8:0/2369932254 shutdown_connections 2024-03-16T21:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.082+0000 7f9fdfc00640 1 -- 172.21.15.8:0/2369932254 wait complete. 2024-03-16T21:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.083+0000 7f9fdfc00640 1 Processor -- start 2024-03-16T21:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.083+0000 7f9fdfc00640 1 -- start start 2024-03-16T21:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.083+0000 7f9fdfc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fd80ffcf0 0x7f9fd8103240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.083+0000 7f9fdfc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fd8109810 0x7f9fd8103780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.083+0000 7f9fdfc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fd8103cc0 0x7f9fd81aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.083+0000 7f9fdfc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8107420 con 0x7f9fd80ffcf0 2024-03-16T21:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.083+0000 7f9fdfc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd81aa910 con 0x7f9fd8109810 2024-03-16T21:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.083+0000 7f9fdfc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd81aaad0 con 0x7f9fd8103cc0 2024-03-16T21:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.084+0000 7f9fd7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fd8109810 0x7f9fd8103780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.084+0000 7f9fdd200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fd80ffcf0 0x7f9fd8103240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.084+0000 7f9fd7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fd8109810 0x7f9fd8103780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50698/0 (socket says 172.21.15.8:50698) 2024-03-16T21:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.084+0000 7f9fd7e00640 1 -- 172.21.15.8:0/3921448532 learned_addr learned my addr 172.21.15.8:0/3921448532 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.084+0000 7f9fddc00640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fd8103cc0 0x7f9fd81aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.084+0000 7f9fd7e00640 1 -- 172.21.15.8:0/3921448532 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fd8103cc0 msgr2=0x7f9fd81aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.084+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fd8103cc0 0x7f9fd81aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.084+0000 7f9fd7e00640 1 -- 172.21.15.8:0/3921448532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fd80ffcf0 msgr2=0x7f9fd8103240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.084+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fd80ffcf0 0x7f9fd8103240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.084+0000 7f9fd7e00640 1 -- 172.21.15.8:0/3921448532 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8009560 con 0x7f9fd8109810 2024-03-16T21:02:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.084+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fd8109810 0x7f9fd8103780 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8005ab0 tx=0x7f9fc802ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.085+0000 7f9fd5600640 1 -- 172.21.15.8:0/3921448532 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80042d0 con 0x7f9fd8109810 2024-03-16T21:02:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.085+0000 7f9fd5600640 1 -- 172.21.15.8:0/3921448532 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9fc8004430 con 0x7f9fd8109810 2024-03-16T21:02:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.085+0000 7f9fdfc00640 1 -- 172.21.15.8:0/3921448532 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd81aad50 con 0x7f9fd8109810 2024-03-16T21:02:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.085+0000 7f9fd5600640 1 -- 172.21.15.8:0/3921448532 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8003d30 con 0x7f9fd8109810 2024-03-16T21:02:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.085+0000 7f9fdfc00640 1 -- 172.21.15.8:0/3921448532 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd81ab200 con 0x7f9fd8109810 2024-03-16T21:02:06.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.088+0000 7f9fd5600640 1 -- 172.21.15.8:0/3921448532 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f9fc8004e10 con 0x7f9fd8109810 2024-03-16T21:02:06.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.088+0000 7f9fe2829740 1 Processor -- start 2024-03-16T21:02:06.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.088+0000 7f9fe2829740 1 -- start start 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.088+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d393c40 0x56459d394020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.088+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d394560 0x56459d39cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.088+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d39f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.088+0000 7f9fe2829740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d302210 con 0x56459d39d140 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fe2829740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d2ff740 con 0x56459d394560 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fe2829740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d2faf20 con 0x56459d393c40 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fddc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d393c40 0x56459d394020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fdd200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d394560 0x56459d39cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fddc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d393c40 0x56459d394020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46702/0 (socket says 172.21.15.8:46702) 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fddc00640 1 -- 172.21.15.8:0/859447011 learned_addr learned my addr 172.21.15.8:0/859447011 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/859447011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d39f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fddc00640 1 -- 172.21.15.8:0/859447011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d394560 msgr2=0x56459d39cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fddc00640 1 --2- 172.21.15.8:0/859447011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d394560 0x56459d39cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fddc00640 1 -- 172.21.15.8:0/859447011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 msgr2=0x56459d39f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fddc00640 1 --2- 172.21.15.8:0/859447011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d39f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fddc00640 1 -- 172.21.15.8:0/859447011 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459d2bcdf0 con 0x56459d393c40 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/859447011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d39f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.089+0000 7f9fdd200640 1 --2- 172.21.15.8:0/859447011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d394560 0x56459d39cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.090+0000 7f9fd5600640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9fc00a1ba0 0x7f9fc00a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.090+0000 7f9fddc00640 1 --2- 172.21.15.8:0/859447011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d393c40 0x56459d394020 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0010370 tx=0x7f9fd0010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=945a9fa941e84737 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.090+0000 7f9fc6000640 1 -- 172.21.15.8:0/859447011 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0004d20 con 0x56459d393c40 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.090+0000 7f9fd5600640 1 -- 172.21.15.8:0/3921448532 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9fc80ef740 con 0x7f9fd8109810 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.090+0000 7f9fc6000640 1 -- 172.21.15.8:0/859447011 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9fd0004e80 con 0x56459d393c40 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.090+0000 7f9fc6000640 1 -- 172.21.15.8:0/859447011 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0005660 con 0x56459d393c40 2024-03-16T21:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.090+0000 7f9fdd200640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9fc00a1ba0 0x7f9fc00a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.090+0000 7f9fe2829740 1 -- 172.21.15.8:0/859447011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d393c40 msgr2=0x56459d394020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.090+0000 7f9fe2829740 1 --2- 172.21.15.8:0/859447011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d393c40 0x56459d394020 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0010370 tx=0x7f9fd0010830 comp rx=0 tx=0).stop 2024-03-16T21:02:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.091+0000 7f9fe2829740 1 -- 172.21.15.8:0/859447011 shutdown_connections 2024-03-16T21:02:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.091+0000 7f9fe2829740 1 --2- 172.21.15.8:0/859447011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d39f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.091+0000 7f9fe2829740 1 --2- 172.21.15.8:0/859447011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d394560 0x56459d39cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.091+0000 7f9fe2829740 1 --2- 172.21.15.8:0/859447011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d393c40 0x56459d394020 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.091+0000 7f9fe2829740 1 -- 172.21.15.8:0/859447011 >> 172.21.15.8:0/859447011 conn(0x56459d38e370 msgr2=0x56459d38e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.091+0000 7f9fdd200640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9fc00a1ba0 0x7f9fc00a4060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x56459d393710 tx=0x7f9fcc00b390 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.091+0000 7f9fe2829740 1 -- 172.21.15.8:0/859447011 shutdown_connections 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.091+0000 7f9fe2829740 1 -- 172.21.15.8:0/859447011 wait complete. 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.091+0000 7f9fe2829740 1 -- start start 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.091+0000 7f9fe2829740 1 Processor -- start 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d393c40 0x56459d39a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d39aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fe2829740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d2a0150 con 0x56459d39d140 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fe2829740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d29fdf0 con 0x56459d393c40 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fe2829740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d0691c0 con 0x56459d394560 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fe2829740 10 client.0 _ll_register_callbacks cb 0x56459d2ef2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fdd200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d393c40 0x56459d39a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fd7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fdd200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d393c40 0x56459d39a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50712/0 (socket says 172.21.15.8:50712) 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fdd200640 1 -- 172.21.15.8:0/3985225779 learned_addr learned my addr 172.21.15.8:0/3985225779 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fd7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46712/0 (socket says 172.21.15.8:46712) 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.092+0000 7f9fddc00640 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d39aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fd7e00640 1 -- 172.21.15.8:0/3985225779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d393c40 msgr2=0x56459d39a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d393c40 0x56459d39a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fd7e00640 1 -- 172.21.15.8:0/3985225779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 msgr2=0x56459d39aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d39aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fd7e00640 1 -- 172.21.15.8:0/3985225779 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd0009c50 con 0x56459d394560 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fddc00640 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d39aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a660 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80ecf70 tx=0x7f9fc8003e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84020b933485e471 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fbaa00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3985225779 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80ed2e0 con 0x56459d394560 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3985225779 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9fc80035f0 con 0x56459d394560 2024-03-16T21:02:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fe2829740 1 -- 172.21.15.8:0/3985225779 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56459d037720 con 0x56459d394560 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3985225779 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fc80bc220 con 0x56459d394560 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fe2829740 10 client.26503 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.093+0000 7f9fe2829740 1 -- 172.21.15.8:0/3985225779 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56459d2f95a0 con 0x56459d394560 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.094+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3985225779 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x56459d037720 con 0x56459d394560 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.094+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3985225779 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f9fc803c070 con 0x56459d394560 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.094+0000 7f9fe2829740 10 client.26503 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.094+0000 7f9fe2829740 10 client.26503 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.094+0000 7f9fe2829740 20 client.26503 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.094+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56459d3ad010 0x56459d3af430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.094+0000 7f9fe2829740 4 client.26503 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.094+0000 7f9fe2829740 1 -- 172.21.15.8:0/3985225779 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56459d086890 con 0x56459d3ad010 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.094+0000 7f9fdd200640 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56459d3ad010 0x56459d3af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.095+0000 7f9fdd200640 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56459d3ad010 0x56459d3af430 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=935ec2c79712c6e0 server_cookie=36fd9522a89ec0d3 in_seq=0 out_seq=0 2024-03-16T21:02:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.095+0000 7f9fbaa00640 10 client.26503 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3985225779 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56459d086890 con 0x56459d3ad010 2024-03-16T21:02:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fbaa00640 10 client.26503 handle_command_reply: tid=0 2024-03-16T21:02:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fe2829740 1 client.26503 shutdown 2024-03-16T21:02:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fe2829740 1 -- 172.21.15.8:0/3985225779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 msgr2=0x56459d39a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a660 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80ecf70 tx=0x7f9fc8003e90 comp rx=0 tx=0).stop 2024-03-16T21:02:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fe2829740 1 -- 172.21.15.8:0/3985225779 shutdown_connections 2024-03-16T21:02:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56459d3ad010 0x56459d3af430 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d39aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a660 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fbaa00640 0 client.26503 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3985225779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d393c40 0x56459d39a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fe2829740 1 -- 172.21.15.8:0/3985225779 >> 172.21.15.8:0/3985225779 conn(0x56459d38e370 msgr2=0x56459d3900c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fe2829740 1 -- 172.21.15.8:0/3985225779 shutdown_connections 2024-03-16T21:02:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.096+0000 7f9fe2829740 1 -- 172.21.15.8:0/3985225779 wait complete. 2024-03-16T21:02:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.097+0000 7f9fe2829740 20 client.26503 trim_cache size 0 max 16384 2024-03-16T21:02:06.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.110+0000 7f9fe2829740 1 Processor -- start 2024-03-16T21:02:06.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.110+0000 7f9fe2829740 1 -- start start 2024-03-16T21:02:06.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.110+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d393c40 0x56459d39c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.110+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d3a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fe2829740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d395d70 con 0x56459d39d140 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fe2829740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d389aa0 con 0x56459d393c40 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fe2829740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d3afa90 con 0x56459d394560 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fd7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fd7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46716/0 (socket says 172.21.15.8:46716) 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fd7e00640 1 -- 172.21.15.8:0/2684433253 learned_addr learned my addr 172.21.15.8:0/2684433253 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fdd200640 1 --2- 172.21.15.8:0/2684433253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d393c40 0x56459d39c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fddc00640 1 --2- 172.21.15.8:0/2684433253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d3a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fd7e00640 1 -- 172.21.15.8:0/2684433253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d393c40 msgr2=0x56459d39c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/2684433253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d393c40 0x56459d39c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fd7e00640 1 -- 172.21.15.8:0/2684433253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 msgr2=0x56459d3a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/2684433253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d3a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fd7e00640 1 -- 172.21.15.8:0/2684433253 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459d295ab0 con 0x56459d394560 2024-03-16T21:02:06.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fddc00640 1 --2- 172.21.15.8:0/2684433253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d3a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:02:06.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.111+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/2684433253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a9c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80b8e20 tx=0x7f9fc80057e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12addf92dfab2e4e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fc5600640 1 -- 172.21.15.8:0/2684433253 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80ed250 con 0x56459d394560 2024-03-16T21:02:06.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fc5600640 1 -- 172.21.15.8:0/2684433253 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9fc80bbdb0 con 0x56459d394560 2024-03-16T21:02:06.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fc5600640 1 -- 172.21.15.8:0/2684433253 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80c49c0 con 0x56459d394560 2024-03-16T21:02:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fe2829740 1 -- 172.21.15.8:0/2684433253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 msgr2=0x56459d39a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fe2829740 1 --2- 172.21.15.8:0/2684433253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a9c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80b8e20 tx=0x7f9fc80057e0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fe2829740 1 -- 172.21.15.8:0/2684433253 shutdown_connections 2024-03-16T21:02:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fe2829740 1 --2- 172.21.15.8:0/2684433253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d39d140 0x56459d3a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fe2829740 1 --2- 172.21.15.8:0/2684433253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d39a9c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fe2829740 1 --2- 172.21.15.8:0/2684433253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d393c40 0x56459d39c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fe2829740 1 -- 172.21.15.8:0/2684433253 >> 172.21.15.8:0/2684433253 conn(0x56459d38e370 msgr2=0x56459d38d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fe2829740 1 -- 172.21.15.8:0/2684433253 shutdown_connections 2024-03-16T21:02:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.112+0000 7f9fe2829740 1 -- 172.21.15.8:0/2684433253 wait complete. 2024-03-16T21:02:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.113+0000 7f9fe2829740 1 -- start start 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.113+0000 7f9fe2829740 1 Processor -- start 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.113+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d393c40 0x56459d396f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.113+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d397440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.113+0000 7f9fe2829740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d39d140 0x56459d4078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.113+0000 7f9fe2829740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d407e00 con 0x56459d393c40 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.113+0000 7f9fe2829740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d407f40 con 0x56459d39d140 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.113+0000 7f9fe2829740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459d4080d0 con 0x56459d394560 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fe2829740 10 client.0 _ll_register_callbacks cb 0x7f9fc80b80b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fd7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d397440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fd7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d397440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46732/0 (socket says 172.21.15.8:46732) 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fd7e00640 1 -- 172.21.15.8:0/3147462923 learned_addr learned my addr 172.21.15.8:0/3147462923 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fddc00640 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d39d140 0x56459d4078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fdd200640 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d393c40 0x56459d396f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fd7e00640 1 -- 172.21.15.8:0/3147462923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d39d140 msgr2=0x56459d4078c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d39d140 0x56459d4078c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fd7e00640 1 -- 172.21.15.8:0/3147462923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d393c40 msgr2=0x56459d396f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d393c40 0x56459d396f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fd7e00640 1 -- 172.21.15.8:0/3147462923 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56459d2f95a0 con 0x56459d394560 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fdd200640 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d393c40 0x56459d396f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fd7e00640 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d397440 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9fc802c4e0 tx=0x7f9fc80f5240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc64f3761dc9a46 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.114+0000 7f9fbaa00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3147462923 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80c02f0 con 0x56459d394560 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3147462923 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9fc80035f0 con 0x56459d394560 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fe2829740 1 -- 172.21.15.8:0/3147462923 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56459cffa7e0 con 0x56459d394560 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3147462923 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fc80bbf90 con 0x56459d394560 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fe2829740 10 client.26509 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fe2829740 1 -- 172.21.15.8:0/3147462923 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56459d2bb650 con 0x56459d394560 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3147462923 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x56459cffa7e0 con 0x56459d394560 2024-03-16T21:02:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3147462923 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f9fc80d8070 con 0x56459d394560 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fe2829740 10 client.26509 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fe2829740 10 client.26509 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fe2829740 20 client.26509 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56459d409330 0x56459d40b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fe2829740 4 client.26509 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.115+0000 7f9fe2829740 1 -- 172.21.15.8:0/3147462923 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56459cfe94e0 con 0x56459d409330 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.116+0000 7f9fdd200640 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56459d409330 0x56459d40b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.116+0000 7f9fdd200640 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56459d409330 0x56459d40b720 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=64ab0ca4a0eb848e server_cookie=c370b4262ac6ddf2 in_seq=0 out_seq=0 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.116+0000 7f9fbaa00640 10 client.26509 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.116+0000 7f9fbaa00640 1 -- 172.21.15.8:0/3147462923 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56459cfe94e0 con 0x56459d409330 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.116+0000 7f9fbaa00640 10 client.26509 handle_command_reply: tid=0 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.116+0000 7f9fe2829740 1 client.26509 shutdown 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.116+0000 7f9fe2829740 1 -- 172.21.15.8:0/3147462923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 msgr2=0x56459d397440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.116+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d397440 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9fc802c4e0 tx=0x7f9fc80f5240 comp rx=0 tx=0).stop 2024-03-16T21:02:06.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fe2829740 1 -- 172.21.15.8:0/3147462923 shutdown_connections 2024-03-16T21:02:06.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56459d409330 0x56459d40b720 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56459d39d140 0x56459d4078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56459d394560 0x56459d397440 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fe2829740 1 --2- 172.21.15.8:0/3147462923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56459d393c40 0x56459d396f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fe2829740 1 -- 172.21.15.8:0/3147462923 >> 172.21.15.8:0/3147462923 conn(0x56459d38e370 msgr2=0x56459d3b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fbaa00640 0 client.26509 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:06.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fe2829740 1 -- 172.21.15.8:0/3147462923 shutdown_connections 2024-03-16T21:02:06.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fe2829740 1 -- 172.21.15.8:0/3147462923 wait complete. 2024-03-16T21:02:06.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fe2829740 20 client.26509 trim_cache size 0 max 16384 2024-03-16T21:02:06.127 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:02:06.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fdfc00640 1 -- 172.21.15.8:0/3921448532 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9fc00a1ba0 msgr2=0x7f9fc00a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fdfc00640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9fc00a1ba0 0x7f9fc00a4060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x56459d393710 tx=0x7f9fcc00b390 comp rx=0 tx=0).stop 2024-03-16T21:02:06.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fdfc00640 1 -- 172.21.15.8:0/3921448532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fd8109810 msgr2=0x7f9fd8103780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.117+0000 7f9fdfc00640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fd8109810 0x7f9fd8103780 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8005ab0 tx=0x7f9fc802ce50 comp rx=0 tx=0).stop 2024-03-16T21:02:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.118+0000 7f9fdfc00640 1 -- 172.21.15.8:0/3921448532 shutdown_connections 2024-03-16T21:02:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.118+0000 7f9fdfc00640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9fc00a1ba0 0x7f9fc00a4060 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.118+0000 7f9fdfc00640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fd8103cc0 0x7f9fd81aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.118+0000 7f9fdfc00640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fd8109810 0x7f9fd8103780 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.118+0000 7f9fdfc00640 1 --2- 172.21.15.8:0/3921448532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9fd80ffcf0 0x7f9fd8103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.118+0000 7f9fdfc00640 1 -- 172.21.15.8:0/3921448532 >> 172.21.15.8:0/3921448532 conn(0x7f9fd8076540 msgr2=0x7f9fd81010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.118+0000 7f9fdfc00640 1 -- 172.21.15.8:0/3921448532 shutdown_connections 2024-03-16T21:02:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.118+0000 7f9fdfc00640 1 -- 172.21.15.8:0/3921448532 wait complete. 2024-03-16T21:02:06.141 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:02:06.141 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:02:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.364+0000 7f8340e00640 1 -- 172.21.15.8:0/594079576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f833c103f50 msgr2=0x7f833c110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.364+0000 7f8340e00640 1 --2- 172.21.15.8:0/594079576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f833c103f50 0x7f833c110410 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8334009cd0 tx=0x7f833402c0f0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.364+0000 7f8340e00640 1 -- 172.21.15.8:0/594079576 shutdown_connections 2024-03-16T21:02:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.364+0000 7f8340e00640 1 --2- 172.21.15.8:0/594079576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f833c103f50 0x7f833c110410 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.364+0000 7f8340e00640 1 --2- 172.21.15.8:0/594079576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f833c103590 0x7f833c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.364+0000 7f8340e00640 1 --2- 172.21.15.8:0/594079576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f833c109650 0x7f833c109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.364+0000 7f8340e00640 1 -- 172.21.15.8:0/594079576 >> 172.21.15.8:0/594079576 conn(0x7f833c0ff000 msgr2=0x7f833c101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.364+0000 7f8340e00640 1 -- 172.21.15.8:0/594079576 shutdown_connections 2024-03-16T21:02:06.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.364+0000 7f8340e00640 1 -- 172.21.15.8:0/594079576 wait complete. 2024-03-16T21:02:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.365+0000 7f8340e00640 1 Processor -- start 2024-03-16T21:02:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f8340e00640 1 -- start start 2024-03-16T21:02:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f8340e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f833c103590 0x7f833c199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f8340e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f833c103f50 0x7f833c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f8340e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f833c109650 0x7f833c19e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f8340e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c19edb0 con 0x7f833c109650 2024-03-16T21:02:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f8340e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c19ef20 con 0x7f833c103590 2024-03-16T21:02:06.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f8340e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c19f0e0 con 0x7f833c103f50 2024-03-16T21:02:06.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f833b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f833c103590 0x7f833c199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f833aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f833c103f50 0x7f833c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f833be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f833c109650 0x7f833c19e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f833b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f833c103590 0x7f833c199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50750/0 (socket says 172.21.15.8:50750) 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f833aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f833c103f50 0x7f833c19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46740/0 (socket says 172.21.15.8:46740) 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.366+0000 7f833b400640 1 -- 172.21.15.8:0/106883501 learned_addr learned my addr 172.21.15.8:0/106883501 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.367+0000 7f833b400640 1 -- 172.21.15.8:0/106883501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f833c103f50 msgr2=0x7f833c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.367+0000 7f833b400640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f833c103f50 0x7f833c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.367+0000 7f833b400640 1 -- 172.21.15.8:0/106883501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f833c109650 msgr2=0x7f833c19e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.367+0000 7f833b400640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f833c109650 0x7f833c19e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.367+0000 7f833b400640 1 -- 172.21.15.8:0/106883501 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8328009490 con 0x7f833c103590 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.367+0000 7f833aa00640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f833c103f50 0x7f833c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.367+0000 7f833b400640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f833c103590 0x7f833c199ef0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f832c00e9f0 tx=0x7f832c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.367+0000 7f8333e00640 1 -- 172.21.15.8:0/106883501 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c009700 con 0x7f833c103590 2024-03-16T21:02:06.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.367+0000 7f8333e00640 1 -- 172.21.15.8:0/106883501 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f832c00cd80 con 0x7f833c103590 2024-03-16T21:02:06.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.367+0000 7f8340e00640 1 -- 172.21.15.8:0/106883501 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8334009900 con 0x7f833c103590 2024-03-16T21:02:06.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.368+0000 7f8333e00640 1 -- 172.21.15.8:0/106883501 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c0189c0 con 0x7f833c103590 2024-03-16T21:02:06.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.368+0000 7f8340e00640 1 -- 172.21.15.8:0/106883501 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c1a6a60 con 0x7f833c103590 2024-03-16T21:02:06.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.371+0000 7f8345173740 1 Processor -- start 2024-03-16T21:02:06.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.371+0000 7f8333e00640 1 -- 172.21.15.8:0/106883501 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f832c018b20 con 0x7f833c103590 2024-03-16T21:02:06.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.371+0000 7f8345173740 1 -- start start 2024-03-16T21:02:06.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.371+0000 7f8345173740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82394df0 0x560f823951d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.371+0000 7f8345173740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82395710 0x560f8239ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.371+0000 7f8345173740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 0x560f823a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.371+0000 7f8345173740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f82303210 con 0x560f82395710 2024-03-16T21:02:06.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.371+0000 7f8345173740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f82300740 con 0x560f82394df0 2024-03-16T21:02:06.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.371+0000 7f8345173740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f822fbf20 con 0x560f8239e2f0 2024-03-16T21:02:06.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.372+0000 7f833aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 0x560f823a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.372+0000 7f833b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82395710 0x560f8239ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.372+0000 7f833be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82394df0 0x560f823951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.372+0000 7f833aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 0x560f823a06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46756/0 (socket says 172.21.15.8:46756) 2024-03-16T21:02:06.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.372+0000 7f833aa00640 1 -- 172.21.15.8:0/3778411295 learned_addr learned my addr 172.21.15.8:0/3778411295 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:06.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.372+0000 7f833aa00640 1 -- 172.21.15.8:0/3778411295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82394df0 msgr2=0x560f823951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.372+0000 7f833aa00640 1 --2- 172.21.15.8:0/3778411295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82394df0 0x560f823951d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.372+0000 7f833aa00640 1 -- 172.21.15.8:0/3778411295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82395710 msgr2=0x560f8239ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.372+0000 7f833aa00640 1 --2- 172.21.15.8:0/3778411295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82395710 0x560f8239ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.372+0000 7f833aa00640 1 -- 172.21.15.8:0/3778411295 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f822bddf0 con 0x560f8239e2f0 2024-03-16T21:02:06.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.372+0000 7f833aa00640 1 --2- 172.21.15.8:0/3778411295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 0x560f823a06e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8328011680 tx=0x7f8328011b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd26b4b6fbacb11c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.373+0000 7f8333e00640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83200a1c20 0x7f83200a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.373+0000 7f8330c00640 1 -- 172.21.15.8:0/3778411295 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832800fba0 con 0x560f8239e2f0 2024-03-16T21:02:06.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.373+0000 7f8330c00640 1 -- 172.21.15.8:0/3778411295 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f832800fd00 con 0x560f8239e2f0 2024-03-16T21:02:06.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.373+0000 7f8330c00640 1 -- 172.21.15.8:0/3778411295 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832800e790 con 0x560f8239e2f0 2024-03-16T21:02:06.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.373+0000 7f8333e00640 1 -- 172.21.15.8:0/106883501 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f832c014070 con 0x7f833c103590 2024-03-16T21:02:06.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.373+0000 7f833be00640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83200a1c20 0x7f83200a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.373+0000 7f8345173740 1 -- 172.21.15.8:0/3778411295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 msgr2=0x560f823a06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.373+0000 7f8345173740 1 --2- 172.21.15.8:0/3778411295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 0x560f823a06e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8328011680 tx=0x7f8328011b40 comp rx=0 tx=0).stop 2024-03-16T21:02:06.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.374+0000 7f8345173740 1 -- 172.21.15.8:0/3778411295 shutdown_connections 2024-03-16T21:02:06.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.374+0000 7f8345173740 1 --2- 172.21.15.8:0/3778411295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 0x560f823a06e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.374+0000 7f8345173740 1 --2- 172.21.15.8:0/3778411295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82395710 0x560f8239ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.374+0000 7f8345173740 1 --2- 172.21.15.8:0/3778411295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82394df0 0x560f823951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.374+0000 7f8345173740 1 -- 172.21.15.8:0/3778411295 >> 172.21.15.8:0/3778411295 conn(0x560f8238f520 msgr2=0x560f8238f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.374+0000 7f8345173740 1 -- 172.21.15.8:0/3778411295 shutdown_connections 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.374+0000 7f8345173740 1 -- 172.21.15.8:0/3778411295 wait complete. 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.374+0000 7f833be00640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83200a1c20 0x7f83200a40e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f833402c630 tx=0x7f8334005d80 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.374+0000 7f8345173740 1 -- start start 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.374+0000 7f8345173740 1 Processor -- start 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f8345173740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 0x560f8239b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f8345173740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82395710 0x560f8239b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f8345173740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f8239e2f0 0x560f8239bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f8345173740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f822a1150 con 0x560f82394df0 2024-03-16T21:02:06.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f8345173740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f822a0df0 con 0x560f8239e2f0 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f8345173740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f8206a1c0 con 0x560f82395710 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f8345173740 10 client.0 _ll_register_callbacks cb 0x560f822f02b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f833aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82395710 0x560f8239b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f833be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f8239e2f0 0x560f8239bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f833b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 0x560f8239b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f833aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82395710 0x560f8239b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46762/0 (socket says 172.21.15.8:46762) 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f833aa00640 1 -- 172.21.15.8:0/4175657846 learned_addr learned my addr 172.21.15.8:0/4175657846 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.375+0000 7f833be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f8239e2f0 0x560f8239bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50756/0 (socket says 172.21.15.8:50756) 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.376+0000 7f833aa00640 1 -- 172.21.15.8:0/4175657846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f8239e2f0 msgr2=0x560f8239bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.376+0000 7f833aa00640 1 --2- 172.21.15.8:0/4175657846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f8239e2f0 0x560f8239bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.376+0000 7f833aa00640 1 -- 172.21.15.8:0/4175657846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 msgr2=0x560f8239b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.376+0000 7f833aa00640 1 --2- 172.21.15.8:0/4175657846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 0x560f8239b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.376+0000 7f833aa00640 1 -- 172.21.15.8:0/4175657846 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8328009e50 con 0x560f82395710 2024-03-16T21:02:06.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.376+0000 7f833aa00640 1 --2- 172.21.15.8:0/4175657846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82395710 0x560f8239b7c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f83280058c0 tx=0x7f8328019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6715bfbded69175 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.376+0000 7f8325600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.376+0000 7f8325600640 1 -- 172.21.15.8:0/4175657846 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328019cc0 con 0x560f82395710 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.376+0000 7f8345173740 1 -- 172.21.15.8:0/4175657846 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f81ffb7e0 con 0x560f82395710 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.376+0000 7f8325600640 1 -- 172.21.15.8:0/4175657846 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8328004030 con 0x560f82395710 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.377+0000 7f8325600640 1 -- 172.21.15.8:0/4175657846 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83280041f0 con 0x560f82395710 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.377+0000 7f8345173740 10 client.26521 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.377+0000 7f8345173740 1 -- 172.21.15.8:0/4175657846 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560f822fa5a0 con 0x560f82395710 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.377+0000 7f8325600640 1 -- 172.21.15.8:0/4175657846 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x560f81ffb7e0 con 0x560f82395710 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.377+0000 7f8325600640 1 -- 172.21.15.8:0/4175657846 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f832800e490 con 0x560f82395710 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.377+0000 7f8345173740 10 client.26521 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.377+0000 7f8345173740 10 client.26521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.377+0000 7f8345173740 20 client.26521 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:06.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.377+0000 7f8345173740 1 --2- 172.21.15.8:0/4175657846 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560f823ae210 0x560f823b0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.377+0000 7f8345173740 4 client.26521 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:06.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.377+0000 7f8345173740 1 -- 172.21.15.8:0/4175657846 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f82038720 con 0x560f823ae210 2024-03-16T21:02:06.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.378+0000 7f833b400640 1 --2- 172.21.15.8:0/4175657846 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560f823ae210 0x560f823b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.378+0000 7f833b400640 1 --2- 172.21.15.8:0/4175657846 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560f823ae210 0x560f823b0650 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=585ceef5992614b3 server_cookie=e1188ffca2cb8d84 in_seq=0 out_seq=0 2024-03-16T21:02:06.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.378+0000 7f8325600640 10 client.26521 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:06.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8325600640 1 -- 172.21.15.8:0/4175657846 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560f82038720 con 0x560f823ae210 2024-03-16T21:02:06.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8325600640 10 client.26521 handle_command_reply: tid=0 2024-03-16T21:02:06.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 1 client.26521 shutdown 2024-03-16T21:02:06.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 1 -- 172.21.15.8:0/4175657846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82395710 msgr2=0x560f8239b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 1 --2- 172.21.15.8:0/4175657846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82395710 0x560f8239b7c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f83280058c0 tx=0x7f8328019660 comp rx=0 tx=0).stop 2024-03-16T21:02:06.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 1 -- 172.21.15.8:0/4175657846 shutdown_connections 2024-03-16T21:02:06.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 1 --2- 172.21.15.8:0/4175657846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f8239e2f0 0x560f8239bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 1 --2- 172.21.15.8:0/4175657846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82395710 0x560f8239b7c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 1 --2- 172.21.15.8:0/4175657846 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560f823ae210 0x560f823b0650 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 1 --2- 172.21.15.8:0/4175657846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 0x560f8239b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 1 -- 172.21.15.8:0/4175657846 >> 172.21.15.8:0/4175657846 conn(0x560f8238f520 msgr2=0x560f82391270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8325600640 0 client.26521 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:06.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 1 -- 172.21.15.8:0/4175657846 shutdown_connections 2024-03-16T21:02:06.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 1 -- 172.21.15.8:0/4175657846 wait complete. 2024-03-16T21:02:06.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.379+0000 7f8345173740 20 client.26521 trim_cache size 0 max 16384 2024-03-16T21:02:06.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.393+0000 7f8345173740 1 Processor -- start 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.393+0000 7f8345173740 1 -- start start 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f8345173740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 0x560f8239d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f8345173740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82395710 0x560f8238a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f8345173740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 0x560f8239bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f8345173740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f82393fd0 con 0x560f82394df0 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f8345173740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f8238aa90 con 0x560f82395710 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f8345173740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f82390750 con 0x560f8239e2f0 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f833b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 0x560f8239d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f833be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 0x560f8239bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f833b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 0x560f8239d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56406/0 (socket says 172.21.15.8:56406) 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f833b400640 1 -- 172.21.15.8:0/1795795562 learned_addr learned my addr 172.21.15.8:0/1795795562 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:06.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f833aa00640 1 --2- 172.21.15.8:0/1795795562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82395710 0x560f8238a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f833b400640 1 -- 172.21.15.8:0/1795795562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 msgr2=0x560f8239bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f833b400640 1 --2- 172.21.15.8:0/1795795562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 0x560f8239bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f833b400640 1 -- 172.21.15.8:0/1795795562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82395710 msgr2=0x560f8238a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f833b400640 1 --2- 172.21.15.8:0/1795795562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82395710 0x560f8238a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.394+0000 7f833b400640 1 -- 172.21.15.8:0/1795795562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f82296ab0 con 0x560f82394df0 2024-03-16T21:02:06.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.395+0000 7f833b400640 1 --2- 172.21.15.8:0/1795795562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 0x560f8239d9b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f832c09a750 tx=0x7f832c0cfdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fddac678562ea8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.395+0000 7f8327e00640 1 -- 172.21.15.8:0/1795795562 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c09a300 con 0x560f82394df0 2024-03-16T21:02:06.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.395+0000 7f8327e00640 1 -- 172.21.15.8:0/1795795562 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f832c09a120 con 0x560f82394df0 2024-03-16T21:02:06.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.395+0000 7f8327e00640 1 -- 172.21.15.8:0/1795795562 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c096e30 con 0x560f82394df0 2024-03-16T21:02:06.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.396+0000 7f8345173740 1 -- 172.21.15.8:0/1795795562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 msgr2=0x560f8239d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.396+0000 7f8345173740 1 --2- 172.21.15.8:0/1795795562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 0x560f8239d9b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f832c09a750 tx=0x7f832c0cfdd0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.396+0000 7f8345173740 1 -- 172.21.15.8:0/1795795562 shutdown_connections 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.396+0000 7f8345173740 1 --2- 172.21.15.8:0/1795795562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f8239e2f0 0x560f8239bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.396+0000 7f8345173740 1 --2- 172.21.15.8:0/1795795562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82395710 0x560f8238a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.396+0000 7f8345173740 1 --2- 172.21.15.8:0/1795795562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f82394df0 0x560f8239d9b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.396+0000 7f8345173740 1 -- 172.21.15.8:0/1795795562 >> 172.21.15.8:0/1795795562 conn(0x560f8238f520 msgr2=0x560f823911e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.396+0000 7f8345173740 1 -- 172.21.15.8:0/1795795562 shutdown_connections 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.396+0000 7f8345173740 1 -- 172.21.15.8:0/1795795562 wait complete. 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.396+0000 7f8345173740 1 -- start start 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.396+0000 7f8345173740 1 Processor -- start 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f8345173740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82394df0 0x560f82401dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f8345173740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82395710 0x560f82402310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f8345173740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f8239e2f0 0x560f823a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f8345173740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f823a2430 con 0x560f8239e2f0 2024-03-16T21:02:06.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f8345173740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f823a25a0 con 0x560f82395710 2024-03-16T21:02:06.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f8345173740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f823a2760 con 0x560f82394df0 2024-03-16T21:02:06.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f8345173740 10 client.0 _ll_register_callbacks cb 0x7f832801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:06.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f833b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82394df0 0x560f82401dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f833b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82394df0 0x560f82401dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46782/0 (socket says 172.21.15.8:46782) 2024-03-16T21:02:06.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f833b400640 1 -- 172.21.15.8:0/3624498938 learned_addr learned my addr 172.21.15.8:0/3624498938 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:06.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f833aa00640 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82395710 0x560f82402310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f833be00640 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f8239e2f0 0x560f823a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f833b400640 1 -- 172.21.15.8:0/3624498938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82395710 msgr2=0x560f82402310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f833b400640 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82395710 0x560f82402310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f833b400640 1 -- 172.21.15.8:0/3624498938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f8239e2f0 msgr2=0x560f823a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f833b400640 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f8239e2f0 0x560f823a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.397+0000 7f833b400640 1 -- 172.21.15.8:0/3624498938 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c1a6a60 con 0x560f82394df0 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.398+0000 7f833b400640 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82394df0 0x560f82401dd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f832c0d2010 tx=0x7f832c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d43398adc27a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.398+0000 7f8325600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.398+0000 7f8325600640 1 -- 172.21.15.8:0/3624498938 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c0a2eb0 con 0x560f82394df0 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.398+0000 7f8325600640 1 -- 172.21.15.8:0/3624498938 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f832c0cfe40 con 0x560f82394df0 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.398+0000 7f8345173740 1 -- 172.21.15.8:0/3624498938 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f8238ac30 con 0x560f82394df0 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.398+0000 7f8325600640 1 -- 172.21.15.8:0/3624498938 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f832c0d34c0 con 0x560f82394df0 2024-03-16T21:02:06.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.398+0000 7f8345173740 10 client.26527 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.398+0000 7f8345173740 1 -- 172.21.15.8:0/3624498938 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560f822bc650 con 0x560f82394df0 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.398+0000 7f8325600640 1 -- 172.21.15.8:0/3624498938 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x560f8238ac30 con 0x560f82394df0 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.399+0000 7f8325600640 1 -- 172.21.15.8:0/3624498938 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f832c0cb540 con 0x560f82394df0 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.399+0000 7f8345173740 10 client.26527 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.399+0000 7f8345173740 10 client.26527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.399+0000 7f8345173740 20 client.26527 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.399+0000 7f8345173740 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560f8240abf0 0x560f8240d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.399+0000 7f8345173740 4 client.26527 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.399+0000 7f8345173740 1 -- 172.21.15.8:0/3624498938 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f832800fd00 con 0x560f8240abf0 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.399+0000 7f833aa00640 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560f8240abf0 0x560f8240d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.399+0000 7f833aa00640 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560f8240abf0 0x560f8240d010 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c22be5329718637 server_cookie=6a16d6c5da831c4d in_seq=0 out_seq=0 2024-03-16T21:02:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.399+0000 7f8325600640 10 client.26527 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8325600640 1 -- 172.21.15.8:0/3624498938 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f832800fd00 con 0x560f8240abf0 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8325600640 10 client.26527 handle_command_reply: tid=0 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 1 client.26527 shutdown 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 1 -- 172.21.15.8:0/3624498938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82394df0 msgr2=0x560f82401dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82394df0 0x560f82401dd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f832c0d2010 tx=0x7f832c000bc0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 1 -- 172.21.15.8:0/3624498938 shutdown_connections 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560f8240abf0 0x560f8240d010 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560f8239e2f0 0x560f823a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560f82395710 0x560f82402310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 1 --2- 172.21.15.8:0/3624498938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f82394df0 0x560f82401dd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8325600640 0 client.26527 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 1 -- 172.21.15.8:0/3624498938 >> 172.21.15.8:0/3624498938 conn(0x560f8238f520 msgr2=0x560f8238de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 1 -- 172.21.15.8:0/3624498938 shutdown_connections 2024-03-16T21:02:06.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 1 -- 172.21.15.8:0/3624498938 wait complete. 2024-03-16T21:02:06.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.400+0000 7f8345173740 20 client.26527 trim_cache size 0 max 16384 2024-03-16T21:02:06.410 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:02:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 -- 172.21.15.8:0/106883501 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83200a1c20 msgr2=0x7f83200a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83200a1c20 0x7f83200a40e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f833402c630 tx=0x7f8334005d80 comp rx=0 tx=0).stop 2024-03-16T21:02:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 -- 172.21.15.8:0/106883501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f833c103590 msgr2=0x7f833c199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f833c103590 0x7f833c199ef0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f832c00e9f0 tx=0x7f832c00eeb0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 -- 172.21.15.8:0/106883501 shutdown_connections 2024-03-16T21:02:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83200a1c20 0x7f83200a40e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f833c109650 0x7f833c19e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f833c103f50 0x7f833c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 --2- 172.21.15.8:0/106883501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f833c103590 0x7f833c199ef0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 -- 172.21.15.8:0/106883501 >> 172.21.15.8:0/106883501 conn(0x7f833c0ff000 msgr2=0x7f833c100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 -- 172.21.15.8:0/106883501 shutdown_connections 2024-03-16T21:02:06.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:06.401+0000 7f8340e00640 1 -- 172.21.15.8:0/106883501 wait complete. 2024-03-16T21:02:06.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:06 smithi008 ceph-mon[31434]: pgmap v131: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-03-16T21:02:06.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:06 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2356566904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:02:06.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:06 smithi170 ceph-mon[35947]: pgmap v131: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-03-16T21:02:06.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:06 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2356566904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:02:06.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:06 smithi186 ceph-mon[36391]: pgmap v131: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-03-16T21:02:06.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:06 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2356566904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:02:07.426 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:02:07.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:02:07.426 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:02:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.663+0000 7f730b600640 1 -- 172.21.15.8:0/3280795900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304103690 msgr2=0x7f7304103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.663+0000 7f730b600640 1 --2- 172.21.15.8:0/3280795900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304103690 0x7f7304103b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009900 tx=0x7f72f002bc30 comp rx=0 tx=0).stop 2024-03-16T21:02:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.664+0000 7f730b600640 1 -- 172.21.15.8:0/3280795900 shutdown_connections 2024-03-16T21:02:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.664+0000 7f730b600640 1 --2- 172.21.15.8:0/3280795900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7304104050 0x7f7304110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.664+0000 7f730b600640 1 --2- 172.21.15.8:0/3280795900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304103690 0x7f7304103b10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.664+0000 7f730b600640 1 --2- 172.21.15.8:0/3280795900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73041096a0 0x7f7304109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.664+0000 7f730b600640 1 -- 172.21.15.8:0/3280795900 >> 172.21.15.8:0/3280795900 conn(0x7f73040ff160 msgr2=0x7f7304101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.664+0000 7f730b600640 1 -- 172.21.15.8:0/3280795900 shutdown_connections 2024-03-16T21:02:07.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.664+0000 7f730b600640 1 -- 172.21.15.8:0/3280795900 wait complete. 2024-03-16T21:02:07.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f730b600640 1 Processor -- start 2024-03-16T21:02:07.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f730b600640 1 -- start start 2024-03-16T21:02:07.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f730b600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7304103690 0x7f7304199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f730b600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304104050 0x7f730419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f730b600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73041096a0 0x7f730419e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f730b600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730419ece0 con 0x7f7304103690 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f730b600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730419ee50 con 0x7f7304104050 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f730b600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730419f010 con 0x7f73041096a0 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f7308c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7304103690 0x7f7304199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f7309600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73041096a0 0x7f730419e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f7308c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7304103690 0x7f7304199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56440/0 (socket says 172.21.15.8:56440) 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f7308c00640 1 -- 172.21.15.8:0/3884428659 learned_addr learned my addr 172.21.15.8:0/3884428659 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.665+0000 7f7303e00640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304104050 0x7f730419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.666+0000 7f7309600640 1 -- 172.21.15.8:0/3884428659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304104050 msgr2=0x7f730419a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.666+0000 7f7309600640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304104050 0x7f730419a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.666+0000 7f7309600640 1 -- 172.21.15.8:0/3884428659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7304103690 msgr2=0x7f7304199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.666+0000 7f7309600640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7304103690 0x7f7304199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.666+0000 7f7309600640 1 -- 172.21.15.8:0/3884428659 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc009840 con 0x7f73041096a0 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.666+0000 7f7308c00640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7304103690 0x7f7304199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:07.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.666+0000 7f7309600640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73041096a0 0x7f730419e6e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00ec50 tx=0x7f72fc00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.666+0000 7f7301600640 1 -- 172.21.15.8:0/3884428659 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc003b70 con 0x7f73041096a0 2024-03-16T21:02:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.666+0000 7f730b600640 1 -- 172.21.15.8:0/3884428659 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f0009560 con 0x7f73041096a0 2024-03-16T21:02:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.666+0000 7f7301600640 1 -- 172.21.15.8:0/3884428659 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f72fc00ce70 con 0x7f73041096a0 2024-03-16T21:02:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.666+0000 7f7301600640 1 -- 172.21.15.8:0/3884428659 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc010810 con 0x7f73041096a0 2024-03-16T21:02:07.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.667+0000 7f730b600640 1 -- 172.21.15.8:0/3884428659 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73041a6990 con 0x7f73041096a0 2024-03-16T21:02:07.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.669+0000 7f7301600640 1 -- 172.21.15.8:0/3884428659 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f72fc004020 con 0x7f73041096a0 2024-03-16T21:02:07.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.670+0000 7f730e42c740 1 Processor -- start 2024-03-16T21:02:07.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.670+0000 7f730e42c740 1 -- start start 2024-03-16T21:02:07.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.670+0000 7f730e42c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 0x55fe8388e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.670+0000 7f730e42c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe83896f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.670+0000 7f730e42c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe83899830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.670+0000 7f730e42c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe83849300 con 0x55fe83897440 2024-03-16T21:02:07.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.670+0000 7f730e42c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe837fbe50 con 0x55fe8388e860 2024-03-16T21:02:07.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.670+0000 7f730e42c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe837f9380 con 0x55fe8388df40 2024-03-16T21:02:07.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.671+0000 7f7303e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 0x55fe8388e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.671+0000 7f7308c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe83896f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.671+0000 7f7303e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 0x55fe8388e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46818/0 (socket says 172.21.15.8:46818) 2024-03-16T21:02:07.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.671+0000 7f7308c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe83896f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50802/0 (socket says 172.21.15.8:50802) 2024-03-16T21:02:07.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.671+0000 7f7303e00640 1 -- 172.21.15.8:0/1636591902 learned_addr learned my addr 172.21.15.8:0/1636591902 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:07.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.671+0000 7f7303e00640 1 --2- 172.21.15.8:0/1636591902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe83899830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.671+0000 7f7308c00640 1 -- 172.21.15.8:0/1636591902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 msgr2=0x55fe8388e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.671+0000 7f7308c00640 1 --2- 172.21.15.8:0/1636591902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 0x55fe8388e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.671+0000 7f7308c00640 1 -- 172.21.15.8:0/1636591902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 msgr2=0x55fe83899830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.671+0000 7f7308c00640 1 --2- 172.21.15.8:0/1636591902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe83899830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.671+0000 7f7308c00640 1 -- 172.21.15.8:0/1636591902 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe837bdc80 con 0x55fe8388e860 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.672+0000 7f7308c00640 1 --2- 172.21.15.8:0/1636591902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe83896f00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f72f8011440 tx=0x7f72f8011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=442b359fd0ef6b20 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.672+0000 7f72f5c00640 1 -- 172.21.15.8:0/1636591902 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8004030 con 0x55fe8388e860 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.672+0000 7f72f5c00640 1 -- 172.21.15.8:0/1636591902 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f72f8004190 con 0x55fe8388e860 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.672+0000 7f72f5c00640 1 -- 172.21.15.8:0/1636591902 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800f930 con 0x55fe8388e860 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.672+0000 7f7301600640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f72ec0a1c20 0x7f72ec0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.672+0000 7f7301600640 1 -- 172.21.15.8:0/3884428659 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f72fc014070 con 0x7f73041096a0 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.672+0000 7f7303e00640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f72ec0a1c20 0x7f72ec0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.673+0000 7f730e42c740 1 -- 172.21.15.8:0/1636591902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 msgr2=0x55fe83896f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.673+0000 7f730e42c740 1 --2- 172.21.15.8:0/1636591902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe83896f00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f72f8011440 tx=0x7f72f8011900 comp rx=0 tx=0).stop 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.673+0000 7f730e42c740 1 -- 172.21.15.8:0/1636591902 shutdown_connections 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.673+0000 7f730e42c740 1 --2- 172.21.15.8:0/1636591902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe83899830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.673+0000 7f730e42c740 1 --2- 172.21.15.8:0/1636591902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe83896f00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.673+0000 7f730e42c740 1 --2- 172.21.15.8:0/1636591902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 0x55fe8388e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.673+0000 7f730e42c740 1 -- 172.21.15.8:0/1636591902 >> 172.21.15.8:0/1636591902 conn(0x55fe83888670 msgr2=0x55fe83888a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.673+0000 7f730e42c740 1 -- 172.21.15.8:0/1636591902 shutdown_connections 2024-03-16T21:02:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.673+0000 7f730e42c740 1 -- 172.21.15.8:0/1636591902 wait complete. 2024-03-16T21:02:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.673+0000 7f7303e00640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f72ec0a1c20 0x7f72ec0a40e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55fe83889800 tx=0x7f72f0045040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.674+0000 7f730e42c740 1 -- start start 2024-03-16T21:02:07.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.674+0000 7f730e42c740 1 Processor -- start 2024-03-16T21:02:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.674+0000 7f730e42c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388df40 0x55fe83894450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.674+0000 7f730e42c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388e860 0x55fe83894990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.674+0000 7f730e42c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe83894ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.674+0000 7f730e42c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe837f4b60 con 0x55fe83897440 2024-03-16T21:02:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.674+0000 7f730e42c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe83799fd0 con 0x55fe8388df40 2024-03-16T21:02:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.674+0000 7f730e42c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe83799c70 con 0x55fe8388e860 2024-03-16T21:02:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.674+0000 7f730e42c740 10 client.0 _ll_register_callbacks cb 0x55fe83505c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f7308c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388df40 0x55fe83894450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f7303e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388e860 0x55fe83894990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f7308c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388df40 0x55fe83894450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50812/0 (socket says 172.21.15.8:50812) 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f7308c00640 1 -- 172.21.15.8:0/1839188808 learned_addr learned my addr 172.21.15.8:0/1839188808 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f7309600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe83894ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f7308c00640 1 -- 172.21.15.8:0/1839188808 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388e860 msgr2=0x55fe83894990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f7308c00640 1 --2- 172.21.15.8:0/1839188808 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388e860 0x55fe83894990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f7308c00640 1 -- 172.21.15.8:0/1839188808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 msgr2=0x55fe83894ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f7308c00640 1 --2- 172.21.15.8:0/1839188808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe83894ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f7308c00640 1 -- 172.21.15.8:0/1839188808 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f8009c50 con 0x55fe8388df40 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f7308c00640 1 --2- 172.21.15.8:0/1839188808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388df40 0x55fe83894450 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f72f801b040 tx=0x7f72f8005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4823876f88948553 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.675+0000 7f72ea000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.676+0000 7f72ea000640 1 -- 172.21.15.8:0/1839188808 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f80035f0 con 0x55fe8388df40 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.676+0000 7f72ea000640 1 -- 172.21.15.8:0/1839188808 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f72f8003750 con 0x55fe8388df40 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.676+0000 7f730e42c740 1 -- 172.21.15.8:0/1839188808 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe834f4860 con 0x55fe8388df40 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.676+0000 7f72ea000640 1 -- 172.21.15.8:0/1839188808 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72f8003910 con 0x55fe8388df40 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.676+0000 7f730e42c740 10 client.26534 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:07.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.676+0000 7f730e42c740 1 -- 172.21.15.8:0/1839188808 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55fe837f31e0 con 0x55fe8388df40 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.676+0000 7f72ea000640 1 -- 172.21.15.8:0/1839188808 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55fe834f4860 con 0x55fe8388df40 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.676+0000 7f72ea000640 1 -- 172.21.15.8:0/1839188808 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f72f8021040 con 0x55fe8388df40 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.677+0000 7f730e42c740 10 client.26534 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.677+0000 7f730e42c740 10 client.26534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.677+0000 7f730e42c740 20 client.26534 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.677+0000 7f730e42c740 1 --2- 172.21.15.8:0/1839188808 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fe838a7870 0x55fe838a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.677+0000 7f730e42c740 4 client.26534 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.677+0000 7f730e42c740 1 -- 172.21.15.8:0/1839188808 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe83545410 con 0x55fe838a7870 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.677+0000 7f7303e00640 1 --2- 172.21.15.8:0/1839188808 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fe838a7870 0x55fe838a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.677+0000 7f7303e00640 1 --2- 172.21.15.8:0/1839188808 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fe838a7870 0x55fe838a9cb0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=841273ee1eaa9fd0 server_cookie=cf27a2eea9d8896b in_seq=0 out_seq=0 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.678+0000 7f72ea000640 10 client.26534 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.678+0000 7f72ea000640 1 -- 172.21.15.8:0/1839188808 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55fe83545410 con 0x55fe838a7870 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.678+0000 7f72ea000640 10 client.26534 handle_command_reply: tid=0 2024-03-16T21:02:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.678+0000 7f730e42c740 1 client.26534 shutdown 2024-03-16T21:02:07.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f730e42c740 1 -- 172.21.15.8:0/1839188808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388df40 msgr2=0x55fe83894450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f730e42c740 1 --2- 172.21.15.8:0/1839188808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388df40 0x55fe83894450 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f72f801b040 tx=0x7f72f8005270 comp rx=0 tx=0).stop 2024-03-16T21:02:07.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f730e42c740 1 -- 172.21.15.8:0/1839188808 shutdown_connections 2024-03-16T21:02:07.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f730e42c740 1 --2- 172.21.15.8:0/1839188808 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fe838a7870 0x55fe838a9cb0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f730e42c740 1 --2- 172.21.15.8:0/1839188808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe83894ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f730e42c740 1 --2- 172.21.15.8:0/1839188808 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388e860 0x55fe83894990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f72ea000640 0 client.26534 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:07.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f730e42c740 1 --2- 172.21.15.8:0/1839188808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388df40 0x55fe83894450 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f730e42c740 1 -- 172.21.15.8:0/1839188808 >> 172.21.15.8:0/1839188808 conn(0x55fe83888670 msgr2=0x55fe8388a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f730e42c740 1 -- 172.21.15.8:0/1839188808 shutdown_connections 2024-03-16T21:02:07.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f730e42c740 1 -- 172.21.15.8:0/1839188808 wait complete. 2024-03-16T21:02:07.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.679+0000 7f730e42c740 20 client.26534 trim_cache size 0 max 16384 2024-03-16T21:02:07.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.697+0000 7f730e42c740 1 Processor -- start 2024-03-16T21:02:07.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.697+0000 7f730e42c740 1 -- start start 2024-03-16T21:02:07.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.697+0000 7f730e42c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8388df40 0x55fe83896b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.697+0000 7f730e42c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe83894cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.697+0000 7f730e42c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe83897440 0x55fe838a2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.697+0000 7f730e42c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe8353d0c0 con 0x55fe8388df40 2024-03-16T21:02:07.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.697+0000 7f730e42c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe83883a70 con 0x55fe8388e860 2024-03-16T21:02:07.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.697+0000 7f730e42c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe8388d930 con 0x55fe83897440 2024-03-16T21:02:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f7309600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe83897440 0x55fe838a2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f7308c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8388df40 0x55fe83896b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f7309600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe83897440 0x55fe838a2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46842/0 (socket says 172.21.15.8:46842) 2024-03-16T21:02:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f7309600640 1 -- 172.21.15.8:0/2161996785 learned_addr learned my addr 172.21.15.8:0/2161996785 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f7303e00640 1 --2- 172.21.15.8:0/2161996785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe83894cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f7309600640 1 -- 172.21.15.8:0/2161996785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 msgr2=0x55fe83894cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f7309600640 1 --2- 172.21.15.8:0/2161996785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe83894cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f7309600640 1 -- 172.21.15.8:0/2161996785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8388df40 msgr2=0x55fe83896b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f7309600640 1 --2- 172.21.15.8:0/2161996785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8388df40 0x55fe83896b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f7309600640 1 -- 172.21.15.8:0/2161996785 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe8378fa90 con 0x55fe83897440 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f7309600640 1 --2- 172.21.15.8:0/2161996785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe83897440 0x55fe838a2820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f72fc004af0 tx=0x7f72fc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f9a2af9668f70df server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.698+0000 7f72f5200640 1 -- 172.21.15.8:0/2161996785 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc09aae0 con 0x55fe83897440 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.699+0000 7f72f5200640 1 -- 172.21.15.8:0/2161996785 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f72fc09ec30 con 0x55fe83897440 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.699+0000 7f72f5200640 1 -- 172.21.15.8:0/2161996785 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0042d0 con 0x55fe83897440 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.699+0000 7f730e42c740 1 -- 172.21.15.8:0/2161996785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe83897440 msgr2=0x55fe838a2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.699+0000 7f730e42c740 1 --2- 172.21.15.8:0/2161996785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe83897440 0x55fe838a2820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f72fc004af0 tx=0x7f72fc004730 comp rx=0 tx=0).stop 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.699+0000 7f730e42c740 1 -- 172.21.15.8:0/2161996785 shutdown_connections 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.699+0000 7f730e42c740 1 --2- 172.21.15.8:0/2161996785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe83897440 0x55fe838a2820 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.699+0000 7f730e42c740 1 --2- 172.21.15.8:0/2161996785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe83894cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.699+0000 7f730e42c740 1 --2- 172.21.15.8:0/2161996785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8388df40 0x55fe83896b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.699+0000 7f730e42c740 1 -- 172.21.15.8:0/2161996785 >> 172.21.15.8:0/2161996785 conn(0x55fe83888670 msgr2=0x55fe838876f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.699+0000 7f730e42c740 1 -- 172.21.15.8:0/2161996785 shutdown_connections 2024-03-16T21:02:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.699+0000 7f730e42c740 1 -- 172.21.15.8:0/2161996785 wait complete. 2024-03-16T21:02:07.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.700+0000 7f730e42c740 1 -- start start 2024-03-16T21:02:07.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.700+0000 7f730e42c740 1 Processor -- start 2024-03-16T21:02:07.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.700+0000 7f730e42c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 0x55fe8389b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f730e42c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe8389bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f730e42c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe8389c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f730e42c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe8389f630 con 0x55fe83897440 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f730e42c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe83903190 con 0x55fe8388e860 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f730e42c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe839032d0 con 0x55fe8388df40 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f730e42c740 10 client.0 _ll_register_callbacks cb 0x7f72f0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7308c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 0x55fe8389b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7308c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 0x55fe8389b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46846/0 (socket says 172.21.15.8:46846) 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7308c00640 1 -- 172.21.15.8:0/2105545769 learned_addr learned my addr 172.21.15.8:0/2105545769 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7303e00640 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe8389bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7309600640 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe8389c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7308c00640 1 -- 172.21.15.8:0/2105545769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 msgr2=0x55fe8389bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7308c00640 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe8389bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7308c00640 1 -- 172.21.15.8:0/2105545769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 msgr2=0x55fe8389c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7308c00640 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe8389c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7308c00640 1 -- 172.21.15.8:0/2105545769 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73041a6990 con 0x55fe8388df40 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7303e00640 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe8389bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7309600640 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe8389c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f7308c00640 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 0x55fe8389b670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f72f8006010 tx=0x7f72f8005d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49e7b6486f431cdd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.701+0000 7f72ea000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f72ea000640 1 -- 172.21.15.8:0/2105545769 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800fb90 con 0x55fe8388df40 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f72ea000640 1 -- 172.21.15.8:0/2105545769 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f72f8000e40 con 0x55fe8388df40 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f730e42c740 1 -- 172.21.15.8:0/2105545769 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72f8004190 con 0x55fe8388df40 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f72ea000640 1 -- 172.21.15.8:0/2105545769 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72f80052e0 con 0x55fe8388df40 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f730e42c740 10 client.26545 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f730e42c740 1 -- 172.21.15.8:0/2105545769 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55fe837b56a0 con 0x55fe8388df40 2024-03-16T21:02:07.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f72ea000640 1 -- 172.21.15.8:0/2105545769 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f72f8004190 con 0x55fe8388df40 2024-03-16T21:02:07.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f72ea000640 1 -- 172.21.15.8:0/2105545769 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f72f8021040 con 0x55fe8388df40 2024-03-16T21:02:07.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f730e42c740 10 client.26545 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:07.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f730e42c740 10 client.26545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:07.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f730e42c740 20 client.26545 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:07.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f730e42c740 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fe83904710 0x55fe83906b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f730e42c740 4 client.26545 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:02:07.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.702+0000 7f730e42c740 1 -- 172.21.15.8:0/2105545769 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55fe835317b0 con 0x55fe83904710 2024-03-16T21:02:07.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.703+0000 7f7303e00640 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fe83904710 0x55fe83906b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.703+0000 7f7303e00640 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fe83904710 0x55fe83906b30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3ba579f2eb66618 server_cookie=22ac3705a5f05ef4 in_seq=0 out_seq=0 2024-03-16T21:02:07.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.703+0000 7f72ea000640 10 client.26545 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:07.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f72ea000640 1 -- 172.21.15.8:0/2105545769 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55fe835317b0 con 0x55fe83904710 2024-03-16T21:02:07.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f72ea000640 10 client.26545 handle_command_reply: tid=0 2024-03-16T21:02:07.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f730e42c740 1 client.26545 shutdown 2024-03-16T21:02:07.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f730e42c740 1 -- 172.21.15.8:0/2105545769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 msgr2=0x55fe8389b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f730e42c740 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 0x55fe8389b670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f72f8006010 tx=0x7f72f8005d30 comp rx=0 tx=0).stop 2024-03-16T21:02:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f730e42c740 1 -- 172.21.15.8:0/2105545769 shutdown_connections 2024-03-16T21:02:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f730e42c740 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fe83904710 0x55fe83906b30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f72ea000640 0 client.26545 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f730e42c740 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe83897440 0x55fe8389c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f730e42c740 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe8388e860 0x55fe8389bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f730e42c740 1 --2- 172.21.15.8:0/2105545769 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fe8388df40 0x55fe8389b670 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.704+0000 7f730e42c740 1 -- 172.21.15.8:0/2105545769 >> 172.21.15.8:0/2105545769 conn(0x55fe83888670 msgr2=0x55fe83889830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.705+0000 7f730e42c740 1 -- 172.21.15.8:0/2105545769 shutdown_connections 2024-03-16T21:02:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.705+0000 7f730e42c740 1 -- 172.21.15.8:0/2105545769 wait complete. 2024-03-16T21:02:07.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.705+0000 7f730e42c740 20 client.26545 trim_cache size 0 max 16384 2024-03-16T21:02:07.714 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:02:07.714 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:02:07.714 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "89ba5781-6c95-43fc-8ada-85af7a570ce4", 2024-03-16T21:02:07.714 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:02:07.714 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:02:07.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.705+0000 7f730b600640 1 -- 172.21.15.8:0/3884428659 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f72ec0a1c20 msgr2=0x7f72ec0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.705+0000 7f730b600640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f72ec0a1c20 0x7f72ec0a40e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55fe83889800 tx=0x7f72f0045040 comp rx=0 tx=0).stop 2024-03-16T21:02:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.705+0000 7f730b600640 1 -- 172.21.15.8:0/3884428659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73041096a0 msgr2=0x7f730419e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.705+0000 7f730b600640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73041096a0 0x7f730419e6e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00ec50 tx=0x7f72fc00c6a0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.706+0000 7f730b600640 1 -- 172.21.15.8:0/3884428659 shutdown_connections 2024-03-16T21:02:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.706+0000 7f730b600640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f72ec0a1c20 0x7f72ec0a40e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.706+0000 7f730b600640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73041096a0 0x7f730419e6e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.706+0000 7f730b600640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7304104050 0x7f730419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.706+0000 7f730b600640 1 --2- 172.21.15.8:0/3884428659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7304103690 0x7f7304199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.706+0000 7f730b600640 1 -- 172.21.15.8:0/3884428659 >> 172.21.15.8:0/3884428659 conn(0x7f73040ff160 msgr2=0x7f73040ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.706+0000 7f730b600640 1 -- 172.21.15.8:0/3884428659 shutdown_connections 2024-03-16T21:02:07.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.706+0000 7f730b600640 1 -- 172.21.15.8:0/3884428659 wait complete. 2024-03-16T21:02:07.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:02:07.728 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:02:07.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.942+0000 7fea9f200640 1 -- 172.21.15.8:0/2541374757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaa01004c0 msgr2=0x7feaa01008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.942+0000 7fea9f200640 1 --2- 172.21.15.8:0/2541374757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaa01004c0 0x7feaa01008a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fea90009900 tx=0x7fea9002bc40 comp rx=0 tx=0).stop 2024-03-16T21:02:07.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.942+0000 7fea9f200640 1 -- 172.21.15.8:0/2541374757 shutdown_connections 2024-03-16T21:02:07.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.942+0000 7fea9f200640 1 --2- 172.21.15.8:0/2541374757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaa0105590 0x7feaa010d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.942+0000 7fea9f200640 1 --2- 172.21.15.8:0/2541374757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa0100e70 0x7feaa0104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.942+0000 7fea9f200640 1 --2- 172.21.15.8:0/2541374757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaa01004c0 0x7feaa01008a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.942+0000 7fea9f200640 1 -- 172.21.15.8:0/2541374757 >> 172.21.15.8:0/2541374757 conn(0x7feaa00fbd40 msgr2=0x7feaa00fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.943+0000 7fea9f200640 1 -- 172.21.15.8:0/2541374757 shutdown_connections 2024-03-16T21:02:07.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.943+0000 7fea9f200640 1 -- 172.21.15.8:0/2541374757 wait complete. 2024-03-16T21:02:07.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.944+0000 7fea9f200640 1 Processor -- start 2024-03-16T21:02:07.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.944+0000 7fea9f200640 1 -- start start 2024-03-16T21:02:07.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaa01004c0 0x7feaa0101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa0105590 0x7feaa0102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaa01029d0 0x7feaa01a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9f200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa01a61d0 con 0x7feaa01029d0 2024-03-16T21:02:07.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa01a6340 con 0x7feaa0105590 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa01a6500 con 0x7feaa01004c0 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaa01004c0 0x7feaa0101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa0105590 0x7feaa0102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaa01004c0 0x7feaa0101f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57342/0 (socket says 172.21.15.8:57342) 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9de00640 1 -- 172.21.15.8:0/3227313085 learned_addr learned my addr 172.21.15.8:0/3227313085 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9e800640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaa01029d0 0x7feaa01a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9de00640 1 -- 172.21.15.8:0/3227313085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa0105590 msgr2=0x7feaa0102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9de00640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa0105590 0x7feaa0102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9de00640 1 -- 172.21.15.8:0/3227313085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaa01029d0 msgr2=0x7feaa01a5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9de00640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaa01029d0 0x7feaa01a5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9de00640 1 -- 172.21.15.8:0/3227313085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90009560 con 0x7feaa01004c0 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.945+0000 7fea9d400640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa0105590 0x7feaa0102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:07.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.946+0000 7fea9de00640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaa01004c0 0x7feaa0101f50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fea9002c250 tx=0x7fea9002ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.946+0000 7fea96a00640 1 -- 172.21.15.8:0/3227313085 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90004250 con 0x7feaa01004c0 2024-03-16T21:02:07.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.946+0000 7fea96a00640 1 -- 172.21.15.8:0/3227313085 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fea900043b0 con 0x7feaa01004c0 2024-03-16T21:02:07.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.946+0000 7fea96a00640 1 -- 172.21.15.8:0/3227313085 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90003c50 con 0x7feaa01004c0 2024-03-16T21:02:07.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.946+0000 7fea9f200640 1 -- 172.21.15.8:0/3227313085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa01a6780 con 0x7feaa01004c0 2024-03-16T21:02:07.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.946+0000 7fea9f200640 1 -- 172.21.15.8:0/3227313085 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa01a6c40 con 0x7feaa01004c0 2024-03-16T21:02:07.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.949+0000 7feaa77d4740 1 Processor -- start 2024-03-16T21:02:07.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7fea96a00640 1 -- 172.21.15.8:0/3227313085 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fea90004e10 con 0x7feaa01004c0 2024-03-16T21:02:07.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7feaa77d4740 1 -- start start 2024-03-16T21:02:07.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb9170 0x5601f6fb7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fb8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fc1800 0x5601f6fc3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7feaa77d4740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6f27150 con 0x5601f6fb9170 2024-03-16T21:02:07.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7feaa77d4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6f24680 con 0x5601f6fb8490 2024-03-16T21:02:07.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7feaa77d4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6f1fe60 con 0x5601f6fc1800 2024-03-16T21:02:07.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7fea9e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb9170 0x5601f6fb7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7fea9de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fb8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7fea9e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb9170 0x5601f6fb7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54636/0 (socket says 172.21.15.8:54636) 2024-03-16T21:02:07.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7fea9e800640 1 -- 172.21.15.8:0/1597796528 learned_addr learned my addr 172.21.15.8:0/1597796528 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:07.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.950+0000 7fea9d400640 1 --2- 172.21.15.8:0/1597796528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fc1800 0x5601f6fc3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.951+0000 7fea9e800640 1 -- 172.21.15.8:0/1597796528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fc1800 msgr2=0x5601f6fc3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.951+0000 7fea9e800640 1 --2- 172.21.15.8:0/1597796528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fc1800 0x5601f6fc3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.951+0000 7fea9e800640 1 -- 172.21.15.8:0/1597796528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 msgr2=0x5601f6fb8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.951+0000 7fea9e800640 1 --2- 172.21.15.8:0/1597796528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fb8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.951+0000 7fea9e800640 1 -- 172.21.15.8:0/1597796528 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601f6ed9060 con 0x5601f6fb9170 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.951+0000 7fea96a00640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea840a1c50 0x7fea840a4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.951+0000 7fea9e800640 1 --2- 172.21.15.8:0/1597796528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb9170 0x5601f6fb7ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fea98009f70 tx=0x7fea98010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fb449d26bf76a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.951+0000 7fea96a00640 1 -- 172.21.15.8:0/3227313085 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fea900efcb0 con 0x7feaa01004c0 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.951+0000 7fea9de00640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea840a1c50 0x7fea840a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.952+0000 7fea8b000640 1 -- 172.21.15.8:0/1597796528 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98004d20 con 0x5601f6fb9170 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.952+0000 7fea8b000640 1 -- 172.21.15.8:0/1597796528 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fea98004e80 con 0x5601f6fb9170 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.952+0000 7fea8b000640 1 -- 172.21.15.8:0/1597796528 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98012a80 con 0x5601f6fb9170 2024-03-16T21:02:07.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.952+0000 7feaa77d4740 1 -- 172.21.15.8:0/1597796528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb9170 msgr2=0x5601f6fb7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.952+0000 7fea9de00640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea840a1c50 0x7fea840a4110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fea900ed5f0 tx=0x7fea900f37c0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.952+0000 7feaa77d4740 1 --2- 172.21.15.8:0/1597796528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb9170 0x5601f6fb7ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fea98009f70 tx=0x7fea98010800 comp rx=0 tx=0).stop 2024-03-16T21:02:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.953+0000 7feaa77d4740 1 -- 172.21.15.8:0/1597796528 shutdown_connections 2024-03-16T21:02:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.953+0000 7feaa77d4740 1 --2- 172.21.15.8:0/1597796528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fc1800 0x5601f6fc3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.953+0000 7feaa77d4740 1 --2- 172.21.15.8:0/1597796528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fb8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.953+0000 7feaa77d4740 1 --2- 172.21.15.8:0/1597796528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb9170 0x5601f6fb7ec0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.953+0000 7feaa77d4740 1 -- 172.21.15.8:0/1597796528 >> 172.21.15.8:0/1597796528 conn(0x5601f6f7f5a0 msgr2=0x5601f6fb2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.953+0000 7feaa77d4740 1 -- 172.21.15.8:0/1597796528 shutdown_connections 2024-03-16T21:02:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.953+0000 7feaa77d4740 1 -- 172.21.15.8:0/1597796528 wait complete. 2024-03-16T21:02:07.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.953+0000 7feaa77d4740 1 -- start start 2024-03-16T21:02:07.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.953+0000 7feaa77d4740 1 Processor -- start 2024-03-16T21:02:07.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb8490 0x5601f6fbe810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fc1800 0x5601f6fbf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7feaa77d4740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6ec4ec0 con 0x5601f6fb8490 2024-03-16T21:02:07.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7feaa77d4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6ec4b60 con 0x5601f6fc1800 2024-03-16T21:02:07.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7feaa77d4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6c8e1c0 con 0x5601f6fb9170 2024-03-16T21:02:07.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7feaa77d4740 10 client.0 _ll_register_callbacks cb 0x5601f6ed8960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7fea9d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7fea9e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb8490 0x5601f6fbe810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7fea9d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57360/0 (socket says 172.21.15.8:57360) 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7fea9d400640 1 -- 172.21.15.8:0/3405780460 learned_addr learned my addr 172.21.15.8:0/3405780460 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7fea9e800640 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fc1800 0x5601f6fbf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7fea9d400640 1 -- 172.21.15.8:0/3405780460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fc1800 msgr2=0x5601f6fbf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7fea9d400640 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fc1800 0x5601f6fbf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7fea9d400640 1 -- 172.21.15.8:0/3405780460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb8490 msgr2=0x5601f6fbe810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7fea9d400640 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb8490 0x5601f6fbe810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7fea9d400640 1 -- 172.21.15.8:0/3405780460 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea98009bd0 con 0x5601f6fb9170 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.954+0000 7fea9e800640 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb8490 0x5601f6fbe810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.955+0000 7fea9d400640 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbed50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fea8c012d00 tx=0x7fea8c00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b29320a9e8413381 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.955+0000 7fea7f400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.955+0000 7fea7f400640 1 -- 172.21.15.8:0/3405780460 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c017070 con 0x5601f6fb9170 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.955+0000 7fea7f400640 1 -- 172.21.15.8:0/3405780460 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fea8c009d90 con 0x5601f6fb9170 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.955+0000 7feaa77d4740 1 -- 172.21.15.8:0/3405780460 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601f6c5c720 con 0x5601f6fb9170 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.955+0000 7fea7f400640 1 -- 172.21.15.8:0/3405780460 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea8c012110 con 0x5601f6fb9170 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.955+0000 7feaa77d4740 10 client.26557 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.956+0000 7feaa77d4740 1 -- 172.21.15.8:0/3405780460 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5601f6f1e4e0 con 0x5601f6fb9170 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.956+0000 7fea7f400640 1 -- 172.21.15.8:0/3405780460 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5601f6c5c720 con 0x5601f6fb9170 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.956+0000 7fea7f400640 1 -- 172.21.15.8:0/3405780460 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fea8c010430 con 0x5601f6fb9170 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.956+0000 7feaa77d4740 10 client.26557 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.956+0000 7feaa77d4740 10 client.26557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.956+0000 7feaa77d4740 20 client.26557 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.956+0000 7feaa77d4740 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5601f6fd19f0 0x5601f6fd3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.956+0000 7feaa77d4740 4 client.26557 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.956+0000 7feaa77d4740 1 -- 172.21.15.8:0/3405780460 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601f6cab890 con 0x5601f6fd19f0 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.956+0000 7fea9e800640 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5601f6fd19f0 0x5601f6fd3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.957+0000 7fea9e800640 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5601f6fd19f0 0x5601f6fd3e10 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f9c208f07cd473f server_cookie=78cb6ccd037c1e68 in_seq=0 out_seq=0 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.957+0000 7fea7f400640 10 client.26557 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7fea7f400640 1 -- 172.21.15.8:0/3405780460 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5601f6cab890 con 0x5601f6fd19f0 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7fea7f400640 10 client.26557 handle_command_reply: tid=0 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 1 client.26557 shutdown 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 1 -- 172.21.15.8:0/3405780460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 msgr2=0x5601f6fbed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbed50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fea8c012d00 tx=0x7fea8c00f790 comp rx=0 tx=0).stop 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 1 -- 172.21.15.8:0/3405780460 shutdown_connections 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fc1800 0x5601f6fbf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbed50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5601f6fd19f0 0x5601f6fd3e10 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 1 --2- 172.21.15.8:0/3405780460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fb8490 0x5601f6fbe810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 1 -- 172.21.15.8:0/3405780460 >> 172.21.15.8:0/3405780460 conn(0x5601f6f7f5a0 msgr2=0x5601f6fb4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7fea7f400640 0 client.26557 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:07.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 1 -- 172.21.15.8:0/3405780460 shutdown_connections 2024-03-16T21:02:07.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 1 -- 172.21.15.8:0/3405780460 wait complete. 2024-03-16T21:02:07.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.958+0000 7feaa77d4740 20 client.26557 trim_cache size 0 max 16384 2024-03-16T21:02:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.976+0000 7feaa77d4740 1 Processor -- start 2024-03-16T21:02:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.976+0000 7feaa77d4740 1 -- start start 2024-03-16T21:02:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.976+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fc0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.976+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.976+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 0x5601f6fb49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.976+0000 7feaa77d4740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6fb8dd0 con 0x5601f6fc1800 2024-03-16T21:02:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.976+0000 7feaa77d4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6fb74c0 con 0x5601f6fb8490 2024-03-16T21:02:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.976+0000 7feaa77d4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6fb26e0 con 0x5601f6fb9170 2024-03-16T21:02:07.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.977+0000 7fea9e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fc0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.977+0000 7fea9e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 0x5601f6fb49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.977+0000 7fea9e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 0x5601f6fb49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54648/0 (socket says 172.21.15.8:54648) 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.977+0000 7fea9e800640 1 -- 172.21.15.8:0/3156304125 learned_addr learned my addr 172.21.15.8:0/3156304125 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.977+0000 7fea9d400640 1 --2- 172.21.15.8:0/3156304125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.977+0000 7fea9e800640 1 -- 172.21.15.8:0/3156304125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 msgr2=0x5601f6fbf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.977+0000 7fea9e800640 1 --2- 172.21.15.8:0/3156304125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.977+0000 7fea9e800640 1 -- 172.21.15.8:0/3156304125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 msgr2=0x5601f6fc0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.977+0000 7fea9e800640 1 --2- 172.21.15.8:0/3156304125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fc0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.977+0000 7fea9e800640 1 -- 172.21.15.8:0/3156304125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601f6eba950 con 0x5601f6fc1800 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.978+0000 7fea9e800640 1 --2- 172.21.15.8:0/3156304125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 0x5601f6fb49b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fea98012630 tx=0x7fea98012660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cca6b04e74ed0c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.978+0000 7fea8a600640 1 -- 172.21.15.8:0/3156304125 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9801f040 con 0x5601f6fc1800 2024-03-16T21:02:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.978+0000 7fea8a600640 1 -- 172.21.15.8:0/3156304125 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fea9802a650 con 0x5601f6fc1800 2024-03-16T21:02:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.978+0000 7fea8a600640 1 -- 172.21.15.8:0/3156304125 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98005260 con 0x5601f6fc1800 2024-03-16T21:02:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.978+0000 7feaa77d4740 1 -- 172.21.15.8:0/3156304125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 msgr2=0x5601f6fb49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.979+0000 7feaa77d4740 1 --2- 172.21.15.8:0/3156304125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 0x5601f6fb49b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fea98012630 tx=0x7fea98012660 comp rx=0 tx=0).stop 2024-03-16T21:02:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.979+0000 7feaa77d4740 1 -- 172.21.15.8:0/3156304125 shutdown_connections 2024-03-16T21:02:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.979+0000 7feaa77d4740 1 --2- 172.21.15.8:0/3156304125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 0x5601f6fb49b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.979+0000 7feaa77d4740 1 --2- 172.21.15.8:0/3156304125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.979+0000 7feaa77d4740 1 --2- 172.21.15.8:0/3156304125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fc0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.979+0000 7feaa77d4740 1 -- 172.21.15.8:0/3156304125 >> 172.21.15.8:0/3156304125 conn(0x5601f6f7f5a0 msgr2=0x5601f6fb42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.979+0000 7feaa77d4740 1 -- 172.21.15.8:0/3156304125 shutdown_connections 2024-03-16T21:02:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.979+0000 7feaa77d4740 1 -- 172.21.15.8:0/3156304125 wait complete. 2024-03-16T21:02:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.979+0000 7feaa77d4740 1 -- start start 2024-03-16T21:02:07.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.979+0000 7feaa77d4740 1 Processor -- start 2024-03-16T21:02:07.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fbaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7feaa77d4740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 0x5601f6fbb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7feaa77d4740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6fc36f0 con 0x5601f6fc1800 2024-03-16T21:02:07.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7feaa77d4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6fc3860 con 0x5601f6fb8490 2024-03-16T21:02:07.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7feaa77d4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601f6fbbae0 con 0x5601f6fb9170 2024-03-16T21:02:07.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7feaa77d4740 10 client.0 _ll_register_callbacks cb 0x7fea8c012910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7fea9d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7fea9e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fbaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7fea9d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57378/0 (socket says 172.21.15.8:57378) 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7fea9d400640 1 -- 172.21.15.8:0/2253400689 learned_addr learned my addr 172.21.15.8:0/2253400689 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.980+0000 7fea9e800640 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 0x5601f6fbb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7fea9d400640 1 -- 172.21.15.8:0/2253400689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 msgr2=0x5601f6fbaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7fea9d400640 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fbaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7fea9d400640 1 -- 172.21.15.8:0/2253400689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 msgr2=0x5601f6fbb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7fea9d400640 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 0x5601f6fbb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7fea9d400640 1 -- 172.21.15.8:0/2253400689 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601f6ed9060 con 0x5601f6fb9170 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7fea9e800640 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 0x5601f6fbb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:07.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7fea9d400640 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbafe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fea8c001eb0 tx=0x7fea8c00fd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=405bcafc93692b1a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7fea7f400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7fea7f400640 1 -- 172.21.15.8:0/2253400689 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c017030 con 0x5601f6fb9170 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7fea7f400640 1 -- 172.21.15.8:0/2253400689 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fea8c000e40 con 0x5601f6fb9170 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7feaa77d4740 1 -- 172.21.15.8:0/2253400689 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601f6c1f7e0 con 0x5601f6fb9170 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.981+0000 7fea7f400640 1 -- 172.21.15.8:0/2253400689 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea8c010bd0 con 0x5601f6fb9170 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.982+0000 7feaa77d4740 10 client.26563 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.982+0000 7feaa77d4740 1 -- 172.21.15.8:0/2253400689 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5601f6ee0430 con 0x5601f6fb9170 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.982+0000 7fea7f400640 1 -- 172.21.15.8:0/2253400689 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5601f6c1f7e0 con 0x5601f6fb9170 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.982+0000 7fea7f400640 1 -- 172.21.15.8:0/2253400689 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fea8c003b30 con 0x5601f6fb9170 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.982+0000 7feaa77d4740 10 client.26563 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.982+0000 7feaa77d4740 10 client.26563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.982+0000 7feaa77d4740 20 client.26563 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.982+0000 7feaa77d4740 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5601f702ebd0 0x5601f7030ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:07.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.982+0000 7feaa77d4740 4 client.26563 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:02:07.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.982+0000 7feaa77d4740 1 -- 172.21.15.8:0/2253400689 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5601f6bcb700 con 0x5601f702ebd0 2024-03-16T21:02:07.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.982+0000 7fea9e800640 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5601f702ebd0 0x5601f7030ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:07.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7fea9e800640 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5601f702ebd0 0x5601f7030ff0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b21f5c6f896a07a server_cookie=5250d72f298032c in_seq=0 out_seq=0 2024-03-16T21:02:07.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7fea7f400640 10 client.26563 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:07.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7fea7f400640 1 -- 172.21.15.8:0/2253400689 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5601f6bcb700 con 0x5601f702ebd0 2024-03-16T21:02:07.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7fea7f400640 10 client.26563 handle_command_reply: tid=0 2024-03-16T21:02:07.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7feaa77d4740 1 client.26563 shutdown 2024-03-16T21:02:07.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7feaa77d4740 1 -- 172.21.15.8:0/2253400689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 msgr2=0x5601f6fbafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7feaa77d4740 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbafe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fea8c001eb0 tx=0x7fea8c00fd40 comp rx=0 tx=0).stop 2024-03-16T21:02:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7feaa77d4740 1 -- 172.21.15.8:0/2253400689 shutdown_connections 2024-03-16T21:02:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7feaa77d4740 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5601f702ebd0 0x5601f7030ff0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7feaa77d4740 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601f6fc1800 0x5601f6fbb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7feaa77d4740 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5601f6fb9170 0x5601f6fbafe0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7feaa77d4740 1 --2- 172.21.15.8:0/2253400689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5601f6fb8490 0x5601f6fbaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7feaa77d4740 1 -- 172.21.15.8:0/2253400689 >> 172.21.15.8:0/2253400689 conn(0x5601f6f7f5a0 msgr2=0x5601f6fb1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7fea7f400640 0 client.26563 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7feaa77d4740 1 -- 172.21.15.8:0/2253400689 shutdown_connections 2024-03-16T21:02:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.983+0000 7feaa77d4740 1 -- 172.21.15.8:0/2253400689 wait complete. 2024-03-16T21:02:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7feaa77d4740 20 client.26563 trim_cache size 0 max 16384 2024-03-16T21:02:07.995 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:02:07.995 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:02:07.995 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:02:07.995 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:02:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7fea9f200640 1 -- 172.21.15.8:0/3227313085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea840a1c50 msgr2=0x7fea840a4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7fea9f200640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea840a1c50 0x7fea840a4110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fea900ed5f0 tx=0x7fea900f37c0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7fea9f200640 1 -- 172.21.15.8:0/3227313085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaa01004c0 msgr2=0x7feaa0101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7fea9f200640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaa01004c0 0x7feaa0101f50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fea9002c250 tx=0x7fea9002ccb0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7fea9f200640 1 -- 172.21.15.8:0/3227313085 shutdown_connections 2024-03-16T21:02:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7fea9f200640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea840a1c50 0x7fea840a4110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7fea9f200640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feaa01029d0 0x7feaa01a5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7fea9f200640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa0105590 0x7feaa0102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7fea9f200640 1 --2- 172.21.15.8:0/3227313085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaa01004c0 0x7feaa0101f50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7fea9f200640 1 -- 172.21.15.8:0/3227313085 >> 172.21.15.8:0/3227313085 conn(0x7feaa00fbd40 msgr2=0x7feaa0104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.984+0000 7fea9f200640 1 -- 172.21.15.8:0/3227313085 shutdown_connections 2024-03-16T21:02:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:07.985+0000 7fea9f200640 1 -- 172.21.15.8:0/3227313085 wait complete. 2024-03-16T21:02:08.007 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:02:08.007 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:02:08.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.219+0000 7fe95b200640 1 -- 172.21.15.8:0/1665353099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe95c10d8c0 msgr2=0x7fe95c10dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.219+0000 7fe95b200640 1 --2- 172.21.15.8:0/1665353099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe95c10d8c0 0x7fe95c10dca0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009cd0 tx=0x7fe94c02c0e0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.219+0000 7fe95b200640 1 -- 172.21.15.8:0/1665353099 shutdown_connections 2024-03-16T21:02:08.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.219+0000 7fe95b200640 1 --2- 172.21.15.8:0/1665353099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe95c108270 0x7fe95c114780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.219+0000 7fe95b200640 1 --2- 172.21.15.8:0/1665353099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe95c1078b0 0x7fe95c107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.219+0000 7fe95b200640 1 --2- 172.21.15.8:0/1665353099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe95c10d8c0 0x7fe95c10dca0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.219+0000 7fe95b200640 1 -- 172.21.15.8:0/1665353099 >> 172.21.15.8:0/1665353099 conn(0x7fe95c077010 msgr2=0x7fe95c079430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:08.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.219+0000 7fe95b200640 1 -- 172.21.15.8:0/1665353099 shutdown_connections 2024-03-16T21:02:08.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.219+0000 7fe95b200640 1 -- 172.21.15.8:0/1665353099 wait complete. 2024-03-16T21:02:08.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.221+0000 7fe95b200640 1 Processor -- start 2024-03-16T21:02:08.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.221+0000 7fe95b200640 1 -- start start 2024-03-16T21:02:08.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.221+0000 7fe95b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe95c1078b0 0x7fe95c19dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.221+0000 7fe95b200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe95c108270 0x7fe95c19e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.221+0000 7fe95b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe95c10d8c0 0x7fe95c1a2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.221+0000 7fe95b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1a2e70 con 0x7fe95c10d8c0 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.221+0000 7fe95b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1a2fe0 con 0x7fe95c1078b0 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.221+0000 7fe95b200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1a31a0 con 0x7fe95c108270 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.221+0000 7fe959e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe95c1078b0 0x7fe95c19dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.222+0000 7fe959e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe95c1078b0 0x7fe95c19dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55730/0 (socket says 172.21.15.8:55730) 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.222+0000 7fe959e00640 1 -- 172.21.15.8:0/302052372 learned_addr learned my addr 172.21.15.8:0/302052372 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.222+0000 7fe95a800640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe95c10d8c0 0x7fe95c1a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.222+0000 7fe959400640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe95c108270 0x7fe95c19e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.222+0000 7fe959e00640 1 -- 172.21.15.8:0/302052372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe95c108270 msgr2=0x7fe95c19e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.222+0000 7fe959e00640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe95c108270 0x7fe95c19e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.222+0000 7fe959e00640 1 -- 172.21.15.8:0/302052372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe95c10d8c0 msgr2=0x7fe95c1a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.222+0000 7fe959e00640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe95c10d8c0 0x7fe95c1a2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.222+0000 7fe959e00640 1 -- 172.21.15.8:0/302052372 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944009490 con 0x7fe95c1078b0 2024-03-16T21:02:08.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.222+0000 7fe959400640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe95c108270 0x7fe95c19e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:08.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.222+0000 7fe959e00640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe95c1078b0 0x7fe95c19dfb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe94c004af0 tx=0x7fe94c034670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:08.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.223+0000 7fe952a00640 1 -- 172.21.15.8:0/302052372 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c032bc0 con 0x7fe95c1078b0 2024-03-16T21:02:08.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.223+0000 7fe952a00640 1 -- 172.21.15.8:0/302052372 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe94c003e70 con 0x7fe95c1078b0 2024-03-16T21:02:08.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.223+0000 7fe95b200640 1 -- 172.21.15.8:0/302052372 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94c009900 con 0x7fe95c1078b0 2024-03-16T21:02:08.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.223+0000 7fe952a00640 1 -- 172.21.15.8:0/302052372 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c004790 con 0x7fe95c1078b0 2024-03-16T21:02:08.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.223+0000 7fe95b200640 1 -- 172.21.15.8:0/302052372 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c1aab20 con 0x7fe95c1078b0 2024-03-16T21:02:08.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.224+0000 7fe95b200640 1 -- 172.21.15.8:0/302052372 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95c068650 con 0x7fe95c1078b0 2024-03-16T21:02:08.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.226+0000 7fe952a00640 1 -- 172.21.15.8:0/302052372 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fe94c00a040 con 0x7fe95c1078b0 2024-03-16T21:02:08.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.227+0000 7fe952a00640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe9400a1ba0 0x7fe9400a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.227+0000 7fe952a00640 1 -- 172.21.15.8:0/302052372 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe94c0effd0 con 0x7fe95c1078b0 2024-03-16T21:02:08.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.228+0000 7fe959400640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe9400a1ba0 0x7fe9400a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.229+0000 7fe959400640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe9400a1ba0 0x7fe9400a4060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe95c10ce40 tx=0x7fe944005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:08.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.230+0000 7fe952a00640 1 -- 172.21.15.8:0/302052372 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe94c0b8f80 con 0x7fe95c1078b0 2024-03-16T21:02:08.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.476+0000 7fe95b200640 1 -- 172.21.15.8:0/302052372 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe95c10fe20 con 0x7fe95c1078b0 2024-03-16T21:02:08.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.483+0000 7fe952a00640 1 -- 172.21.15.8:0/302052372 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11396 (secure 0 0 0) 0x7fe94c044090 con 0x7fe95c1078b0 2024-03-16T21:02:08.488 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:02:08.488 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:00:21.828404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:02:08.488 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 30 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.485+0000 7fe95b200640 1 -- 172.21.15.8:0/302052372 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe9400a1ba0 msgr2=0x7fe9400a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.485+0000 7fe95b200640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe9400a1ba0 0x7fe9400a4060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe95c10ce40 tx=0x7fe944005f90 comp rx=0 tx=0).stop 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.485+0000 7fe95b200640 1 -- 172.21.15.8:0/302052372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe95c1078b0 msgr2=0x7fe95c19dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.485+0000 7fe95b200640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe95c1078b0 0x7fe95c19dfb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe94c004af0 tx=0x7fe94c034670 comp rx=0 tx=0).stop 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.486+0000 7fe95b200640 1 -- 172.21.15.8:0/302052372 shutdown_connections 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.486+0000 7fe95b200640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe9400a1ba0 0x7fe9400a4060 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.486+0000 7fe95b200640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe95c10d8c0 0x7fe95c1a2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.486+0000 7fe95b200640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe95c108270 0x7fe95c19e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.486+0000 7fe95b200640 1 --2- 172.21.15.8:0/302052372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe95c1078b0 0x7fe95c19dfb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.486+0000 7fe95b200640 1 -- 172.21.15.8:0/302052372 >> 172.21.15.8:0/302052372 conn(0x7fe95c077010 msgr2=0x7fe95c0775b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.486+0000 7fe95b200640 1 -- 172.21.15.8:0/302052372 shutdown_connections 2024-03-16T21:02:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.486+0000 7fe95b200640 1 -- 172.21.15.8:0/302052372 wait complete. 2024-03-16T21:02:08.511 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:02:08.512 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:02:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.736+0000 7f7052200640 1 -- 172.21.15.8:0/4011932684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f704c104050 msgr2=0x7f704c110560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.736+0000 7f7052200640 1 --2- 172.21.15.8:0/4011932684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f704c104050 0x7f704c110560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7044009930 tx=0x7f704402bc30 comp rx=0 tx=0).stop 2024-03-16T21:02:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.737+0000 7f7052200640 1 -- 172.21.15.8:0/4011932684 shutdown_connections 2024-03-16T21:02:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.737+0000 7f7052200640 1 --2- 172.21.15.8:0/4011932684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f704c104050 0x7f704c110560 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.737+0000 7f7052200640 1 --2- 172.21.15.8:0/4011932684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f704c103690 0x7f704c103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.737+0000 7f7052200640 1 --2- 172.21.15.8:0/4011932684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f704c1096a0 0x7f704c109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.737+0000 7f7052200640 1 -- 172.21.15.8:0/4011932684 >> 172.21.15.8:0/4011932684 conn(0x7f704c0ff1a0 msgr2=0x7f704c1015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.737+0000 7f7052200640 1 -- 172.21.15.8:0/4011932684 shutdown_connections 2024-03-16T21:02:08.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.737+0000 7f7052200640 1 -- 172.21.15.8:0/4011932684 wait complete. 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.738+0000 7f7052200640 1 Processor -- start 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.738+0000 7f7052200640 1 -- start start 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.738+0000 7f7052200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f704c103690 0x7f704c199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.738+0000 7f7052200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f704c104050 0x7f704c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.738+0000 7f7052200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f704c1096a0 0x7f704c19e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.738+0000 7f7052200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c19ec90 con 0x7f704c1096a0 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.738+0000 7f7052200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c19ee00 con 0x7f704c103690 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.738+0000 7f7052200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c19efc0 con 0x7f704c104050 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f704c103690 0x7f704c199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f704c104050 0x7f704c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f704c103690 0x7f704c199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55746/0 (socket says 172.21.15.8:55746) 2024-03-16T21:02:08.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704b400640 1 -- 172.21.15.8:0/1685715608 learned_addr learned my addr 172.21.15.8:0/1685715608 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704be00640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f704c1096a0 0x7f704c19e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704b400640 1 -- 172.21.15.8:0/1685715608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f704c104050 msgr2=0x7f704c19a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704b400640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f704c104050 0x7f704c19a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704b400640 1 -- 172.21.15.8:0/1685715608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f704c1096a0 msgr2=0x7f704c19e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704b400640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f704c1096a0 0x7f704c19e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704b400640 1 -- 172.21.15.8:0/1685715608 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7034009490 con 0x7f704c103690 2024-03-16T21:02:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704aa00640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f704c104050 0x7f704c19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.739+0000 7f704b400640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f704c103690 0x7f704c199e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f703c00ebc0 tx=0x7f703c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.740+0000 7f7043e00640 1 -- 172.21.15.8:0/1685715608 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c0099b0 con 0x7f704c103690 2024-03-16T21:02:08.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.740+0000 7f7043e00640 1 -- 172.21.15.8:0/1685715608 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f703c00eec0 con 0x7f704c103690 2024-03-16T21:02:08.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.740+0000 7f7052200640 1 -- 172.21.15.8:0/1685715608 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7044009560 con 0x7f704c103690 2024-03-16T21:02:08.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.740+0000 7f7043e00640 1 -- 172.21.15.8:0/1685715608 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c018c10 con 0x7f704c103690 2024-03-16T21:02:08.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.740+0000 7f7052200640 1 -- 172.21.15.8:0/1685715608 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704c1a6940 con 0x7f704c103690 2024-03-16T21:02:08.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:08 smithi008 ceph-mon[31434]: pgmap v132: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:02:08.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:08 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:02:08.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:08 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:08.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:08 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:02:08.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:08 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:08.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:08 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:02:08.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.743+0000 7f7043e00640 1 -- 172.21.15.8:0/1685715608 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f703c010630 con 0x7f704c103690 2024-03-16T21:02:08.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.743+0000 7f7054f7d740 1 Processor -- start 2024-03-16T21:02:08.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.743+0000 7f7054f7d740 1 -- start start 2024-03-16T21:02:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.744+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 0x55e4b297e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.744+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b2986c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.744+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b2987140 0x55e4b2989530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.744+0000 7f7054f7d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b28ec210 con 0x55e4b2987140 2024-03-16T21:02:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.744+0000 7f7054f7d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b28e9740 con 0x55e4b297dc40 2024-03-16T21:02:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.744+0000 7f7054f7d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b28e4f20 con 0x55e4b297e560 2024-03-16T21:02:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.744+0000 7f704b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b2986c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.744+0000 7f704be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 0x55e4b297e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.744+0000 7f704be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 0x55e4b297e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55748/0 (socket says 172.21.15.8:55748) 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.744+0000 7f704be00640 1 -- 172.21.15.8:0/1538477420 learned_addr learned my addr 172.21.15.8:0/1538477420 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.744+0000 7f704aa00640 1 --2- 172.21.15.8:0/1538477420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b2987140 0x55e4b2989530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f704be00640 1 -- 172.21.15.8:0/1538477420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 msgr2=0x55e4b2986c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f704be00640 1 --2- 172.21.15.8:0/1538477420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b2986c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f704be00640 1 -- 172.21.15.8:0/1538477420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b2987140 msgr2=0x55e4b2989530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f704be00640 1 --2- 172.21.15.8:0/1538477420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b2987140 0x55e4b2989530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f704be00640 1 -- 172.21.15.8:0/1538477420 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4b28a6df0 con 0x55e4b297dc40 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f7043e00640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70300a1ba0 0x7f70300a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f704be00640 1 --2- 172.21.15.8:0/1538477420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 0x55e4b297e020 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7044005ab0 tx=0x7f704402c610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1045c16866264b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f7043e00640 1 -- 172.21.15.8:0/1685715608 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f703c014070 con 0x7f704c103690 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f704b400640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70300a1ba0 0x7f70300a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f703be00640 1 -- 172.21.15.8:0/1538477420 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70440046c0 con 0x55e4b297dc40 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f703be00640 1 -- 172.21.15.8:0/1538477420 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7044004820 con 0x55e4b297dc40 2024-03-16T21:02:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.745+0000 7f703be00640 1 -- 172.21.15.8:0/1538477420 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044005070 con 0x55e4b297dc40 2024-03-16T21:02:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.746+0000 7f7054f7d740 1 -- 172.21.15.8:0/1538477420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 msgr2=0x55e4b297e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.746+0000 7f704b400640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70300a1ba0 0x7f70300a4060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55e4b297d710 tx=0x7f703c0d16b0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.746+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1538477420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 0x55e4b297e020 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7044005ab0 tx=0x7f704402c610 comp rx=0 tx=0).stop 2024-03-16T21:02:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.746+0000 7f7054f7d740 1 -- 172.21.15.8:0/1538477420 shutdown_connections 2024-03-16T21:02:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.746+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1538477420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b2987140 0x55e4b2989530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.746+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1538477420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b2986c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.746+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1538477420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 0x55e4b297e020 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.746+0000 7f7054f7d740 1 -- 172.21.15.8:0/1538477420 >> 172.21.15.8:0/1538477420 conn(0x55e4b2978370 msgr2=0x55e4b2978750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.746+0000 7f7054f7d740 1 -- 172.21.15.8:0/1538477420 shutdown_connections 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.746+0000 7f7054f7d740 1 -- 172.21.15.8:0/1538477420 wait complete. 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.747+0000 7f7054f7d740 1 -- start start 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.747+0000 7f7054f7d740 1 Processor -- start 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.747+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b297dc40 0x55e4b2984200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.747+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297e560 0x55e4b2984740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.747+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b2987140 0x55e4b2984c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.747+0000 7f7054f7d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b288a150 con 0x55e4b297dc40 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.747+0000 7f7054f7d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b2889df0 con 0x55e4b297e560 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.747+0000 7f7054f7d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b26531c0 con 0x55e4b2987140 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.748+0000 7f7054f7d740 10 client.0 _ll_register_callbacks cb 0x55e4b28d92b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.748+0000 7f704aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297e560 0x55e4b2984740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.748+0000 7f704be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b297dc40 0x55e4b2984200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.748+0000 7f704aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297e560 0x55e4b2984740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55764/0 (socket says 172.21.15.8:55764) 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.748+0000 7f704aa00640 1 -- 172.21.15.8:0/2352034737 learned_addr learned my addr 172.21.15.8:0/2352034737 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.748+0000 7f704be00640 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b2987140 0x55e4b2984c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.748+0000 7f704aa00640 1 -- 172.21.15.8:0/2352034737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b2987140 msgr2=0x55e4b2984c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.748+0000 7f704aa00640 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b2987140 0x55e4b2984c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.748+0000 7f704aa00640 1 -- 172.21.15.8:0/2352034737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b297dc40 msgr2=0x55e4b2984200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.748+0000 7f704aa00640 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b297dc40 0x55e4b2984200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.748+0000 7f704aa00640 1 -- 172.21.15.8:0/2352034737 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704c110e60 con 0x55e4b297e560 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.749+0000 7f704aa00640 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297e560 0x55e4b2984740 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7034012cf0 tx=0x7f703400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded620e07cbbd775 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.749+0000 7f7038c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.749+0000 7f7038c00640 1 -- 172.21.15.8:0/2352034737 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034017070 con 0x55e4b297e560 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.749+0000 7f7038c00640 1 -- 172.21.15.8:0/2352034737 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7034010430 con 0x55e4b297e560 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.749+0000 7f7054f7d740 1 -- 172.21.15.8:0/2352034737 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4b25e47e0 con 0x55e4b297e560 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.749+0000 7f7038c00640 1 -- 172.21.15.8:0/2352034737 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70340122e0 con 0x55e4b297e560 2024-03-16T21:02:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.749+0000 7f7054f7d740 10 client.26573 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.749+0000 7f7054f7d740 1 -- 172.21.15.8:0/2352034737 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e4b28e35a0 con 0x55e4b297e560 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.750+0000 7f7038c00640 1 -- 172.21.15.8:0/2352034737 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55e4b25e47e0 con 0x55e4b297e560 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.750+0000 7f7038c00640 1 -- 172.21.15.8:0/2352034737 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f703401c680 con 0x55e4b297e560 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.750+0000 7f7054f7d740 10 client.26573 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.750+0000 7f7054f7d740 10 client.26573 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.750+0000 7f7054f7d740 20 client.26573 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.750+0000 7f7054f7d740 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e4b29972c0 0x55e4b29996e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.750+0000 7f7054f7d740 4 client.26573 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.750+0000 7f7054f7d740 1 -- 172.21.15.8:0/2352034737 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4b2621720 con 0x55e4b29972c0 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.750+0000 7f704be00640 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e4b29972c0 0x55e4b29996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.751+0000 7f704be00640 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e4b29972c0 0x55e4b29996e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae968a09002941e0 server_cookie=b9f4aab2f415bcad in_seq=0 out_seq=0 2024-03-16T21:02:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.751+0000 7f7038c00640 10 client.26573 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.751+0000 7f7038c00640 1 -- 172.21.15.8:0/2352034737 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55e4b2621720 con 0x55e4b29972c0 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.751+0000 7f7038c00640 10 client.26573 handle_command_reply: tid=0 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.751+0000 7f7054f7d740 1 client.26573 shutdown 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7054f7d740 1 -- 172.21.15.8:0/2352034737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297e560 msgr2=0x55e4b2984740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7054f7d740 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297e560 0x55e4b2984740 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7034012cf0 tx=0x7f703400f790 comp rx=0 tx=0).stop 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7054f7d740 1 -- 172.21.15.8:0/2352034737 shutdown_connections 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7054f7d740 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e4b29972c0 0x55e4b29996e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7054f7d740 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b2987140 0x55e4b2984c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7054f7d740 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297e560 0x55e4b2984740 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7038c00640 0 client.26573 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7054f7d740 1 --2- 172.21.15.8:0/2352034737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b297dc40 0x55e4b2984200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7054f7d740 1 -- 172.21.15.8:0/2352034737 >> 172.21.15.8:0/2352034737 conn(0x55e4b2978370 msgr2=0x55e4b297a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7054f7d740 1 -- 172.21.15.8:0/2352034737 shutdown_connections 2024-03-16T21:02:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7054f7d740 1 -- 172.21.15.8:0/2352034737 wait complete. 2024-03-16T21:02:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.752+0000 7f7054f7d740 20 client.26573 trim_cache size 0 max 16384 2024-03-16T21:02:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.766+0000 7f7054f7d740 1 Processor -- start 2024-03-16T21:02:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.766+0000 7f7054f7d740 1 -- start start 2024-03-16T21:02:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b297dc40 0x55e4b2986930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b2977470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b2987140 0x55e4b2984aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f7054f7d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b2973ae0 con 0x55e4b297dc40 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f7054f7d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b2995a30 con 0x55e4b2987140 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f7054f7d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b297a6b0 con 0x55e4b297e560 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f704aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b2977470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f704aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b2977470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57436/0 (socket says 172.21.15.8:57436) 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f704be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b297dc40 0x55e4b2986930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f704aa00640 1 -- 172.21.15.8:0/1618310600 learned_addr learned my addr 172.21.15.8:0/1618310600 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f704be00640 1 --2- 172.21.15.8:0/1618310600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b2987140 0x55e4b2984aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f704aa00640 1 -- 172.21.15.8:0/1618310600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b2987140 msgr2=0x55e4b2984aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f704aa00640 1 --2- 172.21.15.8:0/1618310600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b2987140 0x55e4b2984aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f704aa00640 1 -- 172.21.15.8:0/1618310600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b297dc40 msgr2=0x55e4b2986930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.767+0000 7f704aa00640 1 --2- 172.21.15.8:0/1618310600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b297dc40 0x55e4b2986930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.768+0000 7f704aa00640 1 -- 172.21.15.8:0/1618310600 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4b287fab0 con 0x55e4b297e560 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.768+0000 7f704be00640 1 --2- 172.21.15.8:0/1618310600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b297dc40 0x55e4b2986930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.768+0000 7f704aa00640 1 --2- 172.21.15.8:0/1618310600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b2977470 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f703401cab0 tx=0x7f703400fee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff78e86137e0e8df server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.768+0000 7f703b400640 1 -- 172.21.15.8:0/1618310600 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034017040 con 0x55e4b297e560 2024-03-16T21:02:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.768+0000 7f703b400640 1 -- 172.21.15.8:0/1618310600 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f70340122e0 con 0x55e4b297e560 2024-03-16T21:02:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.768+0000 7f703b400640 1 -- 172.21.15.8:0/1618310600 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034003b00 con 0x55e4b297e560 2024-03-16T21:02:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.769+0000 7f7054f7d740 1 -- 172.21.15.8:0/1618310600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 msgr2=0x55e4b2977470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.769+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1618310600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b2977470 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f703401cab0 tx=0x7f703400fee0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.769+0000 7f7054f7d740 1 -- 172.21.15.8:0/1618310600 shutdown_connections 2024-03-16T21:02:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.769+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1618310600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b2987140 0x55e4b2984aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.769+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1618310600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b2977470 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.769+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1618310600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b297dc40 0x55e4b2986930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.769+0000 7f7054f7d740 1 -- 172.21.15.8:0/1618310600 >> 172.21.15.8:0/1618310600 conn(0x55e4b2978370 msgr2=0x55e4b2978750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.769+0000 7f7054f7d740 1 -- 172.21.15.8:0/1618310600 shutdown_connections 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.769+0000 7f7054f7d740 1 -- 172.21.15.8:0/1618310600 wait complete. 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.769+0000 7f7054f7d740 1 -- start start 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f7054f7d740 1 Processor -- start 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 0x55e4b298eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b298ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f7054f7d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b2987140 0x55e4b298b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f7054f7d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b298b910 con 0x55e4b2987140 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f7054f7d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b298ba80 con 0x55e4b297dc40 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f7054f7d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b298bc40 con 0x55e4b297e560 2024-03-16T21:02:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f7054f7d740 10 client.0 _ll_register_callbacks cb 0x7f7034009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f704aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b298ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f704be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 0x55e4b298eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f704aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b298ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57452/0 (socket says 172.21.15.8:57452) 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.770+0000 7f704aa00640 1 -- 172.21.15.8:0/1698671612 learned_addr learned my addr 172.21.15.8:0/1698671612 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f704be00640 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b2987140 0x55e4b298b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f704aa00640 1 -- 172.21.15.8:0/1698671612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 msgr2=0x55e4b298eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f704aa00640 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 0x55e4b298eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f704aa00640 1 -- 172.21.15.8:0/1698671612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b2987140 msgr2=0x55e4b298b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f704aa00640 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b2987140 0x55e4b298b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f704aa00640 1 -- 172.21.15.8:0/1698671612 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4b28e35a0 con 0x55e4b297e560 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f704be00640 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b2987140 0x55e4b298b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f704aa00640 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b298ae90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f703401ca30 tx=0x7f7034009770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5b39394ca705d95 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f7038c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:08.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f7038c00640 1 -- 172.21.15.8:0/1698671612 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034017070 con 0x55e4b297e560 2024-03-16T21:02:08.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f7038c00640 1 -- 172.21.15.8:0/1698671612 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f70340052c0 con 0x55e4b297e560 2024-03-16T21:02:08.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.771+0000 7f7054f7d740 1 -- 172.21.15.8:0/1698671612 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7044004820 con 0x55e4b297e560 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.772+0000 7f7038c00640 1 -- 172.21.15.8:0/1698671612 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7034005500 con 0x55e4b297e560 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.772+0000 7f7054f7d740 10 client.26587 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.772+0000 7f7054f7d740 1 -- 172.21.15.8:0/1698671612 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e4b28a5650 con 0x55e4b297e560 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.772+0000 7f7038c00640 1 -- 172.21.15.8:0/1698671612 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7044004820 con 0x55e4b297e560 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.772+0000 7f7038c00640 1 -- 172.21.15.8:0/1698671612 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f703402e980 con 0x55e4b297e560 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.772+0000 7f7054f7d740 10 client.26587 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.772+0000 7f7054f7d740 10 client.26587 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.772+0000 7f7054f7d740 20 client.26587 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.772+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e4b29fc600 0x55e4b29fea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.772+0000 7f7054f7d740 4 client.26587 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.772+0000 7f7054f7d740 1 -- 172.21.15.8:0/1698671612 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e4b2670890 con 0x55e4b29fc600 2024-03-16T21:02:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.773+0000 7f704be00640 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e4b29fc600 0x55e4b29fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.773+0000 7f704be00640 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e4b29fc600 0x55e4b29fea20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=25b333d19951d907 server_cookie=45741779fb93851b in_seq=0 out_seq=0 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.773+0000 7f7038c00640 10 client.26587 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.773+0000 7f7038c00640 1 -- 172.21.15.8:0/1698671612 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e4b2670890 con 0x55e4b29fc600 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.773+0000 7f7038c00640 10 client.26587 handle_command_reply: tid=0 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.773+0000 7f7054f7d740 1 client.26587 shutdown 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.773+0000 7f7054f7d740 1 -- 172.21.15.8:0/1698671612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 msgr2=0x55e4b298ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.773+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b298ae90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f703401ca30 tx=0x7f7034009770 comp rx=0 tx=0).stop 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7054f7d740 1 -- 172.21.15.8:0/1698671612 shutdown_connections 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e4b29fc600 0x55e4b29fea20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4b2987140 0x55e4b298b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e4b297e560 0x55e4b298ae90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7054f7d740 1 --2- 172.21.15.8:0/1698671612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e4b297dc40 0x55e4b298eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7054f7d740 1 -- 172.21.15.8:0/1698671612 >> 172.21.15.8:0/1698671612 conn(0x55e4b2978370 msgr2=0x55e4b2979ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7038c00640 0 client.26587 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7054f7d740 1 -- 172.21.15.8:0/1698671612 shutdown_connections 2024-03-16T21:02:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7054f7d740 1 -- 172.21.15.8:0/1698671612 wait complete. 2024-03-16T21:02:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7054f7d740 20 client.26587 trim_cache size 0 max 16384 2024-03-16T21:02:08.783 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:02:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7052200640 1 -- 172.21.15.8:0/1685715608 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70300a1ba0 msgr2=0x7f70300a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7052200640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70300a1ba0 0x7f70300a4060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55e4b297d710 tx=0x7f703c0d16b0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7052200640 1 -- 172.21.15.8:0/1685715608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f704c103690 msgr2=0x7f704c199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.774+0000 7f7052200640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f704c103690 0x7f704c199e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f703c00ebc0 tx=0x7f703c00c6a0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.775+0000 7f7052200640 1 -- 172.21.15.8:0/1685715608 shutdown_connections 2024-03-16T21:02:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.775+0000 7f7052200640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70300a1ba0 0x7f70300a4060 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.775+0000 7f7052200640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f704c1096a0 0x7f704c19e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.775+0000 7f7052200640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f704c104050 0x7f704c19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.775+0000 7f7052200640 1 --2- 172.21.15.8:0/1685715608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f704c103690 0x7f704c199e20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.775+0000 7f7052200640 1 -- 172.21.15.8:0/1685715608 >> 172.21.15.8:0/1685715608 conn(0x7f704c0ff1a0 msgr2=0x7f704c0ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.775+0000 7f7052200640 1 -- 172.21.15.8:0/1685715608 shutdown_connections 2024-03-16T21:02:08.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:08.775+0000 7f7052200640 1 -- 172.21.15.8:0/1685715608 wait complete. 2024-03-16T21:02:08.797 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:02:08.797 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:02:08.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:08 smithi170 ceph-mon[35947]: pgmap v132: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:02:08.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:08 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:02:08.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:08 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:08.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:08 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:02:08.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:08 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:08.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:08 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:02:08.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:08 smithi186 ceph-mon[36391]: pgmap v132: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:02:08.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:08 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:02:08.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:08 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:08.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:08 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:02:08.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:08 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:08.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:08 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:02:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.008+0000 7fd54a600640 1 -- 172.21.15.8:0/317221380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5441015d0 msgr2=0x7fd5441019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.008+0000 7fd54a600640 1 --2- 172.21.15.8:0/317221380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5441015d0 0x7fd5441019b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd538009930 tx=0x7fd53802bc30 comp rx=0 tx=0).stop 2024-03-16T21:02:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.008+0000 7fd54a600640 1 -- 172.21.15.8:0/317221380 shutdown_connections 2024-03-16T21:02:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.008+0000 7fd54a600640 1 --2- 172.21.15.8:0/317221380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5441066a0 0x7fd54410e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.008+0000 7fd54a600640 1 --2- 172.21.15.8:0/317221380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd544101f80 0x7fd544105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.008+0000 7fd54a600640 1 --2- 172.21.15.8:0/317221380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5441015d0 0x7fd5441019b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.008+0000 7fd54a600640 1 -- 172.21.15.8:0/317221380 >> 172.21.15.8:0/317221380 conn(0x7fd5440fce50 msgr2=0x7fd5440ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.009+0000 7fd54a600640 1 -- 172.21.15.8:0/317221380 shutdown_connections 2024-03-16T21:02:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.009+0000 7fd54a600640 1 -- 172.21.15.8:0/317221380 wait complete. 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd54a600640 1 Processor -- start 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd54a600640 1 -- start start 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd54a600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5441015d0 0x7fd544199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd54a600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5441066a0 0x7fd54419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd54a600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54419e680 0x7fd54419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd54a600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54419f070 con 0x7fd54419e680 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd54a600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54419f1e0 con 0x7fd5441015d0 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd54a600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54419f350 con 0x7fd5441066a0 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd543e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5441066a0 0x7fd54419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd549200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5441015d0 0x7fd544199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd543e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5441066a0 0x7fd54419a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57472/0 (socket says 172.21.15.8:57472) 2024-03-16T21:02:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.010+0000 7fd543e00640 1 -- 172.21.15.8:0/2588021622 learned_addr learned my addr 172.21.15.8:0/2588021622 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.011+0000 7fd549c00640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54419e680 0x7fd54419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.011+0000 7fd543e00640 1 -- 172.21.15.8:0/2588021622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5441015d0 msgr2=0x7fd544199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.011+0000 7fd543e00640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5441015d0 0x7fd544199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.011+0000 7fd543e00640 1 -- 172.21.15.8:0/2588021622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54419e680 msgr2=0x7fd54419eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.011+0000 7fd543e00640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54419e680 0x7fd54419eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.011+0000 7fd543e00640 1 -- 172.21.15.8:0/2588021622 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530009490 con 0x7fd5441066a0 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.011+0000 7fd543e00640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5441066a0 0x7fd54419a300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd53000e9a0 tx=0x7fd53000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.011+0000 7fd541600640 1 -- 172.21.15.8:0/2588021622 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53000cd80 con 0x7fd5441066a0 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.011+0000 7fd541600640 1 -- 172.21.15.8:0/2588021622 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd5300035f0 con 0x7fd5441066a0 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.011+0000 7fd54a600640 1 -- 172.21.15.8:0/2588021622 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c009840 con 0x7fd5441066a0 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.012+0000 7fd541600640 1 -- 172.21.15.8:0/2588021622 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530010690 con 0x7fd5441066a0 2024-03-16T21:02:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.012+0000 7fd54a600640 1 -- 172.21.15.8:0/2588021622 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd538009560 con 0x7fd5441066a0 2024-03-16T21:02:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.015+0000 7fd54e81c740 1 Processor -- start 2024-03-16T21:02:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.015+0000 7fd54e81c740 1 -- start start 2024-03-16T21:02:09.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.015+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 0x55a3aa9371d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.015+0000 7fd541600640 1 -- 172.21.15.8:0/2588021622 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fd530003b60 con 0x7fd5441066a0 2024-03-16T21:02:09.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.015+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa937710 0x55a3aa93fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.015+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa9402f0 0x55a3aa9426e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.015+0000 7fd54e81c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa8a5210 con 0x55a3aa9402f0 2024-03-16T21:02:09.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.015+0000 7fd54e81c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa8a2740 con 0x55a3aa936df0 2024-03-16T21:02:09.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.015+0000 7fd54e81c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa89df20 con 0x55a3aa937710 2024-03-16T21:02:09.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd549200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa937710 0x55a3aa93fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd549c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 0x55a3aa9371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd549200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa937710 0x55a3aa93fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57476/0 (socket says 172.21.15.8:57476) 2024-03-16T21:02:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd543e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa9402f0 0x55a3aa9426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd549200640 1 -- 172.21.15.8:0/2772063932 learned_addr learned my addr 172.21.15.8:0/2772063932 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd549c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 0x55a3aa9371d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55808/0 (socket says 172.21.15.8:55808) 2024-03-16T21:02:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd549200640 1 -- 172.21.15.8:0/2772063932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 msgr2=0x55a3aa9371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd549200640 1 --2- 172.21.15.8:0/2772063932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 0x55a3aa9371d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd549200640 1 -- 172.21.15.8:0/2772063932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa9402f0 msgr2=0x55a3aa9426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd549200640 1 --2- 172.21.15.8:0/2772063932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa9402f0 0x55a3aa9426e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd549200640 1 -- 172.21.15.8:0/2772063932 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3aa85fdf0 con 0x55a3aa937710 2024-03-16T21:02:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.016+0000 7fd549200640 1 --2- 172.21.15.8:0/2772063932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa937710 0x55a3aa93fdb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd538005ab0 tx=0x7fd53802c660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24587b92c8d0586d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.017+0000 7fd536000640 1 -- 172.21.15.8:0/2772063932 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380046c0 con 0x55a3aa937710 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.017+0000 7fd536000640 1 -- 172.21.15.8:0/2772063932 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd538004820 con 0x55a3aa937710 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.017+0000 7fd536000640 1 -- 172.21.15.8:0/2772063932 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538005070 con 0x55a3aa937710 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.017+0000 7fd541600640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd52c0a1ba0 0x7fd52c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.017+0000 7fd541600640 1 -- 172.21.15.8:0/2588021622 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd530014070 con 0x7fd5441066a0 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.017+0000 7fd549c00640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd52c0a1ba0 0x7fd52c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.018+0000 7fd54e81c740 1 -- 172.21.15.8:0/2772063932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa937710 msgr2=0x55a3aa93fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.018+0000 7fd54e81c740 1 --2- 172.21.15.8:0/2772063932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa937710 0x55a3aa93fdb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd538005ab0 tx=0x7fd53802c660 comp rx=0 tx=0).stop 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.018+0000 7fd54e81c740 1 -- 172.21.15.8:0/2772063932 shutdown_connections 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.018+0000 7fd54e81c740 1 --2- 172.21.15.8:0/2772063932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa9402f0 0x55a3aa9426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.018+0000 7fd54e81c740 1 --2- 172.21.15.8:0/2772063932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa937710 0x55a3aa93fdb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.018+0000 7fd54e81c740 1 --2- 172.21.15.8:0/2772063932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 0x55a3aa9371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.018+0000 7fd54e81c740 1 -- 172.21.15.8:0/2772063932 >> 172.21.15.8:0/2772063932 conn(0x55a3aa931520 msgr2=0x55a3aa931900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.018+0000 7fd54e81c740 1 -- 172.21.15.8:0/2772063932 shutdown_connections 2024-03-16T21:02:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.018+0000 7fd549c00640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd52c0a1ba0 0x7fd52c0a4060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd53c005fd0 tx=0x7fd53c009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.018+0000 7fd54e81c740 1 -- 172.21.15.8:0/2772063932 wait complete. 2024-03-16T21:02:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.018+0000 7fd54e81c740 1 -- start start 2024-03-16T21:02:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd54e81c740 1 Processor -- start 2024-03-16T21:02:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa936df0 0x55a3aa93d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa937710 0x55a3aa93d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa9402f0 0x55a3aa93de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd54e81c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa843150 con 0x55a3aa937710 2024-03-16T21:02:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd54e81c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa842df0 con 0x55a3aa9402f0 2024-03-16T21:02:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd54e81c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa60c1c0 con 0x55a3aa936df0 2024-03-16T21:02:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd54e81c740 10 client.0 _ll_register_callbacks cb 0x55a3aa8922b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd549200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa936df0 0x55a3aa93d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd549200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa936df0 0x55a3aa93d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57480/0 (socket says 172.21.15.8:57480) 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd549c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa9402f0 0x55a3aa93de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.019+0000 7fd549200640 1 -- 172.21.15.8:0/2469629488 learned_addr learned my addr 172.21.15.8:0/2469629488 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.020+0000 7fd543e00640 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa937710 0x55a3aa93d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.020+0000 7fd549200640 1 -- 172.21.15.8:0/2469629488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa9402f0 msgr2=0x55a3aa93de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.020+0000 7fd549200640 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa9402f0 0x55a3aa93de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.020+0000 7fd549200640 1 -- 172.21.15.8:0/2469629488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa937710 msgr2=0x55a3aa93d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.020+0000 7fd549200640 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa937710 0x55a3aa93d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.020+0000 7fd549200640 1 -- 172.21.15.8:0/2469629488 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54410ea80 con 0x55a3aa936df0 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.020+0000 7fd549200640 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa936df0 0x55a3aa93d3c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd53802c170 tx=0x7fd538004bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dc67385087cd06a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.020+0000 7fd52aa00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.020+0000 7fd52aa00640 1 -- 172.21.15.8:0/2469629488 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53802cce0 con 0x55a3aa936df0 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.020+0000 7fd52aa00640 1 -- 172.21.15.8:0/2469629488 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd538005020 con 0x55a3aa936df0 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.020+0000 7fd54e81c740 1 -- 172.21.15.8:0/2469629488 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3aa59d7e0 con 0x55a3aa936df0 2024-03-16T21:02:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.021+0000 7fd52aa00640 1 -- 172.21.15.8:0/2469629488 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5380051e0 con 0x55a3aa936df0 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.021+0000 7fd54e81c740 10 client.26599 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.021+0000 7fd54e81c740 1 -- 172.21.15.8:0/2469629488 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55a3aa89c5a0 con 0x55a3aa936df0 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.021+0000 7fd52aa00640 1 -- 172.21.15.8:0/2469629488 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a3aa59d7e0 con 0x55a3aa936df0 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.021+0000 7fd52aa00640 1 -- 172.21.15.8:0/2469629488 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fd53803c050 con 0x55a3aa936df0 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.021+0000 7fd54e81c740 10 client.26599 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.021+0000 7fd54e81c740 10 client.26599 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.021+0000 7fd54e81c740 20 client.26599 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.021+0000 7fd54e81c740 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a3aa950000 0x55a3aa952420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.021+0000 7fd54e81c740 4 client.26599 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.021+0000 7fd54e81c740 1 -- 172.21.15.8:0/2469629488 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3aa5da720 con 0x55a3aa950000 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.022+0000 7fd543e00640 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a3aa950000 0x55a3aa952420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.022+0000 7fd543e00640 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a3aa950000 0x55a3aa952420 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ed254a94a1f551d0 server_cookie=e1ff96999df5ced3 in_seq=0 out_seq=0 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.022+0000 7fd52aa00640 10 client.26599 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd52aa00640 1 -- 172.21.15.8:0/2469629488 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a3aa5da720 con 0x55a3aa950000 2024-03-16T21:02:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd52aa00640 10 client.26599 handle_command_reply: tid=0 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 1 client.26599 shutdown 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 1 -- 172.21.15.8:0/2469629488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa936df0 msgr2=0x55a3aa93d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa936df0 0x55a3aa93d3c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd53802c170 tx=0x7fd538004bc0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 1 -- 172.21.15.8:0/2469629488 shutdown_connections 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a3aa950000 0x55a3aa952420 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa9402f0 0x55a3aa93de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa937710 0x55a3aa93d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 1 --2- 172.21.15.8:0/2469629488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa936df0 0x55a3aa93d3c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 1 -- 172.21.15.8:0/2469629488 >> 172.21.15.8:0/2469629488 conn(0x55a3aa931520 msgr2=0x55a3aa933270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd52aa00640 0 client.26599 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 1 -- 172.21.15.8:0/2469629488 shutdown_connections 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 1 -- 172.21.15.8:0/2469629488 wait complete. 2024-03-16T21:02:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.023+0000 7fd54e81c740 20 client.26599 trim_cache size 0 max 16384 2024-03-16T21:02:09.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.037+0000 7fd54e81c740 1 Processor -- start 2024-03-16T21:02:09.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.037+0000 7fd54e81c740 1 -- start start 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa936df0 0x55a3aa93faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa937710 0x55a3aa94b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa9402f0 0x55a3aa94bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd54e81c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa932310 con 0x55a3aa936df0 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd54e81c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa930dd0 con 0x55a3aa937710 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd54e81c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa94cea0 con 0x55a3aa9402f0 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd543e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa937710 0x55a3aa94b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd543e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa937710 0x55a3aa94b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55816/0 (socket says 172.21.15.8:55816) 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd543e00640 1 -- 172.21.15.8:0/1537123662 learned_addr learned my addr 172.21.15.8:0/1537123662 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd549c00640 1 --2- 172.21.15.8:0/1537123662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa9402f0 0x55a3aa94bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd549200640 1 --2- 172.21.15.8:0/1537123662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa936df0 0x55a3aa93faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd543e00640 1 -- 172.21.15.8:0/1537123662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa9402f0 msgr2=0x55a3aa94bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd543e00640 1 --2- 172.21.15.8:0/1537123662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa9402f0 0x55a3aa94bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd543e00640 1 -- 172.21.15.8:0/1537123662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa936df0 msgr2=0x55a3aa93faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd543e00640 1 --2- 172.21.15.8:0/1537123662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa936df0 0x55a3aa93faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.038+0000 7fd543e00640 1 -- 172.21.15.8:0/1537123662 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3aa838ab0 con 0x55a3aa937710 2024-03-16T21:02:09.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd543e00640 1 --2- 172.21.15.8:0/1537123662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa937710 0x55a3aa94b610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd53000c6a0 tx=0x7fd5300d1600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=123247b6fd3bb437 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd535600640 1 -- 172.21.15.8:0/1537123662 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5300d2040 con 0x55a3aa937710 2024-03-16T21:02:09.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd535600640 1 -- 172.21.15.8:0/1537123662 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd53009a2b0 con 0x55a3aa937710 2024-03-16T21:02:09.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd535600640 1 -- 172.21.15.8:0/1537123662 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5300cb6f0 con 0x55a3aa937710 2024-03-16T21:02:09.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd54e81c740 1 -- 172.21.15.8:0/1537123662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa937710 msgr2=0x55a3aa94b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd54e81c740 1 --2- 172.21.15.8:0/1537123662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa937710 0x55a3aa94b610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd53000c6a0 tx=0x7fd5300d1600 comp rx=0 tx=0).stop 2024-03-16T21:02:09.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd54e81c740 1 -- 172.21.15.8:0/1537123662 shutdown_connections 2024-03-16T21:02:09.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd54e81c740 1 --2- 172.21.15.8:0/1537123662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa9402f0 0x55a3aa94bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd54e81c740 1 --2- 172.21.15.8:0/1537123662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa937710 0x55a3aa94b610 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd54e81c740 1 --2- 172.21.15.8:0/1537123662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa936df0 0x55a3aa93faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd54e81c740 1 -- 172.21.15.8:0/1537123662 >> 172.21.15.8:0/1537123662 conn(0x55a3aa931520 msgr2=0x55a3aa9306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.039+0000 7fd54e81c740 1 -- 172.21.15.8:0/1537123662 shutdown_connections 2024-03-16T21:02:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.040+0000 7fd54e81c740 1 -- 172.21.15.8:0/1537123662 wait complete. 2024-03-16T21:02:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.040+0000 7fd54e81c740 1 -- start start 2024-03-16T21:02:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.040+0000 7fd54e81c740 1 Processor -- start 2024-03-16T21:02:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 0x55a3aa9438d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa937710 0x55a3aa943e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd54e81c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa9402f0 0x55a3aa9aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd54e81c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa9445b0 con 0x55a3aa937710 2024-03-16T21:02:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd54e81c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa944720 con 0x55a3aa936df0 2024-03-16T21:02:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd54e81c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aa9aae30 con 0x55a3aa9402f0 2024-03-16T21:02:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd54e81c740 10 client.0 _ll_register_callbacks cb 0x7fd5300d14d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:09.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd549200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 0x55a3aa9438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd549200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 0x55a3aa9438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55824/0 (socket says 172.21.15.8:55824) 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd549200640 1 -- 172.21.15.8:0/1218612812 learned_addr learned my addr 172.21.15.8:0/1218612812 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd543e00640 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa937710 0x55a3aa943e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd549c00640 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa9402f0 0x55a3aa9aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd549200640 1 -- 172.21.15.8:0/1218612812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa9402f0 msgr2=0x55a3aa9aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd549200640 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa9402f0 0x55a3aa9aa8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd549200640 1 -- 172.21.15.8:0/1218612812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa937710 msgr2=0x55a3aa943e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd549200640 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa937710 0x55a3aa943e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.041+0000 7fd549200640 1 -- 172.21.15.8:0/1218612812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd538009560 con 0x55a3aa936df0 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.042+0000 7fd549200640 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 0x55a3aa9438d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd53802c170 tx=0x7fd538005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aa808acf104cf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.042+0000 7fd52aa00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.042+0000 7fd52aa00640 1 -- 172.21.15.8:0/1218612812 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53804aea0 con 0x55a3aa936df0 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.042+0000 7fd54e81c740 1 -- 172.21.15.8:0/1218612812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd538004820 con 0x55a3aa936df0 2024-03-16T21:02:09.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.042+0000 7fd52aa00640 1 -- 172.21.15.8:0/1218612812 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd538000e40 con 0x55a3aa936df0 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.042+0000 7fd52aa00640 1 -- 172.21.15.8:0/1218612812 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd53802cbc0 con 0x55a3aa936df0 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.042+0000 7fd54e81c740 10 client.26597 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.042+0000 7fd54e81c740 1 -- 172.21.15.8:0/1218612812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55a3aa85e650 con 0x55a3aa936df0 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.042+0000 7fd52aa00640 1 -- 172.21.15.8:0/1218612812 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd538004820 con 0x55a3aa936df0 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.042+0000 7fd52aa00640 1 -- 172.21.15.8:0/1218612812 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fd53803c070 con 0x55a3aa936df0 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd54e81c740 10 client.26597 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd54e81c740 10 client.26597 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd54e81c740 20 client.26597 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd54e81c740 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a3aa9ac300 0x55a3aa9ae720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd54e81c740 4 client.26597 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd54e81c740 1 -- 172.21.15.8:0/1218612812 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a3aa629890 con 0x55a3aa9ac300 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd543e00640 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a3aa9ac300 0x55a3aa9ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd543e00640 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a3aa9ac300 0x55a3aa9ae720 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eae87318da1ad352 server_cookie=81467e5371074d23 in_seq=0 out_seq=0 2024-03-16T21:02:09.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd52aa00640 10 client.26597 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd52aa00640 1 -- 172.21.15.8:0/1218612812 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a3aa629890 con 0x55a3aa9ac300 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd52aa00640 10 client.26597 handle_command_reply: tid=0 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.043+0000 7fd54e81c740 1 client.26597 shutdown 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd54e81c740 1 -- 172.21.15.8:0/1218612812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 msgr2=0x55a3aa9438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd54e81c740 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 0x55a3aa9438d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd53802c170 tx=0x7fd538005a20 comp rx=0 tx=0).stop 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd54e81c740 1 -- 172.21.15.8:0/1218612812 shutdown_connections 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd54e81c740 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55a3aa9ac300 0x55a3aa9ae720 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd54e81c740 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a3aa9402f0 0x55a3aa9aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd54e81c740 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aa937710 0x55a3aa943e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd54e81c740 1 --2- 172.21.15.8:0/1218612812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3aa936df0 0x55a3aa9438d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd52aa00640 0 client.26597 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd54e81c740 1 -- 172.21.15.8:0/1218612812 >> 172.21.15.8:0/1218612812 conn(0x55a3aa931520 msgr2=0x55a3aa93d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd54e81c740 1 -- 172.21.15.8:0/1218612812 shutdown_connections 2024-03-16T21:02:09.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd54e81c740 1 -- 172.21.15.8:0/1218612812 wait complete. 2024-03-16T21:02:09.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.044+0000 7fd54e81c740 20 client.26597 trim_cache size 0 max 16384 2024-03-16T21:02:09.055 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:02:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 -- 172.21.15.8:0/2588021622 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd52c0a1ba0 msgr2=0x7fd52c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd52c0a1ba0 0x7fd52c0a4060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd53c005fd0 tx=0x7fd53c009500 comp rx=0 tx=0).stop 2024-03-16T21:02:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 -- 172.21.15.8:0/2588021622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5441066a0 msgr2=0x7fd54419a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5441066a0 0x7fd54419a300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd53000e9a0 tx=0x7fd53000ee60 comp rx=0 tx=0).stop 2024-03-16T21:02:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 -- 172.21.15.8:0/2588021622 shutdown_connections 2024-03-16T21:02:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd52c0a1ba0 0x7fd52c0a4060 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd54419e680 0x7fd54419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5441066a0 0x7fd54419a300 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 --2- 172.21.15.8:0/2588021622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5441015d0 0x7fd544199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 -- 172.21.15.8:0/2588021622 >> 172.21.15.8:0/2588021622 conn(0x7fd5440fce50 msgr2=0x7fd5440ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 -- 172.21.15.8:0/2588021622 shutdown_connections 2024-03-16T21:02:09.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.045+0000 7fd54a600640 1 -- 172.21.15.8:0/2588021622 wait complete. 2024-03-16T21:02:09.066 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:02:09.067 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:02:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.285+0000 7fd31a400640 1 -- 172.21.15.8:0/2433921447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd314103f50 msgr2=0x7fd314110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.285+0000 7fd31a400640 1 --2- 172.21.15.8:0/2433921447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd314103f50 0x7fd314110410 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009cd0 tx=0x7fd30c02c0f0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.286+0000 7fd31a400640 1 -- 172.21.15.8:0/2433921447 shutdown_connections 2024-03-16T21:02:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.286+0000 7fd31a400640 1 --2- 172.21.15.8:0/2433921447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd314103f50 0x7fd314110410 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.286+0000 7fd31a400640 1 --2- 172.21.15.8:0/2433921447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd314103590 0x7fd314103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.286+0000 7fd31a400640 1 --2- 172.21.15.8:0/2433921447 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd314109650 0x7fd314109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.286+0000 7fd31a400640 1 -- 172.21.15.8:0/2433921447 >> 172.21.15.8:0/2433921447 conn(0x7fd3140ff020 msgr2=0x7fd314101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.286+0000 7fd31a400640 1 -- 172.21.15.8:0/2433921447 shutdown_connections 2024-03-16T21:02:09.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.286+0000 7fd31a400640 1 -- 172.21.15.8:0/2433921447 wait complete. 2024-03-16T21:02:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.287+0000 7fd31a400640 1 Processor -- start 2024-03-16T21:02:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.287+0000 7fd31a400640 1 -- start start 2024-03-16T21:02:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd31a400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd314103590 0x7fd31419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd31a400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd314103f50 0x7fd31419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd31a400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd314109650 0x7fd314199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd31a400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31419a080 con 0x7fd314103f50 2024-03-16T21:02:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd31a400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31419a1f0 con 0x7fd314103590 2024-03-16T21:02:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd31a400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31419a3b0 con 0x7fd314109650 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd319000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd314103590 0x7fd31419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd319a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd314109650 0x7fd314199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd319000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd314103590 0x7fd31419f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55838/0 (socket says 172.21.15.8:55838) 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd319000640 1 -- 172.21.15.8:0/4012786300 learned_addr learned my addr 172.21.15.8:0/4012786300 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd313e00640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd314103f50 0x7fd31419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd319000640 1 -- 172.21.15.8:0/4012786300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd314109650 msgr2=0x7fd314199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd319000640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd314109650 0x7fd314199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd319000640 1 -- 172.21.15.8:0/4012786300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd314103f50 msgr2=0x7fd31419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd319000640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd314103f50 0x7fd31419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd319000640 1 -- 172.21.15.8:0/4012786300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c009900 con 0x7fd314103590 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.288+0000 7fd319a00640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd314109650 0x7fd314199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.289+0000 7fd319000640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd314103590 0x7fd31419f880 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd30800e9f0 tx=0x7fd30800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.289+0000 7fd311600640 1 -- 172.21.15.8:0/4012786300 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308009700 con 0x7fd314103590 2024-03-16T21:02:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.289+0000 7fd311600640 1 -- 172.21.15.8:0/4012786300 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd30800cd80 con 0x7fd314103590 2024-03-16T21:02:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.289+0000 7fd311600640 1 -- 172.21.15.8:0/4012786300 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3080189c0 con 0x7fd314103590 2024-03-16T21:02:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.289+0000 7fd31a400640 1 -- 172.21.15.8:0/4012786300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31419a690 con 0x7fd314103590 2024-03-16T21:02:09.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.289+0000 7fd31a400640 1 -- 172.21.15.8:0/4012786300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3141a6920 con 0x7fd314103590 2024-03-16T21:02:09.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd31e769740 1 Processor -- start 2024-03-16T21:02:09.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd31e769740 1 -- start start 2024-03-16T21:02:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd311600640 1 -- 172.21.15.8:0/4012786300 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fd308018b20 con 0x7fd314103590 2024-03-16T21:02:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd31e769740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f151d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd31e769740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd31e769740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f206e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd31e769740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9e83210 con 0x5590c9f15710 2024-03-16T21:02:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd31e769740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9e80740 con 0x5590c9f1e2f0 2024-03-16T21:02:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd31e769740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9e7bf20 con 0x5590c9f14df0 2024-03-16T21:02:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd319a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd319a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f151d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57506/0 (socket says 172.21.15.8:57506) 2024-03-16T21:02:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd319a00640 1 -- 172.21.15.8:0/1505247164 learned_addr learned my addr 172.21.15.8:0/1505247164 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd319000640 1 --2- 172.21.15.8:0/1505247164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.293+0000 7fd313e00640 1 --2- 172.21.15.8:0/1505247164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.294+0000 7fd319a00640 1 -- 172.21.15.8:0/1505247164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 msgr2=0x5590c9f206e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.294+0000 7fd319a00640 1 --2- 172.21.15.8:0/1505247164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f206e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.294+0000 7fd319a00640 1 -- 172.21.15.8:0/1505247164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 msgr2=0x5590c9f1ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.294+0000 7fd319a00640 1 --2- 172.21.15.8:0/1505247164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.294+0000 7fd319a00640 1 -- 172.21.15.8:0/1505247164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590c9e3ddf0 con 0x5590c9f14df0 2024-03-16T21:02:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.294+0000 7fd319a00640 1 --2- 172.21.15.8:0/1505247164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f151d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd30c005e30 tx=0x7fd30c005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3838f3a065224add server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.294+0000 7fd306000640 1 -- 172.21.15.8:0/1505247164 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c034640 con 0x5590c9f14df0 2024-03-16T21:02:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.294+0000 7fd306000640 1 -- 172.21.15.8:0/1505247164 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd30c0347a0 con 0x5590c9f14df0 2024-03-16T21:02:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.294+0000 7fd306000640 1 -- 172.21.15.8:0/1505247164 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c004040 con 0x5590c9f14df0 2024-03-16T21:02:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd311600640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd2fc0a1ba0 0x7fd2fc0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd319000640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd2fc0a1ba0 0x7fd2fc0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd311600640 1 -- 172.21.15.8:0/4012786300 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd308014070 con 0x7fd314103590 2024-03-16T21:02:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd31e769740 1 -- 172.21.15.8:0/1505247164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 msgr2=0x5590c9f151d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd31e769740 1 --2- 172.21.15.8:0/1505247164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f151d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd30c005e30 tx=0x7fd30c005ef0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd31e769740 1 -- 172.21.15.8:0/1505247164 shutdown_connections 2024-03-16T21:02:09.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd31e769740 1 --2- 172.21.15.8:0/1505247164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f206e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd31e769740 1 --2- 172.21.15.8:0/1505247164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd31e769740 1 --2- 172.21.15.8:0/1505247164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f151d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd31e769740 1 -- 172.21.15.8:0/1505247164 >> 172.21.15.8:0/1505247164 conn(0x5590c9f0f520 msgr2=0x5590c9f0f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd31e769740 1 -- 172.21.15.8:0/1505247164 shutdown_connections 2024-03-16T21:02:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd31e769740 1 -- 172.21.15.8:0/1505247164 wait complete. 2024-03-16T21:02:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.295+0000 7fd319000640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd2fc0a1ba0 0x7fd2fc0a4060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd3080cb330 tx=0x7fd308083f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.296+0000 7fd31e769740 1 -- start start 2024-03-16T21:02:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.296+0000 7fd31e769740 1 Processor -- start 2024-03-16T21:02:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd31e769740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd31e769740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd31e769740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f1bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd31e769740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9e21150 con 0x5590c9f15710 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd31e769740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9e20df0 con 0x5590c9f1e2f0 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd31e769740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9bea1c0 con 0x5590c9f14df0 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd31e769740 10 client.0 _ll_register_callbacks cb 0x5590c9e702b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd319a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd313e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd319a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57520/0 (socket says 172.21.15.8:57520) 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd313e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54830/0 (socket says 172.21.15.8:54830) 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd319a00640 1 -- 172.21.15.8:0/3252387246 learned_addr learned my addr 172.21.15.8:0/3252387246 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.297+0000 7fd319a00640 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f1bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd319a00640 1 -- 172.21.15.8:0/3252387246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 msgr2=0x5590c9f1bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd319a00640 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f1bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd319a00640 1 -- 172.21.15.8:0/3252387246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 msgr2=0x5590c9f1b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd319a00640 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd319a00640 1 -- 172.21.15.8:0/3252387246 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd314110d10 con 0x5590c9f14df0 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd313e00640 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd319a00640 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1b310 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd30c003c10 tx=0x7fd30c003b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=951ffe517a659c91 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd2faa00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd2faa00640 1 -- 172.21.15.8:0/3252387246 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c032870 con 0x5590c9f14df0 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd2faa00640 1 -- 172.21.15.8:0/3252387246 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd30c0329d0 con 0x5590c9f14df0 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd31e769740 1 -- 172.21.15.8:0/3252387246 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590c9b7b7e0 con 0x5590c9f14df0 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd2faa00640 1 -- 172.21.15.8:0/3252387246 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd30c032b90 con 0x5590c9f14df0 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.298+0000 7fd31e769740 10 client.26617 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.299+0000 7fd31e769740 1 -- 172.21.15.8:0/3252387246 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5590c9e7a5a0 con 0x5590c9f14df0 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.299+0000 7fd2faa00640 1 -- 172.21.15.8:0/3252387246 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5590c9b7b7e0 con 0x5590c9f14df0 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.299+0000 7fd2faa00640 1 -- 172.21.15.8:0/3252387246 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fd30c04a980 con 0x5590c9f14df0 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.299+0000 7fd31e769740 10 client.26617 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.299+0000 7fd31e769740 10 client.26617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.299+0000 7fd31e769740 20 client.26617 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.299+0000 7fd31e769740 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5590c9f2de40 0x5590c9f30260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.299+0000 7fd31e769740 4 client.26617 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.299+0000 7fd31e769740 1 -- 172.21.15.8:0/3252387246 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590c9bb8720 con 0x5590c9f2de40 2024-03-16T21:02:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.299+0000 7fd313e00640 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5590c9f2de40 0x5590c9f30260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.300+0000 7fd313e00640 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5590c9f2de40 0x5590c9f30260 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddb232a5c57109e1 server_cookie=1d4793da975a2dfe in_seq=0 out_seq=0 2024-03-16T21:02:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.300+0000 7fd2faa00640 10 client.26617 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd2faa00640 1 -- 172.21.15.8:0/3252387246 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5590c9bb8720 con 0x5590c9f2de40 2024-03-16T21:02:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd2faa00640 10 client.26617 handle_command_reply: tid=0 2024-03-16T21:02:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 1 client.26617 shutdown 2024-03-16T21:02:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 1 -- 172.21.15.8:0/3252387246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 msgr2=0x5590c9f1b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1b310 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd30c003c10 tx=0x7fd30c003b10 comp rx=0 tx=0).stop 2024-03-16T21:02:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 1 -- 172.21.15.8:0/3252387246 shutdown_connections 2024-03-16T21:02:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f1bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5590c9f2de40 0x5590c9f30260 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 1 --2- 172.21.15.8:0/3252387246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1b310 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 1 -- 172.21.15.8:0/3252387246 >> 172.21.15.8:0/3252387246 conn(0x5590c9f0f520 msgr2=0x5590c9f11270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd2faa00640 0 client.26617 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:09.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 1 -- 172.21.15.8:0/3252387246 shutdown_connections 2024-03-16T21:02:09.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 1 -- 172.21.15.8:0/3252387246 wait complete. 2024-03-16T21:02:09.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.301+0000 7fd31e769740 20 client.26617 trim_cache size 0 max 16384 2024-03-16T21:02:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd31e769740 1 Processor -- start 2024-03-16T21:02:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd31e769740 1 -- start start 2024-03-16T21:02:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd31e769740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd31e769740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd31e769740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f0e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd31e769740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9bb8720 con 0x5590c9f15710 2024-03-16T21:02:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd31e769740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9f140e0 con 0x5590c9f1e2f0 2024-03-16T21:02:09.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd31e769740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9f10570 con 0x5590c9f14df0 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd319a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd319a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57526/0 (socket says 172.21.15.8:57526) 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd319a00640 1 -- 172.21.15.8:0/3018580657 learned_addr learned my addr 172.21.15.8:0/3018580657 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.316+0000 7fd319a00640 1 --2- 172.21.15.8:0/3018580657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f0e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.317+0000 7fd313e00640 1 --2- 172.21.15.8:0/3018580657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.317+0000 7fd319a00640 1 -- 172.21.15.8:0/3018580657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 msgr2=0x5590c9f0e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.317+0000 7fd319a00640 1 --2- 172.21.15.8:0/3018580657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f0e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.317+0000 7fd319a00640 1 -- 172.21.15.8:0/3018580657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 msgr2=0x5590c9f1a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.317+0000 7fd319a00640 1 --2- 172.21.15.8:0/3018580657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.317+0000 7fd319a00640 1 -- 172.21.15.8:0/3018580657 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590c9e16ab0 con 0x5590c9f14df0 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.317+0000 7fd319a00640 1 --2- 172.21.15.8:0/3018580657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1da40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd30c002230 tx=0x7fd30c005d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50cfbed1aab6057 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.317+0000 7fd305600640 1 -- 172.21.15.8:0/3018580657 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c032a70 con 0x5590c9f14df0 2024-03-16T21:02:09.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.317+0000 7fd305600640 1 -- 172.21.15.8:0/3018580657 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd30c043040 con 0x5590c9f14df0 2024-03-16T21:02:09.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.317+0000 7fd305600640 1 -- 172.21.15.8:0/3018580657 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0043c0 con 0x5590c9f14df0 2024-03-16T21:02:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.318+0000 7fd31e769740 1 -- 172.21.15.8:0/3018580657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 msgr2=0x5590c9f1da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.318+0000 7fd31e769740 1 --2- 172.21.15.8:0/3018580657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1da40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd30c002230 tx=0x7fd30c005d80 comp rx=0 tx=0).stop 2024-03-16T21:02:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.318+0000 7fd31e769740 1 -- 172.21.15.8:0/3018580657 shutdown_connections 2024-03-16T21:02:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.318+0000 7fd31e769740 1 --2- 172.21.15.8:0/3018580657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f1e2f0 0x5590c9f0e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.318+0000 7fd31e769740 1 --2- 172.21.15.8:0/3018580657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f1a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.318+0000 7fd31e769740 1 --2- 172.21.15.8:0/3018580657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f14df0 0x5590c9f1da40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.318+0000 7fd31e769740 1 -- 172.21.15.8:0/3018580657 >> 172.21.15.8:0/3018580657 conn(0x5590c9f0f520 msgr2=0x5590c9f0de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.318+0000 7fd31e769740 1 -- 172.21.15.8:0/3018580657 shutdown_connections 2024-03-16T21:02:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.318+0000 7fd31e769740 1 -- 172.21.15.8:0/3018580657 wait complete. 2024-03-16T21:02:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.318+0000 7fd31e769740 1 -- start start 2024-03-16T21:02:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.319+0000 7fd31e769740 1 Processor -- start 2024-03-16T21:02:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.319+0000 7fd31e769740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f14df0 0x5590c9f25cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.319+0000 7fd31e769740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f21110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.319+0000 7fd31e769740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f1e2f0 0x5590c9f21650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.319+0000 7fd31e769740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9f21b90 con 0x5590c9f15710 2024-03-16T21:02:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.319+0000 7fd31e769740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9f21d00 con 0x5590c9f14df0 2024-03-16T21:02:09.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.319+0000 7fd31e769740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c9f21ec0 con 0x5590c9f1e2f0 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.319+0000 7fd31e769740 10 client.0 _ll_register_callbacks cb 0x7fd3000097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.320+0000 7fd319a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f14df0 0x5590c9f25cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.320+0000 7fd319a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f14df0 0x5590c9f25cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55882/0 (socket says 172.21.15.8:55882) 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.320+0000 7fd319a00640 1 -- 172.21.15.8:0/3371764611 learned_addr learned my addr 172.21.15.8:0/3371764611 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.320+0000 7fd319a00640 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f1e2f0 0x5590c9f21650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.320+0000 7fd313e00640 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f21110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.320+0000 7fd319a00640 1 -- 172.21.15.8:0/3371764611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f1e2f0 msgr2=0x5590c9f21650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.320+0000 7fd319a00640 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f1e2f0 0x5590c9f21650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.320+0000 7fd319a00640 1 -- 172.21.15.8:0/3371764611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 msgr2=0x5590c9f21110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.320+0000 7fd319a00640 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f21110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.320+0000 7fd319a00640 1 -- 172.21.15.8:0/3371764611 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590c9e7a5a0 con 0x5590c9f14df0 2024-03-16T21:02:09.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.321+0000 7fd319a00640 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f14df0 0x5590c9f25cc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd30c003f80 tx=0x7fd30c032c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3855b6a8256a135 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.321+0000 7fd2faa00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.321+0000 7fd2faa00640 1 -- 172.21.15.8:0/3371764611 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c04a6d0 con 0x5590c9f14df0 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.321+0000 7fd2faa00640 1 -- 172.21.15.8:0/3371764611 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd30c032a80 con 0x5590c9f14df0 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.321+0000 7fd31e769740 1 -- 172.21.15.8:0/3371764611 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd30c0347a0 con 0x5590c9f14df0 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.321+0000 7fd2faa00640 1 -- 172.21.15.8:0/3371764611 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd30c04a830 con 0x5590c9f14df0 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.321+0000 7fd31e769740 10 client.26615 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.321+0000 7fd31e769740 1 -- 172.21.15.8:0/3371764611 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5590c9e3c650 con 0x5590c9f14df0 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.322+0000 7fd2faa00640 1 -- 172.21.15.8:0/3371764611 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd30c0347a0 con 0x5590c9f14df0 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.322+0000 7fd2faa00640 1 -- 172.21.15.8:0/3371764611 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fd30c03f660 con 0x5590c9f14df0 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.322+0000 7fd31e769740 10 client.26615 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.322+0000 7fd31e769740 10 client.26615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:09.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.322+0000 7fd31e769740 20 client.26615 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:09.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.322+0000 7fd31e769740 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5590c9f89740 0x5590c9f8bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:09.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.322+0000 7fd31e769740 4 client.26615 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:02:09.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.322+0000 7fd31e769740 1 -- 172.21.15.8:0/3371764611 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5590c9c07890 con 0x5590c9f89740 2024-03-16T21:02:09.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.322+0000 7fd313e00640 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5590c9f89740 0x5590c9f8bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd313e00640 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5590c9f89740 0x5590c9f8bb60 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d60db4cc637e54ab server_cookie=810c01cf7267c2bf in_seq=0 out_seq=0 2024-03-16T21:02:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd2faa00640 10 client.26615 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd2faa00640 1 -- 172.21.15.8:0/3371764611 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5590c9c07890 con 0x5590c9f89740 2024-03-16T21:02:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd2faa00640 10 client.26615 handle_command_reply: tid=0 2024-03-16T21:02:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 1 client.26615 shutdown 2024-03-16T21:02:09.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 1 -- 172.21.15.8:0/3371764611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f14df0 msgr2=0x5590c9f25cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f14df0 0x5590c9f25cc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd30c003f80 tx=0x7fd30c032c70 comp rx=0 tx=0).stop 2024-03-16T21:02:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 1 -- 172.21.15.8:0/3371764611 shutdown_connections 2024-03-16T21:02:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5590c9f1e2f0 0x5590c9f21650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5590c9f89740 0x5590c9f8bb60 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c9f15710 0x5590c9f21110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 1 --2- 172.21.15.8:0/3371764611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5590c9f14df0 0x5590c9f25cc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 1 -- 172.21.15.8:0/3371764611 >> 172.21.15.8:0/3371764611 conn(0x5590c9f0f520 msgr2=0x5590c9f1bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd2faa00640 0 client.26615 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 1 -- 172.21.15.8:0/3371764611 shutdown_connections 2024-03-16T21:02:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 1 -- 172.21.15.8:0/3371764611 wait complete. 2024-03-16T21:02:09.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.323+0000 7fd31e769740 20 client.26615 trim_cache size 0 max 16384 2024-03-16T21:02:09.334 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:02:09.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 -- 172.21.15.8:0/4012786300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd2fc0a1ba0 msgr2=0x7fd2fc0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd2fc0a1ba0 0x7fd2fc0a4060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd3080cb330 tx=0x7fd308083f90 comp rx=0 tx=0).stop 2024-03-16T21:02:09.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 -- 172.21.15.8:0/4012786300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd314103590 msgr2=0x7fd31419f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:09.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd314103590 0x7fd31419f880 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd30800e9f0 tx=0x7fd30800eeb0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 -- 172.21.15.8:0/4012786300 shutdown_connections 2024-03-16T21:02:09.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd2fc0a1ba0 0x7fd2fc0a4060 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd314109650 0x7fd314199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd314103f50 0x7fd31419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 --2- 172.21.15.8:0/4012786300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd314103590 0x7fd31419f880 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:09.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 -- 172.21.15.8:0/4012786300 >> 172.21.15.8:0/4012786300 conn(0x7fd3140ff020 msgr2=0x7fd314100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:09.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 -- 172.21.15.8:0/4012786300 shutdown_connections 2024-03-16T21:02:09.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:09.324+0000 7fd31a400640 1 -- 172.21.15.8:0/4012786300 wait complete. 2024-03-16T21:02:09.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:09 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/302052372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:02:09.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:09 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/302052372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:02:09.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:09 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/302052372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:02:10.351 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:02:10.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:02:10.351 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:02:10.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.592+0000 7faa20c00640 1 -- 172.21.15.8:0/38845067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1c10d9d0 msgr2=0x7faa1c10ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.592+0000 7faa20c00640 1 --2- 172.21.15.8:0/38845067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1c10d9d0 0x7faa1c10ddb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009900 tx=0x7faa0c02bcc0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.592+0000 7faa20c00640 1 -- 172.21.15.8:0/38845067 shutdown_connections 2024-03-16T21:02:10.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.592+0000 7faa20c00640 1 --2- 172.21.15.8:0/38845067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa1c1083d0 0x7faa1c114820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.592+0000 7faa20c00640 1 --2- 172.21.15.8:0/38845067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c107a30 0x7faa1c107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.592+0000 7faa20c00640 1 --2- 172.21.15.8:0/38845067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1c10d9d0 0x7faa1c10ddb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.592+0000 7faa20c00640 1 -- 172.21.15.8:0/38845067 >> 172.21.15.8:0/38845067 conn(0x7faa1c077310 msgr2=0x7faa1c106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.592+0000 7faa20c00640 1 -- 172.21.15.8:0/38845067 shutdown_connections 2024-03-16T21:02:10.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.592+0000 7faa20c00640 1 -- 172.21.15.8:0/38845067 wait complete. 2024-03-16T21:02:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.593+0000 7faa20c00640 1 Processor -- start 2024-03-16T21:02:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.593+0000 7faa20c00640 1 -- start start 2024-03-16T21:02:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.593+0000 7faa20c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c107a30 0x7faa1c19e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.593+0000 7faa20c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa1c1083d0 0x7faa1c19e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.593+0000 7faa20c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1c10d9d0 0x7faa1c1a2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.593+0000 7faa20c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c1a2f90 con 0x7faa1c107a30 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.593+0000 7faa20c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c1a3100 con 0x7faa1c10d9d0 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.593+0000 7faa20c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c1a32c0 con 0x7faa1c1083d0 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c107a30 0x7faa1c19e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa1c1083d0 0x7faa1c19e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c107a30 0x7faa1c19e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54862/0 (socket says 172.21.15.8:54862) 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1b400640 1 -- 172.21.15.8:0/1787974957 learned_addr learned my addr 172.21.15.8:0/1787974957 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1be00640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1c10d9d0 0x7faa1c1a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1b400640 1 -- 172.21.15.8:0/1787974957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa1c1083d0 msgr2=0x7faa1c19e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1b400640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa1c1083d0 0x7faa1c19e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1b400640 1 -- 172.21.15.8:0/1787974957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1c10d9d0 msgr2=0x7faa1c1a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1b400640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1c10d9d0 0x7faa1c1a2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1b400640 1 -- 172.21.15.8:0/1787974957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c009560 con 0x7faa1c107a30 2024-03-16T21:02:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1aa00640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa1c1083d0 0x7faa1c19e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.594+0000 7faa1be00640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1c10d9d0 0x7faa1c1a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.595+0000 7faa1b400640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c107a30 0x7faa1c19e0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa0c000c00 tx=0x7faa0c02c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.595+0000 7faa13e00640 1 -- 172.21.15.8:0/1787974957 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c02dd20 con 0x7faa1c107a30 2024-03-16T21:02:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.595+0000 7faa20c00640 1 -- 172.21.15.8:0/1787974957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c1a3540 con 0x7faa1c107a30 2024-03-16T21:02:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.595+0000 7faa20c00640 1 -- 172.21.15.8:0/1787974957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c1aae20 con 0x7faa1c107a30 2024-03-16T21:02:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.595+0000 7faa13e00640 1 -- 172.21.15.8:0/1787974957 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7faa0c02de80 con 0x7faa1c107a30 2024-03-16T21:02:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.595+0000 7faa13e00640 1 -- 172.21.15.8:0/1787974957 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c003c90 con 0x7faa1c107a30 2024-03-16T21:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.598+0000 7faa13e00640 1 -- 172.21.15.8:0/1787974957 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7faa0c004e10 con 0x7faa1c107a30 2024-03-16T21:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.598+0000 7faa24f9a740 1 Processor -- start 2024-03-16T21:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.598+0000 7faa24f9a740 1 -- start start 2024-03-16T21:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e92004f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e92090d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 0x5650e920ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa24f9a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e91bb300 con 0x5650e9200a30 2024-03-16T21:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa24f9a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e916de50 con 0x5650e9200110 2024-03-16T21:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa24f9a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e916b380 con 0x5650e9209610 2024-03-16T21:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa1aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 0x5650e920ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa1b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e92090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa1be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e92004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa1be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e92004f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55916/0 (socket says 172.21.15.8:55916) 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa1be00640 1 -- 172.21.15.8:0/893885029 learned_addr learned my addr 172.21.15.8:0/893885029 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.599+0000 7faa1aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 0x5650e920ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57570/0 (socket says 172.21.15.8:57570) 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa1be00640 1 -- 172.21.15.8:0/893885029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 msgr2=0x5650e920ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa1be00640 1 --2- 172.21.15.8:0/893885029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 0x5650e920ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa1be00640 1 -- 172.21.15.8:0/893885029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 msgr2=0x5650e92090d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa1be00640 1 --2- 172.21.15.8:0/893885029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e92090d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa1be00640 1 -- 172.21.15.8:0/893885029 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650e912fc80 con 0x5650e9200110 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa1aa00640 1 --2- 172.21.15.8:0/893885029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 0x5650e920ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa1be00640 1 --2- 172.21.15.8:0/893885029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e92004f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa14010750 tx=0x7faa14010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3229cb68e32c3e1b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa13e00640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faa000a1ba0 0x7faa000a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa07e00640 1 -- 172.21.15.8:0/893885029 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14003b70 con 0x5650e9200110 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa07e00640 1 -- 172.21.15.8:0/893885029 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7faa14015070 con 0x5650e9200110 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa07e00640 1 -- 172.21.15.8:0/893885029 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14004590 con 0x5650e9200110 2024-03-16T21:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa13e00640 1 -- 172.21.15.8:0/1787974957 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faa0c0ef650 con 0x7faa1c107a30 2024-03-16T21:02:10.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.600+0000 7faa1b400640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faa000a1ba0 0x7faa000a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.601+0000 7faa24f9a740 1 -- 172.21.15.8:0/893885029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 msgr2=0x5650e92004f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.601+0000 7faa1b400640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faa000a1ba0 0x7faa000a4060 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5650e91ffbe0 tx=0x7faa0c0dc040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.601+0000 7faa24f9a740 1 --2- 172.21.15.8:0/893885029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e92004f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa14010750 tx=0x7faa14010c10 comp rx=0 tx=0).stop 2024-03-16T21:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.601+0000 7faa24f9a740 1 -- 172.21.15.8:0/893885029 shutdown_connections 2024-03-16T21:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.601+0000 7faa24f9a740 1 --2- 172.21.15.8:0/893885029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 0x5650e920ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.601+0000 7faa24f9a740 1 --2- 172.21.15.8:0/893885029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e92090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.601+0000 7faa24f9a740 1 --2- 172.21.15.8:0/893885029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e92004f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.601+0000 7faa24f9a740 1 -- 172.21.15.8:0/893885029 >> 172.21.15.8:0/893885029 conn(0x5650e91fa840 msgr2=0x5650e91fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.601+0000 7faa24f9a740 1 -- 172.21.15.8:0/893885029 shutdown_connections 2024-03-16T21:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.601+0000 7faa24f9a740 1 -- 172.21.15.8:0/893885029 wait complete. 2024-03-16T21:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.602+0000 7faa24f9a740 1 -- start start 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.602+0000 7faa24f9a740 1 Processor -- start 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.602+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200110 0x5650e9206610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e9206b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9209610 0x5650e9207090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa24f9a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e9166b60 con 0x5650e9200a30 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa24f9a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e910bfd0 con 0x5650e9209610 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa24f9a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e910bc70 con 0x5650e9200110 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa24f9a740 10 client.0 _ll_register_callbacks cb 0x5650e8e77c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa1be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200110 0x5650e9206610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa1aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e9206b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa1be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200110 0x5650e9206610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57586/0 (socket says 172.21.15.8:57586) 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa1be00640 1 -- 172.21.15.8:0/3259020734 learned_addr learned my addr 172.21.15.8:0/3259020734 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa1be00640 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9209610 0x5650e9207090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa1aa00640 1 -- 172.21.15.8:0/3259020734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200110 msgr2=0x5650e9206610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa1aa00640 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200110 0x5650e9206610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa1aa00640 1 -- 172.21.15.8:0/3259020734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9209610 msgr2=0x5650e9207090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa1aa00640 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9209610 0x5650e9207090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa1aa00640 1 -- 172.21.15.8:0/3259020734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa140103d0 con 0x5650e9200a30 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.603+0000 7faa1be00640 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9209610 0x5650e9207090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.604+0000 7faa1aa00640 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e9206b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faa1c077a60 tx=0x7faa08011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd0636b751d73eb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.604+0000 7faa04c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.604+0000 7faa04c00640 1 -- 172.21.15.8:0/3259020734 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa08016070 con 0x5650e9200a30 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.604+0000 7faa04c00640 1 -- 172.21.15.8:0/3259020734 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faa08010c30 con 0x5650e9200a30 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.604+0000 7faa24f9a740 1 -- 172.21.15.8:0/3259020734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650e8e66860 con 0x5650e9200a30 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.604+0000 7faa04c00640 1 -- 172.21.15.8:0/3259020734 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa08010df0 con 0x5650e9200a30 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.604+0000 7faa24f9a740 10 client.16455 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.604+0000 7faa24f9a740 1 -- 172.21.15.8:0/3259020734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5650e91651e0 con 0x5650e9200a30 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.605+0000 7faa04c00640 1 -- 172.21.15.8:0/3259020734 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7faa08027080 con 0x5650e9200a30 2024-03-16T21:02:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.605+0000 7faa04c00640 1 -- 172.21.15.8:0/3259020734 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7faa08023430 con 0x5650e9200a30 2024-03-16T21:02:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.605+0000 7faa24f9a740 10 client.16455 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.605+0000 7faa24f9a740 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.605+0000 7faa24f9a740 20 client.16455 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.605+0000 7faa24f9a740 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5650e9219be0 0x5650e921c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.605+0000 7faa24f9a740 4 client.16455 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.605+0000 7faa24f9a740 1 -- 172.21.15.8:0/3259020734 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650e8eb7410 con 0x5650e9219be0 2024-03-16T21:02:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.605+0000 7faa1be00640 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5650e9219be0 0x5650e921c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.606+0000 7faa1be00640 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5650e9219be0 0x5650e921c000 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f57030135b11525 server_cookie=e57166f15a78d226 in_seq=0 out_seq=0 2024-03-16T21:02:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.606+0000 7faa04c00640 10 client.16455 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.606+0000 7faa04c00640 1 -- 172.21.15.8:0/3259020734 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5650e8eb7410 con 0x5650e9219be0 2024-03-16T21:02:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.606+0000 7faa04c00640 10 client.16455 handle_command_reply: tid=0 2024-03-16T21:02:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 1 client.16455 shutdown 2024-03-16T21:02:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 1 -- 172.21.15.8:0/3259020734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 msgr2=0x5650e9206b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e9206b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faa1c077a60 tx=0x7faa08011b50 comp rx=0 tx=0).stop 2024-03-16T21:02:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 1 -- 172.21.15.8:0/3259020734 shutdown_connections 2024-03-16T21:02:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9209610 0x5650e9207090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5650e9219be0 0x5650e921c000 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e9206b50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 1 --2- 172.21.15.8:0/3259020734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200110 0x5650e9206610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa04c00640 0 client.16455 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 1 -- 172.21.15.8:0/3259020734 >> 172.21.15.8:0/3259020734 conn(0x5650e91fa840 msgr2=0x5650e91fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 1 -- 172.21.15.8:0/3259020734 shutdown_connections 2024-03-16T21:02:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 1 -- 172.21.15.8:0/3259020734 wait complete. 2024-03-16T21:02:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.607+0000 7faa24f9a740 20 client.16455 trim_cache size 0 max 16384 2024-03-16T21:02:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.625+0000 7faa24f9a740 1 Processor -- start 2024-03-16T21:02:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.625+0000 7faa24f9a740 1 -- start start 2024-03-16T21:02:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.625+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e9208d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.625+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e9206eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.625+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 0x5650e9214a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.625+0000 7faa24f9a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e91f5950 con 0x5650e9200a30 2024-03-16T21:02:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.625+0000 7faa24f9a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e8eaf0c0 con 0x5650e9200110 2024-03-16T21:02:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.625+0000 7faa24f9a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e91f5f60 con 0x5650e9209610 2024-03-16T21:02:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.626+0000 7faa1be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e9208d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.626+0000 7faa1aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e9206eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.626+0000 7faa1be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e9208d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55940/0 (socket says 172.21.15.8:55940) 2024-03-16T21:02:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.626+0000 7faa1be00640 1 -- 172.21.15.8:0/2669650824 learned_addr learned my addr 172.21.15.8:0/2669650824 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.626+0000 7faa1be00640 1 --2- 172.21.15.8:0/2669650824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 0x5650e9214a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.626+0000 7faa1be00640 1 -- 172.21.15.8:0/2669650824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 msgr2=0x5650e9214a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.626+0000 7faa1be00640 1 --2- 172.21.15.8:0/2669650824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 0x5650e9214a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.626+0000 7faa1be00640 1 -- 172.21.15.8:0/2669650824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 msgr2=0x5650e9206eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.626+0000 7faa1be00640 1 --2- 172.21.15.8:0/2669650824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e9206eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.626+0000 7faa1be00640 1 -- 172.21.15.8:0/2669650824 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650e9101a90 con 0x5650e9200110 2024-03-16T21:02:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.626+0000 7faa1aa00640 1 --2- 172.21.15.8:0/2669650824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e9206eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.627+0000 7faa1be00640 1 --2- 172.21.15.8:0/2669650824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e9208d40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faa14010750 tx=0x7faa140095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4618e35aff8c21c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.627+0000 7faa07400640 1 -- 172.21.15.8:0/2669650824 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1401e040 con 0x5650e9200110 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.627+0000 7faa07400640 1 -- 172.21.15.8:0/2669650824 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7faa14033070 con 0x5650e9200110 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.627+0000 7faa07400640 1 -- 172.21.15.8:0/2669650824 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14003bd0 con 0x5650e9200110 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.628+0000 7faa24f9a740 1 -- 172.21.15.8:0/2669650824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 msgr2=0x5650e9208d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.628+0000 7faa24f9a740 1 --2- 172.21.15.8:0/2669650824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e9208d40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faa14010750 tx=0x7faa140095f0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.628+0000 7faa24f9a740 1 -- 172.21.15.8:0/2669650824 shutdown_connections 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.628+0000 7faa24f9a740 1 --2- 172.21.15.8:0/2669650824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9209610 0x5650e9214a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.628+0000 7faa24f9a740 1 --2- 172.21.15.8:0/2669650824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9200a30 0x5650e9206eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.628+0000 7faa24f9a740 1 --2- 172.21.15.8:0/2669650824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e9208d40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.628+0000 7faa24f9a740 1 -- 172.21.15.8:0/2669650824 >> 172.21.15.8:0/2669650824 conn(0x5650e91fa840 msgr2=0x5650e91f98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.628+0000 7faa24f9a740 1 -- 172.21.15.8:0/2669650824 shutdown_connections 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.628+0000 7faa24f9a740 1 -- 172.21.15.8:0/2669650824 wait complete. 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.628+0000 7faa24f9a740 1 -- start start 2024-03-16T21:02:10.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.628+0000 7faa24f9a740 1 Processor -- start 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e9211270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200a30 0x5650e920d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa24f9a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9209610 0x5650e920db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa24f9a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e920e1b0 con 0x5650e9209610 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa24f9a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e920e320 con 0x5650e9200110 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa24f9a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650e92754a0 con 0x5650e9200a30 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa24f9a740 10 client.0 _ll_register_callbacks cb 0x7faa0800bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa1be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e9211270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa1aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200a30 0x5650e920d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa1be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e9211270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55956/0 (socket says 172.21.15.8:55956) 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa1aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200a30 0x5650e920d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57596/0 (socket says 172.21.15.8:57596) 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa1be00640 1 -- 172.21.15.8:0/1514185137 learned_addr learned my addr 172.21.15.8:0/1514185137 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.629+0000 7faa1be00640 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9209610 0x5650e920db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa1aa00640 1 -- 172.21.15.8:0/1514185137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 msgr2=0x5650e9211270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa1aa00640 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e9211270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa1aa00640 1 -- 172.21.15.8:0/1514185137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9209610 msgr2=0x5650e920db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa1aa00640 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9209610 0x5650e920db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa1aa00640 1 -- 172.21.15.8:0/1514185137 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650e91651e0 con 0x5650e9200a30 2024-03-16T21:02:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa1be00640 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9209610 0x5650e920db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa1aa00640 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200a30 0x5650e920d5f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faa080238e0 tx=0x7faa08023c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39434af57cd00980 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa04c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa04c00640 1 -- 172.21.15.8:0/1514185137 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa08016070 con 0x5650e9200a30 2024-03-16T21:02:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa24f9a740 1 -- 172.21.15.8:0/1514185137 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa14015070 con 0x5650e9200a30 2024-03-16T21:02:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa04c00640 1 -- 172.21.15.8:0/1514185137 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faa0802a070 con 0x5650e9200a30 2024-03-16T21:02:10.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa04c00640 1 -- 172.21.15.8:0/1514185137 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa08010e30 con 0x5650e9200a30 2024-03-16T21:02:10.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa24f9a740 10 client.26641 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:10.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.630+0000 7faa24f9a740 1 -- 172.21.15.8:0/1514185137 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7faa14021040 con 0x5650e9200a30 2024-03-16T21:02:10.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.631+0000 7faa04c00640 1 -- 172.21.15.8:0/1514185137 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7faa14015070 con 0x5650e9200a30 2024-03-16T21:02:10.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.631+0000 7faa04c00640 1 -- 172.21.15.8:0/1514185137 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7faa08004a10 con 0x5650e9200a30 2024-03-16T21:02:10.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.631+0000 7faa24f9a740 10 client.26641 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:10.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.631+0000 7faa24f9a740 10 client.26641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.631+0000 7faa24f9a740 20 client.26641 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.631+0000 7faa24f9a740 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5650e9276bd0 0x5650e9278ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.631+0000 7faa24f9a740 4 client.26641 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.631+0000 7faa24f9a740 1 -- 172.21.15.8:0/1514185137 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5650e8ea37b0 con 0x5650e9276bd0 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.631+0000 7faa1be00640 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5650e9276bd0 0x5650e9278ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.632+0000 7faa1be00640 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5650e9276bd0 0x5650e9278ff0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a41261fb5576790a server_cookie=25e1b021f05ef9fc in_seq=0 out_seq=0 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.632+0000 7faa04c00640 10 client.26641 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa04c00640 1 -- 172.21.15.8:0/1514185137 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5650e8ea37b0 con 0x5650e9276bd0 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa04c00640 10 client.26641 handle_command_reply: tid=0 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa24f9a740 1 client.26641 shutdown 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa24f9a740 1 -- 172.21.15.8:0/1514185137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200a30 msgr2=0x5650e920d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa24f9a740 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200a30 0x5650e920d5f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faa080238e0 tx=0x7faa08023c80 comp rx=0 tx=0).stop 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa24f9a740 1 -- 172.21.15.8:0/1514185137 shutdown_connections 2024-03-16T21:02:10.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa24f9a740 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5650e9276bd0 0x5650e9278ff0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa24f9a740 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650e9209610 0x5650e920db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa24f9a740 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5650e9200a30 0x5650e920d5f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa24f9a740 1 --2- 172.21.15.8:0/1514185137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5650e9200110 0x5650e9211270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa04c00640 0 client.26641 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:10.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa24f9a740 1 -- 172.21.15.8:0/1514185137 >> 172.21.15.8:0/1514185137 conn(0x5650e91fa840 msgr2=0x5650e91fb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.633+0000 7faa24f9a740 1 -- 172.21.15.8:0/1514185137 shutdown_connections 2024-03-16T21:02:10.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa24f9a740 1 -- 172.21.15.8:0/1514185137 wait complete. 2024-03-16T21:02:10.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa24f9a740 20 client.26641 trim_cache size 0 max 16384 2024-03-16T21:02:10.641 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:02:10.641 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:02:10.642 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "18fb83d3-1d61-453c-bfc1-6f27bfa62c1d", 2024-03-16T21:02:10.642 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:02:10.642 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:02:10.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa20c00640 1 -- 172.21.15.8:0/1787974957 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faa000a1ba0 msgr2=0x7faa000a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa20c00640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faa000a1ba0 0x7faa000a4060 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5650e91ffbe0 tx=0x7faa0c0dc040 comp rx=0 tx=0).stop 2024-03-16T21:02:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa20c00640 1 -- 172.21.15.8:0/1787974957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c107a30 msgr2=0x7faa1c19e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa20c00640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c107a30 0x7faa1c19e0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa0c000c00 tx=0x7faa0c02c800 comp rx=0 tx=0).stop 2024-03-16T21:02:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa20c00640 1 -- 172.21.15.8:0/1787974957 shutdown_connections 2024-03-16T21:02:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa20c00640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faa000a1ba0 0x7faa000a4060 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa20c00640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1c10d9d0 0x7faa1c1a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa20c00640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa1c1083d0 0x7faa1c19e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa20c00640 1 --2- 172.21.15.8:0/1787974957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c107a30 0x7faa1c19e0d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.634+0000 7faa20c00640 1 -- 172.21.15.8:0/1787974957 >> 172.21.15.8:0/1787974957 conn(0x7faa1c077310 msgr2=0x7faa1c078250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.635+0000 7faa20c00640 1 -- 172.21.15.8:0/1787974957 shutdown_connections 2024-03-16T21:02:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.635+0000 7faa20c00640 1 -- 172.21.15.8:0/1787974957 wait complete. 2024-03-16T21:02:10.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:02:10.660 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:02:10.742 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:10 smithi008 ceph-mon[31434]: pgmap v133: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:02:10.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:10 smithi170 ceph-mon[35947]: pgmap v133: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:02:10.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.880+0000 7fa5d1600640 1 -- 172.21.15.8:0/575273374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5cc109650 msgr2=0x7fa5cc109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.880+0000 7fa5d1600640 1 --2- 172.21.15.8:0/575273374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5cc109650 0x7fa5cc109a30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009930 tx=0x7fa5bc02bc30 comp rx=0 tx=0).stop 2024-03-16T21:02:10.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.880+0000 7fa5d1600640 1 -- 172.21.15.8:0/575273374 shutdown_connections 2024-03-16T21:02:10.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.880+0000 7fa5d1600640 1 --2- 172.21.15.8:0/575273374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5cc103f50 0x7fa5cc110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.880+0000 7fa5d1600640 1 --2- 172.21.15.8:0/575273374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5cc103590 0x7fa5cc103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.880+0000 7fa5d1600640 1 --2- 172.21.15.8:0/575273374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5cc109650 0x7fa5cc109a30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.880+0000 7fa5d1600640 1 -- 172.21.15.8:0/575273374 >> 172.21.15.8:0/575273374 conn(0x7fa5cc0ff020 msgr2=0x7fa5cc101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.880+0000 7fa5d1600640 1 -- 172.21.15.8:0/575273374 shutdown_connections 2024-03-16T21:02:10.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.881+0000 7fa5d1600640 1 -- 172.21.15.8:0/575273374 wait complete. 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.881+0000 7fa5d1600640 1 Processor -- start 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5d1600640 1 -- start start 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5d1600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5cc103590 0x7fa5cc19f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5d1600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5cc103f50 0x7fa5cc19fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5d1600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5cc109650 0x7fa5cc199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5d1600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc19a0d0 con 0x7fa5cc109650 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5d1600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc19a240 con 0x7fa5cc103590 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5d1600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc19a400 con 0x7fa5cc103f50 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5d0c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5cc109650 0x7fa5cc199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5cbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5cc103590 0x7fa5cc19f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5cb400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5cc103f50 0x7fa5cc19fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5d0c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5cc109650 0x7fa5cc199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54914/0 (socket says 172.21.15.8:54914) 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.882+0000 7fa5d0c00640 1 -- 172.21.15.8:0/1144650326 learned_addr learned my addr 172.21.15.8:0/1144650326 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:10.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.883+0000 7fa5cbe00640 1 -- 172.21.15.8:0/1144650326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5cc103f50 msgr2=0x7fa5cc19fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.883+0000 7fa5cbe00640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5cc103f50 0x7fa5cc19fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.883+0000 7fa5cbe00640 1 -- 172.21.15.8:0/1144650326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5cc109650 msgr2=0x7fa5cc199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.883+0000 7fa5cbe00640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5cc109650 0x7fa5cc199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.883+0000 7fa5cbe00640 1 -- 172.21.15.8:0/1144650326 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc009560 con 0x7fa5cc103590 2024-03-16T21:02:10.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.883+0000 7fa5cbe00640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5cc103590 0x7fa5cc19f8d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc036040 tx=0x7fa5bc02cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.883+0000 7fa5c8c00640 1 -- 172.21.15.8:0/1144650326 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc004250 con 0x7fa5cc103590 2024-03-16T21:02:10.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.883+0000 7fa5c8c00640 1 -- 172.21.15.8:0/1144650326 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa5bc0043b0 con 0x7fa5cc103590 2024-03-16T21:02:10.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.883+0000 7fa5d1600640 1 -- 172.21.15.8:0/1144650326 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5cc19a680 con 0x7fa5cc103590 2024-03-16T21:02:10.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.883+0000 7fa5c8c00640 1 -- 172.21.15.8:0/1144650326 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc003b70 con 0x7fa5cc103590 2024-03-16T21:02:10.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.884+0000 7fa5d1600640 1 -- 172.21.15.8:0/1144650326 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5cc1a6970 con 0x7fa5cc103590 2024-03-16T21:02:10.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.887+0000 7fa5d5802740 1 Processor -- start 2024-03-16T21:02:10.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.887+0000 7fa5c8c00640 1 -- 172.21.15.8:0/1144650326 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fa5bc003cd0 con 0x7fa5cc103590 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.887+0000 7fa5d5802740 1 -- start start 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.887+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fea170 0x556e07fe8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.887+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fe9490 0x556e07fe9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.887+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07ff2800 0x556e07ff4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.887+0000 7fa5d5802740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e07f58150 con 0x556e07ff2800 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.887+0000 7fa5d5802740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e07f55680 con 0x556e07fe9490 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.887+0000 7fa5d5802740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e07f50e60 con 0x556e07fea170 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.887+0000 7fa5d0c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fea170 0x556e07fe8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.887+0000 7fa5d0c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fea170 0x556e07fe8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57618/0 (socket says 172.21.15.8:57618) 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5d0c00640 1 -- 172.21.15.8:0/1975926438 learned_addr learned my addr 172.21.15.8:0/1975926438 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5cbe00640 1 --2- 172.21.15.8:0/1975926438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fe9490 0x556e07fe9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5cb400640 1 --2- 172.21.15.8:0/1975926438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07ff2800 0x556e07ff4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5d0c00640 1 -- 172.21.15.8:0/1975926438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fe9490 msgr2=0x556e07fe9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/1975926438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fe9490 0x556e07fe9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5d0c00640 1 -- 172.21.15.8:0/1975926438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07ff2800 msgr2=0x556e07ff4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/1975926438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07ff2800 0x556e07ff4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5d0c00640 1 -- 172.21.15.8:0/1975926438 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e07f0a060 con 0x556e07fea170 2024-03-16T21:02:10.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:10 smithi186 ceph-mon[36391]: pgmap v133: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:02:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/1975926438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fea170 0x556e07fe8ec0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4011570 tx=0x7fa5c4011a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14cc8418aaf3115 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5c8c00640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa5b00a1c20 0x7fa5b00a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5c1200640 1 -- 172.21.15.8:0/1975926438 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4004b20 con 0x556e07fea170 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.888+0000 7fa5c1200640 1 -- 172.21.15.8:0/1975926438 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa5c4004c80 con 0x556e07fea170 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5c1200640 1 -- 172.21.15.8:0/1975926438 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4005530 con 0x556e07fea170 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5c8c00640 1 -- 172.21.15.8:0/1144650326 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa5bc0efba0 con 0x7fa5cc103590 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5cbe00640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa5b00a1c20 0x7fa5b00a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5d5802740 1 -- 172.21.15.8:0/1975926438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fea170 msgr2=0x556e07fe8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5d5802740 1 --2- 172.21.15.8:0/1975926438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fea170 0x556e07fe8ec0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4011570 tx=0x7fa5c4011a30 comp rx=0 tx=0).stop 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5d5802740 1 -- 172.21.15.8:0/1975926438 shutdown_connections 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5d5802740 1 --2- 172.21.15.8:0/1975926438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07ff2800 0x556e07ff4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5d5802740 1 --2- 172.21.15.8:0/1975926438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fe9490 0x556e07fe9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5d5802740 1 --2- 172.21.15.8:0/1975926438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fea170 0x556e07fe8ec0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5d5802740 1 -- 172.21.15.8:0/1975926438 >> 172.21.15.8:0/1975926438 conn(0x556e07fb05a0 msgr2=0x556e07fe3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5d5802740 1 -- 172.21.15.8:0/1975926438 shutdown_connections 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.889+0000 7fa5d5802740 1 -- 172.21.15.8:0/1975926438 wait complete. 2024-03-16T21:02:10.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.890+0000 7fa5cbe00640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa5b00a1c20 0x7fa5b00a40e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x556e07fea6c0 tx=0x7fa5bc0f3610 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.890+0000 7fa5d5802740 1 -- start start 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.890+0000 7fa5d5802740 1 Processor -- start 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fe9490 0x556e07fef730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07ff2800 0x556e07ff01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5d5802740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e07ef5ec0 con 0x556e07fe9490 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5d5802740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e07ef5b60 con 0x556e07fea170 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5d5802740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e07cbf1c0 con 0x556e07ff2800 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5d5802740 10 client.0 _ll_register_callbacks cb 0x556e07f09960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5cb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5d0c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fe9490 0x556e07fef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5cb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55982/0 (socket says 172.21.15.8:55982) 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5cb400640 1 -- 172.21.15.8:0/2671870256 learned_addr learned my addr 172.21.15.8:0/2671870256 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07ff2800 0x556e07ff01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5cb400640 1 -- 172.21.15.8:0/2671870256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07ff2800 msgr2=0x556e07ff01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5cb400640 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07ff2800 0x556e07ff01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5cb400640 1 -- 172.21.15.8:0/2671870256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fe9490 msgr2=0x556e07fef730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5cb400640 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fe9490 0x556e07fef730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5cb400640 1 -- 172.21.15.8:0/2671870256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c4009d50 con 0x556e07fea170 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.891+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fe9490 0x556e07fef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.892+0000 7fa5cb400640 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefc70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8012700 tx=0x7fa5b8012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a4b7e711b87b278 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.892+0000 7fa5b5600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.892+0000 7fa5b5600640 1 -- 172.21.15.8:0/2671870256 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8017070 con 0x556e07fea170 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.892+0000 7fa5b5600640 1 -- 172.21.15.8:0/2671870256 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa5b800f8c0 con 0x556e07fea170 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.892+0000 7fa5d5802740 1 -- 172.21.15.8:0/2671870256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e07c507e0 con 0x556e07fea170 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.892+0000 7fa5b5600640 1 -- 172.21.15.8:0/2671870256 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5b800fa80 con 0x556e07fea170 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.892+0000 7fa5d5802740 10 client.26645 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.892+0000 7fa5d5802740 1 -- 172.21.15.8:0/2671870256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x556e07f4f4e0 con 0x556e07fea170 2024-03-16T21:02:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.892+0000 7fa5b5600640 1 -- 172.21.15.8:0/2671870256 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x556e07c507e0 con 0x556e07fea170 2024-03-16T21:02:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.893+0000 7fa5b5600640 1 -- 172.21.15.8:0/2671870256 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fa5b8010430 con 0x556e07fea170 2024-03-16T21:02:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.893+0000 7fa5d5802740 10 client.26645 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.893+0000 7fa5d5802740 10 client.26645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.893+0000 7fa5d5802740 20 client.26645 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.893+0000 7fa5d5802740 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556e08002990 0x556e08004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.893+0000 7fa5d5802740 4 client.26645 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.893+0000 7fa5d5802740 1 -- 172.21.15.8:0/2671870256 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e07c8d720 con 0x556e08002990 2024-03-16T21:02:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.893+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556e08002990 0x556e08004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.894+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556e08002990 0x556e08004db0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21ba500316cd4fc3 server_cookie=68661309e9415239 in_seq=0 out_seq=0 2024-03-16T21:02:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.894+0000 7fa5b5600640 10 client.26645 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.894+0000 7fa5b5600640 1 -- 172.21.15.8:0/2671870256 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556e07c8d720 con 0x556e08002990 2024-03-16T21:02:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.894+0000 7fa5b5600640 10 client.26645 handle_command_reply: tid=0 2024-03-16T21:02:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.894+0000 7fa5d5802740 1 client.26645 shutdown 2024-03-16T21:02:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.894+0000 7fa5d5802740 1 -- 172.21.15.8:0/2671870256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 msgr2=0x556e07fefc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.895+0000 7fa5d5802740 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefc70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8012700 tx=0x7fa5b8012bc0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.895+0000 7fa5d5802740 1 -- 172.21.15.8:0/2671870256 shutdown_connections 2024-03-16T21:02:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.895+0000 7fa5d5802740 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07ff2800 0x556e07ff01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.895+0000 7fa5d5802740 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefc70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.895+0000 7fa5d5802740 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556e08002990 0x556e08004db0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.895+0000 7fa5d5802740 1 --2- 172.21.15.8:0/2671870256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fe9490 0x556e07fef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.895+0000 7fa5d5802740 1 -- 172.21.15.8:0/2671870256 >> 172.21.15.8:0/2671870256 conn(0x556e07fb05a0 msgr2=0x556e07fe5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.895+0000 7fa5b5600640 0 client.26645 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.895+0000 7fa5d5802740 1 -- 172.21.15.8:0/2671870256 shutdown_connections 2024-03-16T21:02:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.895+0000 7fa5d5802740 1 -- 172.21.15.8:0/2671870256 wait complete. 2024-03-16T21:02:10.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.895+0000 7fa5d5802740 20 client.26645 trim_cache size 0 max 16384 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.913+0000 7fa5d5802740 1 Processor -- start 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.913+0000 7fa5d5802740 1 -- start start 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.913+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fe9490 0x556e07ff1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.913+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.913+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07ff2800 0x556e07ff01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.913+0000 7fa5d5802740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e07fe8d00 con 0x556e07ff2800 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.913+0000 7fa5d5802740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e07fff3c0 con 0x556e07fea170 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.913+0000 7fa5d5802740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e08001100 con 0x556e07fe9490 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.913+0000 7fa5cb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.913+0000 7fa5cb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:55988/0 (socket says 172.21.15.8:55988) 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.913+0000 7fa5cb400640 1 -- 172.21.15.8:0/819028674 learned_addr learned my addr 172.21.15.8:0/819028674 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:10.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/819028674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fe9490 0x556e07ff1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/819028674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07ff2800 0x556e07ff01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5cb400640 1 -- 172.21.15.8:0/819028674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fe9490 msgr2=0x556e07ff1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5cb400640 1 --2- 172.21.15.8:0/819028674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fe9490 0x556e07ff1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5cb400640 1 -- 172.21.15.8:0/819028674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07ff2800 msgr2=0x556e07ff01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5cb400640 1 --2- 172.21.15.8:0/819028674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07ff2800 0x556e07ff01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5cb400640 1 -- 172.21.15.8:0/819028674 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e07eeb950 con 0x556e07fea170 2024-03-16T21:02:10.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/819028674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07ff2800 0x556e07ff01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:02:10.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5cb400640 1 --2- 172.21.15.8:0/819028674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefca0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8011df0 tx=0x7fa5b8011e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2cc37594f5de307 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5b7e00640 1 -- 172.21.15.8:0/819028674 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8017040 con 0x556e07fea170 2024-03-16T21:02:10.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5b7e00640 1 -- 172.21.15.8:0/819028674 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa5b8005040 con 0x556e07fea170 2024-03-16T21:02:10.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.914+0000 7fa5b7e00640 1 -- 172.21.15.8:0/819028674 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800faa0 con 0x556e07fea170 2024-03-16T21:02:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.915+0000 7fa5d5802740 1 -- 172.21.15.8:0/819028674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 msgr2=0x556e07fefca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.915+0000 7fa5d5802740 1 --2- 172.21.15.8:0/819028674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefca0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8011df0 tx=0x7fa5b8011e20 comp rx=0 tx=0).stop 2024-03-16T21:02:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.915+0000 7fa5d5802740 1 -- 172.21.15.8:0/819028674 shutdown_connections 2024-03-16T21:02:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.915+0000 7fa5d5802740 1 --2- 172.21.15.8:0/819028674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07ff2800 0x556e07ff01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.915+0000 7fa5d5802740 1 --2- 172.21.15.8:0/819028674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07fea170 0x556e07fefca0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.915+0000 7fa5d5802740 1 --2- 172.21.15.8:0/819028674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fe9490 0x556e07ff1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.915+0000 7fa5d5802740 1 -- 172.21.15.8:0/819028674 >> 172.21.15.8:0/819028674 conn(0x556e07fb05a0 msgr2=0x556e07ff0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.915+0000 7fa5d5802740 1 -- 172.21.15.8:0/819028674 shutdown_connections 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.915+0000 7fa5d5802740 1 -- 172.21.15.8:0/819028674 wait complete. 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.915+0000 7fa5d5802740 1 -- start start 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5d5802740 1 Processor -- start 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fe9490 0x556e07fec500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fea170 0x556e07feca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5d5802740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07ff2800 0x556e0805d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5d5802740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e07fed1c0 con 0x556e07fea170 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5d5802740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0805d7b0 con 0x556e07ff2800 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5d5802740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0805d970 con 0x556e07fe9490 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5d5802740 10 client.0 _ll_register_callbacks cb 0x7fa5b8009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5cb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fea170 0x556e07feca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5cb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fea170 0x556e07feca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54958/0 (socket says 172.21.15.8:54958) 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5cb400640 1 -- 172.21.15.8:0/3373930687 learned_addr learned my addr 172.21.15.8:0/3373930687 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.916+0000 7fa5d0c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fe9490 0x556e07fec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07ff2800 0x556e0805d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5cb400640 1 -- 172.21.15.8:0/3373930687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fe9490 msgr2=0x556e07fec500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5cb400640 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fe9490 0x556e07fec500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5cb400640 1 -- 172.21.15.8:0/3373930687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07ff2800 msgr2=0x556e0805d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5cb400640 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07ff2800 0x556e0805d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5cb400640 1 -- 172.21.15.8:0/3373930687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e07f4f4e0 con 0x556e07fea170 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07ff2800 0x556e0805d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5cb400640 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fea170 0x556e07feca40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8011e90 tx=0x7fa5b8010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958c680f13d82647 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5b5600640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5b5600640 1 -- 172.21.15.8:0/3373930687 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8017070 con 0x556e07fea170 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5b5600640 1 -- 172.21.15.8:0/3373930687 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa5b800f790 con 0x556e07fea170 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.917+0000 7fa5d5802740 1 -- 172.21.15.8:0/3373930687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5c4004c80 con 0x556e07fea170 2024-03-16T21:02:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.918+0000 7fa5b5600640 1 -- 172.21.15.8:0/3373930687 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5b800f950 con 0x556e07fea170 2024-03-16T21:02:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.918+0000 7fa5d5802740 10 client.16476 fetch_fsmap learned FSMap version 30 2024-03-16T21:02:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.918+0000 7fa5d5802740 1 -- 172.21.15.8:0/3373930687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x556e07f11430 con 0x556e07fea170 2024-03-16T21:02:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.918+0000 7fa5b5600640 1 -- 172.21.15.8:0/3373930687 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa5c4004c80 con 0x556e07fea170 2024-03-16T21:02:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.918+0000 7fa5b5600640 1 -- 172.21.15.8:0/3373930687 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fa5b801c470 con 0x556e07fea170 2024-03-16T21:02:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.918+0000 7fa5d5802740 10 client.16476 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T21:02:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.918+0000 7fa5d5802740 10 client.16476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.918+0000 7fa5d5802740 20 client.16476 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.918+0000 7fa5d5802740 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556e0805ed70 0x556e08061160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.918+0000 7fa5d5802740 4 client.16476 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:02:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.918+0000 7fa5d5802740 1 -- 172.21.15.8:0/3373930687 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556e07cdc890 con 0x556e0805ed70 2024-03-16T21:02:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.919+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556e0805ed70 0x556e08061160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:10.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.919+0000 7fa5d0c00640 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556e0805ed70 0x556e08061160 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=192c7b0209cdf00d server_cookie=f02468c48c269ec3 in_seq=0 out_seq=0 2024-03-16T21:02:10.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.919+0000 7fa5b5600640 10 client.16476 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.919+0000 7fa5b5600640 1 -- 172.21.15.8:0/3373930687 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556e07cdc890 con 0x556e0805ed70 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.919+0000 7fa5b5600640 10 client.16476 handle_command_reply: tid=0 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.919+0000 7fa5d5802740 1 client.16476 shutdown 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.919+0000 7fa5d5802740 1 -- 172.21.15.8:0/3373930687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fea170 msgr2=0x556e07feca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.919+0000 7fa5d5802740 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fea170 0x556e07feca40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8011e90 tx=0x7fa5b8010650 comp rx=0 tx=0).stop 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d5802740 1 -- 172.21.15.8:0/3373930687 shutdown_connections 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d5802740 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e07ff2800 0x556e0805d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d5802740 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556e0805ed70 0x556e08061160 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d5802740 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556e07fea170 0x556e07feca40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d5802740 1 --2- 172.21.15.8:0/3373930687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556e07fe9490 0x556e07fec500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5b5600640 0 client.16476 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d5802740 1 -- 172.21.15.8:0/3373930687 >> 172.21.15.8:0/3373930687 conn(0x556e07fb05a0 msgr2=0x556e07fe5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d5802740 1 -- 172.21.15.8:0/3373930687 shutdown_connections 2024-03-16T21:02:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d5802740 1 -- 172.21.15.8:0/3373930687 wait complete. 2024-03-16T21:02:10.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d5802740 20 client.16476 trim_cache size 0 max 16384 2024-03-16T21:02:10.929 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:02:10.929 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:02:10.929 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:02:10.929 INFO:teuthology.orchestra.run.smithi008.stdout: "18fb83d3-1d61-453c-bfc1-6f27bfa62c1d": { 2024-03-16T21:02:10.929 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:02:10.929 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "18fb83d3-1d61-453c-bfc1-6f27bfa62c1d", 2024-03-16T21:02:10.929 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:02:10.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:02:10.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:02:10.929 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:02:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d1600640 1 -- 172.21.15.8:0/1144650326 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa5b00a1c20 msgr2=0x7fa5b00a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d1600640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa5b00a1c20 0x7fa5b00a40e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x556e07fea6c0 tx=0x7fa5bc0f3610 comp rx=0 tx=0).stop 2024-03-16T21:02:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d1600640 1 -- 172.21.15.8:0/1144650326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5cc103590 msgr2=0x7fa5cc19f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.920+0000 7fa5d1600640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5cc103590 0x7fa5cc19f8d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc036040 tx=0x7fa5bc02cc20 comp rx=0 tx=0).stop 2024-03-16T21:02:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.921+0000 7fa5d1600640 1 -- 172.21.15.8:0/1144650326 shutdown_connections 2024-03-16T21:02:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.921+0000 7fa5d1600640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa5b00a1c20 0x7fa5b00a40e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.921+0000 7fa5d1600640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5cc109650 0x7fa5cc199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.921+0000 7fa5d1600640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5cc103f50 0x7fa5cc19fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.921+0000 7fa5d1600640 1 --2- 172.21.15.8:0/1144650326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5cc103590 0x7fa5cc19f8d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.921+0000 7fa5d1600640 1 -- 172.21.15.8:0/1144650326 >> 172.21.15.8:0/1144650326 conn(0x7fa5cc0ff020 msgr2=0x7fa5cc1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.921+0000 7fa5d1600640 1 -- 172.21.15.8:0/1144650326 shutdown_connections 2024-03-16T21:02:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:10.921+0000 7fa5d1600640 1 -- 172.21.15.8:0/1144650326 wait complete. 2024-03-16T21:02:10.944 INFO:tasks.cephfs.filesystem:scrub status for tag:18fb83d3-1d61-453c-bfc1-6f27bfa62c1d - {'path': '/', 'tag': '18fb83d3-1d61-453c-bfc1-6f27bfa62c1d', 'options': 'recursive,force'} 2024-03-16T21:02:11.794 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:11 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:02:11.795 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:11 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:11.795 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:11 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:02:11.795 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:11 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:11.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:11 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:02:11.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:11 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:11.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:11 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:02:11.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:11 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:11 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:02:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:11 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:11 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:02:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:11 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:12.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:12 smithi170 ceph-mon[35947]: pgmap v134: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-16T21:02:12.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:12 smithi186 ceph-mon[36391]: pgmap v134: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-16T21:02:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:12 smithi008 ceph-mon[31434]: pgmap v134: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-16T21:02:13.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:13 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:02:13.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:13 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:02:13.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:13 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:02:13.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:13 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:02:13.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:13 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:02:13.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:13 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:02:14.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:14 smithi008 ceph-mon[31434]: pgmap v135: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:02:14.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:14 smithi170 ceph-mon[35947]: pgmap v135: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:02:14.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:14 smithi186 ceph-mon[36391]: pgmap v135: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:02:16.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:16 smithi170 ceph-mon[35947]: pgmap v136: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:02:16.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:16 smithi186 ceph-mon[36391]: pgmap v136: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:02:16.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:16 smithi008 ceph-mon[31434]: pgmap v136: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:02:18.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:18 smithi170 ceph-mon[35947]: pgmap v137: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-03-16T21:02:18.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:18 smithi186 ceph-mon[36391]: pgmap v137: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-03-16T21:02:18.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:18 smithi008 ceph-mon[31434]: pgmap v137: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-03-16T21:02:20.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:20 smithi170 ceph-mon[35947]: pgmap v138: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-16T21:02:20.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:20 smithi186 ceph-mon[36391]: pgmap v138: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-16T21:02:20.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:20 smithi008 ceph-mon[31434]: pgmap v138: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-16T21:02:22.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:22 smithi170 ceph-mon[35947]: pgmap v139: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-16T21:02:22.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:22 smithi186 ceph-mon[36391]: pgmap v139: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-16T21:02:22.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:22 smithi008 ceph-mon[31434]: pgmap v139: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-03-16T21:02:24.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:24 smithi170 ceph-mon[35947]: pgmap v140: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:24.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:24 smithi186 ceph-mon[36391]: pgmap v140: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:24.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:24 smithi008 ceph-mon[31434]: pgmap v140: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:26.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:26 smithi170 ceph-mon[35947]: pgmap v141: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:26.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:26 smithi186 ceph-mon[36391]: pgmap v141: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:26.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:26 smithi008 ceph-mon[31434]: pgmap v141: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:28.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:28 smithi170 ceph-mon[35947]: pgmap v142: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-03-16T21:02:28.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:28 smithi186 ceph-mon[36391]: pgmap v142: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-03-16T21:02:28.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:28 smithi008 ceph-mon[31434]: pgmap v142: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-03-16T21:02:30.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:30 smithi170 ceph-mon[35947]: pgmap v143: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:30.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:30 smithi186 ceph-mon[36391]: pgmap v143: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:30.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:30 smithi008 ceph-mon[31434]: pgmap v143: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:32.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:32 smithi170 ceph-mon[35947]: pgmap v144: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:32.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:32 smithi186 ceph-mon[36391]: pgmap v144: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:32.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:32 smithi008 ceph-mon[31434]: pgmap v144: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:34.867 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:34 smithi170 ceph-mon[35947]: pgmap v145: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:34.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:34 smithi186 ceph-mon[36391]: pgmap v145: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:34.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:34 smithi008 ceph-mon[31434]: pgmap v145: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:36.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:36 smithi170 ceph-mon[35947]: pgmap v146: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:02:36.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:36 smithi186 ceph-mon[36391]: pgmap v146: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:02:36.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:36 smithi008 ceph-mon[31434]: pgmap v146: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:02:38.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:38 smithi170 ceph-mon[35947]: pgmap v147: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:38.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:38 smithi186 ceph-mon[36391]: pgmap v147: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:38.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:38 smithi008 ceph-mon[31434]: pgmap v147: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:40.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:40 smithi170 ceph-mon[35947]: pgmap v148: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:40.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:40 smithi186 ceph-mon[36391]: pgmap v148: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:40.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:02:40.945 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:02:40.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:40 smithi008 ceph-mon[31434]: pgmap v148: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:41.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.180+0000 7ff890200640 1 -- 172.21.15.8:0/3055212191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff888103690 msgr2=0x7ff888103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.180+0000 7ff890200640 1 --2- 172.21.15.8:0/3055212191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff888103690 0x7ff888103b10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff874009900 tx=0x7ff87402bc40 comp rx=0 tx=0).stop 2024-03-16T21:02:41.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.180+0000 7ff890200640 1 -- 172.21.15.8:0/3055212191 shutdown_connections 2024-03-16T21:02:41.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.180+0000 7ff890200640 1 --2- 172.21.15.8:0/3055212191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff888104050 0x7ff888110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.180+0000 7ff890200640 1 --2- 172.21.15.8:0/3055212191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff888103690 0x7ff888103b10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.180+0000 7ff890200640 1 --2- 172.21.15.8:0/3055212191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8881096a0 0x7ff888109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.180+0000 7ff890200640 1 -- 172.21.15.8:0/3055212191 >> 172.21.15.8:0/3055212191 conn(0x7ff8880ff160 msgr2=0x7ff888101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:41.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.180+0000 7ff890200640 1 -- 172.21.15.8:0/3055212191 shutdown_connections 2024-03-16T21:02:41.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.180+0000 7ff890200640 1 -- 172.21.15.8:0/3055212191 wait complete. 2024-03-16T21:02:41.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.182+0000 7ff890200640 1 Processor -- start 2024-03-16T21:02:41.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.182+0000 7ff890200640 1 -- start start 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.182+0000 7ff890200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff888103690 0x7ff888199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.182+0000 7ff890200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff888104050 0x7ff88819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.182+0000 7ff890200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8881096a0 0x7ff88819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.182+0000 7ff890200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88819ecf0 con 0x7ff8881096a0 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.182+0000 7ff890200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88819ee60 con 0x7ff888104050 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.182+0000 7ff890200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88819f020 con 0x7ff888103690 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8881096a0 0x7ff88819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff888104050 0x7ff88819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff888103690 0x7ff888199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff888104050 0x7ff88819a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46322/0 (socket says 172.21.15.8:46322) 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff888103690 0x7ff888199e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56638/0 (socket says 172.21.15.8:56638) 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88ce00640 1 -- 172.21.15.8:0/856191368 learned_addr learned my addr 172.21.15.8:0/856191368 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:41.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8881096a0 0x7ff88819e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34524/0 (socket says 172.21.15.8:34524) 2024-03-16T21:02:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88d800640 1 -- 172.21.15.8:0/856191368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff888104050 msgr2=0x7ff88819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88d800640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff888104050 0x7ff88819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88d800640 1 -- 172.21.15.8:0/856191368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8881096a0 msgr2=0x7ff88819e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88d800640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8881096a0 0x7ff88819e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88d800640 1 -- 172.21.15.8:0/856191368 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff874009560 con 0x7ff888103690 2024-03-16T21:02:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.183+0000 7ff88d800640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff888103690 0x7ff888199e30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00e9f0 tx=0x7ff87c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.184+0000 7ff886000640 1 -- 172.21.15.8:0/856191368 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c00ccc0 con 0x7ff888103690 2024-03-16T21:02:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.184+0000 7ff890200640 1 -- 172.21.15.8:0/856191368 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88819f300 con 0x7ff888103690 2024-03-16T21:02:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.184+0000 7ff886000640 1 -- 172.21.15.8:0/856191368 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff87c00ce20 con 0x7ff888103690 2024-03-16T21:02:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.184+0000 7ff886000640 1 -- 172.21.15.8:0/856191368 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0189c0 con 0x7ff888103690 2024-03-16T21:02:41.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.184+0000 7ff890200640 1 -- 172.21.15.8:0/856191368 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8881a6b80 con 0x7ff888103690 2024-03-16T21:02:41.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.187+0000 7ff892fe9740 1 Processor -- start 2024-03-16T21:02:41.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.187+0000 7ff886000640 1 -- 172.21.15.8:0/856191368 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7ff87c018b20 con 0x7ff888103690 2024-03-16T21:02:41.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.187+0000 7ff892fe9740 1 -- start start 2024-03-16T21:02:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f8fa0 0x55d8f61f7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f82c0 0x55d8f61f8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 0x55d8f6203a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff892fe9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f6167150 con 0x55d8f61f8fa0 2024-03-16T21:02:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff892fe9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f6164680 con 0x55d8f61f82c0 2024-03-16T21:02:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff892fe9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f615fe60 con 0x55d8f6201630 2024-03-16T21:02:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff88d800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f82c0 0x55d8f61f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff88ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 0x55d8f6203a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff88e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f8fa0 0x55d8f61f7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff88ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 0x55d8f6203a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56640/0 (socket says 172.21.15.8:56640) 2024-03-16T21:02:41.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff88ce00640 1 -- 172.21.15.8:0/3209835660 learned_addr learned my addr 172.21.15.8:0/3209835660 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:41.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.188+0000 7ff88ce00640 1 -- 172.21.15.8:0/3209835660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f82c0 msgr2=0x55d8f61f8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:41.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.189+0000 7ff88ce00640 1 --2- 172.21.15.8:0/3209835660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f82c0 0x55d8f61f8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.189+0000 7ff88ce00640 1 -- 172.21.15.8:0/3209835660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f8fa0 msgr2=0x55d8f61f7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.189+0000 7ff88ce00640 1 --2- 172.21.15.8:0/3209835660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f8fa0 0x55d8f61f7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.189+0000 7ff88ce00640 1 -- 172.21.15.8:0/3209835660 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8f6119060 con 0x55d8f6201630 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.189+0000 7ff886000640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8700a1c20 0x7ff8700a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.189+0000 7ff88ce00640 1 --2- 172.21.15.8:0/3209835660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 0x55d8f6203a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff874006010 tx=0x7ff87402c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d324772bb1891e24 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.189+0000 7ff886000640 1 -- 172.21.15.8:0/856191368 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff87c014070 con 0x7ff888103690 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.189+0000 7ff88e200640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8700a1c20 0x7ff8700a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.189+0000 7ff87aa00640 1 -- 172.21.15.8:0/3209835660 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874004980 con 0x55d8f6201630 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.189+0000 7ff87aa00640 1 -- 172.21.15.8:0/3209835660 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff874004ae0 con 0x55d8f6201630 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.189+0000 7ff87aa00640 1 -- 172.21.15.8:0/3209835660 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874005370 con 0x55d8f6201630 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.190+0000 7ff892fe9740 1 -- 172.21.15.8:0/3209835660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 msgr2=0x55d8f6203a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.190+0000 7ff88e200640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8700a1c20 0x7ff8700a40e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff880005fd0 tx=0x7ff880009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:41.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.190+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3209835660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 0x55d8f6203a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff874006010 tx=0x7ff87402c680 comp rx=0 tx=0).stop 2024-03-16T21:02:41.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.190+0000 7ff892fe9740 1 -- 172.21.15.8:0/3209835660 shutdown_connections 2024-03-16T21:02:41.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.190+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3209835660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 0x55d8f6203a20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.190+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3209835660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f82c0 0x55d8f61f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.190+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3209835660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f8fa0 0x55d8f61f7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.190+0000 7ff892fe9740 1 -- 172.21.15.8:0/3209835660 >> 172.21.15.8:0/3209835660 conn(0x55d8f61bf5a0 msgr2=0x55d8f61f2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:41.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.190+0000 7ff892fe9740 1 -- 172.21.15.8:0/3209835660 shutdown_connections 2024-03-16T21:02:41.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.190+0000 7ff892fe9740 1 -- 172.21.15.8:0/3209835660 wait complete. 2024-03-16T21:02:41.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.191+0000 7ff892fe9740 1 -- start start 2024-03-16T21:02:41.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.191+0000 7ff892fe9740 1 Processor -- start 2024-03-16T21:02:41.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.191+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 0x55d8f61fe540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.191+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f8fa0 0x55d8f61fea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.191+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f6201630 0x55d8f61fefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.191+0000 7ff892fe9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f6104ec0 con 0x55d8f61f8fa0 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.191+0000 7ff892fe9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f6104b60 con 0x55d8f6201630 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.191+0000 7ff892fe9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f5ece1c0 con 0x55d8f61f82c0 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.191+0000 7ff892fe9740 10 client.0 _ll_register_callbacks cb 0x55d8f6118960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff88d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 0x55d8f61fe540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff88d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 0x55d8f61fe540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56656/0 (socket says 172.21.15.8:56656) 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff88d800640 1 -- 172.21.15.8:0/3341906506 learned_addr learned my addr 172.21.15.8:0/3341906506 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff88ce00640 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f8fa0 0x55d8f61fea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff88e200640 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f6201630 0x55d8f61fefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff88d800640 1 -- 172.21.15.8:0/3341906506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f6201630 msgr2=0x55d8f61fefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:41.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff88d800640 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f6201630 0x55d8f61fefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff88d800640 1 -- 172.21.15.8:0/3341906506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f8fa0 msgr2=0x55d8f61fea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff88d800640 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f8fa0 0x55d8f61fea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff88d800640 1 -- 172.21.15.8:0/3341906506 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff888110e60 con 0x55d8f61f82c0 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff88d800640 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 0x55d8f61fe540 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff87c09a660 tx=0x7ff87c09a4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e6b8b159354683 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff86f400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.192+0000 7ff86f400640 1 -- 172.21.15.8:0/3341906506 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c09a6d0 con 0x55d8f61f82c0 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff86f400640 1 -- 172.21.15.8:0/3341906506 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff87c09e770 con 0x55d8f61f82c0 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff892fe9740 1 -- 172.21.15.8:0/3341906506 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8f5e5f7e0 con 0x55d8f61f82c0 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff86f400640 1 -- 172.21.15.8:0/3341906506 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff87c0a2dc0 con 0x55d8f61f82c0 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff892fe9740 10 client.26671 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff892fe9740 1 -- 172.21.15.8:0/3341906506 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d8f615e4e0 con 0x55d8f61f82c0 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff86f400640 1 -- 172.21.15.8:0/3341906506 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55d8f5e5f7e0 con 0x55d8f61f82c0 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff86f400640 1 -- 172.21.15.8:0/3341906506 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7ff87c085180 con 0x55d8f61f82c0 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff892fe9740 10 client.26671 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff892fe9740 10 client.26671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff892fe9740 20 client.26671 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d8f62115b0 0x55d8f62139a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff892fe9740 4 client.26671 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.193+0000 7ff892fe9740 1 -- 172.21.15.8:0/3341906506 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8f5e9c720 con 0x55d8f62115b0 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.194+0000 7ff88ce00640 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d8f62115b0 0x55d8f62139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.194+0000 7ff88ce00640 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d8f62115b0 0x55d8f62139a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c95ab38a1e1ae2eb server_cookie=e31e7221bb37dd49 in_seq=0 out_seq=0 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.194+0000 7ff86f400640 10 client.26671 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.195+0000 7ff86f400640 1 -- 172.21.15.8:0/3341906506 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d8f5e9c720 con 0x55d8f62115b0 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.195+0000 7ff86f400640 10 client.26671 handle_command_reply: tid=0 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.195+0000 7ff892fe9740 1 client.26671 shutdown 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.195+0000 7ff892fe9740 1 -- 172.21.15.8:0/3341906506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 msgr2=0x55d8f61fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.195+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 0x55d8f61fe540 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff87c09a660 tx=0x7ff87c09a4a0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.196+0000 7ff892fe9740 1 -- 172.21.15.8:0/3341906506 shutdown_connections 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.196+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f6201630 0x55d8f61fefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.196+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d8f62115b0 0x55d8f62139a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.196+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f8fa0 0x55d8f61fea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.196+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3341906506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 0x55d8f61fe540 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.196+0000 7ff86f400640 0 client.26671 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:41.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.196+0000 7ff892fe9740 1 -- 172.21.15.8:0/3341906506 >> 172.21.15.8:0/3341906506 conn(0x55d8f61bf5a0 msgr2=0x55d8f61f4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:41.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.196+0000 7ff892fe9740 1 -- 172.21.15.8:0/3341906506 shutdown_connections 2024-03-16T21:02:41.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.196+0000 7ff892fe9740 1 -- 172.21.15.8:0/3341906506 wait complete. 2024-03-16T21:02:41.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.196+0000 7ff892fe9740 20 client.26671 trim_cache size 0 max 16384 2024-03-16T21:02:41.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff892fe9740 1 Processor -- start 2024-03-16T21:02:41.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff892fe9740 1 -- start start 2024-03-16T21:02:41.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 0x55d8f6200c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f6201630 0x55d8f61fede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff892fe9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f61ee680 con 0x55d8f6201630 2024-03-16T21:02:41.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff892fe9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f620e1d0 con 0x55d8f61f8fa0 2024-03-16T21:02:41.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff892fe9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f61f7540 con 0x55d8f61f82c0 2024-03-16T21:02:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff88ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff88ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61f47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46358/0 (socket says 172.21.15.8:46358) 2024-03-16T21:02:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff88ce00640 1 -- 172.21.15.8:0/4128688694 learned_addr learned my addr 172.21.15.8:0/4128688694 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:41.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff88d800640 1 --2- 172.21.15.8:0/4128688694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 0x55d8f6200c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.214+0000 7ff88e200640 1 --2- 172.21.15.8:0/4128688694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f6201630 0x55d8f61fede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.215+0000 7ff88ce00640 1 -- 172.21.15.8:0/4128688694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 msgr2=0x55d8f6200c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.215+0000 7ff88ce00640 1 --2- 172.21.15.8:0/4128688694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 0x55d8f6200c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.215+0000 7ff88ce00640 1 -- 172.21.15.8:0/4128688694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f6201630 msgr2=0x55d8f61fede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.215+0000 7ff88ce00640 1 --2- 172.21.15.8:0/4128688694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f6201630 0x55d8f61fede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.215+0000 7ff88ce00640 1 -- 172.21.15.8:0/4128688694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8f60fa950 con 0x55d8f61f8fa0 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.215+0000 7ff88d800640 1 --2- 172.21.15.8:0/4128688694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 0x55d8f6200c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.215+0000 7ff88ce00640 1 --2- 172.21.15.8:0/4128688694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61f47d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff874004f20 tx=0x7ff87402bc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7e693e7a65942e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.215+0000 7ff87a000640 1 -- 172.21.15.8:0/4128688694 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87404a040 con 0x55d8f61f8fa0 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.215+0000 7ff87a000640 1 -- 172.21.15.8:0/4128688694 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff874055180 con 0x55d8f61f8fa0 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.215+0000 7ff87a000640 1 -- 172.21.15.8:0/4128688694 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874034440 con 0x55d8f61f8fa0 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.216+0000 7ff892fe9740 1 -- 172.21.15.8:0/4128688694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 msgr2=0x55d8f61f47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.216+0000 7ff892fe9740 1 --2- 172.21.15.8:0/4128688694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61f47d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff874004f20 tx=0x7ff87402bc40 comp rx=0 tx=0).stop 2024-03-16T21:02:41.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.216+0000 7ff892fe9740 1 -- 172.21.15.8:0/4128688694 shutdown_connections 2024-03-16T21:02:41.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.216+0000 7ff892fe9740 1 --2- 172.21.15.8:0/4128688694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f6201630 0x55d8f61fede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.216+0000 7ff892fe9740 1 --2- 172.21.15.8:0/4128688694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61f47d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.216+0000 7ff892fe9740 1 --2- 172.21.15.8:0/4128688694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f61f82c0 0x55d8f6200c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.216+0000 7ff892fe9740 1 -- 172.21.15.8:0/4128688694 >> 172.21.15.8:0/4128688694 conn(0x55d8f61bf5a0 msgr2=0x55d8f61f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.216+0000 7ff892fe9740 1 -- 172.21.15.8:0/4128688694 shutdown_connections 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.216+0000 7ff892fe9740 1 -- 172.21.15.8:0/4128688694 wait complete. 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.216+0000 7ff892fe9740 1 -- start start 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.217+0000 7ff892fe9740 1 Processor -- start 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.217+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f82c0 0x55d8f61fadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.217+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61fb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.217+0000 7ff892fe9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 0x55d8f61fb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.217+0000 7ff892fe9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f6274660 con 0x55d8f61f82c0 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.217+0000 7ff892fe9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f62747a0 con 0x55d8f61f8fa0 2024-03-16T21:02:41.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.217+0000 7ff892fe9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f6274960 con 0x55d8f6201630 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.217+0000 7ff892fe9740 10 client.0 _ll_register_callbacks cb 0x7ff87c0962b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.217+0000 7ff88ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61fb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff88ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61fb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46372/0 (socket says 172.21.15.8:46372) 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff88ce00640 1 -- 172.21.15.8:0/3877490209 learned_addr learned my addr 172.21.15.8:0/3877490209 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff88d800640 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f82c0 0x55d8f61fadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff88e200640 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 0x55d8f61fb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff88ce00640 1 -- 172.21.15.8:0/3877490209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 msgr2=0x55d8f61fb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff88ce00640 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 0x55d8f61fb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff88ce00640 1 -- 172.21.15.8:0/3877490209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f82c0 msgr2=0x55d8f61fadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff88ce00640 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f82c0 0x55d8f61fadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff88ce00640 1 -- 172.21.15.8:0/3877490209 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8f6119060 con 0x55d8f61f8fa0 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff88e200640 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 0x55d8f61fb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff88ce00640 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61fb330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff874036040 tx=0x7ff874000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75e6d1db321dbd22 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:41.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.218+0000 7ff86f400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.219+0000 7ff86f400640 1 -- 172.21.15.8:0/3877490209 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87404a040 con 0x55d8f61f8fa0 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.219+0000 7ff86f400640 1 -- 172.21.15.8:0/3877490209 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff874000e40 con 0x55d8f61f8fa0 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.219+0000 7ff892fe9740 1 -- 172.21.15.8:0/3877490209 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff874004ae0 con 0x55d8f61f8fa0 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.219+0000 7ff86f400640 1 -- 172.21.15.8:0/3877490209 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff874004f50 con 0x55d8f61f8fa0 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.219+0000 7ff892fe9740 10 client.26669 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.219+0000 7ff892fe9740 1 -- 172.21.15.8:0/3877490209 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d8f6120430 con 0x55d8f61f8fa0 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.219+0000 7ff86f400640 1 -- 172.21.15.8:0/3877490209 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff874004ae0 con 0x55d8f61f8fa0 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.219+0000 7ff86f400640 1 -- 172.21.15.8:0/3877490209 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7ff874044020 con 0x55d8f61f8fa0 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.219+0000 7ff892fe9740 10 client.26669 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.219+0000 7ff892fe9740 10 client.26669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.219+0000 7ff892fe9740 20 client.26669 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.220+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d8f6275dd0 0x55d8f62781f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.220+0000 7ff892fe9740 4 client.26669 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.220+0000 7ff892fe9740 1 -- 172.21.15.8:0/3877490209 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d8f5eeb890 con 0x55d8f6275dd0 2024-03-16T21:02:41.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.220+0000 7ff88d800640 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d8f6275dd0 0x55d8f62781f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.220+0000 7ff88d800640 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d8f6275dd0 0x55d8f62781f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4628fb92c095fe69 server_cookie=defeb4dfcc325dfa in_seq=0 out_seq=0 2024-03-16T21:02:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.220+0000 7ff86f400640 10 client.26669 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.220+0000 7ff86f400640 1 -- 172.21.15.8:0/3877490209 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d8f5eeb890 con 0x55d8f6275dd0 2024-03-16T21:02:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.220+0000 7ff86f400640 10 client.26669 handle_command_reply: tid=0 2024-03-16T21:02:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 1 client.26669 shutdown 2024-03-16T21:02:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 1 -- 172.21.15.8:0/3877490209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 msgr2=0x55d8f61fb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61fb330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff874036040 tx=0x7ff874000bc0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 1 -- 172.21.15.8:0/3877490209 shutdown_connections 2024-03-16T21:02:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f6201630 0x55d8f61fb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8f61f8fa0 0x55d8f61fb330 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55d8f6275dd0 0x55d8f62781f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 1 --2- 172.21.15.8:0/3877490209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8f61f82c0 0x55d8f61fadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff86f400640 0 client.26669 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 1 -- 172.21.15.8:0/3877490209 >> 172.21.15.8:0/3877490209 conn(0x55d8f61bf5a0 msgr2=0x55d8f61f4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 1 -- 172.21.15.8:0/3877490209 shutdown_connections 2024-03-16T21:02:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 1 -- 172.21.15.8:0/3877490209 wait complete. 2024-03-16T21:02:41.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.221+0000 7ff892fe9740 20 client.26669 trim_cache size 0 max 16384 2024-03-16T21:02:41.231 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:02:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:02:41.231 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:02:41.231 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:02:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 -- 172.21.15.8:0/856191368 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8700a1c20 msgr2=0x7ff8700a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8700a1c20 0x7ff8700a40e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff880005fd0 tx=0x7ff880009500 comp rx=0 tx=0).stop 2024-03-16T21:02:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 -- 172.21.15.8:0/856191368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff888103690 msgr2=0x7ff888199e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff888103690 0x7ff888199e30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00e9f0 tx=0x7ff87c00eeb0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 -- 172.21.15.8:0/856191368 shutdown_connections 2024-03-16T21:02:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8700a1c20 0x7ff8700a40e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8881096a0 0x7ff88819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff888104050 0x7ff88819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 --2- 172.21.15.8:0/856191368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff888103690 0x7ff888199e30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 -- 172.21.15.8:0/856191368 >> 172.21.15.8:0/856191368 conn(0x7ff8880ff160 msgr2=0x7ff8880ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:41.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 -- 172.21.15.8:0/856191368 shutdown_connections 2024-03-16T21:02:41.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.222+0000 7ff890200640 1 -- 172.21.15.8:0/856191368 wait complete. 2024-03-16T21:02:41.245 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:02:41.245 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:02:41.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.509+0000 7f20f7e00640 1 -- 172.21.15.8:0/3553682450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f8101f00 msgr2=0x7f20f8105f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.509+0000 7f20f7e00640 1 --2- 172.21.15.8:0/3553682450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f8101f00 0x7f20f8105f40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009900 tx=0x7f20e002bc30 comp rx=0 tx=0).stop 2024-03-16T21:02:41.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.509+0000 7f20f7e00640 1 -- 172.21.15.8:0/3553682450 shutdown_connections 2024-03-16T21:02:41.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.509+0000 7f20f7e00640 1 --2- 172.21.15.8:0/3553682450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8106620 0x7f20f810e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.509+0000 7f20f7e00640 1 --2- 172.21.15.8:0/3553682450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f8101f00 0x7f20f8105f40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.509+0000 7f20f7e00640 1 --2- 172.21.15.8:0/3553682450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f8101550 0x7f20f8101930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.509+0000 7f20f7e00640 1 -- 172.21.15.8:0/3553682450 >> 172.21.15.8:0/3553682450 conn(0x7f20f80fcdd0 msgr2=0x7f20f80ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:41.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.509+0000 7f20f7e00640 1 -- 172.21.15.8:0/3553682450 shutdown_connections 2024-03-16T21:02:41.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.509+0000 7f20f7e00640 1 -- 172.21.15.8:0/3553682450 wait complete. 2024-03-16T21:02:41.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.511+0000 7f20f7e00640 1 Processor -- start 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.511+0000 7f20f7e00640 1 -- start start 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.511+0000 7f20f7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f8101550 0x7f20f819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.511+0000 7f20f7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8106620 0x7f20f819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.511+0000 7f20f7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81978c0 0x7f20f8197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.511+0000 7f20f7e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f81982b0 con 0x7f20f8101550 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.511+0000 7f20f7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8198420 con 0x7f20f8106620 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.511+0000 7f20f7e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f81985e0 con 0x7f20f81978c0 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.512+0000 7f20f6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8106620 0x7f20f819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.512+0000 7f20f6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f8101550 0x7f20f819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.512+0000 7f20f6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8106620 0x7f20f819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46392/0 (socket says 172.21.15.8:46392) 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.512+0000 7f20f6000640 1 -- 172.21.15.8:0/2790497200 learned_addr learned my addr 172.21.15.8:0/2790497200 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.512+0000 7f20f7400640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81978c0 0x7f20f8197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.512+0000 7f20f6000640 1 -- 172.21.15.8:0/2790497200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81978c0 msgr2=0x7f20f8197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.512+0000 7f20f6000640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81978c0 0x7f20f8197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.512+0000 7f20f6000640 1 -- 172.21.15.8:0/2790497200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f8101550 msgr2=0x7f20f819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.512+0000 7f20f6000640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f8101550 0x7f20f819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.512+0000 7f20f6000640 1 -- 172.21.15.8:0/2790497200 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8009490 con 0x7f20f8106620 2024-03-16T21:02:41.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.512+0000 7f20f6000640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8106620 0x7f20f819dc00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000c00 tx=0x7f20e0005e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:41.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.513+0000 7f20ef400640 1 -- 172.21.15.8:0/2790497200 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0004450 con 0x7f20f8106620 2024-03-16T21:02:41.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.513+0000 7f20ef400640 1 -- 172.21.15.8:0/2790497200 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f20e0005310 con 0x7f20f8106620 2024-03-16T21:02:41.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.513+0000 7f20ef400640 1 -- 172.21.15.8:0/2790497200 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0034440 con 0x7f20f8106620 2024-03-16T21:02:41.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.513+0000 7f20f7e00640 1 -- 172.21.15.8:0/2790497200 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e0009560 con 0x7f20f8106620 2024-03-16T21:02:41.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.513+0000 7f20f7e00640 1 -- 172.21.15.8:0/2790497200 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f81a4870 con 0x7f20f8106620 2024-03-16T21:02:41.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.514+0000 7f20f7e00640 1 -- 172.21.15.8:0/2790497200 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f8102a20 con 0x7f20f8106620 2024-03-16T21:02:41.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.516+0000 7f20ef400640 1 -- 172.21.15.8:0/2790497200 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f20e00035f0 con 0x7f20f8106620 2024-03-16T21:02:41.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.517+0000 7f20ef400640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20dc0a1ba0 0x7f20dc0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:41.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.517+0000 7f20ef400640 1 -- 172.21.15.8:0/2790497200 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f20e00ef6e0 con 0x7f20f8106620 2024-03-16T21:02:41.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.517+0000 7f20f6a00640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20dc0a1ba0 0x7f20dc0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:41.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.518+0000 7f20f6a00640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20dc0a1ba0 0x7f20dc0a4060 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f20f80fd1d0 tx=0x7f20e8005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:41.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.526+0000 7f20ef400640 1 -- 172.21.15.8:0/2790497200 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f20e00b8740 con 0x7f20f8106620 2024-03-16T21:02:41.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.770+0000 7f20f7e00640 1 -- 172.21.15.8:0/2790497200 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20f8068200 con 0x7f20f8106620 2024-03-16T21:02:41.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.771+0000 7f20ef400640 1 -- 172.21.15.8:0/2790497200 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+11394 (secure 0 0 0) 0x7f20e00bbe00 con 0x7f20f8106620 2024-03-16T21:02:41.777 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:02:41.777 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:02:11.828933+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24593,24544]},"id":1}]} 2024-03-16T21:02:41.778 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 31 2024-03-16T21:02:41.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 -- 172.21.15.8:0/2790497200 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20dc0a1ba0 msgr2=0x7f20dc0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20dc0a1ba0 0x7f20dc0a4060 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f20f80fd1d0 tx=0x7f20e8005f90 comp rx=0 tx=0).stop 2024-03-16T21:02:41.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 -- 172.21.15.8:0/2790497200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8106620 msgr2=0x7f20f819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:41.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8106620 0x7f20f819dc00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000c00 tx=0x7f20e0005e70 comp rx=0 tx=0).stop 2024-03-16T21:02:41.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 -- 172.21.15.8:0/2790497200 shutdown_connections 2024-03-16T21:02:41.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f20dc0a1ba0 0x7f20dc0a4060 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20f81978c0 0x7f20f8197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f8106620 0x7f20f819dc00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 --2- 172.21.15.8:0/2790497200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20f8101550 0x7f20f819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:41.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 -- 172.21.15.8:0/2790497200 >> 172.21.15.8:0/2790497200 conn(0x7f20f80fcdd0 msgr2=0x7f20f80ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:41.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 -- 172.21.15.8:0/2790497200 shutdown_connections 2024-03-16T21:02:41.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:41.774+0000 7f20f7e00640 1 -- 172.21.15.8:0/2790497200 wait complete. 2024-03-16T21:02:41.799 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:02:41.799 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:02:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.010+0000 7f5ec0a00640 1 -- 172.21.15.8:0/2421861704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ebc1083d0 msgr2=0x7f5ebc114820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.010+0000 7f5ec0a00640 1 --2- 172.21.15.8:0/2421861704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ebc1083d0 0x7f5ebc114820 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009ca0 tx=0x7f5eb402c190 comp rx=0 tx=0).stop 2024-03-16T21:02:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.011+0000 7f5ec0a00640 1 -- 172.21.15.8:0/2421861704 shutdown_connections 2024-03-16T21:02:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.011+0000 7f5ec0a00640 1 --2- 172.21.15.8:0/2421861704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ebc1083d0 0x7f5ebc114820 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.011+0000 7f5ec0a00640 1 --2- 172.21.15.8:0/2421861704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ebc107a30 0x7f5ebc107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.011+0000 7f5ec0a00640 1 --2- 172.21.15.8:0/2421861704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ebc10d9d0 0x7f5ebc10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.011+0000 7f5ec0a00640 1 -- 172.21.15.8:0/2421861704 >> 172.21.15.8:0/2421861704 conn(0x7f5ebc077310 msgr2=0x7f5ebc106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.011+0000 7f5ec0a00640 1 -- 172.21.15.8:0/2421861704 shutdown_connections 2024-03-16T21:02:42.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.011+0000 7f5ec0a00640 1 -- 172.21.15.8:0/2421861704 wait complete. 2024-03-16T21:02:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.012+0000 7f5ec0a00640 1 Processor -- start 2024-03-16T21:02:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.012+0000 7f5ec0a00640 1 -- start start 2024-03-16T21:02:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.012+0000 7f5ec0a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ebc107a30 0x7f5ebc19e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.012+0000 7f5ec0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ebc1083d0 0x7f5ebc19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.012+0000 7f5ec0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ebc10d9d0 0x7f5ebc1a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.012+0000 7f5ec0a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc1a2ee0 con 0x7f5ebc10d9d0 2024-03-16T21:02:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.012+0000 7f5ec0a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc1a3050 con 0x7f5ebc1083d0 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.012+0000 7f5ec0a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc1a3210 con 0x7f5ebc107a30 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.013+0000 7f5ebb200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ebc10d9d0 0x7f5ebc1a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.013+0000 7f5eb9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ebc1083d0 0x7f5ebc19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.013+0000 7f5ebb200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ebc10d9d0 0x7f5ebc1a28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34586/0 (socket says 172.21.15.8:34586) 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.013+0000 7f5ebb200640 1 -- 172.21.15.8:0/1779517391 learned_addr learned my addr 172.21.15.8:0/1779517391 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.013+0000 7f5eba800640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ebc107a30 0x7f5ebc19e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.013+0000 7f5ebb200640 1 -- 172.21.15.8:0/1779517391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ebc107a30 msgr2=0x7f5ebc19e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.013+0000 7f5ebb200640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ebc107a30 0x7f5ebc19e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.013+0000 7f5ebb200640 1 -- 172.21.15.8:0/1779517391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ebc1083d0 msgr2=0x7f5ebc19e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.013+0000 7f5ebb200640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ebc1083d0 0x7f5ebc19e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.013+0000 7f5ebb200640 1 -- 172.21.15.8:0/1779517391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb4009900 con 0x7f5ebc10d9d0 2024-03-16T21:02:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.013+0000 7f5ebb200640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ebc10d9d0 0x7f5ebc1a28e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4037040 tx=0x7f5eb4034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.014+0000 7f5eb3400640 1 -- 172.21.15.8:0/1779517391 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4003b70 con 0x7f5ebc10d9d0 2024-03-16T21:02:42.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.014+0000 7f5ec0a00640 1 -- 172.21.15.8:0/1779517391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc1a3490 con 0x7f5ebc10d9d0 2024-03-16T21:02:42.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.014+0000 7f5eb3400640 1 -- 172.21.15.8:0/1779517391 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f5eb4003cd0 con 0x7f5ebc10d9d0 2024-03-16T21:02:42.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.014+0000 7f5eb3400640 1 -- 172.21.15.8:0/1779517391 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4004750 con 0x7f5ebc10d9d0 2024-03-16T21:02:42.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.014+0000 7f5ec0a00640 1 -- 172.21.15.8:0/1779517391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc1aad70 con 0x7f5ebc10d9d0 2024-03-16T21:02:42.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.017+0000 7f5eb3400640 1 -- 172.21.15.8:0/1779517391 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f5eb403b040 con 0x7f5ebc10d9d0 2024-03-16T21:02:42.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.017+0000 7f5ec4033740 1 Processor -- start 2024-03-16T21:02:42.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.017+0000 7f5ec4033740 1 -- start start 2024-03-16T21:02:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.018+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 0x56400ffff1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.018+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400ffff710 0x564010007db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.018+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5640100082f0 0x56401000a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.018+0000 7f5ec4033740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400ff6d210 con 0x56400ffff710 2024-03-16T21:02:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.018+0000 7f5ec4033740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400ff6a740 con 0x56400fffedf0 2024-03-16T21:02:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.018+0000 7f5ec4033740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400ff65f20 con 0x5640100082f0 2024-03-16T21:02:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.018+0000 7f5eba800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400ffff710 0x564010007db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.018+0000 7f5eb9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 0x56400ffff1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.018+0000 7f5eba800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400ffff710 0x564010007db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34600/0 (socket says 172.21.15.8:34600) 2024-03-16T21:02:42.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.018+0000 7f5eba800640 1 -- 172.21.15.8:0/2788041178 learned_addr learned my addr 172.21.15.8:0/2788041178 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.018+0000 7f5eb9e00640 1 --2- 172.21.15.8:0/2788041178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5640100082f0 0x56401000a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.019+0000 7f5eba800640 1 -- 172.21.15.8:0/2788041178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5640100082f0 msgr2=0x56401000a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.019+0000 7f5eba800640 1 --2- 172.21.15.8:0/2788041178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5640100082f0 0x56401000a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.019+0000 7f5eba800640 1 -- 172.21.15.8:0/2788041178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 msgr2=0x56400ffff1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.019+0000 7f5eba800640 1 --2- 172.21.15.8:0/2788041178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 0x56400ffff1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.019+0000 7f5eba800640 1 -- 172.21.15.8:0/2788041178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56400ff27df0 con 0x56400ffff710 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.019+0000 7f5eb9e00640 1 --2- 172.21.15.8:0/2788041178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 0x56400ffff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.019+0000 7f5eb3400640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5ea00a1ba0 0x7f5ea00a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.019+0000 7f5eb3400640 1 -- 172.21.15.8:0/1779517391 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5eb40efee0 con 0x7f5ebc10d9d0 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.019+0000 7f5eba800640 1 --2- 172.21.15.8:0/2788041178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400ffff710 0x564010007db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009c70 tx=0x7f5eac011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f80c3649f359c93 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.019+0000 7f5eb9e00640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5ea00a1ba0 0x7f5ea00a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.019+0000 7f5ea7400640 1 -- 172.21.15.8:0/2788041178 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac004230 con 0x56400ffff710 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.020+0000 7f5ea7400640 1 -- 172.21.15.8:0/2788041178 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f5eac004390 con 0x56400ffff710 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.020+0000 7f5ea7400640 1 -- 172.21.15.8:0/2788041178 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac019760 con 0x56400ffff710 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.020+0000 7f5ec4033740 1 -- 172.21.15.8:0/2788041178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400ffff710 msgr2=0x564010007db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.020+0000 7f5eb9e00640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5ea00a1ba0 0x7f5ea00a4060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x56400fffa6b0 tx=0x7f5ea80096c0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.020+0000 7f5ec4033740 1 --2- 172.21.15.8:0/2788041178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400ffff710 0x564010007db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009c70 tx=0x7f5eac011810 comp rx=0 tx=0).stop 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.020+0000 7f5ec4033740 1 -- 172.21.15.8:0/2788041178 shutdown_connections 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.020+0000 7f5ec4033740 1 --2- 172.21.15.8:0/2788041178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5640100082f0 0x56401000a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.020+0000 7f5ec4033740 1 --2- 172.21.15.8:0/2788041178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400ffff710 0x564010007db0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.020+0000 7f5ec4033740 1 --2- 172.21.15.8:0/2788041178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 0x56400ffff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.020+0000 7f5ec4033740 1 -- 172.21.15.8:0/2788041178 >> 172.21.15.8:0/2788041178 conn(0x56400fff9520 msgr2=0x56400fff9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.020+0000 7f5ec4033740 1 -- 172.21.15.8:0/2788041178 shutdown_connections 2024-03-16T21:02:42.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.021+0000 7f5ec4033740 1 -- 172.21.15.8:0/2788041178 wait complete. 2024-03-16T21:02:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.021+0000 7f5ec4033740 1 -- start start 2024-03-16T21:02:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.021+0000 7f5ec4033740 1 Processor -- start 2024-03-16T21:02:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400fffedf0 0x5640100052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x564010005820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640100082f0 0x564010005d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ec4033740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400ff0b150 con 0x56400fffedf0 2024-03-16T21:02:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ec4033740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400ff0adf0 con 0x5640100082f0 2024-03-16T21:02:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ec4033740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400fcd41c0 con 0x56400ffff710 2024-03-16T21:02:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ec4033740 10 client.0 _ll_register_callbacks cb 0x56400ff5a2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5eba800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400fffedf0 0x5640100052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5eb9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x564010005820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ebb200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640100082f0 0x564010005d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5eb9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x564010005820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56714/0 (socket says 172.21.15.8:56714) 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5eb9e00640 1 -- 172.21.15.8:0/37012911 learned_addr learned my addr 172.21.15.8:0/37012911 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ebb200640 1 -- 172.21.15.8:0/37012911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 msgr2=0x564010005820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ebb200640 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x564010005820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ebb200640 1 -- 172.21.15.8:0/37012911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400fffedf0 msgr2=0x5640100052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ebb200640 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400fffedf0 0x5640100052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5ebb200640 1 -- 172.21.15.8:0/37012911 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac0098d0 con 0x5640100082f0 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.022+0000 7f5eba800640 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400fffedf0 0x5640100052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.023+0000 7f5ebb200640 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640100082f0 0x564010005d60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40ed710 tx=0x7f5eb4004100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5c81a74d163fa6a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.023+0000 7f5e9be00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.023+0000 7f5e9be00640 1 -- 172.21.15.8:0/37012911 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40c5390 con 0x5640100082f0 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.023+0000 7f5e9be00640 1 -- 172.21.15.8:0/37012911 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5eb40bcf00 con 0x5640100082f0 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.023+0000 7f5ec4033740 1 -- 172.21.15.8:0/37012911 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56400fc657e0 con 0x5640100082f0 2024-03-16T21:02:42.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.023+0000 7f5e9be00640 1 -- 172.21.15.8:0/37012911 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eb40bd0c0 con 0x5640100082f0 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.023+0000 7f5ec4033740 10 client.26687 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.023+0000 7f5ec4033740 1 -- 172.21.15.8:0/37012911 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56400ff645a0 con 0x5640100082f0 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.023+0000 7f5e9be00640 1 -- 172.21.15.8:0/37012911 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x56400fc657e0 con 0x5640100082f0 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.024+0000 7f5e9be00640 1 -- 172.21.15.8:0/37012911 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f5eb4004bd0 con 0x5640100082f0 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.024+0000 7f5ec4033740 10 client.26687 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.024+0000 7f5ec4033740 10 client.26687 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.024+0000 7f5ec4033740 20 client.26687 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.024+0000 7f5ec4033740 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564010018160 0x56401001a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.024+0000 7f5ec4033740 4 client.26687 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.024+0000 7f5ec4033740 1 -- 172.21.15.8:0/37012911 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56400fca2720 con 0x564010018160 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.024+0000 7f5eba800640 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564010018160 0x56401001a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.025+0000 7f5eba800640 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564010018160 0x56401001a580 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bbc4cc3f7b6a56a6 server_cookie=9d4df377dc213596 in_seq=0 out_seq=0 2024-03-16T21:02:42.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.025+0000 7f5e9be00640 10 client.26687 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:42.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5e9be00640 1 -- 172.21.15.8:0/37012911 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56400fca2720 con 0x564010018160 2024-03-16T21:02:42.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5e9be00640 10 client.26687 handle_command_reply: tid=0 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5ec4033740 1 client.26687 shutdown 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5ec4033740 1 -- 172.21.15.8:0/37012911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640100082f0 msgr2=0x564010005d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5ec4033740 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640100082f0 0x564010005d60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40ed710 tx=0x7f5eb4004100 comp rx=0 tx=0).stop 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5ec4033740 1 -- 172.21.15.8:0/37012911 shutdown_connections 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5ec4033740 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564010018160 0x56401001a580 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5ec4033740 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640100082f0 0x564010005d60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5ec4033740 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x564010005820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5ec4033740 1 --2- 172.21.15.8:0/37012911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400fffedf0 0x5640100052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5ec4033740 1 -- 172.21.15.8:0/37012911 >> 172.21.15.8:0/37012911 conn(0x56400fff9520 msgr2=0x56400fffb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.026+0000 7f5e9be00640 0 client.26687 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.027+0000 7f5ec4033740 1 -- 172.21.15.8:0/37012911 shutdown_connections 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.027+0000 7f5ec4033740 1 -- 172.21.15.8:0/37012911 wait complete. 2024-03-16T21:02:42.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.027+0000 7f5ec4033740 20 client.26687 trim_cache size 0 max 16384 2024-03-16T21:02:42.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.040+0000 7f5ec4033740 1 Processor -- start 2024-03-16T21:02:42.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.040+0000 7f5ec4033740 1 -- start start 2024-03-16T21:02:42.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400fffedf0 0x564010007a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x564010004440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640100082f0 0x56400fff8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5ec4033740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400fca2720 con 0x56400fffedf0 2024-03-16T21:02:42.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5ec4033740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400fc657e0 con 0x5640100082f0 2024-03-16T21:02:42.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5ec4033740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56400fffa520 con 0x56400ffff710 2024-03-16T21:02:42.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5eb9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x564010004440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5eba800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400fffedf0 0x564010007a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5eb9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x564010004440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56716/0 (socket says 172.21.15.8:56716) 2024-03-16T21:02:42.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5eb9e00640 1 -- 172.21.15.8:0/1543314694 learned_addr learned my addr 172.21.15.8:0/1543314694 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5ebb200640 1 --2- 172.21.15.8:0/1543314694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640100082f0 0x56400fff8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5eb9e00640 1 -- 172.21.15.8:0/1543314694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640100082f0 msgr2=0x56400fff8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5eb9e00640 1 --2- 172.21.15.8:0/1543314694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640100082f0 0x56400fff8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5eb9e00640 1 -- 172.21.15.8:0/1543314694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400fffedf0 msgr2=0x564010007a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5eb9e00640 1 --2- 172.21.15.8:0/1543314694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400fffedf0 0x564010007a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.041+0000 7f5eb9e00640 1 -- 172.21.15.8:0/1543314694 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56400ff00ab0 con 0x56400ffff710 2024-03-16T21:02:42.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.042+0000 7f5eb9e00640 1 --2- 172.21.15.8:0/1543314694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x564010004440 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8004650 tx=0x7f5ea8013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e72a3aef6e84ba8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.042+0000 7f5ea6a00640 1 -- 172.21.15.8:0/1543314694 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8025040 con 0x56400ffff710 2024-03-16T21:02:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.042+0000 7f5ea6a00640 1 -- 172.21.15.8:0/1543314694 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f5ea8005520 con 0x56400ffff710 2024-03-16T21:02:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.042+0000 7f5ea6a00640 1 -- 172.21.15.8:0/1543314694 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8004be0 con 0x56400ffff710 2024-03-16T21:02:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.042+0000 7f5ec4033740 1 -- 172.21.15.8:0/1543314694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 msgr2=0x564010004440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.042+0000 7f5ec4033740 1 --2- 172.21.15.8:0/1543314694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x564010004440 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8004650 tx=0x7f5ea8013040 comp rx=0 tx=0).stop 2024-03-16T21:02:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.043+0000 7f5ec4033740 1 -- 172.21.15.8:0/1543314694 shutdown_connections 2024-03-16T21:02:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.043+0000 7f5ec4033740 1 --2- 172.21.15.8:0/1543314694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640100082f0 0x56400fff8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.043+0000 7f5ec4033740 1 --2- 172.21.15.8:0/1543314694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x564010004440 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.043+0000 7f5ec4033740 1 --2- 172.21.15.8:0/1543314694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56400fffedf0 0x564010007a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.043+0000 7f5ec4033740 1 -- 172.21.15.8:0/1543314694 >> 172.21.15.8:0/1543314694 conn(0x56400fff9520 msgr2=0x56400fff7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.043+0000 7f5ec4033740 1 -- 172.21.15.8:0/1543314694 shutdown_connections 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.043+0000 7f5ec4033740 1 -- 172.21.15.8:0/1543314694 wait complete. 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.043+0000 7f5ec4033740 1 -- start start 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.043+0000 7f5ec4033740 1 Processor -- start 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 0x564010002160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x5640100026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5ec4033740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640100082f0 0x56401006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5ec4033740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401006cf40 con 0x5640100082f0 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5ec4033740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401006d0b0 con 0x56400fffedf0 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5ec4033740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401006d270 con 0x56400ffff710 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5ec4033740 10 client.0 _ll_register_callbacks cb 0x7f5eb40bc890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5eba800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 0x564010002160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5eba800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 0x564010002160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46444/0 (socket says 172.21.15.8:46444) 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5eba800640 1 -- 172.21.15.8:0/2211316752 learned_addr learned my addr 172.21.15.8:0/2211316752 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5eb9e00640 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x5640100026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5ebb200640 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640100082f0 0x56401006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5eba800640 1 -- 172.21.15.8:0/2211316752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 msgr2=0x5640100026a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5eba800640 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x5640100026a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5eba800640 1 -- 172.21.15.8:0/2211316752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640100082f0 msgr2=0x56401006ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5eba800640 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640100082f0 0x56401006ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.044+0000 7f5eba800640 1 -- 172.21.15.8:0/2211316752 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea8016030 con 0x56400fffedf0 2024-03-16T21:02:42.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.045+0000 7f5eba800640 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 0x564010002160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009c70 tx=0x7f5eac009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96a1505496bedbfa server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.045+0000 7f5e9be00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:42.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.045+0000 7f5e9be00640 1 -- 172.21.15.8:0/2211316752 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac02b070 con 0x56400fffedf0 2024-03-16T21:02:42.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.045+0000 7f5e9be00640 1 -- 172.21.15.8:0/2211316752 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5eac005040 con 0x56400fffedf0 2024-03-16T21:02:42.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.045+0000 7f5ec4033740 1 -- 172.21.15.8:0/2211316752 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5eac004390 con 0x56400fffedf0 2024-03-16T21:02:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.045+0000 7f5e9be00640 1 -- 172.21.15.8:0/2211316752 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eac005200 con 0x56400fffedf0 2024-03-16T21:02:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.045+0000 7f5ec4033740 10 client.26693 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.045+0000 7f5ec4033740 1 -- 172.21.15.8:0/2211316752 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56400ff26650 con 0x56400fffedf0 2024-03-16T21:02:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.046+0000 7f5e9be00640 1 -- 172.21.15.8:0/2211316752 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f5eac004390 con 0x56400fffedf0 2024-03-16T21:02:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.046+0000 7f5e9be00640 1 -- 172.21.15.8:0/2211316752 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f5eac004620 con 0x56400fffedf0 2024-03-16T21:02:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.046+0000 7f5ec4033740 10 client.26693 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.046+0000 7f5ec4033740 10 client.26693 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:02:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.046+0000 7f5ec4033740 20 client.26693 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:42.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.046+0000 7f5ec4033740 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564010074b30 0x564010076f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.046+0000 7f5ec4033740 4 client.26693 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.046+0000 7f5ec4033740 1 -- 172.21.15.8:0/2211316752 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56400fcf1890 con 0x564010074b30 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.046+0000 7f5eb9e00640 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564010074b30 0x564010076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5eb9e00640 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564010074b30 0x564010076f50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cebcbd08574d6282 server_cookie=4acf0e281419e2e5 in_seq=0 out_seq=0 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5e9be00640 10 client.26693 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5e9be00640 1 -- 172.21.15.8:0/2211316752 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56400fcf1890 con 0x564010074b30 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5e9be00640 10 client.26693 handle_command_reply: tid=0 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 1 client.26693 shutdown 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 1 -- 172.21.15.8:0/2211316752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 msgr2=0x564010002160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 0x564010002160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009c70 tx=0x7f5eac009310 comp rx=0 tx=0).stop 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 1 -- 172.21.15.8:0/2211316752 shutdown_connections 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564010074b30 0x564010076f50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640100082f0 0x56401006ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56400ffff710 0x5640100026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 1 --2- 172.21.15.8:0/2211316752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56400fffedf0 0x564010002160 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5e9be00640 0 client.26693 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:02:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 1 -- 172.21.15.8:0/2211316752 >> 172.21.15.8:0/2211316752 conn(0x56400fff9520 msgr2=0x564010005b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 1 -- 172.21.15.8:0/2211316752 shutdown_connections 2024-03-16T21:02:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 1 -- 172.21.15.8:0/2211316752 wait complete. 2024-03-16T21:02:42.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.047+0000 7f5ec4033740 20 client.26693 trim_cache size 0 max 16384 2024-03-16T21:02:42.057 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:02:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 -- 172.21.15.8:0/1779517391 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5ea00a1ba0 msgr2=0x7f5ea00a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5ea00a1ba0 0x7f5ea00a4060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x56400fffa6b0 tx=0x7f5ea80096c0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 -- 172.21.15.8:0/1779517391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ebc10d9d0 msgr2=0x7f5ebc1a28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ebc10d9d0 0x7f5ebc1a28e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4037040 tx=0x7f5eb4034670 comp rx=0 tx=0).stop 2024-03-16T21:02:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 -- 172.21.15.8:0/1779517391 shutdown_connections 2024-03-16T21:02:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f5ea00a1ba0 0x7f5ea00a4060 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ebc10d9d0 0x7f5ebc1a28e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ebc1083d0 0x7f5ebc19e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 --2- 172.21.15.8:0/1779517391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ebc107a30 0x7f5ebc19e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 -- 172.21.15.8:0/1779517391 >> 172.21.15.8:0/1779517391 conn(0x7f5ebc077310 msgr2=0x7f5ebc078250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 -- 172.21.15.8:0/1779517391 shutdown_connections 2024-03-16T21:02:42.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.048+0000 7f5ec0a00640 1 -- 172.21.15.8:0/1779517391 wait complete. 2024-03-16T21:02:42.074 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:02:42.074 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:02:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.287+0000 7f1554a00640 1 -- 172.21.15.8:0/2302447680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1550103f50 msgr2=0x7f1550110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.287+0000 7f1554a00640 1 --2- 172.21.15.8:0/2302447680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1550103f50 0x7f1550110410 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1548009cd0 tx=0x7f154802c0e0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.288+0000 7f1554a00640 1 -- 172.21.15.8:0/2302447680 shutdown_connections 2024-03-16T21:02:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.288+0000 7f1554a00640 1 --2- 172.21.15.8:0/2302447680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1550103f50 0x7f1550110410 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.288+0000 7f1554a00640 1 --2- 172.21.15.8:0/2302447680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1550103590 0x7f1550103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.288+0000 7f1554a00640 1 --2- 172.21.15.8:0/2302447680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1550109650 0x7f1550109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.288+0000 7f1554a00640 1 -- 172.21.15.8:0/2302447680 >> 172.21.15.8:0/2302447680 conn(0x7f15500ff020 msgr2=0x7f1550101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.288+0000 7f1554a00640 1 -- 172.21.15.8:0/2302447680 shutdown_connections 2024-03-16T21:02:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.288+0000 7f1554a00640 1 -- 172.21.15.8:0/2302447680 wait complete. 2024-03-16T21:02:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.289+0000 7f1554a00640 1 Processor -- start 2024-03-16T21:02:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.289+0000 7f1554a00640 1 -- start start 2024-03-16T21:02:42.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.289+0000 7f1554a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1550103590 0x7f155019f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.289+0000 7f1554a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1550103f50 0x7f155019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.289+0000 7f1554a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1550109650 0x7f1550199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.289+0000 7f1554a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155019a080 con 0x7f1550103f50 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.289+0000 7f1554a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155019a1f0 con 0x7f1550109650 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.289+0000 7f1554a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155019a3b0 con 0x7f1550103590 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.290+0000 7f154e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1550103590 0x7f155019f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.290+0000 7f154e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1550103590 0x7f155019f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56744/0 (socket says 172.21.15.8:56744) 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.290+0000 7f154e800640 1 -- 172.21.15.8:0/3853379187 learned_addr learned my addr 172.21.15.8:0/3853379187 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.290+0000 7f154de00640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1550103f50 0x7f155019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.290+0000 7f154f200640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1550109650 0x7f1550199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.290+0000 7f154e800640 1 -- 172.21.15.8:0/3853379187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1550109650 msgr2=0x7f1550199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.290+0000 7f154e800640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1550109650 0x7f1550199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.290+0000 7f154e800640 1 -- 172.21.15.8:0/3853379187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1550103f50 msgr2=0x7f155019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.290+0000 7f154e800640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1550103f50 0x7f155019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.290+0000 7f154e800640 1 -- 172.21.15.8:0/3853379187 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1548009900 con 0x7f1550103590 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.290+0000 7f154e800640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1550103590 0x7f155019f880 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f154000d950 tx=0x7f154000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.291+0000 7f1547400640 1 -- 172.21.15.8:0/3853379187 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540009a30 con 0x7f1550103590 2024-03-16T21:02:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.291+0000 7f1554a00640 1 -- 172.21.15.8:0/3853379187 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155019a690 con 0x7f1550103590 2024-03-16T21:02:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.291+0000 7f1547400640 1 -- 172.21.15.8:0/3853379187 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1540009b90 con 0x7f1550103590 2024-03-16T21:02:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.291+0000 7f1547400640 1 -- 172.21.15.8:0/3853379187 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540004a00 con 0x7f1550103590 2024-03-16T21:02:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.291+0000 7f1554a00640 1 -- 172.21.15.8:0/3853379187 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15501a6920 con 0x7f1550103590 2024-03-16T21:02:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.294+0000 7f1558051740 1 Processor -- start 2024-03-16T21:02:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.294+0000 7f1558051740 1 -- start start 2024-03-16T21:02:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.294+0000 7f1547400640 1 -- 172.21.15.8:0/3853379187 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f1540009d00 con 0x7f1550103590 2024-03-16T21:02:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.294+0000 7f1558051740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bc3df0 0x55bf76bc41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f1558051740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 0x55bf76bccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f1558051740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bcd2f0 0x55bf76bcf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f1558051740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76b32210 con 0x55bf76bc3df0 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f1558051740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76b2f740 con 0x55bf76bcd2f0 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f1558051740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76b2af20 con 0x55bf76bc4710 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f154de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bcd2f0 0x55bf76bcf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f154e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 0x55bf76bccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f154de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bcd2f0 0x55bf76bcf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46470/0 (socket says 172.21.15.8:46470) 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f154de00640 1 -- 172.21.15.8:0/25380645 learned_addr learned my addr 172.21.15.8:0/25380645 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f154f200640 1 --2- 172.21.15.8:0/25380645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bc3df0 0x55bf76bc41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f154de00640 1 -- 172.21.15.8:0/25380645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 msgr2=0x55bf76bccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f154de00640 1 --2- 172.21.15.8:0/25380645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 0x55bf76bccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f154de00640 1 -- 172.21.15.8:0/25380645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bc3df0 msgr2=0x55bf76bc41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f154de00640 1 --2- 172.21.15.8:0/25380645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bc3df0 0x55bf76bc41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.295+0000 7f154de00640 1 -- 172.21.15.8:0/25380645 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf76aecdf0 con 0x55bf76bcd2f0 2024-03-16T21:02:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.296+0000 7f154de00640 1 --2- 172.21.15.8:0/25380645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bcd2f0 0x55bf76bcf6e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f153c009c60 tx=0x7f153c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=938a706d7d8eeb09 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.296+0000 7f153b400640 1 -- 172.21.15.8:0/25380645 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c004230 con 0x55bf76bcd2f0 2024-03-16T21:02:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.296+0000 7f153b400640 1 -- 172.21.15.8:0/25380645 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f153c005520 con 0x55bf76bcd2f0 2024-03-16T21:02:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.296+0000 7f153b400640 1 -- 172.21.15.8:0/25380645 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c004e40 con 0x55bf76bcd2f0 2024-03-16T21:02:42.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.296+0000 7f1547400640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15340a1ba0 0x7f15340a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.296+0000 7f1558051740 1 -- 172.21.15.8:0/25380645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bcd2f0 msgr2=0x55bf76bcf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.296+0000 7f1558051740 1 --2- 172.21.15.8:0/25380645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bcd2f0 0x55bf76bcf6e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f153c009c60 tx=0x7f153c011810 comp rx=0 tx=0).stop 2024-03-16T21:02:42.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.297+0000 7f1547400640 1 -- 172.21.15.8:0/3853379187 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f15400cd180 con 0x7f1550103590 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.297+0000 7f154f200640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15340a1ba0 0x7f15340a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.297+0000 7f1558051740 1 -- 172.21.15.8:0/25380645 shutdown_connections 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.297+0000 7f1558051740 1 --2- 172.21.15.8:0/25380645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bcd2f0 0x55bf76bcf6e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.297+0000 7f1558051740 1 --2- 172.21.15.8:0/25380645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 0x55bf76bccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.297+0000 7f1558051740 1 --2- 172.21.15.8:0/25380645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bc3df0 0x55bf76bc41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.297+0000 7f1558051740 1 -- 172.21.15.8:0/25380645 >> 172.21.15.8:0/25380645 conn(0x55bf76bbe520 msgr2=0x55bf76bbe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.297+0000 7f1558051740 1 -- 172.21.15.8:0/25380645 shutdown_connections 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.297+0000 7f1558051740 1 -- 172.21.15.8:0/25380645 wait complete. 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.297+0000 7f1558051740 1 -- start start 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.297+0000 7f154f200640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15340a1ba0 0x7f15340a4060 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f154802c620 tx=0x7f1548005d80 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.298+0000 7f1558051740 1 Processor -- start 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.298+0000 7f1558051740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.298+0000 7f1558051740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 0x55bf76bca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.298+0000 7f1558051740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bcad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.298+0000 7f1558051740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76ad0150 con 0x55bf76bcd2f0 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.298+0000 7f1558051740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76acfdf0 con 0x55bf76bc4710 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.298+0000 7f1558051740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf768991c0 con 0x55bf76bc3df0 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.298+0000 7f1558051740 10 client.0 _ll_register_callbacks cb 0x55bf76b1f2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.298+0000 7f154e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.298+0000 7f154f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bcad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.298+0000 7f154e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56760/0 (socket says 172.21.15.8:56760) 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f154e800640 1 -- 172.21.15.8:0/3127923331 learned_addr learned my addr 172.21.15.8:0/3127923331 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f154de00640 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 0x55bf76bca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f154e800640 1 -- 172.21.15.8:0/3127923331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 msgr2=0x55bf76bca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f154e800640 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 0x55bf76bca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f154e800640 1 -- 172.21.15.8:0/3127923331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 msgr2=0x55bf76bcad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f154e800640 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bcad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f154e800640 1 -- 172.21.15.8:0/3127923331 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c009890 con 0x55bf76bc3df0 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f154e800640 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bca310 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1540009610 tx=0x7f1540005790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5abf8a863f424210 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f152fe00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f152fe00640 1 -- 172.21.15.8:0/3127923331 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15400998c0 con 0x55bf76bc3df0 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f152fe00640 1 -- 172.21.15.8:0/3127923331 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f154009a480 con 0x55bf76bc3df0 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.299+0000 7f1558051740 1 -- 172.21.15.8:0/3127923331 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf7682a7e0 con 0x55bf76bc3df0 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f152fe00640 1 -- 172.21.15.8:0/3127923331 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15400996e0 con 0x55bf76bc3df0 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f1558051740 10 client.26713 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f1558051740 1 -- 172.21.15.8:0/3127923331 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55bf76b295a0 con 0x55bf76bc3df0 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f152fe00640 1 -- 172.21.15.8:0/3127923331 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55bf7682a7e0 con 0x55bf76bc3df0 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f152fe00640 1 -- 172.21.15.8:0/3127923331 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f15400cf110 con 0x55bf76bc3df0 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f1558051740 10 client.26713 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f1558051740 10 client.26713 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f1558051740 20 client.26713 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f1558051740 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55bf76bdd230 0x55bf76bdf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f1558051740 4 client.26713 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f1558051740 1 -- 172.21.15.8:0/3127923331 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf76867720 con 0x55bf76bdd230 2024-03-16T21:02:42.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.300+0000 7f154de00640 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55bf76bdd230 0x55bf76bdf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.301+0000 7f154de00640 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55bf76bdd230 0x55bf76bdf650 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b08d8dd6f882c770 server_cookie=1327156e0943d118 in_seq=0 out_seq=0 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.301+0000 7f152fe00640 10 client.26713 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f152fe00640 1 -- 172.21.15.8:0/3127923331 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55bf76867720 con 0x55bf76bdd230 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f152fe00640 10 client.26713 handle_command_reply: tid=0 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f1558051740 1 client.26713 shutdown 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f1558051740 1 -- 172.21.15.8:0/3127923331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 msgr2=0x55bf76bca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f1558051740 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bca310 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1540009610 tx=0x7f1540005790 comp rx=0 tx=0).stop 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f1558051740 1 -- 172.21.15.8:0/3127923331 shutdown_connections 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f1558051740 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55bf76bdd230 0x55bf76bdf650 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f1558051740 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bcad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f1558051740 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 0x55bf76bca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f152fe00640 0 client.26713 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f1558051740 1 --2- 172.21.15.8:0/3127923331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bca310 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f1558051740 1 -- 172.21.15.8:0/3127923331 >> 172.21.15.8:0/3127923331 conn(0x55bf76bbe520 msgr2=0x55bf76bc0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.302+0000 7f1558051740 1 -- 172.21.15.8:0/3127923331 shutdown_connections 2024-03-16T21:02:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.303+0000 7f1558051740 1 -- 172.21.15.8:0/3127923331 wait complete. 2024-03-16T21:02:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.303+0000 7f1558051740 20 client.26713 trim_cache size 0 max 16384 2024-03-16T21:02:42.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.316+0000 7f1558051740 1 Processor -- start 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.316+0000 7f1558051740 1 -- start start 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f1558051740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc3df0 0x55bf76bcabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f1558051740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 0x55bf76bbff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f1558051740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bd8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f1558051740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76bcf6e0 con 0x55bf76bcd2f0 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f1558051740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76bb9df0 con 0x55bf76bc3df0 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f1558051740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76bc8860 con 0x55bf76bc4710 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f154de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 0x55bf76bbff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f154e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc3df0 0x55bf76bcabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f154de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 0x55bf76bbff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56776/0 (socket says 172.21.15.8:56776) 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f154de00640 1 -- 172.21.15.8:0/4268202638 learned_addr learned my addr 172.21.15.8:0/4268202638 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f154f200640 1 --2- 172.21.15.8:0/4268202638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bd8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f154de00640 1 -- 172.21.15.8:0/4268202638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc3df0 msgr2=0x55bf76bcabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f154de00640 1 --2- 172.21.15.8:0/4268202638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc3df0 0x55bf76bcabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f154de00640 1 -- 172.21.15.8:0/4268202638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 msgr2=0x55bf76bd8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f154de00640 1 --2- 172.21.15.8:0/4268202638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bd8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.317+0000 7f154de00640 1 -- 172.21.15.8:0/4268202638 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf76ac5ab0 con 0x55bf76bc4710 2024-03-16T21:02:42.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.318+0000 7f154de00640 1 --2- 172.21.15.8:0/4268202638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 0x55bf76bbff80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f153c009c60 tx=0x7f153c009f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=272dbc86bab1fddd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.318+0000 7f153aa00640 1 -- 172.21.15.8:0/4268202638 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c004b90 con 0x55bf76bc4710 2024-03-16T21:02:42.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.318+0000 7f153aa00640 1 -- 172.21.15.8:0/4268202638 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f153c004650 con 0x55bf76bc4710 2024-03-16T21:02:42.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.318+0000 7f153aa00640 1 -- 172.21.15.8:0/4268202638 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c026970 con 0x55bf76bc4710 2024-03-16T21:02:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.319+0000 7f1558051740 1 -- 172.21.15.8:0/4268202638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 msgr2=0x55bf76bbff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.319+0000 7f1558051740 1 --2- 172.21.15.8:0/4268202638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 0x55bf76bbff80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f153c009c60 tx=0x7f153c009f40 comp rx=0 tx=0).stop 2024-03-16T21:02:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.319+0000 7f1558051740 1 -- 172.21.15.8:0/4268202638 shutdown_connections 2024-03-16T21:02:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.319+0000 7f1558051740 1 --2- 172.21.15.8:0/4268202638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bd8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.319+0000 7f1558051740 1 --2- 172.21.15.8:0/4268202638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc4710 0x55bf76bbff80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.319+0000 7f1558051740 1 --2- 172.21.15.8:0/4268202638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc3df0 0x55bf76bcabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.319+0000 7f1558051740 1 -- 172.21.15.8:0/4268202638 >> 172.21.15.8:0/4268202638 conn(0x55bf76bbe520 msgr2=0x55bf76bbf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.319+0000 7f1558051740 1 -- 172.21.15.8:0/4268202638 shutdown_connections 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.319+0000 7f1558051740 1 -- 172.21.15.8:0/4268202638 wait complete. 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.319+0000 7f1558051740 1 -- start start 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.319+0000 7f1558051740 1 Processor -- start 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f1558051740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bd2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f1558051740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 0x55bf76bd26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f1558051740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bd2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f1558051740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76bc82a0 con 0x55bf76bcd2f0 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f1558051740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76bc8410 con 0x55bf76bc4710 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f1558051740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76c38b60 con 0x55bf76bc3df0 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f1558051740 10 client.0 _ll_register_callbacks cb 0x7f15400d08e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 0x55bf76bd26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bd2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bd2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 0x55bf76bd26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46510/0 (socket says 172.21.15.8:46510) 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bd2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56790/0 (socket says 172.21.15.8:56790) 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154de00640 1 -- 172.21.15.8:0/1101393852 learned_addr learned my addr 172.21.15.8:0/1101393852 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154de00640 1 -- 172.21.15.8:0/1101393852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 msgr2=0x55bf76bd2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154de00640 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bd2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154de00640 1 -- 172.21.15.8:0/1101393852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 msgr2=0x55bf76bd2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154de00640 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bd2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154de00640 1 -- 172.21.15.8:0/1101393852 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf76aecdf0 con 0x55bf76bc4710 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.320+0000 7f154e800640 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bd2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.321+0000 7f154de00640 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 0x55bf76bd26c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f153c009c30 tx=0x7f153c0264d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fd0277cf66125e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.321+0000 7f152fe00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.321+0000 7f152fe00640 1 -- 172.21.15.8:0/1101393852 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c0268f0 con 0x55bf76bc4710 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.321+0000 7f1558051740 1 -- 172.21.15.8:0/1101393852 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f153c005520 con 0x55bf76bc4710 2024-03-16T21:02:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.321+0000 7f152fe00640 1 -- 172.21.15.8:0/1101393852 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f153c026a50 con 0x55bf76bc4710 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.321+0000 7f152fe00640 1 -- 172.21.15.8:0/1101393852 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f153c009310 con 0x55bf76bc4710 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.321+0000 7f1558051740 10 client.26711 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.321+0000 7f1558051740 1 -- 172.21.15.8:0/1101393852 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55bf76aeb650 con 0x55bf76bc4710 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.322+0000 7f152fe00640 1 -- 172.21.15.8:0/1101393852 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f153c005520 con 0x55bf76bc4710 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.322+0000 7f152fe00640 1 -- 172.21.15.8:0/1101393852 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f153c034050 con 0x55bf76bc4710 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.322+0000 7f1558051740 10 client.26711 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.322+0000 7f1558051740 10 client.26711 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.322+0000 7f1558051740 20 client.26711 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.322+0000 7f1558051740 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55bf76c3a100 0x55bf76c3c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.322+0000 7f1558051740 4 client.26711 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.322+0000 7f1558051740 1 -- 172.21.15.8:0/1101393852 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bf768b6890 con 0x55bf76c3a100 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.322+0000 7f154e800640 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55bf76c3a100 0x55bf76c3c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f154e800640 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55bf76c3a100 0x55bf76c3c520 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c7c76aeacb69cee server_cookie=e8859364110c878d in_seq=0 out_seq=0 2024-03-16T21:02:42.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f152fe00640 10 client.26711 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f152fe00640 1 -- 172.21.15.8:0/1101393852 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bf768b6890 con 0x55bf76c3a100 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f152fe00640 10 client.26711 handle_command_reply: tid=0 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 1 client.26711 shutdown 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 1 -- 172.21.15.8:0/1101393852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 msgr2=0x55bf76bd26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 0x55bf76bd26c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f153c009c30 tx=0x7f153c0264d0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 1 -- 172.21.15.8:0/1101393852 shutdown_connections 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55bf76c3a100 0x55bf76c3c520 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf76bcd2f0 0x55bf76bd2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bf76bc4710 0x55bf76bd26c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f152fe00640 0 client.26711 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 1 --2- 172.21.15.8:0/1101393852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bf76bc3df0 0x55bf76bd2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 1 -- 172.21.15.8:0/1101393852 >> 172.21.15.8:0/1101393852 conn(0x55bf76bbe520 msgr2=0x55bf76bc0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 1 -- 172.21.15.8:0/1101393852 shutdown_connections 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 1 -- 172.21.15.8:0/1101393852 wait complete. 2024-03-16T21:02:42.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.323+0000 7f1558051740 20 client.26711 trim_cache size 0 max 16384 2024-03-16T21:02:42.334 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:02:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 -- 172.21.15.8:0/3853379187 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15340a1ba0 msgr2=0x7f15340a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15340a1ba0 0x7f15340a4060 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f154802c620 tx=0x7f1548005d80 comp rx=0 tx=0).stop 2024-03-16T21:02:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 -- 172.21.15.8:0/3853379187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1550103590 msgr2=0x7f155019f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1550103590 0x7f155019f880 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f154000d950 tx=0x7f154000de10 comp rx=0 tx=0).stop 2024-03-16T21:02:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 -- 172.21.15.8:0/3853379187 shutdown_connections 2024-03-16T21:02:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f15340a1ba0 0x7f15340a4060 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1550109650 0x7f1550199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1550103f50 0x7f155019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 --2- 172.21.15.8:0/3853379187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1550103590 0x7f155019f880 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 -- 172.21.15.8:0/3853379187 >> 172.21.15.8:0/3853379187 conn(0x7f15500ff020 msgr2=0x7f1550100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 -- 172.21.15.8:0/3853379187 shutdown_connections 2024-03-16T21:02:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.324+0000 7f1554a00640 1 -- 172.21.15.8:0/3853379187 wait complete. 2024-03-16T21:02:42.348 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:02:42.348 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:02:42.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.570+0000 7f7a92800640 1 -- 172.21.15.8:0/3370443957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c075a20 msgr2=0x7f7a8c075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.570+0000 7f7a92800640 1 --2- 172.21.15.8:0/3370443957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c075a20 0x7f7a8c075e00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009900 tx=0x7f7a8002bc50 comp rx=0 tx=0).stop 2024-03-16T21:02:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.570+0000 7f7a92800640 1 -- 172.21.15.8:0/3370443957 shutdown_connections 2024-03-16T21:02:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.570+0000 7f7a92800640 1 --2- 172.21.15.8:0/3370443957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a8c112210 0x7f7a8c114600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.570+0000 7f7a92800640 1 --2- 172.21.15.8:0/3370443957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a8c076340 0x7f7a8c111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.570+0000 7f7a92800640 1 --2- 172.21.15.8:0/3370443957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c075a20 0x7f7a8c075e00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.570+0000 7f7a92800640 1 -- 172.21.15.8:0/3370443957 >> 172.21.15.8:0/3370443957 conn(0x7f7a8c0ff000 msgr2=0x7f7a8c101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.570+0000 7f7a92800640 1 -- 172.21.15.8:0/3370443957 shutdown_connections 2024-03-16T21:02:42.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.570+0000 7f7a92800640 1 -- 172.21.15.8:0/3370443957 wait complete. 2024-03-16T21:02:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.571+0000 7f7a92800640 1 Processor -- start 2024-03-16T21:02:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.571+0000 7f7a92800640 1 -- start start 2024-03-16T21:02:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a92800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a8c075a20 0x7f7a8c19e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a92800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c076340 0x7f7a8c19eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a92800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a8c112210 0x7f7a8c1a2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a92800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c1a3440 con 0x7f7a8c076340 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a92800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c1a35b0 con 0x7f7a8c075a20 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a92800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c1a3770 con 0x7f7a8c112210 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a91400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a8c075a20 0x7f7a8c19e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c076340 0x7f7a8c19eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a91400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a8c075a20 0x7f7a8c19e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46528/0 (socket says 172.21.15.8:46528) 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a91400640 1 -- 172.21.15.8:0/2103680482 learned_addr learned my addr 172.21.15.8:0/2103680482 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a91e00640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a8c112210 0x7f7a8c1a2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a91400640 1 -- 172.21.15.8:0/2103680482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a8c112210 msgr2=0x7f7a8c1a2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a91400640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a8c112210 0x7f7a8c1a2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a91400640 1 -- 172.21.15.8:0/2103680482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c076340 msgr2=0x7f7a8c19eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a91400640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c076340 0x7f7a8c19eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.572+0000 7f7a91400640 1 -- 172.21.15.8:0/2103680482 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a84009840 con 0x7f7a8c075a20 2024-03-16T21:02:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.573+0000 7f7a91400640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a8c075a20 0x7f7a8c19e580 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7a8002efd0 tx=0x7f7a8002cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.573+0000 7f7a8a000640 1 -- 172.21.15.8:0/2103680482 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80004450 con 0x7f7a8c075a20 2024-03-16T21:02:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.573+0000 7f7a8a000640 1 -- 172.21.15.8:0/2103680482 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7a80005310 con 0x7f7a8c075a20 2024-03-16T21:02:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.573+0000 7f7a92800640 1 -- 172.21.15.8:0/2103680482 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a80009560 con 0x7f7a8c075a20 2024-03-16T21:02:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.573+0000 7f7a8a000640 1 -- 172.21.15.8:0/2103680482 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80003de0 con 0x7f7a8c075a20 2024-03-16T21:02:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.573+0000 7f7a92800640 1 -- 172.21.15.8:0/2103680482 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c1ab0f0 con 0x7f7a8c075a20 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.576+0000 7f7a96a63740 1 Processor -- start 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.576+0000 7f7a96a63740 1 -- start start 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.576+0000 7f7a8a000640 1 -- 172.21.15.8:0/2103680482 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7a80005480 con 0x7f7a8c075a20 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 0x5641dc08f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc097db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc0982f0 0x5641dc09a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a96a63740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dbffd210 con 0x5641dc08edf0 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a96a63740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dbffa740 con 0x5641dc08f710 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a96a63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dbff5f20 con 0x5641dc0982f0 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a91e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 0x5641dc08f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a91400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc097db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc0982f0 0x5641dc09a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a91e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 0x5641dc08f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34696/0 (socket says 172.21.15.8:34696) 2024-03-16T21:02:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a91e00640 1 -- 172.21.15.8:0/3252244806 learned_addr learned my addr 172.21.15.8:0/3252244806 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a91e00640 1 -- 172.21.15.8:0/3252244806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc0982f0 msgr2=0x5641dc09a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a91e00640 1 --2- 172.21.15.8:0/3252244806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc0982f0 0x5641dc09a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a91e00640 1 -- 172.21.15.8:0/3252244806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 msgr2=0x5641dc097db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a91e00640 1 --2- 172.21.15.8:0/3252244806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc097db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.577+0000 7f7a91e00640 1 -- 172.21.15.8:0/3252244806 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641dbfb7df0 con 0x5641dc08edf0 2024-03-16T21:02:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.578+0000 7f7a91e00640 1 --2- 172.21.15.8:0/3252244806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 0x5641dc08f1d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a84011570 tx=0x7f7a84011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46831e65fa764a69 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.578+0000 7f7a7e600640 1 -- 172.21.15.8:0/3252244806 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84003c30 con 0x5641dc08edf0 2024-03-16T21:02:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.578+0000 7f7a7e600640 1 -- 172.21.15.8:0/3252244806 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7a84003d90 con 0x5641dc08edf0 2024-03-16T21:02:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.578+0000 7f7a7e600640 1 -- 172.21.15.8:0/3252244806 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8400fc60 con 0x5641dc08edf0 2024-03-16T21:02:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.578+0000 7f7a8a000640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7a740a1c20 0x7f7a740a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a8a000640 1 -- 172.21.15.8:0/2103680482 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7a800ef690 con 0x7f7a8c075a20 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a91400640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7a740a1c20 0x7f7a740a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a96a63740 1 -- 172.21.15.8:0/3252244806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 msgr2=0x5641dc08f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a96a63740 1 --2- 172.21.15.8:0/3252244806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 0x5641dc08f1d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a84011570 tx=0x7f7a84011a30 comp rx=0 tx=0).stop 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a96a63740 1 -- 172.21.15.8:0/3252244806 shutdown_connections 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a96a63740 1 --2- 172.21.15.8:0/3252244806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc0982f0 0x5641dc09a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a96a63740 1 --2- 172.21.15.8:0/3252244806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc097db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a96a63740 1 --2- 172.21.15.8:0/3252244806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 0x5641dc08f1d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a96a63740 1 -- 172.21.15.8:0/3252244806 >> 172.21.15.8:0/3252244806 conn(0x5641dc089520 msgr2=0x5641dc089900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a96a63740 1 -- 172.21.15.8:0/3252244806 shutdown_connections 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a96a63740 1 -- 172.21.15.8:0/3252244806 wait complete. 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.579+0000 7f7a91400640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7a740a1c20 0x7f7a740a40e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5641dc08e8c0 tx=0x7f7a800b8040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.580+0000 7f7a96a63740 1 -- start start 2024-03-16T21:02:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.580+0000 7f7a96a63740 1 Processor -- start 2024-03-16T21:02:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 0x5641dc095300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc0982f0 0x5641dc095d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a96a63740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dbf9b150 con 0x5641dc08edf0 2024-03-16T21:02:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a96a63740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dbf9adf0 con 0x5641dc08f710 2024-03-16T21:02:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a96a63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dbd641c0 con 0x5641dc0982f0 2024-03-16T21:02:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a96a63740 10 client.0 _ll_register_callbacks cb 0x5641dbfea2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a91e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 0x5641dc095300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46544/0 (socket says 172.21.15.8:46544) 2024-03-16T21:02:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a91e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 0x5641dc095300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34698/0 (socket says 172.21.15.8:34698) 2024-03-16T21:02:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a90a00640 1 -- 172.21.15.8:0/2588826072 learned_addr learned my addr 172.21.15.8:0/2588826072 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a91e00640 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc0982f0 0x5641dc095d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a90a00640 1 -- 172.21.15.8:0/2588826072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc0982f0 msgr2=0x5641dc095d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a90a00640 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc0982f0 0x5641dc095d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a90a00640 1 -- 172.21.15.8:0/2588826072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 msgr2=0x5641dc095300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a90a00640 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 0x5641dc095300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.581+0000 7f7a90a00640 1 -- 172.21.15.8:0/2588826072 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a84009d80 con 0x5641dc08f710 2024-03-16T21:02:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.582+0000 7f7a90a00640 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095840 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800bf30 tx=0x7f7a780118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fac43d8268376295 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.582+0000 7f7a72a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.584+0000 7f7a72a00640 1 -- 172.21.15.8:0/2588826072 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a78016070 con 0x5641dc08f710 2024-03-16T21:02:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.585+0000 7f7a72a00640 1 -- 172.21.15.8:0/2588826072 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7a78005020 con 0x5641dc08f710 2024-03-16T21:02:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.585+0000 7f7a96a63740 1 -- 172.21.15.8:0/2588826072 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641dbcf57e0 con 0x5641dc08f710 2024-03-16T21:02:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.585+0000 7f7a72a00640 1 -- 172.21.15.8:0/2588826072 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a780051e0 con 0x5641dc08f710 2024-03-16T21:02:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.585+0000 7f7a96a63740 10 client.26723 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.585+0000 7f7a96a63740 1 -- 172.21.15.8:0/2588826072 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5641dbff45a0 con 0x5641dc08f710 2024-03-16T21:02:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.586+0000 7f7a72a00640 1 -- 172.21.15.8:0/2588826072 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5641dbcf57e0 con 0x5641dc08f710 2024-03-16T21:02:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.586+0000 7f7a72a00640 1 -- 172.21.15.8:0/2588826072 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f7a78004bd0 con 0x5641dc08f710 2024-03-16T21:02:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.586+0000 7f7a96a63740 10 client.26723 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.586+0000 7f7a96a63740 10 client.26723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.586+0000 7f7a96a63740 20 client.26723 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.586+0000 7f7a96a63740 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5641dc0a8490 0x5641dc0aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.586+0000 7f7a96a63740 4 client.26723 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.586+0000 7f7a96a63740 1 -- 172.21.15.8:0/2588826072 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641dbd32720 con 0x5641dc0a8490 2024-03-16T21:02:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.586+0000 7f7a91e00640 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5641dc0a8490 0x5641dc0aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.587+0000 7f7a91e00640 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5641dc0a8490 0x5641dc0aa8b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a434c68c78ddffbd server_cookie=3fa3370f6a5b9d8e in_seq=0 out_seq=0 2024-03-16T21:02:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.587+0000 7f7a72a00640 10 client.26723 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.587+0000 7f7a72a00640 1 -- 172.21.15.8:0/2588826072 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5641dbd32720 con 0x5641dc0a8490 2024-03-16T21:02:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.587+0000 7f7a72a00640 10 client.26723 handle_command_reply: tid=0 2024-03-16T21:02:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.587+0000 7f7a96a63740 1 client.26723 shutdown 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a96a63740 1 -- 172.21.15.8:0/2588826072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 msgr2=0x5641dc095840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a96a63740 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095840 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800bf30 tx=0x7f7a780118d0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a96a63740 1 -- 172.21.15.8:0/2588826072 shutdown_connections 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a96a63740 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc0982f0 0x5641dc095d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a96a63740 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095840 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a96a63740 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5641dc0a8490 0x5641dc0aa8b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a96a63740 1 --2- 172.21.15.8:0/2588826072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc08edf0 0x5641dc095300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a72a00640 0 client.26723 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a96a63740 1 -- 172.21.15.8:0/2588826072 >> 172.21.15.8:0/2588826072 conn(0x5641dc089520 msgr2=0x5641dc08b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a96a63740 1 -- 172.21.15.8:0/2588826072 shutdown_connections 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a96a63740 1 -- 172.21.15.8:0/2588826072 wait complete. 2024-03-16T21:02:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.588+0000 7f7a96a63740 20 client.26723 trim_cache size 0 max 16384 2024-03-16T21:02:42.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.602+0000 7f7a96a63740 1 Processor -- start 2024-03-16T21:02:42.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.602+0000 7f7a96a63740 1 -- start start 2024-03-16T21:02:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.602+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 0x5641dc097a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.602+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.602+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc0982f0 0x5641dc088540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.602+0000 7f7a96a63740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dc0a6bc0 con 0x5641dc0982f0 2024-03-16T21:02:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.602+0000 7f7a96a63740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dc083ad0 con 0x5641dc08f710 2024-03-16T21:02:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.602+0000 7f7a96a63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dc084df0 con 0x5641dc08edf0 2024-03-16T21:02:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a91e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 0x5641dc097a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46554/0 (socket says 172.21.15.8:46554) 2024-03-16T21:02:42.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a90a00640 1 -- 172.21.15.8:0/4142074500 learned_addr learned my addr 172.21.15.8:0/4142074500 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a91e00640 1 --2- 172.21.15.8:0/4142074500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc0982f0 0x5641dc088540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a91e00640 1 -- 172.21.15.8:0/4142074500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 msgr2=0x5641dc095ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a91e00640 1 --2- 172.21.15.8:0/4142074500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a91e00640 1 -- 172.21.15.8:0/4142074500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc0982f0 msgr2=0x5641dc088540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a91e00640 1 --2- 172.21.15.8:0/4142074500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc0982f0 0x5641dc088540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a91e00640 1 -- 172.21.15.8:0/4142074500 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641dbf90ab0 con 0x5641dc08edf0 2024-03-16T21:02:42.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a90a00640 1 --2- 172.21.15.8:0/4142074500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:42.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.603+0000 7f7a91e00640 1 --2- 172.21.15.8:0/4142074500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 0x5641dc097a30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a840049d0 tx=0x7f7a8400f780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53a98474edc9853c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a7dc00640 1 -- 172.21.15.8:0/4142074500 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8402d330 con 0x5641dc08edf0 2024-03-16T21:02:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a7dc00640 1 -- 172.21.15.8:0/4142074500 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7a8400f8c0 con 0x5641dc08edf0 2024-03-16T21:02:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a7dc00640 1 -- 172.21.15.8:0/4142074500 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a840041f0 con 0x5641dc08edf0 2024-03-16T21:02:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a96a63740 1 -- 172.21.15.8:0/4142074500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 msgr2=0x5641dc097a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a96a63740 1 --2- 172.21.15.8:0/4142074500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 0x5641dc097a30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a840049d0 tx=0x7f7a8400f780 comp rx=0 tx=0).stop 2024-03-16T21:02:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a96a63740 1 -- 172.21.15.8:0/4142074500 shutdown_connections 2024-03-16T21:02:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a96a63740 1 --2- 172.21.15.8:0/4142074500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc0982f0 0x5641dc088540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a96a63740 1 --2- 172.21.15.8:0/4142074500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc095ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a96a63740 1 --2- 172.21.15.8:0/4142074500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 0x5641dc097a30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a96a63740 1 -- 172.21.15.8:0/4142074500 >> 172.21.15.8:0/4142074500 conn(0x5641dc089520 msgr2=0x5641dc087e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a96a63740 1 -- 172.21.15.8:0/4142074500 shutdown_connections 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.604+0000 7f7a96a63740 1 -- 172.21.15.8:0/4142074500 wait complete. 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.605+0000 7f7a96a63740 1 -- start start 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.605+0000 7f7a96a63740 1 Processor -- start 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 0x5641dc092100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc092640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a96a63740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc0982f0 0x5641dc102d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a96a63740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dc1032a0 con 0x5641dc0982f0 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a96a63740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dc1033e0 con 0x5641dc08f710 2024-03-16T21:02:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a96a63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641dc103520 con 0x5641dc08edf0 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a96a63740 10 client.0 _ll_register_callbacks cb 0x7f7a7800bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc092640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a91e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 0x5641dc092100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc092640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46558/0 (socket says 172.21.15.8:46558) 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a91e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc0982f0 0x5641dc102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a90a00640 1 -- 172.21.15.8:0/3997573434 learned_addr learned my addr 172.21.15.8:0/3997573434 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a90a00640 1 -- 172.21.15.8:0/3997573434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 msgr2=0x5641dc092100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a90a00640 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 0x5641dc092100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a90a00640 1 -- 172.21.15.8:0/3997573434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc0982f0 msgr2=0x5641dc102d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a90a00640 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc0982f0 0x5641dc102d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a90a00640 1 -- 172.21.15.8:0/3997573434 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641dbff45a0 con 0x5641dc08f710 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.606+0000 7f7a91e00640 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 0x5641dc092100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.607+0000 7f7a90a00640 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc092640 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7a78005330 tx=0x7f7a78005360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab18590f6a9f69ac server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.607+0000 7f7a72a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.607+0000 7f7a72a00640 1 -- 172.21.15.8:0/3997573434 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a78016040 con 0x5641dc08f710 2024-03-16T21:02:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.607+0000 7f7a72a00640 1 -- 172.21.15.8:0/3997573434 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7a78004860 con 0x5641dc08f710 2024-03-16T21:02:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.607+0000 7f7a96a63740 1 -- 172.21.15.8:0/3997573434 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641dc084c30 con 0x5641dc08f710 2024-03-16T21:02:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.607+0000 7f7a72a00640 1 -- 172.21.15.8:0/3997573434 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a7800b4a0 con 0x5641dc08f710 2024-03-16T21:02:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.607+0000 7f7a96a63740 10 client.26729 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.607+0000 7f7a96a63740 1 -- 172.21.15.8:0/3997573434 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5641dbfb7df0 con 0x5641dc08f710 2024-03-16T21:02:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.608+0000 7f7a72a00640 1 -- 172.21.15.8:0/3997573434 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7a78039020 con 0x5641dc08f710 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.608+0000 7f7a72a00640 1 -- 172.21.15.8:0/3997573434 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f7a78023810 con 0x5641dc08f710 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.608+0000 7f7a96a63740 10 client.26729 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.608+0000 7f7a96a63740 10 client.26729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.608+0000 7f7a96a63740 20 client.26729 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.608+0000 7f7a96a63740 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5641dc104da0 0x5641dc1071c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.608+0000 7f7a96a63740 4 client.26729 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.608+0000 7f7a96a63740 1 -- 172.21.15.8:0/3997573434 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f7a84003d90 con 0x5641dc104da0 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.608+0000 7f7a91e00640 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5641dc104da0 0x5641dc1071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.608+0000 7f7a91e00640 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5641dc104da0 0x5641dc1071c0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=685862e0642729ac server_cookie=8b4eaed48837a15d in_seq=0 out_seq=0 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.608+0000 7f7a72a00640 10 client.26729 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a72a00640 1 -- 172.21.15.8:0/3997573434 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f7a84003d90 con 0x5641dc104da0 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a72a00640 10 client.26729 handle_command_reply: tid=0 2024-03-16T21:02:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 1 client.26729 shutdown 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 1 -- 172.21.15.8:0/3997573434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 msgr2=0x5641dc092640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc092640 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7a78005330 tx=0x7f7a78005360 comp rx=0 tx=0).stop 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 1 -- 172.21.15.8:0/3997573434 shutdown_connections 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5641dc104da0 0x5641dc1071c0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641dc0982f0 0x5641dc102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641dc08f710 0x5641dc092640 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 1 --2- 172.21.15.8:0/3997573434 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5641dc08edf0 0x5641dc092100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 1 -- 172.21.15.8:0/3997573434 >> 172.21.15.8:0/3997573434 conn(0x5641dc089520 msgr2=0x5641dc08b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a72a00640 0 client.26729 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 1 -- 172.21.15.8:0/3997573434 shutdown_connections 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 1 -- 172.21.15.8:0/3997573434 wait complete. 2024-03-16T21:02:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.609+0000 7f7a96a63740 20 client.26729 trim_cache size 0 max 16384 2024-03-16T21:02:42.620 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:02:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 -- 172.21.15.8:0/2103680482 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7a740a1c20 msgr2=0x7f7a740a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7a740a1c20 0x7f7a740a40e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5641dc08e8c0 tx=0x7f7a800b8040 comp rx=0 tx=0).stop 2024-03-16T21:02:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 -- 172.21.15.8:0/2103680482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a8c075a20 msgr2=0x7f7a8c19e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a8c075a20 0x7f7a8c19e580 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7a8002efd0 tx=0x7f7a8002cce0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 -- 172.21.15.8:0/2103680482 shutdown_connections 2024-03-16T21:02:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7a740a1c20 0x7f7a740a40e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a8c112210 0x7f7a8c1a2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c076340 0x7f7a8c19eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 --2- 172.21.15.8:0/2103680482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a8c075a20 0x7f7a8c19e580 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 -- 172.21.15.8:0/2103680482 >> 172.21.15.8:0/2103680482 conn(0x7f7a8c0ff000 msgr2=0x7f7a8c1130c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 -- 172.21.15.8:0/2103680482 shutdown_connections 2024-03-16T21:02:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:42.610+0000 7f7a92800640 1 -- 172.21.15.8:0/2103680482 wait complete. 2024-03-16T21:02:42.631 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:42 smithi008 ceph-mon[31434]: pgmap v149: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:42.632 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:42 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2790497200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:02:42.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:42 smithi170 ceph-mon[35947]: pgmap v149: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:42.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:42 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2790497200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:02:42.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:42 smithi186 ceph-mon[36391]: pgmap v149: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:02:42.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:42 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2790497200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:02:43.634 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:02:43.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:02:43.635 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:02:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.868+0000 7f796be00640 1 -- 172.21.15.8:0/2907128834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c10d9d0 msgr2=0x7f796c10ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.868+0000 7f796be00640 1 --2- 172.21.15.8:0/2907128834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c10d9d0 0x7f796c10ddb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f795c009930 tx=0x7f795c02bcd0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.868+0000 7f796be00640 1 -- 172.21.15.8:0/2907128834 shutdown_connections 2024-03-16T21:02:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.868+0000 7f796be00640 1 --2- 172.21.15.8:0/2907128834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f796c1083d0 0x7f796c114820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.868+0000 7f796be00640 1 --2- 172.21.15.8:0/2907128834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c107a30 0x7f796c107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.868+0000 7f796be00640 1 --2- 172.21.15.8:0/2907128834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c10d9d0 0x7f796c10ddb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.868+0000 7f796be00640 1 -- 172.21.15.8:0/2907128834 >> 172.21.15.8:0/2907128834 conn(0x7f796c077310 msgr2=0x7f796c106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.868+0000 7f796be00640 1 -- 172.21.15.8:0/2907128834 shutdown_connections 2024-03-16T21:02:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.868+0000 7f796be00640 1 -- 172.21.15.8:0/2907128834 wait complete. 2024-03-16T21:02:43.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.870+0000 7f796be00640 1 Processor -- start 2024-03-16T21:02:43.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.870+0000 7f796be00640 1 -- start start 2024-03-16T21:02:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c107a30 0x7f796c19e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f796c1083d0 0x7f796c19e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c10d9d0 0x7f796c1a2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796be00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a2f70 con 0x7f796c107a30 2024-03-16T21:02:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a30e0 con 0x7f796c1083d0 2024-03-16T21:02:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a32a0 con 0x7f796c10d9d0 2024-03-16T21:02:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c107a30 0x7f796c19e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c107a30 0x7f796c19e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34732/0 (socket says 172.21.15.8:34732) 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796aa00640 1 -- 172.21.15.8:0/4172477917 learned_addr learned my addr 172.21.15.8:0/4172477917 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796b400640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c10d9d0 0x7f796c1a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796a000640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f796c1083d0 0x7f796c19e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796aa00640 1 -- 172.21.15.8:0/4172477917 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c10d9d0 msgr2=0x7f796c1a2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796aa00640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c10d9d0 0x7f796c1a2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796aa00640 1 -- 172.21.15.8:0/4172477917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f796c1083d0 msgr2=0x7f796c19e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796aa00640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f796c1083d0 0x7f796c19e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796aa00640 1 -- 172.21.15.8:0/4172477917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c009560 con 0x7f796c107a30 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796b400640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c10d9d0 0x7f796c1a2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.871+0000 7f796a000640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f796c1083d0 0x7f796c19e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.872+0000 7f796aa00640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c107a30 0x7f796c19e0b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f795c009230 tx=0x7f795c02cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.872+0000 7f7963400640 1 -- 172.21.15.8:0/4172477917 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c02cdd0 con 0x7f796c107a30 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.872+0000 7f7963400640 1 -- 172.21.15.8:0/4172477917 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f795c004250 con 0x7f796c107a30 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.872+0000 7f796be00640 1 -- 172.21.15.8:0/4172477917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c1a3520 con 0x7f796c107a30 2024-03-16T21:02:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.872+0000 7f7963400640 1 -- 172.21.15.8:0/4172477917 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c003ab0 con 0x7f796c107a30 2024-03-16T21:02:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.872+0000 7f796be00640 1 -- 172.21.15.8:0/4172477917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c1aae00 con 0x7f796c107a30 2024-03-16T21:02:43.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.876+0000 7f797486d740 1 Processor -- start 2024-03-16T21:02:43.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.876+0000 7f7963400640 1 -- 172.21.15.8:0/4172477917 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f795c0043c0 con 0x7f796c107a30 2024-03-16T21:02:43.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.876+0000 7f797486d740 1 -- start start 2024-03-16T21:02:43.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.876+0000 7f797486d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cf8a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.876+0000 7f797486d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8aa30 0x560a4cf930d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.876+0000 7f797486d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf93610 0x560a4cf95a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.876+0000 7f797486d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4cf45300 con 0x560a4cf8aa30 2024-03-16T21:02:43.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.876+0000 7f797486d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4cef7e50 con 0x560a4cf93610 2024-03-16T21:02:43.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.876+0000 7f797486d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4cef5380 con 0x560a4cf8a110 2024-03-16T21:02:43.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.876+0000 7f796b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cf8a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.876+0000 7f796aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8aa30 0x560a4cf930d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.877+0000 7f796a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf93610 0x560a4cf95a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.877+0000 7f796b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cf8a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56868/0 (socket says 172.21.15.8:56868) 2024-03-16T21:02:43.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.877+0000 7f796b400640 1 -- 172.21.15.8:0/2153638338 learned_addr learned my addr 172.21.15.8:0/2153638338 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:43.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.877+0000 7f796a000640 1 -- 172.21.15.8:0/2153638338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 msgr2=0x560a4cf8a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:43.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.877+0000 7f796a000640 1 --2- 172.21.15.8:0/2153638338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cf8a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.877+0000 7f796a000640 1 -- 172.21.15.8:0/2153638338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8aa30 msgr2=0x560a4cf930d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:43.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.877+0000 7f796a000640 1 --2- 172.21.15.8:0/2153638338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8aa30 0x560a4cf930d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.877+0000 7f796a000640 1 -- 172.21.15.8:0/2153638338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a4ceb9c80 con 0x560a4cf93610 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.877+0000 7f796b400640 1 --2- 172.21.15.8:0/2153638338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cf8a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.877+0000 7f796a000640 1 --2- 172.21.15.8:0/2153638338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf93610 0x560a4cf95a00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7958009fa0 tx=0x7f79580118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a4e51788e568fbe server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.877+0000 7f7957e00640 1 -- 172.21.15.8:0/2153638338 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958004030 con 0x560a4cf93610 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f7957e00640 1 -- 172.21.15.8:0/2153638338 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7958005520 con 0x560a4cf93610 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f7957e00640 1 -- 172.21.15.8:0/2153638338 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958004ce0 con 0x560a4cf93610 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f7963400640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79500a1ba0 0x7f79500a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f7963400640 1 -- 172.21.15.8:0/4172477917 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f795c0efc40 con 0x7f796c107a30 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f796b400640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79500a1ba0 0x7f79500a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f797486d740 1 -- 172.21.15.8:0/2153638338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf93610 msgr2=0x560a4cf95a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f797486d740 1 --2- 172.21.15.8:0/2153638338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf93610 0x560a4cf95a00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7958009fa0 tx=0x7f79580118d0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f797486d740 1 -- 172.21.15.8:0/2153638338 shutdown_connections 2024-03-16T21:02:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f797486d740 1 --2- 172.21.15.8:0/2153638338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf93610 0x560a4cf95a00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f797486d740 1 --2- 172.21.15.8:0/2153638338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8aa30 0x560a4cf930d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f797486d740 1 --2- 172.21.15.8:0/2153638338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cf8a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.878+0000 7f797486d740 1 -- 172.21.15.8:0/2153638338 >> 172.21.15.8:0/2153638338 conn(0x560a4cf84840 msgr2=0x560a4cf84c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.879+0000 7f797486d740 1 -- 172.21.15.8:0/2153638338 shutdown_connections 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.879+0000 7f797486d740 1 -- 172.21.15.8:0/2153638338 wait complete. 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.879+0000 7f796b400640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79500a1ba0 0x7f79500a4060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7964012ad0 tx=0x7f7964009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.879+0000 7f797486d740 1 -- start start 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.879+0000 7f797486d740 1 Processor -- start 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f797486d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8a110 0x560a4cf906d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f797486d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 0x560a4cf90c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f797486d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 0x560a4cf91150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f797486d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4cef0b60 con 0x560a4cf8a110 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f797486d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4ce95fd0 con 0x560a4cf8aa30 2024-03-16T21:02:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f797486d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4ce95c70 con 0x560a4cf93610 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f797486d740 10 client.0 _ll_register_callbacks cb 0x560a4cc01c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f796aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8a110 0x560a4cf906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f796b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 0x560a4cf91150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f796a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 0x560a4cf90c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f796aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8a110 0x560a4cf906d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34752/0 (socket says 172.21.15.8:34752) 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f796b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 0x560a4cf91150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56876/0 (socket says 172.21.15.8:56876) 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f796a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 0x560a4cf90c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46606/0 (socket says 172.21.15.8:46606) 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.880+0000 7f796aa00640 1 -- 172.21.15.8:0/3714474507 learned_addr learned my addr 172.21.15.8:0/3714474507 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f796a000640 1 -- 172.21.15.8:0/3714474507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 msgr2=0x560a4cf91150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f796a000640 1 --2- 172.21.15.8:0/3714474507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 0x560a4cf91150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f796a000640 1 -- 172.21.15.8:0/3714474507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8a110 msgr2=0x560a4cf906d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f796a000640 1 --2- 172.21.15.8:0/3714474507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8a110 0x560a4cf906d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f796a000640 1 -- 172.21.15.8:0/3714474507 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7958009c00 con 0x560a4cf8aa30 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f796a000640 1 --2- 172.21.15.8:0/3714474507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 0x560a4cf90c10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f795801b040 tx=0x7f79580050f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15c3cac3fb5b40a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f7954c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f7954c00640 1 -- 172.21.15.8:0/3714474507 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79580052e0 con 0x560a4cf8aa30 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f7954c00640 1 -- 172.21.15.8:0/3714474507 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f795800f5a0 con 0x560a4cf8aa30 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f797486d740 1 -- 172.21.15.8:0/3714474507 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a4cbf0860 con 0x560a4cf8aa30 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f7954c00640 1 -- 172.21.15.8:0/3714474507 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f795800f760 con 0x560a4cf8aa30 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f797486d740 10 client.26741 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.881+0000 7f797486d740 1 -- 172.21.15.8:0/3714474507 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560a4ceef1e0 con 0x560a4cf8aa30 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.882+0000 7f7954c00640 1 -- 172.21.15.8:0/3714474507 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x560a4cbf0860 con 0x560a4cf8aa30 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.882+0000 7f7954c00640 1 -- 172.21.15.8:0/3714474507 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f7958023620 con 0x560a4cf8aa30 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.882+0000 7f797486d740 10 client.26741 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.882+0000 7f797486d740 10 client.26741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.882+0000 7f797486d740 20 client.26741 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.882+0000 7f797486d740 1 --2- 172.21.15.8:0/3714474507 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560a4cfa3a40 0x560a4cfa5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.882+0000 7f797486d740 4 client.26741 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.882+0000 7f797486d740 1 -- 172.21.15.8:0/3714474507 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a4cc41410 con 0x560a4cfa3a40 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.882+0000 7f796aa00640 1 --2- 172.21.15.8:0/3714474507 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560a4cfa3a40 0x560a4cfa5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.883+0000 7f796aa00640 1 --2- 172.21.15.8:0/3714474507 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560a4cfa3a40 0x560a4cfa5e80 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0fbe24d0d9f93fd server_cookie=9e811a6561d5fff8 in_seq=0 out_seq=0 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.883+0000 7f7954c00640 10 client.26741 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f7954c00640 1 -- 172.21.15.8:0/3714474507 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560a4cc41410 con 0x560a4cfa3a40 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f7954c00640 10 client.26741 handle_command_reply: tid=0 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 1 client.26741 shutdown 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 1 -- 172.21.15.8:0/3714474507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 msgr2=0x560a4cf90c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 1 --2- 172.21.15.8:0/3714474507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 0x560a4cf90c10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f795801b040 tx=0x7f79580050f0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 1 -- 172.21.15.8:0/3714474507 shutdown_connections 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 1 --2- 172.21.15.8:0/3714474507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 0x560a4cf91150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 1 --2- 172.21.15.8:0/3714474507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 0x560a4cf90c10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 1 --2- 172.21.15.8:0/3714474507 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560a4cfa3a40 0x560a4cfa5e80 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 1 --2- 172.21.15.8:0/3714474507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8a110 0x560a4cf906d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f7954c00640 0 client.26741 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 1 -- 172.21.15.8:0/3714474507 >> 172.21.15.8:0/3714474507 conn(0x560a4cf84840 msgr2=0x560a4cf86590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 1 -- 172.21.15.8:0/3714474507 shutdown_connections 2024-03-16T21:02:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 1 -- 172.21.15.8:0/3714474507 wait complete. 2024-03-16T21:02:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.884+0000 7f797486d740 20 client.26741 trim_cache size 0 max 16384 2024-03-16T21:02:43.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.902+0000 7f797486d740 1 Processor -- start 2024-03-16T21:02:43.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.902+0000 7f797486d740 1 -- start start 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.902+0000 7f797486d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8a110 0x560a4cf92e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.902+0000 7f797486d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8aa30 0x560a4cf90f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.902+0000 7f797486d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 0x560a4cf83720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.902+0000 7f797486d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4cc390c0 con 0x560a4cf8aa30 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.902+0000 7f797486d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4cf7ff60 con 0x560a4cf8a110 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.902+0000 7f797486d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4cf85840 con 0x560a4cf93610 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8a110 0x560a4cf92e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8a110 0x560a4cf92e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46608/0 (socket says 172.21.15.8:46608) 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 0x560a4cf83720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796aa00640 1 -- 172.21.15.8:0/2963862959 learned_addr learned my addr 172.21.15.8:0/2963862959 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796a000640 1 --2- 172.21.15.8:0/2963862959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8aa30 0x560a4cf90f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796aa00640 1 -- 172.21.15.8:0/2963862959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 msgr2=0x560a4cf83720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796aa00640 1 --2- 172.21.15.8:0/2963862959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 0x560a4cf83720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796aa00640 1 -- 172.21.15.8:0/2963862959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8aa30 msgr2=0x560a4cf90f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796aa00640 1 --2- 172.21.15.8:0/2963862959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8aa30 0x560a4cf90f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796aa00640 1 -- 172.21.15.8:0/2963862959 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a4ce8ba90 con 0x560a4cf8a110 2024-03-16T21:02:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796b400640 1 --2- 172.21.15.8:0/2963862959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 0x560a4cf83720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f796aa00640 1 --2- 172.21.15.8:0/2963862959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8a110 0x560a4cf92e00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f795c0bc8e0 tx=0x7f795c0ef040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94285d157b4f4c3b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f7957400640 1 -- 172.21.15.8:0/2963862959 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0f3020 con 0x560a4cf8a110 2024-03-16T21:02:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.903+0000 7f7957400640 1 -- 172.21.15.8:0/2963862959 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f795c0bc2b0 con 0x560a4cf8a110 2024-03-16T21:02:43.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.904+0000 7f7957400640 1 -- 172.21.15.8:0/2963862959 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0b8fc0 con 0x560a4cf8a110 2024-03-16T21:02:43.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.904+0000 7f797486d740 1 -- 172.21.15.8:0/2963862959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8a110 msgr2=0x560a4cf92e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:43.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.904+0000 7f797486d740 1 --2- 172.21.15.8:0/2963862959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8a110 0x560a4cf92e00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f795c0bc8e0 tx=0x7f795c0ef040 comp rx=0 tx=0).stop 2024-03-16T21:02:43.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.904+0000 7f797486d740 1 -- 172.21.15.8:0/2963862959 shutdown_connections 2024-03-16T21:02:43.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.904+0000 7f797486d740 1 --2- 172.21.15.8:0/2963862959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf93610 0x560a4cf83720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.904+0000 7f797486d740 1 --2- 172.21.15.8:0/2963862959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf8aa30 0x560a4cf90f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.904+0000 7f797486d740 1 --2- 172.21.15.8:0/2963862959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8a110 0x560a4cf92e00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.904+0000 7f797486d740 1 -- 172.21.15.8:0/2963862959 >> 172.21.15.8:0/2963862959 conn(0x560a4cf84840 msgr2=0x560a4cf83010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.904+0000 7f797486d740 1 -- 172.21.15.8:0/2963862959 shutdown_connections 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.904+0000 7f797486d740 1 -- 172.21.15.8:0/2963862959 wait complete. 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.905+0000 7f797486d740 1 -- start start 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.905+0000 7f797486d740 1 Processor -- start 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.905+0000 7f797486d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cff8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.905+0000 7f797486d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 0x560a4cff8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.905+0000 7f797486d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf93610 0x560a4cf8d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.905+0000 7f797486d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4cf8da40 con 0x560a4cf93610 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.905+0000 7f797486d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4cf8dbb0 con 0x560a4cf8aa30 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.905+0000 7f797486d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a4cf8dd70 con 0x560a4cf8a110 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.905+0000 7f797486d740 10 client.0 _ll_register_callbacks cb 0x7f795c0f3580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cff8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cff8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56886/0 (socket says 172.21.15.8:56886) 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796aa00640 1 -- 172.21.15.8:0/69314296 learned_addr learned my addr 172.21.15.8:0/69314296 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796a000640 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 0x560a4cff8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796b400640 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf93610 0x560a4cf8d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796aa00640 1 -- 172.21.15.8:0/69314296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 msgr2=0x560a4cff8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796aa00640 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 0x560a4cff8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796aa00640 1 -- 172.21.15.8:0/69314296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf93610 msgr2=0x560a4cf8d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796aa00640 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf93610 0x560a4cf8d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796aa00640 1 -- 172.21.15.8:0/69314296 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c1aae00 con 0x560a4cf8a110 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796b400640 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf93610 0x560a4cf8d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796a000640 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 0x560a4cff8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f796aa00640 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cff8660 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f795c0c4bc0 tx=0x7f795c0f36b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d6c90100f458b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.906+0000 7f7954c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f7954c00640 1 -- 172.21.15.8:0/69314296 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0bd050 con 0x560a4cf8a110 2024-03-16T21:02:43.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f797486d740 1 -- 172.21.15.8:0/69314296 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7958005520 con 0x560a4cf8a110 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f7954c00640 1 -- 172.21.15.8:0/69314296 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f795c0c50f0 con 0x560a4cf8a110 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f7954c00640 1 -- 172.21.15.8:0/69314296 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f795c0b8fc0 con 0x560a4cf8a110 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f797486d740 10 client.26755 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f797486d740 1 -- 172.21.15.8:0/69314296 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560a4ceb16a0 con 0x560a4cf8a110 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f7954c00640 1 -- 172.21.15.8:0/69314296 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7958005520 con 0x560a4cf8a110 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f7954c00640 1 -- 172.21.15.8:0/69314296 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f795c03c070 con 0x560a4cf8a110 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f797486d740 10 client.26755 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f797486d740 10 client.26755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f797486d740 20 client.26755 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f797486d740 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560a4d000110 0x560a4d002530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f797486d740 4 client.26755 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.907+0000 7f797486d740 1 -- 172.21.15.8:0/69314296 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560a4cc2d7b0 con 0x560a4d000110 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.908+0000 7f796a000640 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560a4d000110 0x560a4d002530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:43.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.908+0000 7f796a000640 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560a4d000110 0x560a4d002530 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f00bd3c170e7382 server_cookie=d2013567d2b10ff7 in_seq=0 out_seq=0 2024-03-16T21:02:43.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.908+0000 7f7954c00640 10 client.26755 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.909+0000 7f7954c00640 1 -- 172.21.15.8:0/69314296 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560a4cc2d7b0 con 0x560a4d000110 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.909+0000 7f7954c00640 10 client.26755 handle_command_reply: tid=0 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.909+0000 7f797486d740 1 client.26755 shutdown 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f797486d740 1 -- 172.21.15.8:0/69314296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 msgr2=0x560a4cff8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f797486d740 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cff8660 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f795c0c4bc0 tx=0x7f795c0f36b0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f797486d740 1 -- 172.21.15.8:0/69314296 shutdown_connections 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f797486d740 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560a4d000110 0x560a4d002530 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f797486d740 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560a4cf93610 0x560a4cf8d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f797486d740 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560a4cf8aa30 0x560a4cff8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f797486d740 1 --2- 172.21.15.8:0/69314296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a4cf8a110 0x560a4cff8660 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f7954c00640 0 client.26755 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f797486d740 1 -- 172.21.15.8:0/69314296 >> 172.21.15.8:0/69314296 conn(0x560a4cf84840 msgr2=0x560a4cf838a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f797486d740 1 -- 172.21.15.8:0/69314296 shutdown_connections 2024-03-16T21:02:43.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f797486d740 1 -- 172.21.15.8:0/69314296 wait complete. 2024-03-16T21:02:43.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.910+0000 7f797486d740 20 client.26755 trim_cache size 0 max 16384 2024-03-16T21:02:43.920 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:02:43.920 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:02:43.920 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "e653d09a-95ec-4edc-821d-5402cb859a8c", 2024-03-16T21:02:43.920 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:02:43.920 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:02:43.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 -- 172.21.15.8:0/4172477917 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79500a1ba0 msgr2=0x7f79500a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:43.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79500a1ba0 0x7f79500a4060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7964012ad0 tx=0x7f7964009500 comp rx=0 tx=0).stop 2024-03-16T21:02:43.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 -- 172.21.15.8:0/4172477917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c107a30 msgr2=0x7f796c19e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:43.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c107a30 0x7f796c19e0b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f795c009230 tx=0x7f795c02cbe0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 -- 172.21.15.8:0/4172477917 shutdown_connections 2024-03-16T21:02:43.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f79500a1ba0 0x7f79500a4060 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f796c10d9d0 0x7f796c1a2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f796c1083d0 0x7f796c19e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 --2- 172.21.15.8:0/4172477917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c107a30 0x7f796c19e0b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:43.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 -- 172.21.15.8:0/4172477917 >> 172.21.15.8:0/4172477917 conn(0x7f796c077310 msgr2=0x7f796c078350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:43.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 -- 172.21.15.8:0/4172477917 shutdown_connections 2024-03-16T21:02:43.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:43.911+0000 7f796be00640 1 -- 172.21.15.8:0/4172477917 wait complete. 2024-03-16T21:02:43.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:02:43.935 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:02:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.146+0000 7f8172c00640 1 -- 172.21.15.8:0/3615226880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f816c103680 msgr2=0x7f816c103b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.146+0000 7f8172c00640 1 --2- 172.21.15.8:0/3615226880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f816c103680 0x7f816c103b00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8158009900 tx=0x7f815802bc40 comp rx=0 tx=0).stop 2024-03-16T21:02:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.146+0000 7f8172c00640 1 -- 172.21.15.8:0/3615226880 shutdown_connections 2024-03-16T21:02:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.146+0000 7f8172c00640 1 --2- 172.21.15.8:0/3615226880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f816c104040 0x7f816c110550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.146+0000 7f8172c00640 1 --2- 172.21.15.8:0/3615226880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f816c103680 0x7f816c103b00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.146+0000 7f8172c00640 1 --2- 172.21.15.8:0/3615226880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c109690 0x7f816c109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.146+0000 7f8172c00640 1 -- 172.21.15.8:0/3615226880 >> 172.21.15.8:0/3615226880 conn(0x7f816c0ff170 msgr2=0x7f816c101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.146+0000 7f8172c00640 1 -- 172.21.15.8:0/3615226880 shutdown_connections 2024-03-16T21:02:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.146+0000 7f8172c00640 1 -- 172.21.15.8:0/3615226880 wait complete. 2024-03-16T21:02:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.147+0000 7f8172c00640 1 Processor -- start 2024-03-16T21:02:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.147+0000 7f8172c00640 1 -- start start 2024-03-16T21:02:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.148+0000 7f8172c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c103680 0x7f816c199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.148+0000 7f8172c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f816c104040 0x7f816c19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.148+0000 7f8172c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f816c109690 0x7f816c19e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.148+0000 7f8172c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c19eca0 con 0x7f816c104040 2024-03-16T21:02:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.148+0000 7f8172c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c19ee10 con 0x7f816c109690 2024-03-16T21:02:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.148+0000 7f8172c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c19efd0 con 0x7f816c103680 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.148+0000 7f816be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c103680 0x7f816c199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.148+0000 7f8170c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f816c109690 0x7f816c19e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.148+0000 7f816be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c103680 0x7f816c199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56914/0 (socket says 172.21.15.8:56914) 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.148+0000 7f816b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f816c104040 0x7f816c19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.148+0000 7f816be00640 1 -- 172.21.15.8:0/3109821406 learned_addr learned my addr 172.21.15.8:0/3109821406 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.149+0000 7f816be00640 1 -- 172.21.15.8:0/3109821406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f816c109690 msgr2=0x7f816c19e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.149+0000 7f816be00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f816c109690 0x7f816c19e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.149+0000 7f816be00640 1 -- 172.21.15.8:0/3109821406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f816c104040 msgr2=0x7f816c19a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.149+0000 7f816be00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f816c104040 0x7f816c19a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.149+0000 7f816be00640 1 -- 172.21.15.8:0/3109821406 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8158009560 con 0x7f816c103680 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.149+0000 7f816be00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c103680 0x7f816c199de0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f815c00e9f0 tx=0x7f815c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.149+0000 7f8168c00640 1 -- 172.21.15.8:0/3109821406 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c009700 con 0x7f816c103680 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.149+0000 7f8168c00640 1 -- 172.21.15.8:0/3109821406 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f815c00cd80 con 0x7f816c103680 2024-03-16T21:02:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.149+0000 7f8168c00640 1 -- 172.21.15.8:0/3109821406 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0189c0 con 0x7f816c103680 2024-03-16T21:02:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.149+0000 7f8172c00640 1 -- 172.21.15.8:0/3109821406 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816c19f2b0 con 0x7f816c103680 2024-03-16T21:02:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.149+0000 7f8172c00640 1 -- 172.21.15.8:0/3109821406 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816c1a6b30 con 0x7f816c103680 2024-03-16T21:02:44.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.153+0000 7f8168c00640 1 -- 172.21.15.8:0/3109821406 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f815c018b20 con 0x7f816c103680 2024-03-16T21:02:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.153+0000 7f8175883740 1 Processor -- start 2024-03-16T21:02:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.153+0000 7f8175883740 1 -- start start 2024-03-16T21:02:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.153+0000 7f8175883740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 0x557034228cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.153+0000 7f8175883740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x557034229740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.153+0000 7f8175883740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034232630 0x557034234a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.153+0000 7f8175883740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557034198150 con 0x557034232630 2024-03-16T21:02:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.153+0000 7f8175883740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557034195680 con 0x5570342292c0 2024-03-16T21:02:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.153+0000 7f8175883740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557034190e60 con 0x557034229fa0 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.154+0000 7f816be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x557034229740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.154+0000 7f816be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x557034229740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46640/0 (socket says 172.21.15.8:46640) 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.154+0000 7f816be00640 1 -- 172.21.15.8:0/2363096706 learned_addr learned my addr 172.21.15.8:0/2363096706 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.154+0000 7f8170c00640 1 --2- 172.21.15.8:0/2363096706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 0x557034228cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.154+0000 7f816b400640 1 --2- 172.21.15.8:0/2363096706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034232630 0x557034234a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.154+0000 7f816be00640 1 -- 172.21.15.8:0/2363096706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 msgr2=0x557034228cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.154+0000 7f816be00640 1 --2- 172.21.15.8:0/2363096706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 0x557034228cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.154+0000 7f816be00640 1 -- 172.21.15.8:0/2363096706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034232630 msgr2=0x557034234a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.154+0000 7f816be00640 1 --2- 172.21.15.8:0/2363096706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034232630 0x557034234a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.154+0000 7f816be00640 1 -- 172.21.15.8:0/2363096706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55703414a060 con 0x5570342292c0 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.154+0000 7f8170c00640 1 --2- 172.21.15.8:0/2363096706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 0x557034228cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:02:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.155+0000 7f816be00640 1 --2- 172.21.15.8:0/2363096706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x557034229740 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f815c0cb0d0 tx=0x7f815c0d3ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72de0b2953e73491 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:44.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.155+0000 7f8161200640 1 -- 172.21.15.8:0/2363096706 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0d5e10 con 0x5570342292c0 2024-03-16T21:02:44.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.155+0000 7f8161200640 1 -- 172.21.15.8:0/2363096706 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f815c0d36d0 con 0x5570342292c0 2024-03-16T21:02:44.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.155+0000 7f8161200640 1 -- 172.21.15.8:0/2363096706 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0d8ac0 con 0x5570342292c0 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.155+0000 7f8168c00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81500a1c20 0x7f81500a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.156+0000 7f8175883740 1 -- 172.21.15.8:0/2363096706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 msgr2=0x557034229740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.156+0000 7f8175883740 1 --2- 172.21.15.8:0/2363096706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x557034229740 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f815c0cb0d0 tx=0x7f815c0d3ef0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.156+0000 7f8168c00640 1 -- 172.21.15.8:0/3109821406 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f815c014070 con 0x7f816c103680 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.156+0000 7f8170c00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81500a1c20 0x7f81500a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.156+0000 7f8175883740 1 -- 172.21.15.8:0/2363096706 shutdown_connections 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.156+0000 7f8175883740 1 --2- 172.21.15.8:0/2363096706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034232630 0x557034234a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.156+0000 7f8175883740 1 --2- 172.21.15.8:0/2363096706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x557034229740 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.156+0000 7f8175883740 1 --2- 172.21.15.8:0/2363096706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 0x557034228cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.156+0000 7f8175883740 1 -- 172.21.15.8:0/2363096706 >> 172.21.15.8:0/2363096706 conn(0x5570341f05a0 msgr2=0x557034223d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.156+0000 7f8175883740 1 -- 172.21.15.8:0/2363096706 shutdown_connections 2024-03-16T21:02:44.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.156+0000 7f8175883740 1 -- 172.21.15.8:0/2363096706 wait complete. 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.157+0000 7f8170c00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81500a1c20 0x7f81500a40e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8164009cf0 tx=0x7f8164009600 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.157+0000 7f8175883740 1 -- start start 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.157+0000 7f8175883740 1 Processor -- start 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.157+0000 7f8175883740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x55703422f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f8175883740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034229fa0 0x55703422fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f8175883740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034232630 0x557034230080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f8175883740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557034135ec0 con 0x557034229fa0 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f8175883740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557034135b60 con 0x5570342292c0 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f8175883740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557033eff1c0 con 0x557034232630 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f8175883740 10 client.0 _ll_register_callbacks cb 0x557034149960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f816be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x55703422f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f8170c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034232630 0x557034230080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f816be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x55703422f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46642/0 (socket says 172.21.15.8:46642) 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f816be00640 1 -- 172.21.15.8:0/2966791133 learned_addr learned my addr 172.21.15.8:0/2966791133 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:44.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f816b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034229fa0 0x55703422fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f816be00640 1 -- 172.21.15.8:0/2966791133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034232630 msgr2=0x557034230080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f816be00640 1 --2- 172.21.15.8:0/2966791133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034232630 0x557034230080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f816be00640 1 -- 172.21.15.8:0/2966791133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034229fa0 msgr2=0x55703422fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f816be00640 1 --2- 172.21.15.8:0/2966791133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034229fa0 0x55703422fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f816be00640 1 -- 172.21.15.8:0/2966791133 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816c1a6b30 con 0x5570342292c0 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.158+0000 7f816be00640 1 --2- 172.21.15.8:0/2966791133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x55703422f600 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f815c096b80 tx=0x7f815c0cdaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf2aeb8a38f2c6d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.159+0000 7f8155600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.159+0000 7f8155600640 1 -- 172.21.15.8:0/2966791133 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c083ea0 con 0x5570342292c0 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.159+0000 7f8155600640 1 -- 172.21.15.8:0/2966791133 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f815c09a720 con 0x5570342292c0 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.159+0000 7f8175883740 1 -- 172.21.15.8:0/2966791133 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557033ecd720 con 0x5570342292c0 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.159+0000 7f8155600640 1 -- 172.21.15.8:0/2966791133 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f815c0d8420 con 0x5570342292c0 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.159+0000 7f8175883740 10 client.26759 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.159+0000 7f8175883740 1 -- 172.21.15.8:0/2966791133 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55703418f4e0 con 0x5570342292c0 2024-03-16T21:02:44.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.159+0000 7f8155600640 1 -- 172.21.15.8:0/2966791133 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x557033ecd720 con 0x5570342292c0 2024-03-16T21:02:44.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.159+0000 7f8155600640 1 -- 172.21.15.8:0/2966791133 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f815c0ba110 con 0x5570342292c0 2024-03-16T21:02:44.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.160+0000 7f8175883740 10 client.26759 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:44.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.160+0000 7f8175883740 10 client.26759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:44.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.160+0000 7f8175883740 20 client.26759 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:44.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.160+0000 7f8175883740 1 --2- 172.21.15.8:0/2966791133 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570342422d0 0x5570342446c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.160+0000 7f8175883740 4 client.26759 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:02:44.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.160+0000 7f8175883740 1 -- 172.21.15.8:0/2966791133 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557033f1c890 con 0x5570342422d0 2024-03-16T21:02:44.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.160+0000 7f816b400640 1 --2- 172.21.15.8:0/2966791133 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570342422d0 0x5570342446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.160+0000 7f816b400640 1 --2- 172.21.15.8:0/2966791133 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570342422d0 0x5570342446c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a96831f149d1da9 server_cookie=4284c6c5ac19d06b in_seq=0 out_seq=0 2024-03-16T21:02:44.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.160+0000 7f8155600640 10 client.26759 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:44.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8155600640 1 -- 172.21.15.8:0/2966791133 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x557033f1c890 con 0x5570342422d0 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8155600640 10 client.26759 handle_command_reply: tid=0 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8175883740 1 client.26759 shutdown 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8175883740 1 -- 172.21.15.8:0/2966791133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 msgr2=0x55703422f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8175883740 1 --2- 172.21.15.8:0/2966791133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x55703422f600 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f815c096b80 tx=0x7f815c0cdaf0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8175883740 1 -- 172.21.15.8:0/2966791133 shutdown_connections 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8175883740 1 --2- 172.21.15.8:0/2966791133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034232630 0x557034230080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8175883740 1 --2- 172.21.15.8:0/2966791133 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5570342422d0 0x5570342446c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8175883740 1 --2- 172.21.15.8:0/2966791133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034229fa0 0x55703422fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8175883740 1 --2- 172.21.15.8:0/2966791133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570342292c0 0x55703422f600 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8175883740 1 -- 172.21.15.8:0/2966791133 >> 172.21.15.8:0/2966791133 conn(0x5570341f05a0 msgr2=0x557034225a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.161+0000 7f8155600640 0 client.26759 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.162+0000 7f8175883740 1 -- 172.21.15.8:0/2966791133 shutdown_connections 2024-03-16T21:02:44.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.162+0000 7f8175883740 1 -- 172.21.15.8:0/2966791133 wait complete. 2024-03-16T21:02:44.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.162+0000 7f8175883740 20 client.26759 trim_cache size 0 max 16384 2024-03-16T21:02:44.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f8175883740 1 Processor -- start 2024-03-16T21:02:44.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f8175883740 1 -- start start 2024-03-16T21:02:44.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f8175883740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570342292c0 0x557034231d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f8175883740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034229fa0 0x55703422e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f8175883740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 0x55703422fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f8175883740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557034235380 con 0x557034229fa0 2024-03-16T21:02:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f8175883740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557034235000 con 0x557034232630 2024-03-16T21:02:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f8175883740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557034224d10 con 0x5570342292c0 2024-03-16T21:02:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f8170c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 0x55703422fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f816be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570342292c0 0x557034231d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f816b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034229fa0 0x55703422e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f8170c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 0x55703422fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:46650/0 (socket says 172.21.15.8:46650) 2024-03-16T21:02:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.184+0000 7f8170c00640 1 -- 172.21.15.8:0/1388553105 learned_addr learned my addr 172.21.15.8:0/1388553105 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.185+0000 7f8170c00640 1 -- 172.21.15.8:0/1388553105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570342292c0 msgr2=0x557034231d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.185+0000 7f8170c00640 1 --2- 172.21.15.8:0/1388553105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570342292c0 0x557034231d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.185+0000 7f8170c00640 1 -- 172.21.15.8:0/1388553105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034229fa0 msgr2=0x55703422e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.185+0000 7f8170c00640 1 --2- 172.21.15.8:0/1388553105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034229fa0 0x55703422e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.185+0000 7f8170c00640 1 -- 172.21.15.8:0/1388553105 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55703412b950 con 0x557034232630 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.185+0000 7f8170c00640 1 --2- 172.21.15.8:0/1388553105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 0x55703422fea0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8164011830 tx=0x7f8164016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89f693420ea3b023 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.185+0000 7f8157e00640 1 -- 172.21.15.8:0/1388553105 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8164025070 con 0x557034232630 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.185+0000 7f8157e00640 1 -- 172.21.15.8:0/1388553105 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8164003e70 con 0x557034232630 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.185+0000 7f8157e00640 1 -- 172.21.15.8:0/1388553105 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816402a6d0 con 0x557034232630 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.186+0000 7f8175883740 1 -- 172.21.15.8:0/1388553105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 msgr2=0x55703422fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.186+0000 7f8175883740 1 --2- 172.21.15.8:0/1388553105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 0x55703422fea0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8164011830 tx=0x7f8164016000 comp rx=0 tx=0).stop 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.186+0000 7f8175883740 1 -- 172.21.15.8:0/1388553105 shutdown_connections 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.186+0000 7f8175883740 1 --2- 172.21.15.8:0/1388553105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 0x55703422fea0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.186+0000 7f8175883740 1 --2- 172.21.15.8:0/1388553105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557034229fa0 0x55703422e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.186+0000 7f8175883740 1 --2- 172.21.15.8:0/1388553105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570342292c0 0x557034231d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.186+0000 7f8175883740 1 -- 172.21.15.8:0/1388553105 >> 172.21.15.8:0/1388553105 conn(0x5570341f05a0 msgr2=0x5570342225a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.187+0000 7f8175883740 1 -- 172.21.15.8:0/1388553105 shutdown_connections 2024-03-16T21:02:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.187+0000 7f8175883740 1 -- 172.21.15.8:0/1388553105 wait complete. 2024-03-16T21:02:44.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.187+0000 7f8175883740 1 -- start start 2024-03-16T21:02:44.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.187+0000 7f8175883740 1 Processor -- start 2024-03-16T21:02:44.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f8175883740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570342292c0 0x55703423a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f8175883740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 0x5570342359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f8175883740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 0x557034236110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f8175883740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557034236810 con 0x5570342292c0 2024-03-16T21:02:44.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f8175883740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703429cb30 con 0x557034232630 2024-03-16T21:02:44.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f8175883740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703429cc70 con 0x557034229fa0 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f8175883740 10 client.0 _ll_register_callbacks cb 0x7f815c0d38e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f816b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 0x5570342359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f816b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 0x5570342359d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56948/0 (socket says 172.21.15.8:56948) 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f816b400640 1 -- 172.21.15.8:0/4196953937 learned_addr learned my addr 172.21.15.8:0/4196953937 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f816be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570342292c0 0x55703423a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f8170c00640 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 0x557034236110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f816b400640 1 -- 172.21.15.8:0/4196953937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 msgr2=0x557034236110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f816b400640 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 0x557034236110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f816b400640 1 -- 172.21.15.8:0/4196953937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570342292c0 msgr2=0x55703423a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f816b400640 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570342292c0 0x55703423a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.188+0000 7f816b400640 1 -- 172.21.15.8:0/4196953937 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8164019070 con 0x557034229fa0 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.189+0000 7f816b400640 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 0x5570342359d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f815802c860 tx=0x7f815802c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=565b9489537cab6d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.189+0000 7f8155600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:02:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.189+0000 7f8155600640 1 -- 172.21.15.8:0/4196953937 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158045040 con 0x557034229fa0 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.189+0000 7f8155600640 1 -- 172.21.15.8:0/4196953937 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8158004450 con 0x557034229fa0 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.189+0000 7f8175883740 1 -- 172.21.15.8:0/4196953937 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557033e907e0 con 0x557034229fa0 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.189+0000 7f8155600640 1 -- 172.21.15.8:0/4196953937 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8158049300 con 0x557034229fa0 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.189+0000 7f8175883740 10 client.26773 fetch_fsmap learned FSMap version 31 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.189+0000 7f8175883740 1 -- 172.21.15.8:0/4196953937 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x557034151430 con 0x557034229fa0 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.190+0000 7f8155600640 1 -- 172.21.15.8:0/4196953937 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x557033e907e0 con 0x557034229fa0 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.190+0000 7f8155600640 1 -- 172.21.15.8:0/4196953937 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 31) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f815804f020 con 0x557034229fa0 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.190+0000 7f8175883740 10 client.26773 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.190+0000 7f8175883740 10 client.26773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.190+0000 7f8175883740 20 client.26773 populate_metadata read hostname 'smithi008' 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.190+0000 7f8175883740 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55703429e4b0 0x5570342a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.190+0000 7f8175883740 4 client.26773 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.190+0000 7f8175883740 1 -- 172.21.15.8:0/4196953937 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557033e3c700 con 0x55703429e4b0 2024-03-16T21:02:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.190+0000 7f816be00640 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55703429e4b0 0x5570342a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:02:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f816be00640 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55703429e4b0 0x5570342a08d0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=229a581ffbb6800b server_cookie=b2fa11d3b36b2669 in_seq=0 out_seq=0 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8155600640 10 client.26773 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8155600640 1 -- 172.21.15.8:0/4196953937 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557033e3c700 con 0x55703429e4b0 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8155600640 10 client.26773 handle_command_reply: tid=0 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8175883740 1 client.26773 shutdown 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8175883740 1 -- 172.21.15.8:0/4196953937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 msgr2=0x5570342359d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8175883740 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 0x5570342359d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f815802c860 tx=0x7f815802c3f0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8175883740 1 -- 172.21.15.8:0/4196953937 shutdown_connections 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8175883740 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557034232630 0x557034236110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8175883740 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557034229fa0 0x5570342359d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8175883740 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55703429e4b0 0x5570342a08d0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8175883740 1 --2- 172.21.15.8:0/4196953937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5570342292c0 0x55703423a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8175883740 1 -- 172.21.15.8:0/4196953937 >> 172.21.15.8:0/4196953937 conn(0x5570341f05a0 msgr2=0x557034222e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.191+0000 7f8155600640 0 client.26773 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.192+0000 7f8175883740 1 -- 172.21.15.8:0/4196953937 shutdown_connections 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.192+0000 7f8175883740 1 -- 172.21.15.8:0/4196953937 wait complete. 2024-03-16T21:02:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.192+0000 7f8175883740 20 client.26773 trim_cache size 0 max 16384 2024-03-16T21:02:44.201 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:02:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:02:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:02:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: "e653d09a-95ec-4edc-821d-5402cb859a8c": { 2024-03-16T21:02:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:02:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "e653d09a-95ec-4edc-821d-5402cb859a8c", 2024-03-16T21:02:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:02:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:02:44.201 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:02:44.201 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:02:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 -- 172.21.15.8:0/3109821406 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81500a1c20 msgr2=0x7f81500a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81500a1c20 0x7f81500a40e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8164009cf0 tx=0x7f8164009600 comp rx=0 tx=0).stop 2024-03-16T21:02:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 -- 172.21.15.8:0/3109821406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c103680 msgr2=0x7f816c199de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:02:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c103680 0x7f816c199de0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f815c00e9f0 tx=0x7f815c00eeb0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 -- 172.21.15.8:0/3109821406 shutdown_connections 2024-03-16T21:02:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81500a1c20 0x7f81500a40e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f816c109690 0x7f816c19e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f816c104040 0x7f816c19a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 --2- 172.21.15.8:0/3109821406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c103680 0x7f816c199de0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:02:44.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 -- 172.21.15.8:0/3109821406 >> 172.21.15.8:0/3109821406 conn(0x7f816c0ff170 msgr2=0x7f816c0ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:02:44.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 -- 172.21.15.8:0/3109821406 shutdown_connections 2024-03-16T21:02:44.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:02:44.193+0000 7f8172c00640 1 -- 172.21.15.8:0/3109821406 wait complete. 2024-03-16T21:02:44.219 INFO:tasks.cephfs.filesystem:scrub status for tag:e653d09a-95ec-4edc-821d-5402cb859a8c - {'path': '/', 'tag': 'e653d09a-95ec-4edc-821d-5402cb859a8c', 'options': 'recursive,force'} 2024-03-16T21:02:44.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:44 smithi170 ceph-mon[35947]: pgmap v150: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:44.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:44 smithi186 ceph-mon[36391]: pgmap v150: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:44.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:44 smithi008 ceph-mon[31434]: pgmap v150: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:02:45.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:45 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:02:45.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:45 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:45.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:45 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:02:45.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:45 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:45.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:45 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:02:45.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:45 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:45.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:45 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:02:45.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:45 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:45.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:45 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:02:45.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:45 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:45.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:45 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:02:45.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:45 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:02:46.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:46 smithi170 ceph-mon[35947]: pgmap v151: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:02:46.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:46 smithi186 ceph-mon[36391]: pgmap v151: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:02:46.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:46 smithi008 ceph-mon[31434]: pgmap v151: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:02:48.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:48 smithi170 ceph-mon[35947]: pgmap v152: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:02:48.869 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:48 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:02:48.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:48 smithi186 ceph-mon[36391]: pgmap v152: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:02:48.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:48 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:02:48.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:48 smithi008 ceph-mon[31434]: pgmap v152: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:02:48.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:48 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:02:50.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:50 smithi170 ceph-mon[35947]: pgmap v153: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:50.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:50 smithi186 ceph-mon[36391]: pgmap v153: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:50.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:50 smithi008 ceph-mon[31434]: pgmap v153: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:52.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:52 smithi186 ceph-mon[36391]: pgmap v154: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:02:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:52 smithi008 ceph-mon[31434]: pgmap v154: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:02:53.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:52 smithi170 ceph-mon[35947]: pgmap v154: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:02:54.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:54 smithi186 ceph-mon[36391]: pgmap v155: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:54.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:54 smithi008 ceph-mon[31434]: pgmap v155: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:54 smithi170 ceph-mon[35947]: pgmap v155: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:02:56.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:56 smithi186 ceph-mon[36391]: pgmap v156: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:02:56.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:56 smithi008 ceph-mon[31434]: pgmap v156: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:02:57.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:56 smithi170 ceph-mon[35947]: pgmap v156: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:02:58.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:02:58 smithi186 ceph-mon[36391]: pgmap v157: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-16T21:02:58.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:02:58 smithi008 ceph-mon[31434]: pgmap v157: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-16T21:02:59.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:02:58 smithi170 ceph-mon[35947]: pgmap v157: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-16T21:03:00.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:00 smithi008 ceph-mon[31434]: pgmap v158: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:00 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:01.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:00 smithi170 ceph-mon[35947]: pgmap v158: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:01.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:00 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:01.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:00 smithi186 ceph-mon[36391]: pgmap v158: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:01.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:00 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:02.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:02 smithi008 ceph-mon[31434]: pgmap v159: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:03.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:02 smithi170 ceph-mon[35947]: pgmap v159: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:03.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:02 smithi186 ceph-mon[36391]: pgmap v159: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:03 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:04.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:03 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:04.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:03 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:04 smithi008 ceph-mon[31434]: pgmap v160: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:05.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:04 smithi170 ceph-mon[35947]: pgmap v160: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:04 smithi186 ceph-mon[36391]: pgmap v160: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:05.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:05 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:03:06.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:05 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:03:06.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:05 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:03:06.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:06 smithi008 ceph-mon[31434]: pgmap v161: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-03-16T21:03:06.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:06 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:03:06.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:06 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:03:06.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:06 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:03:07.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:06 smithi170 ceph-mon[35947]: pgmap v161: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-03-16T21:03:07.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:06 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:03:07.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:06 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:03:07.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:06 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:03:07.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:06 smithi186 ceph-mon[36391]: pgmap v161: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-03-16T21:03:07.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:06 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:03:07.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:06 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:03:07.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:06 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:03:08.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:08 smithi008 ceph-mon[31434]: pgmap v162: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:03:09.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:08 smithi170 ceph-mon[35947]: pgmap v162: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:03:09.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:08 smithi186 ceph-mon[36391]: pgmap v162: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:03:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:10 smithi008 ceph-mon[31434]: pgmap v163: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:03:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:10 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:11.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:10 smithi170 ceph-mon[35947]: pgmap v163: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:03:11.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:10 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:11.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:10 smithi186 ceph-mon[36391]: pgmap v163: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:03:11.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:10 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:12 smithi008 ceph-mon[31434]: pgmap v164: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:03:13.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:12 smithi170 ceph-mon[35947]: pgmap v164: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:03:13.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:12 smithi186 ceph-mon[36391]: pgmap v164: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:03:14.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:03:14.220 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:03:14.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.452+0000 7efd89000640 1 -- 172.21.15.8:0/3674532216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84103690 msgr2=0x7efd84103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.452+0000 7efd89000640 1 --2- 172.21.15.8:0/3674532216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84103690 0x7efd84103b10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009930 tx=0x7efd6c02bc30 comp rx=0 tx=0).stop 2024-03-16T21:03:14.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.452+0000 7efd89000640 1 -- 172.21.15.8:0/3674532216 shutdown_connections 2024-03-16T21:03:14.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.452+0000 7efd89000640 1 --2- 172.21.15.8:0/3674532216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd84104050 0x7efd84110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.452+0000 7efd89000640 1 --2- 172.21.15.8:0/3674532216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84103690 0x7efd84103b10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.452+0000 7efd89000640 1 --2- 172.21.15.8:0/3674532216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd841096a0 0x7efd84109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.452+0000 7efd89000640 1 -- 172.21.15.8:0/3674532216 >> 172.21.15.8:0/3674532216 conn(0x7efd840ff140 msgr2=0x7efd84101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:14.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.453+0000 7efd89000640 1 -- 172.21.15.8:0/3674532216 shutdown_connections 2024-03-16T21:03:14.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.453+0000 7efd89000640 1 -- 172.21.15.8:0/3674532216 wait complete. 2024-03-16T21:03:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.453+0000 7efd89000640 1 Processor -- start 2024-03-16T21:03:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd89000640 1 -- start start 2024-03-16T21:03:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd89000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd84103690 0x7efd84199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd89000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84104050 0x7efd8419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd89000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd841096a0 0x7efd8419e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd89000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8419ed20 con 0x7efd84103690 2024-03-16T21:03:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd89000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8419ee90 con 0x7efd841096a0 2024-03-16T21:03:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd89000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8419f050 con 0x7efd84104050 2024-03-16T21:03:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd82800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd841096a0 0x7efd8419e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd81e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd84103690 0x7efd84199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd79400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84104050 0x7efd8419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd82800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd841096a0 0x7efd8419e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45178/0 (socket says 172.21.15.8:45178) 2024-03-16T21:03:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.454+0000 7efd82800640 1 -- 172.21.15.8:0/4073828613 learned_addr learned my addr 172.21.15.8:0/4073828613 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.455+0000 7efd82800640 1 -- 172.21.15.8:0/4073828613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84104050 msgr2=0x7efd8419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.455+0000 7efd82800640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84104050 0x7efd8419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.455+0000 7efd82800640 1 -- 172.21.15.8:0/4073828613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd84103690 msgr2=0x7efd84199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.455+0000 7efd82800640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd84103690 0x7efd84199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.455+0000 7efd82800640 1 -- 172.21.15.8:0/4073828613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c009560 con 0x7efd841096a0 2024-03-16T21:03:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.455+0000 7efd82800640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd841096a0 0x7efd8419e720 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00e970 tx=0x7efd7c00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.455+0000 7efd7b400640 1 -- 172.21.15.8:0/4073828613 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c009720 con 0x7efd841096a0 2024-03-16T21:03:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.455+0000 7efd7b400640 1 -- 172.21.15.8:0/4073828613 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7efd7c005520 con 0x7efd841096a0 2024-03-16T21:03:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.455+0000 7efd89000640 1 -- 172.21.15.8:0/4073828613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8419f330 con 0x7efd841096a0 2024-03-16T21:03:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.455+0000 7efd7b400640 1 -- 172.21.15.8:0/4073828613 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c010470 con 0x7efd841096a0 2024-03-16T21:03:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.456+0000 7efd89000640 1 -- 172.21.15.8:0/4073828613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd841a6bb0 con 0x7efd841096a0 2024-03-16T21:03:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.458+0000 7efd7b400640 1 -- 172.21.15.8:0/4073828613 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7efd7c005020 con 0x7efd841096a0 2024-03-16T21:03:14.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.459+0000 7efd8bd91740 1 Processor -- start 2024-03-16T21:03:14.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.459+0000 7efd8bd91740 1 -- start start 2024-03-16T21:03:14.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.459+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efa5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.459+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efa6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.459+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efb1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.459+0000 7efd8bd91740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ef15150 con 0x558a8efaf630 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.459+0000 7efd8bd91740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ef12680 con 0x558a8efa62c0 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.459+0000 7efd8bd91740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ef0de60 con 0x558a8efa6fa0 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd81e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efa6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd81e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efa6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45188/0 (socket says 172.21.15.8:45188) 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd79400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efa5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd81e00640 1 -- 172.21.15.8:0/1613266228 learned_addr learned my addr 172.21.15.8:0/1613266228 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd7b400640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efd680a1ba0 0x7efd680a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd79400640 1 --2- 172.21.15.8:0/1613266228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efb1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd7b400640 1 -- 172.21.15.8:0/4073828613 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7efd7c014070 con 0x7efd841096a0 2024-03-16T21:03:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd81e00640 1 -- 172.21.15.8:0/1613266228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 msgr2=0x558a8efa5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd81e00640 1 --2- 172.21.15.8:0/1613266228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efa5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd81e00640 1 -- 172.21.15.8:0/1613266228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 msgr2=0x558a8efb1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd81e00640 1 --2- 172.21.15.8:0/1613266228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efb1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd81e00640 1 -- 172.21.15.8:0/1613266228 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a8eec7060 con 0x558a8efa62c0 2024-03-16T21:03:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd79400640 1 --2- 172.21.15.8:0/1613266228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efa5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd82800640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efd680a1ba0 0x7efd680a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.460+0000 7efd81e00640 1 --2- 172.21.15.8:0/1613266228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efa6740 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efd740103d0 tx=0x7efd74010890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49f78e4e0f625f04 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.461+0000 7efd73400640 1 -- 172.21.15.8:0/1613266228 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74003b70 con 0x558a8efa62c0 2024-03-16T21:03:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.461+0000 7efd73400640 1 -- 172.21.15.8:0/1613266228 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7efd74003cd0 con 0x558a8efa62c0 2024-03-16T21:03:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.461+0000 7efd73400640 1 -- 172.21.15.8:0/1613266228 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74011ae0 con 0x558a8efa62c0 2024-03-16T21:03:14.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.461+0000 7efd8bd91740 1 -- 172.21.15.8:0/1613266228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 msgr2=0x558a8efa6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.461+0000 7efd8bd91740 1 --2- 172.21.15.8:0/1613266228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efa6740 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efd740103d0 tx=0x7efd74010890 comp rx=0 tx=0).stop 2024-03-16T21:03:14.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.461+0000 7efd82800640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efd680a1ba0 0x7efd680a4060 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efd7c097210 tx=0x7efd7c005690 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:14.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.461+0000 7efd8bd91740 1 -- 172.21.15.8:0/1613266228 shutdown_connections 2024-03-16T21:03:14.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.461+0000 7efd8bd91740 1 --2- 172.21.15.8:0/1613266228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efb1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.461+0000 7efd8bd91740 1 --2- 172.21.15.8:0/1613266228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efa6740 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.461+0000 7efd8bd91740 1 --2- 172.21.15.8:0/1613266228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efa5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.461+0000 7efd8bd91740 1 -- 172.21.15.8:0/1613266228 >> 172.21.15.8:0/1613266228 conn(0x558a8ef6d5a0 msgr2=0x558a8efa0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:14.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.462+0000 7efd8bd91740 1 -- 172.21.15.8:0/1613266228 shutdown_connections 2024-03-16T21:03:14.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.462+0000 7efd8bd91740 1 -- 172.21.15.8:0/1613266228 wait complete. 2024-03-16T21:03:14.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.462+0000 7efd8bd91740 1 -- start start 2024-03-16T21:03:14.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.462+0000 7efd8bd91740 1 Processor -- start 2024-03-16T21:03:14.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa62c0 0x558a8efac610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa6fa0 0x558a8efacb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd8bd91740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8eeb2ec0 con 0x558a8efaf630 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd8bd91740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8eeb2b60 con 0x558a8efa6fa0 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd8bd91740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ec7c1c0 con 0x558a8efa62c0 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd8bd91740 10 client.0 _ll_register_callbacks cb 0x558a8eec6960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd79400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa62c0 0x558a8efac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd79400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa62c0 0x558a8efac610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52972/0 (socket says 172.21.15.8:52972) 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd79400640 1 -- 172.21.15.8:0/3384298157 learned_addr learned my addr 172.21.15.8:0/3384298157 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd81e00640 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa6fa0 0x558a8efacb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd79400640 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd79400640 1 -- 172.21.15.8:0/3384298157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa6fa0 msgr2=0x558a8efacb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd79400640 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa6fa0 0x558a8efacb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd79400640 1 -- 172.21.15.8:0/3384298157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 msgr2=0x558a8efad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd79400640 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.463+0000 7efd79400640 1 -- 172.21.15.8:0/3384298157 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd74009c30 con 0x558a8efa62c0 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.464+0000 7efd79400640 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa62c0 0x558a8efac610 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efd6c02c240 tx=0x7efd6c02bc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e28e3afec5510397 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.464+0000 7efd67e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.464+0000 7efd67e00640 1 -- 172.21.15.8:0/3384298157 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c02cd60 con 0x558a8efa62c0 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.464+0000 7efd67e00640 1 -- 172.21.15.8:0/3384298157 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7efd6c004260 con 0x558a8efa62c0 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.464+0000 7efd8bd91740 1 -- 172.21.15.8:0/3384298157 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a8ec0d7e0 con 0x558a8efa62c0 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.464+0000 7efd67e00640 1 -- 172.21.15.8:0/3384298157 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd6c004420 con 0x558a8efa62c0 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.464+0000 7efd8bd91740 10 client.26785 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.464+0000 7efd8bd91740 1 -- 172.21.15.8:0/3384298157 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x558a8ef0c4e0 con 0x558a8efa62c0 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.464+0000 7efd67e00640 1 -- 172.21.15.8:0/3384298157 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x558a8ec0d7e0 con 0x558a8efa62c0 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.465+0000 7efd67e00640 1 -- 172.21.15.8:0/3384298157 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7efd6c005170 con 0x558a8efa62c0 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.465+0000 7efd8bd91740 10 client.26785 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.465+0000 7efd8bd91740 10 client.26785 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.465+0000 7efd8bd91740 20 client.26785 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.465+0000 7efd8bd91740 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558a8efbf750 0x558a8efc1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.465+0000 7efd8bd91740 4 client.26785 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:14.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.465+0000 7efd8bd91740 1 -- 172.21.15.8:0/3384298157 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a8ec4a720 con 0x558a8efbf750 2024-03-16T21:03:14.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.465+0000 7efd81e00640 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558a8efbf750 0x558a8efc1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.466+0000 7efd81e00640 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558a8efbf750 0x558a8efc1b70 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b766b1a39098cd13 server_cookie=923eca3e67a6d31f in_seq=0 out_seq=0 2024-03-16T21:03:14.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.466+0000 7efd67e00640 10 client.26785 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:14.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.466+0000 7efd67e00640 1 -- 172.21.15.8:0/3384298157 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x558a8ec4a720 con 0x558a8efbf750 2024-03-16T21:03:14.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.466+0000 7efd67e00640 10 client.26785 handle_command_reply: tid=0 2024-03-16T21:03:14.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.466+0000 7efd8bd91740 1 client.26785 shutdown 2024-03-16T21:03:14.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd8bd91740 1 -- 172.21.15.8:0/3384298157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa62c0 msgr2=0x558a8efac610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd8bd91740 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa62c0 0x558a8efac610 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efd6c02c240 tx=0x7efd6c02bc30 comp rx=0 tx=0).stop 2024-03-16T21:03:14.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd8bd91740 1 -- 172.21.15.8:0/3384298157 shutdown_connections 2024-03-16T21:03:14.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd8bd91740 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558a8efbf750 0x558a8efc1b70 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd8bd91740 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd67e00640 0 client.26785 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:14.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd8bd91740 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa6fa0 0x558a8efacb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd8bd91740 1 --2- 172.21.15.8:0/3384298157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa62c0 0x558a8efac610 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd8bd91740 1 -- 172.21.15.8:0/3384298157 >> 172.21.15.8:0/3384298157 conn(0x558a8ef6d5a0 msgr2=0x558a8efa2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:14.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd8bd91740 1 -- 172.21.15.8:0/3384298157 shutdown_connections 2024-03-16T21:03:14.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd8bd91740 1 -- 172.21.15.8:0/3384298157 wait complete. 2024-03-16T21:03:14.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.467+0000 7efd8bd91740 20 client.26785 trim_cache size 0 max 16384 2024-03-16T21:03:14.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.485+0000 7efd8bd91740 1 Processor -- start 2024-03-16T21:03:14.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.485+0000 7efd8bd91740 1 -- start start 2024-03-16T21:03:14.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.485+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efaed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.485+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efaceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.485+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efa27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.485+0000 7efd8bd91740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8efb23b0 con 0x558a8efaf630 2024-03-16T21:03:14.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.485+0000 7efd8bd91740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8efbf550 con 0x558a8efa62c0 2024-03-16T21:03:14.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.485+0000 7efd8bd91740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8efa6c00 con 0x558a8efa6fa0 2024-03-16T21:03:14.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.485+0000 7efd81e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efaceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd81e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efaceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52982/0 (socket says 172.21.15.8:52982) 2024-03-16T21:03:14.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd81e00640 1 -- 172.21.15.8:0/599576512 learned_addr learned my addr 172.21.15.8:0/599576512 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:14.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd79400640 1 --2- 172.21.15.8:0/599576512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efaed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd79400640 1 --2- 172.21.15.8:0/599576512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efa27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd81e00640 1 -- 172.21.15.8:0/599576512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 msgr2=0x558a8efaed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd81e00640 1 --2- 172.21.15.8:0/599576512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efaed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd81e00640 1 -- 172.21.15.8:0/599576512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 msgr2=0x558a8efa27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd81e00640 1 --2- 172.21.15.8:0/599576512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efa27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd81e00640 1 -- 172.21.15.8:0/599576512 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a8eea8950 con 0x558a8efa6fa0 2024-03-16T21:03:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd79400640 1 --2- 172.21.15.8:0/599576512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efaed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd81e00640 1 --2- 172.21.15.8:0/599576512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efaceb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efd74000f80 tx=0x7efd74013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8079d3157a3d1265 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.486+0000 7efd72a00640 1 -- 172.21.15.8:0/599576512 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74021040 con 0x558a8efa6fa0 2024-03-16T21:03:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.487+0000 7efd72a00640 1 -- 172.21.15.8:0/599576512 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7efd74022040 con 0x558a8efa6fa0 2024-03-16T21:03:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.487+0000 7efd72a00640 1 -- 172.21.15.8:0/599576512 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7402a9d0 con 0x558a8efa6fa0 2024-03-16T21:03:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.487+0000 7efd8bd91740 1 -- 172.21.15.8:0/599576512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 msgr2=0x558a8efaceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.487+0000 7efd8bd91740 1 --2- 172.21.15.8:0/599576512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efaceb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efd74000f80 tx=0x7efd74013040 comp rx=0 tx=0).stop 2024-03-16T21:03:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.487+0000 7efd8bd91740 1 -- 172.21.15.8:0/599576512 shutdown_connections 2024-03-16T21:03:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.487+0000 7efd8bd91740 1 --2- 172.21.15.8:0/599576512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efa27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.487+0000 7efd8bd91740 1 --2- 172.21.15.8:0/599576512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efaceb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.487+0000 7efd8bd91740 1 --2- 172.21.15.8:0/599576512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efaed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.487+0000 7efd8bd91740 1 -- 172.21.15.8:0/599576512 >> 172.21.15.8:0/599576512 conn(0x558a8ef6d5a0 msgr2=0x558a8efa20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.487+0000 7efd8bd91740 1 -- 172.21.15.8:0/599576512 shutdown_connections 2024-03-16T21:03:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.487+0000 7efd8bd91740 1 -- 172.21.15.8:0/599576512 wait complete. 2024-03-16T21:03:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.488+0000 7efd8bd91740 1 -- start start 2024-03-16T21:03:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.488+0000 7efd8bd91740 1 Processor -- start 2024-03-16T21:03:14.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.488+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efaa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.488+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efb0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.488+0000 7efd8bd91740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efb0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.488+0000 7efd8bd91740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8efb1180 con 0x558a8efaf630 2024-03-16T21:03:14.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.488+0000 7efd8bd91740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8efb12f0 con 0x558a8efa62c0 2024-03-16T21:03:14.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.488+0000 7efd8bd91740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8efb14b0 con 0x558a8efa6fa0 2024-03-16T21:03:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.488+0000 7efd8bd91740 10 client.0 _ll_register_callbacks cb 0x7efd6c02c9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd81e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efb0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd79400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efaa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd81e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efb0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52988/0 (socket says 172.21.15.8:52988) 2024-03-16T21:03:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd81e00640 1 -- 172.21.15.8:0/4287885495 learned_addr learned my addr 172.21.15.8:0/4287885495 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd79400640 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efb0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd81e00640 1 -- 172.21.15.8:0/4287885495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 msgr2=0x558a8efaa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd81e00640 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efaa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd81e00640 1 -- 172.21.15.8:0/4287885495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 msgr2=0x558a8efb0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd81e00640 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efb0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd81e00640 1 -- 172.21.15.8:0/4287885495 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a8eec7060 con 0x558a8efa6fa0 2024-03-16T21:03:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd81e00640 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efb0700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efd74010f40 tx=0x7efd74009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19a44f9efe3dbcea server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.489+0000 7efd67e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:03:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.490+0000 7efd67e00640 1 -- 172.21.15.8:0/4287885495 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74021030 con 0x558a8efa6fa0 2024-03-16T21:03:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.490+0000 7efd8bd91740 1 -- 172.21.15.8:0/4287885495 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd74003cd0 con 0x558a8efa6fa0 2024-03-16T21:03:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.490+0000 7efd67e00640 1 -- 172.21.15.8:0/4287885495 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7efd7402a2e0 con 0x558a8efa6fa0 2024-03-16T21:03:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.490+0000 7efd67e00640 1 -- 172.21.15.8:0/4287885495 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd74011920 con 0x558a8efa6fa0 2024-03-16T21:03:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.490+0000 7efd8bd91740 10 client.26791 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.490+0000 7efd8bd91740 1 -- 172.21.15.8:0/4287885495 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x558a8eece430 con 0x558a8efa6fa0 2024-03-16T21:03:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.490+0000 7efd67e00640 1 -- 172.21.15.8:0/4287885495 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7efd74003cd0 con 0x558a8efa6fa0 2024-03-16T21:03:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.490+0000 7efd67e00640 1 -- 172.21.15.8:0/4287885495 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7efd74031070 con 0x558a8efa6fa0 2024-03-16T21:03:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.490+0000 7efd8bd91740 10 client.26791 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.490+0000 7efd8bd91740 10 client.26791 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.490+0000 7efd8bd91740 20 client.26791 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.491+0000 7efd8bd91740 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558a8efbf750 0x558a8f01e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.491+0000 7efd8bd91740 4 client.26791 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:03:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.491+0000 7efd8bd91740 1 -- 172.21.15.8:0/4287885495 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558a8ec99890 con 0x558a8efbf750 2024-03-16T21:03:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.491+0000 7efd79400640 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558a8efbf750 0x558a8f01e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.491+0000 7efd79400640 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558a8efbf750 0x558a8f01e130 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4b7db7b327818b4 server_cookie=eaccbcdea3d836cc in_seq=0 out_seq=0 2024-03-16T21:03:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.491+0000 7efd67e00640 10 client.26791 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.491+0000 7efd67e00640 1 -- 172.21.15.8:0/4287885495 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558a8ec99890 con 0x558a8efbf750 2024-03-16T21:03:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.491+0000 7efd67e00640 10 client.26791 handle_command_reply: tid=0 2024-03-16T21:03:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.491+0000 7efd8bd91740 1 client.26791 shutdown 2024-03-16T21:03:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd8bd91740 1 -- 172.21.15.8:0/4287885495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 msgr2=0x558a8efb0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd8bd91740 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efb0700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efd74010f40 tx=0x7efd74009b20 comp rx=0 tx=0).stop 2024-03-16T21:03:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd8bd91740 1 -- 172.21.15.8:0/4287885495 shutdown_connections 2024-03-16T21:03:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd8bd91740 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x558a8efbf750 0x558a8f01e130 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd8bd91740 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558a8efaf630 0x558a8efb0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd8bd91740 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558a8efa6fa0 0x558a8efb0700 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd8bd91740 1 --2- 172.21.15.8:0/4287885495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a8efa62c0 0x558a8efaa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd67e00640 0 client.26791 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd8bd91740 1 -- 172.21.15.8:0/4287885495 >> 172.21.15.8:0/4287885495 conn(0x558a8ef6d5a0 msgr2=0x558a8efa2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd8bd91740 1 -- 172.21.15.8:0/4287885495 shutdown_connections 2024-03-16T21:03:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd8bd91740 1 -- 172.21.15.8:0/4287885495 wait complete. 2024-03-16T21:03:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.492+0000 7efd8bd91740 20 client.26791 trim_cache size 0 max 16384 2024-03-16T21:03:14.512 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:03:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:03:14.512 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:03:14.513 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:03:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 -- 172.21.15.8:0/4073828613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efd680a1ba0 msgr2=0x7efd680a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efd680a1ba0 0x7efd680a4060 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efd7c097210 tx=0x7efd7c005690 comp rx=0 tx=0).stop 2024-03-16T21:03:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 -- 172.21.15.8:0/4073828613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd841096a0 msgr2=0x7efd8419e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd841096a0 0x7efd8419e720 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00e970 tx=0x7efd7c00ed70 comp rx=0 tx=0).stop 2024-03-16T21:03:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 -- 172.21.15.8:0/4073828613 shutdown_connections 2024-03-16T21:03:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efd680a1ba0 0x7efd680a4060 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd841096a0 0x7efd8419e720 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84104050 0x7efd8419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 --2- 172.21.15.8:0/4073828613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd84103690 0x7efd84199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 -- 172.21.15.8:0/4073828613 >> 172.21.15.8:0/4073828613 conn(0x7efd840ff140 msgr2=0x7efd840ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 -- 172.21.15.8:0/4073828613 shutdown_connections 2024-03-16T21:03:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.493+0000 7efd89000640 1 -- 172.21.15.8:0/4073828613 wait complete. 2024-03-16T21:03:14.518 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:03:14.518 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:03:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.737+0000 7f40ec600640 1 -- 172.21.15.8:0/3658880342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40e4104040 msgr2=0x7f40e4110550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.737+0000 7f40ec600640 1 --2- 172.21.15.8:0/3658880342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40e4104040 0x7f40e4110550 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009cd0 tx=0x7f40dc02c0e0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.738+0000 7f40ec600640 1 -- 172.21.15.8:0/3658880342 shutdown_connections 2024-03-16T21:03:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.738+0000 7f40ec600640 1 --2- 172.21.15.8:0/3658880342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40e4104040 0x7f40e4110550 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.738+0000 7f40ec600640 1 --2- 172.21.15.8:0/3658880342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40e4103680 0x7f40e4103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.738+0000 7f40ec600640 1 --2- 172.21.15.8:0/3658880342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4109690 0x7f40e4109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.738+0000 7f40ec600640 1 -- 172.21.15.8:0/3658880342 >> 172.21.15.8:0/3658880342 conn(0x7f40e40ff150 msgr2=0x7f40e4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:14.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.738+0000 7f40ec600640 1 -- 172.21.15.8:0/3658880342 shutdown_connections 2024-03-16T21:03:14.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.738+0000 7f40ec600640 1 -- 172.21.15.8:0/3658880342 wait complete. 2024-03-16T21:03:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.739+0000 7f40ec600640 1 Processor -- start 2024-03-16T21:03:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.739+0000 7f40ec600640 1 -- start start 2024-03-16T21:03:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.739+0000 7f40ec600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4103680 0x7f40e4199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.739+0000 7f40ec600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40e4104040 0x7f40e419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.739+0000 7f40ec600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40e4109690 0x7f40e419e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.739+0000 7f40ec600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e419ec60 con 0x7f40e4103680 2024-03-16T21:03:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.739+0000 7f40ec600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e419edd0 con 0x7f40e4104040 2024-03-16T21:03:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.739+0000 7f40ec600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e419ef90 con 0x7f40e4109690 2024-03-16T21:03:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40e9c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4103680 0x7f40e4199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40e9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40e4104040 0x7f40e419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40ea600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40e4109690 0x7f40e419e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40e9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40e4104040 0x7f40e419a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45216/0 (socket says 172.21.15.8:45216) 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40e9200640 1 -- 172.21.15.8:0/3436614246 learned_addr learned my addr 172.21.15.8:0/3436614246 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40e9200640 1 -- 172.21.15.8:0/3436614246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40e4109690 msgr2=0x7f40e419e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40e9200640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40e4109690 0x7f40e419e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40e9200640 1 -- 172.21.15.8:0/3436614246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4103680 msgr2=0x7f40e4199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40e9200640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4103680 0x7f40e4199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40e9200640 1 -- 172.21.15.8:0/3436614246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d4009490 con 0x7f40e4104040 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40e9200640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40e4104040 0x7f40e419a2e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e9f0 tx=0x7f40d000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.740+0000 7f40e2000640 1 -- 172.21.15.8:0/3436614246 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0009720 con 0x7f40e4104040 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.741+0000 7f40e2000640 1 -- 172.21.15.8:0/3436614246 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f40d000cd80 con 0x7f40e4104040 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.741+0000 7f40e2000640 1 -- 172.21.15.8:0/3436614246 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0010690 con 0x7f40e4104040 2024-03-16T21:03:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.741+0000 7f40ec600640 1 -- 172.21.15.8:0/3436614246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc009900 con 0x7f40e4104040 2024-03-16T21:03:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.741+0000 7f40ec600640 1 -- 172.21.15.8:0/3436614246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e41a6910 con 0x7f40e4104040 2024-03-16T21:03:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.742+0000 7f40ec600640 1 -- 172.21.15.8:0/3436614246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e4068730 con 0x7f40e4104040 2024-03-16T21:03:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.744+0000 7f40e2000640 1 -- 172.21.15.8:0/3436614246 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f40d00046c0 con 0x7f40e4104040 2024-03-16T21:03:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.745+0000 7f40e2000640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40c80a1c20 0x7f40c80a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.746+0000 7f40e2000640 1 -- 172.21.15.8:0/3436614246 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f40d0014070 con 0x7f40e4104040 2024-03-16T21:03:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.746+0000 7f40e9c00640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40c80a1c20 0x7f40c80a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.746+0000 7f40e9c00640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40c80a1c20 0x7f40c80a40e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009ce0 tx=0x7f40d4005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.750+0000 7f40e2000640 1 -- 172.21.15.8:0/3436614246 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f40d00969b0 con 0x7f40e4104040 2024-03-16T21:03:14.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:14 smithi008 ceph-mon[31434]: pgmap v165: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:03:14.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.992+0000 7f40ec600640 1 -- 172.21.15.8:0/3436614246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40e4113970 con 0x7f40e4104040 2024-03-16T21:03:14.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.993+0000 7f40e2000640 1 -- 172.21.15.8:0/3436614246 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11390 (secure 0 0 0) 0x7f40d009a070 con 0x7f40e4104040 2024-03-16T21:03:14.998 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:03:14.999 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:08.788743+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:03:14.999 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 34 2024-03-16T21:03:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 -- 172.21.15.8:0/3436614246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40c80a1c20 msgr2=0x7f40c80a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40c80a1c20 0x7f40c80a40e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009ce0 tx=0x7f40d4005f90 comp rx=0 tx=0).stop 2024-03-16T21:03:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 -- 172.21.15.8:0/3436614246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40e4104040 msgr2=0x7f40e419a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40e4104040 0x7f40e419a2e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e9f0 tx=0x7f40d000edf0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 -- 172.21.15.8:0/3436614246 shutdown_connections 2024-03-16T21:03:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f40c80a1c20 0x7f40c80a40e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40e4109690 0x7f40e419e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40e4104040 0x7f40e419a2e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 --2- 172.21.15.8:0/3436614246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4103680 0x7f40e4199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 -- 172.21.15.8:0/3436614246 >> 172.21.15.8:0/3436614246 conn(0x7f40e40ff150 msgr2=0x7f40e40ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 -- 172.21.15.8:0/3436614246 shutdown_connections 2024-03-16T21:03:15.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:14.996+0000 7f40ec600640 1 -- 172.21.15.8:0/3436614246 wait complete. 2024-03-16T21:03:15.022 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:03:15.022 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:03:15.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:14 smithi170 ceph-mon[35947]: pgmap v165: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:03:15.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:14 smithi186 ceph-mon[36391]: pgmap v165: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:03:15.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.243+0000 7fb4e3200640 1 -- 172.21.15.8:0/946652379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e4075a20 msgr2=0x7fb4e4075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.243+0000 7fb4e3200640 1 --2- 172.21.15.8:0/946652379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e4075a20 0x7fb4e4075e00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009cd0 tx=0x7fb4d402c0e0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.243+0000 7fb4e3200640 1 -- 172.21.15.8:0/946652379 shutdown_connections 2024-03-16T21:03:15.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.243+0000 7fb4e3200640 1 --2- 172.21.15.8:0/946652379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4e4112210 0x7fb4e4114600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.243+0000 7fb4e3200640 1 --2- 172.21.15.8:0/946652379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4e4076340 0x7fb4e4111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.243+0000 7fb4e3200640 1 --2- 172.21.15.8:0/946652379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e4075a20 0x7fb4e4075e00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.243+0000 7fb4e3200640 1 -- 172.21.15.8:0/946652379 >> 172.21.15.8:0/946652379 conn(0x7fb4e40ff000 msgr2=0x7fb4e4101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.243+0000 7fb4e3200640 1 -- 172.21.15.8:0/946652379 shutdown_connections 2024-03-16T21:03:15.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.243+0000 7fb4e3200640 1 -- 172.21.15.8:0/946652379 wait complete. 2024-03-16T21:03:15.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.244+0000 7fb4e3200640 1 Processor -- start 2024-03-16T21:03:15.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.244+0000 7fb4e3200640 1 -- start start 2024-03-16T21:03:15.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.244+0000 7fb4e3200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4e4075a20 0x7fb4e419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.244+0000 7fb4e3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4e4076340 0x7fb4e419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.244+0000 7fb4e3200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e4112210 0x7fb4e41a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.244+0000 7fb4e3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41a2fb0 con 0x7fb4e4076340 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.244+0000 7fb4e3200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41a3120 con 0x7fb4e4075a20 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.244+0000 7fb4e3200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41a32e0 con 0x7fb4e4112210 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4e1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4e4075a20 0x7fb4e419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4d9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4e4076340 0x7fb4e419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4e2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e4112210 0x7fb4e41a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4e1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4e4075a20 0x7fb4e419e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45228/0 (socket says 172.21.15.8:45228) 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4e1e00640 1 -- 172.21.15.8:0/3284213666 learned_addr learned my addr 172.21.15.8:0/3284213666 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4e1e00640 1 -- 172.21.15.8:0/3284213666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e4112210 msgr2=0x7fb4e41a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4e1e00640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e4112210 0x7fb4e41a29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4e1e00640 1 -- 172.21.15.8:0/3284213666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4e4076340 msgr2=0x7fb4e419e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4e1e00640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4e4076340 0x7fb4e419e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4e1e00640 1 -- 172.21.15.8:0/3284213666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d4009900 con 0x7fb4e4075a20 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4e2800640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e4112210 0x7fb4e41a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:15.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4d9400640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4e4076340 0x7fb4e419e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:15.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.245+0000 7fb4e1e00640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4e4075a20 0x7fb4e419e0f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4004af0 tx=0x7fb4d4034670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.246+0000 7fb4db400640 1 -- 172.21.15.8:0/3284213666 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4032bc0 con 0x7fb4e4075a20 2024-03-16T21:03:15.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.246+0000 7fb4db400640 1 -- 172.21.15.8:0/3284213666 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb4d4003e70 con 0x7fb4e4075a20 2024-03-16T21:03:15.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.246+0000 7fb4e3200640 1 -- 172.21.15.8:0/3284213666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e41a3560 con 0x7fb4e4075a20 2024-03-16T21:03:15.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.246+0000 7fb4db400640 1 -- 172.21.15.8:0/3284213666 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40048a0 con 0x7fb4e4075a20 2024-03-16T21:03:15.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.246+0000 7fb4e3200640 1 -- 172.21.15.8:0/3284213666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e41a3830 con 0x7fb4e4075a20 2024-03-16T21:03:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.249+0000 7fb4ebe0d740 1 Processor -- start 2024-03-16T21:03:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.249+0000 7fb4ebe0d740 1 -- start start 2024-03-16T21:03:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.249+0000 7fb4db400640 1 -- 172.21.15.8:0/3284213666 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fb4d400a040 con 0x7fb4e4075a20 2024-03-16T21:03:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 0x55cdcc99e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99e710 0x55cdcc9a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc90c210 con 0x55cdcc9a72f0 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc909740 con 0x55cdcc99ddf0 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc904f20 con 0x55cdcc99e710 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4e2800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 0x55cdcc99e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4e2800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 0x55cdcc99e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45242/0 (socket says 172.21.15.8:45242) 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4e2800640 1 -- 172.21.15.8:0/766806299 learned_addr learned my addr 172.21.15.8:0/766806299 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4e1e00640 1 --2- 172.21.15.8:0/766806299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99e710 0x55cdcc9a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4d9400640 1 --2- 172.21.15.8:0/766806299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4e2800640 1 -- 172.21.15.8:0/766806299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99e710 msgr2=0x55cdcc9a6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4e2800640 1 --2- 172.21.15.8:0/766806299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99e710 0x55cdcc9a6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4e2800640 1 -- 172.21.15.8:0/766806299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 msgr2=0x55cdcc9a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4e2800640 1 --2- 172.21.15.8:0/766806299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4e2800640 1 -- 172.21.15.8:0/766806299 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdcc8c6df0 con 0x55cdcc99ddf0 2024-03-16T21:03:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.250+0000 7fb4d9400640 1 --2- 172.21.15.8:0/766806299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:15.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.251+0000 7fb4e2800640 1 --2- 172.21.15.8:0/766806299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 0x55cdcc99e1d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00bf90 tx=0x7fb4dc010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=add901914c8aa813 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.251+0000 7fb4d3400640 1 -- 172.21.15.8:0/766806299 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc011700 con 0x55cdcc99ddf0 2024-03-16T21:03:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.251+0000 7fb4d3400640 1 -- 172.21.15.8:0/766806299 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb4dc015070 con 0x55cdcc99ddf0 2024-03-16T21:03:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.251+0000 7fb4d3400640 1 -- 172.21.15.8:0/766806299 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc01cdb0 con 0x55cdcc99ddf0 2024-03-16T21:03:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.251+0000 7fb4db400640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb4c80a1ba0 0x7fb4c80a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.251+0000 7fb4db400640 1 -- 172.21.15.8:0/3284213666 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb4d40f00d0 con 0x7fb4e4075a20 2024-03-16T21:03:15.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.251+0000 7fb4e1e00640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb4c80a1ba0 0x7fb4c80a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.251+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/766806299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 msgr2=0x55cdcc99e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.251+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/766806299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 0x55cdcc99e1d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00bf90 tx=0x7fb4dc010860 comp rx=0 tx=0).stop 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.252+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/766806299 shutdown_connections 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.252+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/766806299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.252+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/766806299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99e710 0x55cdcc9a6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.252+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/766806299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 0x55cdcc99e1d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.252+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/766806299 >> 172.21.15.8:0/766806299 conn(0x55cdcc998520 msgr2=0x55cdcc998900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.252+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/766806299 shutdown_connections 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.252+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/766806299 wait complete. 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.252+0000 7fb4e1e00640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb4c80a1ba0 0x7fb4c80a4060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55cdcc99d8c0 tx=0x7fb4d40f3b40 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.252+0000 7fb4ebe0d740 1 -- start start 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4ebe0d740 1 Processor -- start 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 0x55cdcc9a4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc8aa150 con 0x55cdcc99e710 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc8a9df0 con 0x55cdcc99ddf0 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc6731c0 con 0x55cdcc9a72f0 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4ebe0d740 10 client.0 _ll_register_callbacks cb 0x55cdcc8f92b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4d9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 0x55cdcc9a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4e2800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4d9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 0x55cdcc9a4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57828/0 (socket says 172.21.15.8:57828) 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.253+0000 7fb4d9400640 1 -- 172.21.15.8:0/704028321 learned_addr learned my addr 172.21.15.8:0/704028321 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.254+0000 7fb4e2800640 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.254+0000 7fb4d9400640 1 -- 172.21.15.8:0/704028321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc9a72f0 msgr2=0x55cdcc9a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.254+0000 7fb4d9400640 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.254+0000 7fb4d9400640 1 -- 172.21.15.8:0/704028321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 msgr2=0x55cdcc9a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.254+0000 7fb4d9400640 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.254+0000 7fb4d9400640 1 -- 172.21.15.8:0/704028321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4dc00bbc0 con 0x55cdcc99e710 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.254+0000 7fb4e2800640 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.254+0000 7fb4d9400640 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 0x55cdcc9a4930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc012a10 tx=0x7fb4cc012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a717b5faeefcc424 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.254+0000 7fb4c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.254+0000 7fb4c7e00640 1 -- 172.21.15.8:0/704028321 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc017070 con 0x55cdcc99e710 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.255+0000 7fb4c7e00640 1 -- 172.21.15.8:0/704028321 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb4cc00fac0 con 0x55cdcc99e710 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.255+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/704028321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cdcc6047e0 con 0x55cdcc99e710 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.255+0000 7fb4c7e00640 1 -- 172.21.15.8:0/704028321 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4cc00fc80 con 0x55cdcc99e710 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.255+0000 7fb4ebe0d740 10 client.16620 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.255+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/704028321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55cdcc9035a0 con 0x55cdcc99e710 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.255+0000 7fb4c7e00640 1 -- 172.21.15.8:0/704028321 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55cdcc6047e0 con 0x55cdcc99e710 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.255+0000 7fb4c7e00640 1 -- 172.21.15.8:0/704028321 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fb4cc004c10 con 0x55cdcc99e710 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.256+0000 7fb4ebe0d740 10 client.16620 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.256+0000 7fb4ebe0d740 10 client.16620 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.256+0000 7fb4ebe0d740 20 client.16620 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.256+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55cdcc9b7440 0x55cdcc9b9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.256+0000 7fb4ebe0d740 4 client.16620 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.256+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/704028321 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cdcc641720 con 0x55cdcc9b7440 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.256+0000 7fb4e2800640 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55cdcc9b7440 0x55cdcc9b9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.256+0000 7fb4e2800640 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55cdcc9b7440 0x55cdcc9b9860 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=267453752455a990 server_cookie=5f93dd424af8655c in_seq=0 out_seq=0 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.256+0000 7fb4c7e00640 10 client.16620 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.257+0000 7fb4c7e00640 1 -- 172.21.15.8:0/704028321 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55cdcc641720 con 0x55cdcc9b7440 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.257+0000 7fb4c7e00640 10 client.16620 handle_command_reply: tid=0 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.257+0000 7fb4ebe0d740 1 client.16620 shutdown 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/704028321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 msgr2=0x55cdcc9a4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 0x55cdcc9a4930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc012a10 tx=0x7fb4cc012ed0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/704028321 shutdown_connections 2024-03-16T21:03:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55cdcc9b7440 0x55cdcc9b9860 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 0x55cdcc9a4930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4c7e00640 0 client.16620 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:03:15.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/704028321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/704028321 >> 172.21.15.8:0/704028321 conn(0x55cdcc998520 msgr2=0x55cdcc99a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/704028321 shutdown_connections 2024-03-16T21:03:15.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/704028321 wait complete. 2024-03-16T21:03:15.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.258+0000 7fb4ebe0d740 20 client.16620 trim_cache size 0 max 16384 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.272+0000 7fb4ebe0d740 1 Processor -- start 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.272+0000 7fb4ebe0d740 1 -- start start 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.272+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.272+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 0x55cdcc997540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.272+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.272+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc993df0 con 0x55cdcc99e710 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.272+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc9b3f50 con 0x55cdcc9a72f0 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.272+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc9a41e0 con 0x55cdcc99ddf0 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.273+0000 7fb4e2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.273+0000 7fb4d9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 0x55cdcc997540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.273+0000 7fb4e2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53050/0 (socket says 172.21.15.8:53050) 2024-03-16T21:03:15.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.273+0000 7fb4e2800640 1 -- 172.21.15.8:0/3795849266 learned_addr learned my addr 172.21.15.8:0/3795849266 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.273+0000 7fb4e2800640 1 --2- 172.21.15.8:0/3795849266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.273+0000 7fb4e2800640 1 -- 172.21.15.8:0/3795849266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc9a72f0 msgr2=0x55cdcc9b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.273+0000 7fb4e2800640 1 --2- 172.21.15.8:0/3795849266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.273+0000 7fb4e2800640 1 -- 172.21.15.8:0/3795849266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 msgr2=0x55cdcc997540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.273+0000 7fb4e2800640 1 --2- 172.21.15.8:0/3795849266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 0x55cdcc997540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.273+0000 7fb4e2800640 1 -- 172.21.15.8:0/3795849266 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdcc89fab0 con 0x55cdcc99ddf0 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.273+0000 7fb4e2800640 1 --2- 172.21.15.8:0/3795849266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9a6b20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc01c960 tx=0x7fb4dc013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7782efd60c9598b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4d2a00640 1 -- 172.21.15.8:0/3795849266 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc01ca80 con 0x55cdcc99ddf0 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4d2a00640 1 -- 172.21.15.8:0/3795849266 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb4dc0055e0 con 0x55cdcc99ddf0 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4d2a00640 1 -- 172.21.15.8:0/3795849266 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc02de20 con 0x55cdcc99ddf0 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/3795849266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 msgr2=0x55cdcc9a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/3795849266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9a6b20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc01c960 tx=0x7fb4dc013040 comp rx=0 tx=0).stop 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/3795849266 shutdown_connections 2024-03-16T21:03:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/3795849266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/3795849266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc99e710 0x55cdcc997540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/3795849266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9a6b20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/3795849266 >> 172.21.15.8:0/3795849266 conn(0x55cdcc998520 msgr2=0x55cdcc996e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/3795849266 shutdown_connections 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.274+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/3795849266 wait complete. 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.275+0000 7fb4ebe0d740 1 -- start start 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.275+0000 7fb4ebe0d740 1 Processor -- start 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.275+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99e710 0x55cdcc9a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4ebe0d740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc9a2020 con 0x55cdcc9a72f0 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc9a2190 con 0x55cdcc99e710 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4ebe0d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdcc9a2300 con 0x55cdcc99ddf0 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4ebe0d740 10 client.0 _ll_register_callbacks cb 0x7fb4cc009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4d9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99e710 0x55cdcc9a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4e2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4d9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99e710 0x55cdcc9a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45274/0 (socket says 172.21.15.8:45274) 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4d9400640 1 -- 172.21.15.8:0/275951096 learned_addr learned my addr 172.21.15.8:0/275951096 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4e2800640 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4d9400640 1 -- 172.21.15.8:0/275951096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 msgr2=0x55cdcc9aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4d9400640 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4d9400640 1 -- 172.21.15.8:0/275951096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 msgr2=0x55cdcc9a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4d9400640 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4d9400640 1 -- 172.21.15.8:0/275951096 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4dc023040 con 0x55cdcc99e710 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4e2800640 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4d9400640 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99e710 0x55cdcc9a15a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55cdcc9a59c0 tx=0x7fb4cc009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd220a541723091f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.276+0000 7fb4c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.277+0000 7fb4c7e00640 1 -- 172.21.15.8:0/275951096 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc017070 con 0x55cdcc99e710 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.277+0000 7fb4c7e00640 1 -- 172.21.15.8:0/275951096 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb4cc000e40 con 0x55cdcc99e710 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.277+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/275951096 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4dc015070 con 0x55cdcc99e710 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.277+0000 7fb4c7e00640 1 -- 172.21.15.8:0/275951096 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4cc012590 con 0x55cdcc99e710 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.277+0000 7fb4ebe0d740 10 client.26807 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.277+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/275951096 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55cdcc8c5650 con 0x55cdcc99e710 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.277+0000 7fb4c7e00640 1 -- 172.21.15.8:0/275951096 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb4dc015070 con 0x55cdcc99e710 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.278+0000 7fb4c7e00640 1 -- 172.21.15.8:0/275951096 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fb4cc01c9e0 con 0x55cdcc99e710 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.278+0000 7fb4ebe0d740 10 client.26807 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.278+0000 7fb4ebe0d740 10 client.26807 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.278+0000 7fb4ebe0d740 20 client.26807 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.278+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55cdcca14280 0x55cdcca166a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.278+0000 7fb4ebe0d740 4 client.26807 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.278+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/275951096 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cdcc690890 con 0x55cdcca14280 2024-03-16T21:03:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.278+0000 7fb4e2800640 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55cdcca14280 0x55cdcca166a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.278+0000 7fb4e2800640 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55cdcca14280 0x55cdcca166a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=380864e07e0cc72b server_cookie=130217b790be16c in_seq=0 out_seq=0 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.278+0000 7fb4c7e00640 10 client.26807 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4c7e00640 1 -- 172.21.15.8:0/275951096 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cdcc690890 con 0x55cdcca14280 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4c7e00640 10 client.26807 handle_command_reply: tid=0 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 1 client.26807 shutdown 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/275951096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99e710 msgr2=0x55cdcc9a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99e710 0x55cdcc9a15a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55cdcc9a59c0 tx=0x7fb4cc009240 comp rx=0 tx=0).stop 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/275951096 shutdown_connections 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55cdcca14280 0x55cdcca166a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cdcc9a72f0 0x55cdcc9a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cdcc99e710 0x55cdcc9a15a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4c7e00640 0 client.26807 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:03:15.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 1 --2- 172.21.15.8:0/275951096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cdcc99ddf0 0x55cdcc9aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/275951096 >> 172.21.15.8:0/275951096 conn(0x55cdcc998520 msgr2=0x55cdcc9976c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/275951096 shutdown_connections 2024-03-16T21:03:15.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 1 -- 172.21.15.8:0/275951096 wait complete. 2024-03-16T21:03:15.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.279+0000 7fb4ebe0d740 20 client.26807 trim_cache size 0 max 16384 2024-03-16T21:03:15.290 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:03:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 -- 172.21.15.8:0/3284213666 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb4c80a1ba0 msgr2=0x7fb4c80a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb4c80a1ba0 0x7fb4c80a4060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55cdcc99d8c0 tx=0x7fb4d40f3b40 comp rx=0 tx=0).stop 2024-03-16T21:03:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 -- 172.21.15.8:0/3284213666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4e4075a20 msgr2=0x7fb4e419e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4e4075a20 0x7fb4e419e0f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4004af0 tx=0x7fb4d4034670 comp rx=0 tx=0).stop 2024-03-16T21:03:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 -- 172.21.15.8:0/3284213666 shutdown_connections 2024-03-16T21:03:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb4c80a1ba0 0x7fb4c80a4060 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e4112210 0x7fb4e41a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4e4076340 0x7fb4e419e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 --2- 172.21.15.8:0/3284213666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4e4075a20 0x7fb4e419e0f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 -- 172.21.15.8:0/3284213666 >> 172.21.15.8:0/3284213666 conn(0x7fb4e40ff000 msgr2=0x7fb4e4113820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 -- 172.21.15.8:0/3284213666 shutdown_connections 2024-03-16T21:03:15.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.280+0000 7fb4e3200640 1 -- 172.21.15.8:0/3284213666 wait complete. 2024-03-16T21:03:15.305 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:03:15.305 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:03:15.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.527+0000 7f4fbc200640 1 -- 172.21.15.8:0/3975680895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fb4075a20 msgr2=0x7f4fb4075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.527+0000 7f4fbc200640 1 --2- 172.21.15.8:0/3975680895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fb4075a20 0x7f4fb4075e00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009930 tx=0x7f4fa802bc30 comp rx=0 tx=0).stop 2024-03-16T21:03:15.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.527+0000 7f4fbc200640 1 -- 172.21.15.8:0/3975680895 shutdown_connections 2024-03-16T21:03:15.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.527+0000 7f4fbc200640 1 --2- 172.21.15.8:0/3975680895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb4112330 0x7f4fb4114720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.527+0000 7f4fbc200640 1 --2- 172.21.15.8:0/3975680895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb4076340 0x7f4fb4111df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.527+0000 7f4fbc200640 1 --2- 172.21.15.8:0/3975680895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fb4075a20 0x7f4fb4075e00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.527+0000 7f4fbc200640 1 -- 172.21.15.8:0/3975680895 >> 172.21.15.8:0/3975680895 conn(0x7f4fb40ff160 msgr2=0x7f4fb4101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.527+0000 7f4fbc200640 1 -- 172.21.15.8:0/3975680895 shutdown_connections 2024-03-16T21:03:15.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.527+0000 7f4fbc200640 1 -- 172.21.15.8:0/3975680895 wait complete. 2024-03-16T21:03:15.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.528+0000 7f4fbc200640 1 Processor -- start 2024-03-16T21:03:15.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fbc200640 1 -- start start 2024-03-16T21:03:15.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fbc200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb4075a20 0x7f4fb419e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fbc200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fb4076340 0x7f4fb419e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fbc200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb4112330 0x7f4fb41a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fbc200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb41a30f0 con 0x7f4fb4112330 2024-03-16T21:03:15.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fbc200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb41a3260 con 0x7f4fb4075a20 2024-03-16T21:03:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fbc200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb41a3420 con 0x7f4fb4076340 2024-03-16T21:03:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb4075a20 0x7f4fb419e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fba200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb4112330 0x7f4fb41a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fb8e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fb4076340 0x7f4fb419e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb4075a20 0x7f4fb419e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45296/0 (socket says 172.21.15.8:45296) 2024-03-16T21:03:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.529+0000 7f4fb9800640 1 -- 172.21.15.8:0/739372400 learned_addr learned my addr 172.21.15.8:0/739372400 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fb8e00640 1 -- 172.21.15.8:0/739372400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb4075a20 msgr2=0x7f4fb419e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fb8e00640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb4075a20 0x7f4fb419e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fb8e00640 1 -- 172.21.15.8:0/739372400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb4112330 msgr2=0x7f4fb41a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fb8e00640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb4112330 0x7f4fb41a2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fb8e00640 1 -- 172.21.15.8:0/739372400 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa8009560 con 0x7f4fb4076340 2024-03-16T21:03:15.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fba200640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb4112330 0x7f4fb41a2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:15.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fb8e00640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fb4076340 0x7f4fb419e7c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000e9f0 tx=0x7f4fa000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fb2000640 1 -- 172.21.15.8:0/739372400 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000ccc0 con 0x7f4fb4076340 2024-03-16T21:03:15.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fb2000640 1 -- 172.21.15.8:0/739372400 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4fa000ce20 con 0x7f4fb4076340 2024-03-16T21:03:15.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fb2000640 1 -- 172.21.15.8:0/739372400 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00189c0 con 0x7f4fb4076340 2024-03-16T21:03:15.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fbc200640 1 -- 172.21.15.8:0/739372400 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb41a3700 con 0x7f4fb4076340 2024-03-16T21:03:15.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.530+0000 7f4fbc200640 1 -- 172.21.15.8:0/739372400 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb41aaf80 con 0x7f4fb4076340 2024-03-16T21:03:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.534+0000 7f4fbee42740 1 Processor -- start 2024-03-16T21:03:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.534+0000 7f4fbee42740 1 -- start start 2024-03-16T21:03:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.534+0000 7f4fb2000640 1 -- 172.21.15.8:0/739372400 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f4fa0018b20 con 0x7f4fb4076340 2024-03-16T21:03:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.534+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40270c40 0x563d40271020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.534+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40271560 0x563d40279c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.534+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d4027a140 0x563d4027c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.534+0000 7f4fbee42740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d401df210 con 0x563d40270c40 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.534+0000 7f4fbee42740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d401dc740 con 0x563d4027a140 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.534+0000 7f4fbee42740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d401d7f20 con 0x563d40271560 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40271560 0x563d40279c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fba200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40270c40 0x563d40271020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40271560 0x563d40279c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53086/0 (socket says 172.21.15.8:53086) 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fb9800640 1 -- 172.21.15.8:0/2316079870 learned_addr learned my addr 172.21.15.8:0/2316079870 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fba200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40270c40 0x563d40271020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57866/0 (socket says 172.21.15.8:57866) 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fb8e00640 1 --2- 172.21.15.8:0/2316079870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d4027a140 0x563d4027c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fb9800640 1 -- 172.21.15.8:0/2316079870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d4027a140 msgr2=0x563d4027c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fb9800640 1 --2- 172.21.15.8:0/2316079870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d4027a140 0x563d4027c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fb9800640 1 -- 172.21.15.8:0/2316079870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40270c40 msgr2=0x563d40271020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fb9800640 1 --2- 172.21.15.8:0/2316079870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40270c40 0x563d40271020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fb9800640 1 -- 172.21.15.8:0/2316079870 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d40199df0 con 0x563d40271560 2024-03-16T21:03:15.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.535+0000 7f4fb9800640 1 --2- 172.21.15.8:0/2316079870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40271560 0x563d40279c00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4fa802c170 tx=0x7f4fa802c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=275e91cf45f3be84 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.536+0000 7f4fa6a00640 1 -- 172.21.15.8:0/2316079870 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8004800 con 0x563d40271560 2024-03-16T21:03:15.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.536+0000 7f4fa6a00640 1 -- 172.21.15.8:0/2316079870 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4fa8004960 con 0x563d40271560 2024-03-16T21:03:15.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.536+0000 7f4fa6a00640 1 -- 172.21.15.8:0/2316079870 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8005180 con 0x563d40271560 2024-03-16T21:03:15.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.536+0000 7f4fb2000640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f4f9c0a1ba0 0x7f4f9c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.536+0000 7f4fb2000640 1 -- 172.21.15.8:0/739372400 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4fa0014070 con 0x7f4fb4076340 2024-03-16T21:03:15.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.536+0000 7f4fba200640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f4f9c0a1ba0 0x7f4f9c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.536+0000 7f4fbee42740 1 -- 172.21.15.8:0/2316079870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40271560 msgr2=0x563d40279c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.536+0000 7f4fbee42740 1 --2- 172.21.15.8:0/2316079870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40271560 0x563d40279c00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4fa802c170 tx=0x7f4fa802c730 comp rx=0 tx=0).stop 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.537+0000 7f4fbee42740 1 -- 172.21.15.8:0/2316079870 shutdown_connections 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.537+0000 7f4fbee42740 1 --2- 172.21.15.8:0/2316079870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d4027a140 0x563d4027c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.537+0000 7f4fbee42740 1 --2- 172.21.15.8:0/2316079870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40271560 0x563d40279c00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.537+0000 7f4fbee42740 1 --2- 172.21.15.8:0/2316079870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40270c40 0x563d40271020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.537+0000 7f4fbee42740 1 -- 172.21.15.8:0/2316079870 >> 172.21.15.8:0/2316079870 conn(0x563d4026b370 msgr2=0x563d4026b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.537+0000 7f4fbee42740 1 -- 172.21.15.8:0/2316079870 shutdown_connections 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.537+0000 7f4fbee42740 1 -- 172.21.15.8:0/2316079870 wait complete. 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.537+0000 7f4fba200640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f4f9c0a1ba0 0x7f4f9c0a4060 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4fb406a9a0 tx=0x7f4fac0096a0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.537+0000 7f4fbee42740 1 -- start start 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fbee42740 1 Processor -- start 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40270c40 0x563d402771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40271560 0x563d40277720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4027a140 0x563d40277c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fbee42740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4017d150 con 0x563d40271560 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fbee42740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4017cdf0 con 0x563d40270c40 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fbee42740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d3ff461c0 con 0x563d4027a140 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fbee42740 10 client.0 _ll_register_callbacks cb 0x563d401cc2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fb8e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40271560 0x563d40277720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40270c40 0x563d402771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fb8e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40271560 0x563d40277720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57878/0 (socket says 172.21.15.8:57878) 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fb8e00640 1 -- 172.21.15.8:0/239537676 learned_addr learned my addr 172.21.15.8:0/239537676 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.538+0000 7f4fba200640 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4027a140 0x563d40277c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.539+0000 7f4fb9800640 1 -- 172.21.15.8:0/239537676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4027a140 msgr2=0x563d40277c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.539+0000 7f4fb9800640 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4027a140 0x563d40277c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.539+0000 7f4fb9800640 1 -- 172.21.15.8:0/239537676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40271560 msgr2=0x563d40277720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.539+0000 7f4fb9800640 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40271560 0x563d40277720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.539+0000 7f4fb9800640 1 -- 172.21.15.8:0/239537676 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb41151b0 con 0x563d40270c40 2024-03-16T21:03:15.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.539+0000 7f4fb8e00640 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40271560 0x563d40277720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:15.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.539+0000 7f4fb9800640 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40270c40 0x563d402771e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005ab0 tx=0x7f4fa8005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d8bd61b58fdbf79 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.539+0000 7f4f9b400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:15.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.539+0000 7f4f9b400640 1 -- 172.21.15.8:0/239537676 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8004800 con 0x563d40270c40 2024-03-16T21:03:15.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.539+0000 7f4f9b400640 1 -- 172.21.15.8:0/239537676 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4fa8005290 con 0x563d40270c40 2024-03-16T21:03:15.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.540+0000 7f4fbee42740 1 -- 172.21.15.8:0/239537676 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d3fed77e0 con 0x563d40270c40 2024-03-16T21:03:15.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.540+0000 7f4f9b400640 1 -- 172.21.15.8:0/239537676 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fa8004310 con 0x563d40270c40 2024-03-16T21:03:15.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.540+0000 7f4fbee42740 10 client.26819 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:15.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.540+0000 7f4fbee42740 1 -- 172.21.15.8:0/239537676 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x563d401d65a0 con 0x563d40270c40 2024-03-16T21:03:15.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.540+0000 7f4f9b400640 1 -- 172.21.15.8:0/239537676 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x563d3fed77e0 con 0x563d40270c40 2024-03-16T21:03:15.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.541+0000 7f4f9b400640 1 -- 172.21.15.8:0/239537676 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f4fa803c050 con 0x563d40270c40 2024-03-16T21:03:15.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.541+0000 7f4fbee42740 10 client.26819 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:15.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.541+0000 7f4fbee42740 10 client.26819 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.541+0000 7f4fbee42740 20 client.26819 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.541+0000 7f4fbee42740 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x563d40289e10 0x563d4028c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.541+0000 7f4fbee42740 4 client.26819 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.541+0000 7f4fbee42740 1 -- 172.21.15.8:0/239537676 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d3ff14720 con 0x563d40289e10 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.541+0000 7f4fb8e00640 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x563d40289e10 0x563d4028c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.542+0000 7f4fb8e00640 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x563d40289e10 0x563d4028c200 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f00a666b356e2449 server_cookie=b8612def069b5e67 in_seq=0 out_seq=0 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.542+0000 7f4f9b400640 10 client.26819 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.542+0000 7f4f9b400640 1 -- 172.21.15.8:0/239537676 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563d3ff14720 con 0x563d40289e10 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.542+0000 7f4f9b400640 10 client.26819 handle_command_reply: tid=0 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.542+0000 7f4fbee42740 1 client.26819 shutdown 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4fbee42740 1 -- 172.21.15.8:0/239537676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40270c40 msgr2=0x563d402771e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4fbee42740 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40270c40 0x563d402771e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005ab0 tx=0x7f4fa8005b50 comp rx=0 tx=0).stop 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4fbee42740 1 -- 172.21.15.8:0/239537676 shutdown_connections 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4fbee42740 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x563d40289e10 0x563d4028c200 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4fbee42740 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d4027a140 0x563d40277c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4fbee42740 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d40271560 0x563d40277720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4f9b400640 0 client.26819 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:03:15.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4fbee42740 1 --2- 172.21.15.8:0/239537676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40270c40 0x563d402771e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4fbee42740 1 -- 172.21.15.8:0/239537676 >> 172.21.15.8:0/239537676 conn(0x563d4026b370 msgr2=0x563d4026d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4fbee42740 1 -- 172.21.15.8:0/239537676 shutdown_connections 2024-03-16T21:03:15.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4fbee42740 1 -- 172.21.15.8:0/239537676 wait complete. 2024-03-16T21:03:15.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.543+0000 7f4fbee42740 20 client.26819 trim_cache size 0 max 16384 2024-03-16T21:03:15.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.557+0000 7f4fbee42740 1 Processor -- start 2024-03-16T21:03:15.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.557+0000 7f4fbee42740 1 -- start start 2024-03-16T21:03:15.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.557+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40285460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.557+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40271560 0x563d402859a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.557+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4027a140 0x563d40277770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.557+0000 7f4fbee42740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d40270680 con 0x563d4027a140 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.557+0000 7f4fbee42740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4026c140 con 0x563d40271560 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.557+0000 7f4fbee42740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d4026abf0 con 0x563d40270c40 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.558+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40285460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.558+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40285460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53108/0 (socket says 172.21.15.8:53108) 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.558+0000 7f4fb9800640 1 -- 172.21.15.8:0/3092183069 learned_addr learned my addr 172.21.15.8:0/3092183069 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.558+0000 7f4fba200640 1 --2- 172.21.15.8:0/3092183069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4027a140 0x563d40277770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.558+0000 7f4fb8e00640 1 --2- 172.21.15.8:0/3092183069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40271560 0x563d402859a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.558+0000 7f4fb9800640 1 -- 172.21.15.8:0/3092183069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40271560 msgr2=0x563d402859a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.558+0000 7f4fb9800640 1 --2- 172.21.15.8:0/3092183069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40271560 0x563d402859a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.558+0000 7f4fb9800640 1 -- 172.21.15.8:0/3092183069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4027a140 msgr2=0x563d40277770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.558+0000 7f4fb9800640 1 --2- 172.21.15.8:0/3092183069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4027a140 0x563d40277770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.558+0000 7f4fb9800640 1 -- 172.21.15.8:0/3092183069 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d40172ab0 con 0x563d40270c40 2024-03-16T21:03:15.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.558+0000 7f4fb9800640 1 --2- 172.21.15.8:0/3092183069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40285460 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8004bf0 tx=0x7f4fa8004e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1c6236487661037 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fa6000640 1 -- 172.21.15.8:0/3092183069 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa804a450 con 0x563d40270c40 2024-03-16T21:03:15.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fa6000640 1 -- 172.21.15.8:0/3092183069 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4fa804a5b0 con 0x563d40270c40 2024-03-16T21:03:15.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fa6000640 1 -- 172.21.15.8:0/3092183069 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa804ad90 con 0x563d40270c40 2024-03-16T21:03:15.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fbee42740 1 -- 172.21.15.8:0/3092183069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 msgr2=0x563d40285460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fbee42740 1 --2- 172.21.15.8:0/3092183069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40285460 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8004bf0 tx=0x7f4fa8004e10 comp rx=0 tx=0).stop 2024-03-16T21:03:15.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fbee42740 1 -- 172.21.15.8:0/3092183069 shutdown_connections 2024-03-16T21:03:15.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fbee42740 1 --2- 172.21.15.8:0/3092183069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4027a140 0x563d40277770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fbee42740 1 --2- 172.21.15.8:0/3092183069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40271560 0x563d402859a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fbee42740 1 --2- 172.21.15.8:0/3092183069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40285460 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fbee42740 1 -- 172.21.15.8:0/3092183069 >> 172.21.15.8:0/3092183069 conn(0x563d4026b370 msgr2=0x563d4026cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fbee42740 1 -- 172.21.15.8:0/3092183069 shutdown_connections 2024-03-16T21:03:15.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.559+0000 7f4fbee42740 1 -- 172.21.15.8:0/3092183069 wait complete. 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.560+0000 7f4fbee42740 1 -- start start 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.560+0000 7f4fbee42740 1 Processor -- start 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40273a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40271560 0x563d40273fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fbee42740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4027a140 0x563d40274510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fbee42740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d402e4710 con 0x563d4027a140 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fbee42740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d402e4850 con 0x563d40271560 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fbee42740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d402e4a10 con 0x563d40270c40 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fbee42740 10 client.0 _ll_register_callbacks cb 0x7f4fac009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40273a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fb9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40273a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53114/0 (socket says 172.21.15.8:53114) 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fb9800640 1 -- 172.21.15.8:0/2347047341 learned_addr learned my addr 172.21.15.8:0/2347047341 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fba200640 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4027a140 0x563d40274510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fb8e00640 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40271560 0x563d40273fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fb9800640 1 -- 172.21.15.8:0/2347047341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40271560 msgr2=0x563d40273fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fb9800640 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40271560 0x563d40273fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fb9800640 1 -- 172.21.15.8:0/2347047341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4027a140 msgr2=0x563d40274510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fb9800640 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4027a140 0x563d40274510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.561+0000 7f4fb9800640 1 -- 172.21.15.8:0/2347047341 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d401d65a0 con 0x563d40270c40 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.562+0000 7f4fb9800640 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40273a90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8041040 tx=0x7f4fa802bc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e95b14fb1014430e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.562+0000 7f4f9b400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.562+0000 7f4f9b400640 1 -- 172.21.15.8:0/2347047341 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa804a450 con 0x563d40270c40 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.562+0000 7f4f9b400640 1 -- 172.21.15.8:0/2347047341 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4fa8000e40 con 0x563d40270c40 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.562+0000 7f4fbee42740 1 -- 172.21.15.8:0/2347047341 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4fa8004960 con 0x563d40270c40 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.562+0000 7f4f9b400640 1 -- 172.21.15.8:0/2347047341 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fa8005090 con 0x563d40270c40 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.562+0000 7f4fbee42740 10 client.26833 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:15.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.562+0000 7f4fbee42740 1 -- 172.21.15.8:0/2347047341 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x563d40198650 con 0x563d40270c40 2024-03-16T21:03:15.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.562+0000 7f4f9b400640 1 -- 172.21.15.8:0/2347047341 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4fa8072020 con 0x563d40270c40 2024-03-16T21:03:15.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.563+0000 7f4f9b400640 1 -- 172.21.15.8:0/2347047341 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f4fa803c040 con 0x563d40270c40 2024-03-16T21:03:15.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.563+0000 7f4fbee42740 10 client.26833 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:15.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.563+0000 7f4fbee42740 10 client.26833 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:03:15.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.563+0000 7f4fbee42740 20 client.26833 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:15.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.563+0000 7f4fbee42740 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x563d402e5e20 0x563d402e8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.563+0000 7f4fbee42740 4 client.26833 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:03:15.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.563+0000 7f4fbee42740 1 -- 172.21.15.8:0/2347047341 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563d3ff63890 con 0x563d402e5e20 2024-03-16T21:03:15.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.563+0000 7f4fb8e00640 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x563d402e5e20 0x563d402e8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.563+0000 7f4fb8e00640 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x563d402e5e20 0x563d402e8240 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6660002337d3a45f server_cookie=1945ad5c75dacdd0 in_seq=0 out_seq=0 2024-03-16T21:03:15.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4f9b400640 10 client.26833 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4f9b400640 1 -- 172.21.15.8:0/2347047341 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563d3ff63890 con 0x563d402e5e20 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4f9b400640 10 client.26833 handle_command_reply: tid=0 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 1 client.26833 shutdown 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 1 -- 172.21.15.8:0/2347047341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 msgr2=0x563d40273a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40273a90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8041040 tx=0x7f4fa802bc30 comp rx=0 tx=0).stop 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 1 -- 172.21.15.8:0/2347047341 shutdown_connections 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x563d402e5e20 0x563d402e8240 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d4027a140 0x563d40274510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563d40271560 0x563d40273fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 1 --2- 172.21.15.8:0/2347047341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563d40270c40 0x563d40273a90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4f9b400640 0 client.26833 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 1 -- 172.21.15.8:0/2347047341 >> 172.21.15.8:0/2347047341 conn(0x563d4026b370 msgr2=0x563d40269be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 1 -- 172.21.15.8:0/2347047341 shutdown_connections 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 1 -- 172.21.15.8:0/2347047341 wait complete. 2024-03-16T21:03:15.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.564+0000 7f4fbee42740 20 client.26833 trim_cache size 0 max 16384 2024-03-16T21:03:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:03:15.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 -- 172.21.15.8:0/739372400 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f4f9c0a1ba0 msgr2=0x7f4f9c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f4f9c0a1ba0 0x7f4f9c0a4060 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4fb406a9a0 tx=0x7f4fac0096a0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 -- 172.21.15.8:0/739372400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fb4076340 msgr2=0x7f4fb419e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fb4076340 0x7f4fb419e7c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000e9f0 tx=0x7f4fa000eeb0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 -- 172.21.15.8:0/739372400 shutdown_connections 2024-03-16T21:03:15.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f4f9c0a1ba0 0x7f4f9c0a4060 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb4112330 0x7f4fb41a2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fb4076340 0x7f4fb419e7c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 --2- 172.21.15.8:0/739372400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fb4075a20 0x7f4fb419e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 -- 172.21.15.8:0/739372400 >> 172.21.15.8:0/739372400 conn(0x7f4fb40ff160 msgr2=0x7f4fb4113e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 -- 172.21.15.8:0/739372400 shutdown_connections 2024-03-16T21:03:15.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.565+0000 7f4fbc200640 1 -- 172.21.15.8:0/739372400 wait complete. 2024-03-16T21:03:15.588 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:03:15.588 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:03:15.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.807+0000 7f1d0b200640 1 -- 172.21.15.8:0/3106842203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d0c103590 msgr2=0x7f1d0c103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.807+0000 7f1d0b200640 1 --2- 172.21.15.8:0/3106842203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d0c103590 0x7f1d0c103a10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009cd0 tx=0x7f1cf402c0e0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.807+0000 7f1d0b200640 1 -- 172.21.15.8:0/3106842203 shutdown_connections 2024-03-16T21:03:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.807+0000 7f1d0b200640 1 --2- 172.21.15.8:0/3106842203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d0c103f50 0x7f1d0c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.807+0000 7f1d0b200640 1 --2- 172.21.15.8:0/3106842203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d0c103590 0x7f1d0c103a10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.807+0000 7f1d0b200640 1 --2- 172.21.15.8:0/3106842203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c109650 0x7f1d0c109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.807+0000 7f1d0b200640 1 -- 172.21.15.8:0/3106842203 >> 172.21.15.8:0/3106842203 conn(0x7f1d0c0ff020 msgr2=0x7f1d0c101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.807+0000 7f1d0b200640 1 -- 172.21.15.8:0/3106842203 shutdown_connections 2024-03-16T21:03:15.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.807+0000 7f1d0b200640 1 -- 172.21.15.8:0/3106842203 wait complete. 2024-03-16T21:03:15.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.808+0000 7f1d0b200640 1 Processor -- start 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.808+0000 7f1d0b200640 1 -- start start 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.808+0000 7f1d0b200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d0c103590 0x7f1d0c19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.808+0000 7f1d0b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d0c103f50 0x7f1d0c19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d0b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c109650 0x7f1d0c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d0b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c19a120 con 0x7f1d0c103f50 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d0b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c19a290 con 0x7f1d0c109650 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d0b200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c19a450 con 0x7f1d0c103590 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d09e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d0c103590 0x7f1d0c19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d0a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c109650 0x7f1d0c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d09400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d0c103f50 0x7f1d0c19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d09e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d0c103590 0x7f1d0c19f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53122/0 (socket says 172.21.15.8:53122) 2024-03-16T21:03:15.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d09e00640 1 -- 172.21.15.8:0/1519147613 learned_addr learned my addr 172.21.15.8:0/1519147613 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d09e00640 1 -- 172.21.15.8:0/1519147613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c109650 msgr2=0x7f1d0c199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d09e00640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c109650 0x7f1d0c199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d09e00640 1 -- 172.21.15.8:0/1519147613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d0c103f50 msgr2=0x7f1d0c19fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d09e00640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d0c103f50 0x7f1d0c19fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d09e00640 1 -- 172.21.15.8:0/1519147613 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf4009900 con 0x7f1d0c103590 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.809+0000 7f1d0a800640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c109650 0x7f1d0c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.810+0000 7f1d09e00640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d0c103590 0x7f1d0c19f920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00e9f0 tx=0x7f1cfc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.810+0000 7f1d02a00640 1 -- 172.21.15.8:0/1519147613 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc009720 con 0x7f1d0c103590 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.810+0000 7f1d02a00640 1 -- 172.21.15.8:0/1519147613 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1cfc00cd80 con 0x7f1d0c103590 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.810+0000 7f1d0b200640 1 -- 172.21.15.8:0/1519147613 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c19a730 con 0x7f1d0c103590 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.810+0000 7f1d02a00640 1 -- 172.21.15.8:0/1519147613 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc010690 con 0x7f1d0c103590 2024-03-16T21:03:15.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.810+0000 7f1d0b200640 1 -- 172.21.15.8:0/1519147613 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c1a69c0 con 0x7f1d0c103590 2024-03-16T21:03:15.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.813+0000 7f1d02a00640 1 -- 172.21.15.8:0/1519147613 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f1cfc0046c0 con 0x7f1d0c103590 2024-03-16T21:03:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.813+0000 7f1d13e48740 1 Processor -- start 2024-03-16T21:03:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.813+0000 7f1d13e48740 1 -- start start 2024-03-16T21:03:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 0x557b068e61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e6710 0x557b068eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d13e48740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b06854210 con 0x557b068ef2f0 2024-03-16T21:03:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d13e48740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b06851740 con 0x557b068e5df0 2024-03-16T21:03:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d13e48740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b0684cf20 con 0x557b068e6710 2024-03-16T21:03:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d0a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 0x557b068e61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d09e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e6710 0x557b068eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d0a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 0x557b068e61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45344/0 (socket says 172.21.15.8:45344) 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d0a800640 1 -- 172.21.15.8:0/2824614601 learned_addr learned my addr 172.21.15.8:0/2824614601 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d09400640 1 --2- 172.21.15.8:0/2824614601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d0a800640 1 -- 172.21.15.8:0/2824614601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e6710 msgr2=0x557b068eedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d0a800640 1 --2- 172.21.15.8:0/2824614601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e6710 0x557b068eedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d0a800640 1 -- 172.21.15.8:0/2824614601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 msgr2=0x557b068f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d0a800640 1 --2- 172.21.15.8:0/2824614601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.814+0000 7f1d0a800640 1 -- 172.21.15.8:0/2824614601 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b0680edf0 con 0x557b068e5df0 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.815+0000 7f1d0a800640 1 --2- 172.21.15.8:0/2824614601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 0x557b068e61d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1d04011540 tx=0x7f1d04011a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87f97b3df830b0f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.815+0000 7f1d02a00640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1cf00a1c20 0x7f1cf00a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.815+0000 7f1cfb400640 1 -- 172.21.15.8:0/2824614601 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0400f5c0 con 0x557b068e5df0 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.815+0000 7f1cfb400640 1 -- 172.21.15.8:0/2824614601 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1d0400fc20 con 0x557b068e5df0 2024-03-16T21:03:15.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.815+0000 7f1cfb400640 1 -- 172.21.15.8:0/2824614601 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04019d50 con 0x557b068e5df0 2024-03-16T21:03:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.815+0000 7f1d02a00640 1 -- 172.21.15.8:0/1519147613 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1cfc014070 con 0x7f1d0c103590 2024-03-16T21:03:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.815+0000 7f1d09e00640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1cf00a1c20 0x7f1cf00a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.816+0000 7f1d13e48740 1 -- 172.21.15.8:0/2824614601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 msgr2=0x557b068e61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.816+0000 7f1d13e48740 1 --2- 172.21.15.8:0/2824614601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 0x557b068e61d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1d04011540 tx=0x7f1d04011a00 comp rx=0 tx=0).stop 2024-03-16T21:03:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.816+0000 7f1d13e48740 1 -- 172.21.15.8:0/2824614601 shutdown_connections 2024-03-16T21:03:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.816+0000 7f1d13e48740 1 --2- 172.21.15.8:0/2824614601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.816+0000 7f1d13e48740 1 --2- 172.21.15.8:0/2824614601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e6710 0x557b068eedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.816+0000 7f1d13e48740 1 --2- 172.21.15.8:0/2824614601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 0x557b068e61d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.816+0000 7f1d13e48740 1 -- 172.21.15.8:0/2824614601 >> 172.21.15.8:0/2824614601 conn(0x557b068e0520 msgr2=0x557b068e0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.816+0000 7f1d09e00640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1cf00a1c20 0x7f1cf00a40e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x557b068e58c0 tx=0x7f1cfc0d3530 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.816+0000 7f1d13e48740 1 -- 172.21.15.8:0/2824614601 shutdown_connections 2024-03-16T21:03:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.816+0000 7f1d13e48740 1 -- 172.21.15.8:0/2824614601 wait complete. 2024-03-16T21:03:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.816+0000 7f1d13e48740 1 -- start start 2024-03-16T21:03:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.817+0000 7f1d13e48740 1 Processor -- start 2024-03-16T21:03:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.817+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 0x557b068ec380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.817+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068e6710 0x557b068ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.817+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068ef2f0 0x557b068ece00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.817+0000 7f1d13e48740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b067f2150 con 0x557b068e6710 2024-03-16T21:03:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.817+0000 7f1d13e48740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b067f1df0 con 0x557b068e5df0 2024-03-16T21:03:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.817+0000 7f1d13e48740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b065bb1c0 con 0x557b068ef2f0 2024-03-16T21:03:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.817+0000 7f1d13e48740 10 client.0 _ll_register_callbacks cb 0x557b068412b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:15.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.817+0000 7f1d09400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068e6710 0x557b068ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.817+0000 7f1d0a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 0x557b068ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.818+0000 7f1d09400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068e6710 0x557b068ec8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57950/0 (socket says 172.21.15.8:57950) 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.818+0000 7f1d09400640 1 -- 172.21.15.8:0/234820902 learned_addr learned my addr 172.21.15.8:0/234820902 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.818+0000 7f1d0a800640 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068ef2f0 0x557b068ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.818+0000 7f1d09400640 1 -- 172.21.15.8:0/234820902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068ef2f0 msgr2=0x557b068ece00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.818+0000 7f1d09400640 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068ef2f0 0x557b068ece00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.818+0000 7f1d09400640 1 -- 172.21.15.8:0/234820902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 msgr2=0x557b068ec380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.818+0000 7f1d09400640 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 0x557b068ec380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.818+0000 7f1d09400640 1 -- 172.21.15.8:0/234820902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d04009d40 con 0x557b068e6710 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.818+0000 7f1d0a800640 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 0x557b068ec380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.818+0000 7f1d09400640 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068e6710 0x557b068ec8c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4037040 tx=0x7f1cf4034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acb78535d63dfc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.818+0000 7f1cefe00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.819+0000 7f1cefe00640 1 -- 172.21.15.8:0/234820902 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40329b0 con 0x557b068e6710 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.819+0000 7f1cefe00640 1 -- 172.21.15.8:0/234820902 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1cf4046070 con 0x557b068e6710 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.819+0000 7f1d13e48740 1 -- 172.21.15.8:0/234820902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b0654c7e0 con 0x557b068e6710 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.819+0000 7f1cefe00640 1 -- 172.21.15.8:0/234820902 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cf4032e70 con 0x557b068e6710 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.819+0000 7f1d13e48740 10 client.16656 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.819+0000 7f1d13e48740 1 -- 172.21.15.8:0/234820902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557b0684b5a0 con 0x557b068e6710 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.819+0000 7f1cefe00640 1 -- 172.21.15.8:0/234820902 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x557b0654c7e0 con 0x557b068e6710 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.819+0000 7f1cefe00640 1 -- 172.21.15.8:0/234820902 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f1cf40044c0 con 0x557b068e6710 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.819+0000 7f1d13e48740 10 client.16656 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.819+0000 7f1d13e48740 10 client.16656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.820+0000 7f1d13e48740 20 client.16656 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:15.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.820+0000 7f1d13e48740 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557b068ff440 0x557b06901860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.820+0000 7f1d13e48740 4 client.16656 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.820+0000 7f1d13e48740 1 -- 172.21.15.8:0/234820902 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b06589720 con 0x557b068ff440 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.820+0000 7f1d0a800640 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557b068ff440 0x557b06901860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.820+0000 7f1d0a800640 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557b068ff440 0x557b06901860 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=548b6d85495a5669 server_cookie=cedbc8b1433dfad6 in_seq=0 out_seq=0 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.820+0000 7f1cefe00640 10 client.16656 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1cefe00640 1 -- 172.21.15.8:0/234820902 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x557b06589720 con 0x557b068ff440 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1cefe00640 10 client.16656 handle_command_reply: tid=0 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1d13e48740 1 client.16656 shutdown 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1d13e48740 1 -- 172.21.15.8:0/234820902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068e6710 msgr2=0x557b068ec8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1d13e48740 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068e6710 0x557b068ec8c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4037040 tx=0x7f1cf4034670 comp rx=0 tx=0).stop 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1d13e48740 1 -- 172.21.15.8:0/234820902 shutdown_connections 2024-03-16T21:03:15.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1d13e48740 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068ef2f0 0x557b068ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1d13e48740 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557b068ff440 0x557b06901860 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1d13e48740 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068e6710 0x557b068ec8c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1d13e48740 1 --2- 172.21.15.8:0/234820902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068e5df0 0x557b068ec380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1cefe00640 0 client.16656 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:15.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.821+0000 7f1d13e48740 1 -- 172.21.15.8:0/234820902 >> 172.21.15.8:0/234820902 conn(0x557b068e0520 msgr2=0x557b068e2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.822+0000 7f1d13e48740 1 -- 172.21.15.8:0/234820902 shutdown_connections 2024-03-16T21:03:15.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.822+0000 7f1d13e48740 1 -- 172.21.15.8:0/234820902 wait complete. 2024-03-16T21:03:15.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.822+0000 7f1d13e48740 20 client.16656 trim_cache size 0 max 16384 2024-03-16T21:03:15.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.835+0000 7f1d13e48740 1 Processor -- start 2024-03-16T21:03:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d13e48740 1 -- start start 2024-03-16T21:03:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 0x557b068eea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068df540 0x557b068fa670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d13e48740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b068fbf00 con 0x557b068ef2f0 2024-03-16T21:03:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d13e48740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b068f1a80 con 0x557b068df540 2024-03-16T21:03:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d13e48740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b068dbe20 con 0x557b068e5df0 2024-03-16T21:03:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d0a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 0x557b068eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d09400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d09400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068ecc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57960/0 (socket says 172.21.15.8:57960) 2024-03-16T21:03:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d09400640 1 -- 172.21.15.8:0/3298130546 learned_addr learned my addr 172.21.15.8:0/3298130546 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d0a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 0x557b068eea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53144/0 (socket says 172.21.15.8:53144) 2024-03-16T21:03:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.836+0000 7f1d0a800640 1 --2- 172.21.15.8:0/3298130546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068df540 0x557b068fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.837+0000 7f1d09400640 1 -- 172.21.15.8:0/3298130546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 msgr2=0x557b068eea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.837+0000 7f1d09400640 1 --2- 172.21.15.8:0/3298130546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 0x557b068eea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.837+0000 7f1d09400640 1 -- 172.21.15.8:0/3298130546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068df540 msgr2=0x557b068fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.837+0000 7f1d09400640 1 --2- 172.21.15.8:0/3298130546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068df540 0x557b068fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.837+0000 7f1d09400640 1 -- 172.21.15.8:0/3298130546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b067e7ab0 con 0x557b068ef2f0 2024-03-16T21:03:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.837+0000 7f1d0a800640 1 --2- 172.21.15.8:0/3298130546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068df540 0x557b068fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:15.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.837+0000 7f1d09400640 1 --2- 172.21.15.8:0/3298130546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068ecc20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4004af0 tx=0x7f1cf402c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a70fe4c16cb14cd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.837+0000 7f1cfaa00640 1 -- 172.21.15.8:0/3298130546 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40329b0 con 0x557b068ef2f0 2024-03-16T21:03:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.837+0000 7f1cfaa00640 1 -- 172.21.15.8:0/3298130546 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1cf4044070 con 0x557b068ef2f0 2024-03-16T21:03:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.837+0000 7f1cfaa00640 1 -- 172.21.15.8:0/3298130546 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4032c20 con 0x557b068ef2f0 2024-03-16T21:03:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.838+0000 7f1d13e48740 1 -- 172.21.15.8:0/3298130546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 msgr2=0x557b068ecc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.838+0000 7f1d13e48740 1 --2- 172.21.15.8:0/3298130546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068ecc20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4004af0 tx=0x7f1cf402c0e0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.838+0000 7f1d13e48740 1 -- 172.21.15.8:0/3298130546 shutdown_connections 2024-03-16T21:03:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.838+0000 7f1d13e48740 1 --2- 172.21.15.8:0/3298130546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068df540 0x557b068fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.838+0000 7f1d13e48740 1 --2- 172.21.15.8:0/3298130546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068ecc20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.838+0000 7f1d13e48740 1 --2- 172.21.15.8:0/3298130546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 0x557b068eea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.838+0000 7f1d13e48740 1 -- 172.21.15.8:0/3298130546 >> 172.21.15.8:0/3298130546 conn(0x557b068e0520 msgr2=0x557b068dee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.838+0000 7f1d13e48740 1 -- 172.21.15.8:0/3298130546 shutdown_connections 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.838+0000 7f1d13e48740 1 -- 172.21.15.8:0/3298130546 wait complete. 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.838+0000 7f1d13e48740 1 -- start start 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d13e48740 1 Processor -- start 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068df540 0x557b068f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 0x557b068f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d13e48740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068f3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d13e48740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b068f3b40 con 0x557b068ef2f0 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d13e48740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b068f3cb0 con 0x557b068df540 2024-03-16T21:03:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d13e48740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b068f3e70 con 0x557b068e5df0 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d13e48740 10 client.0 _ll_register_callbacks cb 0x7f1cfc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d0a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068df540 0x557b068f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d09400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 0x557b068f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d09400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 0x557b068f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53148/0 (socket says 172.21.15.8:53148) 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d09400640 1 -- 172.21.15.8:0/3307022418 learned_addr learned my addr 172.21.15.8:0/3307022418 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.839+0000 7f1d0a800640 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.840+0000 7f1d09400640 1 -- 172.21.15.8:0/3307022418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068df540 msgr2=0x557b068f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.840+0000 7f1d09400640 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068df540 0x557b068f6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.840+0000 7f1d09400640 1 -- 172.21.15.8:0/3307022418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 msgr2=0x557b068f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.840+0000 7f1d09400640 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.840+0000 7f1d09400640 1 -- 172.21.15.8:0/3307022418 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b0684b5a0 con 0x557b068e5df0 2024-03-16T21:03:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.840+0000 7f1d0a800640 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.840+0000 7f1d09400640 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 0x557b068f30c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009600 tx=0x7f1cf4034650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abde1b8c564f580 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.840+0000 7f1cefe00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.840+0000 7f1cefe00640 1 -- 172.21.15.8:0/3307022418 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf404a640 con 0x557b068e5df0 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.840+0000 7f1cefe00640 1 -- 172.21.15.8:0/3307022418 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1cf4061070 con 0x557b068e5df0 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.840+0000 7f1d13e48740 1 -- 172.21.15.8:0/3307022418 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b068dbc30 con 0x557b068e5df0 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1cefe00640 1 -- 172.21.15.8:0/3307022418 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cf404a7a0 con 0x557b068e5df0 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1d13e48740 10 client.26851 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1d13e48740 1 -- 172.21.15.8:0/3307022418 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557b0680d650 con 0x557b068e5df0 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1cefe00640 1 -- 172.21.15.8:0/3307022418 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x557b068dbc30 con 0x557b068e5df0 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1cefe00640 1 -- 172.21.15.8:0/3307022418 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f1cf4059070 con 0x557b068e5df0 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1d13e48740 10 client.26851 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1d13e48740 10 client.26851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1d13e48740 20 client.26851 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1d13e48740 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557b0695bdb0 0x557b0695e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1d13e48740 4 client.26851 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1d13e48740 1 -- 172.21.15.8:0/3307022418 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f1d0400fc20 con 0x557b0695bdb0 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.841+0000 7f1d0a800640 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557b0695bdb0 0x557b0695e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1d0a800640 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557b0695bdb0 0x557b0695e1a0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7562c91f7b7b0242 server_cookie=198f165d9bceed0b in_seq=0 out_seq=0 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1cefe00640 10 client.26851 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1cefe00640 1 -- 172.21.15.8:0/3307022418 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f1d0400fc20 con 0x557b0695bdb0 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1cefe00640 10 client.26851 handle_command_reply: tid=0 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1d13e48740 1 client.26851 shutdown 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1d13e48740 1 -- 172.21.15.8:0/3307022418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 msgr2=0x557b068f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1d13e48740 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 0x557b068f30c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009600 tx=0x7f1cf4034650 comp rx=0 tx=0).stop 2024-03-16T21:03:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1d13e48740 1 -- 172.21.15.8:0/3307022418 shutdown_connections 2024-03-16T21:03:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1d13e48740 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557b0695bdb0 0x557b0695e1a0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1d13e48740 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b068ef2f0 0x557b068f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1d13e48740 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b068e5df0 0x557b068f30c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1cefe00640 0 client.26851 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1d13e48740 1 --2- 172.21.15.8:0/3307022418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b068df540 0x557b068f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1d13e48740 1 -- 172.21.15.8:0/3307022418 >> 172.21.15.8:0/3307022418 conn(0x557b068e0520 msgr2=0x557b068e18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.842+0000 7f1d13e48740 1 -- 172.21.15.8:0/3307022418 shutdown_connections 2024-03-16T21:03:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d13e48740 1 -- 172.21.15.8:0/3307022418 wait complete. 2024-03-16T21:03:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d13e48740 20 client.26851 trim_cache size 0 max 16384 2024-03-16T21:03:15.854 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:03:15.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d0b200640 1 -- 172.21.15.8:0/1519147613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1cf00a1c20 msgr2=0x7f1cf00a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d0b200640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1cf00a1c20 0x7f1cf00a40e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x557b068e58c0 tx=0x7f1cfc0d3530 comp rx=0 tx=0).stop 2024-03-16T21:03:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d0b200640 1 -- 172.21.15.8:0/1519147613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d0c103590 msgr2=0x7f1d0c19f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d0b200640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d0c103590 0x7f1d0c19f920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00e9f0 tx=0x7f1cfc00edf0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d0b200640 1 -- 172.21.15.8:0/1519147613 shutdown_connections 2024-03-16T21:03:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d0b200640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1cf00a1c20 0x7f1cf00a40e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d0b200640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d0c109650 0x7f1d0c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d0b200640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d0c103f50 0x7f1d0c19fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d0b200640 1 --2- 172.21.15.8:0/1519147613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d0c103590 0x7f1d0c19f920 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.843+0000 7f1d0b200640 1 -- 172.21.15.8:0/1519147613 >> 172.21.15.8:0/1519147613 conn(0x7f1d0c0ff020 msgr2=0x7f1d0c1006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.844+0000 7f1d0b200640 1 -- 172.21.15.8:0/1519147613 shutdown_connections 2024-03-16T21:03:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:15.844+0000 7f1d0b200640 1 -- 172.21.15.8:0/1519147613 wait complete. 2024-03-16T21:03:15.864 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:15 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3436614246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:03:16.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:15 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3436614246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:03:16.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:15 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3436614246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:03:16.868 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:03:16.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:03:16.868 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:03:16.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:16 smithi008 ceph-mon[31434]: pgmap v166: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:03:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.105+0000 7f94a2800640 1 -- 172.21.15.8:0/7786561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f949c103590 msgr2=0x7f949c103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.105+0000 7f94a2800640 1 --2- 172.21.15.8:0/7786561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f949c103590 0x7f949c103a10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9488009930 tx=0x7f948802bc20 comp rx=0 tx=0).stop 2024-03-16T21:03:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.105+0000 7f94a2800640 1 -- 172.21.15.8:0/7786561 shutdown_connections 2024-03-16T21:03:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.105+0000 7f94a2800640 1 --2- 172.21.15.8:0/7786561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f949c103f50 0x7f949c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.105+0000 7f94a2800640 1 --2- 172.21.15.8:0/7786561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f949c103590 0x7f949c103a10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.105+0000 7f94a2800640 1 --2- 172.21.15.8:0/7786561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c109650 0x7f949c109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.105+0000 7f94a2800640 1 -- 172.21.15.8:0/7786561 >> 172.21.15.8:0/7786561 conn(0x7f949c0ff020 msgr2=0x7f949c101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.105+0000 7f94a2800640 1 -- 172.21.15.8:0/7786561 shutdown_connections 2024-03-16T21:03:17.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.105+0000 7f94a2800640 1 -- 172.21.15.8:0/7786561 wait complete. 2024-03-16T21:03:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.106+0000 7f94a2800640 1 Processor -- start 2024-03-16T21:03:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.106+0000 7f94a2800640 1 -- start start 2024-03-16T21:03:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.107+0000 7f94a2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f949c103590 0x7f949c19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.107+0000 7f94a2800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f949c103f50 0x7f949c19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.107+0000 7f94a2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c109650 0x7f949c199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.107+0000 7f94a2800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c19a110 con 0x7f949c109650 2024-03-16T21:03:17.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.107+0000 7f94a2800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c19a280 con 0x7f949c103f50 2024-03-16T21:03:17.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.107+0000 7f94a2800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c19a440 con 0x7f949c103590 2024-03-16T21:03:17.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.107+0000 7f94a1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f949c103590 0x7f949c19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.107+0000 7f94a1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f949c103590 0x7f949c19f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53168/0 (socket says 172.21.15.8:53168) 2024-03-16T21:03:17.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.107+0000 7f94a1400640 1 -- 172.21.15.8:0/285074982 learned_addr learned my addr 172.21.15.8:0/285074982 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:17.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.107+0000 7f94a0a00640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f949c103f50 0x7f949c19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.107+0000 7f94a1e00640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c109650 0x7f949c199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.108+0000 7f94a1400640 1 -- 172.21.15.8:0/285074982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f949c103f50 msgr2=0x7f949c19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.108+0000 7f94a1400640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f949c103f50 0x7f949c19fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.108+0000 7f94a1400640 1 -- 172.21.15.8:0/285074982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c109650 msgr2=0x7f949c199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.108+0000 7f94a1400640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c109650 0x7f949c199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.108+0000 7f94a1400640 1 -- 172.21.15.8:0/285074982 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488009560 con 0x7f949c103590 2024-03-16T21:03:17.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.108+0000 7f94a1e00640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c109650 0x7f949c199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:17.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.108+0000 7f94a1400640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f949c103590 0x7f949c19f8c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f949000e9f0 tx=0x7f949000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.108+0000 7f949a000640 1 -- 172.21.15.8:0/285074982 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9490009700 con 0x7f949c103590 2024-03-16T21:03:17.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.108+0000 7f949a000640 1 -- 172.21.15.8:0/285074982 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f949000cd80 con 0x7f949c103590 2024-03-16T21:03:17.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.108+0000 7f94a2800640 1 -- 172.21.15.8:0/285074982 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c19a720 con 0x7f949c103590 2024-03-16T21:03:17.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.108+0000 7f949a000640 1 -- 172.21.15.8:0/285074982 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900189c0 con 0x7f949c103590 2024-03-16T21:03:17.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.109+0000 7f94a2800640 1 -- 172.21.15.8:0/285074982 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c1a6960 con 0x7f949c103590 2024-03-16T21:03:17.120 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:16 smithi170 ceph-mon[35947]: pgmap v166: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:03:17.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.112+0000 7f949a000640 1 -- 172.21.15.8:0/285074982 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f9490018b20 con 0x7f949c103590 2024-03-16T21:03:17.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.112+0000 7f94a6b87740 1 Processor -- start 2024-03-16T21:03:17.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.112+0000 7f94a6b87740 1 -- start start 2024-03-16T21:03:17.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.112+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 0x5579523134f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.112+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x55795231c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.112+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795231ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.112+0000 7f94a6b87740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579522ce300 con 0x557952313a30 2024-03-16T21:03:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.112+0000 7f94a6b87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557952280e50 con 0x557952313110 2024-03-16T21:03:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.112+0000 7f94a6b87740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55795227e380 con 0x55795231c610 2024-03-16T21:03:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f94a1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 0x5579523134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f94a1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 0x5579523134f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45404/0 (socket says 172.21.15.8:45404) 2024-03-16T21:03:17.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f94a1e00640 1 -- 172.21.15.8:0/480141646 learned_addr learned my addr 172.21.15.8:0/480141646 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:17.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f94a0a00640 1 --2- 172.21.15.8:0/480141646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795231ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f94a1400640 1 --2- 172.21.15.8:0/480141646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x55795231c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f949a000640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94840a1ba0 0x7f94840a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f94a1e00640 1 -- 172.21.15.8:0/480141646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 msgr2=0x55795231ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f94a1e00640 1 --2- 172.21.15.8:0/480141646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795231ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f94a1e00640 1 -- 172.21.15.8:0/480141646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 msgr2=0x55795231c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f94a1e00640 1 --2- 172.21.15.8:0/480141646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x55795231c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f94a1e00640 1 -- 172.21.15.8:0/480141646 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557952242c80 con 0x557952313110 2024-03-16T21:03:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f94a0a00640 1 --2- 172.21.15.8:0/480141646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795231ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.113+0000 7f949a000640 1 -- 172.21.15.8:0/285074982 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9490014070 con 0x7f949c103590 2024-03-16T21:03:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.114+0000 7f94a1e00640 1 --2- 172.21.15.8:0/480141646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 0x5579523134f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f949400f430 tx=0x7f949400f8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f729f6f1eb93b2d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.114+0000 7f94a1e00640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94840a1ba0 0x7f94840a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.114+0000 7f948e600640 1 -- 172.21.15.8:0/480141646 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494011be0 con 0x557952313110 2024-03-16T21:03:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.114+0000 7f948e600640 1 -- 172.21.15.8:0/480141646 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9494011e80 con 0x557952313110 2024-03-16T21:03:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.114+0000 7f948e600640 1 -- 172.21.15.8:0/480141646 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949401a370 con 0x557952313110 2024-03-16T21:03:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.115+0000 7f94a6b87740 1 -- 172.21.15.8:0/480141646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 msgr2=0x5579523134f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.115+0000 7f94a1e00640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94840a1ba0 0x7f94840a4060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f949401e000 tx=0x7f9494021000 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.115+0000 7f94a6b87740 1 --2- 172.21.15.8:0/480141646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 0x5579523134f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f949400f430 tx=0x7f949400f8f0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.115+0000 7f94a6b87740 1 -- 172.21.15.8:0/480141646 shutdown_connections 2024-03-16T21:03:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.115+0000 7f94a6b87740 1 --2- 172.21.15.8:0/480141646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795231ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.115+0000 7f94a6b87740 1 --2- 172.21.15.8:0/480141646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x55795231c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.115+0000 7f94a6b87740 1 --2- 172.21.15.8:0/480141646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 0x5579523134f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.115+0000 7f94a6b87740 1 -- 172.21.15.8:0/480141646 >> 172.21.15.8:0/480141646 conn(0x55795230d840 msgr2=0x55795230dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.115+0000 7f94a6b87740 1 -- 172.21.15.8:0/480141646 shutdown_connections 2024-03-16T21:03:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.115+0000 7f94a6b87740 1 -- 172.21.15.8:0/480141646 wait complete. 2024-03-16T21:03:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.116+0000 7f94a6b87740 1 -- start start 2024-03-16T21:03:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.116+0000 7f94a6b87740 1 Processor -- start 2024-03-16T21:03:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.116+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 0x557952319680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.116+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x557952319bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.116+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795231a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.116+0000 7f94a6b87740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557952279b60 con 0x557952313a30 2024-03-16T21:03:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.116+0000 7f94a6b87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55795221efd0 con 0x557952313110 2024-03-16T21:03:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.116+0000 7f94a6b87740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55795221ec70 con 0x55795231c610 2024-03-16T21:03:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a6b87740 10 client.0 _ll_register_callbacks cb 0x557951f8ac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x557952319bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 0x557952319680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 0x557952319680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45416/0 (socket says 172.21.15.8:45416) 2024-03-16T21:03:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a1e00640 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795231a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a1400640 1 -- 172.21.15.8:0/896825773 learned_addr learned my addr 172.21.15.8:0/896825773 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a1e00640 1 -- 172.21.15.8:0/896825773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 msgr2=0x557952319680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a1e00640 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 0x557952319680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a1e00640 1 -- 172.21.15.8:0/896825773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 msgr2=0x557952319bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a1e00640 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x557952319bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a1e00640 1 -- 172.21.15.8:0/896825773 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9494009d00 con 0x55795231c610 2024-03-16T21:03:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f94a1e00640 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795231a100 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9494009fd0 tx=0x7f9494010f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a759577e179b7d45 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.117+0000 7f9482a00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:03:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.118+0000 7f9482a00640 1 -- 172.21.15.8:0/896825773 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949401a370 con 0x55795231c610 2024-03-16T21:03:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.118+0000 7f9482a00640 1 -- 172.21.15.8:0/896825773 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9494011bf0 con 0x55795231c610 2024-03-16T21:03:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.118+0000 7f94a6b87740 1 -- 172.21.15.8:0/896825773 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557951fca410 con 0x55795231c610 2024-03-16T21:03:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.118+0000 7f9482a00640 1 -- 172.21.15.8:0/896825773 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f949401b610 con 0x55795231c610 2024-03-16T21:03:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.118+0000 7f94a6b87740 10 client.26863 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.118+0000 7f94a6b87740 1 -- 172.21.15.8:0/896825773 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5579522781e0 con 0x55795231c610 2024-03-16T21:03:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.118+0000 7f9482a00640 1 -- 172.21.15.8:0/896825773 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x557951fca410 con 0x55795231c610 2024-03-16T21:03:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.118+0000 7f9482a00640 1 -- 172.21.15.8:0/896825773 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f9494023030 con 0x55795231c610 2024-03-16T21:03:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.119+0000 7f94a6b87740 10 client.26863 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.119+0000 7f94a6b87740 10 client.26863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.119+0000 7f94a6b87740 20 client.26863 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.119+0000 7f94a6b87740 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55795232cae0 0x55795232ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.119+0000 7f94a6b87740 4 client.26863 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.119+0000 7f94a6b87740 1 -- 172.21.15.8:0/896825773 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557951fb67b0 con 0x55795232cae0 2024-03-16T21:03:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.119+0000 7f94a1400640 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55795232cae0 0x55795232ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.119+0000 7f94a1400640 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55795232cae0 0x55795232ef00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e3a88c8b0ebcc5b server_cookie=4e2ef1f49f6364f8 in_seq=0 out_seq=0 2024-03-16T21:03:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.119+0000 7f9482a00640 10 client.26863 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f9482a00640 1 -- 172.21.15.8:0/896825773 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x557951fb67b0 con 0x55795232cae0 2024-03-16T21:03:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f9482a00640 10 client.26863 handle_command_reply: tid=0 2024-03-16T21:03:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f94a6b87740 1 client.26863 shutdown 2024-03-16T21:03:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f94a6b87740 1 -- 172.21.15.8:0/896825773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 msgr2=0x55795231a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f94a6b87740 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795231a100 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9494009fd0 tx=0x7f9494010f40 comp rx=0 tx=0).stop 2024-03-16T21:03:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f94a6b87740 1 -- 172.21.15.8:0/896825773 shutdown_connections 2024-03-16T21:03:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f94a6b87740 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795231a100 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f94a6b87740 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55795232cae0 0x55795232ef00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f94a6b87740 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x557952319bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f94a6b87740 1 --2- 172.21.15.8:0/896825773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313110 0x557952319680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f94a6b87740 1 -- 172.21.15.8:0/896825773 >> 172.21.15.8:0/896825773 conn(0x55795230d840 msgr2=0x55795230f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f9482a00640 0 client.26863 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f94a6b87740 1 -- 172.21.15.8:0/896825773 shutdown_connections 2024-03-16T21:03:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.120+0000 7f94a6b87740 1 -- 172.21.15.8:0/896825773 wait complete. 2024-03-16T21:03:17.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.121+0000 7f94a6b87740 20 client.26863 trim_cache size 0 max 16384 2024-03-16T21:03:17.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.138+0000 7f94a6b87740 1 Processor -- start 2024-03-16T21:03:17.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.138+0000 7f94a6b87740 1 -- start start 2024-03-16T21:03:17.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313110 0x55795231bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313a30 0x557952319f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795230c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a6b87740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579523143b0 con 0x557952313110 2024-03-16T21:03:17.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a6b87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557952308ab0 con 0x557952313a30 2024-03-16T21:03:17.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a6b87740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557951fc20c0 con 0x55795231c610 2024-03-16T21:03:17.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:16 smithi186 ceph-mon[36391]: pgmap v166: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:03:17.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313110 0x55795231bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313110 0x55795231bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58006/0 (socket says 172.21.15.8:58006) 2024-03-16T21:03:17.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a1400640 1 -- 172.21.15.8:0/3493618318 learned_addr learned my addr 172.21.15.8:0/3493618318 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:17.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a1e00640 1 --2- 172.21.15.8:0/3493618318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795230c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a0a00640 1 --2- 172.21.15.8:0/3493618318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313a30 0x557952319f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a1400640 1 -- 172.21.15.8:0/3493618318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 msgr2=0x55795230c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a1400640 1 --2- 172.21.15.8:0/3493618318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795230c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a1400640 1 -- 172.21.15.8:0/3493618318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313a30 msgr2=0x557952319f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a1400640 1 --2- 172.21.15.8:0/3493618318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313a30 0x557952319f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.139+0000 7f94a1400640 1 -- 172.21.15.8:0/3493618318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557952214a90 con 0x557952313110 2024-03-16T21:03:17.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.140+0000 7f94a1400640 1 --2- 172.21.15.8:0/3493618318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313110 0x55795231bd40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f949000c6a0 tx=0x7f94900cfe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc71cc5ff47da65c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.140+0000 7f948dc00640 1 -- 172.21.15.8:0/3493618318 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949009a7c0 con 0x557952313110 2024-03-16T21:03:17.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.140+0000 7f948dc00640 1 -- 172.21.15.8:0/3493618318 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f949009e910 con 0x557952313110 2024-03-16T21:03:17.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.140+0000 7f948dc00640 1 -- 172.21.15.8:0/3493618318 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900cb560 con 0x557952313110 2024-03-16T21:03:17.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.141+0000 7f94a6b87740 1 -- 172.21.15.8:0/3493618318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313110 msgr2=0x55795231bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.141+0000 7f94a6b87740 1 --2- 172.21.15.8:0/3493618318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313110 0x55795231bd40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f949000c6a0 tx=0x7f94900cfe80 comp rx=0 tx=0).stop 2024-03-16T21:03:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.141+0000 7f94a6b87740 1 -- 172.21.15.8:0/3493618318 shutdown_connections 2024-03-16T21:03:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.141+0000 7f94a6b87740 1 --2- 172.21.15.8:0/3493618318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55795231c610 0x55795230c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.141+0000 7f94a6b87740 1 --2- 172.21.15.8:0/3493618318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557952313a30 0x557952319f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.141+0000 7f94a6b87740 1 --2- 172.21.15.8:0/3493618318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313110 0x55795231bd40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.141+0000 7f94a6b87740 1 -- 172.21.15.8:0/3493618318 >> 172.21.15.8:0/3493618318 conn(0x55795230d840 msgr2=0x55795230c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.141+0000 7f94a6b87740 1 -- 172.21.15.8:0/3493618318 shutdown_connections 2024-03-16T21:03:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.141+0000 7f94a6b87740 1 -- 172.21.15.8:0/3493618318 wait complete. 2024-03-16T21:03:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.141+0000 7f94a6b87740 1 -- start start 2024-03-16T21:03:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a6b87740 1 Processor -- start 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557952313110 0x557952324040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x5579523203c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a6b87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55795231c610 0x557952320900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a6b87740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557952320e40 con 0x557952313a30 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a6b87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557952320fb0 con 0x55795231c610 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a6b87740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557952321170 con 0x557952313110 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a6b87740 10 client.0 _ll_register_callbacks cb 0x7f949401f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557952313110 0x557952324040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x5579523203c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a1400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557952313110 0x557952324040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53214/0 (socket says 172.21.15.8:53214) 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a1400640 1 -- 172.21.15.8:0/473274346 learned_addr learned my addr 172.21.15.8:0/473274346 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.142+0000 7f94a1e00640 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55795231c610 0x557952320900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f94a1400640 1 -- 172.21.15.8:0/473274346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55795231c610 msgr2=0x557952320900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f94a1400640 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55795231c610 0x557952320900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f94a1400640 1 -- 172.21.15.8:0/473274346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 msgr2=0x5579523203c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f94a1400640 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x5579523203c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f94a1400640 1 -- 172.21.15.8:0/473274346 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c1a6960 con 0x557952313110 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f94a1400640 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557952313110 0x557952324040 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f949000e9c0 tx=0x7f949000cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=131843576f799308 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f9482a00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f9482a00640 1 -- 172.21.15.8:0/473274346 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900a2f60 con 0x557952313110 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f9482a00640 1 -- 172.21.15.8:0/473274346 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9490010c30 con 0x557952313110 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f94a6b87740 1 -- 172.21.15.8:0/473274346 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557951f79860 con 0x557952313110 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f9482a00640 1 -- 172.21.15.8:0/473274346 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9490096e30 con 0x557952313110 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f94a6b87740 10 client.26869 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.143+0000 7f94a6b87740 1 -- 172.21.15.8:0/473274346 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55795223a6a0 con 0x557952313110 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.144+0000 7f9482a00640 1 -- 172.21.15.8:0/473274346 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x557951f79860 con 0x557952313110 2024-03-16T21:03:17.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.144+0000 7f9482a00640 1 -- 172.21.15.8:0/473274346 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f9490099d30 con 0x557952313110 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.144+0000 7f94a6b87740 10 client.26869 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.144+0000 7f94a6b87740 10 client.26869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.144+0000 7f94a6b87740 20 client.26869 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.144+0000 7f94a6b87740 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557952389720 0x55795238bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.144+0000 7f94a6b87740 4 client.26869 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.144+0000 7f94a6b87740 1 -- 172.21.15.8:0/473274346 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x557951f25990 con 0x557952389720 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.144+0000 7f94a0a00640 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557952389720 0x55795238bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.145+0000 7f94a0a00640 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557952389720 0x55795238bb40 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a43209511155f50 server_cookie=76a3e343a8ad3f99 in_seq=0 out_seq=0 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.145+0000 7f9482a00640 10 client.26869 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f9482a00640 1 -- 172.21.15.8:0/473274346 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557951f25990 con 0x557952389720 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f9482a00640 10 client.26869 handle_command_reply: tid=0 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 1 client.26869 shutdown 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 1 -- 172.21.15.8:0/473274346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557952313110 msgr2=0x557952324040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557952313110 0x557952324040 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f949000e9c0 tx=0x7f949000cf70 comp rx=0 tx=0).stop 2024-03-16T21:03:17.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 1 -- 172.21.15.8:0/473274346 shutdown_connections 2024-03-16T21:03:17.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55795231c610 0x557952320900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x557952389720 0x55795238bb40 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557952313a30 0x5579523203c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 1 --2- 172.21.15.8:0/473274346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557952313110 0x557952324040 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f9482a00640 0 client.26869 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:17.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 1 -- 172.21.15.8:0/473274346 >> 172.21.15.8:0/473274346 conn(0x55795230d840 msgr2=0x55795230c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 1 -- 172.21.15.8:0/473274346 shutdown_connections 2024-03-16T21:03:17.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 1 -- 172.21.15.8:0/473274346 wait complete. 2024-03-16T21:03:17.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.146+0000 7f94a6b87740 20 client.26869 trim_cache size 0 max 16384 2024-03-16T21:03:17.159 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:03:17.159 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:03:17.159 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "32a847ae-8828-49d5-8d9f-fe9ea9bd7bcd", 2024-03-16T21:03:17.159 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:03:17.159 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 -- 172.21.15.8:0/285074982 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94840a1ba0 msgr2=0x7f94840a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94840a1ba0 0x7f94840a4060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f949401e000 tx=0x7f9494021000 comp rx=0 tx=0).stop 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 -- 172.21.15.8:0/285074982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f949c103590 msgr2=0x7f949c19f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f949c103590 0x7f949c19f8c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f949000e9f0 tx=0x7f949000eeb0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 -- 172.21.15.8:0/285074982 shutdown_connections 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94840a1ba0 0x7f94840a4060 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f949c109650 0x7f949c199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f949c103f50 0x7f949c19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 --2- 172.21.15.8:0/285074982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f949c103590 0x7f949c19f8c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 -- 172.21.15.8:0/285074982 >> 172.21.15.8:0/285074982 conn(0x7f949c0ff020 msgr2=0x7f949c100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 -- 172.21.15.8:0/285074982 shutdown_connections 2024-03-16T21:03:17.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.147+0000 7f94a2800640 1 -- 172.21.15.8:0/285074982 wait complete. 2024-03-16T21:03:17.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:03:17.173 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:03:17.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.388+0000 7f33a7e00640 1 -- 172.21.15.8:0/3648076853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a0103690 msgr2=0x7f33a0103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.388+0000 7f33a7e00640 1 --2- 172.21.15.8:0/3648076853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a0103690 0x7f33a0103b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f338c009930 tx=0x7f338c02bc30 comp rx=0 tx=0).stop 2024-03-16T21:03:17.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.389+0000 7f33a7e00640 1 -- 172.21.15.8:0/3648076853 shutdown_connections 2024-03-16T21:03:17.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.389+0000 7f33a7e00640 1 --2- 172.21.15.8:0/3648076853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33a0104050 0x7f33a0110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.389+0000 7f33a7e00640 1 --2- 172.21.15.8:0/3648076853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a0103690 0x7f33a0103b10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.389+0000 7f33a7e00640 1 --2- 172.21.15.8:0/3648076853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33a01096a0 0x7f33a0109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.389+0000 7f33a7e00640 1 -- 172.21.15.8:0/3648076853 >> 172.21.15.8:0/3648076853 conn(0x7f33a00ff140 msgr2=0x7f33a0101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.389+0000 7f33a7e00640 1 -- 172.21.15.8:0/3648076853 shutdown_connections 2024-03-16T21:03:17.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.389+0000 7f33a7e00640 1 -- 172.21.15.8:0/3648076853 wait complete. 2024-03-16T21:03:17.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.390+0000 7f33a7e00640 1 Processor -- start 2024-03-16T21:03:17.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.390+0000 7f33a7e00640 1 -- start start 2024-03-16T21:03:17.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.390+0000 7f33a7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a0103690 0x7f33a0199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.390+0000 7f33a7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33a0104050 0x7f33a019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.390+0000 7f33a7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33a01096a0 0x7f33a019e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.390+0000 7f33a7e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a019ed60 con 0x7f33a0103690 2024-03-16T21:03:17.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.390+0000 7f33a7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a019eed0 con 0x7f33a01096a0 2024-03-16T21:03:17.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.390+0000 7f33a7e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a019f090 con 0x7f33a0104050 2024-03-16T21:03:17.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a0103690 0x7f33a0199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a4a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33a0104050 0x7f33a019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33a01096a0 0x7f33a019e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a4a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33a0104050 0x7f33a019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53222/0 (socket says 172.21.15.8:53222) 2024-03-16T21:03:17.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a0103690 0x7f33a0199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58034/0 (socket says 172.21.15.8:58034) 2024-03-16T21:03:17.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a4a00640 1 -- 172.21.15.8:0/1270557262 learned_addr learned my addr 172.21.15.8:0/1270557262 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a4a00640 1 -- 172.21.15.8:0/1270557262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33a01096a0 msgr2=0x7f33a019e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a4a00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33a01096a0 0x7f33a019e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a4a00640 1 -- 172.21.15.8:0/1270557262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a0103690 msgr2=0x7f33a0199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a4a00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a0103690 0x7f33a0199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a4a00640 1 -- 172.21.15.8:0/1270557262 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398009840 con 0x7f33a0104050 2024-03-16T21:03:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a5e00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33a01096a0 0x7f33a019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:17.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.391+0000 7f33a5400640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a0103690 0x7f33a0199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:17.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.392+0000 7f33a4a00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33a0104050 0x7f33a019a3e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f338c000c00 tx=0x7f338c02cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.392+0000 7f339e000640 1 -- 172.21.15.8:0/1270557262 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c004250 con 0x7f33a0104050 2024-03-16T21:03:17.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.392+0000 7f33a7e00640 1 -- 172.21.15.8:0/1270557262 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c009560 con 0x7f33a0104050 2024-03-16T21:03:17.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.392+0000 7f339e000640 1 -- 172.21.15.8:0/1270557262 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f338c0043b0 con 0x7f33a0104050 2024-03-16T21:03:17.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.392+0000 7f339e000640 1 -- 172.21.15.8:0/1270557262 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c003ab0 con 0x7f33a0104050 2024-03-16T21:03:17.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.392+0000 7f33a7e00640 1 -- 172.21.15.8:0/1270557262 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a01a6a10 con 0x7f33a0104050 2024-03-16T21:03:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.395+0000 7f33aab8e740 1 Processor -- start 2024-03-16T21:03:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.395+0000 7f339e000640 1 -- 172.21.15.8:0/1270557262 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f338c0053a0 con 0x7f33a0104050 2024-03-16T21:03:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.395+0000 7f33aab8e740 1 -- start start 2024-03-16T21:03:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.395+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c32c0 0x559b5d2c3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2cc630 0x559b5d2cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33aab8e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5d232150 con 0x559b5d2c3fa0 2024-03-16T21:03:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33aab8e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5d22f680 con 0x559b5d2cc630 2024-03-16T21:03:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33aab8e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5d22ae60 con 0x559b5d2c32c0 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33a5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c32c0 0x559b5d2c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33a5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33a5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c32c0 0x559b5d2c3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53232/0 (socket says 172.21.15.8:53232) 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33a5400640 1 -- 172.21.15.8:0/1979278004 learned_addr learned my addr 172.21.15.8:0/1979278004 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33a4a00640 1 --2- 172.21.15.8:0/1979278004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2cc630 0x559b5d2cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33a5400640 1 -- 172.21.15.8:0/1979278004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2cc630 msgr2=0x559b5d2cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33a5400640 1 --2- 172.21.15.8:0/1979278004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2cc630 0x559b5d2cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33a5400640 1 -- 172.21.15.8:0/1979278004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c3fa0 msgr2=0x559b5d2c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33a5400640 1 --2- 172.21.15.8:0/1979278004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.396+0000 7f33a5400640 1 -- 172.21.15.8:0/1979278004 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b5d1e4060 con 0x559b5d2c32c0 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.397+0000 7f33a5400640 1 --2- 172.21.15.8:0/1979278004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c32c0 0x559b5d2c3740 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f33940114c0 tx=0x7f3394011980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4d3a146f0b6a9c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.397+0000 7f3392600640 1 -- 172.21.15.8:0/1979278004 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394004020 con 0x559b5d2c32c0 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.397+0000 7f3392600640 1 -- 172.21.15.8:0/1979278004 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3394004180 con 0x559b5d2c32c0 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.397+0000 7f3392600640 1 -- 172.21.15.8:0/1979278004 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339400f9c0 con 0x559b5d2c32c0 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.397+0000 7f339e000640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f33880a1c20 0x7f33880a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.397+0000 7f339e000640 1 -- 172.21.15.8:0/1270557262 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f338c0efb90 con 0x7f33a0104050 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.397+0000 7f33a5e00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f33880a1c20 0x7f33880a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.397+0000 7f33aab8e740 1 -- 172.21.15.8:0/1979278004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c32c0 msgr2=0x559b5d2c3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.397+0000 7f33aab8e740 1 --2- 172.21.15.8:0/1979278004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c32c0 0x559b5d2c3740 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f33940114c0 tx=0x7f3394011980 comp rx=0 tx=0).stop 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.398+0000 7f33aab8e740 1 -- 172.21.15.8:0/1979278004 shutdown_connections 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.398+0000 7f33aab8e740 1 --2- 172.21.15.8:0/1979278004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2cc630 0x559b5d2cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.398+0000 7f33aab8e740 1 --2- 172.21.15.8:0/1979278004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c32c0 0x559b5d2c3740 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.398+0000 7f33aab8e740 1 --2- 172.21.15.8:0/1979278004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.398+0000 7f33aab8e740 1 -- 172.21.15.8:0/1979278004 >> 172.21.15.8:0/1979278004 conn(0x559b5d28a5a0 msgr2=0x559b5d2bdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.398+0000 7f33aab8e740 1 -- 172.21.15.8:0/1979278004 shutdown_connections 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.398+0000 7f33aab8e740 1 -- 172.21.15.8:0/1979278004 wait complete. 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.398+0000 7f33a5e00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f33880a1c20 0x7f33880a40e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3398005fd0 tx=0x7f3398009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.398+0000 7f33aab8e740 1 -- start start 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33aab8e740 1 Processor -- start 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 0x559b5d2c9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2cc630 0x559b5d2ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33aab8e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5d1cfec0 con 0x559b5d2c32c0 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33aab8e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5d1cfb60 con 0x559b5d2c3fa0 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33aab8e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5cf991c0 con 0x559b5d2cc630 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33aab8e740 10 client.0 _ll_register_callbacks cb 0x559b5d1e3960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33a4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33a5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2cc630 0x559b5d2ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33a4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45486/0 (socket says 172.21.15.8:45486) 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33a4a00640 1 -- 172.21.15.8:0/3514840199 learned_addr learned my addr 172.21.15.8:0/3514840199 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33a5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2cc630 0x559b5d2ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53238/0 (socket says 172.21.15.8:53238) 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.399+0000 7f33a5400640 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 0x559b5d2c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.400+0000 7f33a4a00640 1 -- 172.21.15.8:0/3514840199 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2cc630 msgr2=0x559b5d2ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.400+0000 7f33a4a00640 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2cc630 0x559b5d2ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.400+0000 7f33a4a00640 1 -- 172.21.15.8:0/3514840199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 msgr2=0x559b5d2c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.400+0000 7f33a4a00640 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 0x559b5d2c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.400+0000 7f33a4a00640 1 -- 172.21.15.8:0/3514840199 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3394009cc0 con 0x559b5d2c3fa0 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.400+0000 7f33a4a00640 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c9b40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f338c006010 tx=0x7f338c0092e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53cc1f7fad20b5e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.400+0000 7f3386a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.400+0000 7f3386a00640 1 -- 172.21.15.8:0/3514840199 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c0f4040 con 0x559b5d2c3fa0 2024-03-16T21:03:17.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.400+0000 7f3386a00640 1 -- 172.21.15.8:0/3514840199 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f338c0bcfa0 con 0x559b5d2c3fa0 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.400+0000 7f33aab8e740 1 -- 172.21.15.8:0/3514840199 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b5cf2a7e0 con 0x559b5d2c3fa0 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.400+0000 7f3386a00640 1 -- 172.21.15.8:0/3514840199 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f338c0bc3e0 con 0x559b5d2c3fa0 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.401+0000 7f33aab8e740 10 client.26873 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.401+0000 7f33aab8e740 1 -- 172.21.15.8:0/3514840199 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559b5d2294e0 con 0x559b5d2c3fa0 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.401+0000 7f3386a00640 1 -- 172.21.15.8:0/3514840199 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x559b5cf2a7e0 con 0x559b5d2c3fa0 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.401+0000 7f3386a00640 1 -- 172.21.15.8:0/3514840199 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f338c03c070 con 0x559b5d2c3fa0 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.401+0000 7f33aab8e740 10 client.26873 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.401+0000 7f33aab8e740 10 client.26873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.401+0000 7f33aab8e740 20 client.26873 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.401+0000 7f33aab8e740 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559b5d2dc610 0x559b5d2dea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.401+0000 7f33aab8e740 4 client.26873 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.401+0000 7f33aab8e740 1 -- 172.21.15.8:0/3514840199 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b5cf67720 con 0x559b5d2dc610 2024-03-16T21:03:17.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.401+0000 7f33a5400640 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559b5d2dc610 0x559b5d2dea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.402+0000 7f33a5400640 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559b5d2dc610 0x559b5d2dea30 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4a1cb40e1c97834 server_cookie=2ea9adbad0f39c38 in_seq=0 out_seq=0 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.402+0000 7f3386a00640 10 client.26873 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.402+0000 7f3386a00640 1 -- 172.21.15.8:0/3514840199 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x559b5cf67720 con 0x559b5d2dc610 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.402+0000 7f3386a00640 10 client.26873 handle_command_reply: tid=0 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 1 client.26873 shutdown 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 1 -- 172.21.15.8:0/3514840199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c3fa0 msgr2=0x559b5d2c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c9b40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f338c006010 tx=0x7f338c0092e0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 1 -- 172.21.15.8:0/3514840199 shutdown_connections 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2cc630 0x559b5d2ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c9b40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559b5d2dc610 0x559b5d2dea30 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 1 --2- 172.21.15.8:0/3514840199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 0x559b5d2c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f3386a00640 0 client.26873 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 1 -- 172.21.15.8:0/3514840199 >> 172.21.15.8:0/3514840199 conn(0x559b5d28a5a0 msgr2=0x559b5d2bfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 1 -- 172.21.15.8:0/3514840199 shutdown_connections 2024-03-16T21:03:17.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 1 -- 172.21.15.8:0/3514840199 wait complete. 2024-03-16T21:03:17.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.403+0000 7f33aab8e740 20 client.26873 trim_cache size 0 max 16384 2024-03-16T21:03:17.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.421+0000 7f33aab8e740 1 Processor -- start 2024-03-16T21:03:17.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.421+0000 7f33aab8e740 1 -- start start 2024-03-16T21:03:17.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c32c0 0x559b5d2cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2cc630 0x559b5d2d7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33aab8e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5d2c0070 con 0x559b5d2cc630 2024-03-16T21:03:17.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33aab8e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5cf67720 con 0x559b5d2c32c0 2024-03-16T21:03:17.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33aab8e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5d2b95e0 con 0x559b5d2c3fa0 2024-03-16T21:03:17.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33a5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2cc630 0x559b5d2d7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33a5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2cc630 0x559b5d2d7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58054/0 (socket says 172.21.15.8:58054) 2024-03-16T21:03:17.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33a5e00640 1 -- 172.21.15.8:0/2227151956 learned_addr learned my addr 172.21.15.8:0/2227151956 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:17.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33a5400640 1 --2- 172.21.15.8:0/2227151956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c32c0 0x559b5d2cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33a4a00640 1 --2- 172.21.15.8:0/2227151956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33a5e00640 1 -- 172.21.15.8:0/2227151956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c3fa0 msgr2=0x559b5d2c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33a5e00640 1 --2- 172.21.15.8:0/2227151956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33a5e00640 1 -- 172.21.15.8:0/2227151956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c32c0 msgr2=0x559b5d2cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33a5e00640 1 --2- 172.21.15.8:0/2227151956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c32c0 0x559b5d2cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33a5e00640 1 -- 172.21.15.8:0/2227151956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b5d1c5950 con 0x559b5d2cc630 2024-03-16T21:03:17.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.422+0000 7f33a5400640 1 --2- 172.21.15.8:0/2227151956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c32c0 0x559b5d2cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:17.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.423+0000 7f33a5e00640 1 --2- 172.21.15.8:0/2227151956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2cc630 0x559b5d2d7a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3398012f70 tx=0x7f3398017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e825353b25025450 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.423+0000 7f3391c00640 1 -- 172.21.15.8:0/2227151956 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398023070 con 0x559b5d2cc630 2024-03-16T21:03:17.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.423+0000 7f3391c00640 1 -- 172.21.15.8:0/2227151956 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3398024040 con 0x559b5d2cc630 2024-03-16T21:03:17.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.423+0000 7f3391c00640 1 -- 172.21.15.8:0/2227151956 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398017070 con 0x559b5d2cc630 2024-03-16T21:03:17.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.424+0000 7f33aab8e740 1 -- 172.21.15.8:0/2227151956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2cc630 msgr2=0x559b5d2d7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.424+0000 7f33aab8e740 1 --2- 172.21.15.8:0/2227151956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2cc630 0x559b5d2d7a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3398012f70 tx=0x7f3398017000 comp rx=0 tx=0).stop 2024-03-16T21:03:17.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.424+0000 7f33aab8e740 1 -- 172.21.15.8:0/2227151956 shutdown_connections 2024-03-16T21:03:17.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.424+0000 7f33aab8e740 1 --2- 172.21.15.8:0/2227151956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2cc630 0x559b5d2d7a70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.424+0000 7f33aab8e740 1 --2- 172.21.15.8:0/2227151956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.424+0000 7f33aab8e740 1 --2- 172.21.15.8:0/2227151956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2c32c0 0x559b5d2cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.424+0000 7f33aab8e740 1 -- 172.21.15.8:0/2227151956 >> 172.21.15.8:0/2227151956 conn(0x559b5d28a5a0 msgr2=0x559b5d2bf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.424+0000 7f33aab8e740 1 -- 172.21.15.8:0/2227151956 shutdown_connections 2024-03-16T21:03:17.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.424+0000 7f33aab8e740 1 -- 172.21.15.8:0/2227151956 wait complete. 2024-03-16T21:03:17.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.424+0000 7f33aab8e740 1 -- start start 2024-03-16T21:03:17.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.424+0000 7f33aab8e740 1 Processor -- start 2024-03-16T21:03:17.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 0x559b5d2ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33aab8e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2cc630 0x559b5d2c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33aab8e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5d2c6390 con 0x559b5d2c32c0 2024-03-16T21:03:17.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33aab8e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5d2c64d0 con 0x559b5d2cc630 2024-03-16T21:03:17.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33aab8e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b5d2c6690 con 0x559b5d2c3fa0 2024-03-16T21:03:17.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33aab8e740 10 client.0 _ll_register_callbacks cb 0x7f338c005650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:17.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33a5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 0x559b5d2ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33a5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2cc630 0x559b5d2c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33a4a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33a5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 0x559b5d2ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58060/0 (socket says 172.21.15.8:58060) 2024-03-16T21:03:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33a5400640 1 -- 172.21.15.8:0/1781755552 learned_addr learned my addr 172.21.15.8:0/1781755552 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.425+0000 7f33a5e00640 1 -- 172.21.15.8:0/1781755552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c3fa0 msgr2=0x559b5d2c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f33a5e00640 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f33a5e00640 1 -- 172.21.15.8:0/1781755552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 msgr2=0x559b5d2ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f33a5e00640 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 0x559b5d2ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f33a5e00640 1 -- 172.21.15.8:0/1781755552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b5d1e4060 con 0x559b5d2cc630 2024-03-16T21:03:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f33a5400640 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 0x559b5d2ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f33a4a00640 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f33a5e00640 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2cc630 0x559b5d2c5db0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3398019040 tx=0x7f3398004f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc219928331aa96 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f3386a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f3386a00640 1 -- 172.21.15.8:0/1781755552 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398023070 con 0x559b5d2cc630 2024-03-16T21:03:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f3386a00640 1 -- 172.21.15.8:0/1781755552 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f339801da50 con 0x559b5d2cc630 2024-03-16T21:03:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f33aab8e740 1 -- 172.21.15.8:0/1781755552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3394004180 con 0x559b5d2cc630 2024-03-16T21:03:17.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f3386a00640 1 -- 172.21.15.8:0/1781755552 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3398004100 con 0x559b5d2cc630 2024-03-16T21:03:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f33aab8e740 10 client.26879 fetch_fsmap learned FSMap version 34 2024-03-16T21:03:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.426+0000 7f33aab8e740 1 -- 172.21.15.8:0/1781755552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f3398012c20 con 0x559b5d2cc630 2024-03-16T21:03:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.427+0000 7f3386a00640 1 -- 172.21.15.8:0/1781755552 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3394004180 con 0x559b5d2cc630 2024-03-16T21:03:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.427+0000 7f3386a00640 1 -- 172.21.15.8:0/1781755552 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 34) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f3398005550 con 0x559b5d2cc630 2024-03-16T21:03:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.427+0000 7f33aab8e740 10 client.26879 fetch_fsmap finished waiting for FSMap version 34 2024-03-16T21:03:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.427+0000 7f33aab8e740 10 client.26879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.427+0000 7f33aab8e740 20 client.26879 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.427+0000 7f33aab8e740 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559b5d341cf0 0x559b5d344110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:17.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.427+0000 7f33aab8e740 4 client.26879 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:03:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.427+0000 7f33aab8e740 1 -- 172.21.15.8:0/1781755552 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559b5cfb6890 con 0x559b5d341cf0 2024-03-16T21:03:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.427+0000 7f33a5400640 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559b5d341cf0 0x559b5d344110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33a5400640 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559b5d341cf0 0x559b5d344110 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26762c3316c78a7e server_cookie=a334cc3db1c936e0 in_seq=0 out_seq=0 2024-03-16T21:03:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f3386a00640 10 client.26879 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f3386a00640 1 -- 172.21.15.8:0/1781755552 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559b5cfb6890 con 0x559b5d341cf0 2024-03-16T21:03:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f3386a00640 10 client.26879 handle_command_reply: tid=0 2024-03-16T21:03:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33aab8e740 1 client.26879 shutdown 2024-03-16T21:03:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33aab8e740 1 -- 172.21.15.8:0/1781755552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2cc630 msgr2=0x559b5d2c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33aab8e740 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2cc630 0x559b5d2c5db0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3398019040 tx=0x7f3398004f40 comp rx=0 tx=0).stop 2024-03-16T21:03:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33aab8e740 1 -- 172.21.15.8:0/1781755552 shutdown_connections 2024-03-16T21:03:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33aab8e740 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b5d2cc630 0x559b5d2c5db0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33aab8e740 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b5d2c3fa0 0x559b5d2c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33aab8e740 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559b5d341cf0 0x559b5d344110 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33aab8e740 1 --2- 172.21.15.8:0/1781755552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559b5d2c32c0 0x559b5d2ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33aab8e740 1 -- 172.21.15.8:0/1781755552 >> 172.21.15.8:0/1781755552 conn(0x559b5d28a5a0 msgr2=0x559b5d2beeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f3386a00640 0 client.26879 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33aab8e740 1 -- 172.21.15.8:0/1781755552 shutdown_connections 2024-03-16T21:03:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.428+0000 7f33aab8e740 1 -- 172.21.15.8:0/1781755552 wait complete. 2024-03-16T21:03:17.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33aab8e740 20 client.26879 trim_cache size 0 max 16384 2024-03-16T21:03:17.442 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:03:17.442 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:03:17.442 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:03:17.442 INFO:teuthology.orchestra.run.smithi008.stdout: "32a847ae-8828-49d5-8d9f-fe9ea9bd7bcd": { 2024-03-16T21:03:17.443 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:03:17.443 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "32a847ae-8828-49d5-8d9f-fe9ea9bd7bcd", 2024-03-16T21:03:17.443 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:03:17.443 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:03:17.443 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:03:17.443 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:03:17.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 -- 172.21.15.8:0/1270557262 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f33880a1c20 msgr2=0x7f33880a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f33880a1c20 0x7f33880a40e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3398005fd0 tx=0x7f3398009500 comp rx=0 tx=0).stop 2024-03-16T21:03:17.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 -- 172.21.15.8:0/1270557262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33a0104050 msgr2=0x7f33a019a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:17.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33a0104050 0x7f33a019a3e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f338c000c00 tx=0x7f338c02cc20 comp rx=0 tx=0).stop 2024-03-16T21:03:17.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 -- 172.21.15.8:0/1270557262 shutdown_connections 2024-03-16T21:03:17.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f33880a1c20 0x7f33880a40e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33a01096a0 0x7f33a019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33a0104050 0x7f33a019a3e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 --2- 172.21.15.8:0/1270557262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33a0103690 0x7f33a0199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:17.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 -- 172.21.15.8:0/1270557262 >> 172.21.15.8:0/1270557262 conn(0x7f33a00ff140 msgr2=0x7f33a00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:17.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 -- 172.21.15.8:0/1270557262 shutdown_connections 2024-03-16T21:03:17.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:17.429+0000 7f33a7e00640 1 -- 172.21.15.8:0/1270557262 wait complete. 2024-03-16T21:03:17.454 INFO:tasks.cephfs.filesystem:scrub status for tag:32a847ae-8828-49d5-8d9f-fe9ea9bd7bcd - {'path': '/', 'tag': '32a847ae-8828-49d5-8d9f-fe9ea9bd7bcd', 'options': 'recursive,force'} 2024-03-16T21:03:18.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:18 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:03:18.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:18 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:18.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:18 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:03:18.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:18 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:18.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:18 smithi008 ceph-mon[31434]: pgmap v167: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-16T21:03:18.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:18 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:03:19.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:18 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:03:19.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:18 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:19.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:18 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:03:19.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:18 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:19.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:18 smithi170 ceph-mon[35947]: pgmap v167: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-16T21:03:19.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:18 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:03:19.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:18 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:03:19.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:18 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:19.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:18 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:03:19.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:18 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:19.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:18 smithi186 ceph-mon[36391]: pgmap v167: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-16T21:03:19.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:18 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:03:19.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:19 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:20.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:19 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:20.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:19 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:21.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:20 smithi170 ceph-mon[35947]: pgmap v168: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-16T21:03:21.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:20 smithi186 ceph-mon[36391]: pgmap v168: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-16T21:03:21.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:20 smithi008 ceph-mon[31434]: pgmap v168: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-16T21:03:23.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:22 smithi170 ceph-mon[35947]: pgmap v169: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-16T21:03:23.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:22 smithi186 ceph-mon[36391]: pgmap v169: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-16T21:03:23.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:22 smithi008 ceph-mon[31434]: pgmap v169: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-16T21:03:25.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:24 smithi170 ceph-mon[35947]: pgmap v170: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:03:25.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:24 smithi186 ceph-mon[36391]: pgmap v170: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:03:25.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:24 smithi008 ceph-mon[31434]: pgmap v170: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:03:27.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:26 smithi170 ceph-mon[35947]: pgmap v171: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:03:27.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:26 smithi186 ceph-mon[36391]: pgmap v171: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:03:27.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:26 smithi008 ceph-mon[31434]: pgmap v171: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:03:29.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:28 smithi170 ceph-mon[35947]: pgmap v172: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:03:29.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:28 smithi186 ceph-mon[36391]: pgmap v172: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:03:29.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:28 smithi008 ceph-mon[31434]: pgmap v172: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:03:30.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:29 smithi170 ceph-mon[35947]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:30.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:29 smithi186 ceph-mon[36391]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:30.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:29 smithi008 ceph-mon[31434]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-16T21:03:31.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:30 smithi170 ceph-mon[35947]: pgmap v173: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:03:31.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:30 smithi186 ceph-mon[36391]: pgmap v173: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:03:31.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:30 smithi008 ceph-mon[31434]: pgmap v173: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:03:33.048 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:32 smithi008 ceph-mon[31434]: pgmap v174: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:03:33.117 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:32 smithi170 ceph-mon[35947]: pgmap v174: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:03:33.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:32 smithi186 ceph-mon[36391]: pgmap v174: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:03:35.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:34 smithi170 ceph-mon[35947]: pgmap v175: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:35.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:34 smithi186 ceph-mon[36391]: pgmap v175: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:35.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:34 smithi008 ceph-mon[31434]: pgmap v175: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:37.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:36 smithi170 ceph-mon[35947]: pgmap v176: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:03:37.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:36 smithi186 ceph-mon[36391]: pgmap v176: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:03:37.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:36 smithi008 ceph-mon[31434]: pgmap v176: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:03:39.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:38 smithi170 ceph-mon[35947]: pgmap v177: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:39.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:38 smithi186 ceph-mon[36391]: pgmap v177: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:39.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:38 smithi008 ceph-mon[31434]: pgmap v177: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:41.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:40 smithi170 ceph-mon[35947]: pgmap v178: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:41.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:40 smithi186 ceph-mon[36391]: pgmap v178: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:41.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:40 smithi008 ceph-mon[31434]: pgmap v178: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:43.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:42 smithi170 ceph-mon[35947]: pgmap v179: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:43.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:42 smithi186 ceph-mon[36391]: pgmap v179: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:43.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:42 smithi008 ceph-mon[31434]: pgmap v179: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:45.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:44 smithi170 ceph-mon[35947]: pgmap v180: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:45.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:44 smithi186 ceph-mon[36391]: pgmap v180: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:45.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:44 smithi008 ceph-mon[31434]: pgmap v180: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:47.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:46 smithi170 ceph-mon[35947]: pgmap v181: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:03:47.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:46 smithi186 ceph-mon[36391]: pgmap v181: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:03:47.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:46 smithi008 ceph-mon[31434]: pgmap v181: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:03:47.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:03:47.455 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:03:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.688+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1492857416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a8074240 msgr2=0x7fc9a810d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.688+0000 7fc9a7e00640 1 --2- 172.21.15.8:0/1492857416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a8074240 0x7fc9a810d660 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc994009900 tx=0x7fc99402bcd0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.689+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1492857416 shutdown_connections 2024-03-16T21:03:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.689+0000 7fc9a7e00640 1 --2- 172.21.15.8:0/1492857416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9a810dba0 0x7fc9a810fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.689+0000 7fc9a7e00640 1 --2- 172.21.15.8:0/1492857416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a8074240 0x7fc9a810d660 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.689+0000 7fc9a7e00640 1 --2- 172.21.15.8:0/1492857416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9a8073920 0x7fc9a8073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.689+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1492857416 >> 172.21.15.8:0/1492857416 conn(0x7fc9a80fce50 msgr2=0x7fc9a80ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.689+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1492857416 shutdown_connections 2024-03-16T21:03:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.689+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1492857416 wait complete. 2024-03-16T21:03:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.690+0000 7fc9a7e00640 1 Processor -- start 2024-03-16T21:03:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.690+0000 7fc9a7e00640 1 -- start start 2024-03-16T21:03:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.691+0000 7fc9a7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a8073920 0x7fc9a819f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.691+0000 7fc9a7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9a8074240 0x7fc9a819fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.691+0000 7fc9a7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9a810dba0 0x7fc9a8199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.691+0000 7fc9a7e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a819a180 con 0x7fc9a8074240 2024-03-16T21:03:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.691+0000 7fc9a7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a819a2f0 con 0x7fc9a810dba0 2024-03-16T21:03:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.691+0000 7fc9a7e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a819a4b0 con 0x7fc9a8073920 2024-03-16T21:03:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.691+0000 7fc9a6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a8073920 0x7fc9a819f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.691+0000 7fc9a6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a8073920 0x7fc9a819f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52664/0 (socket says 172.21.15.8:52664) 2024-03-16T21:03:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.691+0000 7fc9a6a00640 1 -- 172.21.15.8:0/1113872921 learned_addr learned my addr 172.21.15.8:0/1113872921 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.691+0000 7fc9a6000640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9a8074240 0x7fc9a819fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.691+0000 7fc9a7400640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9a810dba0 0x7fc9a8199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.692+0000 7fc9a6a00640 1 -- 172.21.15.8:0/1113872921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9a810dba0 msgr2=0x7fc9a8199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.692+0000 7fc9a6a00640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9a810dba0 0x7fc9a8199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.692+0000 7fc9a6a00640 1 -- 172.21.15.8:0/1113872921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9a8074240 msgr2=0x7fc9a819fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.692+0000 7fc9a6a00640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9a8074240 0x7fc9a819fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.692+0000 7fc9a6a00640 1 -- 172.21.15.8:0/1113872921 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc994009560 con 0x7fc9a8073920 2024-03-16T21:03:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.692+0000 7fc9a6a00640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a8073920 0x7fc9a819f930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc99800e9f0 tx=0x7fc99800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.692+0000 7fc99f400640 1 -- 172.21.15.8:0/1113872921 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998009700 con 0x7fc9a8073920 2024-03-16T21:03:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.692+0000 7fc99f400640 1 -- 172.21.15.8:0/1113872921 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc99800cd80 con 0x7fc9a8073920 2024-03-16T21:03:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.692+0000 7fc99f400640 1 -- 172.21.15.8:0/1113872921 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9980189c0 con 0x7fc9a8073920 2024-03-16T21:03:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.692+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1113872921 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a819a790 con 0x7fc9a8073920 2024-03-16T21:03:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.692+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1113872921 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a81a69d0 con 0x7fc9a8073920 2024-03-16T21:03:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.695+0000 7fc99f400640 1 -- 172.21.15.8:0/1113872921 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fc998018b20 con 0x7fc9a8073920 2024-03-16T21:03:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9b07c8740 1 Processor -- start 2024-03-16T21:03:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9b07c8740 1 -- start start 2024-03-16T21:03:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa627ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa628490 0x5566aa628910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa631800 0x5566aa633bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa597150 con 0x5566aa628490 2024-03-16T21:03:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa594680 con 0x5566aa629170 2024-03-16T21:03:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa58fe60 con 0x5566aa631800 2024-03-16T21:03:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9a6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa628490 0x5566aa628910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9a6000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa631800 0x5566aa633bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9a7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa627ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9a7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa627ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50856/0 (socket says 172.21.15.8:50856) 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.696+0000 7fc9a6000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa631800 0x5566aa633bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52674/0 (socket says 172.21.15.8:52674) 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc9a7400640 1 -- 172.21.15.8:0/1075769089 learned_addr learned my addr 172.21.15.8:0/1075769089 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc9a7400640 1 -- 172.21.15.8:0/1075769089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa631800 msgr2=0x5566aa633bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc9a7400640 1 --2- 172.21.15.8:0/1075769089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa631800 0x5566aa633bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc9a7400640 1 -- 172.21.15.8:0/1075769089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa628490 msgr2=0x5566aa628910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc9a7400640 1 --2- 172.21.15.8:0/1075769089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa628490 0x5566aa628910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc9a7400640 1 -- 172.21.15.8:0/1075769089 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566aa549060 con 0x5566aa629170 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc9a6000640 1 --2- 172.21.15.8:0/1075769089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa631800 0x5566aa633bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc99f400640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc98c0a1c20 0x7fc98c0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc9a7400640 1 --2- 172.21.15.8:0/1075769089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa627ec0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009f50 tx=0x7fc9a00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=232b7a0a6a050c43 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc99f400640 1 -- 172.21.15.8:0/1113872921 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc998014070 con 0x7fc9a8073920 2024-03-16T21:03:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc993e00640 1 -- 172.21.15.8:0/1075769089 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0004d20 con 0x5566aa629170 2024-03-16T21:03:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.697+0000 7fc9a6a00640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc98c0a1c20 0x7fc98c0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc993e00640 1 -- 172.21.15.8:0/1075769089 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc9a0004e80 con 0x5566aa629170 2024-03-16T21:03:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc993e00640 1 -- 172.21.15.8:0/1075769089 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0005260 con 0x5566aa629170 2024-03-16T21:03:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc9b07c8740 1 -- 172.21.15.8:0/1075769089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 msgr2=0x5566aa627ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc9a6a00640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc98c0a1c20 0x7fc98c0a40e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5566aa6296c0 tx=0x7fc9980d3530 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/1075769089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa627ec0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009f50 tx=0x7fc9a00118d0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc9b07c8740 1 -- 172.21.15.8:0/1075769089 shutdown_connections 2024-03-16T21:03:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/1075769089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa631800 0x5566aa633bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/1075769089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa628490 0x5566aa628910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/1075769089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa627ec0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc9b07c8740 1 -- 172.21.15.8:0/1075769089 >> 172.21.15.8:0/1075769089 conn(0x5566aa5ef5a0 msgr2=0x5566aa622ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc9b07c8740 1 -- 172.21.15.8:0/1075769089 shutdown_connections 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.698+0000 7fc9b07c8740 1 -- 172.21.15.8:0/1075769089 wait complete. 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.699+0000 7fc9b07c8740 1 -- start start 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.699+0000 7fc9b07c8740 1 Processor -- start 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa628490 0x5566aa62e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa629170 0x5566aa62ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa631800 0x5566aa62f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa534ec0 con 0x5566aa631800 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa534b60 con 0x5566aa628490 2024-03-16T21:03:47.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa2fe1c0 con 0x5566aa629170 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9b07c8740 10 client.0 _ll_register_callbacks cb 0x5566aa548960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9a7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa628490 0x5566aa62e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9a6000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa629170 0x5566aa62ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9a7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa628490 0x5566aa62e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50870/0 (socket says 172.21.15.8:50870) 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9a6000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa629170 0x5566aa62ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52682/0 (socket says 172.21.15.8:52682) 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9a7400640 1 -- 172.21.15.8:0/2096158388 learned_addr learned my addr 172.21.15.8:0/2096158388 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.700+0000 7fc9a7400640 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa631800 0x5566aa62f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.701+0000 7fc9a6000640 1 -- 172.21.15.8:0/2096158388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa628490 msgr2=0x5566aa62e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.701+0000 7fc9a6000640 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa628490 0x5566aa62e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.701+0000 7fc9a6000640 1 -- 172.21.15.8:0/2096158388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa631800 msgr2=0x5566aa62f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.701+0000 7fc9a6000640 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa631800 0x5566aa62f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.701+0000 7fc9a6000640 1 -- 172.21.15.8:0/2096158388 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a0009c00 con 0x5566aa629170 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.701+0000 7fc9a6000640 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa629170 0x5566aa62ece0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc99402c210 tx=0x7fc994004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7f52af381dbbe5c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:47.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.701+0000 7fc990c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.701+0000 7fc990c00640 1 -- 172.21.15.8:0/2096158388 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994004500 con 0x5566aa629170 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.701+0000 7fc990c00640 1 -- 172.21.15.8:0/2096158388 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc99402c950 con 0x5566aa629170 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.701+0000 7fc9b07c8740 1 -- 172.21.15.8:0/2096158388 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566aa2cc720 con 0x5566aa629170 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.702+0000 7fc990c00640 1 -- 172.21.15.8:0/2096158388 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc99402cb10 con 0x5566aa629170 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.702+0000 7fc9b07c8740 10 client.26899 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.702+0000 7fc9b07c8740 1 -- 172.21.15.8:0/2096158388 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5566aa58e4e0 con 0x5566aa629170 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.702+0000 7fc990c00640 1 -- 172.21.15.8:0/2096158388 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5566aa2cc720 con 0x5566aa629170 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.702+0000 7fc990c00640 1 -- 172.21.15.8:0/2096158388 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fc994046020 con 0x5566aa629170 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.702+0000 7fc9b07c8740 10 client.26899 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.702+0000 7fc9b07c8740 10 client.26899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.702+0000 7fc9b07c8740 20 client.26899 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.702+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5566aa641a00 0x5566aa643e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.702+0000 7fc9b07c8740 4 client.26899 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.702+0000 7fc9b07c8740 1 -- 172.21.15.8:0/2096158388 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5566aa31b890 con 0x5566aa641a00 2024-03-16T21:03:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.703+0000 7fc9a7400640 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5566aa641a00 0x5566aa643e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.703+0000 7fc9a7400640 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5566aa641a00 0x5566aa643e20 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=921dfd621556c5c0 server_cookie=1f2170961c47f097 in_seq=0 out_seq=0 2024-03-16T21:03:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.703+0000 7fc990c00640 10 client.26899 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc990c00640 1 -- 172.21.15.8:0/2096158388 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5566aa31b890 con 0x5566aa641a00 2024-03-16T21:03:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc990c00640 10 client.26899 handle_command_reply: tid=0 2024-03-16T21:03:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 1 client.26899 shutdown 2024-03-16T21:03:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 1 -- 172.21.15.8:0/2096158388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa629170 msgr2=0x5566aa62ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa629170 0x5566aa62ece0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc99402c210 tx=0x7fc994004040 comp rx=0 tx=0).stop 2024-03-16T21:03:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 1 -- 172.21.15.8:0/2096158388 shutdown_connections 2024-03-16T21:03:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5566aa641a00 0x5566aa643e20 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa631800 0x5566aa62f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa629170 0x5566aa62ece0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc990c00640 0 client.26899 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/2096158388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa628490 0x5566aa62e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 1 -- 172.21.15.8:0/2096158388 >> 172.21.15.8:0/2096158388 conn(0x5566aa5ef5a0 msgr2=0x5566aa624c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 1 -- 172.21.15.8:0/2096158388 shutdown_connections 2024-03-16T21:03:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 1 -- 172.21.15.8:0/2096158388 wait complete. 2024-03-16T21:03:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.704+0000 7fc9b07c8740 20 client.26899 trim_cache size 0 max 16384 2024-03-16T21:03:47.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.722+0000 7fc9b07c8740 1 Processor -- start 2024-03-16T21:03:47.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.722+0000 7fc9b07c8740 1 -- start start 2024-03-16T21:03:47.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.723+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 0x5566aa630ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.723+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa629170 0x5566aa62f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.723+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa631800 0x5566aa621de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.723+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa628e00 con 0x5566aa629170 2024-03-16T21:03:47.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.723+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa622750 con 0x5566aa631800 2024-03-16T21:03:47.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.723+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa634550 con 0x5566aa628490 2024-03-16T21:03:47.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.723+0000 7fc9a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 0x5566aa630ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.723+0000 7fc9a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 0x5566aa630ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:52686/0 (socket says 172.21.15.8:52686) 2024-03-16T21:03:47.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.723+0000 7fc9a7400640 1 -- 172.21.15.8:0/1342930687 learned_addr learned my addr 172.21.15.8:0/1342930687 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:47.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.723+0000 7fc9a7400640 1 --2- 172.21.15.8:0/1342930687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa631800 0x5566aa621de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.723+0000 7fc9a6000640 1 --2- 172.21.15.8:0/1342930687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa629170 0x5566aa62f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.724+0000 7fc9a7400640 1 -- 172.21.15.8:0/1342930687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa631800 msgr2=0x5566aa621de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:47.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.724+0000 7fc9a7400640 1 --2- 172.21.15.8:0/1342930687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa631800 0x5566aa621de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.724+0000 7fc9a7400640 1 -- 172.21.15.8:0/1342930687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa629170 msgr2=0x5566aa62f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:47.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.724+0000 7fc9a7400640 1 --2- 172.21.15.8:0/1342930687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa629170 0x5566aa62f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.724+0000 7fc9a7400640 1 -- 172.21.15.8:0/1342930687 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566aa62a3e0 con 0x5566aa628490 2024-03-16T21:03:47.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.724+0000 7fc9a7400640 1 --2- 172.21.15.8:0/1342930687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 0x5566aa630ed0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0011910 tx=0x7fc9a0004510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2f9352de2430022 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:47.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.724+0000 7fc993400640 1 -- 172.21.15.8:0/1342930687 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a002f170 con 0x5566aa628490 2024-03-16T21:03:47.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.724+0000 7fc993400640 1 -- 172.21.15.8:0/1342930687 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc9a002f2d0 con 0x5566aa628490 2024-03-16T21:03:47.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.724+0000 7fc993400640 1 -- 172.21.15.8:0/1342930687 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00056d0 con 0x5566aa628490 2024-03-16T21:03:47.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.725+0000 7fc9b07c8740 1 -- 172.21.15.8:0/1342930687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 msgr2=0x5566aa630ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.725+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/1342930687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 0x5566aa630ed0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0011910 tx=0x7fc9a0004510 comp rx=0 tx=0).stop 2024-03-16T21:03:47.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.725+0000 7fc9b07c8740 1 -- 172.21.15.8:0/1342930687 shutdown_connections 2024-03-16T21:03:47.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.725+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/1342930687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa631800 0x5566aa621de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.725+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/1342930687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa629170 0x5566aa62f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.725+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/1342930687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 0x5566aa630ed0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.725+0000 7fc9b07c8740 1 -- 172.21.15.8:0/1342930687 >> 172.21.15.8:0/1342930687 conn(0x5566aa5ef5a0 msgr2=0x5566aa6216d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:47.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.725+0000 7fc9b07c8740 1 -- 172.21.15.8:0/1342930687 shutdown_connections 2024-03-16T21:03:47.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.725+0000 7fc9b07c8740 1 -- 172.21.15.8:0/1342930687 wait complete. 2024-03-16T21:03:47.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.726+0000 7fc9b07c8740 1 -- start start 2024-03-16T21:03:47.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.726+0000 7fc9b07c8740 1 Processor -- start 2024-03-16T21:03:47.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.726+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 0x5566aa62b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa62be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9b07c8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa631800 0x5566aa695270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa6957e0 con 0x5566aa631800 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa695950 con 0x5566aa629170 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9b07c8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566aa695b10 con 0x5566aa628490 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9b07c8740 10 client.0 _ll_register_callbacks cb 0x7fc994004b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 0x5566aa62b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9a6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa62be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9a6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa62be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:50892/0 (socket says 172.21.15.8:50892) 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9a6000640 1 -- 172.21.15.8:0/3464670952 learned_addr learned my addr 172.21.15.8:0/3464670952 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9a7400640 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa631800 0x5566aa695270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9a6000640 1 -- 172.21.15.8:0/3464670952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 msgr2=0x5566aa62b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:47.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9a6000640 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 0x5566aa62b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9a6000640 1 -- 172.21.15.8:0/3464670952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa631800 msgr2=0x5566aa695270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9a6000640 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa631800 0x5566aa695270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9a6000640 1 -- 172.21.15.8:0/3464670952 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5566aa549060 con 0x5566aa629170 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc9a6000640 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa62be60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc994009900 tx=0x7fc994009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=181401983299d9ef server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.727+0000 7fc990c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc990c00640 1 -- 172.21.15.8:0/3464670952 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99402cb50 con 0x5566aa629170 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc9b07c8740 1 -- 172.21.15.8:0/3464670952 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566aa28f7e0 con 0x5566aa629170 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc990c00640 1 -- 172.21.15.8:0/3464670952 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc994000e40 con 0x5566aa629170 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc990c00640 1 -- 172.21.15.8:0/3464670952 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9940039d0 con 0x5566aa629170 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc9b07c8740 10 client.26897 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc9b07c8740 1 -- 172.21.15.8:0/3464670952 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5566aa52a950 con 0x5566aa629170 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc990c00640 1 -- 172.21.15.8:0/3464670952 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5566aa28f7e0 con 0x5566aa629170 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc990c00640 1 -- 172.21.15.8:0/3464670952 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fc994046040 con 0x5566aa629170 2024-03-16T21:03:47.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc9b07c8740 10 client.26897 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc9b07c8740 10 client.26897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc9b07c8740 20 client.26897 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.728+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5566aa69e320 0x5566aa6a0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.729+0000 7fc9b07c8740 4 client.26897 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.729+0000 7fc9b07c8740 1 -- 172.21.15.8:0/3464670952 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5566aa23b700 con 0x5566aa69e320 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.729+0000 7fc9a7400640 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5566aa69e320 0x5566aa6a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.729+0000 7fc9a7400640 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5566aa69e320 0x5566aa6a0740 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de14f7f4ecf893f server_cookie=2ff3f8ebb4e72b0f in_seq=0 out_seq=0 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.729+0000 7fc990c00640 10 client.26897 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.729+0000 7fc990c00640 1 -- 172.21.15.8:0/3464670952 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5566aa23b700 con 0x5566aa69e320 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.729+0000 7fc990c00640 10 client.26897 handle_command_reply: tid=0 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.729+0000 7fc9b07c8740 1 client.26897 shutdown 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc9b07c8740 1 -- 172.21.15.8:0/3464670952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 msgr2=0x5566aa62be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa62be60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc994009900 tx=0x7fc994009290 comp rx=0 tx=0).stop 2024-03-16T21:03:47.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc9b07c8740 1 -- 172.21.15.8:0/3464670952 shutdown_connections 2024-03-16T21:03:47.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5566aa69e320 0x5566aa6a0740 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566aa631800 0x5566aa695270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5566aa629170 0x5566aa62be60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc990c00640 0 client.26897 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:47.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc9b07c8740 1 --2- 172.21.15.8:0/3464670952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5566aa628490 0x5566aa62b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc9b07c8740 1 -- 172.21.15.8:0/3464670952 >> 172.21.15.8:0/3464670952 conn(0x5566aa5ef5a0 msgr2=0x5566aa6216d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:47.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc9b07c8740 1 -- 172.21.15.8:0/3464670952 shutdown_connections 2024-03-16T21:03:47.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc9b07c8740 1 -- 172.21.15.8:0/3464670952 wait complete. 2024-03-16T21:03:47.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.730+0000 7fc9b07c8740 20 client.26897 trim_cache size 0 max 16384 2024-03-16T21:03:47.740 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:03:47.741 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:03:47.741 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:03:47.741 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:03:47.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1113872921 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc98c0a1c20 msgr2=0x7fc98c0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc98c0a1c20 0x7fc98c0a40e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5566aa6296c0 tx=0x7fc9980d3530 comp rx=0 tx=0).stop 2024-03-16T21:03:47.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1113872921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a8073920 msgr2=0x7fc9a819f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a8073920 0x7fc9a819f930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc99800e9f0 tx=0x7fc99800eeb0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1113872921 shutdown_connections 2024-03-16T21:03:47.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc98c0a1c20 0x7fc98c0a40e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9a810dba0 0x7fc9a8199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9a8074240 0x7fc9a819fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 --2- 172.21.15.8:0/1113872921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a8073920 0x7fc9a819f930 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1113872921 >> 172.21.15.8:0/1113872921 conn(0x7fc9a80fce50 msgr2=0x7fc9a80fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:47.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1113872921 shutdown_connections 2024-03-16T21:03:47.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.731+0000 7fc9a7e00640 1 -- 172.21.15.8:0/1113872921 wait complete. 2024-03-16T21:03:47.757 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:03:47.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.986+0000 7fe77e600640 1 -- 172.21.15.8:0/1837101072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7781078b0 msgr2=0x7fe778107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.986+0000 7fe77e600640 1 --2- 172.21.15.8:0/1837101072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7781078b0 0x7fe778107d30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe768009930 tx=0x7fe76802bc20 comp rx=0 tx=0).stop 2024-03-16T21:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.986+0000 7fe77e600640 1 -- 172.21.15.8:0/1837101072 shutdown_connections 2024-03-16T21:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.986+0000 7fe77e600640 1 --2- 172.21.15.8:0/1837101072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778108270 0x7fe778114780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.986+0000 7fe77e600640 1 --2- 172.21.15.8:0/1837101072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7781078b0 0x7fe778107d30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.986+0000 7fe77e600640 1 --2- 172.21.15.8:0/1837101072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe77810d8c0 0x7fe77810dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.986+0000 7fe77e600640 1 -- 172.21.15.8:0/1837101072 >> 172.21.15.8:0/1837101072 conn(0x7fe778077010 msgr2=0x7fe778079430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.987+0000 7fe77e600640 1 -- 172.21.15.8:0/1837101072 shutdown_connections 2024-03-16T21:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.987+0000 7fe77e600640 1 -- 172.21.15.8:0/1837101072 wait complete. 2024-03-16T21:03:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77e600640 1 Processor -- start 2024-03-16T21:03:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77e600640 1 -- start start 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7781078b0 0x7fe77819e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778108270 0x7fe77819e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77810d8c0 0x7fe7781a2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77e600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7781a2f70 con 0x7fe77810d8c0 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77e600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7781a30e0 con 0x7fe778108270 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77e600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7781a32a0 con 0x7fe7781078b0 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe777e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778108270 0x7fe77819e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77dc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77810d8c0 0x7fe7781a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77d200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7781078b0 0x7fe77819e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe777e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778108270 0x7fe77819e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34244/0 (socket says 172.21.15.8:34244) 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe777e00640 1 -- 172.21.15.8:0/1937438902 learned_addr learned my addr 172.21.15.8:0/1937438902 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77d200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7781078b0 0x7fe77819e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33684/0 (socket says 172.21.15.8:33684) 2024-03-16T21:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.988+0000 7fe77dc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77810d8c0 0x7fe7781a2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55996/0 (socket says 172.21.15.8:55996) 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.989+0000 7fe777e00640 1 -- 172.21.15.8:0/1937438902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7781078b0 msgr2=0x7fe77819e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.989+0000 7fe777e00640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7781078b0 0x7fe77819e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.989+0000 7fe777e00640 1 -- 172.21.15.8:0/1937438902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77810d8c0 msgr2=0x7fe7781a2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.989+0000 7fe777e00640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77810d8c0 0x7fe7781a2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.989+0000 7fe777e00640 1 -- 172.21.15.8:0/1937438902 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe770009840 con 0x7fe778108270 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.989+0000 7fe77d200640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7781078b0 0x7fe77819e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.989+0000 7fe777e00640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778108270 0x7fe77819e5f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe768009230 tx=0x7fe76802cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.989+0000 7fe775600640 1 -- 172.21.15.8:0/1937438902 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768004450 con 0x7fe778108270 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.989+0000 7fe77e600640 1 -- 172.21.15.8:0/1937438902 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe768009560 con 0x7fe778108270 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.989+0000 7fe775600640 1 -- 172.21.15.8:0/1937438902 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe768005310 con 0x7fe778108270 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.989+0000 7fe775600640 1 -- 172.21.15.8:0/1937438902 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768003d20 con 0x7fe778108270 2024-03-16T21:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.990+0000 7fe77e600640 1 -- 172.21.15.8:0/1937438902 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7781aac20 con 0x7fe778108270 2024-03-16T21:03:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.991+0000 7fe77e600640 1 -- 172.21.15.8:0/1937438902 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe778068650 con 0x7fe778108270 2024-03-16T21:03:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.992+0000 7fe775600640 1 -- 172.21.15.8:0/1937438902 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fe768005480 con 0x7fe778108270 2024-03-16T21:03:48.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.994+0000 7fe775600640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe7600a1ba0 0x7fe7600a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.995+0000 7fe775600640 1 -- 172.21.15.8:0/1937438902 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe7680ef9c0 con 0x7fe778108270 2024-03-16T21:03:48.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.995+0000 7fe77d200640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe7600a1ba0 0x7fe7600a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:47.995+0000 7fe77d200640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe7600a1ba0 0x7fe7600a4060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009f40 tx=0x7fe76c005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.002+0000 7fe775600640 1 -- 172.21.15.8:0/1937438902 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe7680b8970 con 0x7fe778108270 2024-03-16T21:03:48.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.248+0000 7fe77e600640 1 -- 172.21.15.8:0/1937438902 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe77810fe40 con 0x7fe778108270 2024-03-16T21:03:48.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.249+0000 7fe775600640 1 -- 172.21.15.8:0/1937438902 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11387 (secure 0 0 0) 0x7fe7680bc030 con 0x7fe778108270 2024-03-16T21:03:48.256 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:03:48.256 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:27.879028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:03:48.256 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-03-16T21:03:48.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 -- 172.21.15.8:0/1937438902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe7600a1ba0 msgr2=0x7fe7600a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe7600a1ba0 0x7fe7600a4060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009f40 tx=0x7fe76c005f90 comp rx=0 tx=0).stop 2024-03-16T21:03:48.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 -- 172.21.15.8:0/1937438902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778108270 msgr2=0x7fe77819e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778108270 0x7fe77819e5f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe768009230 tx=0x7fe76802cc10 comp rx=0 tx=0).stop 2024-03-16T21:03:48.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 -- 172.21.15.8:0/1937438902 shutdown_connections 2024-03-16T21:03:48.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe7600a1ba0 0x7fe7600a4060 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe77810d8c0 0x7fe7781a2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe778108270 0x7fe77819e5f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 --2- 172.21.15.8:0/1937438902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7781078b0 0x7fe77819e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 -- 172.21.15.8:0/1937438902 >> 172.21.15.8:0/1937438902 conn(0x7fe778077010 msgr2=0x7fe7780775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 -- 172.21.15.8:0/1937438902 shutdown_connections 2024-03-16T21:03:48.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.252+0000 7fe77e600640 1 -- 172.21.15.8:0/1937438902 wait complete. 2024-03-16T21:03:48.277 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:03:48.278 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:03:48.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.495+0000 7fa706800640 1 -- 172.21.15.8:0/2942899390 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70006a3c0 msgr2=0x7fa70010d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.495+0000 7fa706800640 1 --2- 172.21.15.8:0/2942899390 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70006a3c0 0x7fa70010d9c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009be0 tx=0x7fa6f002bef0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.495+0000 7fa706800640 1 -- 172.21.15.8:0/2942899390 shutdown_connections 2024-03-16T21:03:48.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.495+0000 7fa706800640 1 --2- 172.21.15.8:0/2942899390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa70010df00 0x7fa7001102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.495+0000 7fa706800640 1 --2- 172.21.15.8:0/2942899390 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70006a3c0 0x7fa70010d9c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.495+0000 7fa706800640 1 --2- 172.21.15.8:0/2942899390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa700069aa0 0x7fa700069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.495+0000 7fa706800640 1 -- 172.21.15.8:0/2942899390 >> 172.21.15.8:0/2942899390 conn(0x7fa700077480 msgr2=0x7fa700077890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.495+0000 7fa706800640 1 -- 172.21.15.8:0/2942899390 shutdown_connections 2024-03-16T21:03:48.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.496+0000 7fa706800640 1 -- 172.21.15.8:0/2942899390 wait complete. 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa706800640 1 Processor -- start 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa706800640 1 -- start start 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa706800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa700069aa0 0x7fa700199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa706800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70006a3c0 0x7fa70019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa706800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa70010df00 0x7fa70019e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa706800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019ecc0 con 0x7fa70010df00 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa706800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019ee30 con 0x7fa700069aa0 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa706800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019eff0 con 0x7fa70006a3c0 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa6ff400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa700069aa0 0x7fa700199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa6fea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70006a3c0 0x7fa70019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa6ff400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa700069aa0 0x7fa700199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34250/0 (socket says 172.21.15.8:34250) 2024-03-16T21:03:48.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.497+0000 7fa6ff400640 1 -- 172.21.15.8:0/1609365 learned_addr learned my addr 172.21.15.8:0/1609365 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:48.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.498+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa70010df00 0x7fa70019e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.498+0000 7fa6ff400640 1 -- 172.21.15.8:0/1609365 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70006a3c0 msgr2=0x7fa70019a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.498+0000 7fa6ff400640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70006a3c0 0x7fa70019a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.498+0000 7fa6ff400640 1 -- 172.21.15.8:0/1609365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa70010df00 msgr2=0x7fa70019e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.498+0000 7fa6ff400640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa70010df00 0x7fa70019e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.498+0000 7fa6ff400640 1 -- 172.21.15.8:0/1609365 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e8009560 con 0x7fa700069aa0 2024-03-16T21:03:48.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.498+0000 7fa6ff400640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa700069aa0 0x7fa700199e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800e9c0 tx=0x7fa6e800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.498+0000 7fa6f7e00640 1 -- 172.21.15.8:0/1609365 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800cde0 con 0x7fa700069aa0 2024-03-16T21:03:48.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.498+0000 7fa6f7e00640 1 -- 172.21.15.8:0/1609365 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa6e80035f0 con 0x7fa700069aa0 2024-03-16T21:03:48.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.498+0000 7fa6f7e00640 1 -- 172.21.15.8:0/1609365 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8010690 con 0x7fa700069aa0 2024-03-16T21:03:48.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.498+0000 7fa706800640 1 -- 172.21.15.8:0/1609365 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f0009840 con 0x7fa700069aa0 2024-03-16T21:03:48.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.499+0000 7fa706800640 1 -- 172.21.15.8:0/1609365 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7001a6970 con 0x7fa700069aa0 2024-03-16T21:03:48.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.502+0000 7fa6f7e00640 1 -- 172.21.15.8:0/1609365 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fa6e8003b60 con 0x7fa700069aa0 2024-03-16T21:03:48.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.502+0000 7fa7093e2740 1 Processor -- start 2024-03-16T21:03:48.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.502+0000 7fa7093e2740 1 -- start start 2024-03-16T21:03:48.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 0x55d159877020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159877560 0x55d15987fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159880140 0x55d159882530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa7093e2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1597e5210 con 0x55d159880140 2024-03-16T21:03:48.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa7093e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1597e2740 con 0x55d159876c40 2024-03-16T21:03:48.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa7093e2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1597ddf20 con 0x55d159877560 2024-03-16T21:03:48.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 0x55d159877020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 0x55d159877020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34252/0 (socket says 172.21.15.8:34252) 2024-03-16T21:03:48.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa6ff400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159877560 0x55d15987fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa6ffe00640 1 -- 172.21.15.8:0/4264046218 learned_addr learned my addr 172.21.15.8:0/4264046218 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa6fea00640 1 --2- 172.21.15.8:0/4264046218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159880140 0x55d159882530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa6ffe00640 1 -- 172.21.15.8:0/4264046218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159877560 msgr2=0x55d15987fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/4264046218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159877560 0x55d15987fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa6ffe00640 1 -- 172.21.15.8:0/4264046218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159880140 msgr2=0x55d159882530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/4264046218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159880140 0x55d159882530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa6ffe00640 1 -- 172.21.15.8:0/4264046218 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d15979fdf0 con 0x55d159876c40 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.503+0000 7fa6fea00640 1 --2- 172.21.15.8:0/4264046218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159880140 0x55d159882530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.504+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/4264046218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 0x55d159877020 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800bb70 tx=0x7fa6f800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=866003d5f9b9f33d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.504+0000 7fa6f7e00640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa6e40a1c20 0x7fa6e40a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.504+0000 7fa6f4c00640 1 -- 172.21.15.8:0/4264046218 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800be60 con 0x55d159876c40 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.504+0000 7fa6f7e00640 1 -- 172.21.15.8:0/1609365 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa6e8014070 con 0x7fa700069aa0 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.504+0000 7fa6f4c00640 1 -- 172.21.15.8:0/4264046218 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa6f8005520 con 0x55d159876c40 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.504+0000 7fa6f4c00640 1 -- 172.21.15.8:0/4264046218 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80116a0 con 0x55d159876c40 2024-03-16T21:03:48.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.504+0000 7fa6ff400640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa6e40a1c20 0x7fa6e40a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.505+0000 7fa7093e2740 1 -- 172.21.15.8:0/4264046218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 msgr2=0x55d159877020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.505+0000 7fa7093e2740 1 --2- 172.21.15.8:0/4264046218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 0x55d159877020 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800bb70 tx=0x7fa6f800f730 comp rx=0 tx=0).stop 2024-03-16T21:03:48.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.505+0000 7fa6ff400640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa6e40a1c20 0x7fa6e40a40e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55d159876710 tx=0x7fa6e80d14e0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.505+0000 7fa7093e2740 1 -- 172.21.15.8:0/4264046218 shutdown_connections 2024-03-16T21:03:48.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.505+0000 7fa7093e2740 1 --2- 172.21.15.8:0/4264046218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159880140 0x55d159882530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.505+0000 7fa7093e2740 1 --2- 172.21.15.8:0/4264046218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159877560 0x55d15987fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.505+0000 7fa7093e2740 1 --2- 172.21.15.8:0/4264046218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 0x55d159877020 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.505+0000 7fa7093e2740 1 -- 172.21.15.8:0/4264046218 >> 172.21.15.8:0/4264046218 conn(0x55d159871370 msgr2=0x55d159871750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.505+0000 7fa7093e2740 1 -- 172.21.15.8:0/4264046218 shutdown_connections 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.505+0000 7fa7093e2740 1 -- 172.21.15.8:0/4264046218 wait complete. 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.505+0000 7fa7093e2740 1 -- start start 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.506+0000 7fa7093e2740 1 Processor -- start 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.506+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 0x55d15987d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.506+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159877560 0x55d15987d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.506+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159880140 0x55d15987dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.506+0000 7fa7093e2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d159783150 con 0x55d159877560 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.506+0000 7fa7093e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d159782df0 con 0x55d159876c40 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.506+0000 7fa7093e2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d15954c1c0 con 0x55d159880140 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.506+0000 7fa7093e2740 10 client.0 _ll_register_callbacks cb 0x55d1597d22b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:48.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.506+0000 7fa6fea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159877560 0x55d15987d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.506+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 0x55d15987d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6fea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159877560 0x55d15987d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56020/0 (socket says 172.21.15.8:56020) 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6fea00640 1 -- 172.21.15.8:0/203461945 learned_addr learned my addr 172.21.15.8:0/203461945 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 0x55d15987d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34260/0 (socket says 172.21.15.8:34260) 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159880140 0x55d15987dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6fea00640 1 -- 172.21.15.8:0/203461945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159880140 msgr2=0x55d15987dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6fea00640 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159880140 0x55d15987dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6fea00640 1 -- 172.21.15.8:0/203461945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 msgr2=0x55d15987d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6fea00640 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 0x55d15987d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6fea00640 1 -- 172.21.15.8:0/203461945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f800b7d0 con 0x55d159877560 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159880140 0x55d15987dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6fea00640 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159877560 0x55d15987d780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0036040 tx=0x7fa6f0033500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f325e232abb705a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.507+0000 7fa6ed600640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:03:48.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.508+0000 7fa6ed600640 1 -- 172.21.15.8:0/203461945 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0003970 con 0x55d159877560 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.508+0000 7fa6ed600640 1 -- 172.21.15.8:0/203461945 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa6f0045070 con 0x55d159877560 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.508+0000 7fa7093e2740 1 -- 172.21.15.8:0/203461945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1594dd7e0 con 0x55d159877560 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.508+0000 7fa6ed600640 1 -- 172.21.15.8:0/203461945 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6f0003ad0 con 0x55d159877560 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.508+0000 7fa7093e2740 10 client.16734 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.508+0000 7fa7093e2740 1 -- 172.21.15.8:0/203461945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d1597dc5a0 con 0x55d159877560 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.508+0000 7fa6ed600640 1 -- 172.21.15.8:0/203461945 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55d1594dd7e0 con 0x55d159877560 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.509+0000 7fa6ed600640 1 -- 172.21.15.8:0/203461945 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fa6f003c040 con 0x55d159877560 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.509+0000 7fa7093e2740 10 client.16734 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.509+0000 7fa7093e2740 10 client.16734 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.509+0000 7fa7093e2740 20 client.16734 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.509+0000 7fa7093e2740 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d159890260 0x55d159892680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.509+0000 7fa7093e2740 4 client.16734 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:48.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.509+0000 7fa7093e2740 1 -- 172.21.15.8:0/203461945 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d15951a720 con 0x55d159890260 2024-03-16T21:03:48.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.509+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d159890260 0x55d159892680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.509+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d159890260 0x55d159892680 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fccf6be9b831c519 server_cookie=b9a5d11c03f291b6 in_seq=0 out_seq=0 2024-03-16T21:03:48.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.509+0000 7fa6ed600640 10 client.16734 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa6ed600640 1 -- 172.21.15.8:0/203461945 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d15951a720 con 0x55d159890260 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa6ed600640 10 client.16734 handle_command_reply: tid=0 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 1 client.16734 shutdown 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 1 -- 172.21.15.8:0/203461945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159877560 msgr2=0x55d15987d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159877560 0x55d15987d780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0036040 tx=0x7fa6f0033500 comp rx=0 tx=0).stop 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 1 -- 172.21.15.8:0/203461945 shutdown_connections 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d159890260 0x55d159892680 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159880140 0x55d15987dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159877560 0x55d15987d780 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 1 --2- 172.21.15.8:0/203461945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159876c40 0x55d15987d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa6ed600640 0 client.16734 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:03:48.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 1 -- 172.21.15.8:0/203461945 >> 172.21.15.8:0/203461945 conn(0x55d159871370 msgr2=0x55d1598730c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 1 -- 172.21.15.8:0/203461945 shutdown_connections 2024-03-16T21:03:48.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 1 -- 172.21.15.8:0/203461945 wait complete. 2024-03-16T21:03:48.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.511+0000 7fa7093e2740 20 client.16734 trim_cache size 0 max 16384 2024-03-16T21:03:48.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.525+0000 7fa7093e2740 1 Processor -- start 2024-03-16T21:03:48.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.525+0000 7fa7093e2740 1 -- start start 2024-03-16T21:03:48.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.525+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159876c40 0x55d15987f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.525+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 0x55d15987dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.525+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159880140 0x55d1598702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.525+0000 7fa7093e2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d15988cda0 con 0x55d159880140 2024-03-16T21:03:48.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.525+0000 7fa7093e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d159876010 con 0x55d159877560 2024-03-16T21:03:48.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.525+0000 7fa7093e2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d159877fe0 con 0x55d159876c40 2024-03-16T21:03:48.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6fea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 0x55d15987dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6fea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 0x55d15987dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34268/0 (socket says 172.21.15.8:34268) 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6fea00640 1 -- 172.21.15.8:0/2040324021 learned_addr learned my addr 172.21.15.8:0/2040324021 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/2040324021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159880140 0x55d1598702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/2040324021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159876c40 0x55d15987f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6fea00640 1 -- 172.21.15.8:0/2040324021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159876c40 msgr2=0x55d15987f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6fea00640 1 --2- 172.21.15.8:0/2040324021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159876c40 0x55d15987f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6fea00640 1 -- 172.21.15.8:0/2040324021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159880140 msgr2=0x55d1598702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6fea00640 1 --2- 172.21.15.8:0/2040324021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159880140 0x55d1598702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6fea00640 1 -- 172.21.15.8:0/2040324021 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d159778ab0 con 0x55d159877560 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/2040324021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159876c40 0x55d15987f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.526+0000 7fa6fea00640 1 --2- 172.21.15.8:0/2040324021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 0x55d15987dae0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009be0 tx=0x7fa6f002bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1112b3de81732cfb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.527+0000 7fa6efe00640 1 -- 172.21.15.8:0/2040324021 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0033c40 con 0x55d159877560 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.527+0000 7fa6efe00640 1 -- 172.21.15.8:0/2040324021 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa6f0043070 con 0x55d159877560 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.527+0000 7fa6efe00640 1 -- 172.21.15.8:0/2040324021 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f003e670 con 0x55d159877560 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.527+0000 7fa7093e2740 1 -- 172.21.15.8:0/2040324021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 msgr2=0x55d15987dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.527+0000 7fa7093e2740 1 --2- 172.21.15.8:0/2040324021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 0x55d15987dae0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009be0 tx=0x7fa6f002bef0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.527+0000 7fa7093e2740 1 -- 172.21.15.8:0/2040324021 shutdown_connections 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.527+0000 7fa7093e2740 1 --2- 172.21.15.8:0/2040324021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159880140 0x55d1598702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.527+0000 7fa7093e2740 1 --2- 172.21.15.8:0/2040324021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 0x55d15987dae0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.527+0000 7fa7093e2740 1 --2- 172.21.15.8:0/2040324021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159876c40 0x55d15987f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.527+0000 7fa7093e2740 1 -- 172.21.15.8:0/2040324021 >> 172.21.15.8:0/2040324021 conn(0x55d159871370 msgr2=0x55d15986fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.528+0000 7fa7093e2740 1 -- 172.21.15.8:0/2040324021 shutdown_connections 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.528+0000 7fa7093e2740 1 -- 172.21.15.8:0/2040324021 wait complete. 2024-03-16T21:03:48.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.528+0000 7fa7093e2740 1 -- start start 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.528+0000 7fa7093e2740 1 Processor -- start 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159876c40 0x55d159883c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 0x55d1598841c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa7093e2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159880140 0x55d1598e4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa7093e2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1598e5090 con 0x55d159876c40 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa7093e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1598e5200 con 0x55d159877560 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa7093e2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1598e53c0 con 0x55d159880140 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa7093e2740 10 client.0 _ll_register_callbacks cb 0x7fa6f0009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159876c40 0x55d159883c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159876c40 0x55d159883c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56048/0 (socket says 172.21.15.8:56048) 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa6ffe00640 1 -- 172.21.15.8:0/3728759204 learned_addr learned my addr 172.21.15.8:0/3728759204 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:48.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa6fea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 0x55d1598841c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159880140 0x55d1598e4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa6ffe00640 1 -- 172.21.15.8:0/3728759204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159880140 msgr2=0x55d1598e4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159880140 0x55d1598e4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa6ffe00640 1 -- 172.21.15.8:0/3728759204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 msgr2=0x55d1598841c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 0x55d1598841c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa6ffe00640 1 -- 172.21.15.8:0/3728759204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1597dc5a0 con 0x55d159876c40 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.529+0000 7fa6fea00640 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 0x55d1598841c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.530+0000 7fa6ffe00640 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159876c40 0x55d159883c80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800fc30 tx=0x7fa6f800b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e75be75ee81cdc8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.530+0000 7fa6ed600640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.530+0000 7fa6ed600640 1 -- 172.21.15.8:0/3728759204 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8004900 con 0x55d159876c40 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.530+0000 7fa6ed600640 1 -- 172.21.15.8:0/3728759204 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa6f8004f10 con 0x55d159876c40 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.530+0000 7fa7093e2740 1 -- 172.21.15.8:0/3728759204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6f8005520 con 0x55d159876c40 2024-03-16T21:03:48.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.530+0000 7fa6ed600640 1 -- 172.21.15.8:0/3728759204 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6f80050d0 con 0x55d159876c40 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.530+0000 7fa7093e2740 10 client.16740 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.530+0000 7fa7093e2740 1 -- 172.21.15.8:0/3728759204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d15979e650 con 0x55d159876c40 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.530+0000 7fa6ed600640 1 -- 172.21.15.8:0/3728759204 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa6f8005520 con 0x55d159876c40 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.531+0000 7fa6ed600640 1 -- 172.21.15.8:0/3728759204 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fa6f8011560 con 0x55d159876c40 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.531+0000 7fa7093e2740 10 client.16740 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.531+0000 7fa7093e2740 10 client.16740 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.531+0000 7fa7093e2740 20 client.16740 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.531+0000 7fa7093e2740 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d1598ecaa0 0x55d1598eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.531+0000 7fa7093e2740 4 client.16740 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.531+0000 7fa7093e2740 1 -- 172.21.15.8:0/3728759204 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d159569890 con 0x55d1598ecaa0 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.531+0000 7fa6fea00640 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d1598ecaa0 0x55d1598eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa6fea00640 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d1598ecaa0 0x55d1598eeec0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=34f36be55e945a74 server_cookie=f8ba44f3b7249bcd in_seq=0 out_seq=0 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa6ed600640 10 client.16740 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa6ed600640 1 -- 172.21.15.8:0/3728759204 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d159569890 con 0x55d1598ecaa0 2024-03-16T21:03:48.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa6ed600640 10 client.16740 handle_command_reply: tid=0 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 1 client.16740 shutdown 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 1 -- 172.21.15.8:0/3728759204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159876c40 msgr2=0x55d159883c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159876c40 0x55d159883c80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800fc30 tx=0x7fa6f800b3a0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 1 -- 172.21.15.8:0/3728759204 shutdown_connections 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55d1598ecaa0 0x55d1598eeec0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d159880140 0x55d1598e4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d159877560 0x55d1598841c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 1 --2- 172.21.15.8:0/3728759204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d159876c40 0x55d159883c80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 1 -- 172.21.15.8:0/3728759204 >> 172.21.15.8:0/3728759204 conn(0x55d159871370 msgr2=0x55d159870470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa6ed600640 0 client.16740 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 1 -- 172.21.15.8:0/3728759204 shutdown_connections 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 1 -- 172.21.15.8:0/3728759204 wait complete. 2024-03-16T21:03:48.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.532+0000 7fa7093e2740 20 client.16740 trim_cache size 0 max 16384 2024-03-16T21:03:48.543 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:03:48.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 -- 172.21.15.8:0/1609365 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa6e40a1c20 msgr2=0x7fa6e40a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa6e40a1c20 0x7fa6e40a40e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55d159876710 tx=0x7fa6e80d14e0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 -- 172.21.15.8:0/1609365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa700069aa0 msgr2=0x7fa700199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa700069aa0 0x7fa700199e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800e9c0 tx=0x7fa6e800ee80 comp rx=0 tx=0).stop 2024-03-16T21:03:48.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 -- 172.21.15.8:0/1609365 shutdown_connections 2024-03-16T21:03:48.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa6e40a1c20 0x7fa6e40a40e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa70010df00 0x7fa70019e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70006a3c0 0x7fa70019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 --2- 172.21.15.8:0/1609365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa700069aa0 0x7fa700199e50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 -- 172.21.15.8:0/1609365 >> 172.21.15.8:0/1609365 conn(0x7fa700077480 msgr2=0x7fa70010f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 -- 172.21.15.8:0/1609365 shutdown_connections 2024-03-16T21:03:48.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.533+0000 7fa706800640 1 -- 172.21.15.8:0/1609365 wait complete. 2024-03-16T21:03:48.559 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:03:48.559 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:03:48.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.779+0000 7f704fe00640 1 -- 172.21.15.8:0/3412535787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7050102e40 msgr2=0x7f705010b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.779+0000 7f704fe00640 1 --2- 172.21.15.8:0/3412535787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7050102e40 0x7f705010b320 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7038009900 tx=0x7f703802bcd0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.780+0000 7f704fe00640 1 -- 172.21.15.8:0/3412535787 shutdown_connections 2024-03-16T21:03:48.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.780+0000 7f704fe00640 1 --2- 172.21.15.8:0/3412535787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f705010b940 0x7f705010dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.780+0000 7f704fe00640 1 --2- 172.21.15.8:0/3412535787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7050102e40 0x7f705010b320 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.780+0000 7f704fe00640 1 --2- 172.21.15.8:0/3412535787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7050102520 0x7f7050102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.780+0000 7f704fe00640 1 -- 172.21.15.8:0/3412535787 >> 172.21.15.8:0/3412535787 conn(0x7f70500fbd40 msgr2=0x7f70500fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.780+0000 7f704fe00640 1 -- 172.21.15.8:0/3412535787 shutdown_connections 2024-03-16T21:03:48.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.780+0000 7f704fe00640 1 -- 172.21.15.8:0/3412535787 wait complete. 2024-03-16T21:03:48.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.781+0000 7f704fe00640 1 Processor -- start 2024-03-16T21:03:48.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.781+0000 7f704fe00640 1 -- start start 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.782+0000 7f704fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7050102520 0x7f705019f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.782+0000 7f704fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7050102e40 0x7f705019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.782+0000 7f704fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f705010b940 0x7f7050199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.782+0000 7f704fe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705019a0c0 con 0x7f7050102520 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.782+0000 7f704fe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705019a230 con 0x7f7050102e40 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.782+0000 7f704fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705019a3f0 con 0x7f705010b940 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.782+0000 7f704ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7050102520 0x7f705019f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.782+0000 7f704ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7050102520 0x7f705019f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56066/0 (socket says 172.21.15.8:56066) 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.782+0000 7f704ea00640 1 -- 172.21.15.8:0/3994374359 learned_addr learned my addr 172.21.15.8:0/3994374359 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.782+0000 7f704e000640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7050102e40 0x7f705019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.782+0000 7f704f400640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f705010b940 0x7f7050199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f704e000640 1 -- 172.21.15.8:0/3994374359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f705010b940 msgr2=0x7f7050199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f704e000640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f705010b940 0x7f7050199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f704e000640 1 -- 172.21.15.8:0/3994374359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7050102520 msgr2=0x7f705019f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f704e000640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7050102520 0x7f705019f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f704e000640 1 -- 172.21.15.8:0/3994374359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038009560 con 0x7f7050102e40 2024-03-16T21:03:48.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f704ea00640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7050102520 0x7f705019f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:48.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f704f400640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f705010b940 0x7f7050199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:48.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f704e000640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7050102e40 0x7f705019fe00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f703802c210 tx=0x7f70380043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f7047400640 1 -- 172.21.15.8:0/3994374359 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703802cb60 con 0x7f7050102e40 2024-03-16T21:03:48.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f7047400640 1 -- 172.21.15.8:0/3994374359 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f703802ccc0 con 0x7f7050102e40 2024-03-16T21:03:48.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f7047400640 1 -- 172.21.15.8:0/3994374359 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038003a80 con 0x7f7050102e40 2024-03-16T21:03:48.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.783+0000 7f704fe00640 1 -- 172.21.15.8:0/3994374359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705019a670 con 0x7f7050102e40 2024-03-16T21:03:48.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.784+0000 7f704fe00640 1 -- 172.21.15.8:0/3994374359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70501a6960 con 0x7f7050102e40 2024-03-16T21:03:48.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.787+0000 7f7047400640 1 -- 172.21.15.8:0/3994374359 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f70380053a0 con 0x7f7050102e40 2024-03-16T21:03:48.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.787+0000 7f705899a740 1 Processor -- start 2024-03-16T21:03:48.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.787+0000 7f705899a740 1 -- start start 2024-03-16T21:03:48.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.787+0000 7f705899a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306cdf0 0x56277306d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.787+0000 7f705899a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306d710 0x562773075db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.787+0000 7f705899a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627730762f0 0x5627730786e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.787+0000 7f705899a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562772fdb210 con 0x56277306cdf0 2024-03-16T21:03:48.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.787+0000 7f705899a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562772fd8740 con 0x56277306d710 2024-03-16T21:03:48.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.787+0000 7f705899a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562772fd3f20 con 0x5627730762f0 2024-03-16T21:03:48.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306d710 0x562773075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306cdf0 0x56277306d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704e000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627730762f0 0x5627730786e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306d710 0x562773075db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34284/0 (socket says 172.21.15.8:34284) 2024-03-16T21:03:48.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704ea00640 1 -- 172.21.15.8:0/2468357201 learned_addr learned my addr 172.21.15.8:0/2468357201 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704ea00640 1 -- 172.21.15.8:0/2468357201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627730762f0 msgr2=0x5627730786e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704ea00640 1 --2- 172.21.15.8:0/2468357201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627730762f0 0x5627730786e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704ea00640 1 -- 172.21.15.8:0/2468357201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306cdf0 msgr2=0x56277306d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704ea00640 1 --2- 172.21.15.8:0/2468357201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306cdf0 0x56277306d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704ea00640 1 -- 172.21.15.8:0/2468357201 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562772f95df0 con 0x56277306d710 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704f400640 1 --2- 172.21.15.8:0/2468357201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306cdf0 0x56277306d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f704ea00640 1 --2- 172.21.15.8:0/2468357201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306d710 0x562773075db0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f70480108a0 tx=0x7f7048010d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21a14ccfc2ef0846 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f7047400640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70340a1ba0 0x7f70340a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f703fe00640 1 -- 172.21.15.8:0/2468357201 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048004d20 con 0x56277306d710 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f7047400640 1 -- 172.21.15.8:0/3994374359 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f70380ef8e0 con 0x7f7050102e40 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f703fe00640 1 -- 172.21.15.8:0/2468357201 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7048015070 con 0x56277306d710 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.788+0000 7f703fe00640 1 -- 172.21.15.8:0/2468357201 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70480058c0 con 0x56277306d710 2024-03-16T21:03:48.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.789+0000 7f704f400640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70340a1ba0 0x7f70340a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.789+0000 7f705899a740 1 -- 172.21.15.8:0/2468357201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306d710 msgr2=0x562773075db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.789+0000 7f705899a740 1 --2- 172.21.15.8:0/2468357201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306d710 0x562773075db0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f70480108a0 tx=0x7f7048010d60 comp rx=0 tx=0).stop 2024-03-16T21:03:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.789+0000 7f704f400640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70340a1ba0 0x7f70340a4060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7040009cc0 tx=0x7f7040005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.789+0000 7f705899a740 1 -- 172.21.15.8:0/2468357201 shutdown_connections 2024-03-16T21:03:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.789+0000 7f705899a740 1 --2- 172.21.15.8:0/2468357201 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627730762f0 0x5627730786e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.789+0000 7f705899a740 1 --2- 172.21.15.8:0/2468357201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306d710 0x562773075db0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.789+0000 7f705899a740 1 --2- 172.21.15.8:0/2468357201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306cdf0 0x56277306d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.789+0000 7f705899a740 1 -- 172.21.15.8:0/2468357201 >> 172.21.15.8:0/2468357201 conn(0x562773067520 msgr2=0x562773067900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.789+0000 7f705899a740 1 -- 172.21.15.8:0/2468357201 shutdown_connections 2024-03-16T21:03:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.790+0000 7f705899a740 1 -- 172.21.15.8:0/2468357201 wait complete. 2024-03-16T21:03:48.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.790+0000 7f705899a740 1 -- start start 2024-03-16T21:03:48.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.790+0000 7f705899a740 1 Processor -- start 2024-03-16T21:03:48.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f705899a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306cdf0 0x562773073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f705899a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306d710 0x5627730738d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f705899a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627730762f0 0x562773073e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f705899a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562772f79150 con 0x56277306d710 2024-03-16T21:03:48.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f705899a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562772f78df0 con 0x56277306cdf0 2024-03-16T21:03:48.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f705899a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562772d421c0 con 0x5627730762f0 2024-03-16T21:03:48.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f705899a740 10 client.0 _ll_register_callbacks cb 0x562772fc82b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:48.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f704ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306cdf0 0x562773073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f704ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306cdf0 0x562773073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34300/0 (socket says 172.21.15.8:34300) 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f704ea00640 1 -- 172.21.15.8:0/3956474170 learned_addr learned my addr 172.21.15.8:0/3956474170 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f704e000640 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306d710 0x5627730738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f704f400640 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627730762f0 0x562773073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f704ea00640 1 -- 172.21.15.8:0/3956474170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627730762f0 msgr2=0x562773073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f704ea00640 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627730762f0 0x562773073e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f704ea00640 1 -- 172.21.15.8:0/3956474170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306d710 msgr2=0x5627730738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f704ea00640 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306d710 0x5627730738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f704ea00640 1 -- 172.21.15.8:0/3956474170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70480104d0 con 0x56277306cdf0 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.791+0000 7f704f400640 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627730762f0 0x562773073e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.792+0000 7f704ea00640 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306cdf0 0x562773073390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7048000f80 tx=0x7f7048005280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52ef22885a9a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.792+0000 7f703cc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:48.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.792+0000 7f703cc00640 1 -- 172.21.15.8:0/3956474170 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048021070 con 0x56277306cdf0 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.792+0000 7f703cc00640 1 -- 172.21.15.8:0/3956474170 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7048005870 con 0x56277306cdf0 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.792+0000 7f705899a740 1 -- 172.21.15.8:0/3956474170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562772cd37e0 con 0x56277306cdf0 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.792+0000 7f703cc00640 1 -- 172.21.15.8:0/3956474170 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7048004a40 con 0x56277306cdf0 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.792+0000 7f705899a740 10 client.26933 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.792+0000 7f705899a740 1 -- 172.21.15.8:0/3956474170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562772fd25a0 con 0x56277306cdf0 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.793+0000 7f703cc00640 1 -- 172.21.15.8:0/3956474170 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x562772cd37e0 con 0x56277306cdf0 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.793+0000 7f703cc00640 1 -- 172.21.15.8:0/3956474170 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f704801a7b0 con 0x56277306cdf0 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.793+0000 7f705899a740 10 client.26933 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.793+0000 7f705899a740 10 client.26933 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.793+0000 7f705899a740 20 client.26933 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.793+0000 7f705899a740 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562773086360 0x562773088770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.793+0000 7f705899a740 4 client.26933 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.793+0000 7f705899a740 1 -- 172.21.15.8:0/3956474170 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562772d10720 con 0x562773086360 2024-03-16T21:03:48.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.793+0000 7f704e000640 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562773086360 0x562773088770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.794+0000 7f704e000640 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562773086360 0x562773088770 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=82909d9f3e783e6e server_cookie=5d1df5963f56671e in_seq=0 out_seq=0 2024-03-16T21:03:48.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.794+0000 7f703cc00640 10 client.26933 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:03:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f703cc00640 1 -- 172.21.15.8:0/3956474170 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x562772d10720 con 0x562773086360 2024-03-16T21:03:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f703cc00640 10 client.26933 handle_command_reply: tid=0 2024-03-16T21:03:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 1 client.26933 shutdown 2024-03-16T21:03:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 1 -- 172.21.15.8:0/3956474170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306cdf0 msgr2=0x562773073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306cdf0 0x562773073390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7048000f80 tx=0x7f7048005280 comp rx=0 tx=0).stop 2024-03-16T21:03:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 1 -- 172.21.15.8:0/3956474170 shutdown_connections 2024-03-16T21:03:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562773086360 0x562773088770 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5627730762f0 0x562773073e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306d710 0x5627730738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 1 --2- 172.21.15.8:0/3956474170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56277306cdf0 0x562773073390 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f703cc00640 0 client.26933 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:03:48.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 1 -- 172.21.15.8:0/3956474170 >> 172.21.15.8:0/3956474170 conn(0x562773067520 msgr2=0x562773069270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 1 -- 172.21.15.8:0/3956474170 shutdown_connections 2024-03-16T21:03:48.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 1 -- 172.21.15.8:0/3956474170 wait complete. 2024-03-16T21:03:48.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.795+0000 7f705899a740 20 client.26933 trim_cache size 0 max 16384 2024-03-16T21:03:48.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.809+0000 7f705899a740 1 Processor -- start 2024-03-16T21:03:48.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.809+0000 7f705899a740 1 -- start start 2024-03-16T21:03:48.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.809+0000 7f705899a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56277306cdf0 0x562773075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.809+0000 7f705899a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306d710 0x562773073c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.809+0000 7f705899a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x562773081670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.809+0000 7f705899a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562773062e20 con 0x56277306d710 2024-03-16T21:03:48.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.809+0000 7f705899a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562773078a10 con 0x5627730762f0 2024-03-16T21:03:48.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.809+0000 7f705899a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627730718e0 con 0x56277306cdf0 2024-03-16T21:03:48.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.810+0000 7f704f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x562773081670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.810+0000 7f704f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x562773081670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34308/0 (socket says 172.21.15.8:34308) 2024-03-16T21:03:48.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.810+0000 7f704f400640 1 -- 172.21.15.8:0/1275463882 learned_addr learned my addr 172.21.15.8:0/1275463882 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:48.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.810+0000 7f704ea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56277306cdf0 0x562773075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.810+0000 7f704e000640 1 --2- 172.21.15.8:0/1275463882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306d710 0x562773073c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.810+0000 7f704f400640 1 -- 172.21.15.8:0/1275463882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56277306cdf0 msgr2=0x562773075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.810+0000 7f704f400640 1 --2- 172.21.15.8:0/1275463882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56277306cdf0 0x562773075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.810+0000 7f704f400640 1 -- 172.21.15.8:0/1275463882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306d710 msgr2=0x562773073c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.810+0000 7f704f400640 1 --2- 172.21.15.8:0/1275463882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306d710 0x562773073c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.810+0000 7f704f400640 1 -- 172.21.15.8:0/1275463882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562772f6eab0 con 0x5627730762f0 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.810+0000 7f704f400640 1 --2- 172.21.15.8:0/1275463882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x562773081670 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7040009eb0 tx=0x7f7040016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc62fe8f1d209a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f703f400640 1 -- 172.21.15.8:0/1275463882 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040024070 con 0x5627730762f0 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f703f400640 1 -- 172.21.15.8:0/1275463882 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7040011dc0 con 0x5627730762f0 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f703f400640 1 -- 172.21.15.8:0/1275463882 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704001f950 con 0x5627730762f0 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f705899a740 1 -- 172.21.15.8:0/1275463882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 msgr2=0x562773081670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f705899a740 1 --2- 172.21.15.8:0/1275463882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x562773081670 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7040009eb0 tx=0x7f7040016000 comp rx=0 tx=0).stop 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f705899a740 1 -- 172.21.15.8:0/1275463882 shutdown_connections 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f705899a740 1 --2- 172.21.15.8:0/1275463882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x562773081670 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f705899a740 1 --2- 172.21.15.8:0/1275463882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306d710 0x562773073c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f705899a740 1 --2- 172.21.15.8:0/1275463882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56277306cdf0 0x562773075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f705899a740 1 -- 172.21.15.8:0/1275463882 >> 172.21.15.8:0/1275463882 conn(0x562773067520 msgr2=0x562773071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f705899a740 1 -- 172.21.15.8:0/1275463882 shutdown_connections 2024-03-16T21:03:48.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.811+0000 7f705899a740 1 -- 172.21.15.8:0/1275463882 wait complete. 2024-03-16T21:03:48.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.812+0000 7f705899a740 1 -- start start 2024-03-16T21:03:48.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.812+0000 7f705899a740 1 Processor -- start 2024-03-16T21:03:48.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.812+0000 7f705899a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306cdf0 0x56277307dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.812+0000 7f705899a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56277306d710 0x562773079350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.812+0000 7f705899a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x5627730798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.812+0000 7f705899a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562773079fd0 con 0x56277306cdf0 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.812+0000 7f705899a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277307a140 con 0x5627730762f0 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.812+0000 7f705899a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627730e9450 con 0x56277306d710 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.812+0000 7f705899a740 10 client.0 _ll_register_callbacks cb 0x7f70380f5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x5627730798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x5627730798d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34316/0 (socket says 172.21.15.8:34316) 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704f400640 1 -- 172.21.15.8:0/1613044812 learned_addr learned my addr 172.21.15.8:0/1613044812 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704e000640 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56277306d710 0x562773079350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704ea00640 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306cdf0 0x56277307dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704f400640 1 -- 172.21.15.8:0/1613044812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56277306d710 msgr2=0x562773079350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704f400640 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56277306d710 0x562773079350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704f400640 1 -- 172.21.15.8:0/1613044812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306cdf0 msgr2=0x56277307dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704f400640 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306cdf0 0x56277307dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704f400640 1 -- 172.21.15.8:0/1613044812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7040019070 con 0x5627730762f0 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704e000640 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56277306d710 0x562773079350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f704f400640 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x5627730798d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7040029fd0 tx=0x7f7040005710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eb6018183621516 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.813+0000 7f703cc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f703cc00640 1 -- 172.21.15.8:0/1613044812 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040024070 con 0x5627730762f0 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f703cc00640 1 -- 172.21.15.8:0/1613044812 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7040004ad0 con 0x5627730762f0 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f705899a740 1 -- 172.21.15.8:0/1613044812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7048015070 con 0x5627730762f0 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f703cc00640 1 -- 172.21.15.8:0/1613044812 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7040028e00 con 0x5627730762f0 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f705899a740 10 client.26939 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f705899a740 1 -- 172.21.15.8:0/1613044812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562772f94650 con 0x5627730762f0 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f703cc00640 1 -- 172.21.15.8:0/1613044812 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7048015070 con 0x5627730762f0 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f703cc00640 1 -- 172.21.15.8:0/1613044812 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f7040028650 con 0x5627730762f0 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f705899a740 10 client.26939 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f705899a740 10 client.26939 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:03:48.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f705899a740 20 client.26939 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f705899a740 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5627730eabf0 0x5627730ed010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f705899a740 4 client.26939 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.814+0000 7f705899a740 1 -- 172.21.15.8:0/1613044812 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562772d5f890 con 0x5627730eabf0 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.815+0000 7f704ea00640 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5627730eabf0 0x5627730ed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.815+0000 7f704ea00640 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5627730eabf0 0x5627730ed010 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fc2cd453d5a03116 server_cookie=55c73b07becd86e6 in_seq=0 out_seq=0 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.815+0000 7f703cc00640 10 client.26939 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.815+0000 7f703cc00640 1 -- 172.21.15.8:0/1613044812 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562772d5f890 con 0x5627730eabf0 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.815+0000 7f703cc00640 10 client.26939 handle_command_reply: tid=0 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.815+0000 7f705899a740 1 client.26939 shutdown 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f705899a740 1 -- 172.21.15.8:0/1613044812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 msgr2=0x5627730798d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f705899a740 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x5627730798d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7040029fd0 tx=0x7f7040005710 comp rx=0 tx=0).stop 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f705899a740 1 -- 172.21.15.8:0/1613044812 shutdown_connections 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f705899a740 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5627730eabf0 0x5627730ed010 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f703cc00640 0 client.26939 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:03:48.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f705899a740 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5627730762f0 0x5627730798d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f705899a740 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56277306d710 0x562773079350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f705899a740 1 --2- 172.21.15.8:0/1613044812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56277306cdf0 0x56277307dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f705899a740 1 -- 172.21.15.8:0/1613044812 >> 172.21.15.8:0/1613044812 conn(0x562773067520 msgr2=0x562773068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f705899a740 1 -- 172.21.15.8:0/1613044812 shutdown_connections 2024-03-16T21:03:48.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f705899a740 1 -- 172.21.15.8:0/1613044812 wait complete. 2024-03-16T21:03:48.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.816+0000 7f705899a740 20 client.26939 trim_cache size 0 max 16384 2024-03-16T21:03:48.826 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:03:48.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 -- 172.21.15.8:0/3994374359 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70340a1ba0 msgr2=0x7f70340a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70340a1ba0 0x7f70340a4060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7040009cc0 tx=0x7f7040005f90 comp rx=0 tx=0).stop 2024-03-16T21:03:48.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 -- 172.21.15.8:0/3994374359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7050102e40 msgr2=0x7f705019fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:48.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7050102e40 0x7f705019fe00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f703802c210 tx=0x7f70380043b0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 -- 172.21.15.8:0/3994374359 shutdown_connections 2024-03-16T21:03:48.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70340a1ba0 0x7f70340a4060 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f705010b940 0x7f7050199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7050102e40 0x7f705019fe00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 --2- 172.21.15.8:0/3994374359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7050102520 0x7f705019f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 -- 172.21.15.8:0/3994374359 >> 172.21.15.8:0/3994374359 conn(0x7f70500fbd40 msgr2=0x7f705010dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 -- 172.21.15.8:0/3994374359 shutdown_connections 2024-03-16T21:03:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:48.817+0000 7f704fe00640 1 -- 172.21.15.8:0/3994374359 wait complete. 2024-03-16T21:03:48.841 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:03:48.841 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:03:49.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.044+0000 7f45b8800640 1 -- 172.21.15.8:0/3609015513 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45b01096a0 msgr2=0x7f45b0109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:49.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.044+0000 7f45b8800640 1 --2- 172.21.15.8:0/3609015513 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45b01096a0 0x7f45b0109a80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f45a4009cd0 tx=0x7f45a402c0e0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.044+0000 7f45b8800640 1 -- 172.21.15.8:0/3609015513 shutdown_connections 2024-03-16T21:03:49.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.044+0000 7f45b8800640 1 --2- 172.21.15.8:0/3609015513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b0104050 0x7f45b0110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.044+0000 7f45b8800640 1 --2- 172.21.15.8:0/3609015513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45b0103690 0x7f45b0103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.044+0000 7f45b8800640 1 --2- 172.21.15.8:0/3609015513 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45b01096a0 0x7f45b0109a80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.044+0000 7f45b8800640 1 -- 172.21.15.8:0/3609015513 >> 172.21.15.8:0/3609015513 conn(0x7f45b00ff140 msgr2=0x7f45b0101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:49.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.045+0000 7f45b8800640 1 -- 172.21.15.8:0/3609015513 shutdown_connections 2024-03-16T21:03:49.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.045+0000 7f45b8800640 1 -- 172.21.15.8:0/3609015513 wait complete. 2024-03-16T21:03:49.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b8800640 1 Processor -- start 2024-03-16T21:03:49.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b8800640 1 -- start start 2024-03-16T21:03:49.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b8800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45b0103690 0x7f45b0199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b8800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b0104050 0x7f45b019a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b8800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45b01096a0 0x7f45b019e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b8800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b019ecd0 con 0x7f45b0104050 2024-03-16T21:03:49.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b8800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b019ee40 con 0x7f45b0103690 2024-03-16T21:03:49.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b8800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b019f000 con 0x7f45b01096a0 2024-03-16T21:03:49.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45b0103690 0x7f45b0199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45b0103690 0x7f45b0199e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34348/0 (socket says 172.21.15.8:34348) 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b5e00640 1 -- 172.21.15.8:0/3044171843 learned_addr learned my addr 172.21.15.8:0/3044171843 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b6800640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45b01096a0 0x7f45b019e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.046+0000 7f45b5400640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b0104050 0x7f45b019a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.047+0000 7f45b5e00640 1 -- 172.21.15.8:0/3044171843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45b01096a0 msgr2=0x7f45b019e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.047+0000 7f45b5e00640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45b01096a0 0x7f45b019e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.047+0000 7f45b5e00640 1 -- 172.21.15.8:0/3044171843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b0104050 msgr2=0x7f45b019a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.047+0000 7f45b5e00640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b0104050 0x7f45b019a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.047+0000 7f45b5e00640 1 -- 172.21.15.8:0/3044171843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4009900 con 0x7f45b0103690 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.047+0000 7f45b5e00640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45b0103690 0x7f45b0199e10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f45a4004af0 tx=0x7f45a4034670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.047+0000 7f45aaa00640 1 -- 172.21.15.8:0/3044171843 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4032bc0 con 0x7f45b0103690 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.047+0000 7f45aaa00640 1 -- 172.21.15.8:0/3044171843 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f45a4003e70 con 0x7f45b0103690 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.047+0000 7f45aaa00640 1 -- 172.21.15.8:0/3044171843 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a40048a0 con 0x7f45b0103690 2024-03-16T21:03:49.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.047+0000 7f45b8800640 1 -- 172.21.15.8:0/3044171843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b019f280 con 0x7f45b0103690 2024-03-16T21:03:49.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.048+0000 7f45b8800640 1 -- 172.21.15.8:0/3044171843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b01a6980 con 0x7f45b0103690 2024-03-16T21:03:49.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.052+0000 7f45bb5bf740 1 Processor -- start 2024-03-16T21:03:49.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.052+0000 7f45bb5bf740 1 -- start start 2024-03-16T21:03:49.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.052+0000 7f45aaa00640 1 -- 172.21.15.8:0/3044171843 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f45a400a040 con 0x7f45b0103690 2024-03-16T21:03:49.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.052+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.052+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7d5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.052+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7d8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.052+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f73b210 con 0x55a07f7d6140 2024-03-16T21:03:49.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.052+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f738740 con 0x55a07f7cd560 2024-03-16T21:03:49.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f733f20 con 0x55a07f7ccc40 2024-03-16T21:03:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45b5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45b6800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45b5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7d8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45b6800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33818/0 (socket says 172.21.15.8:33818) 2024-03-16T21:03:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45b5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7d5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34356/0 (socket says 172.21.15.8:34356) 2024-03-16T21:03:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45b6800640 1 -- 172.21.15.8:0/2786591331 learned_addr learned my addr 172.21.15.8:0/2786591331 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45b6800640 1 -- 172.21.15.8:0/2786591331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 msgr2=0x55a07f7d5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45b6800640 1 --2- 172.21.15.8:0/2786591331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7d5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45b6800640 1 -- 172.21.15.8:0/2786591331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 msgr2=0x55a07f7d8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45b6800640 1 --2- 172.21.15.8:0/2786591331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7d8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.053+0000 7f45b6800640 1 -- 172.21.15.8:0/2786591331 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a07f6f5df0 con 0x55a07f7ccc40 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.054+0000 7f45b6800640 1 --2- 172.21.15.8:0/2786591331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7cd020 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f45ac004620 tx=0x7f45ac00bb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f066e90fa70615b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.054+0000 7f459f000640 1 -- 172.21.15.8:0/2786591331 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac003ba0 con 0x55a07f7ccc40 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.054+0000 7f459f000640 1 -- 172.21.15.8:0/2786591331 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f45ac003d00 con 0x55a07f7ccc40 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.054+0000 7f459f000640 1 -- 172.21.15.8:0/2786591331 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011800 con 0x55a07f7ccc40 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.054+0000 7f45aaa00640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f45980a1c20 0x7f45980a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.054+0000 7f45aaa00640 1 -- 172.21.15.8:0/3044171843 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f45a40efff0 con 0x7f45b0103690 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.054+0000 7f45b5e00640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f45980a1c20 0x7f45980a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.055+0000 7f45bb5bf740 1 -- 172.21.15.8:0/2786591331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 msgr2=0x55a07f7cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.055+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/2786591331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7cd020 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f45ac004620 tx=0x7f45ac00bb10 comp rx=0 tx=0).stop 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.055+0000 7f45bb5bf740 1 -- 172.21.15.8:0/2786591331 shutdown_connections 2024-03-16T21:03:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.055+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/2786591331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7d8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.055+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/2786591331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7d5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.055+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/2786591331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7cd020 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.055+0000 7f45bb5bf740 1 -- 172.21.15.8:0/2786591331 >> 172.21.15.8:0/2786591331 conn(0x55a07f7c7370 msgr2=0x55a07f7c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:49.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.055+0000 7f45bb5bf740 1 -- 172.21.15.8:0/2786591331 shutdown_connections 2024-03-16T21:03:49.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.055+0000 7f45bb5bf740 1 -- 172.21.15.8:0/2786591331 wait complete. 2024-03-16T21:03:49.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.055+0000 7f45b5e00640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f45980a1c20 0x7f45980a40e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f45a40ed930 tx=0x7f45a40f3b00 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:49.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.055+0000 7f45bb5bf740 1 -- start start 2024-03-16T21:03:49.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45bb5bf740 1 Processor -- start 2024-03-16T21:03:49.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7d3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7d3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f6d9150 con 0x55a07f7d6140 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f6d8df0 con 0x55a07f7cd560 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f4a21c0 con 0x55a07f7ccc40 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45bb5bf740 10 client.0 _ll_register_callbacks cb 0x55a07f7282b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45b5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7d3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45b5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7d3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34372/0 (socket says 172.21.15.8:34372) 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45b5400640 1 -- 172.21.15.8:0/326549907 learned_addr learned my addr 172.21.15.8:0/326549907 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.056+0000 7f45b6800640 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7d3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f45b6800640 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f45b5400640 1 -- 172.21.15.8:0/326549907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 msgr2=0x55a07f7d3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f45b5400640 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7d3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f45b5400640 1 -- 172.21.15.8:0/326549907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 msgr2=0x55a07f7d3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f45b5400640 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7d3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f45b5400640 1 -- 172.21.15.8:0/326549907 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac004250 con 0x55a07f7cd560 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f45b6800640 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7d3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f45b5400640 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7d3740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f45a0012700 tx=0x7f45a0012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e03febd7082ce94f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f4593400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f4593400640 1 -- 172.21.15.8:0/326549907 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0017070 con 0x55a07f7cd560 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f4593400640 1 -- 172.21.15.8:0/326549907 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f45a000f8c0 con 0x55a07f7cd560 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.057+0000 7f45bb5bf740 1 -- 172.21.15.8:0/326549907 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a07f4337e0 con 0x55a07f7cd560 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.058+0000 7f4593400640 1 -- 172.21.15.8:0/326549907 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45a000fac0 con 0x55a07f7cd560 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.058+0000 7f45bb5bf740 10 client.26951 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.058+0000 7f45bb5bf740 1 -- 172.21.15.8:0/326549907 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a07f7325a0 con 0x55a07f7cd560 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.058+0000 7f4593400640 1 -- 172.21.15.8:0/326549907 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a07f4337e0 con 0x55a07f7cd560 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.058+0000 7f4593400640 1 -- 172.21.15.8:0/326549907 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f45a0010430 con 0x55a07f7cd560 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.058+0000 7f45bb5bf740 10 client.26951 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.058+0000 7f45bb5bf740 10 client.26951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.058+0000 7f45bb5bf740 20 client.26951 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.058+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a07f7e6340 0x55a07f7e8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.058+0000 7f45bb5bf740 4 client.26951 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.058+0000 7f45bb5bf740 1 -- 172.21.15.8:0/326549907 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a07f470720 con 0x55a07f7e6340 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.059+0000 7f45b6800640 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a07f7e6340 0x55a07f7e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.059+0000 7f45b6800640 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a07f7e6340 0x55a07f7e8760 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df7ed55a81da7166 server_cookie=565830b6966cd76b in_seq=0 out_seq=0 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.059+0000 7f4593400640 10 client.26951 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f4593400640 1 -- 172.21.15.8:0/326549907 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a07f470720 con 0x55a07f7e6340 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f4593400640 10 client.26951 handle_command_reply: tid=0 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f45bb5bf740 1 client.26951 shutdown 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f45bb5bf740 1 -- 172.21.15.8:0/326549907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 msgr2=0x55a07f7d3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7d3740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f45a0012700 tx=0x7f45a0012bc0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f45bb5bf740 1 -- 172.21.15.8:0/326549907 shutdown_connections 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a07f7e6340 0x55a07f7e8760 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7d3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7d3740 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f4593400640 0 client.26951 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:49.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/326549907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7d3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f45bb5bf740 1 -- 172.21.15.8:0/326549907 >> 172.21.15.8:0/326549907 conn(0x55a07f7c7370 msgr2=0x55a07f7c90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:49.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f45bb5bf740 1 -- 172.21.15.8:0/326549907 shutdown_connections 2024-03-16T21:03:49.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.060+0000 7f45bb5bf740 1 -- 172.21.15.8:0/326549907 wait complete. 2024-03-16T21:03:49.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.061+0000 7f45bb5bf740 20 client.26951 trim_cache size 0 max 16384 2024-03-16T21:03:49.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.074+0000 7f45bb5bf740 1 Processor -- start 2024-03-16T21:03:49.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45bb5bf740 1 -- start start 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7ccc40 0x55a07f7d5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7d6140 0x55a07f7e1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f7d2ff0 con 0x55a07f7ccc40 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f7e8dc0 con 0x55a07f7cd560 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f7d1750 con 0x55a07f7d6140 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45b6800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7ccc40 0x55a07f7d5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45b5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45b5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7e14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34386/0 (socket says 172.21.15.8:34386) 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45b5400640 1 -- 172.21.15.8:0/387153704 learned_addr learned my addr 172.21.15.8:0/387153704 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.075+0000 7f45b6800640 1 --2- 172.21.15.8:0/387153704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7d6140 0x55a07f7e1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.076+0000 7f45b5400640 1 -- 172.21.15.8:0/387153704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7d6140 msgr2=0x55a07f7e1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:49.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.076+0000 7f45b5400640 1 --2- 172.21.15.8:0/387153704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7d6140 0x55a07f7e1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.076+0000 7f45b5400640 1 -- 172.21.15.8:0/387153704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7ccc40 msgr2=0x55a07f7d5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:49.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.076+0000 7f45b5400640 1 --2- 172.21.15.8:0/387153704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7ccc40 0x55a07f7d5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.076+0000 7f45b5400640 1 -- 172.21.15.8:0/387153704 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a07f6ceab0 con 0x55a07f7cd560 2024-03-16T21:03:49.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.076+0000 7f45b5400640 1 --2- 172.21.15.8:0/387153704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7e14c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f45a0010760 tx=0x7f45a0010430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=370f07259b00fd1d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:49.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.076+0000 7f459e600640 1 -- 172.21.15.8:0/387153704 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0017040 con 0x55a07f7cd560 2024-03-16T21:03:49.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.076+0000 7f459e600640 1 -- 172.21.15.8:0/387153704 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f45a00055d0 con 0x55a07f7cd560 2024-03-16T21:03:49.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.076+0000 7f459e600640 1 -- 172.21.15.8:0/387153704 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a000fe00 con 0x55a07f7cd560 2024-03-16T21:03:49.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.077+0000 7f45bb5bf740 1 -- 172.21.15.8:0/387153704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 msgr2=0x55a07f7e14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.077+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/387153704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7e14c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f45a0010760 tx=0x7f45a0010430 comp rx=0 tx=0).stop 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.077+0000 7f45bb5bf740 1 -- 172.21.15.8:0/387153704 shutdown_connections 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.077+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/387153704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7d6140 0x55a07f7e1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.077+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/387153704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7e14c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.077+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/387153704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7ccc40 0x55a07f7d5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.077+0000 7f45bb5bf740 1 -- 172.21.15.8:0/387153704 >> 172.21.15.8:0/387153704 conn(0x55a07f7c7370 msgr2=0x55a07f7c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.077+0000 7f45bb5bf740 1 -- 172.21.15.8:0/387153704 shutdown_connections 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.077+0000 7f45bb5bf740 1 -- 172.21.15.8:0/387153704 wait complete. 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.077+0000 7f45bb5bf740 1 -- start start 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45bb5bf740 1 Processor -- start 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7da350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7da890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45bb5bf740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7dadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f7de2c0 con 0x55a07f7d6140 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f84a410 con 0x55a07f7cd560 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45bb5bf740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07f84a550 con 0x55a07f7ccc40 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45bb5bf740 10 client.0 _ll_register_callbacks cb 0x7f45a0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45b5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7da890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45b6800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7da350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45b5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7da890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34396/0 (socket says 172.21.15.8:34396) 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.078+0000 7f45b5400640 1 -- 172.21.15.8:0/1720567028 learned_addr learned my addr 172.21.15.8:0/1720567028 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f45b6800640 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7dadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f45b5400640 1 -- 172.21.15.8:0/1720567028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 msgr2=0x55a07f7da350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f45b5400640 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7da350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f45b5400640 1 -- 172.21.15.8:0/1720567028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 msgr2=0x55a07f7dadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f45b5400640 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7dadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f45b5400640 1 -- 172.21.15.8:0/1720567028 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a07f7325a0 con 0x55a07f7cd560 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f45b6800640 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7dadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f45b5400640 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7da890 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x55a07f7d42c0 tx=0x7f45a000ffd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcc99b6cbcd389f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f4593400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f4593400640 1 -- 172.21.15.8:0/1720567028 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0017040 con 0x55a07f7cd560 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f4593400640 1 -- 172.21.15.8:0/1720567028 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f45a00109d0 con 0x55a07f7cd560 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.079+0000 7f45bb5bf740 1 -- 172.21.15.8:0/1720567028 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45ac003d00 con 0x55a07f7cd560 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f4593400640 1 -- 172.21.15.8:0/1720567028 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45a00050d0 con 0x55a07f7cd560 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f45bb5bf740 10 client.26957 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f45bb5bf740 1 -- 172.21.15.8:0/1720567028 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a07f6f4650 con 0x55a07f7cd560 2024-03-16T21:03:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f4593400640 1 -- 172.21.15.8:0/1720567028 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f45a003b020 con 0x55a07f7cd560 2024-03-16T21:03:49.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f4593400640 1 -- 172.21.15.8:0/1720567028 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f45a0037480 con 0x55a07f7cd560 2024-03-16T21:03:49.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f45bb5bf740 10 client.26957 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:49.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f45bb5bf740 10 client.26957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:49.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f45bb5bf740 20 client.26957 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:49.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a07f84b930 0x55a07f84dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:49.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f45bb5bf740 4 client.26957 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:03:49.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f45bb5bf740 1 -- 172.21.15.8:0/1720567028 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a07f4bf890 con 0x55a07f84b930 2024-03-16T21:03:49.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.080+0000 7f45b6800640 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a07f84b930 0x55a07f84dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:49.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f45b6800640 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a07f84b930 0x55a07f84dd50 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dd6b528bec51b95 server_cookie=769ecd9a8d1f4014 in_seq=0 out_seq=0 2024-03-16T21:03:49.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f4593400640 10 client.26957 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f4593400640 1 -- 172.21.15.8:0/1720567028 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a07f4bf890 con 0x55a07f84b930 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f4593400640 10 client.26957 handle_command_reply: tid=0 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f45bb5bf740 1 client.26957 shutdown 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f45bb5bf740 1 -- 172.21.15.8:0/1720567028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 msgr2=0x55a07f7da890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7da890 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x55a07f7d42c0 tx=0x7f45a000ffd0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f45bb5bf740 1 -- 172.21.15.8:0/1720567028 shutdown_connections 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a07f84b930 0x55a07f84dd50 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a07f7d6140 0x55a07f7dadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a07f7cd560 0x55a07f7da890 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f45bb5bf740 1 --2- 172.21.15.8:0/1720567028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a07f7ccc40 0x55a07f7da350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f45bb5bf740 1 -- 172.21.15.8:0/1720567028 >> 172.21.15.8:0/1720567028 conn(0x55a07f7c7370 msgr2=0x55a07f7d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.081+0000 7f4593400640 0 client.26957 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:49.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45bb5bf740 1 -- 172.21.15.8:0/1720567028 shutdown_connections 2024-03-16T21:03:49.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45bb5bf740 1 -- 172.21.15.8:0/1720567028 wait complete. 2024-03-16T21:03:49.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45bb5bf740 20 client.26957 trim_cache size 0 max 16384 2024-03-16T21:03:49.093 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:03:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45b8800640 1 -- 172.21.15.8:0/3044171843 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f45980a1c20 msgr2=0x7f45980a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45b8800640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f45980a1c20 0x7f45980a40e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f45a40ed930 tx=0x7f45a40f3b00 comp rx=0 tx=0).stop 2024-03-16T21:03:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45b8800640 1 -- 172.21.15.8:0/3044171843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45b0103690 msgr2=0x7f45b0199e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45b8800640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45b0103690 0x7f45b0199e10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f45a4004af0 tx=0x7f45a4034670 comp rx=0 tx=0).stop 2024-03-16T21:03:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45b8800640 1 -- 172.21.15.8:0/3044171843 shutdown_connections 2024-03-16T21:03:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45b8800640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f45980a1c20 0x7f45980a40e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45b8800640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45b01096a0 0x7f45b019e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45b8800640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b0104050 0x7f45b019a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45b8800640 1 --2- 172.21.15.8:0/3044171843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45b0103690 0x7f45b0199e10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.082+0000 7f45b8800640 1 -- 172.21.15.8:0/3044171843 >> 172.21.15.8:0/3044171843 conn(0x7f45b00ff140 msgr2=0x7f45b00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.083+0000 7f45b8800640 1 -- 172.21.15.8:0/3044171843 shutdown_connections 2024-03-16T21:03:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:49.083+0000 7f45b8800640 1 -- 172.21.15.8:0/3044171843 wait complete. 2024-03-16T21:03:49.105 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:48 smithi008 ceph-mon[31434]: pgmap v182: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:49.105 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:48 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1937438902' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:03:49.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:48 smithi170 ceph-mon[35947]: pgmap v182: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:49.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:48 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1937438902' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:03:49.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:48 smithi186 ceph-mon[36391]: pgmap v182: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:03:49.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:48 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1937438902' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:03:50.109 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:03:50.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:03:50.110 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:03:50.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.348+0000 7fcecb600640 1 -- 172.21.15.8:0/3613728919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec41096a0 msgr2=0x7fcec4109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.348+0000 7fcecb600640 1 --2- 172.21.15.8:0/3613728919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec41096a0 0x7fcec4109a80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009930 tx=0x7fceb402bc30 comp rx=0 tx=0).stop 2024-03-16T21:03:50.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.348+0000 7fcecb600640 1 -- 172.21.15.8:0/3613728919 shutdown_connections 2024-03-16T21:03:50.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.348+0000 7fcecb600640 1 --2- 172.21.15.8:0/3613728919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcec4104050 0x7fcec4110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.348+0000 7fcecb600640 1 --2- 172.21.15.8:0/3613728919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec4103690 0x7fcec4103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.348+0000 7fcecb600640 1 --2- 172.21.15.8:0/3613728919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec41096a0 0x7fcec4109a80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.348+0000 7fcecb600640 1 -- 172.21.15.8:0/3613728919 >> 172.21.15.8:0/3613728919 conn(0x7fcec40ff140 msgr2=0x7fcec4101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.348+0000 7fcecb600640 1 -- 172.21.15.8:0/3613728919 shutdown_connections 2024-03-16T21:03:50.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.348+0000 7fcecb600640 1 -- 172.21.15.8:0/3613728919 wait complete. 2024-03-16T21:03:50.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.349+0000 7fcecb600640 1 Processor -- start 2024-03-16T21:03:50.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.349+0000 7fcecb600640 1 -- start start 2024-03-16T21:03:50.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcecb600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec4103690 0x7fcec4199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcecb600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcec4104050 0x7fcec419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcecb600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec41096a0 0x7fcec419e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcecb600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec419ed00 con 0x7fcec4103690 2024-03-16T21:03:50.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcecb600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec419ee70 con 0x7fcec4104050 2024-03-16T21:03:50.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcecb600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec419f030 con 0x7fcec41096a0 2024-03-16T21:03:50.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcec4104050 0x7fcec419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec8c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec4103690 0x7fcec4199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec9600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec41096a0 0x7fcec419e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcec4104050 0x7fcec419a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34416/0 (socket says 172.21.15.8:34416) 2024-03-16T21:03:50.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec9600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec41096a0 0x7fcec419e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33858/0 (socket says 172.21.15.8:33858) 2024-03-16T21:03:50.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec3e00640 1 -- 172.21.15.8:0/1720189566 learned_addr learned my addr 172.21.15.8:0/1720189566 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:50.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec9600640 1 -- 172.21.15.8:0/1720189566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcec4104050 msgr2=0x7fcec419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec9600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcec4104050 0x7fcec419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec9600640 1 -- 172.21.15.8:0/1720189566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec4103690 msgr2=0x7fcec4199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec9600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec4103690 0x7fcec4199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec9600640 1 -- 172.21.15.8:0/1720189566 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4009560 con 0x7fcec41096a0 2024-03-16T21:03:50.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.350+0000 7fcec3e00640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcec4104050 0x7fcec419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:50.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.351+0000 7fcec9600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec41096a0 0x7fcec419e700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009fd0 tx=0x7fcebc00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.351+0000 7fcec1600640 1 -- 172.21.15.8:0/1720189566 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00ce20 con 0x7fcec41096a0 2024-03-16T21:03:50.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.351+0000 7fcecb600640 1 -- 172.21.15.8:0/1720189566 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec419f310 con 0x7fcec41096a0 2024-03-16T21:03:50.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.351+0000 7fcec1600640 1 -- 172.21.15.8:0/1720189566 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcebc004b20 con 0x7fcec41096a0 2024-03-16T21:03:50.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.351+0000 7fcec1600640 1 -- 172.21.15.8:0/1720189566 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc010710 con 0x7fcec41096a0 2024-03-16T21:03:50.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.351+0000 7fcecb600640 1 -- 172.21.15.8:0/1720189566 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec41a6b90 con 0x7fcec41096a0 2024-03-16T21:03:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.354+0000 7fcec1600640 1 -- 172.21.15.8:0/1720189566 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fcebc004c90 con 0x7fcec41096a0 2024-03-16T21:03:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.355+0000 7fcece257740 1 Processor -- start 2024-03-16T21:03:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.355+0000 7fcece257740 1 -- start start 2024-03-16T21:03:50.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.355+0000 7fcece257740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 0x55846eb35320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.355+0000 7fcece257740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb35860 0x55846eb3df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.355+0000 7fcece257740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb3e440 0x55846eb40830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.355+0000 7fcece257740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846eaf0300 con 0x55846eb35860 2024-03-16T21:03:50.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.355+0000 7fcece257740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846eaa2e50 con 0x55846eb3e440 2024-03-16T21:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.355+0000 7fcece257740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846eaa0380 con 0x55846eb34f40 2024-03-16T21:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.355+0000 7fcec3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 0x55846eb35320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 0x55846eb35320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33870/0 (socket says 172.21.15.8:33870) 2024-03-16T21:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec3e00640 1 -- 172.21.15.8:0/2612378450 learned_addr learned my addr 172.21.15.8:0/2612378450 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec3e00640 1 --2- 172.21.15.8:0/2612378450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb3e440 0x55846eb40830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec8c00640 1 --2- 172.21.15.8:0/2612378450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb35860 0x55846eb3df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec1600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcea80a1ba0 0x7fcea80a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec3e00640 1 -- 172.21.15.8:0/2612378450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb3e440 msgr2=0x55846eb40830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec3e00640 1 --2- 172.21.15.8:0/2612378450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb3e440 0x55846eb40830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec3e00640 1 -- 172.21.15.8:0/2612378450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb35860 msgr2=0x55846eb3df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec3e00640 1 --2- 172.21.15.8:0/2612378450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb35860 0x55846eb3df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec3e00640 1 -- 172.21.15.8:0/2612378450 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55846ea64c80 con 0x55846eb34f40 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec1600640 1 -- 172.21.15.8:0/1720189566 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcebc014070 con 0x7fcec41096a0 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec9600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcea80a1ba0 0x7fcea80a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fcec3e00640 1 --2- 172.21.15.8:0/2612378450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 0x55846eb35320 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fceb0011ca0 tx=0x7fceb0009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7844c24173496f0b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.356+0000 7fceb9c00640 1 -- 172.21.15.8:0/2612378450 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000fc50 con 0x55846eb34f40 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.357+0000 7fceb9c00640 1 -- 172.21.15.8:0/2612378450 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fceb000fdb0 con 0x55846eb34f40 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.357+0000 7fceb9c00640 1 -- 172.21.15.8:0/2612378450 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000e7d0 con 0x55846eb34f40 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.357+0000 7fcece257740 1 -- 172.21.15.8:0/2612378450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 msgr2=0x55846eb35320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.357+0000 7fcec9600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcea80a1ba0 0x7fcea80a4060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcebc004fb0 tx=0x7fcebc004f40 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.357+0000 7fcece257740 1 --2- 172.21.15.8:0/2612378450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 0x55846eb35320 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fceb0011ca0 tx=0x7fceb0009c60 comp rx=0 tx=0).stop 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.357+0000 7fcece257740 1 -- 172.21.15.8:0/2612378450 shutdown_connections 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.357+0000 7fcece257740 1 --2- 172.21.15.8:0/2612378450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb3e440 0x55846eb40830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.357+0000 7fcece257740 1 --2- 172.21.15.8:0/2612378450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb35860 0x55846eb3df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.357+0000 7fcece257740 1 --2- 172.21.15.8:0/2612378450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 0x55846eb35320 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.357+0000 7fcece257740 1 -- 172.21.15.8:0/2612378450 >> 172.21.15.8:0/2612378450 conn(0x55846eb2f670 msgr2=0x55846eb2fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.358+0000 7fcece257740 1 -- 172.21.15.8:0/2612378450 shutdown_connections 2024-03-16T21:03:50.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.358+0000 7fcece257740 1 -- 172.21.15.8:0/2612378450 wait complete. 2024-03-16T21:03:50.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.358+0000 7fcece257740 1 -- start start 2024-03-16T21:03:50.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.358+0000 7fcece257740 1 Processor -- start 2024-03-16T21:03:50.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcece257740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 0x55846eb3b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcece257740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb3b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcece257740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb3e440 0x55846eb3bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcece257740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846ea9bb60 con 0x55846eb34f40 2024-03-16T21:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcece257740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846ea40fd0 con 0x55846eb35860 2024-03-16T21:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcece257740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846ea40c70 con 0x55846eb3e440 2024-03-16T21:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcece257740 10 client.0 _ll_register_callbacks cb 0x55846e7acc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcec8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb3b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcec3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 0x55846eb3b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcec3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 0x55846eb3b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56190/0 (socket says 172.21.15.8:56190) 2024-03-16T21:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcec3e00640 1 -- 172.21.15.8:0/1828707482 learned_addr learned my addr 172.21.15.8:0/1828707482 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcec8c00640 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb3b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34422/0 (socket says 172.21.15.8:34422) 2024-03-16T21:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.359+0000 7fcec3e00640 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb3e440 0x55846eb3bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.360+0000 7fcec8c00640 1 -- 172.21.15.8:0/1828707482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb3e440 msgr2=0x55846eb3bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.360+0000 7fcec8c00640 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb3e440 0x55846eb3bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.360+0000 7fcec8c00640 1 -- 172.21.15.8:0/1828707482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 msgr2=0x55846eb3b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.360+0000 7fcec8c00640 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 0x55846eb3b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.360+0000 7fcec8c00640 1 -- 172.21.15.8:0/1828707482 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb0019040 con 0x55846eb35860 2024-03-16T21:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.360+0000 7fcec8c00640 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb3b9d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fceb4036040 tx=0x7fceb402c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=546a8242e7734d8e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.360+0000 7fceae000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.361+0000 7fceae000640 1 -- 172.21.15.8:0/1828707482 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb402cc80 con 0x55846eb35860 2024-03-16T21:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.361+0000 7fceae000640 1 -- 172.21.15.8:0/1828707482 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fceb4045070 con 0x55846eb35860 2024-03-16T21:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.361+0000 7fcece257740 1 -- 172.21.15.8:0/1828707482 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55846e79b860 con 0x55846eb35860 2024-03-16T21:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.361+0000 7fceae000640 1 -- 172.21.15.8:0/1828707482 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fceb4004040 con 0x55846eb35860 2024-03-16T21:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.361+0000 7fcece257740 10 client.26969 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.361+0000 7fcece257740 1 -- 172.21.15.8:0/1828707482 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55846ea9a1e0 con 0x55846eb35860 2024-03-16T21:03:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.361+0000 7fceae000640 1 -- 172.21.15.8:0/1828707482 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55846e79b860 con 0x55846eb35860 2024-03-16T21:03:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.361+0000 7fceae000640 1 -- 172.21.15.8:0/1828707482 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fceb403c040 con 0x55846eb35860 2024-03-16T21:03:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.362+0000 7fcece257740 10 client.26969 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.362+0000 7fcece257740 10 client.26969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.362+0000 7fcece257740 20 client.26969 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.362+0000 7fcece257740 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55846eb4e8c0 0x55846eb50ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.362+0000 7fcece257740 4 client.26969 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.362+0000 7fcece257740 1 -- 172.21.15.8:0/1828707482 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55846e7ec410 con 0x55846eb4e8c0 2024-03-16T21:03:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.362+0000 7fcec3e00640 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55846eb4e8c0 0x55846eb50ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.362+0000 7fcec3e00640 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55846eb4e8c0 0x55846eb50ce0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9e7696ba7da8fb2 server_cookie=f39e177c51bb4b84 in_seq=0 out_seq=0 2024-03-16T21:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.362+0000 7fceae000640 10 client.26969 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.363+0000 7fceae000640 1 -- 172.21.15.8:0/1828707482 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55846e7ec410 con 0x55846eb4e8c0 2024-03-16T21:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.363+0000 7fceae000640 10 client.26969 handle_command_reply: tid=0 2024-03-16T21:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 1 client.26969 shutdown 2024-03-16T21:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 1 -- 172.21.15.8:0/1828707482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 msgr2=0x55846eb3b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb3b9d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fceb4036040 tx=0x7fceb402c800 comp rx=0 tx=0).stop 2024-03-16T21:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 1 -- 172.21.15.8:0/1828707482 shutdown_connections 2024-03-16T21:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb3e440 0x55846eb3bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb3b9d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55846eb4e8c0 0x55846eb50ce0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 1 --2- 172.21.15.8:0/1828707482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 0x55846eb3b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 1 -- 172.21.15.8:0/1828707482 >> 172.21.15.8:0/1828707482 conn(0x55846eb2f670 msgr2=0x55846eb313c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fceae000640 0 client.26969 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 1 -- 172.21.15.8:0/1828707482 shutdown_connections 2024-03-16T21:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 1 -- 172.21.15.8:0/1828707482 wait complete. 2024-03-16T21:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.364+0000 7fcece257740 20 client.26969 trim_cache size 0 max 16384 2024-03-16T21:03:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.382+0000 7fcece257740 1 Processor -- start 2024-03-16T21:03:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.382+0000 7fcece257740 1 -- start start 2024-03-16T21:03:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcece257740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 0x55846eb3dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcece257740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb35860 0x55846eb49820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcece257740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb3e440 0x55846eb49d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcece257740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846eb3a300 con 0x55846eb35860 2024-03-16T21:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcece257740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846e7e40c0 con 0x55846eb3e440 2024-03-16T21:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcece257740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846eb34980 con 0x55846eb34f40 2024-03-16T21:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcec3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 0x55846eb3dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcec8c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb35860 0x55846eb49820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcec3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 0x55846eb3dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33874/0 (socket says 172.21.15.8:33874) 2024-03-16T21:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcec3e00640 1 -- 172.21.15.8:0/3443374059 learned_addr learned my addr 172.21.15.8:0/3443374059 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcec3e00640 1 --2- 172.21.15.8:0/3443374059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb3e440 0x55846eb49d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcec8c00640 1 -- 172.21.15.8:0/3443374059 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 msgr2=0x55846eb3dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcec8c00640 1 --2- 172.21.15.8:0/3443374059 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 0x55846eb3dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcec8c00640 1 -- 172.21.15.8:0/3443374059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb3e440 msgr2=0x55846eb49d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.383+0000 7fcec8c00640 1 --2- 172.21.15.8:0/3443374059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb3e440 0x55846eb49d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.384+0000 7fcec8c00640 1 -- 172.21.15.8:0/3443374059 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55846ea36a90 con 0x55846eb35860 2024-03-16T21:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.384+0000 7fcec8c00640 1 --2- 172.21.15.8:0/3443374059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb35860 0x55846eb49820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fceb402c170 tx=0x7fceb4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23e59a82dea4ab5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.384+0000 7fceb9200640 1 -- 172.21.15.8:0/3443374059 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb402c2b0 con 0x55846eb35860 2024-03-16T21:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.384+0000 7fceb9200640 1 -- 172.21.15.8:0/3443374059 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fceb4043070 con 0x55846eb35860 2024-03-16T21:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.384+0000 7fceb9200640 1 -- 172.21.15.8:0/3443374059 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4004e10 con 0x55846eb35860 2024-03-16T21:03:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.385+0000 7fcece257740 1 -- 172.21.15.8:0/3443374059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb35860 msgr2=0x55846eb49820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.385+0000 7fcece257740 1 --2- 172.21.15.8:0/3443374059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb35860 0x55846eb49820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fceb402c170 tx=0x7fceb4000bc0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.385+0000 7fcece257740 1 -- 172.21.15.8:0/3443374059 shutdown_connections 2024-03-16T21:03:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.385+0000 7fcece257740 1 --2- 172.21.15.8:0/3443374059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb3e440 0x55846eb49d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.385+0000 7fcece257740 1 --2- 172.21.15.8:0/3443374059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb35860 0x55846eb49820 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.385+0000 7fcece257740 1 --2- 172.21.15.8:0/3443374059 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb34f40 0x55846eb3dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.385+0000 7fcece257740 1 -- 172.21.15.8:0/3443374059 >> 172.21.15.8:0/3443374059 conn(0x55846eb2f670 msgr2=0x55846eb3bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.385+0000 7fcece257740 1 -- 172.21.15.8:0/3443374059 shutdown_connections 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.385+0000 7fcece257740 1 -- 172.21.15.8:0/3443374059 wait complete. 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.385+0000 7fcece257740 1 -- start start 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcece257740 1 Processor -- start 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcece257740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 0x55846eb43330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcece257740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb43870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcece257740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb3e440 0x55846eb43db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcece257740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846ebaa1a0 con 0x55846eb34f40 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcece257740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846ebaa2e0 con 0x55846eb35860 2024-03-16T21:03:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcece257740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846ebaa420 con 0x55846eb3e440 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcece257740 10 client.0 _ll_register_callbacks cb 0x7fceb0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcec8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb43870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcec8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb43870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34444/0 (socket says 172.21.15.8:34444) 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcec8c00640 1 -- 172.21.15.8:0/2098211387 learned_addr learned my addr 172.21.15.8:0/2098211387 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.386+0000 7fcec3e00640 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 0x55846eb43330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fcec3e00640 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb3e440 0x55846eb43db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fcec8c00640 1 -- 172.21.15.8:0/2098211387 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb3e440 msgr2=0x55846eb43db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fcec8c00640 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb3e440 0x55846eb43db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fcec8c00640 1 -- 172.21.15.8:0/2098211387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 msgr2=0x55846eb43330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fcec8c00640 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 0x55846eb43330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fcec8c00640 1 -- 172.21.15.8:0/2098211387 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55846ea9a1e0 con 0x55846eb35860 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fcec3e00640 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 0x55846eb43330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fcec8c00640 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb43870 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fceb402c240 tx=0x7fceb402c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d2a470870943e4d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fceae000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fceae000640 1 -- 172.21.15.8:0/2098211387 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4003bd0 con 0x55846eb35860 2024-03-16T21:03:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fceae000640 1 -- 172.21.15.8:0/2098211387 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fceb4045070 con 0x55846eb35860 2024-03-16T21:03:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.387+0000 7fcece257740 1 -- 172.21.15.8:0/2098211387 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fceb000fdb0 con 0x55846eb35860 2024-03-16T21:03:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fceae000640 1 -- 172.21.15.8:0/2098211387 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fceb402cc80 con 0x55846eb35860 2024-03-16T21:03:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fcece257740 10 client.26975 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fcece257740 1 -- 172.21.15.8:0/2098211387 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55846ea5c6a0 con 0x55846eb35860 2024-03-16T21:03:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fceae000640 1 -- 172.21.15.8:0/2098211387 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fceb000fdb0 con 0x55846eb35860 2024-03-16T21:03:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fceae000640 1 -- 172.21.15.8:0/2098211387 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fceb403c070 con 0x55846eb35860 2024-03-16T21:03:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fcece257740 10 client.26975 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fcece257740 10 client.26975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fcece257740 20 client.26975 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fcece257740 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55846ebab720 0x55846ebadb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fcece257740 4 client.26975 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:03:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fcece257740 1 -- 172.21.15.8:0/2098211387 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55846e7d87b0 con 0x55846ebab720 2024-03-16T21:03:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.388+0000 7fcec3e00640 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55846ebab720 0x55846ebadb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.389+0000 7fcec3e00640 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55846ebab720 0x55846ebadb10 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3119b37258422c43 server_cookie=7ecf6bd04c22a617 in_seq=0 out_seq=0 2024-03-16T21:03:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.389+0000 7fceae000640 10 client.26975 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fceae000640 1 -- 172.21.15.8:0/2098211387 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55846e7d87b0 con 0x55846ebab720 2024-03-16T21:03:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fceae000640 10 client.26975 handle_command_reply: tid=0 2024-03-16T21:03:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fcece257740 1 client.26975 shutdown 2024-03-16T21:03:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fcece257740 1 -- 172.21.15.8:0/2098211387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 msgr2=0x55846eb43870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fcece257740 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb43870 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fceb402c240 tx=0x7fceb402c7e0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fcece257740 1 -- 172.21.15.8:0/2098211387 shutdown_connections 2024-03-16T21:03:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fcece257740 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55846eb3e440 0x55846eb43db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fcece257740 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55846eb35860 0x55846eb43870 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fcece257740 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55846ebab720 0x55846ebadb10 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fcece257740 1 --2- 172.21.15.8:0/2098211387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55846eb34f40 0x55846eb43330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fcece257740 1 -- 172.21.15.8:0/2098211387 >> 172.21.15.8:0/2098211387 conn(0x55846eb2f670 msgr2=0x55846eb30950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.390+0000 7fceae000640 0 client.26975 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.391+0000 7fcece257740 1 -- 172.21.15.8:0/2098211387 shutdown_connections 2024-03-16T21:03:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.391+0000 7fcece257740 1 -- 172.21.15.8:0/2098211387 wait complete. 2024-03-16T21:03:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.391+0000 7fcece257740 20 client.26975 trim_cache size 0 max 16384 2024-03-16T21:03:50.404 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:03:50.405 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:03:50.405 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "228c65d0-5bab-4bc3-9c05-5d5a32d166b2", 2024-03-16T21:03:50.405 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:03:50.405 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:03:50.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.391+0000 7fcecb600640 1 -- 172.21.15.8:0/1720189566 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcea80a1ba0 msgr2=0x7fcea80a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.392+0000 7fcecb600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcea80a1ba0 0x7fcea80a4060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcebc004fb0 tx=0x7fcebc004f40 comp rx=0 tx=0).stop 2024-03-16T21:03:50.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.392+0000 7fcecb600640 1 -- 172.21.15.8:0/1720189566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec41096a0 msgr2=0x7fcec419e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.392+0000 7fcecb600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec41096a0 0x7fcec419e700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009fd0 tx=0x7fcebc00ef10 comp rx=0 tx=0).stop 2024-03-16T21:03:50.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.392+0000 7fcecb600640 1 -- 172.21.15.8:0/1720189566 shutdown_connections 2024-03-16T21:03:50.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.392+0000 7fcecb600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcea80a1ba0 0x7fcea80a4060 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.392+0000 7fcecb600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec41096a0 0x7fcec419e700 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.392+0000 7fcecb600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcec4104050 0x7fcec419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.392+0000 7fcecb600640 1 --2- 172.21.15.8:0/1720189566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcec4103690 0x7fcec4199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.392+0000 7fcecb600640 1 -- 172.21.15.8:0/1720189566 >> 172.21.15.8:0/1720189566 conn(0x7fcec40ff140 msgr2=0x7fcec40ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.392+0000 7fcecb600640 1 -- 172.21.15.8:0/1720189566 shutdown_connections 2024-03-16T21:03:50.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.392+0000 7fcecb600640 1 -- 172.21.15.8:0/1720189566 wait complete. 2024-03-16T21:03:50.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:03:50.415 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:03:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.639+0000 7fee9a400640 1 -- 172.21.15.8:0/1841802654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee94103590 msgr2=0x7fee94103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.639+0000 7fee9a400640 1 --2- 172.21.15.8:0/1841802654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee94103590 0x7fee94103a10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009930 tx=0x7fee7c02bc30 comp rx=0 tx=0).stop 2024-03-16T21:03:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.639+0000 7fee9a400640 1 -- 172.21.15.8:0/1841802654 shutdown_connections 2024-03-16T21:03:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.639+0000 7fee9a400640 1 --2- 172.21.15.8:0/1841802654 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee94103f50 0x7fee94110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.639+0000 7fee9a400640 1 --2- 172.21.15.8:0/1841802654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee94103590 0x7fee94103a10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.639+0000 7fee9a400640 1 --2- 172.21.15.8:0/1841802654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94109650 0x7fee94109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.639+0000 7fee9a400640 1 -- 172.21.15.8:0/1841802654 >> 172.21.15.8:0/1841802654 conn(0x7fee940ff020 msgr2=0x7fee94101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.639+0000 7fee9a400640 1 -- 172.21.15.8:0/1841802654 shutdown_connections 2024-03-16T21:03:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.639+0000 7fee9a400640 1 -- 172.21.15.8:0/1841802654 wait complete. 2024-03-16T21:03:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.640+0000 7fee9a400640 1 Processor -- start 2024-03-16T21:03:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.640+0000 7fee9a400640 1 -- start start 2024-03-16T21:03:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.640+0000 7fee9a400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee94103590 0x7fee9419f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.640+0000 7fee9a400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94103f50 0x7fee9419fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.640+0000 7fee9a400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee94109650 0x7fee94199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee9a400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9419a1a0 con 0x7fee94103f50 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee9a400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9419a310 con 0x7fee94103590 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee9a400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9419a4d0 con 0x7fee94109650 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee99000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee94103590 0x7fee9419f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee99a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee94109650 0x7fee94199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee99000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee94103590 0x7fee9419f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34468/0 (socket says 172.21.15.8:34468) 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee99000640 1 -- 172.21.15.8:0/4229558718 learned_addr learned my addr 172.21.15.8:0/4229558718 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee8be00640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94103f50 0x7fee9419fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee99a00640 1 -- 172.21.15.8:0/4229558718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee94103590 msgr2=0x7fee9419f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee99a00640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee94103590 0x7fee9419f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee99a00640 1 -- 172.21.15.8:0/4229558718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94103f50 msgr2=0x7fee9419fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee99a00640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94103f50 0x7fee9419fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee99a00640 1 -- 172.21.15.8:0/4229558718 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c009560 con 0x7fee94109650 2024-03-16T21:03:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.641+0000 7fee99000640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee94103590 0x7fee9419f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.642+0000 7fee99a00640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee94109650 0x7fee94199b50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00e970 tx=0x7fee8c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.642+0000 7fee92000640 1 -- 172.21.15.8:0/4229558718 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c009620 con 0x7fee94109650 2024-03-16T21:03:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.642+0000 7fee92000640 1 -- 172.21.15.8:0/4229558718 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fee8c00ccc0 con 0x7fee94109650 2024-03-16T21:03:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.642+0000 7fee92000640 1 -- 172.21.15.8:0/4229558718 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c0049e0 con 0x7fee94109650 2024-03-16T21:03:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.642+0000 7fee9a400640 1 -- 172.21.15.8:0/4229558718 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9419a7b0 con 0x7fee94109650 2024-03-16T21:03:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.642+0000 7fee9a400640 1 -- 172.21.15.8:0/4229558718 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee941a69f0 con 0x7fee94109650 2024-03-16T21:03:50.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.645+0000 7fee9e7cb740 1 Processor -- start 2024-03-16T21:03:50.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.645+0000 7fee92000640 1 -- 172.21.15.8:0/4229558718 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fee8c005020 con 0x7fee94109650 2024-03-16T21:03:50.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee9e7cb740 1 -- start start 2024-03-16T21:03:50.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x558488665ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x558488666910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x558488671bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584885d5150 con 0x558488666490 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584885d2680 con 0x558488667170 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584885cde60 con 0x55848866f800 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee8be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x558488665ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee99000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x558488666910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee8be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x558488665ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34484/0 (socket says 172.21.15.8:34484) 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee8be00640 1 -- 172.21.15.8:0/1566949626 learned_addr learned my addr 172.21.15.8:0/1566949626 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.646+0000 7fee8be00640 1 --2- 172.21.15.8:0/1566949626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x558488671bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee99000640 1 -- 172.21.15.8:0/1566949626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 msgr2=0x558488671bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee99000640 1 --2- 172.21.15.8:0/1566949626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x558488671bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee99000640 1 -- 172.21.15.8:0/1566949626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 msgr2=0x558488665ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee99000640 1 --2- 172.21.15.8:0/1566949626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x558488665ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee99000640 1 -- 172.21.15.8:0/1566949626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558488587060 con 0x558488666490 2024-03-16T21:03:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee8be00640 1 --2- 172.21.15.8:0/1566949626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x558488665ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:03:50.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee92000640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fee780a1c20 0x7fee780a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee92000640 1 -- 172.21.15.8:0/4229558718 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fee8c014070 con 0x7fee94109650 2024-03-16T21:03:50.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee99000640 1 --2- 172.21.15.8:0/1566949626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x558488666910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fee84011730 tx=0x7fee84011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a617407c68bb110c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee8be00640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fee780a1c20 0x7fee780a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee8a000640 1 -- 172.21.15.8:0/1566949626 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84003b70 con 0x558488666490 2024-03-16T21:03:50.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee8a000640 1 -- 172.21.15.8:0/1566949626 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fee8400fe40 con 0x558488666490 2024-03-16T21:03:50.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.647+0000 7fee8a000640 1 -- 172.21.15.8:0/1566949626 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84004820 con 0x558488666490 2024-03-16T21:03:50.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.648+0000 7fee9e7cb740 1 -- 172.21.15.8:0/1566949626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 msgr2=0x558488666910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.648+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/1566949626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x558488666910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fee84011730 tx=0x7fee84011bf0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.648+0000 7fee8be00640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fee780a1c20 0x7fee780a40e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee7c02c850 tx=0x7fee7c005fd0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.648+0000 7fee9e7cb740 1 -- 172.21.15.8:0/1566949626 shutdown_connections 2024-03-16T21:03:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.648+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/1566949626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x558488671bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.648+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/1566949626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x558488666910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.648+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/1566949626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x558488665ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.648+0000 7fee9e7cb740 1 -- 172.21.15.8:0/1566949626 >> 172.21.15.8:0/1566949626 conn(0x55848862d5a0 msgr2=0x558488660ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.648+0000 7fee9e7cb740 1 -- 172.21.15.8:0/1566949626 shutdown_connections 2024-03-16T21:03:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.648+0000 7fee9e7cb740 1 -- 172.21.15.8:0/1566949626 wait complete. 2024-03-16T21:03:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.649+0000 7fee9e7cb740 1 -- start start 2024-03-16T21:03:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.649+0000 7fee9e7cb740 1 Processor -- start 2024-03-16T21:03:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.649+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x55848866c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.649+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558488667170 0x55848866cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.649+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848866f800 0x55848866d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.649+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558488572ec0 con 0x558488666490 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.649+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558488572b60 con 0x55848866f800 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.649+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55848833c1c0 con 0x558488667170 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee9e7cb740 10 client.0 _ll_register_callbacks cb 0x558488586960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee8be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558488667170 0x55848866cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee99000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x55848866c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee99a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848866f800 0x55848866d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee8be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558488667170 0x55848866cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:33906/0 (socket says 172.21.15.8:33906) 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee8be00640 1 -- 172.21.15.8:0/465292957 learned_addr learned my addr 172.21.15.8:0/465292957 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee99a00640 1 -- 172.21.15.8:0/465292957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558488667170 msgr2=0x55848866cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee99a00640 1 --2- 172.21.15.8:0/465292957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558488667170 0x55848866cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee99a00640 1 -- 172.21.15.8:0/465292957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 msgr2=0x55848866c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee99a00640 1 --2- 172.21.15.8:0/465292957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x55848866c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee99a00640 1 -- 172.21.15.8:0/465292957 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee840113e0 con 0x55848866f800 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee99a00640 1 --2- 172.21.15.8:0/465292957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848866f800 0x55848866d160 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0cadd0 tx=0x7fee8c09a9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2340f3d2ed8bd9ce server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.650+0000 7fee82a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee82a00640 1 -- 172.21.15.8:0/465292957 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c0a2a50 con 0x55848866f800 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee82a00640 1 -- 172.21.15.8:0/465292957 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fee8c0a25c0 con 0x55848866f800 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee9e7cb740 1 -- 172.21.15.8:0/465292957 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584882cd7e0 con 0x55848866f800 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee82a00640 1 -- 172.21.15.8:0/465292957 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee8c0a2780 con 0x55848866f800 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee9e7cb740 10 client.26987 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee9e7cb740 1 -- 172.21.15.8:0/465292957 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5584885cc4e0 con 0x55848866f800 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee82a00640 1 -- 172.21.15.8:0/465292957 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5584882cd7e0 con 0x55848866f800 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee82a00640 1 -- 172.21.15.8:0/465292957 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fee8c099820 con 0x55848866f800 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee9e7cb740 10 client.26987 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee9e7cb740 10 client.26987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:50.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee9e7cb740 20 client.26987 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/465292957 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55848867f7e0 0x558488681c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee9e7cb740 4 client.26987 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.651+0000 7fee9e7cb740 1 -- 172.21.15.8:0/465292957 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55848830a720 con 0x55848867f7e0 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.652+0000 7fee99000640 1 --2- 172.21.15.8:0/465292957 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55848867f7e0 0x558488681c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.652+0000 7fee99000640 1 --2- 172.21.15.8:0/465292957 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55848867f7e0 0x558488681c00 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=478cc7a1b8dcf81 server_cookie=2deab2825f31139f in_seq=0 out_seq=0 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.652+0000 7fee82a00640 10 client.26987 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee82a00640 1 -- 172.21.15.8:0/465292957 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55848830a720 con 0x55848867f7e0 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee82a00640 10 client.26987 handle_command_reply: tid=0 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee9e7cb740 1 client.26987 shutdown 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee9e7cb740 1 -- 172.21.15.8:0/465292957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848866f800 msgr2=0x55848866d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/465292957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848866f800 0x55848866d160 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0cadd0 tx=0x7fee8c09a9b0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee9e7cb740 1 -- 172.21.15.8:0/465292957 shutdown_connections 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/465292957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55848866f800 0x55848866d160 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/465292957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558488667170 0x55848866cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/465292957 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55848867f7e0 0x558488681c00 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/465292957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x55848866c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee82a00640 0 client.26987 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:50.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee9e7cb740 1 -- 172.21.15.8:0/465292957 >> 172.21.15.8:0/465292957 conn(0x55848862d5a0 msgr2=0x558488662c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee9e7cb740 1 -- 172.21.15.8:0/465292957 shutdown_connections 2024-03-16T21:03:50.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.653+0000 7fee9e7cb740 1 -- 172.21.15.8:0/465292957 wait complete. 2024-03-16T21:03:50.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.654+0000 7fee9e7cb740 20 client.26987 trim_cache size 0 max 16384 2024-03-16T21:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.671+0000 7fee9e7cb740 1 Processor -- start 2024-03-16T21:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.671+0000 7fee9e7cb740 1 -- start start 2024-03-16T21:03:50.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.672+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488666490 0x55848866ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.672+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488667170 0x558488662a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.672+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x55848867acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.672+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558488661d10 con 0x558488667170 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.672+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558488665740 con 0x558488666490 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.672+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558488662110 con 0x55848866f800 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.672+0000 7fee8be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488667170 0x558488662a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.672+0000 7fee99a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x55848867acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.672+0000 7fee8be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488667170 0x558488662a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56268/0 (socket says 172.21.15.8:56268) 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.672+0000 7fee99000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488666490 0x55848866ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.672+0000 7fee8be00640 1 -- 172.21.15.8:0/2481273075 learned_addr learned my addr 172.21.15.8:0/2481273075 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.673+0000 7fee99a00640 1 -- 172.21.15.8:0/2481273075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488666490 msgr2=0x55848866ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.673+0000 7fee99a00640 1 --2- 172.21.15.8:0/2481273075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488666490 0x55848866ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.673+0000 7fee99a00640 1 -- 172.21.15.8:0/2481273075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488667170 msgr2=0x558488662a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.673+0000 7fee99a00640 1 --2- 172.21.15.8:0/2481273075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488667170 0x558488662a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.673+0000 7fee99a00640 1 -- 172.21.15.8:0/2481273075 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558488568950 con 0x55848866f800 2024-03-16T21:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.673+0000 7fee99a00640 1 --2- 172.21.15.8:0/2481273075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x55848867acf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00c6a0 tx=0x7fee8c0965d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5f322dea34773d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.673+0000 7fee89600640 1 -- 172.21.15.8:0/2481273075 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c0a2a50 con 0x55848866f800 2024-03-16T21:03:50.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.673+0000 7fee89600640 1 -- 172.21.15.8:0/2481273075 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fee8c099700 con 0x55848866f800 2024-03-16T21:03:50.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.673+0000 7fee89600640 1 -- 172.21.15.8:0/2481273075 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c0a2820 con 0x55848866f800 2024-03-16T21:03:50.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.674+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2481273075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 msgr2=0x55848867acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.674+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/2481273075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x55848867acf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00c6a0 tx=0x7fee8c0965d0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.674+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2481273075 shutdown_connections 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.674+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/2481273075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x55848867acf0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.674+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/2481273075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488667170 0x558488662a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.674+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/2481273075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488666490 0x55848866ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.674+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2481273075 >> 172.21.15.8:0/2481273075 conn(0x55848862d5a0 msgr2=0x558488662330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.674+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2481273075 shutdown_connections 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.674+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2481273075 wait complete. 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.674+0000 7fee9e7cb740 1 -- start start 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.674+0000 7fee9e7cb740 1 Processor -- start 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x5584886d3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x5584886d3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee9e7cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x5584886696b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558488669c70 con 0x558488666490 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558488669de0 con 0x558488667170 2024-03-16T21:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee9e7cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558488669fa0 con 0x55848866f800 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee9e7cb740 10 client.0 _ll_register_callbacks cb 0x7fee8c099df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee99000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x5584886d3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee8be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x5584886d3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee8be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x5584886d3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:34508/0 (socket says 172.21.15.8:34508) 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee8be00640 1 -- 172.21.15.8:0/2051181919 learned_addr learned my addr 172.21.15.8:0/2051181919 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.675+0000 7fee99a00640 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x5584886696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee8be00640 1 -- 172.21.15.8:0/2051181919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 msgr2=0x5584886696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee8be00640 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x5584886696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee8be00640 1 -- 172.21.15.8:0/2051181919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 msgr2=0x5584886d3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee8be00640 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x5584886d3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee8be00640 1 -- 172.21.15.8:0/2051181919 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584885cc4e0 con 0x558488667170 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee99a00640 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x5584886696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee99000640 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x5584886d3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee8be00640 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x5584886d3970 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fee7c02c170 tx=0x7fee7c02bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=906d3f7a271226f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee82a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee82a00640 1 -- 172.21.15.8:0/2051181919 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c005560 con 0x558488667170 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee82a00640 1 -- 172.21.15.8:0/2051181919 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fee7c048040 con 0x558488667170 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2051181919 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee8400fe40 con 0x558488667170 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee82a00640 1 -- 172.21.15.8:0/2051181919 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee7c0035f0 con 0x558488667170 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee9e7cb740 10 client.26993 fetch_fsmap learned FSMap version 36 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.676+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2051181919 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55848858e430 con 0x558488667170 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.677+0000 7fee82a00640 1 -- 172.21.15.8:0/2051181919 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fee8400fe40 con 0x558488667170 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.677+0000 7fee82a00640 1 -- 172.21.15.8:0/2051181919 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fee7c04f890 con 0x558488667170 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.677+0000 7fee9e7cb740 10 client.26993 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.677+0000 7fee9e7cb740 10 client.26993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.677+0000 7fee9e7cb740 20 client.26993 populate_metadata read hostname 'smithi008' 2024-03-16T21:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.677+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5584886dc470 0x5584886de890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:03:50.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.677+0000 7fee9e7cb740 4 client.26993 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:03:50.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.677+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2051181919 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558488359890 con 0x5584886dc470 2024-03-16T21:03:50.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.677+0000 7fee99000640 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5584886dc470 0x5584886de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:03:50.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee99000640 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5584886dc470 0x5584886de890 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b7929ebf17a400d server_cookie=aa9414e1958029d8 in_seq=0 out_seq=0 2024-03-16T21:03:50.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee82a00640 10 client.26993 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:50.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee82a00640 1 -- 172.21.15.8:0/2051181919 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558488359890 con 0x5584886dc470 2024-03-16T21:03:50.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee82a00640 10 client.26993 handle_command_reply: tid=0 2024-03-16T21:03:50.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 1 client.26993 shutdown 2024-03-16T21:03:50.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2051181919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 msgr2=0x5584886d3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x5584886d3970 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fee7c02c170 tx=0x7fee7c02bc30 comp rx=0 tx=0).stop 2024-03-16T21:03:50.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2051181919 shutdown_connections 2024-03-16T21:03:50.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55848866f800 0x5584886696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558488667170 0x5584886d3970 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5584886dc470 0x5584886de890 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 1 --2- 172.21.15.8:0/2051181919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558488666490 0x5584886d3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee82a00640 0 client.26993 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:03:50.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2051181919 >> 172.21.15.8:0/2051181919 conn(0x55848862d5a0 msgr2=0x55848866cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2051181919 shutdown_connections 2024-03-16T21:03:50.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 1 -- 172.21.15.8:0/2051181919 wait complete. 2024-03-16T21:03:50.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.678+0000 7fee9e7cb740 20 client.26993 trim_cache size 0 max 16384 2024-03-16T21:03:50.689 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:03:50.690 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:03:50.690 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:03:50.690 INFO:teuthology.orchestra.run.smithi008.stdout: "228c65d0-5bab-4bc3-9c05-5d5a32d166b2": { 2024-03-16T21:03:50.690 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:03:50.690 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "228c65d0-5bab-4bc3-9c05-5d5a32d166b2", 2024-03-16T21:03:50.690 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:03:50.690 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:03:50.690 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:03:50.690 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:03:50.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 -- 172.21.15.8:0/4229558718 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fee780a1c20 msgr2=0x7fee780a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fee780a1c20 0x7fee780a40e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee7c02c850 tx=0x7fee7c005fd0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 -- 172.21.15.8:0/4229558718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee94109650 msgr2=0x7fee94199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:03:50.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee94109650 0x7fee94199b50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00e970 tx=0x7fee8c00ee30 comp rx=0 tx=0).stop 2024-03-16T21:03:50.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 -- 172.21.15.8:0/4229558718 shutdown_connections 2024-03-16T21:03:50.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fee780a1c20 0x7fee780a40e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee94109650 0x7fee94199b50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94103f50 0x7fee9419fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 --2- 172.21.15.8:0/4229558718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee94103590 0x7fee9419f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:03:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 -- 172.21.15.8:0/4229558718 >> 172.21.15.8:0/4229558718 conn(0x7fee940ff020 msgr2=0x7fee941006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:03:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 -- 172.21.15.8:0/4229558718 shutdown_connections 2024-03-16T21:03:50.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:03:50.679+0000 7fee9a400640 1 -- 172.21.15.8:0/4229558718 wait complete. 2024-03-16T21:03:50.704 INFO:tasks.cephfs.filesystem:scrub status for tag:228c65d0-5bab-4bc3-9c05-5d5a32d166b2 - {'path': '/', 'tag': '228c65d0-5bab-4bc3-9c05-5d5a32d166b2', 'options': 'recursive,force'} 2024-03-16T21:03:51.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:50 smithi170 ceph-mon[35947]: pgmap v183: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:51.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:50 smithi186 ceph-mon[36391]: pgmap v183: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:51.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:50 smithi008 ceph-mon[31434]: pgmap v183: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:03:52.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:51 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:03:52.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:51 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:52.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:51 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:03:52.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:51 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:52.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:51 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:03:52.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:51 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:52.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:51 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:03:52.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:51 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:52.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:51 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:03:52.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:51 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:52.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:51 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:03:52.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:51 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:03:53.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:52 smithi170 ceph-mon[35947]: pgmap v184: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-03-16T21:03:53.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:52 smithi186 ceph-mon[36391]: pgmap v184: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-03-16T21:03:53.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:52 smithi008 ceph-mon[31434]: pgmap v184: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-03-16T21:03:54.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:53 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:03:54.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:53 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:03:54.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:53 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:03:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:54 smithi170 ceph-mon[35947]: pgmap v185: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-03-16T21:03:55.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:54 smithi186 ceph-mon[36391]: pgmap v185: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-03-16T21:03:55.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:54 smithi008 ceph-mon[31434]: pgmap v185: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-03-16T21:03:57.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:56 smithi170 ceph-mon[35947]: pgmap v186: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:03:57.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:56 smithi186 ceph-mon[36391]: pgmap v186: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:03:57.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:56 smithi008 ceph-mon[31434]: pgmap v186: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:03:59.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:03:58 smithi170 ceph-mon[35947]: pgmap v187: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:03:59.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:03:58 smithi186 ceph-mon[36391]: pgmap v187: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:03:59.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:03:58 smithi008 ceph-mon[31434]: pgmap v187: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:04:01.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:00 smithi186 ceph-mon[36391]: pgmap v188: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:04:01.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:00 smithi008 ceph-mon[31434]: pgmap v188: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:04:01.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:00 smithi170 ceph-mon[35947]: pgmap v188: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:04:03.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:02 smithi186 ceph-mon[36391]: pgmap v189: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:04:03.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:02 smithi008 ceph-mon[31434]: pgmap v189: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:04:03.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:02 smithi170 ceph-mon[35947]: pgmap v189: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:04:05.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:04 smithi186 ceph-mon[36391]: pgmap v190: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-16T21:04:05.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:04 smithi008 ceph-mon[31434]: pgmap v190: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-16T21:04:05.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:04 smithi170 ceph-mon[35947]: pgmap v190: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-16T21:04:07.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:06 smithi186 ceph-mon[36391]: pgmap v191: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-03-16T21:04:07.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:06 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:04:07.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:06 smithi008 ceph-mon[31434]: pgmap v191: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-03-16T21:04:07.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:06 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:04:07.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:06 smithi170 ceph-mon[35947]: pgmap v191: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-03-16T21:04:07.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:06 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:04:08.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:07 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:04:08.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:07 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:04:08.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:07 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:04:08.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:07 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:04:08.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:07 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:04:08.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:07 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:04:08.269 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:07 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:04:08.269 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:07 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:04:08.269 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:07 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:04:09.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:08 smithi008 ceph-mon[31434]: pgmap v192: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-03-16T21:04:09.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:08 smithi008 ceph-mon[31434]: osdmap e90: 12 total, 12 up, 12 in 2024-03-16T21:04:09.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:08 smithi170 ceph-mon[35947]: pgmap v192: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-03-16T21:04:09.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:08 smithi170 ceph-mon[35947]: osdmap e90: 12 total, 12 up, 12 in 2024-03-16T21:04:09.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:08 smithi186 ceph-mon[36391]: pgmap v192: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-03-16T21:04:09.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:08 smithi186 ceph-mon[36391]: osdmap e90: 12 total, 12 up, 12 in 2024-03-16T21:04:11.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:10 smithi008 ceph-mon[31434]: pgmap v194: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-03-16T21:04:11.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:10 smithi170 ceph-mon[35947]: pgmap v194: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-03-16T21:04:11.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:10 smithi186 ceph-mon[36391]: pgmap v194: 97 pgs: 97 active+clean; 172 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-03-16T21:04:13.196 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:12 smithi186 ceph-mon[36391]: pgmap v195: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-03-16T21:04:13.196 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:12 smithi186 ceph-mon[36391]: osdmap e91: 12 total, 12 up, 12 in 2024-03-16T21:04:13.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:12 smithi008 ceph-mon[31434]: pgmap v195: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-03-16T21:04:13.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:12 smithi008 ceph-mon[31434]: osdmap e91: 12 total, 12 up, 12 in 2024-03-16T21:04:13.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:12 smithi170 ceph-mon[35947]: pgmap v195: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-03-16T21:04:13.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:12 smithi170 ceph-mon[35947]: osdmap e91: 12 total, 12 up, 12 in 2024-03-16T21:04:15.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:14 smithi008 ceph-mon[31434]: pgmap v197: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-03-16T21:04:15.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:14 smithi170 ceph-mon[35947]: pgmap v197: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-03-16T21:04:15.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:14 smithi186 ceph-mon[36391]: pgmap v197: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-03-16T21:04:17.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:16 smithi008 ceph-mon[31434]: pgmap v198: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 4 op/s 2024-03-16T21:04:17.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:16 smithi170 ceph-mon[35947]: pgmap v198: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 4 op/s 2024-03-16T21:04:17.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:16 smithi186 ceph-mon[36391]: pgmap v198: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 4 op/s 2024-03-16T21:04:19.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:18 smithi008 ceph-mon[31434]: pgmap v199: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 232 B/s wr, 7 op/s 2024-03-16T21:04:19.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:18 smithi170 ceph-mon[35947]: pgmap v199: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 232 B/s wr, 7 op/s 2024-03-16T21:04:19.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:18 smithi186 ceph-mon[36391]: pgmap v199: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 232 B/s wr, 7 op/s 2024-03-16T21:04:20.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:04:20.706 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:04:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.937+0000 7fe257000640 1 -- 172.21.15.8:0/3215421385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2501096a0 msgr2=0x7fe250109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.937+0000 7fe257000640 1 --2- 172.21.15.8:0/3215421385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2501096a0 0x7fe250109a80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe240009ca0 tx=0x7fe24002c100 comp rx=0 tx=0).stop 2024-03-16T21:04:20.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.937+0000 7fe257000640 1 -- 172.21.15.8:0/3215421385 shutdown_connections 2024-03-16T21:04:20.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.938+0000 7fe257000640 1 --2- 172.21.15.8:0/3215421385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe250104050 0x7fe250110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.938+0000 7fe257000640 1 --2- 172.21.15.8:0/3215421385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe250103690 0x7fe250103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.938+0000 7fe257000640 1 --2- 172.21.15.8:0/3215421385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2501096a0 0x7fe250109a80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.938+0000 7fe257000640 1 -- 172.21.15.8:0/3215421385 >> 172.21.15.8:0/3215421385 conn(0x7fe2500ff1a0 msgr2=0x7fe2501015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:20.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.938+0000 7fe257000640 1 -- 172.21.15.8:0/3215421385 shutdown_connections 2024-03-16T21:04:20.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.938+0000 7fe257000640 1 -- 172.21.15.8:0/3215421385 wait complete. 2024-03-16T21:04:20.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.939+0000 7fe257000640 1 Processor -- start 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.939+0000 7fe257000640 1 -- start start 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.939+0000 7fe257000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe250103690 0x7fe250199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.939+0000 7fe257000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe250104050 0x7fe25019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.939+0000 7fe257000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2501096a0 0x7fe25019e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.939+0000 7fe257000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25019ecb0 con 0x7fe250104050 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.939+0000 7fe257000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25019ee20 con 0x7fe2501096a0 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.939+0000 7fe257000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25019efe0 con 0x7fe250103690 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.940+0000 7fe24fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe250103690 0x7fe250199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.940+0000 7fe24fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe250103690 0x7fe250199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36664/0 (socket says 172.21.15.8:36664) 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.940+0000 7fe24fe00640 1 -- 172.21.15.8:0/2730837164 learned_addr learned my addr 172.21.15.8:0/2730837164 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.940+0000 7fe255000640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2501096a0 0x7fe25019e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.940+0000 7fe24f400640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe250104050 0x7fe25019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.940+0000 7fe24fe00640 1 -- 172.21.15.8:0/2730837164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2501096a0 msgr2=0x7fe25019e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:20.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.940+0000 7fe24fe00640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2501096a0 0x7fe25019e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.940+0000 7fe24fe00640 1 -- 172.21.15.8:0/2730837164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe250104050 msgr2=0x7fe25019a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:20.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.940+0000 7fe24fe00640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe250104050 0x7fe25019a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.940+0000 7fe24fe00640 1 -- 172.21.15.8:0/2730837164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe240009900 con 0x7fe250103690 2024-03-16T21:04:20.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.940+0000 7fe24fe00640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe250103690 0x7fe250199df0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe240005e30 tx=0x7fe240032a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:20.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.941+0000 7fe24cc00640 1 -- 172.21.15.8:0/2730837164 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240034850 con 0x7fe250103690 2024-03-16T21:04:20.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.941+0000 7fe24cc00640 1 -- 172.21.15.8:0/2730837164 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe240032600 con 0x7fe250103690 2024-03-16T21:04:20.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.941+0000 7fe24cc00640 1 -- 172.21.15.8:0/2730837164 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240004810 con 0x7fe250103690 2024-03-16T21:04:20.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.941+0000 7fe257000640 1 -- 172.21.15.8:0/2730837164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25019f260 con 0x7fe250103690 2024-03-16T21:04:20.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.941+0000 7fe257000640 1 -- 172.21.15.8:0/2730837164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2501a6b40 con 0x7fe250103690 2024-03-16T21:04:20.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.944+0000 7fe24cc00640 1 -- 172.21.15.8:0/2730837164 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fe24003b040 con 0x7fe250103690 2024-03-16T21:04:20.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.944+0000 7fe259c57740 1 Processor -- start 2024-03-16T21:04:20.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.944+0000 7fe259c57740 1 -- start start 2024-03-16T21:04:20.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.944+0000 7fe259c57740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e53cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.944+0000 7fe259c57740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e54740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe259c57740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe259c57740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8dc3150 con 0x55f8f8e5d630 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe259c57740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8dc0680 con 0x55f8f8e542c0 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe259c57740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8dbbe60 con 0x55f8f8e54fa0 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe24fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e54740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe255000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e53cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe255000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e53cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36674/0 (socket says 172.21.15.8:36674) 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe255000640 1 -- 172.21.15.8:0/1586467299 learned_addr learned my addr 172.21.15.8:0/1586467299 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe24f400640 1 --2- 172.21.15.8:0/1586467299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe255000640 1 -- 172.21.15.8:0/1586467299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 msgr2=0x55f8f8e54740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:20.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe255000640 1 --2- 172.21.15.8:0/1586467299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e54740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe255000640 1 -- 172.21.15.8:0/1586467299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e5d630 msgr2=0x55f8f8e5fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe255000640 1 --2- 172.21.15.8:0/1586467299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe255000640 1 -- 172.21.15.8:0/1586467299 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8f8d75060 con 0x55f8f8e54fa0 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe24cc00640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2340a1c20 0x7fe2340a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.945+0000 7fe255000640 1 --2- 172.21.15.8:0/1586467299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e53cf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe248009c20 tx=0x7fe248011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27251374c9ace8a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.946+0000 7fe24cc00640 1 -- 172.21.15.8:0/2730837164 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe2400f0130 con 0x7fe250103690 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.946+0000 7fe245600640 1 -- 172.21.15.8:0/1586467299 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248019630 con 0x55f8f8e54fa0 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.946+0000 7fe24fe00640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2340a1c20 0x7fe2340a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.946+0000 7fe245600640 1 -- 172.21.15.8:0/1586467299 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe248009e90 con 0x55f8f8e54fa0 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.946+0000 7fe245600640 1 -- 172.21.15.8:0/1586467299 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800ebb0 con 0x55f8f8e54fa0 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.946+0000 7fe259c57740 1 -- 172.21.15.8:0/1586467299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e54fa0 msgr2=0x55f8f8e53cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.946+0000 7fe259c57740 1 --2- 172.21.15.8:0/1586467299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e53cf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe248009c20 tx=0x7fe248011810 comp rx=0 tx=0).stop 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.946+0000 7fe24fe00640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2340a1c20 0x7fe2340a40e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55f8f8e554f0 tx=0x7fe2400f3ba0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:20.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.947+0000 7fe259c57740 1 -- 172.21.15.8:0/1586467299 shutdown_connections 2024-03-16T21:04:20.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.947+0000 7fe259c57740 1 --2- 172.21.15.8:0/1586467299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.947+0000 7fe259c57740 1 --2- 172.21.15.8:0/1586467299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e54740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.947+0000 7fe259c57740 1 --2- 172.21.15.8:0/1586467299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e53cf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.947+0000 7fe259c57740 1 -- 172.21.15.8:0/1586467299 >> 172.21.15.8:0/1586467299 conn(0x55f8f8e1b5a0 msgr2=0x55f8f8e4ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:20.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.947+0000 7fe259c57740 1 -- 172.21.15.8:0/1586467299 shutdown_connections 2024-03-16T21:04:20.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.947+0000 7fe259c57740 1 -- 172.21.15.8:0/1586467299 wait complete. 2024-03-16T21:04:20.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.947+0000 7fe259c57740 1 -- start start 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.947+0000 7fe259c57740 1 Processor -- start 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe259c57740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e5a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe259c57740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e5ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe259c57740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe259c57740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8d60ec0 con 0x55f8f8e54fa0 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe259c57740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8d60b60 con 0x55f8f8e542c0 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe259c57740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8b2a1c0 con 0x55f8f8e5d630 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe259c57740 10 client.0 _ll_register_callbacks cb 0x55f8f8d74960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe255000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e5a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe24f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e5ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe255000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e5a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48178/0 (socket says 172.21.15.8:48178) 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe255000640 1 -- 172.21.15.8:0/2269301585 learned_addr learned my addr 172.21.15.8:0/2269301585 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.948+0000 7fe255000640 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.949+0000 7fe24f400640 1 -- 172.21.15.8:0/2269301585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e5d630 msgr2=0x55f8f8e5b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.949+0000 7fe24f400640 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.949+0000 7fe24f400640 1 -- 172.21.15.8:0/2269301585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 msgr2=0x55f8f8e5a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.949+0000 7fe24f400640 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e5a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.949+0000 7fe24f400640 1 -- 172.21.15.8:0/2269301585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2480098d0 con 0x55f8f8e54fa0 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.949+0000 7fe24f400640 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e5ab10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe2380134e0 tx=0x7fe2380139a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ef73cb6d7afb89 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.949+0000 7fe23e000640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.949+0000 7fe23e000640 1 -- 172.21.15.8:0/2269301585 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238004230 con 0x55f8f8e54fa0 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.949+0000 7fe23e000640 1 -- 172.21.15.8:0/2269301585 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe238004390 con 0x55f8f8e54fa0 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.949+0000 7fe259c57740 1 -- 172.21.15.8:0/2269301585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8f8abb7e0 con 0x55f8f8e54fa0 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.950+0000 7fe23e000640 1 -- 172.21.15.8:0/2269301585 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2380117f0 con 0x55f8f8e54fa0 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.950+0000 7fe259c57740 10 client.16824 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.950+0000 7fe259c57740 1 -- 172.21.15.8:0/2269301585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f8f8dba4e0 con 0x55f8f8e54fa0 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.950+0000 7fe23e000640 1 -- 172.21.15.8:0/2269301585 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe238029080 con 0x55f8f8e54fa0 2024-03-16T21:04:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.950+0000 7fe23e000640 1 -- 172.21.15.8:0/2269301585 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe238023030 con 0x55f8f8e54fa0 2024-03-16T21:04:20.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.950+0000 7fe259c57740 10 client.16824 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:20.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.950+0000 7fe259c57740 10 client.16824 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:20.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.950+0000 7fe259c57740 20 client.16824 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:20.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.950+0000 7fe259c57740 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f8f8e6d840 0x55f8f8e6fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.950+0000 7fe259c57740 4 client.16824 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:20.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.950+0000 7fe259c57740 1 -- 172.21.15.8:0/2269301585 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8f8af8720 con 0x55f8f8e6d840 2024-03-16T21:04:20.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.951+0000 7fe255000640 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f8f8e6d840 0x55f8f8e6fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.951+0000 7fe255000640 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f8f8e6d840 0x55f8f8e6fc60 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99667225c408d9e1 server_cookie=16823e43a7832466 in_seq=0 out_seq=0 2024-03-16T21:04:20.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.951+0000 7fe23e000640 10 client.16824 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:20.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.952+0000 7fe23e000640 1 -- 172.21.15.8:0/2269301585 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55f8f8af8720 con 0x55f8f8e6d840 2024-03-16T21:04:20.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.952+0000 7fe23e000640 10 client.16824 handle_command_reply: tid=0 2024-03-16T21:04:20.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.952+0000 7fe259c57740 1 client.16824 shutdown 2024-03-16T21:04:20.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe259c57740 1 -- 172.21.15.8:0/2269301585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 msgr2=0x55f8f8e5ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:20.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe259c57740 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e5ab10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe2380134e0 tx=0x7fe2380139a0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe259c57740 1 -- 172.21.15.8:0/2269301585 shutdown_connections 2024-03-16T21:04:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe259c57740 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe259c57740 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f8f8e6d840 0x55f8f8e6fc60 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe259c57740 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e5ab10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe259c57740 1 --2- 172.21.15.8:0/2269301585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e5a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe23e000640 0 client.16824 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe259c57740 1 -- 172.21.15.8:0/2269301585 >> 172.21.15.8:0/2269301585 conn(0x55f8f8e1b5a0 msgr2=0x55f8f8e50a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe259c57740 1 -- 172.21.15.8:0/2269301585 shutdown_connections 2024-03-16T21:04:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe259c57740 1 -- 172.21.15.8:0/2269301585 wait complete. 2024-03-16T21:04:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.953+0000 7fe259c57740 20 client.16824 trim_cache size 0 max 16384 2024-03-16T21:04:20.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.970+0000 7fe259c57740 1 Processor -- start 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe259c57740 1 -- start start 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe259c57740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e542c0 0x55f8f8e5cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe259c57740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e59510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe259c57740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe259c57740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8e54c00 con 0x55f8f8e5d630 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe259c57740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8e702c0 con 0x55f8f8e54fa0 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe259c57740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8e532f0 con 0x55f8f8e542c0 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe24f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e59510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe24f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e59510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48190/0 (socket says 172.21.15.8:48190) 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe24f400640 1 -- 172.21.15.8:0/1579627477 learned_addr learned my addr 172.21.15.8:0/1579627477 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe255000640 1 --2- 172.21.15.8:0/1579627477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e542c0 0x55f8f8e5cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.971+0000 7fe255000640 1 --2- 172.21.15.8:0/1579627477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.972+0000 7fe24f400640 1 -- 172.21.15.8:0/1579627477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e542c0 msgr2=0x55f8f8e5cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:20.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.972+0000 7fe24f400640 1 --2- 172.21.15.8:0/1579627477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e542c0 0x55f8f8e5cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.972+0000 7fe24f400640 1 -- 172.21.15.8:0/1579627477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e5d630 msgr2=0x55f8f8e5ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:20.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.972+0000 7fe24f400640 1 --2- 172.21.15.8:0/1579627477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.972+0000 7fe24f400640 1 -- 172.21.15.8:0/1579627477 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8f8d56950 con 0x55f8f8e54fa0 2024-03-16T21:04:20.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.972+0000 7fe255000640 1 --2- 172.21.15.8:0/1579627477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e542c0 0x55f8f8e5cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:20.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.972+0000 7fe24f400640 1 --2- 172.21.15.8:0/1579627477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e59510 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe23800a010 tx=0x7fe238005860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d3667e608e57c92 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:20.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.972+0000 7fe244c00640 1 -- 172.21.15.8:0/1579627477 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238005190 con 0x55f8f8e54fa0 2024-03-16T21:04:20.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.972+0000 7fe244c00640 1 -- 172.21.15.8:0/1579627477 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55f8f8abb7e0 con 0x55f8f8e54fa0 2024-03-16T21:04:20.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.972+0000 7fe244c00640 1 -- 172.21.15.8:0/1579627477 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238003ab0 con 0x55f8f8e54fa0 2024-03-16T21:04:20.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.973+0000 7fe259c57740 1 -- 172.21.15.8:0/1579627477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e54fa0 msgr2=0x55f8f8e59510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:20.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.973+0000 7fe259c57740 1 --2- 172.21.15.8:0/1579627477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e59510 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe23800a010 tx=0x7fe238005860 comp rx=0 tx=0).stop 2024-03-16T21:04:20.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.973+0000 7fe259c57740 1 -- 172.21.15.8:0/1579627477 shutdown_connections 2024-03-16T21:04:20.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.973+0000 7fe259c57740 1 --2- 172.21.15.8:0/1579627477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.973+0000 7fe259c57740 1 --2- 172.21.15.8:0/1579627477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e59510 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.973+0000 7fe259c57740 1 --2- 172.21.15.8:0/1579627477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e542c0 0x55f8f8e5cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.973+0000 7fe259c57740 1 -- 172.21.15.8:0/1579627477 >> 172.21.15.8:0/1579627477 conn(0x55f8f8e1b5a0 msgr2=0x55f8f8e4de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.973+0000 7fe259c57740 1 -- 172.21.15.8:0/1579627477 shutdown_connections 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.973+0000 7fe259c57740 1 -- 172.21.15.8:0/1579627477 wait complete. 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.974+0000 7fe259c57740 1 -- start start 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.974+0000 7fe259c57740 1 Processor -- start 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.974+0000 7fe259c57740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e57d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.974+0000 7fe259c57740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.974+0000 7fe259c57740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.974+0000 7fe259c57740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8e5eb60 con 0x55f8f8e54fa0 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.974+0000 7fe259c57740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8e5ecd0 con 0x55f8f8e542c0 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.974+0000 7fe259c57740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f8e5ee90 con 0x55f8f8e5d630 2024-03-16T21:04:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.974+0000 7fe259c57740 10 client.0 _ll_register_callbacks cb 0x7fe238009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe24f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe255000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e57d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe24f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43598/0 (socket says 172.21.15.8:43598) 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe24f400640 1 -- 172.21.15.8:0/848371779 learned_addr learned my addr 172.21.15.8:0/848371779 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe255000640 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe24f400640 1 -- 172.21.15.8:0/848371779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e5d630 msgr2=0x55f8f8e5e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe24f400640 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe24f400640 1 -- 172.21.15.8:0/848371779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 msgr2=0x55f8f8e57d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe24f400640 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e57d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe24f400640 1 -- 172.21.15.8:0/848371779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8f8d75060 con 0x55f8f8e54fa0 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe255000640 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e57d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe24f400640 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e582c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe2380134e0 tx=0x7fe238005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cd105a70a7c2f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.975+0000 7fe23e000640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.976+0000 7fe23e000640 1 -- 172.21.15.8:0/848371779 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2380039c0 con 0x55f8f8e54fa0 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.976+0000 7fe259c57740 1 -- 172.21.15.8:0/848371779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe248009e90 con 0x55f8f8e54fa0 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.976+0000 7fe23e000640 1 -- 172.21.15.8:0/848371779 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe238000e40 con 0x55f8f8e54fa0 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.976+0000 7fe23e000640 1 -- 172.21.15.8:0/848371779 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe238003b20 con 0x55f8f8e54fa0 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.976+0000 7fe259c57740 10 client.16830 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.976+0000 7fe259c57740 1 -- 172.21.15.8:0/848371779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f8f8dba4e0 con 0x55f8f8e54fa0 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.976+0000 7fe23e000640 1 -- 172.21.15.8:0/848371779 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fe248009e90 con 0x55f8f8e54fa0 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.977+0000 7fe23e000640 1 -- 172.21.15.8:0/848371779 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe23800f980 con 0x55f8f8e54fa0 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.977+0000 7fe259c57740 10 client.16830 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.977+0000 7fe259c57740 10 client.16830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.977+0000 7fe259c57740 20 client.16830 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.977+0000 7fe259c57740 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f8f8ec9fb0 0x55f8f8ecc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.977+0000 7fe259c57740 4 client.16830 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:04:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.977+0000 7fe259c57740 1 -- 172.21.15.8:0/848371779 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f8f8b47890 con 0x55f8f8ec9fb0 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.977+0000 7fe255000640 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f8f8ec9fb0 0x55f8f8ecc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.977+0000 7fe255000640 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f8f8ec9fb0 0x55f8f8ecc3d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=357137c6e245aea4 server_cookie=1a36495d5b3c6a11 in_seq=0 out_seq=0 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.977+0000 7fe23e000640 10 client.16830 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe23e000640 1 -- 172.21.15.8:0/848371779 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f8f8b47890 con 0x55f8f8ec9fb0 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe23e000640 10 client.16830 handle_command_reply: tid=0 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 1 client.16830 shutdown 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 1 -- 172.21.15.8:0/848371779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 msgr2=0x55f8f8e582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e582c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe2380134e0 tx=0x7fe238005f50 comp rx=0 tx=0).stop 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 1 -- 172.21.15.8:0/848371779 shutdown_connections 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f8e5d630 0x55f8f8e5e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f8f8ec9fb0 0x55f8f8ecc3d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8f8e54fa0 0x55f8f8e582c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 1 --2- 172.21.15.8:0/848371779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8f8e542c0 0x55f8f8e57d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe23e000640 0 client.16830 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 1 -- 172.21.15.8:0/848371779 >> 172.21.15.8:0/848371779 conn(0x55f8f8e1b5a0 msgr2=0x55f8f8e4fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 1 -- 172.21.15.8:0/848371779 shutdown_connections 2024-03-16T21:04:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 1 -- 172.21.15.8:0/848371779 wait complete. 2024-03-16T21:04:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.978+0000 7fe259c57740 20 client.16830 trim_cache size 0 max 16384 2024-03-16T21:04:20.989 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:04:20.989 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:04:20.989 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:04:20.989 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:04:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 -- 172.21.15.8:0/2730837164 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2340a1c20 msgr2=0x7fe2340a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2340a1c20 0x7fe2340a40e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55f8f8e554f0 tx=0x7fe2400f3ba0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 -- 172.21.15.8:0/2730837164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe250103690 msgr2=0x7fe250199df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe250103690 0x7fe250199df0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe240005e30 tx=0x7fe240032a60 comp rx=0 tx=0).stop 2024-03-16T21:04:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 -- 172.21.15.8:0/2730837164 shutdown_connections 2024-03-16T21:04:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fe2340a1c20 0x7fe2340a40e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2501096a0 0x7fe25019e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe250104050 0x7fe25019a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 --2- 172.21.15.8:0/2730837164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe250103690 0x7fe250199df0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:20.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 -- 172.21.15.8:0/2730837164 >> 172.21.15.8:0/2730837164 conn(0x7fe2500ff1a0 msgr2=0x7fe2500ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:20.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 -- 172.21.15.8:0/2730837164 shutdown_connections 2024-03-16T21:04:20.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:20.979+0000 7fe257000640 1 -- 172.21.15.8:0/2730837164 wait complete. 2024-03-16T21:04:21.004 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:04:21.004 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:04:21.081 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:20 smithi008 ceph-mon[31434]: pgmap v200: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-03-16T21:04:21.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.217+0000 7f357f200640 1 -- 172.21.15.8:0/3186281101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35801095c0 msgr2=0x7f35801099a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.217+0000 7f357f200640 1 --2- 172.21.15.8:0/3186281101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35801095c0 0x7f35801099a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3570009930 tx=0x7f357002bc20 comp rx=0 tx=0).stop 2024-03-16T21:04:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.217+0000 7f357f200640 1 -- 172.21.15.8:0/3186281101 shutdown_connections 2024-03-16T21:04:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.217+0000 7f357f200640 1 --2- 172.21.15.8:0/3186281101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3580103ec0 0x7f3580110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.217+0000 7f357f200640 1 --2- 172.21.15.8:0/3186281101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3580103500 0x7f3580103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.217+0000 7f357f200640 1 --2- 172.21.15.8:0/3186281101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35801095c0 0x7f35801099a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.217+0000 7f357f200640 1 -- 172.21.15.8:0/3186281101 >> 172.21.15.8:0/3186281101 conn(0x7f35800fef90 msgr2=0x7f35801013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.217+0000 7f357f200640 1 -- 172.21.15.8:0/3186281101 shutdown_connections 2024-03-16T21:04:21.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.217+0000 7f357f200640 1 -- 172.21.15.8:0/3186281101 wait complete. 2024-03-16T21:04:21.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.218+0000 7f357f200640 1 Processor -- start 2024-03-16T21:04:21.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.219+0000 7f357f200640 1 -- start start 2024-03-16T21:04:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.219+0000 7f357f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3580103500 0x7f358019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.219+0000 7f357f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3580103ec0 0x7f358019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.219+0000 7f357f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35801095c0 0x7f35801999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.219+0000 7f357f200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358019a020 con 0x7f35801095c0 2024-03-16T21:04:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.219+0000 7f357f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358019a190 con 0x7f3580103ec0 2024-03-16T21:04:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.219+0000 7f357f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358019a350 con 0x7f3580103500 2024-03-16T21:04:21.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f357de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3580103500 0x7f358019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f3577e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3580103ec0 0x7f358019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f357de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3580103500 0x7f358019f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36714/0 (socket says 172.21.15.8:36714) 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f357de00640 1 -- 172.21.15.8:0/1269099221 learned_addr learned my addr 172.21.15.8:0/1269099221 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f357e800640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35801095c0 0x7f35801999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f3577e00640 1 -- 172.21.15.8:0/1269099221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3580103500 msgr2=0x7f358019f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f3577e00640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3580103500 0x7f358019f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f3577e00640 1 -- 172.21.15.8:0/1269099221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35801095c0 msgr2=0x7f35801999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f3577e00640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35801095c0 0x7f35801999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f3577e00640 1 -- 172.21.15.8:0/1269099221 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3568009490 con 0x7f3580103ec0 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f357de00640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3580103500 0x7f358019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.220+0000 7f3577e00640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3580103ec0 0x7f358019fd60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f356800e9f0 tx=0x7f356800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.221+0000 7f3576a00640 1 -- 172.21.15.8:0/1269099221 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356800cd80 con 0x7f3580103ec0 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.221+0000 7f3576a00640 1 -- 172.21.15.8:0/1269099221 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f35680035f0 con 0x7f3580103ec0 2024-03-16T21:04:21.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.221+0000 7f3576a00640 1 -- 172.21.15.8:0/1269099221 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568010690 con 0x7f3580103ec0 2024-03-16T21:04:21.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.221+0000 7f357f200640 1 -- 172.21.15.8:0/1269099221 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3570009560 con 0x7f3580103ec0 2024-03-16T21:04:21.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.221+0000 7f357f200640 1 -- 172.21.15.8:0/1269099221 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358019a820 con 0x7f3580103ec0 2024-03-16T21:04:21.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.222+0000 7f357f200640 1 -- 172.21.15.8:0/1269099221 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3580104c20 con 0x7f3580103ec0 2024-03-16T21:04:21.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.224+0000 7f3576a00640 1 -- 172.21.15.8:0/1269099221 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f3568003b80 con 0x7f3580103ec0 2024-03-16T21:04:21.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.225+0000 7f3576a00640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35640a1c20 0x7f35640a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.225+0000 7f3576a00640 1 -- 172.21.15.8:0/1269099221 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3568014070 con 0x7f3580103ec0 2024-03-16T21:04:21.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.225+0000 7f357de00640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35640a1c20 0x7f35640a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.226+0000 7f357de00640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35640a1c20 0x7f35640a40e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3570006010 tx=0x7f3570005a20 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:21.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.229+0000 7f3576a00640 1 -- 172.21.15.8:0/1269099221 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f356809a600 con 0x7f3580103ec0 2024-03-16T21:04:21.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:20 smithi170 ceph-mon[35947]: pgmap v200: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-03-16T21:04:21.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:20 smithi186 ceph-mon[36391]: pgmap v200: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-03-16T21:04:21.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.473+0000 7f357f200640 1 -- 172.21.15.8:0/1269099221 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f358010b9b0 con 0x7f3580103ec0 2024-03-16T21:04:21.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.474+0000 7f3576a00640 1 -- 172.21.15.8:0/1269099221 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f356809a190 con 0x7f3580103ec0 2024-03-16T21:04:21.481 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:04:21.481 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:27.879028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:04:21.481 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-03-16T21:04:21.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 -- 172.21.15.8:0/1269099221 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35640a1c20 msgr2=0x7f35640a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35640a1c20 0x7f35640a40e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3570006010 tx=0x7f3570005a20 comp rx=0 tx=0).stop 2024-03-16T21:04:21.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 -- 172.21.15.8:0/1269099221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3580103ec0 msgr2=0x7f358019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3580103ec0 0x7f358019fd60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f356800e9f0 tx=0x7f356800eeb0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 -- 172.21.15.8:0/1269099221 shutdown_connections 2024-03-16T21:04:21.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35640a1c20 0x7f35640a40e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35801095c0 0x7f35801999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3580103ec0 0x7f358019fd60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 --2- 172.21.15.8:0/1269099221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3580103500 0x7f358019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 -- 172.21.15.8:0/1269099221 >> 172.21.15.8:0/1269099221 conn(0x7f35800fef90 msgr2=0x7f35801005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:21.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 -- 172.21.15.8:0/1269099221 shutdown_connections 2024-03-16T21:04:21.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.478+0000 7f357f200640 1 -- 172.21.15.8:0/1269099221 wait complete. 2024-03-16T21:04:21.505 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:04:21.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:04:21.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.730+0000 7fb270200640 1 -- 172.21.15.8:0/3824097750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb268076340 msgr2=0x7fb268111de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.730+0000 7fb270200640 1 --2- 172.21.15.8:0/3824097750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb268076340 0x7fb268111de0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb254009930 tx=0x7fb25402bc30 comp rx=0 tx=0).stop 2024-03-16T21:04:21.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.730+0000 7fb270200640 1 -- 172.21.15.8:0/3824097750 shutdown_connections 2024-03-16T21:04:21.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.730+0000 7fb270200640 1 --2- 172.21.15.8:0/3824097750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb268112320 0x7fb268114710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.730+0000 7fb270200640 1 --2- 172.21.15.8:0/3824097750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb268076340 0x7fb268111de0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.730+0000 7fb270200640 1 --2- 172.21.15.8:0/3824097750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb268075a20 0x7fb268075e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.730+0000 7fb270200640 1 -- 172.21.15.8:0/3824097750 >> 172.21.15.8:0/3824097750 conn(0x7fb2680ff170 msgr2=0x7fb268101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.730+0000 7fb270200640 1 -- 172.21.15.8:0/3824097750 shutdown_connections 2024-03-16T21:04:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.730+0000 7fb270200640 1 -- 172.21.15.8:0/3824097750 wait complete. 2024-03-16T21:04:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.731+0000 7fb270200640 1 Processor -- start 2024-03-16T21:04:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.731+0000 7fb270200640 1 -- start start 2024-03-16T21:04:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.731+0000 7fb270200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb268075a20 0x7fb26819e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.731+0000 7fb270200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb268076340 0x7fb26819e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.731+0000 7fb270200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb268112320 0x7fb2681a2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.731+0000 7fb270200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2681a3120 con 0x7fb268112320 2024-03-16T21:04:21.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.731+0000 7fb270200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2681a3290 con 0x7fb268075a20 2024-03-16T21:04:21.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.731+0000 7fb270200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2681a3450 con 0x7fb268076340 2024-03-16T21:04:21.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb268112320 0x7fb2681a2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26d800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb268075a20 0x7fb26819e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb268076340 0x7fb26819e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26d800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb268075a20 0x7fb26819e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48230/0 (socket says 172.21.15.8:48230) 2024-03-16T21:04:21.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26d800640 1 -- 172.21.15.8:0/916519735 learned_addr learned my addr 172.21.15.8:0/916519735 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb268112320 0x7fb2681a2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43620/0 (socket says 172.21.15.8:43620) 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb268076340 0x7fb26819e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36724/0 (socket says 172.21.15.8:36724) 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26ce00640 1 -- 172.21.15.8:0/916519735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb268075a20 msgr2=0x7fb26819e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26ce00640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb268075a20 0x7fb26819e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26ce00640 1 -- 172.21.15.8:0/916519735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb268112320 msgr2=0x7fb2681a2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26ce00640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb268112320 0x7fb2681a2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26ce00640 1 -- 172.21.15.8:0/916519735 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb254009560 con 0x7fb268076340 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26d800640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb268075a20 0x7fb26819e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.732+0000 7fb26e200640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb268112320 0x7fb2681a2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.733+0000 7fb26ce00640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb268076340 0x7fb26819e7f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb254036040 tx=0x7fb25402cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.733+0000 7fb266000640 1 -- 172.21.15.8:0/916519735 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254004250 con 0x7fb268076340 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.733+0000 7fb266000640 1 -- 172.21.15.8:0/916519735 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb2540043b0 con 0x7fb268076340 2024-03-16T21:04:21.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.733+0000 7fb266000640 1 -- 172.21.15.8:0/916519735 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254003b70 con 0x7fb268076340 2024-03-16T21:04:21.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.733+0000 7fb270200640 1 -- 172.21.15.8:0/916519735 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2681a36d0 con 0x7fb268076340 2024-03-16T21:04:21.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.733+0000 7fb270200640 1 -- 172.21.15.8:0/916519735 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2681aafb0 con 0x7fb268076340 2024-03-16T21:04:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.736+0000 7fb27301b740 1 Processor -- start 2024-03-16T21:04:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.736+0000 7fb266000640 1 -- 172.21.15.8:0/916519735 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fb254003cd0 con 0x7fb268076340 2024-03-16T21:04:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.736+0000 7fb27301b740 1 -- start start 2024-03-16T21:04:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb27301b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66ea3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb27301b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66eabc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb27301b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66eae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb27301b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66e11210 con 0x561f66ea3560 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb27301b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66e0e740 con 0x561f66ea2c40 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb27301b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66e09f20 con 0x561f66eac140 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb26e200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66ea3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb26e200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66ea3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48242/0 (socket says 172.21.15.8:48242) 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb26e200640 1 -- 172.21.15.8:0/3753865817 learned_addr learned my addr 172.21.15.8:0/3753865817 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb26ce00640 1 --2- 172.21.15.8:0/3753865817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66eae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb26d800640 1 --2- 172.21.15.8:0/3753865817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66eabc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb26e200640 1 -- 172.21.15.8:0/3753865817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 msgr2=0x561f66eae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb26e200640 1 --2- 172.21.15.8:0/3753865817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66eae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb26e200640 1 -- 172.21.15.8:0/3753865817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 msgr2=0x561f66eabc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb26e200640 1 --2- 172.21.15.8:0/3753865817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66eabc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb26e200640 1 -- 172.21.15.8:0/3753865817 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f66dcbdf0 con 0x561f66ea2c40 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.737+0000 7fb26d800640 1 --2- 172.21.15.8:0/3753865817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66eabc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.738+0000 7fb26e200640 1 --2- 172.21.15.8:0/3753865817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66ea3020 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb260011760 tx=0x7fb260011c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e00948fb8326b1e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.738+0000 7fb266000640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 0x7fb2500a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.738+0000 7fb25aa00640 1 -- 172.21.15.8:0/3753865817 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb260004d20 con 0x561f66ea2c40 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.738+0000 7fb25aa00640 1 -- 172.21.15.8:0/3753865817 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb260004e80 con 0x561f66ea2c40 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.738+0000 7fb25aa00640 1 -- 172.21.15.8:0/3753865817 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2600045b0 con 0x561f66ea2c40 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.738+0000 7fb266000640 1 -- 172.21.15.8:0/916519735 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb2540efb60 con 0x7fb268076340 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.738+0000 7fb26d800640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 0x7fb2500a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.738+0000 7fb27301b740 1 -- 172.21.15.8:0/3753865817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 msgr2=0x561f66ea3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.739+0000 7fb27301b740 1 --2- 172.21.15.8:0/3753865817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66ea3020 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb260011760 tx=0x7fb260011c20 comp rx=0 tx=0).stop 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.739+0000 7fb27301b740 1 -- 172.21.15.8:0/3753865817 shutdown_connections 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.739+0000 7fb27301b740 1 --2- 172.21.15.8:0/3753865817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66eae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.739+0000 7fb27301b740 1 --2- 172.21.15.8:0/3753865817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66eabc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.739+0000 7fb27301b740 1 --2- 172.21.15.8:0/3753865817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66ea3020 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.739+0000 7fb27301b740 1 -- 172.21.15.8:0/3753865817 >> 172.21.15.8:0/3753865817 conn(0x561f66e9d370 msgr2=0x561f66e9d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:21.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.739+0000 7fb27301b740 1 -- 172.21.15.8:0/3753865817 shutdown_connections 2024-03-16T21:04:21.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.739+0000 7fb27301b740 1 -- 172.21.15.8:0/3753865817 wait complete. 2024-03-16T21:04:21.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.739+0000 7fb26d800640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 0x7fb2500a40e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x561f66ea2710 tx=0x7fb25c005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:21.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.739+0000 7fb27301b740 1 -- start start 2024-03-16T21:04:21.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb27301b740 1 Processor -- start 2024-03-16T21:04:21.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb27301b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66ea2c40 0x561f66ea9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb27301b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66ea9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb27301b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66eac140 0x561f66ea9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb27301b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66daf150 con 0x561f66ea3560 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb27301b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66daedf0 con 0x561f66eac140 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb27301b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66b781c0 con 0x561f66ea2c40 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb27301b740 10 client.0 _ll_register_callbacks cb 0x561f66dfe2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb26d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66ea2c40 0x561f66ea9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb26ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66ea9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb26d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66ea2c40 0x561f66ea9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36744/0 (socket says 172.21.15.8:36744) 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb26d800640 1 -- 172.21.15.8:0/3907449794 learned_addr learned my addr 172.21.15.8:0/3907449794 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.740+0000 7fb26e200640 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66eac140 0x561f66ea9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.741+0000 7fb26d800640 1 -- 172.21.15.8:0/3907449794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66eac140 msgr2=0x561f66ea9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.741+0000 7fb26d800640 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66eac140 0x561f66ea9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.741+0000 7fb26d800640 1 -- 172.21.15.8:0/3907449794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 msgr2=0x561f66ea9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.741+0000 7fb26d800640 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66ea9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.741+0000 7fb26d800640 1 -- 172.21.15.8:0/3907449794 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb260011440 con 0x561f66ea2c40 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.741+0000 7fb26ce00640 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66ea9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.741+0000 7fb26e200640 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66eac140 0x561f66ea9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.741+0000 7fb26d800640 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66ea2c40 0x561f66ea9220 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00f7a0 tx=0x7fb25c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b1ee49e65ebf142 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.741+0000 7fb24f400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.741+0000 7fb24f400640 1 -- 172.21.15.8:0/3907449794 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c017070 con 0x561f66ea2c40 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb24f400640 1 -- 172.21.15.8:0/3907449794 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb25c0118d0 con 0x561f66ea2c40 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb27301b740 1 -- 172.21.15.8:0/3907449794 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f66b46720 con 0x561f66ea2c40 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb24f400640 1 -- 172.21.15.8:0/3907449794 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb25c011a90 con 0x561f66ea2c40 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb27301b740 10 client.27034 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb27301b740 1 -- 172.21.15.8:0/3907449794 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561f66e085a0 con 0x561f66ea2c40 2024-03-16T21:04:21.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb24f400640 1 -- 172.21.15.8:0/3907449794 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb25c034080 con 0x561f66ea2c40 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb24f400640 1 -- 172.21.15.8:0/3907449794 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fb25c02e030 con 0x561f66ea2c40 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb27301b740 10 client.27034 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb27301b740 10 client.27034 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb27301b740 20 client.27034 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb27301b740 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x561f66ebc370 0x561f66ebe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb27301b740 4 client.27034 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.742+0000 7fb27301b740 1 -- 172.21.15.8:0/3907449794 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f66b95890 con 0x561f66ebc370 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.743+0000 7fb26ce00640 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x561f66ebc370 0x561f66ebe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.743+0000 7fb26ce00640 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x561f66ebc370 0x561f66ebe780 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=782bd8d82ca53b98 server_cookie=342a71bc4c790ecc in_seq=0 out_seq=0 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.743+0000 7fb24f400640 10 client.27034 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb24f400640 1 -- 172.21.15.8:0/3907449794 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561f66b95890 con 0x561f66ebc370 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb24f400640 10 client.27034 handle_command_reply: tid=0 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 1 client.27034 shutdown 2024-03-16T21:04:21.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 1 -- 172.21.15.8:0/3907449794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66ea2c40 msgr2=0x561f66ea9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66ea2c40 0x561f66ea9220 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00f7a0 tx=0x7fb25c004730 comp rx=0 tx=0).stop 2024-03-16T21:04:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 1 -- 172.21.15.8:0/3907449794 shutdown_connections 2024-03-16T21:04:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x561f66ebc370 0x561f66ebe780 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66eac140 0x561f66ea9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66ea9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 1 --2- 172.21.15.8:0/3907449794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66ea2c40 0x561f66ea9220 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb24f400640 0 client.27034 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:04:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 1 -- 172.21.15.8:0/3907449794 >> 172.21.15.8:0/3907449794 conn(0x561f66e9d370 msgr2=0x561f66e9f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 1 -- 172.21.15.8:0/3907449794 shutdown_connections 2024-03-16T21:04:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 1 -- 172.21.15.8:0/3907449794 wait complete. 2024-03-16T21:04:21.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.744+0000 7fb27301b740 20 client.27034 trim_cache size 0 max 16384 2024-03-16T21:04:21.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.758+0000 7fb27301b740 1 Processor -- start 2024-03-16T21:04:21.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.758+0000 7fb27301b740 1 -- start start 2024-03-16T21:04:21.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.758+0000 7fb27301b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66eab950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.758+0000 7fb27301b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66ea9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.758+0000 7fb27301b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66ea9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.758+0000 7fb27301b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66e9e370 con 0x561f66ea3560 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.758+0000 7fb27301b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66e97880 con 0x561f66ea2c40 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.758+0000 7fb27301b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66e98c40 con 0x561f66eac140 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.759+0000 7fb26d800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66eab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.759+0000 7fb26e200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66ea9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.759+0000 7fb26ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66ea9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.759+0000 7fb26d800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66eab950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48260/0 (socket says 172.21.15.8:48260) 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.759+0000 7fb26d800640 1 -- 172.21.15.8:0/3149501792 learned_addr learned my addr 172.21.15.8:0/3149501792 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.759+0000 7fb26d800640 1 -- 172.21.15.8:0/3149501792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 msgr2=0x561f66ea9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.759+0000 7fb26d800640 1 --2- 172.21.15.8:0/3149501792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66ea9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.759+0000 7fb26d800640 1 -- 172.21.15.8:0/3149501792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 msgr2=0x561f66ea9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.759+0000 7fb26d800640 1 --2- 172.21.15.8:0/3149501792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66ea9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.759+0000 7fb26d800640 1 -- 172.21.15.8:0/3149501792 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f66da4ab0 con 0x561f66ea2c40 2024-03-16T21:04:21.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.759+0000 7fb26d800640 1 --2- 172.21.15.8:0/3149501792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66eab950 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb25c000c00 tx=0x7fb25c004640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99815c1a11885684 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:21.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.760+0000 7fb25a000640 1 -- 172.21.15.8:0/3149501792 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c004d40 con 0x561f66ea2c40 2024-03-16T21:04:21.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.760+0000 7fb25a000640 1 -- 172.21.15.8:0/3149501792 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x561f66b46720 con 0x561f66ea2c40 2024-03-16T21:04:21.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.760+0000 7fb25a000640 1 -- 172.21.15.8:0/3149501792 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c005410 con 0x561f66ea2c40 2024-03-16T21:04:21.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.760+0000 7fb27301b740 1 -- 172.21.15.8:0/3149501792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 msgr2=0x561f66eab950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.760+0000 7fb27301b740 1 --2- 172.21.15.8:0/3149501792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66eab950 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb25c000c00 tx=0x7fb25c004640 comp rx=0 tx=0).stop 2024-03-16T21:04:21.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.760+0000 7fb27301b740 1 -- 172.21.15.8:0/3149501792 shutdown_connections 2024-03-16T21:04:21.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.760+0000 7fb27301b740 1 --2- 172.21.15.8:0/3149501792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66ea9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.760+0000 7fb27301b740 1 --2- 172.21.15.8:0/3149501792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea3560 0x561f66ea9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.760+0000 7fb27301b740 1 --2- 172.21.15.8:0/3149501792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea2c40 0x561f66eab950 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.760+0000 7fb27301b740 1 -- 172.21.15.8:0/3149501792 >> 172.21.15.8:0/3149501792 conn(0x561f66e9d370 msgr2=0x561f66e9f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.760+0000 7fb27301b740 1 -- 172.21.15.8:0/3149501792 shutdown_connections 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.761+0000 7fb27301b740 1 -- 172.21.15.8:0/3149501792 wait complete. 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.761+0000 7fb27301b740 1 -- start start 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.761+0000 7fb27301b740 1 Processor -- start 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb27301b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea2c40 0x561f66ea64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb27301b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea3560 0x561f66ea6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb27301b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66f0fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb27301b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66f102e0 con 0x561f66ea2c40 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb27301b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66f10450 con 0x561f66ea3560 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb27301b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f66f10610 con 0x561f66eac140 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb27301b740 10 client.0 _ll_register_callbacks cb 0x7fb25c009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb26d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea2c40 0x561f66ea64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb26e200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66f0fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb26d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea2c40 0x561f66ea64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43654/0 (socket says 172.21.15.8:43654) 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb26d800640 1 -- 172.21.15.8:0/2166289741 learned_addr learned my addr 172.21.15.8:0/2166289741 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb26ce00640 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea3560 0x561f66ea6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb26d800640 1 -- 172.21.15.8:0/2166289741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 msgr2=0x561f66f0fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb26d800640 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66f0fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb26d800640 1 -- 172.21.15.8:0/2166289741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea3560 msgr2=0x561f66ea6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb26d800640 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea3560 0x561f66ea6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.762+0000 7fb26d800640 1 -- 172.21.15.8:0/2166289741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f66e085a0 con 0x561f66ea2c40 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.763+0000 7fb26d800640 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea2c40 0x561f66ea64d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb25c012560 tx=0x7fb25c0095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122f861393591071 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.763+0000 7fb24f400640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.763+0000 7fb24f400640 1 -- 172.21.15.8:0/2166289741 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c011c90 con 0x561f66ea2c40 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.763+0000 7fb24f400640 1 -- 172.21.15.8:0/2166289741 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb25c011df0 con 0x561f66ea2c40 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.763+0000 7fb27301b740 1 -- 172.21.15.8:0/2166289741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f66b097e0 con 0x561f66ea2c40 2024-03-16T21:04:21.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.763+0000 7fb24f400640 1 -- 172.21.15.8:0/2166289741 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb25c005020 con 0x561f66ea2c40 2024-03-16T21:04:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.763+0000 7fb27301b740 10 client.16854 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.763+0000 7fb27301b740 1 -- 172.21.15.8:0/2166289741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561f66dca650 con 0x561f66ea2c40 2024-03-16T21:04:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.763+0000 7fb24f400640 1 -- 172.21.15.8:0/2166289741 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x561f66b097e0 con 0x561f66ea2c40 2024-03-16T21:04:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.764+0000 7fb24f400640 1 -- 172.21.15.8:0/2166289741 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fb25c045cd0 con 0x561f66ea2c40 2024-03-16T21:04:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.764+0000 7fb27301b740 10 client.16854 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.764+0000 7fb27301b740 10 client.16854 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:04:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.764+0000 7fb27301b740 20 client.16854 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.764+0000 7fb27301b740 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x561f66f18970 0x561f66f1ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.764+0000 7fb27301b740 4 client.16854 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:04:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.764+0000 7fb27301b740 1 -- 172.21.15.8:0/2166289741 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561f66af84e0 con 0x561f66f18970 2024-03-16T21:04:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.764+0000 7fb26ce00640 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x561f66f18970 0x561f66f1ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:21.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.764+0000 7fb26ce00640 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x561f66f18970 0x561f66f1ad60 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bbccbb9c0d31dceb server_cookie=c246ec09f34c6f03 in_seq=0 out_seq=0 2024-03-16T21:04:21.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.764+0000 7fb24f400640 10 client.16854 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:04:21.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb24f400640 1 -- 172.21.15.8:0/2166289741 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561f66af84e0 con 0x561f66f18970 2024-03-16T21:04:21.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb24f400640 10 client.16854 handle_command_reply: tid=0 2024-03-16T21:04:21.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 1 client.16854 shutdown 2024-03-16T21:04:21.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 1 -- 172.21.15.8:0/2166289741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea2c40 msgr2=0x561f66ea64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea2c40 0x561f66ea64d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb25c012560 tx=0x7fb25c0095a0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 1 -- 172.21.15.8:0/2166289741 shutdown_connections 2024-03-16T21:04:21.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x561f66f18970 0x561f66f1ad60 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561f66eac140 0x561f66f0fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561f66ea3560 0x561f66ea6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 1 --2- 172.21.15.8:0/2166289741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561f66ea2c40 0x561f66ea64d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 1 -- 172.21.15.8:0/2166289741 >> 172.21.15.8:0/2166289741 conn(0x561f66e9d370 msgr2=0x561f66e9bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb24f400640 0 client.16854 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:04:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 1 -- 172.21.15.8:0/2166289741 shutdown_connections 2024-03-16T21:04:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 1 -- 172.21.15.8:0/2166289741 wait complete. 2024-03-16T21:04:21.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.765+0000 7fb27301b740 20 client.16854 trim_cache size 0 max 16384 2024-03-16T21:04:21.776 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:04:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 -- 172.21.15.8:0/916519735 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 msgr2=0x7fb2500a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 0x7fb2500a40e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x561f66ea2710 tx=0x7fb25c005f90 comp rx=0 tx=0).stop 2024-03-16T21:04:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 -- 172.21.15.8:0/916519735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb268076340 msgr2=0x7fb26819e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb268076340 0x7fb26819e7f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb254036040 tx=0x7fb25402cc20 comp rx=0 tx=0).stop 2024-03-16T21:04:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 -- 172.21.15.8:0/916519735 shutdown_connections 2024-03-16T21:04:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 0x7fb2500a40e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb268112320 0x7fb2681a2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb268076340 0x7fb26819e7f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 --2- 172.21.15.8:0/916519735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb268075a20 0x7fb26819e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:21.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 -- 172.21.15.8:0/916519735 >> 172.21.15.8:0/916519735 conn(0x7fb2680ff170 msgr2=0x7fb268113970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:21.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 -- 172.21.15.8:0/916519735 shutdown_connections 2024-03-16T21:04:21.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:21.766+0000 7fb270200640 1 -- 172.21.15.8:0/916519735 wait complete. 2024-03-16T21:04:21.792 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:04:21.792 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:04:22.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.013+0000 7f82e0200640 1 -- 172.21.15.8:0/4014030452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d8074240 msgr2=0x7f82d810d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.013+0000 7f82e0200640 1 --2- 172.21.15.8:0/4014030452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d8074240 0x7f82d810d780 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009900 tx=0x7f82c402bcc0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.013+0000 7f82e0200640 1 -- 172.21.15.8:0/4014030452 shutdown_connections 2024-03-16T21:04:22.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.013+0000 7f82e0200640 1 --2- 172.21.15.8:0/4014030452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82d810dcc0 0x7f82d8110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.013+0000 7f82e0200640 1 --2- 172.21.15.8:0/4014030452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d8074240 0x7f82d810d780 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.013+0000 7f82e0200640 1 --2- 172.21.15.8:0/4014030452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82d8073920 0x7f82d8073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.013+0000 7f82e0200640 1 -- 172.21.15.8:0/4014030452 >> 172.21.15.8:0/4014030452 conn(0x7f82d80788f0 msgr2=0x7f82d8078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.013+0000 7f82e0200640 1 -- 172.21.15.8:0/4014030452 shutdown_connections 2024-03-16T21:04:22.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.013+0000 7f82e0200640 1 -- 172.21.15.8:0/4014030452 wait complete. 2024-03-16T21:04:22.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.014+0000 7f82e0200640 1 Processor -- start 2024-03-16T21:04:22.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82e0200640 1 -- start start 2024-03-16T21:04:22.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82e0200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d8073920 0x7f82d8199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82e0200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82d8074240 0x7f82d819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82e0200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82d810dcc0 0x7f82d819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82e0200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d819ecb0 con 0x7f82d8074240 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82e0200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d819ee20 con 0x7f82d8073920 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82e0200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d819efe0 con 0x7f82d810dcc0 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82dd800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d8073920 0x7f82d8199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82dd800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d8073920 0x7f82d8199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48284/0 (socket says 172.21.15.8:48284) 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82dd800640 1 -- 172.21.15.8:0/592888312 learned_addr learned my addr 172.21.15.8:0/592888312 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82de200640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82d810dcc0 0x7f82d819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.015+0000 7f82dce00640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82d8074240 0x7f82d819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.016+0000 7f82dd800640 1 -- 172.21.15.8:0/592888312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82d810dcc0 msgr2=0x7f82d819e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.016+0000 7f82dd800640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82d810dcc0 0x7f82d819e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.016+0000 7f82dd800640 1 -- 172.21.15.8:0/592888312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82d8074240 msgr2=0x7f82d819a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.016+0000 7f82dd800640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82d8074240 0x7f82d819a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.016+0000 7f82dd800640 1 -- 172.21.15.8:0/592888312 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c4009560 con 0x7f82d8073920 2024-03-16T21:04:22.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.016+0000 7f82dd800640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d8073920 0x7f82d8199df0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00e9f0 tx=0x7f82cc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.016+0000 7f82d6000640 1 -- 172.21.15.8:0/592888312 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc009700 con 0x7f82d8073920 2024-03-16T21:04:22.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.016+0000 7f82d6000640 1 -- 172.21.15.8:0/592888312 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f82cc00cd80 con 0x7f82d8073920 2024-03-16T21:04:22.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.016+0000 7f82e0200640 1 -- 172.21.15.8:0/592888312 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d819f2c0 con 0x7f82d8073920 2024-03-16T21:04:22.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.016+0000 7f82d6000640 1 -- 172.21.15.8:0/592888312 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0189c0 con 0x7f82d8073920 2024-03-16T21:04:22.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.016+0000 7f82e0200640 1 -- 172.21.15.8:0/592888312 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d81a6b40 con 0x7f82d8073920 2024-03-16T21:04:22.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.019+0000 7f82d6000640 1 -- 172.21.15.8:0/592888312 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f82cc018b20 con 0x7f82d8073920 2024-03-16T21:04:22.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82e2ffc740 1 Processor -- start 2024-03-16T21:04:22.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82e2ffc740 1 -- start start 2024-03-16T21:04:22.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 0x5620488f0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 0x5620488f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488fb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56204885e210 con 0x5620488f9140 2024-03-16T21:04:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56204885b740 con 0x5620488f0560 2024-03-16T21:04:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562048856f20 con 0x5620488efc40 2024-03-16T21:04:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82dd800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 0x5620488f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82dd800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 0x5620488f8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48292/0 (socket says 172.21.15.8:48292) 2024-03-16T21:04:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82dd800640 1 -- 172.21.15.8:0/1947540334 learned_addr learned my addr 172.21.15.8:0/1947540334 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.020+0000 7f82de200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 0x5620488f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82d6000640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82c00a1c20 0x7f82c00a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82dce00640 1 --2- 172.21.15.8:0/1947540334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488fb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82d6000640 1 -- 172.21.15.8:0/592888312 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f82cc014070 con 0x7f82d8073920 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82dd800640 1 -- 172.21.15.8:0/1947540334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 msgr2=0x5620488f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82dd800640 1 --2- 172.21.15.8:0/1947540334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 0x5620488f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82dd800640 1 -- 172.21.15.8:0/1947540334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 msgr2=0x5620488fb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82dd800640 1 --2- 172.21.15.8:0/1947540334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488fb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82de200640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82c00a1c20 0x7f82c00a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82dd800640 1 -- 172.21.15.8:0/1947540334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562048818df0 con 0x5620488f0560 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82dce00640 1 --2- 172.21.15.8:0/1947540334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82dd800640 1 --2- 172.21.15.8:0/1947540334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 0x5620488f8c00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0cb220 tx=0x7f82cc018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32b74f23767cc215 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.021+0000 7f82caa00640 1 -- 172.21.15.8:0/1947540334 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc09ae90 con 0x5620488f0560 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82caa00640 1 -- 172.21.15.8:0/1947540334 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f82cc09a790 con 0x5620488f0560 2024-03-16T21:04:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82caa00640 1 -- 172.21.15.8:0/1947540334 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0850f0 con 0x5620488f0560 2024-03-16T21:04:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82e2ffc740 1 -- 172.21.15.8:0/1947540334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 msgr2=0x5620488f8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/1947540334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 0x5620488f8c00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0cb220 tx=0x7f82cc018420 comp rx=0 tx=0).stop 2024-03-16T21:04:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82de200640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82c00a1c20 0x7f82c00a40e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009fd0 tx=0x7f82d0004ab0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82e2ffc740 1 -- 172.21.15.8:0/1947540334 shutdown_connections 2024-03-16T21:04:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/1947540334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/1947540334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 0x5620488f8c00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/1947540334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 0x5620488f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82e2ffc740 1 -- 172.21.15.8:0/1947540334 >> 172.21.15.8:0/1947540334 conn(0x5620488ea370 msgr2=0x5620488ea750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82e2ffc740 1 -- 172.21.15.8:0/1947540334 shutdown_connections 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.022+0000 7f82e2ffc740 1 -- 172.21.15.8:0/1947540334 wait complete. 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.023+0000 7f82e2ffc740 1 -- start start 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.023+0000 7f82e2ffc740 1 Processor -- start 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.023+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488efc40 0x5620488f6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.023+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 0x5620488f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.023+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.023+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620487fc150 con 0x5620488f9140 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.023+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620487fbdf0 con 0x5620488efc40 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.023+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620485c51c0 con 0x5620488f0560 2024-03-16T21:04:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82e2ffc740 10 client.0 _ll_register_callbacks cb 0x56204884b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82dce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 0x5620488f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82dd800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488efc40 0x5620488f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82dce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 0x5620488f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36794/0 (socket says 172.21.15.8:36794) 2024-03-16T21:04:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82dd800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488efc40 0x5620488f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48298/0 (socket says 172.21.15.8:48298) 2024-03-16T21:04:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82dce00640 1 -- 172.21.15.8:0/581227992 learned_addr learned my addr 172.21.15.8:0/581227992 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82de200640 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82dce00640 1 -- 172.21.15.8:0/581227992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488efc40 msgr2=0x5620488f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82dce00640 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488efc40 0x5620488f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82dce00640 1 -- 172.21.15.8:0/581227992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 msgr2=0x5620488f6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82dce00640 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488f6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82dce00640 1 -- 172.21.15.8:0/581227992 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d81a6b40 con 0x5620488f0560 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.024+0000 7f82dd800640 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488efc40 0x5620488f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.025+0000 7f82dce00640 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 0x5620488f66a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009230 tx=0x7f82c4004c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c62bd9d9b94c392 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.025+0000 7f82bf400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.025+0000 7f82bf400640 1 -- 172.21.15.8:0/581227992 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40043d0 con 0x5620488f0560 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.025+0000 7f82bf400640 1 -- 172.21.15.8:0/581227992 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f82c402c940 con 0x5620488f0560 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.025+0000 7f82e2ffc740 1 -- 172.21.15.8:0/581227992 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620485567e0 con 0x5620488f0560 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.025+0000 7f82bf400640 1 -- 172.21.15.8:0/581227992 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82c402cb00 con 0x5620488f0560 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.025+0000 7f82e2ffc740 10 client.27052 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.025+0000 7f82e2ffc740 1 -- 172.21.15.8:0/581227992 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5620488555a0 con 0x5620488f0560 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.025+0000 7f82bf400640 1 -- 172.21.15.8:0/581227992 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5620485567e0 con 0x5620488f0560 2024-03-16T21:04:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.026+0000 7f82bf400640 1 -- 172.21.15.8:0/581227992 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f82c403c050 con 0x5620488f0560 2024-03-16T21:04:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.026+0000 7f82e2ffc740 10 client.27052 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.026+0000 7f82e2ffc740 10 client.27052 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:04:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.026+0000 7f82e2ffc740 20 client.27052 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.026+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5620489091f0 0x56204890b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.026+0000 7f82e2ffc740 4 client.27052 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.026+0000 7f82e2ffc740 1 -- 172.21.15.8:0/581227992 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562048593720 con 0x5620489091f0 2024-03-16T21:04:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.026+0000 7f82dd800640 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5620489091f0 0x56204890b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.026+0000 7f82dd800640 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5620489091f0 0x56204890b610 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8a8c818bf32736d server_cookie=c68246670bb26ae2 in_seq=0 out_seq=0 2024-03-16T21:04:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.026+0000 7f82bf400640 10 client.27052 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.027+0000 7f82bf400640 1 -- 172.21.15.8:0/581227992 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x562048593720 con 0x5620489091f0 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.027+0000 7f82bf400640 10 client.27052 handle_command_reply: tid=0 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.027+0000 7f82e2ffc740 1 client.27052 shutdown 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.027+0000 7f82e2ffc740 1 -- 172.21.15.8:0/581227992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 msgr2=0x5620488f66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.027+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 0x5620488f66a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009230 tx=0x7f82c4004c00 comp rx=0 tx=0).stop 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.028+0000 7f82e2ffc740 1 -- 172.21.15.8:0/581227992 shutdown_connections 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.028+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5620489091f0 0x56204890b610 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.028+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.028+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 0x5620488f66a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.028+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/581227992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488efc40 0x5620488f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.028+0000 7f82e2ffc740 1 -- 172.21.15.8:0/581227992 >> 172.21.15.8:0/581227992 conn(0x5620488ea370 msgr2=0x5620488ec0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.028+0000 7f82bf400640 0 client.27052 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:04:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.028+0000 7f82e2ffc740 1 -- 172.21.15.8:0/581227992 shutdown_connections 2024-03-16T21:04:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.028+0000 7f82e2ffc740 1 -- 172.21.15.8:0/581227992 wait complete. 2024-03-16T21:04:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.028+0000 7f82e2ffc740 20 client.27052 trim_cache size 0 max 16384 2024-03-16T21:04:22.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.041+0000 7f82e2ffc740 1 Processor -- start 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82e2ffc740 1 -- start start 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 0x5620488f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 0x5620488ebcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488ec1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562048905c70 con 0x5620488f9140 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620488eaf40 con 0x5620488f0560 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620488eb370 con 0x5620488efc40 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82de200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488ec1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82dd800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 0x5620488f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82de200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488ec1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43702/0 (socket says 172.21.15.8:43702) 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82de200640 1 -- 172.21.15.8:0/732427242 learned_addr learned my addr 172.21.15.8:0/732427242 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82dd800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 0x5620488f6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36804/0 (socket says 172.21.15.8:36804) 2024-03-16T21:04:22.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82dce00640 1 --2- 172.21.15.8:0/732427242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 0x5620488ebcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82dd800640 1 -- 172.21.15.8:0/732427242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 msgr2=0x5620488ebcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82dd800640 1 --2- 172.21.15.8:0/732427242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 0x5620488ebcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82dd800640 1 -- 172.21.15.8:0/732427242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 msgr2=0x5620488ec1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.042+0000 7f82dd800640 1 --2- 172.21.15.8:0/732427242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488ec1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.043+0000 7f82dd800640 1 -- 172.21.15.8:0/732427242 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620487f1ab0 con 0x5620488efc40 2024-03-16T21:04:22.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.043+0000 7f82de200640 1 --2- 172.21.15.8:0/732427242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488ec1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:22.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.043+0000 7f82dd800640 1 --2- 172.21.15.8:0/732427242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 0x5620488f6a00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x5620488ef710 tx=0x7f82cc0cf040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b6f8d84c3abbe4e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.043+0000 7f82ca000640 1 -- 172.21.15.8:0/732427242 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc09e8e0 con 0x5620488efc40 2024-03-16T21:04:22.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.043+0000 7f82ca000640 1 -- 172.21.15.8:0/732427242 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f82cc0a2f30 con 0x5620488efc40 2024-03-16T21:04:22.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.043+0000 7f82ca000640 1 -- 172.21.15.8:0/732427242 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0850c0 con 0x5620488efc40 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.044+0000 7f82e2ffc740 1 -- 172.21.15.8:0/732427242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 msgr2=0x5620488f6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.044+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/732427242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 0x5620488f6a00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x5620488ef710 tx=0x7f82cc0cf040 comp rx=0 tx=0).stop 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.044+0000 7f82e2ffc740 1 -- 172.21.15.8:0/732427242 shutdown_connections 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.044+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/732427242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488f9140 0x5620488ec1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.044+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/732427242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f0560 0x5620488ebcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.044+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/732427242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488efc40 0x5620488f6a00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.044+0000 7f82e2ffc740 1 -- 172.21.15.8:0/732427242 >> 172.21.15.8:0/732427242 conn(0x5620488ea370 msgr2=0x5620488eb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.044+0000 7f82e2ffc740 1 -- 172.21.15.8:0/732427242 shutdown_connections 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.044+0000 7f82e2ffc740 1 -- 172.21.15.8:0/732427242 wait complete. 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.044+0000 7f82e2ffc740 1 -- start start 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.044+0000 7f82e2ffc740 1 Processor -- start 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488efc40 0x5620488fcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 0x5620488fcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82e2ffc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f9140 0x56204896c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620488fd740 con 0x5620488efc40 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56204896c7f0 con 0x5620488f9140 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82e2ffc740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56204896c9b0 con 0x5620488f0560 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82e2ffc740 10 client.0 _ll_register_callbacks cb 0x7f82d00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82dd800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488efc40 0x5620488fcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82de200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f9140 0x56204896c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82dce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 0x5620488fcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82de200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f9140 0x56204896c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48326/0 (socket says 172.21.15.8:48326) 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82dd800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488efc40 0x5620488fcaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43704/0 (socket says 172.21.15.8:43704) 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82dce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 0x5620488fcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36820/0 (socket says 172.21.15.8:36820) 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82de200640 1 -- 172.21.15.8:0/2905460314 learned_addr learned my addr 172.21.15.8:0/2905460314 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82de200640 1 -- 172.21.15.8:0/2905460314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 msgr2=0x5620488fcfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82de200640 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 0x5620488fcfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82de200640 1 -- 172.21.15.8:0/2905460314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488efc40 msgr2=0x5620488fcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82de200640 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488efc40 0x5620488fcaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82de200640 1 -- 172.21.15.8:0/2905460314 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d0013170 con 0x5620488f9140 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.045+0000 7f82dd800640 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488efc40 0x5620488fcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.046+0000 7f82de200640 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f9140 0x56204896c2b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f82d0003cf0 tx=0x7f82d0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f49baaa85d575b40 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.046+0000 7f82bf400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.046+0000 7f82bf400640 1 -- 172.21.15.8:0/2905460314 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0027070 con 0x5620488f9140 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.046+0000 7f82e2ffc740 1 -- 172.21.15.8:0/2905460314 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82cc09a790 con 0x5620488f9140 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.046+0000 7f82bf400640 1 -- 172.21.15.8:0/2905460314 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f82d0004540 con 0x5620488f9140 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.046+0000 7f82bf400640 1 -- 172.21.15.8:0/2905460314 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82d000fed0 con 0x5620488f9140 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.046+0000 7f82e2ffc740 10 client.27053 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.046+0000 7f82e2ffc740 1 -- 172.21.15.8:0/2905460314 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562048818df0 con 0x5620488f9140 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.047+0000 7f82bf400640 1 -- 172.21.15.8:0/2905460314 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f82cc09a790 con 0x5620488f9140 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.047+0000 7f82bf400640 1 -- 172.21.15.8:0/2905460314 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f82d0010430 con 0x5620488f9140 2024-03-16T21:04:22.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.047+0000 7f82e2ffc740 10 client.27053 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.047+0000 7f82e2ffc740 10 client.27053 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.047+0000 7f82e2ffc740 20 client.27053 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.047+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56204896e200 0x562048970620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.047+0000 7f82e2ffc740 4 client.27053 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.047+0000 7f82e2ffc740 1 -- 172.21.15.8:0/2905460314 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5620485e2890 con 0x56204896e200 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.047+0000 7f82dd800640 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56204896e200 0x562048970620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82dd800640 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56204896e200 0x562048970620 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2bdff8064aa97409 server_cookie=b8f0d0a8b06596bf in_seq=0 out_seq=0 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82bf400640 10 client.27053 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82bf400640 1 -- 172.21.15.8:0/2905460314 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5620485e2890 con 0x56204896e200 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82bf400640 10 client.27053 handle_command_reply: tid=0 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 1 client.27053 shutdown 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 1 -- 172.21.15.8:0/2905460314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f9140 msgr2=0x56204896c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f9140 0x56204896c2b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f82d0003cf0 tx=0x7f82d0004a40 comp rx=0 tx=0).stop 2024-03-16T21:04:22.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 1 -- 172.21.15.8:0/2905460314 shutdown_connections 2024-03-16T21:04:22.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x56204896e200 0x562048970620 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620488f9140 0x56204896c2b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5620488f0560 0x5620488fcfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82bf400640 0 client.27053 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:04:22.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 1 --2- 172.21.15.8:0/2905460314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620488efc40 0x5620488fcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 1 -- 172.21.15.8:0/2905460314 >> 172.21.15.8:0/2905460314 conn(0x5620488ea370 msgr2=0x5620488ebdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 1 -- 172.21.15.8:0/2905460314 shutdown_connections 2024-03-16T21:04:22.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 1 -- 172.21.15.8:0/2905460314 wait complete. 2024-03-16T21:04:22.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.048+0000 7f82e2ffc740 20 client.27053 trim_cache size 0 max 16384 2024-03-16T21:04:22.059 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:04:22.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 -- 172.21.15.8:0/592888312 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82c00a1c20 msgr2=0x7f82c00a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82c00a1c20 0x7f82c00a40e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009fd0 tx=0x7f82d0004ab0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 -- 172.21.15.8:0/592888312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d8073920 msgr2=0x7f82d8199df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d8073920 0x7f82d8199df0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00e9f0 tx=0x7f82cc00eeb0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 -- 172.21.15.8:0/592888312 shutdown_connections 2024-03-16T21:04:22.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82c00a1c20 0x7f82c00a40e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82d810dcc0 0x7f82d819e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82d8074240 0x7f82d819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 --2- 172.21.15.8:0/592888312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82d8073920 0x7f82d8199df0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 -- 172.21.15.8:0/592888312 >> 172.21.15.8:0/592888312 conn(0x7f82d80788f0 msgr2=0x7f82d80fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 -- 172.21.15.8:0/592888312 shutdown_connections 2024-03-16T21:04:22.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.049+0000 7f82e0200640 1 -- 172.21.15.8:0/592888312 wait complete. 2024-03-16T21:04:22.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:21 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1269099221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:04:22.073 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:04:22.073 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:04:22.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.293+0000 7f0752000640 1 -- 172.21.15.8:0/1391695145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f074c103690 msgr2=0x7f074c103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.293+0000 7f0752000640 1 --2- 172.21.15.8:0/1391695145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f074c103690 0x7f074c103b10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0738009860 tx=0x7f073802bb70 comp rx=0 tx=0).stop 2024-03-16T21:04:22.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.294+0000 7f0752000640 1 -- 172.21.15.8:0/1391695145 shutdown_connections 2024-03-16T21:04:22.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.294+0000 7f0752000640 1 --2- 172.21.15.8:0/1391695145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f074c104050 0x7f074c110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.294+0000 7f0752000640 1 --2- 172.21.15.8:0/1391695145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f074c103690 0x7f074c103b10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.294+0000 7f0752000640 1 --2- 172.21.15.8:0/1391695145 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f074c1096a0 0x7f074c109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.294+0000 7f0752000640 1 -- 172.21.15.8:0/1391695145 >> 172.21.15.8:0/1391695145 conn(0x7f074c0ff140 msgr2=0x7f074c101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.294+0000 7f0752000640 1 -- 172.21.15.8:0/1391695145 shutdown_connections 2024-03-16T21:04:22.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.294+0000 7f0752000640 1 -- 172.21.15.8:0/1391695145 wait complete. 2024-03-16T21:04:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f0752000640 1 Processor -- start 2024-03-16T21:04:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f0752000640 1 -- start start 2024-03-16T21:04:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f0752000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f074c103690 0x7f074c199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f0752000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f074c104050 0x7f074c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f0752000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f074c1096a0 0x7f074c19e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f0752000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c19ed20 con 0x7f074c103690 2024-03-16T21:04:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f0752000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c19ee90 con 0x7f074c104050 2024-03-16T21:04:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f0752000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c19f050 con 0x7f074c1096a0 2024-03-16T21:04:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f074aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f074c104050 0x7f074c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f074be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f074c1096a0 0x7f074c19e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f074b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f074c103690 0x7f074c199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.296+0000 7f074aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f074c104050 0x7f074c19a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48346/0 (socket says 172.21.15.8:48346) 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.295+0000 7f074be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f074c1096a0 0x7f074c19e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36842/0 (socket says 172.21.15.8:36842) 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.296+0000 7f074aa00640 1 -- 172.21.15.8:0/4131281462 learned_addr learned my addr 172.21.15.8:0/4131281462 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.296+0000 7f074be00640 1 -- 172.21.15.8:0/4131281462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f074c104050 msgr2=0x7f074c19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.296+0000 7f074be00640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f074c104050 0x7f074c19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.296+0000 7f074be00640 1 -- 172.21.15.8:0/4131281462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f074c103690 msgr2=0x7f074c199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.296+0000 7f074be00640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f074c103690 0x7f074c199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.296+0000 7f074be00640 1 -- 172.21.15.8:0/4131281462 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c009560 con 0x7f074c1096a0 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.296+0000 7f074aa00640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f074c104050 0x7f074c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.296+0000 7f074be00640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f074c1096a0 0x7f074c19e720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0744009fd0 tx=0x7f074400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.297+0000 7f0743e00640 1 -- 172.21.15.8:0/4131281462 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074400ce20 con 0x7f074c1096a0 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.297+0000 7f0752000640 1 -- 172.21.15.8:0/4131281462 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0738009490 con 0x7f074c1096a0 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.297+0000 7f0743e00640 1 -- 172.21.15.8:0/4131281462 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0744004b20 con 0x7f074c1096a0 2024-03-16T21:04:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.297+0000 7f0743e00640 1 -- 172.21.15.8:0/4131281462 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0744010710 con 0x7f074c1096a0 2024-03-16T21:04:22.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.297+0000 7f0752000640 1 -- 172.21.15.8:0/4131281462 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c1a69d0 con 0x7f074c1096a0 2024-03-16T21:04:22.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.300+0000 7f0743e00640 1 -- 172.21.15.8:0/4131281462 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f0744004c90 con 0x7f074c1096a0 2024-03-16T21:04:22.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.300+0000 7f0754e36740 1 Processor -- start 2024-03-16T21:04:22.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.300+0000 7f0754e36740 1 -- start start 2024-03-16T21:04:22.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f0754e36740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c48c40 0x55df40c49020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f0754e36740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c49560 0x55df40c51c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f0754e36740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c52140 0x55df40c54530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f0754e36740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df40bb7210 con 0x55df40c52140 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f0754e36740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df40bb4740 con 0x55df40c49560 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f0754e36740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df40baff20 con 0x55df40c48c40 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f074b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c49560 0x55df40c51c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f074b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c49560 0x55df40c51c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48348/0 (socket says 172.21.15.8:48348) 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f074aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c48c40 0x55df40c49020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f074b400640 1 -- 172.21.15.8:0/2265243200 learned_addr learned my addr 172.21.15.8:0/2265243200 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f0743e00640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07300a1ba0 0x7f07300a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.301+0000 7f074aa00640 1 --2- 172.21.15.8:0/2265243200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c52140 0x55df40c54530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.302+0000 7f074b400640 1 -- 172.21.15.8:0/2265243200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c48c40 msgr2=0x55df40c49020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.302+0000 7f074b400640 1 --2- 172.21.15.8:0/2265243200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c48c40 0x55df40c49020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.302+0000 7f074b400640 1 -- 172.21.15.8:0/2265243200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c52140 msgr2=0x55df40c54530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.302+0000 7f074b400640 1 --2- 172.21.15.8:0/2265243200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c52140 0x55df40c54530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.302+0000 7f0743e00640 1 -- 172.21.15.8:0/4131281462 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0744014070 con 0x7f074c1096a0 2024-03-16T21:04:22.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.302+0000 7f074b400640 1 -- 172.21.15.8:0/2265243200 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df40b71df0 con 0x55df40c49560 2024-03-16T21:04:22.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.302+0000 7f074be00640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07300a1ba0 0x7f07300a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.302+0000 7f074b400640 1 --2- 172.21.15.8:0/2265243200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c49560 0x55df40c51c00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f073c009de0 tx=0x7f073c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16364e7b35dc3aa3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.302+0000 7f0737e00640 1 -- 172.21.15.8:0/2265243200 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c005220 con 0x55df40c49560 2024-03-16T21:04:22.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.302+0000 7f0737e00640 1 -- 172.21.15.8:0/2265243200 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f073c004ca0 con 0x55df40c49560 2024-03-16T21:04:22.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.302+0000 7f0737e00640 1 -- 172.21.15.8:0/2265243200 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00e960 con 0x55df40c49560 2024-03-16T21:04:22.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.303+0000 7f0754e36740 1 -- 172.21.15.8:0/2265243200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c49560 msgr2=0x55df40c51c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.303+0000 7f0754e36740 1 --2- 172.21.15.8:0/2265243200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c49560 0x55df40c51c00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f073c009de0 tx=0x7f073c011810 comp rx=0 tx=0).stop 2024-03-16T21:04:22.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.303+0000 7f074be00640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07300a1ba0 0x7f07300a4060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0744097550 tx=0x7f0744004a40 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.303+0000 7f0754e36740 1 -- 172.21.15.8:0/2265243200 shutdown_connections 2024-03-16T21:04:22.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.303+0000 7f0754e36740 1 --2- 172.21.15.8:0/2265243200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c52140 0x55df40c54530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.303+0000 7f0754e36740 1 --2- 172.21.15.8:0/2265243200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c49560 0x55df40c51c00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.303+0000 7f0754e36740 1 --2- 172.21.15.8:0/2265243200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c48c40 0x55df40c49020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.303+0000 7f0754e36740 1 -- 172.21.15.8:0/2265243200 >> 172.21.15.8:0/2265243200 conn(0x55df40c43370 msgr2=0x55df40c43750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.303+0000 7f0754e36740 1 -- 172.21.15.8:0/2265243200 shutdown_connections 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.303+0000 7f0754e36740 1 -- 172.21.15.8:0/2265243200 wait complete. 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.304+0000 7f0754e36740 1 -- start start 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.304+0000 7f0754e36740 1 Processor -- start 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.304+0000 7f0754e36740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c48c40 0x55df40c4f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.304+0000 7f0754e36740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c4f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.304+0000 7f0754e36740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c52140 0x55df40c4fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.304+0000 7f0754e36740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df40b55150 con 0x55df40c48c40 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.304+0000 7f0754e36740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df40b54df0 con 0x55df40c52140 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.304+0000 7f0754e36740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df4091e1c0 con 0x55df40c49560 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f0754e36740 10 client.0 _ll_register_callbacks cb 0x55df40ba42b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f074aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c48c40 0x55df40c4f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f074b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c4f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f074aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c48c40 0x55df40c4f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43738/0 (socket says 172.21.15.8:43738) 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f074aa00640 1 -- 172.21.15.8:0/971685158 learned_addr learned my addr 172.21.15.8:0/971685158 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f074b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c4f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36862/0 (socket says 172.21.15.8:36862) 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f074aa00640 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c52140 0x55df40c4fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f074b400640 1 -- 172.21.15.8:0/971685158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c52140 msgr2=0x55df40c4fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f074b400640 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c52140 0x55df40c4fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f074b400640 1 -- 172.21.15.8:0/971685158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c48c40 msgr2=0x55df40c4f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f074b400640 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c48c40 0x55df40c4f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.305+0000 7f074b400640 1 -- 172.21.15.8:0/971685158 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c009a10 con 0x55df40c49560 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.306+0000 7f074b400640 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c4f620 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f073c011d10 tx=0x7f073c0048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8507fa8989851c3f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.306+0000 7f0734c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:04:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.306+0000 7f0734c00640 1 -- 172.21.15.8:0/971685158 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c004e10 con 0x55df40c49560 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.306+0000 7f0734c00640 1 -- 172.21.15.8:0/971685158 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f073c004ae0 con 0x55df40c49560 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.306+0000 7f0754e36740 1 -- 172.21.15.8:0/971685158 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df408af7e0 con 0x55df40c49560 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.306+0000 7f0734c00640 1 -- 172.21.15.8:0/971685158 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f073c004020 con 0x55df40c49560 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.306+0000 7f0754e36740 10 client.27070 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.306+0000 7f0754e36740 1 -- 172.21.15.8:0/971685158 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55df40bae5a0 con 0x55df40c49560 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.307+0000 7f0734c00640 1 -- 172.21.15.8:0/971685158 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55df408af7e0 con 0x55df40c49560 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.307+0000 7f0734c00640 1 -- 172.21.15.8:0/971685158 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f073c003710 con 0x55df40c49560 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.307+0000 7f0754e36740 10 client.27070 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.307+0000 7f0754e36740 10 client.27070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.307+0000 7f0754e36740 20 client.27070 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.307+0000 7f0754e36740 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55df40c61fe0 0x55df40c643d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.307+0000 7f0754e36740 4 client.27070 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.307+0000 7f0754e36740 1 -- 172.21.15.8:0/971685158 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df408ec720 con 0x55df40c61fe0 2024-03-16T21:04:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.307+0000 7f074aa00640 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55df40c61fe0 0x55df40c643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.308+0000 7f074aa00640 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55df40c61fe0 0x55df40c643d0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1fe527737ba12e0 server_cookie=f74facaf4269890c in_seq=0 out_seq=0 2024-03-16T21:04:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.308+0000 7f0734c00640 10 client.27070 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0734c00640 1 -- 172.21.15.8:0/971685158 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55df408ec720 con 0x55df40c61fe0 2024-03-16T21:04:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0734c00640 10 client.27070 handle_command_reply: tid=0 2024-03-16T21:04:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 1 client.27070 shutdown 2024-03-16T21:04:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 1 -- 172.21.15.8:0/971685158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 msgr2=0x55df40c4f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c4f620 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f073c011d10 tx=0x7f073c0048f0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 1 -- 172.21.15.8:0/971685158 shutdown_connections 2024-03-16T21:04:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c52140 0x55df40c4fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c4f620 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55df40c61fe0 0x55df40c643d0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 1 --2- 172.21.15.8:0/971685158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c48c40 0x55df40c4f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 1 -- 172.21.15.8:0/971685158 >> 172.21.15.8:0/971685158 conn(0x55df40c43370 msgr2=0x55df40c450c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0734c00640 0 client.27070 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 1 -- 172.21.15.8:0/971685158 shutdown_connections 2024-03-16T21:04:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 1 -- 172.21.15.8:0/971685158 wait complete. 2024-03-16T21:04:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.309+0000 7f0754e36740 20 client.27070 trim_cache size 0 max 16384 2024-03-16T21:04:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.323+0000 7f0754e36740 1 Processor -- start 2024-03-16T21:04:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.323+0000 7f0754e36740 1 -- start start 2024-03-16T21:04:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.323+0000 7f0754e36740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c48c40 0x55df40c517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.323+0000 7f0754e36740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c49560 0x55df40c4f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.323+0000 7f0754e36740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c52140 0x55df40c5d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.323+0000 7f0754e36740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df40c486b0 con 0x55df40c49560 2024-03-16T21:04:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.323+0000 7f0754e36740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df40c54560 con 0x55df40c48c40 2024-03-16T21:04:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.323+0000 7f0754e36740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df40c443f0 con 0x55df40c52140 2024-03-16T21:04:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.324+0000 7f074aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c48c40 0x55df40c517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.324+0000 7f074b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c49560 0x55df40c4f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.324+0000 7f074aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c48c40 0x55df40c517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:48366/0 (socket says 172.21.15.8:48366) 2024-03-16T21:04:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.324+0000 7f074aa00640 1 -- 172.21.15.8:0/3421981941 learned_addr learned my addr 172.21.15.8:0/3421981941 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.324+0000 7f074aa00640 1 --2- 172.21.15.8:0/3421981941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c52140 0x55df40c5d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.324+0000 7f074b400640 1 -- 172.21.15.8:0/3421981941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c52140 msgr2=0x55df40c5d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.324+0000 7f074b400640 1 --2- 172.21.15.8:0/3421981941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c52140 0x55df40c5d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.324+0000 7f074b400640 1 -- 172.21.15.8:0/3421981941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c48c40 msgr2=0x55df40c517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.324+0000 7f074b400640 1 --2- 172.21.15.8:0/3421981941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c48c40 0x55df40c517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.324+0000 7f074b400640 1 -- 172.21.15.8:0/3421981941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df40b4aab0 con 0x55df40c49560 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.324+0000 7f074aa00640 1 --2- 172.21.15.8:0/3421981941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c48c40 0x55df40c517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.325+0000 7f074b400640 1 --2- 172.21.15.8:0/3421981941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c49560 0x55df40c4f980 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f073c009530 tx=0x7f073c012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e206aeb14156cc25 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.325+0000 7f0737400640 1 -- 172.21.15.8:0/3421981941 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c005970 con 0x55df40c49560 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.325+0000 7f0737400640 1 -- 172.21.15.8:0/3421981941 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f073c004e10 con 0x55df40c49560 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.325+0000 7f0737400640 1 -- 172.21.15.8:0/3421981941 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c0035f0 con 0x55df40c49560 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.325+0000 7f0754e36740 1 -- 172.21.15.8:0/3421981941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c49560 msgr2=0x55df40c4f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.325+0000 7f0754e36740 1 --2- 172.21.15.8:0/3421981941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c49560 0x55df40c4f980 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f073c009530 tx=0x7f073c012f90 comp rx=0 tx=0).stop 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.326+0000 7f0754e36740 1 -- 172.21.15.8:0/3421981941 shutdown_connections 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.326+0000 7f0754e36740 1 --2- 172.21.15.8:0/3421981941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c52140 0x55df40c5d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.326+0000 7f0754e36740 1 --2- 172.21.15.8:0/3421981941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c49560 0x55df40c4f980 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.326+0000 7f0754e36740 1 --2- 172.21.15.8:0/3421981941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c48c40 0x55df40c517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.326+0000 7f0754e36740 1 -- 172.21.15.8:0/3421981941 >> 172.21.15.8:0/3421981941 conn(0x55df40c43370 msgr2=0x55df40c42470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.326+0000 7f0754e36740 1 -- 172.21.15.8:0/3421981941 shutdown_connections 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.326+0000 7f0754e36740 1 -- 172.21.15.8:0/3421981941 wait complete. 2024-03-16T21:04:22.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.326+0000 7f0754e36740 1 -- start start 2024-03-16T21:04:22.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.326+0000 7f0754e36740 1 Processor -- start 2024-03-16T21:04:22.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f0754e36740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c48c40 0x55df40c55b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f0754e36740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f0754e36740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c52140 0x55df40cbc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f0754e36740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df40c56840 con 0x55df40c48c40 2024-03-16T21:04:22.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f0754e36740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df40cbce10 con 0x55df40c52140 2024-03-16T21:04:22.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f0754e36740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df40cbcfd0 con 0x55df40c49560 2024-03-16T21:04:22.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f0754e36740 10 client.0 _ll_register_callbacks cb 0x7f073c005460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:22.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f074b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f074b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36884/0 (socket says 172.21.15.8:36884) 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f074b400640 1 -- 172.21.15.8:0/1973032281 learned_addr learned my addr 172.21.15.8:0/1973032281 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f074aa00640 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c48c40 0x55df40c55b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f074aa00640 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c52140 0x55df40cbc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f074b400640 1 -- 172.21.15.8:0/1973032281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c52140 msgr2=0x55df40cbc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f074b400640 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c52140 0x55df40cbc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f074b400640 1 -- 172.21.15.8:0/1973032281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c48c40 msgr2=0x55df40c55b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f074b400640 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c48c40 0x55df40c55b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.327+0000 7f074b400640 1 -- 172.21.15.8:0/1973032281 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c110e60 con 0x55df40c49560 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.328+0000 7f074b400640 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c560a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f073c00e550 tx=0x7f073c0093c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c4786ab46ca9a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.328+0000 7f0734c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.328+0000 7f0734c00640 1 -- 172.21.15.8:0/1973032281 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c0037f0 con 0x55df40c49560 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.328+0000 7f0754e36740 1 -- 172.21.15.8:0/1973032281 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f073c004ca0 con 0x55df40c49560 2024-03-16T21:04:22.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.328+0000 7f0734c00640 1 -- 172.21.15.8:0/1973032281 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f073c000e40 con 0x55df40c49560 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.328+0000 7f0734c00640 1 -- 172.21.15.8:0/1973032281 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f073c005970 con 0x55df40c49560 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.328+0000 7f0754e36740 10 client.27076 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.328+0000 7f0754e36740 1 -- 172.21.15.8:0/1973032281 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55df40bae5a0 con 0x55df40c49560 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.328+0000 7f0734c00640 1 -- 172.21.15.8:0/1973032281 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f073c004ca0 con 0x55df40c49560 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.329+0000 7f0734c00640 1 -- 172.21.15.8:0/1973032281 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f073c00ea70 con 0x55df40c49560 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.329+0000 7f0754e36740 10 client.27076 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.329+0000 7f0754e36740 10 client.27076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.329+0000 7f0754e36740 20 client.27076 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.329+0000 7f0754e36740 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55df40cbe310 0x55df40cc0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.329+0000 7f0754e36740 4 client.27076 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.329+0000 7f0754e36740 1 -- 172.21.15.8:0/1973032281 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55df4093b890 con 0x55df40cbe310 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.329+0000 7f074aa00640 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55df40cbe310 0x55df40cc0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.329+0000 7f074aa00640 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55df40cbe310 0x55df40cc0700 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5599df81fbdb7ffb server_cookie=fad4a4cdd1d0e0f9 in_seq=0 out_seq=0 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.329+0000 7f0734c00640 10 client.27076 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:22.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0734c00640 1 -- 172.21.15.8:0/1973032281 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55df4093b890 con 0x55df40cbe310 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0734c00640 10 client.27076 handle_command_reply: tid=0 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 1 client.27076 shutdown 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 1 -- 172.21.15.8:0/1973032281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 msgr2=0x55df40c560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c560a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f073c00e550 tx=0x7f073c0093c0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 1 -- 172.21.15.8:0/1973032281 shutdown_connections 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df40c52140 0x55df40cbc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df40c49560 0x55df40c560a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55df40cbe310 0x55df40cc0700 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 1 --2- 172.21.15.8:0/1973032281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df40c48c40 0x55df40c55b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 1 -- 172.21.15.8:0/1973032281 >> 172.21.15.8:0/1973032281 conn(0x55df40c43370 msgr2=0x55df40c44500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0734c00640 0 client.27076 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 1 -- 172.21.15.8:0/1973032281 shutdown_connections 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 1 -- 172.21.15.8:0/1973032281 wait complete. 2024-03-16T21:04:22.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.330+0000 7f0754e36740 20 client.27076 trim_cache size 0 max 16384 2024-03-16T21:04:22.341 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:04:22.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 -- 172.21.15.8:0/4131281462 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07300a1ba0 msgr2=0x7f07300a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07300a1ba0 0x7f07300a4060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0744097550 tx=0x7f0744004a40 comp rx=0 tx=0).stop 2024-03-16T21:04:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 -- 172.21.15.8:0/4131281462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f074c1096a0 msgr2=0x7f074c19e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f074c1096a0 0x7f074c19e720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0744009fd0 tx=0x7f074400ef10 comp rx=0 tx=0).stop 2024-03-16T21:04:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 -- 172.21.15.8:0/4131281462 shutdown_connections 2024-03-16T21:04:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f07300a1ba0 0x7f07300a4060 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f074c1096a0 0x7f074c19e720 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f074c104050 0x7f074c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 --2- 172.21.15.8:0/4131281462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f074c103690 0x7f074c199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 -- 172.21.15.8:0/4131281462 >> 172.21.15.8:0/4131281462 conn(0x7f074c0ff140 msgr2=0x7f074c0ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 -- 172.21.15.8:0/4131281462 shutdown_connections 2024-03-16T21:04:22.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:22.331+0000 7f0752000640 1 -- 172.21.15.8:0/4131281462 wait complete. 2024-03-16T21:04:22.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:21 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1269099221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:04:22.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:21 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1269099221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:04:23.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:22 smithi008 ceph-mon[31434]: pgmap v201: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:04:23.355 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:04:23.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:04:23.356 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:04:23.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:22 smithi170 ceph-mon[35947]: pgmap v201: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:04:23.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:22 smithi186 ceph-mon[36391]: pgmap v201: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:04:23.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.589+0000 7f9a87000640 1 -- 172.21.15.8:0/3441280307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a80075a20 msgr2=0x7f9a80075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.589+0000 7f9a87000640 1 --2- 172.21.15.8:0/3441280307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a80075a20 0x7f9a80075e00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009930 tx=0x7f9a7002bc20 comp rx=0 tx=0).stop 2024-03-16T21:04:23.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.589+0000 7f9a87000640 1 -- 172.21.15.8:0/3441280307 shutdown_connections 2024-03-16T21:04:23.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.589+0000 7f9a87000640 1 --2- 172.21.15.8:0/3441280307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a80112330 0x7f9a80114720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.589+0000 7f9a87000640 1 --2- 172.21.15.8:0/3441280307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a80076340 0x7f9a80111df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.589+0000 7f9a87000640 1 --2- 172.21.15.8:0/3441280307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a80075a20 0x7f9a80075e00 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.589+0000 7f9a87000640 1 -- 172.21.15.8:0/3441280307 >> 172.21.15.8:0/3441280307 conn(0x7f9a800ff160 msgr2=0x7f9a80101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.590+0000 7f9a87000640 1 -- 172.21.15.8:0/3441280307 shutdown_connections 2024-03-16T21:04:23.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.590+0000 7f9a87000640 1 -- 172.21.15.8:0/3441280307 wait complete. 2024-03-16T21:04:23.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.591+0000 7f9a87000640 1 Processor -- start 2024-03-16T21:04:23.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.591+0000 7f9a87000640 1 -- start start 2024-03-16T21:04:23.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a87000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a80075a20 0x7f9a8019e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a87000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a80076340 0x7f9a8019e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a87000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a80112330 0x7f9a801a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a87000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801a3140 con 0x7f9a80076340 2024-03-16T21:04:23.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a87000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801a32b0 con 0x7f9a80112330 2024-03-16T21:04:23.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a87000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801a3470 con 0x7f9a80075a20 2024-03-16T21:04:23.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a7fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a80075a20 0x7f9a8019e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a7fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a80075a20 0x7f9a8019e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36892/0 (socket says 172.21.15.8:36892) 2024-03-16T21:04:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a7fe00640 1 -- 172.21.15.8:0/3865638134 learned_addr learned my addr 172.21.15.8:0/3865638134 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a85000640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a80112330 0x7f9a801a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a77e00640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a80076340 0x7f9a8019e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a7fe00640 1 -- 172.21.15.8:0/3865638134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a80112330 msgr2=0x7f9a801a2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a7fe00640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a80112330 0x7f9a801a2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a7fe00640 1 -- 172.21.15.8:0/3865638134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a80076340 msgr2=0x7f9a8019e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a7fe00640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a80076340 0x7f9a8019e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a7fe00640 1 -- 172.21.15.8:0/3865638134 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a78009840 con 0x7f9a80075a20 2024-03-16T21:04:23.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.592+0000 7f9a85000640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a80112330 0x7f9a801a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:23.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.593+0000 7f9a7fe00640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a80075a20 0x7f9a8019e280 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9a70005ab0 tx=0x7f9a7002cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.593+0000 7f9a7d600640 1 -- 172.21.15.8:0/3865638134 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70004250 con 0x7f9a80075a20 2024-03-16T21:04:23.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.593+0000 7f9a7d600640 1 -- 172.21.15.8:0/3865638134 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9a700043b0 con 0x7f9a80075a20 2024-03-16T21:04:23.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.593+0000 7f9a7d600640 1 -- 172.21.15.8:0/3865638134 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70003b30 con 0x7f9a80075a20 2024-03-16T21:04:23.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.593+0000 7f9a87000640 1 -- 172.21.15.8:0/3865638134 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a70009560 con 0x7f9a80075a20 2024-03-16T21:04:23.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.593+0000 7f9a87000640 1 -- 172.21.15.8:0/3865638134 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a801aadf0 con 0x7f9a80075a20 2024-03-16T21:04:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.596+0000 7f9a7d600640 1 -- 172.21.15.8:0/3865638134 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f9a70003c90 con 0x7f9a80075a20 2024-03-16T21:04:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.596+0000 7f9a89e19740 1 Processor -- start 2024-03-16T21:04:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.597+0000 7f9a89e19740 1 -- start start 2024-03-16T21:04:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.597+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51451320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.597+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b51451860 0x562b51459f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.597+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b5145a440 0x562b5145c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.597+0000 7f9a89e19740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5140c300 con 0x562b5145a440 2024-03-16T21:04:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.597+0000 7f9a89e19740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b513bee50 con 0x562b51451860 2024-03-16T21:04:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.597+0000 7f9a89e19740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b513bc380 con 0x562b51450f40 2024-03-16T21:04:23.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a85000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51451320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a85000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51451320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36904/0 (socket says 172.21.15.8:36904) 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a85000640 1 -- 172.21.15.8:0/830326444 learned_addr learned my addr 172.21.15.8:0/830326444 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a7fe00640 1 --2- 172.21.15.8:0/830326444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b51451860 0x562b51459f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a77e00640 1 --2- 172.21.15.8:0/830326444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b5145a440 0x562b5145c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a85000640 1 -- 172.21.15.8:0/830326444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b51451860 msgr2=0x562b51459f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a85000640 1 --2- 172.21.15.8:0/830326444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b51451860 0x562b51459f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a85000640 1 -- 172.21.15.8:0/830326444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b5145a440 msgr2=0x562b5145c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a85000640 1 --2- 172.21.15.8:0/830326444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b5145a440 0x562b5145c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a85000640 1 -- 172.21.15.8:0/830326444 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b51380c80 con 0x562b51450f40 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a7d600640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9a640a1c20 0x7f9a640a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a85000640 1 --2- 172.21.15.8:0/830326444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51451320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800e890 tx=0x7f9a7800ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823f1ffd73a00746 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a7d600640 1 -- 172.21.15.8:0/3865638134 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9a700efcc0 con 0x7f9a80075a20 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.598+0000 7f9a7fe00640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9a640a1c20 0x7f9a640a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a75600640 1 -- 172.21.15.8:0/830326444 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78011c20 con 0x562b51450f40 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a75600640 1 -- 172.21.15.8:0/830326444 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9a78003e70 con 0x562b51450f40 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a75600640 1 -- 172.21.15.8:0/830326444 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78019430 con 0x562b51450f40 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a89e19740 1 -- 172.21.15.8:0/830326444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 msgr2=0x562b51451320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a89e19740 1 --2- 172.21.15.8:0/830326444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51451320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800e890 tx=0x7f9a7800ed50 comp rx=0 tx=0).stop 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a7fe00640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9a640a1c20 0x7f9a640a40e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x562b51450a10 tx=0x7f9a700f3730 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a89e19740 1 -- 172.21.15.8:0/830326444 shutdown_connections 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a89e19740 1 --2- 172.21.15.8:0/830326444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b5145a440 0x562b5145c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a89e19740 1 --2- 172.21.15.8:0/830326444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b51451860 0x562b51459f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a89e19740 1 --2- 172.21.15.8:0/830326444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51451320 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a89e19740 1 -- 172.21.15.8:0/830326444 >> 172.21.15.8:0/830326444 conn(0x562b5144b670 msgr2=0x562b5144ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.599+0000 7f9a89e19740 1 -- 172.21.15.8:0/830326444 shutdown_connections 2024-03-16T21:04:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.600+0000 7f9a89e19740 1 -- 172.21.15.8:0/830326444 wait complete. 2024-03-16T21:04:23.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.600+0000 7f9a89e19740 1 -- start start 2024-03-16T21:04:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.600+0000 7f9a89e19740 1 Processor -- start 2024-03-16T21:04:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b514573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b51457920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b51457e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a89e19740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b513b7b60 con 0x562b51451860 2024-03-16T21:04:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a89e19740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5135cfd0 con 0x562b5145a440 2024-03-16T21:04:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a89e19740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5135cc70 con 0x562b51450f40 2024-03-16T21:04:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a89e19740 10 client.0 _ll_register_callbacks cb 0x562b510c8c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a77e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b51457920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a85000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b514573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a77e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b51457920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43790/0 (socket says 172.21.15.8:43790) 2024-03-16T21:04:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a77e00640 1 -- 172.21.15.8:0/3628437749 learned_addr learned my addr 172.21.15.8:0/3628437749 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a85000640 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b51457e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a77e00640 1 -- 172.21.15.8:0/3628437749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 msgr2=0x562b514573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.601+0000 7f9a77e00640 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b514573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.602+0000 7f9a77e00640 1 -- 172.21.15.8:0/3628437749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 msgr2=0x562b51457e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.602+0000 7f9a77e00640 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b51457e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.602+0000 7f9a77e00640 1 -- 172.21.15.8:0/3628437749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7800e540 con 0x562b51451860 2024-03-16T21:04:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.602+0000 7f9a77e00640 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b51457920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800be30 tx=0x7f9a68012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e209b92a509f485 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.602+0000 7f9a6e000640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:04:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.602+0000 7f9a6e000640 1 -- 172.21.15.8:0/3628437749 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68005220 con 0x562b51451860 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.602+0000 7f9a6e000640 1 -- 172.21.15.8:0/3628437749 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9a68005380 con 0x562b51451860 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.602+0000 7f9a89e19740 1 -- 172.21.15.8:0/3628437749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b510b7860 con 0x562b51451860 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.602+0000 7f9a6e000640 1 -- 172.21.15.8:0/3628437749 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a68005540 con 0x562b51451860 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.602+0000 7f9a89e19740 10 client.16902 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.602+0000 7f9a89e19740 1 -- 172.21.15.8:0/3628437749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562b513b61e0 con 0x562b51451860 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.603+0000 7f9a6e000640 1 -- 172.21.15.8:0/3628437749 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9a68026080 con 0x562b51451860 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.603+0000 7f9a6e000640 1 -- 172.21.15.8:0/3628437749 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f9a68020030 con 0x562b51451860 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.603+0000 7f9a89e19740 10 client.16902 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.603+0000 7f9a89e19740 10 client.16902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.603+0000 7f9a89e19740 20 client.16902 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.603+0000 7f9a89e19740 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562b5146aa00 0x562b5146ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.603+0000 7f9a89e19740 4 client.16902 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.603+0000 7f9a89e19740 1 -- 172.21.15.8:0/3628437749 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b51108410 con 0x562b5146aa00 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.603+0000 7f9a85000640 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562b5146aa00 0x562b5146ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.604+0000 7f9a85000640 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562b5146aa00 0x562b5146ce20 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c8348e8ac46239 server_cookie=ddb5bb9b158c415c in_seq=0 out_seq=0 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.604+0000 7f9a6e000640 10 client.16902 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a6e000640 1 -- 172.21.15.8:0/3628437749 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x562b51108410 con 0x562b5146aa00 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a6e000640 10 client.16902 handle_command_reply: tid=0 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a89e19740 1 client.16902 shutdown 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a89e19740 1 -- 172.21.15.8:0/3628437749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 msgr2=0x562b51457920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a89e19740 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b51457920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800be30 tx=0x7f9a68012820 comp rx=0 tx=0).stop 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a89e19740 1 -- 172.21.15.8:0/3628437749 shutdown_connections 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a89e19740 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b51457e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a89e19740 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562b5146aa00 0x562b5146ce20 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a89e19740 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b51457920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a89e19740 1 --2- 172.21.15.8:0/3628437749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b514573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a6e000640 0 client.16902 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:23.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a89e19740 1 -- 172.21.15.8:0/3628437749 >> 172.21.15.8:0/3628437749 conn(0x562b5144b670 msgr2=0x562b5144d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.605+0000 7f9a89e19740 1 -- 172.21.15.8:0/3628437749 shutdown_connections 2024-03-16T21:04:23.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.606+0000 7f9a89e19740 1 -- 172.21.15.8:0/3628437749 wait complete. 2024-03-16T21:04:23.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.606+0000 7f9a89e19740 20 client.16902 trim_cache size 0 max 16384 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.623+0000 7f9a89e19740 1 Processor -- start 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a89e19740 1 -- start start 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51459b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b5144d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b51465850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a89e19740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b511000c0 con 0x562b51451860 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a89e19740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5145ca60 con 0x562b5145a440 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a89e19740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b51455970 con 0x562b51450f40 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a85000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51459b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a77e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b5144d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a77e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b5144d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43796/0 (socket says 172.21.15.8:43796) 2024-03-16T21:04:23.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a85000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51459b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36920/0 (socket says 172.21.15.8:36920) 2024-03-16T21:04:23.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a77e00640 1 -- 172.21.15.8:0/806046853 learned_addr learned my addr 172.21.15.8:0/806046853 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:23.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.624+0000 7f9a85000640 1 --2- 172.21.15.8:0/806046853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b51465850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.625+0000 7f9a77e00640 1 -- 172.21.15.8:0/806046853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 msgr2=0x562b51459b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.625+0000 7f9a77e00640 1 --2- 172.21.15.8:0/806046853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51459b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.625+0000 7f9a77e00640 1 -- 172.21.15.8:0/806046853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 msgr2=0x562b51465850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.625+0000 7f9a77e00640 1 --2- 172.21.15.8:0/806046853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b51465850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.625+0000 7f9a77e00640 1 -- 172.21.15.8:0/806046853 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b51352a90 con 0x562b51451860 2024-03-16T21:04:23.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.625+0000 7f9a85000640 1 --2- 172.21.15.8:0/806046853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51459b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:04:23.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.625+0000 7f9a77e00640 1 --2- 172.21.15.8:0/806046853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b5144d1d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9a68010da0 tx=0x7f9a68012dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1763a48ec00317fb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.625+0000 7f9a74c00640 1 -- 172.21.15.8:0/806046853 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68005850 con 0x562b51451860 2024-03-16T21:04:23.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.625+0000 7f9a74c00640 1 -- 172.21.15.8:0/806046853 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x562b510b7860 con 0x562b51451860 2024-03-16T21:04:23.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.625+0000 7f9a74c00640 1 -- 172.21.15.8:0/806046853 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68022910 con 0x562b51451860 2024-03-16T21:04:23.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.626+0000 7f9a89e19740 1 -- 172.21.15.8:0/806046853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 msgr2=0x562b5144d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.626+0000 7f9a89e19740 1 --2- 172.21.15.8:0/806046853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b5144d1d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9a68010da0 tx=0x7f9a68012dd0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.626+0000 7f9a89e19740 1 -- 172.21.15.8:0/806046853 shutdown_connections 2024-03-16T21:04:23.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.626+0000 7f9a89e19740 1 --2- 172.21.15.8:0/806046853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b51465850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.626+0000 7f9a89e19740 1 --2- 172.21.15.8:0/806046853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51451860 0x562b5144d1d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.626+0000 7f9a89e19740 1 --2- 172.21.15.8:0/806046853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51450f40 0x562b51459b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.626+0000 7f9a89e19740 1 -- 172.21.15.8:0/806046853 >> 172.21.15.8:0/806046853 conn(0x562b5144b670 msgr2=0x562b5144cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.626+0000 7f9a89e19740 1 -- 172.21.15.8:0/806046853 shutdown_connections 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.626+0000 7f9a89e19740 1 -- 172.21.15.8:0/806046853 wait complete. 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.626+0000 7f9a89e19740 1 -- start start 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.626+0000 7f9a89e19740 1 Processor -- start 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51450f40 0x562b5145f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51451860 0x562b5145f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a89e19740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b5145fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a89e19740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b514554c0 con 0x562b51450f40 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a89e19740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b514c62e0 con 0x562b5145a440 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a89e19740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b514c6450 con 0x562b51451860 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a89e19740 10 client.0 _ll_register_callbacks cb 0x7f9a6800ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a77e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51451860 0x562b5145f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a85000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51450f40 0x562b5145f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a77e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51451860 0x562b5145f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36930/0 (socket says 172.21.15.8:36930) 2024-03-16T21:04:23.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a77e00640 1 -- 172.21.15.8:0/617038578 learned_addr learned my addr 172.21.15.8:0/617038578 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.627+0000 7f9a85000640 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b5145fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.628+0000 7f9a77e00640 1 -- 172.21.15.8:0/617038578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 msgr2=0x562b5145fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.628+0000 7f9a77e00640 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b5145fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.628+0000 7f9a77e00640 1 -- 172.21.15.8:0/617038578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51450f40 msgr2=0x562b5145f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.628+0000 7f9a77e00640 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51450f40 0x562b5145f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.628+0000 7f9a77e00640 1 -- 172.21.15.8:0/617038578 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b513b61e0 con 0x562b51451860 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.628+0000 7f9a85000640 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51450f40 0x562b5145f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.628+0000 7f9a77e00640 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51451860 0x562b5145f8a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9a68006010 tx=0x7f9a680054c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3276cfbfe2a80490 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.628+0000 7f9a6e000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.628+0000 7f9a6e000640 1 -- 172.21.15.8:0/617038578 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68004020 con 0x562b51451860 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.628+0000 7f9a6e000640 1 -- 172.21.15.8:0/617038578 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9a68000e40 con 0x562b51451860 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.628+0000 7f9a89e19740 1 -- 172.21.15.8:0/617038578 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a78003e70 con 0x562b51451860 2024-03-16T21:04:23.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a6e000640 1 -- 172.21.15.8:0/617038578 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a68004180 con 0x562b51451860 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a89e19740 10 client.27094 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a89e19740 1 -- 172.21.15.8:0/617038578 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562b513786a0 con 0x562b51451860 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a6e000640 1 -- 172.21.15.8:0/617038578 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9a78003e70 con 0x562b51451860 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a6e000640 1 -- 172.21.15.8:0/617038578 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f9a680037b0 con 0x562b51451860 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a89e19740 10 client.27094 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a89e19740 10 client.27094 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a89e19740 20 client.27094 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a89e19740 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562b514c7910 0x562b514c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a89e19740 4 client.27094 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a89e19740 1 -- 172.21.15.8:0/617038578 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562b510f47b0 con 0x562b514c7910 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.629+0000 7f9a85000640 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562b514c7910 0x562b514c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.630+0000 7f9a85000640 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562b514c7910 0x562b514c9d30 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d1935f76fe7f19a server_cookie=805dd2f81e1632e7 in_seq=0 out_seq=0 2024-03-16T21:04:23.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.630+0000 7f9a6e000640 10 client.27094 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:23.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a6e000640 1 -- 172.21.15.8:0/617038578 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562b510f47b0 con 0x562b514c7910 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a6e000640 10 client.27094 handle_command_reply: tid=0 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a89e19740 1 client.27094 shutdown 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a89e19740 1 -- 172.21.15.8:0/617038578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51451860 msgr2=0x562b5145f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a89e19740 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51451860 0x562b5145f8a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9a68006010 tx=0x7f9a680054c0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a89e19740 1 -- 172.21.15.8:0/617038578 shutdown_connections 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a89e19740 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b5145a440 0x562b5145fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a89e19740 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562b51451860 0x562b5145f8a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a89e19740 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562b514c7910 0x562b514c9d30 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a89e19740 1 --2- 172.21.15.8:0/617038578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b51450f40 0x562b5145f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a89e19740 1 -- 172.21.15.8:0/617038578 >> 172.21.15.8:0/617038578 conn(0x562b5144b670 msgr2=0x562b51457c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.631+0000 7f9a6e000640 0 client.27094 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a89e19740 1 -- 172.21.15.8:0/617038578 shutdown_connections 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a89e19740 1 -- 172.21.15.8:0/617038578 wait complete. 2024-03-16T21:04:23.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a89e19740 20 client.27094 trim_cache size 0 max 16384 2024-03-16T21:04:23.642 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:04:23.642 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:04:23.642 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "be43a117-686f-4b21-8fb3-033815526d32", 2024-03-16T21:04:23.642 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:04:23.642 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:04:23.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a87000640 1 -- 172.21.15.8:0/3865638134 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9a640a1c20 msgr2=0x7f9a640a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a87000640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9a640a1c20 0x7f9a640a40e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x562b51450a10 tx=0x7f9a700f3730 comp rx=0 tx=0).stop 2024-03-16T21:04:23.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a87000640 1 -- 172.21.15.8:0/3865638134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a80075a20 msgr2=0x7f9a8019e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a87000640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a80075a20 0x7f9a8019e280 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9a70005ab0 tx=0x7f9a7002cc10 comp rx=0 tx=0).stop 2024-03-16T21:04:23.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a87000640 1 -- 172.21.15.8:0/3865638134 shutdown_connections 2024-03-16T21:04:23.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a87000640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f9a640a1c20 0x7f9a640a40e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a87000640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a80112330 0x7f9a801a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a87000640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a80076340 0x7f9a8019e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a87000640 1 --2- 172.21.15.8:0/3865638134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a80075a20 0x7f9a8019e280 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.632+0000 7f9a87000640 1 -- 172.21.15.8:0/3865638134 >> 172.21.15.8:0/3865638134 conn(0x7f9a800ff160 msgr2=0x7f9a80113970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.633+0000 7f9a87000640 1 -- 172.21.15.8:0/3865638134 shutdown_connections 2024-03-16T21:04:23.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.633+0000 7f9a87000640 1 -- 172.21.15.8:0/3865638134 wait complete. 2024-03-16T21:04:23.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:04:23.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:04:23.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.859+0000 7f461b200640 1 -- 172.21.15.8:0/597364627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f461c109650 msgr2=0x7f461c109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.859+0000 7f461b200640 1 --2- 172.21.15.8:0/597364627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f461c109650 0x7f461c109a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f460c009930 tx=0x7f460c02bc20 comp rx=0 tx=0).stop 2024-03-16T21:04:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.859+0000 7f461b200640 1 -- 172.21.15.8:0/597364627 shutdown_connections 2024-03-16T21:04:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.859+0000 7f461b200640 1 --2- 172.21.15.8:0/597364627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c103f50 0x7f461c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.859+0000 7f461b200640 1 --2- 172.21.15.8:0/597364627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c103590 0x7f461c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.859+0000 7f461b200640 1 --2- 172.21.15.8:0/597364627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f461c109650 0x7f461c109a30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.859+0000 7f461b200640 1 -- 172.21.15.8:0/597364627 >> 172.21.15.8:0/597364627 conn(0x7f461c0ff020 msgr2=0x7f461c101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.859+0000 7f461b200640 1 -- 172.21.15.8:0/597364627 shutdown_connections 2024-03-16T21:04:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.859+0000 7f461b200640 1 -- 172.21.15.8:0/597364627 wait complete. 2024-03-16T21:04:23.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.861+0000 7f461b200640 1 Processor -- start 2024-03-16T21:04:23.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.861+0000 7f461b200640 1 -- start start 2024-03-16T21:04:23.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.861+0000 7f461b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c103590 0x7f461c075a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.861+0000 7f461b200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c103f50 0x7f461c075f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.861+0000 7f461b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f461c109650 0x7f461c076480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.861+0000 7f461b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c1aa2a0 con 0x7f461c103590 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.861+0000 7f461b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c1aa3e0 con 0x7f461c109650 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.861+0000 7f461b200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c1aa520 con 0x7f461c103f50 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.862+0000 7f4619e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c103590 0x7f461c075a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.862+0000 7f4619e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c103590 0x7f461c075a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43822/0 (socket says 172.21.15.8:43822) 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.862+0000 7f4619e00640 1 -- 172.21.15.8:0/1496034871 learned_addr learned my addr 172.21.15.8:0/1496034871 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.862+0000 7f4611400640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c103f50 0x7f461c075f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.862+0000 7f461a800640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f461c109650 0x7f461c076480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.862+0000 7f4619e00640 1 -- 172.21.15.8:0/1496034871 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c103f50 msgr2=0x7f461c075f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.862+0000 7f4619e00640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c103f50 0x7f461c075f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.862+0000 7f4619e00640 1 -- 172.21.15.8:0/1496034871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f461c109650 msgr2=0x7f461c076480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.862+0000 7f4619e00640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f461c109650 0x7f461c076480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.862+0000 7f4619e00640 1 -- 172.21.15.8:0/1496034871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614009840 con 0x7f461c103590 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.862+0000 7f4611400640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c103f50 0x7f461c075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:23.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.863+0000 7f4619e00640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c103590 0x7f461c075a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f460c009900 tx=0x7f460c02cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.863+0000 7f4613400640 1 -- 172.21.15.8:0/1496034871 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c004250 con 0x7f461c103590 2024-03-16T21:04:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.863+0000 7f4613400640 1 -- 172.21.15.8:0/1496034871 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f460c0043b0 con 0x7f461c103590 2024-03-16T21:04:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.863+0000 7f461b200640 1 -- 172.21.15.8:0/1496034871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c009560 con 0x7f461c103590 2024-03-16T21:04:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.863+0000 7f4613400640 1 -- 172.21.15.8:0/1496034871 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c003ab0 con 0x7f461c103590 2024-03-16T21:04:23.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.863+0000 7f461b200640 1 -- 172.21.15.8:0/1496034871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c1aaaf0 con 0x7f461c103590 2024-03-16T21:04:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.866+0000 7f4623fbb740 1 Processor -- start 2024-03-16T21:04:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.866+0000 7f4613400640 1 -- 172.21.15.8:0/1496034871 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f460c0053a0 con 0x7f461c103590 2024-03-16T21:04:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.866+0000 7f4623fbb740 1 -- start start 2024-03-16T21:04:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.867+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba5170 0x55bd96ba3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.867+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 0x55bd96ba4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.867+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96bafbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.867+0000 7f4623fbb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd96b13150 con 0x55bd96ba4490 2024-03-16T21:04:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.867+0000 7f4623fbb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd96b10680 con 0x55bd96ba5170 2024-03-16T21:04:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.867+0000 7f4623fbb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd96b0be60 con 0x55bd96bad800 2024-03-16T21:04:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.867+0000 7f4619e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 0x55bd96ba4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.867+0000 7f461a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba5170 0x55bd96ba3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.867+0000 7f4619e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 0x55bd96ba4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43838/0 (socket says 172.21.15.8:43838) 2024-03-16T21:04:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.867+0000 7f4619e00640 1 -- 172.21.15.8:0/1585066678 learned_addr learned my addr 172.21.15.8:0/1585066678 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:23.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.867+0000 7f4611400640 1 --2- 172.21.15.8:0/1585066678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96bafbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f461a800640 1 -- 172.21.15.8:0/1585066678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 msgr2=0x55bd96bafbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f461a800640 1 --2- 172.21.15.8:0/1585066678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96bafbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f461a800640 1 -- 172.21.15.8:0/1585066678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 msgr2=0x55bd96ba4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f461a800640 1 --2- 172.21.15.8:0/1585066678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 0x55bd96ba4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f461a800640 1 -- 172.21.15.8:0/1585066678 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd96ac5060 con 0x55bd96ba5170 2024-03-16T21:04:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f4619e00640 1 --2- 172.21.15.8:0/1585066678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 0x55bd96ba4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f4611400640 1 --2- 172.21.15.8:0/1585066678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96bafbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f461a800640 1 --2- 172.21.15.8:0/1585066678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba5170 0x55bd96ba3ec0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4614011540 tx=0x7f4614011a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=444e66785d1a5359 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f460b400640 1 -- 172.21.15.8:0/1585066678 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614004d20 con 0x55bd96ba5170 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f460b400640 1 -- 172.21.15.8:0/1585066678 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4614004e80 con 0x55bd96ba5170 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f460b400640 1 -- 172.21.15.8:0/1585066678 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461400f840 con 0x55bd96ba5170 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.868+0000 7f4613400640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f46000a1ba0 0x7f46000a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4613400640 1 -- 172.21.15.8:0/1496034871 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f460c0ef6f0 con 0x7f461c103590 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4619e00640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f46000a1ba0 0x7f46000a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4623fbb740 1 -- 172.21.15.8:0/1585066678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba5170 msgr2=0x55bd96ba3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4623fbb740 1 --2- 172.21.15.8:0/1585066678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba5170 0x55bd96ba3ec0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4614011540 tx=0x7f4614011a00 comp rx=0 tx=0).stop 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4623fbb740 1 -- 172.21.15.8:0/1585066678 shutdown_connections 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4623fbb740 1 --2- 172.21.15.8:0/1585066678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96bafbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4623fbb740 1 --2- 172.21.15.8:0/1585066678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 0x55bd96ba4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4623fbb740 1 --2- 172.21.15.8:0/1585066678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba5170 0x55bd96ba3ec0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4623fbb740 1 -- 172.21.15.8:0/1585066678 >> 172.21.15.8:0/1585066678 conn(0x55bd96b6b5a0 msgr2=0x55bd96b9eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4623fbb740 1 -- 172.21.15.8:0/1585066678 shutdown_connections 2024-03-16T21:04:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4623fbb740 1 -- 172.21.15.8:0/1585066678 wait complete. 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.869+0000 7f4619e00640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f46000a1ba0 0x7f46000a4060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f460c0b8da0 tx=0x7f460c0b8040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.870+0000 7f4623fbb740 1 -- start start 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.870+0000 7f4623fbb740 1 Processor -- start 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.870+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba4490 0x55bd96baa810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.870+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96baad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.870+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96bab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.870+0000 7f4623fbb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd96ab0ec0 con 0x55bd96ba5170 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.870+0000 7f4623fbb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd96ab0b60 con 0x55bd96ba4490 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.870+0000 7f4623fbb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd9687a1c0 con 0x55bd96bad800 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.870+0000 7f4623fbb740 10 client.0 _ll_register_callbacks cb 0x55bd96ac4960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f4611400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96baad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f461a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba4490 0x55bd96baa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f4611400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96baad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43844/0 (socket says 172.21.15.8:43844) 2024-03-16T21:04:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f4611400640 1 -- 172.21.15.8:0/3428932576 learned_addr learned my addr 172.21.15.8:0/3428932576 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f461a800640 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96bab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f4611400640 1 -- 172.21.15.8:0/3428932576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 msgr2=0x55bd96bab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f4611400640 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96bab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f4611400640 1 -- 172.21.15.8:0/3428932576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba4490 msgr2=0x55bd96baa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f4611400640 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba4490 0x55bd96baa810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f4611400640 1 -- 172.21.15.8:0/3428932576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4614009d80 con 0x55bd96ba5170 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f4611400640 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96baad50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4604012d00 tx=0x7f460400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d62dfa977432ac server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.871+0000 7f45ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.872+0000 7f45ffe00640 1 -- 172.21.15.8:0/3428932576 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604017070 con 0x55bd96ba5170 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.872+0000 7f4623fbb740 1 -- 172.21.15.8:0/3428932576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bd96848720 con 0x55bd96ba5170 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.872+0000 7f45ffe00640 1 -- 172.21.15.8:0/3428932576 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4604009d90 con 0x55bd96ba5170 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.872+0000 7f45ffe00640 1 -- 172.21.15.8:0/3428932576 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46040120d0 con 0x55bd96ba5170 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.872+0000 7f4623fbb740 10 client.16920 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:23.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.872+0000 7f4623fbb740 1 -- 172.21.15.8:0/3428932576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55bd96b0a4e0 con 0x55bd96ba5170 2024-03-16T21:04:23.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.872+0000 7f45ffe00640 1 -- 172.21.15.8:0/3428932576 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55bd96848720 con 0x55bd96ba5170 2024-03-16T21:04:23.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.873+0000 7f45ffe00640 1 -- 172.21.15.8:0/3428932576 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f4604010550 con 0x55bd96ba5170 2024-03-16T21:04:23.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.873+0000 7f4623fbb740 10 client.16920 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.873+0000 7f4623fbb740 10 client.16920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.873+0000 7f4623fbb740 20 client.16920 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.873+0000 7f4623fbb740 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd96bbd990 0x55bd96bbfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.873+0000 7f4623fbb740 4 client.16920 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.873+0000 7f4623fbb740 1 -- 172.21.15.8:0/3428932576 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bd96897890 con 0x55bd96bbd990 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.873+0000 7f461a800640 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd96bbd990 0x55bd96bbfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.874+0000 7f461a800640 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd96bbd990 0x55bd96bbfdb0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b589aad1ec379e1b server_cookie=1c0fe2e73db46bdb in_seq=0 out_seq=0 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.874+0000 7f45ffe00640 10 client.16920 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.874+0000 7f45ffe00640 1 -- 172.21.15.8:0/3428932576 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55bd96897890 con 0x55bd96bbd990 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.874+0000 7f45ffe00640 10 client.16920 handle_command_reply: tid=0 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 1 client.16920 shutdown 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 1 -- 172.21.15.8:0/3428932576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 msgr2=0x55bd96baad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96baad50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4604012d00 tx=0x7f460400f790 comp rx=0 tx=0).stop 2024-03-16T21:04:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 1 -- 172.21.15.8:0/3428932576 shutdown_connections 2024-03-16T21:04:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96bab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd96bbd990 0x55bd96bbfdb0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96baad50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 1 --2- 172.21.15.8:0/3428932576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba4490 0x55bd96baa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 1 -- 172.21.15.8:0/3428932576 >> 172.21.15.8:0/3428932576 conn(0x55bd96b6b5a0 msgr2=0x55bd96ba0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f45ffe00640 0 client.16920 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 1 -- 172.21.15.8:0/3428932576 shutdown_connections 2024-03-16T21:04:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 1 -- 172.21.15.8:0/3428932576 wait complete. 2024-03-16T21:04:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.875+0000 7f4623fbb740 20 client.16920 trim_cache size 0 max 16384 2024-03-16T21:04:23.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.893+0000 7f4623fbb740 1 Processor -- start 2024-03-16T21:04:23.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.893+0000 7f4623fbb740 1 -- start start 2024-03-16T21:04:23.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.893+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 0x55bd96bacf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96ba5170 0x55bd96bab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96bad800 0x55bd96ba09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f4623fbb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd96ba8d80 con 0x55bd96ba4490 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f4623fbb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd96b9e6e0 con 0x55bd96bad800 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f4623fbb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd96bab5f0 con 0x55bd96ba5170 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f461a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 0x55bd96bacf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f4611400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96ba5170 0x55bd96bab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f461a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 0x55bd96bacf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43848/0 (socket says 172.21.15.8:43848) 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f461a800640 1 -- 172.21.15.8:0/1731433161 learned_addr learned my addr 172.21.15.8:0/1731433161 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f461a800640 1 --2- 172.21.15.8:0/1731433161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96bad800 0x55bd96ba09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f4611400640 1 -- 172.21.15.8:0/1731433161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96bad800 msgr2=0x55bd96ba09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f4611400640 1 --2- 172.21.15.8:0/1731433161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96bad800 0x55bd96ba09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f4611400640 1 -- 172.21.15.8:0/1731433161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 msgr2=0x55bd96bacf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f4611400640 1 --2- 172.21.15.8:0/1731433161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 0x55bd96bacf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.894+0000 7f4611400640 1 -- 172.21.15.8:0/1731433161 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd96aa6950 con 0x55bd96ba5170 2024-03-16T21:04:23.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.895+0000 7f4611400640 1 --2- 172.21.15.8:0/1731433161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96ba5170 0x55bd96bab0b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4604010930 tx=0x7f4604009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fbad46426b1e949 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.895+0000 7f460aa00640 1 -- 172.21.15.8:0/1731433161 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604017040 con 0x55bd96ba5170 2024-03-16T21:04:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.895+0000 7f460aa00640 1 -- 172.21.15.8:0/1731433161 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4604009ed0 con 0x55bd96ba5170 2024-03-16T21:04:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.895+0000 7f460aa00640 1 -- 172.21.15.8:0/1731433161 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604010ea0 con 0x55bd96ba5170 2024-03-16T21:04:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.895+0000 7f4623fbb740 1 -- 172.21.15.8:0/1731433161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96ba5170 msgr2=0x55bd96bab0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.895+0000 7f4623fbb740 1 --2- 172.21.15.8:0/1731433161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96ba5170 0x55bd96bab0b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4604010930 tx=0x7f4604009c00 comp rx=0 tx=0).stop 2024-03-16T21:04:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.895+0000 7f4623fbb740 1 -- 172.21.15.8:0/1731433161 shutdown_connections 2024-03-16T21:04:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.895+0000 7f4623fbb740 1 --2- 172.21.15.8:0/1731433161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96bad800 0x55bd96ba09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.895+0000 7f4623fbb740 1 --2- 172.21.15.8:0/1731433161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96ba5170 0x55bd96bab0b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.895+0000 7f4623fbb740 1 --2- 172.21.15.8:0/1731433161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba4490 0x55bd96bacf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.895+0000 7f4623fbb740 1 -- 172.21.15.8:0/1731433161 >> 172.21.15.8:0/1731433161 conn(0x55bd96b6b5a0 msgr2=0x55bd96ba02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.896+0000 7f4623fbb740 1 -- 172.21.15.8:0/1731433161 shutdown_connections 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.896+0000 7f4623fbb740 1 -- 172.21.15.8:0/1731433161 wait complete. 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.896+0000 7f4623fbb740 1 -- start start 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.896+0000 7f4623fbb740 1 Processor -- start 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba4490 0x55bd96baf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96ba6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4623fbb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96ba6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4623fbb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd96ba7690 con 0x55bd96ba5170 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4623fbb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd96ba7800 con 0x55bd96ba4490 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4623fbb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd96ba79c0 con 0x55bd96bad800 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4623fbb740 10 client.0 _ll_register_callbacks cb 0x7f4604012910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4611400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96ba6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4611400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96ba6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43860/0 (socket says 172.21.15.8:43860) 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f461a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba4490 0x55bd96baf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4611400640 1 -- 172.21.15.8:0/2549777317 learned_addr learned my addr 172.21.15.8:0/2549777317 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f461a800640 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96ba6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4611400640 1 -- 172.21.15.8:0/2549777317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 msgr2=0x55bd96ba6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4611400640 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96ba6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4611400640 1 -- 172.21.15.8:0/2549777317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba4490 msgr2=0x55bd96baf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4611400640 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba4490 0x55bd96baf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.897+0000 7f4611400640 1 -- 172.21.15.8:0/2549777317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd96b0a4e0 con 0x55bd96ba5170 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.898+0000 7f4611400640 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96ba6aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4604010a00 tx=0x7f4604005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c615632233f3146 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.898+0000 7f45ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.898+0000 7f45ffe00640 1 -- 172.21.15.8:0/2549777317 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604017070 con 0x55bd96ba5170 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.898+0000 7f45ffe00640 1 -- 172.21.15.8:0/2549777317 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4604000e40 con 0x55bd96ba5170 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.898+0000 7f4623fbb740 1 -- 172.21.15.8:0/2549777317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bd96ba4e10 con 0x55bd96ba5170 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.898+0000 7f45ffe00640 1 -- 172.21.15.8:0/2549777317 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4604012280 con 0x55bd96ba5170 2024-03-16T21:04:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.898+0000 7f4623fbb740 10 client.16926 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.898+0000 7f4623fbb740 1 -- 172.21.15.8:0/2549777317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55bd96acc430 con 0x55bd96ba5170 2024-03-16T21:04:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.899+0000 7f45ffe00640 1 -- 172.21.15.8:0/2549777317 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f460403b020 con 0x55bd96ba5170 2024-03-16T21:04:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.899+0000 7f45ffe00640 1 -- 172.21.15.8:0/2549777317 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f4604003b80 con 0x55bd96ba5170 2024-03-16T21:04:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.899+0000 7f4623fbb740 10 client.16926 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.899+0000 7f4623fbb740 10 client.16926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.899+0000 7f4623fbb740 20 client.16926 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.899+0000 7f4623fbb740 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd96c1a490 0x55bd96c1c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.899+0000 7f4623fbb740 4 client.16926 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:04:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.899+0000 7f4623fbb740 1 -- 172.21.15.8:0/2549777317 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bd9680b7e0 con 0x55bd96c1a490 2024-03-16T21:04:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.899+0000 7f461a800640 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd96c1a490 0x55bd96c1c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:23.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f461a800640 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd96c1a490 0x55bd96c1c880 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4b3100d1cfcb56c server_cookie=b8a068a5f3edfc8e in_seq=0 out_seq=0 2024-03-16T21:04:23.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f45ffe00640 10 client.16926 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:23.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f45ffe00640 1 -- 172.21.15.8:0/2549777317 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55bd9680b7e0 con 0x55bd96c1a490 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f45ffe00640 10 client.16926 handle_command_reply: tid=0 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 1 client.16926 shutdown 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 1 -- 172.21.15.8:0/2549777317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 msgr2=0x55bd96ba6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96ba6aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4604010a00 tx=0x7f4604005270 comp rx=0 tx=0).stop 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 1 -- 172.21.15.8:0/2549777317 shutdown_connections 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd96bad800 0x55bd96ba6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd96c1a490 0x55bd96c1c880 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd96ba5170 0x55bd96ba6aa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 1 --2- 172.21.15.8:0/2549777317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd96ba4490 0x55bd96baf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 1 -- 172.21.15.8:0/2549777317 >> 172.21.15.8:0/2549777317 conn(0x55bd96b6b5a0 msgr2=0x55bd96b9df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f45ffe00640 0 client.16926 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 1 -- 172.21.15.8:0/2549777317 shutdown_connections 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 1 -- 172.21.15.8:0/2549777317 wait complete. 2024-03-16T21:04:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.900+0000 7f4623fbb740 20 client.16926 trim_cache size 0 max 16384 2024-03-16T21:04:23.911 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:04:23.911 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:04:23.911 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:04:23.911 INFO:teuthology.orchestra.run.smithi008.stdout: "be43a117-686f-4b21-8fb3-033815526d32": { 2024-03-16T21:04:23.911 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:04:23.911 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "be43a117-686f-4b21-8fb3-033815526d32", 2024-03-16T21:04:23.911 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:04:23.911 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:04:23.911 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:04:23.911 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:04:23.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 -- 172.21.15.8:0/1496034871 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f46000a1ba0 msgr2=0x7f46000a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f46000a1ba0 0x7f46000a4060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f460c0b8da0 tx=0x7f460c0b8040 comp rx=0 tx=0).stop 2024-03-16T21:04:23.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 -- 172.21.15.8:0/1496034871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c103590 msgr2=0x7f461c075a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:23.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c103590 0x7f461c075a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f460c009900 tx=0x7f460c02cc10 comp rx=0 tx=0).stop 2024-03-16T21:04:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 -- 172.21.15.8:0/1496034871 shutdown_connections 2024-03-16T21:04:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f46000a1ba0 0x7f46000a4060 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f461c109650 0x7f461c076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c103f50 0x7f461c075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 --2- 172.21.15.8:0/1496034871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c103590 0x7f461c075a00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 -- 172.21.15.8:0/1496034871 >> 172.21.15.8:0/1496034871 conn(0x7f461c0ff020 msgr2=0x7f461c1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 -- 172.21.15.8:0/1496034871 shutdown_connections 2024-03-16T21:04:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:23.901+0000 7f461b200640 1 -- 172.21.15.8:0/1496034871 wait complete. 2024-03-16T21:04:23.926 INFO:tasks.cephfs.filesystem:scrub status for tag:be43a117-686f-4b21-8fb3-033815526d32 - {'path': '/', 'tag': 'be43a117-686f-4b21-8fb3-033815526d32', 'options': 'recursive,force'} 2024-03-16T21:04:23.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:23 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:04:23.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:23 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:23.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:23 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:04:23.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:23 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:24.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:23 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:04:24.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:23 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:24.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:23 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:04:24.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:23 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:24.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:23 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:04:24.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:23 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:24.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:23 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:04:24.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:23 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:25.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:24 smithi008 ceph-mon[31434]: pgmap v202: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-03-16T21:04:25.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:24 smithi170 ceph-mon[35947]: pgmap v202: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-03-16T21:04:25.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:24 smithi186 ceph-mon[36391]: pgmap v202: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-03-16T21:04:27.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:26 smithi008 ceph-mon[31434]: pgmap v203: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:04:27.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:26 smithi170 ceph-mon[35947]: pgmap v203: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:04:27.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:26 smithi186 ceph-mon[36391]: pgmap v203: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:04:28.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:27 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:04:28.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:27 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:04:28.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:27 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:04:29.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:28 smithi008 ceph-mon[31434]: pgmap v204: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-16T21:04:29.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:28 smithi170 ceph-mon[35947]: pgmap v204: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-16T21:04:29.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:28 smithi186 ceph-mon[36391]: pgmap v204: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-16T21:04:31.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:30 smithi008 ceph-mon[31434]: pgmap v205: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:04:31.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:30 smithi170 ceph-mon[35947]: pgmap v205: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:04:31.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:30 smithi186 ceph-mon[36391]: pgmap v205: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:04:33.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:32 smithi008 ceph-mon[31434]: pgmap v206: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:04:33.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:32 smithi170 ceph-mon[35947]: pgmap v206: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:04:33.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:32 smithi186 ceph-mon[36391]: pgmap v206: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:04:35.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:34 smithi008 ceph-mon[31434]: pgmap v207: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:04:35.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:34 smithi170 ceph-mon[35947]: pgmap v207: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:04:35.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:34 smithi186 ceph-mon[36391]: pgmap v207: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:04:37.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:36 smithi008 ceph-mon[31434]: pgmap v208: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:04:37.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:36 smithi170 ceph-mon[35947]: pgmap v208: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:04:37.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:36 smithi186 ceph-mon[36391]: pgmap v208: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:04:39.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:38 smithi008 ceph-mon[31434]: pgmap v209: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-16T21:04:39.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:38 smithi170 ceph-mon[35947]: pgmap v209: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-16T21:04:39.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:38 smithi186 ceph-mon[36391]: pgmap v209: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-16T21:04:41.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:40 smithi008 ceph-mon[31434]: pgmap v210: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:41.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:40 smithi170 ceph-mon[35947]: pgmap v210: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:41.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:40 smithi186 ceph-mon[36391]: pgmap v210: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:43.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:42 smithi170 ceph-mon[35947]: pgmap v211: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:04:43.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:42 smithi186 ceph-mon[36391]: pgmap v211: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:04:43.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:42 smithi008 ceph-mon[31434]: pgmap v211: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:04:45.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:45 smithi170 ceph-mon[35947]: pgmap v212: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:45.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:45 smithi186 ceph-mon[36391]: pgmap v212: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:45.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:45 smithi008 ceph-mon[31434]: pgmap v212: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:47.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:47 smithi170 ceph-mon[35947]: pgmap v213: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:04:47.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:47 smithi186 ceph-mon[36391]: pgmap v213: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:04:47.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:47 smithi008 ceph-mon[31434]: pgmap v213: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:04:49.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:49 smithi170 ceph-mon[35947]: pgmap v214: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:04:49.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:49 smithi186 ceph-mon[36391]: pgmap v214: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:04:49.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:49 smithi008 ceph-mon[31434]: pgmap v214: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:04:51.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:51 smithi170 ceph-mon[35947]: pgmap v215: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:51.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:51 smithi186 ceph-mon[36391]: pgmap v215: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:51.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:51 smithi008 ceph-mon[31434]: pgmap v215: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:53.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:53 smithi170 ceph-mon[35947]: pgmap v216: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:04:53.498 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:53 smithi008 ceph-mon[31434]: pgmap v216: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:04:53.499 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:53 smithi186 ceph-mon[36391]: pgmap v216: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:04:53.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:04:53.927 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:04:54.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.163+0000 7f489e800640 1 -- 172.21.15.8:0/1301561750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4898103590 msgr2=0x7f4898103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.163+0000 7f489e800640 1 --2- 172.21.15.8:0/1301561750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4898103590 0x7f4898103a10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4884009930 tx=0x7f488402bc20 comp rx=0 tx=0).stop 2024-03-16T21:04:54.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.163+0000 7f489e800640 1 -- 172.21.15.8:0/1301561750 shutdown_connections 2024-03-16T21:04:54.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.163+0000 7f489e800640 1 --2- 172.21.15.8:0/1301561750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4898103f50 0x7f4898110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.163+0000 7f489e800640 1 --2- 172.21.15.8:0/1301561750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4898103590 0x7f4898103a10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.163+0000 7f489e800640 1 --2- 172.21.15.8:0/1301561750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4898109650 0x7f4898109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.163+0000 7f489e800640 1 -- 172.21.15.8:0/1301561750 >> 172.21.15.8:0/1301561750 conn(0x7f48980ff020 msgr2=0x7f4898101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.163+0000 7f489e800640 1 -- 172.21.15.8:0/1301561750 shutdown_connections 2024-03-16T21:04:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.163+0000 7f489e800640 1 -- 172.21.15.8:0/1301561750 wait complete. 2024-03-16T21:04:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.164+0000 7f489e800640 1 Processor -- start 2024-03-16T21:04:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.164+0000 7f489e800640 1 -- start start 2024-03-16T21:04:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4898103590 0x7f489819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4898103f50 0x7f489819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4898109650 0x7f4898199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489e800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489819a130 con 0x7f4898109650 2024-03-16T21:04:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489e800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489819a2a0 con 0x7f4898103590 2024-03-16T21:04:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489e800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489819a460 con 0x7f4898103f50 2024-03-16T21:04:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489ca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4898103f50 0x7f489819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489ca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4898103f50 0x7f489819fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47400/0 (socket says 172.21.15.8:47400) 2024-03-16T21:04:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489ca00640 1 -- 172.21.15.8:0/3623781337 learned_addr learned my addr 172.21.15.8:0/3623781337 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:54.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489d400640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4898103590 0x7f489819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489de00640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4898109650 0x7f4898199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489ca00640 1 -- 172.21.15.8:0/3623781337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4898103590 msgr2=0x7f489819f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489ca00640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4898103590 0x7f489819f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489ca00640 1 -- 172.21.15.8:0/3623781337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4898109650 msgr2=0x7f4898199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489ca00640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4898109650 0x7f4898199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.165+0000 7f489ca00640 1 -- 172.21.15.8:0/3623781337 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884009560 con 0x7f4898103f50 2024-03-16T21:04:54.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.166+0000 7f489ca00640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4898103f50 0x7f489819fe20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4884005ab0 tx=0x7f488402ce40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.166+0000 7f4896000640 1 -- 172.21.15.8:0/3623781337 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48840042d0 con 0x7f4898103f50 2024-03-16T21:04:54.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.166+0000 7f4896000640 1 -- 172.21.15.8:0/3623781337 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4884004430 con 0x7f4898103f50 2024-03-16T21:04:54.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.166+0000 7f4896000640 1 -- 172.21.15.8:0/3623781337 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884003d30 con 0x7f4898103f50 2024-03-16T21:04:54.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.166+0000 7f489e800640 1 -- 172.21.15.8:0/3623781337 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489819a6e0 con 0x7f4898103f50 2024-03-16T21:04:54.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.166+0000 7f489e800640 1 -- 172.21.15.8:0/3623781337 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48981a6980 con 0x7f4898103f50 2024-03-16T21:04:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.169+0000 7f4896000640 1 -- 172.21.15.8:0/3623781337 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f4884004e10 con 0x7f4898103f50 2024-03-16T21:04:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f48a2bdb740 1 Processor -- start 2024-03-16T21:04:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f48a2bdb740 1 -- start start 2024-03-16T21:04:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 0x563dff151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff152910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff15dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff0c1150 con 0x563dff15b800 2024-03-16T21:04:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff0be680 con 0x563dff153170 2024-03-16T21:04:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff0b9e60 con 0x563dff152490 2024-03-16T21:04:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f489de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 0x563dff151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f489d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f489ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff15dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f489de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 0x563dff151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37660/0 (socket says 172.21.15.8:37660) 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f489d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47414/0 (socket says 172.21.15.8:47414) 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.170+0000 7f489de00640 1 -- 172.21.15.8:0/3107481530 learned_addr learned my addr 172.21.15.8:0/3107481530 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.171+0000 7f489de00640 1 -- 172.21.15.8:0/3107481530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 msgr2=0x563dff152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.171+0000 7f489de00640 1 --2- 172.21.15.8:0/3107481530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.171+0000 7f489de00640 1 -- 172.21.15.8:0/3107481530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 msgr2=0x563dff15dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.171+0000 7f489de00640 1 --2- 172.21.15.8:0/3107481530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff15dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.171+0000 7f489de00640 1 -- 172.21.15.8:0/3107481530 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dff073060 con 0x563dff153170 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.171+0000 7f489d400640 1 --2- 172.21.15.8:0/3107481530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.171+0000 7f4896000640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f487c0a1c20 0x7f487c0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.171+0000 7f489de00640 1 --2- 172.21.15.8:0/3107481530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 0x563dff151ec0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f489000b700 tx=0x7f489000bbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34f2cbcf8c7eaae server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.171+0000 7f489d400640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f487c0a1c20 0x7f487c0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.171+0000 7f4896000640 1 -- 172.21.15.8:0/3623781337 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f48840efce0 con 0x7f4898103f50 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.172+0000 7f488e600640 1 -- 172.21.15.8:0/3107481530 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890003dd0 con 0x563dff153170 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.172+0000 7f488e600640 1 -- 172.21.15.8:0/3107481530 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f489000be10 con 0x563dff153170 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.172+0000 7f488e600640 1 -- 172.21.15.8:0/3107481530 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890010840 con 0x563dff153170 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.172+0000 7f48a2bdb740 1 -- 172.21.15.8:0/3107481530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 msgr2=0x563dff151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.172+0000 7f489d400640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f487c0a1c20 0x7f487c0a40e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x563dff1536c0 tx=0x7f4888009680 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.172+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/3107481530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 0x563dff151ec0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f489000b700 tx=0x7f489000bbc0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.173+0000 7f48a2bdb740 1 -- 172.21.15.8:0/3107481530 shutdown_connections 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.173+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/3107481530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff15dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.173+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/3107481530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.173+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/3107481530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 0x563dff151ec0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.173+0000 7f48a2bdb740 1 -- 172.21.15.8:0/3107481530 >> 172.21.15.8:0/3107481530 conn(0x563dff1195a0 msgr2=0x563dff14cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.173+0000 7f48a2bdb740 1 -- 172.21.15.8:0/3107481530 shutdown_connections 2024-03-16T21:04:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.173+0000 7f48a2bdb740 1 -- 172.21.15.8:0/3107481530 wait complete. 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.173+0000 7f48a2bdb740 1 -- start start 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.173+0000 7f48a2bdb740 1 Processor -- start 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff158840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 0x563dff158d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff05eec0 con 0x563dff15b800 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff05eb60 con 0x563dff153170 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dfee281c0 con 0x563dff152490 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f48a2bdb740 10 client.0 _ll_register_callbacks cb 0x563dff072960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f489d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f489d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47422/0 (socket says 172.21.15.8:47422) 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f489d400640 1 -- 172.21.15.8:0/862273874 learned_addr learned my addr 172.21.15.8:0/862273874 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f489de00640 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f489ca00640 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 0x563dff158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f489d400640 1 -- 172.21.15.8:0/862273874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 msgr2=0x563dff158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f489d400640 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 0x563dff158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f489d400640 1 -- 172.21.15.8:0/862273874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 msgr2=0x563dff1592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f489d400640 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff1592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.174+0000 7f489d400640 1 -- 172.21.15.8:0/862273874 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4890004370 con 0x563dff152490 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.175+0000 7f489d400640 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff158840 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4888013c50 tx=0x7f4888004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45e68b21add7aa7b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.175+0000 7f4882a00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.175+0000 7f4882a00640 1 -- 172.21.15.8:0/862273874 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888009d10 con 0x563dff152490 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.175+0000 7f4882a00640 1 -- 172.21.15.8:0/862273874 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4888013c80 con 0x563dff152490 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.175+0000 7f48a2bdb740 1 -- 172.21.15.8:0/862273874 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563dfedb97e0 con 0x563dff152490 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.175+0000 7f4882a00640 1 -- 172.21.15.8:0/862273874 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f488802f460 con 0x563dff152490 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.175+0000 7f48a2bdb740 10 client.27124 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.175+0000 7f48a2bdb740 1 -- 172.21.15.8:0/862273874 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x563dff0b84e0 con 0x563dff152490 2024-03-16T21:04:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.176+0000 7f4882a00640 1 -- 172.21.15.8:0/862273874 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x563dfedb97e0 con 0x563dff152490 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.176+0000 7f4882a00640 1 -- 172.21.15.8:0/862273874 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f4888026780 con 0x563dff152490 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.176+0000 7f48a2bdb740 10 client.27124 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.176+0000 7f48a2bdb740 10 client.27124 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.176+0000 7f48a2bdb740 20 client.27124 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.176+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563dff16ba30 0x563dff16de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.176+0000 7f48a2bdb740 4 client.27124 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.176+0000 7f48a2bdb740 1 -- 172.21.15.8:0/862273874 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563dfedf6720 con 0x563dff16ba30 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.176+0000 7f489ca00640 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563dff16ba30 0x563dff16de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.177+0000 7f489ca00640 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563dff16ba30 0x563dff16de50 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45cae5f780556e3b server_cookie=a3522d3bc2e93a6a in_seq=0 out_seq=0 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.177+0000 7f4882a00640 10 client.27124 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.177+0000 7f4882a00640 1 -- 172.21.15.8:0/862273874 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563dfedf6720 con 0x563dff16ba30 2024-03-16T21:04:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.177+0000 7f4882a00640 10 client.27124 handle_command_reply: tid=0 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 1 client.27124 shutdown 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 1 -- 172.21.15.8:0/862273874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 msgr2=0x563dff158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff158840 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4888013c50 tx=0x7f4888004a40 comp rx=0 tx=0).stop 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 1 -- 172.21.15.8:0/862273874 shutdown_connections 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563dff16ba30 0x563dff16de50 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff1592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff153170 0x563dff158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/862273874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff152490 0x563dff158840 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f4882a00640 0 client.27124 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 1 -- 172.21.15.8:0/862273874 >> 172.21.15.8:0/862273874 conn(0x563dff1195a0 msgr2=0x563dff14ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 1 -- 172.21.15.8:0/862273874 shutdown_connections 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 1 -- 172.21.15.8:0/862273874 wait complete. 2024-03-16T21:04:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.178+0000 7f48a2bdb740 20 client.27124 trim_cache size 0 max 16384 2024-03-16T21:04:54.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.196+0000 7f48a2bdb740 1 Processor -- start 2024-03-16T21:04:54.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.196+0000 7f48a2bdb740 1 -- start start 2024-03-16T21:04:54.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.196+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff152490 0x563dff15af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.196+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 0x563dff1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.196+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff15b800 0x563dff14e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.196+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff153550 con 0x563dff152490 2024-03-16T21:04:54.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.196+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff152e10 con 0x563dff15b800 2024-03-16T21:04:54.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.196+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff15dfc0 con 0x563dff153170 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489ca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 0x563dff1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff152490 0x563dff15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489ca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 0x563dff1590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47436/0 (socket says 172.21.15.8:47436) 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489ca00640 1 -- 172.21.15.8:0/3877614539 learned_addr learned my addr 172.21.15.8:0/3877614539 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489de00640 1 --2- 172.21.15.8:0/3877614539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff15b800 0x563dff14e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489ca00640 1 -- 172.21.15.8:0/3877614539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff15b800 msgr2=0x563dff14e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489ca00640 1 --2- 172.21.15.8:0/3877614539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff15b800 0x563dff14e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489ca00640 1 -- 172.21.15.8:0/3877614539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff152490 msgr2=0x563dff15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489ca00640 1 --2- 172.21.15.8:0/3877614539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff152490 0x563dff15af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489ca00640 1 -- 172.21.15.8:0/3877614539 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dff154480 con 0x563dff153170 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489d400640 1 --2- 172.21.15.8:0/3877614539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff152490 0x563dff15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489de00640 1 --2- 172.21.15.8:0/3877614539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff15b800 0x563dff14e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f489ca00640 1 --2- 172.21.15.8:0/3877614539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 0x563dff1590b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4884032040 tx=0x7f48840f3750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb7b410163e7f025 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.197+0000 7f488dc00640 1 -- 172.21.15.8:0/3877614539 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48840dc040 con 0x563dff153170 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.198+0000 7f488dc00640 1 -- 172.21.15.8:0/3877614539 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f48840bc820 con 0x563dff153170 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.198+0000 7f488dc00640 1 -- 172.21.15.8:0/3877614539 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48840bca50 con 0x563dff153170 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.198+0000 7f48a2bdb740 1 -- 172.21.15.8:0/3877614539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 msgr2=0x563dff1590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.198+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/3877614539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 0x563dff1590b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4884032040 tx=0x7f48840f3750 comp rx=0 tx=0).stop 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.198+0000 7f48a2bdb740 1 -- 172.21.15.8:0/3877614539 shutdown_connections 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.198+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/3877614539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff15b800 0x563dff14e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.198+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/3877614539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 0x563dff1590b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.198+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/3877614539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff152490 0x563dff15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.198+0000 7f48a2bdb740 1 -- 172.21.15.8:0/3877614539 >> 172.21.15.8:0/3877614539 conn(0x563dff1195a0 msgr2=0x563dff14e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.198+0000 7f48a2bdb740 1 -- 172.21.15.8:0/3877614539 shutdown_connections 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.198+0000 7f48a2bdb740 1 -- 172.21.15.8:0/3877614539 wait complete. 2024-03-16T21:04:54.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.199+0000 7f48a2bdb740 1 -- start start 2024-03-16T21:04:54.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.199+0000 7f48a2bdb740 1 Processor -- start 2024-03-16T21:04:54.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.199+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff152490 0x563dff155e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.199+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 0x563dff156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.199+0000 7f48a2bdb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.199+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff15cd00 con 0x563dff15b800 2024-03-16T21:04:54.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.199+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff15ce70 con 0x563dff152490 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.199+0000 7f48a2bdb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff15d030 con 0x563dff153170 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.199+0000 7f48a2bdb740 10 client.0 _ll_register_callbacks cb 0x7f4888013800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff152490 0x563dff155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489ca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 0x563dff156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff152490 0x563dff155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37688/0 (socket says 172.21.15.8:37688) 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489d400640 1 -- 172.21.15.8:0/1669843968 learned_addr learned my addr 172.21.15.8:0/1669843968 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489d400640 1 -- 172.21.15.8:0/1669843968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 msgr2=0x563dff156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489d400640 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 0x563dff156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489d400640 1 -- 172.21.15.8:0/1669843968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 msgr2=0x563dff15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489d400640 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489d400640 1 -- 172.21.15.8:0/1669843968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563dff0b84e0 con 0x563dff152490 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489ca00640 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 0x563dff156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489de00640 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f489d400640 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff152490 0x563dff155e10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4888013c20 tx=0x7f4888004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1021c151f01683 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.200+0000 7f4882a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f4882a00640 1 -- 172.21.15.8:0/1669843968 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48880267f0 con 0x563dff152490 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f4882a00640 1 -- 172.21.15.8:0/1669843968 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4888013e40 con 0x563dff152490 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f48a2bdb740 1 -- 172.21.15.8:0/1669843968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f489000be10 con 0x563dff152490 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f4882a00640 1 -- 172.21.15.8:0/1669843968 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4888026950 con 0x563dff152490 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f48a2bdb740 10 client.27125 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f48a2bdb740 1 -- 172.21.15.8:0/1669843968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f48981a6980 con 0x563dff152490 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f4882a00640 1 -- 172.21.15.8:0/1669843968 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f489000be10 con 0x563dff152490 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f4882a00640 1 -- 172.21.15.8:0/1669843968 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f4888005800 con 0x563dff152490 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f48a2bdb740 10 client.27125 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:54.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f48a2bdb740 10 client.27125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:54.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f48a2bdb740 20 client.27125 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:54.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.201+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563dff1c84e0 0x563dff1ca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.202+0000 7f48a2bdb740 4 client.27125 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:04:54.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.202+0000 7f48a2bdb740 1 -- 172.21.15.8:0/1669843968 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563dfee45890 con 0x563dff1c84e0 2024-03-16T21:04:54.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.202+0000 7f489ca00640 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563dff1c84e0 0x563dff1ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.202+0000 7f489ca00640 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563dff1c84e0 0x563dff1ca900 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=165f31dfae0a635a server_cookie=4c3df661befe717c in_seq=0 out_seq=0 2024-03-16T21:04:54.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.202+0000 7f4882a00640 10 client.27125 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:54.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.202+0000 7f4882a00640 1 -- 172.21.15.8:0/1669843968 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563dfee45890 con 0x563dff1c84e0 2024-03-16T21:04:54.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.202+0000 7f4882a00640 10 client.27125 handle_command_reply: tid=0 2024-03-16T21:04:54.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.202+0000 7f48a2bdb740 1 client.27125 shutdown 2024-03-16T21:04:54.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f48a2bdb740 1 -- 172.21.15.8:0/1669843968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff152490 msgr2=0x563dff155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff152490 0x563dff155e10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4888013c20 tx=0x7f4888004f90 comp rx=0 tx=0).stop 2024-03-16T21:04:54.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f48a2bdb740 1 -- 172.21.15.8:0/1669843968 shutdown_connections 2024-03-16T21:04:54.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563dff1c84e0 0x563dff1ca900 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dff15b800 0x563dff15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563dff153170 0x563dff156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f4882a00640 0 client.27125 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:54.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f48a2bdb740 1 --2- 172.21.15.8:0/1669843968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563dff152490 0x563dff155e10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f48a2bdb740 1 -- 172.21.15.8:0/1669843968 >> 172.21.15.8:0/1669843968 conn(0x563dff1195a0 msgr2=0x563dff14bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f48a2bdb740 1 -- 172.21.15.8:0/1669843968 shutdown_connections 2024-03-16T21:04:54.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f48a2bdb740 1 -- 172.21.15.8:0/1669843968 wait complete. 2024-03-16T21:04:54.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.203+0000 7f48a2bdb740 20 client.27125 trim_cache size 0 max 16384 2024-03-16T21:04:54.215 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:04:54.215 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:04:54.215 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:04:54.215 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:04:54.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 -- 172.21.15.8:0/3623781337 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f487c0a1c20 msgr2=0x7f487c0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f487c0a1c20 0x7f487c0a40e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x563dff1536c0 tx=0x7f4888009680 comp rx=0 tx=0).stop 2024-03-16T21:04:54.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 -- 172.21.15.8:0/3623781337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4898103f50 msgr2=0x7f489819fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4898103f50 0x7f489819fe20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4884005ab0 tx=0x7f488402ce40 comp rx=0 tx=0).stop 2024-03-16T21:04:54.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 -- 172.21.15.8:0/3623781337 shutdown_connections 2024-03-16T21:04:54.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f487c0a1c20 0x7f487c0a40e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4898109650 0x7f4898199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4898103f50 0x7f489819fe20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 --2- 172.21.15.8:0/3623781337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4898103590 0x7f489819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 -- 172.21.15.8:0/3623781337 >> 172.21.15.8:0/3623781337 conn(0x7f48980ff020 msgr2=0x7f4898100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 -- 172.21.15.8:0/3623781337 shutdown_connections 2024-03-16T21:04:54.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.204+0000 7f489e800640 1 -- 172.21.15.8:0/3623781337 wait complete. 2024-03-16T21:04:54.226 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:04:54.226 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:04:54.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.442+0000 7fd63d400640 1 -- 172.21.15.8:0/1890741751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638103080 msgr2=0x7fd63810b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.442+0000 7fd63d400640 1 --2- 172.21.15.8:0/1890741751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638103080 0x7fd63810b560 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd620009ca0 tx=0x7fd62002c210 comp rx=0 tx=0).stop 2024-03-16T21:04:54.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.442+0000 7fd63d400640 1 -- 172.21.15.8:0/1890741751 shutdown_connections 2024-03-16T21:04:54.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.442+0000 7fd63d400640 1 --2- 172.21.15.8:0/1890741751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd63810baa0 0x7fd63810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.442+0000 7fd63d400640 1 --2- 172.21.15.8:0/1890741751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638103080 0x7fd63810b560 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.442+0000 7fd63d400640 1 --2- 172.21.15.8:0/1890741751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd638102760 0x7fd638102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.442+0000 7fd63d400640 1 -- 172.21.15.8:0/1890741751 >> 172.21.15.8:0/1890741751 conn(0x7fd638076770 msgr2=0x7fd638076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.442+0000 7fd63d400640 1 -- 172.21.15.8:0/1890741751 shutdown_connections 2024-03-16T21:04:54.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.442+0000 7fd63d400640 1 -- 172.21.15.8:0/1890741751 wait complete. 2024-03-16T21:04:54.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.443+0000 7fd63d400640 1 Processor -- start 2024-03-16T21:04:54.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd63d400640 1 -- start start 2024-03-16T21:04:54.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd63d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd638102760 0x7fd638199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd63d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638103080 0x7fd63819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd63d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd63810baa0 0x7fd63819e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd63d400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63819ed90 con 0x7fd63810baa0 2024-03-16T21:04:54.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd63d400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63819ef00 con 0x7fd638102760 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd63d400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63819f0c0 con 0x7fd638103080 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd636800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd638102760 0x7fd638199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd62de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638103080 0x7fd63819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd636800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd638102760 0x7fd638199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37700/0 (socket says 172.21.15.8:37700) 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd62de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638103080 0x7fd63819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47460/0 (socket says 172.21.15.8:47460) 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd636800640 1 -- 172.21.15.8:0/1471327638 learned_addr learned my addr 172.21.15.8:0/1471327638 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.444+0000 7fd637200640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd63810baa0 0x7fd63819e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd62de00640 1 -- 172.21.15.8:0/1471327638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd638102760 msgr2=0x7fd638199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd62de00640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd638102760 0x7fd638199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd62de00640 1 -- 172.21.15.8:0/1471327638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd63810baa0 msgr2=0x7fd63819e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd62de00640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd63810baa0 0x7fd63819e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd62de00640 1 -- 172.21.15.8:0/1471327638 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620009900 con 0x7fd638103080 2024-03-16T21:04:54.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd637200640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd63810baa0 0x7fd63819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:04:54.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd636800640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd638102760 0x7fd638199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:54.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd62de00640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638103080 0x7fd63819a410 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd62002c750 tx=0x7fd620034670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd62fe00640 1 -- 172.21.15.8:0/1471327638 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620003b70 con 0x7fd638103080 2024-03-16T21:04:54.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd62fe00640 1 -- 172.21.15.8:0/1471327638 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd620032720 con 0x7fd638103080 2024-03-16T21:04:54.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd62fe00640 1 -- 172.21.15.8:0/1471327638 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620004760 con 0x7fd638103080 2024-03-16T21:04:54.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd63d400640 1 -- 172.21.15.8:0/1471327638 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63819f340 con 0x7fd638103080 2024-03-16T21:04:54.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.445+0000 7fd63d400640 1 -- 172.21.15.8:0/1471327638 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6381a6c20 con 0x7fd638103080 2024-03-16T21:04:54.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.446+0000 7fd63d400640 1 -- 172.21.15.8:0/1471327638 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd638068730 con 0x7fd638103080 2024-03-16T21:04:54.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.448+0000 7fd62fe00640 1 -- 172.21.15.8:0/1471327638 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fd62003b040 con 0x7fd638103080 2024-03-16T21:04:54.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.449+0000 7fd62fe00640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd61c0a1c20 0x7fd61c0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.450+0000 7fd62fe00640 1 -- 172.21.15.8:0/1471327638 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd6200eff10 con 0x7fd638103080 2024-03-16T21:04:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.450+0000 7fd636800640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd61c0a1c20 0x7fd61c0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.450+0000 7fd636800640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd61c0a1c20 0x7fd61c0a40e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd628011550 tx=0x7fd628005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.453+0000 7fd62fe00640 1 -- 172.21.15.8:0/1471327638 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd6200b8e90 con 0x7fd638103080 2024-03-16T21:04:54.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.696+0000 7fd63d400640 1 -- 172.21.15.8:0/1471327638 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd638111740 con 0x7fd638103080 2024-03-16T21:04:54.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.697+0000 7fd62fe00640 1 -- 172.21.15.8:0/1471327638 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11387 (secure 0 0 0) 0x7fd620003e60 con 0x7fd638103080 2024-03-16T21:04:54.703 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:04:54.703 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:27.879028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:04:54.703 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-03-16T21:04:54.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.700+0000 7fd63d400640 1 -- 172.21.15.8:0/1471327638 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd61c0a1c20 msgr2=0x7fd61c0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.700+0000 7fd63d400640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd61c0a1c20 0x7fd61c0a40e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd628011550 tx=0x7fd628005f90 comp rx=0 tx=0).stop 2024-03-16T21:04:54.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.700+0000 7fd63d400640 1 -- 172.21.15.8:0/1471327638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638103080 msgr2=0x7fd63819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.700+0000 7fd63d400640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638103080 0x7fd63819a410 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd62002c750 tx=0x7fd620034670 comp rx=0 tx=0).stop 2024-03-16T21:04:54.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.701+0000 7fd63d400640 1 -- 172.21.15.8:0/1471327638 shutdown_connections 2024-03-16T21:04:54.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.701+0000 7fd63d400640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd61c0a1c20 0x7fd61c0a40e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.701+0000 7fd63d400640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd63810baa0 0x7fd63819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.701+0000 7fd63d400640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd638103080 0x7fd63819a410 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.701+0000 7fd63d400640 1 --2- 172.21.15.8:0/1471327638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd638102760 0x7fd638199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.701+0000 7fd63d400640 1 -- 172.21.15.8:0/1471327638 >> 172.21.15.8:0/1471327638 conn(0x7fd638076770 msgr2=0x7fd6380fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.701+0000 7fd63d400640 1 -- 172.21.15.8:0/1471327638 shutdown_connections 2024-03-16T21:04:54.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.701+0000 7fd63d400640 1 -- 172.21.15.8:0/1471327638 wait complete. 2024-03-16T21:04:54.727 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:04:54.727 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:04:54.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.942+0000 7f7092200640 1 -- 172.21.15.8:0/3747754266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c074240 msgr2=0x7f708c10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.942+0000 7f7092200640 1 --2- 172.21.15.8:0/3747754266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c074240 0x7f708c10d660 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7080009900 tx=0x7f708002bcd0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.942+0000 7f7092200640 1 -- 172.21.15.8:0/3747754266 shutdown_connections 2024-03-16T21:04:54.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.942+0000 7f7092200640 1 --2- 172.21.15.8:0/3747754266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708c10dba0 0x7f708c10fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.942+0000 7f7092200640 1 --2- 172.21.15.8:0/3747754266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c074240 0x7f708c10d660 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.942+0000 7f7092200640 1 --2- 172.21.15.8:0/3747754266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708c073920 0x7f708c073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.942+0000 7f7092200640 1 -- 172.21.15.8:0/3747754266 >> 172.21.15.8:0/3747754266 conn(0x7f708c0fce50 msgr2=0x7f708c0ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.942+0000 7f7092200640 1 -- 172.21.15.8:0/3747754266 shutdown_connections 2024-03-16T21:04:54.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.942+0000 7f7092200640 1 -- 172.21.15.8:0/3747754266 wait complete. 2024-03-16T21:04:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.943+0000 7f7092200640 1 Processor -- start 2024-03-16T21:04:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.943+0000 7f7092200640 1 -- start start 2024-03-16T21:04:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.943+0000 7f7092200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c073920 0x7f708c19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.943+0000 7f7092200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708c074240 0x7f708c19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.943+0000 7f7092200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708c10dba0 0x7f708c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f7092200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c19a120 con 0x7f708c10dba0 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f7092200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c19a290 con 0x7f708c073920 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f7092200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c19a450 con 0x7f708c074240 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f708be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708c074240 0x7f708c19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f708be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708c074240 0x7f708c19fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47478/0 (socket says 172.21.15.8:47478) 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f708be00640 1 -- 172.21.15.8:0/1291660729 learned_addr learned my addr 172.21.15.8:0/1291660729 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f7091800640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708c10dba0 0x7f708c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f7090e00640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c073920 0x7f708c19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f708be00640 1 -- 172.21.15.8:0/1291660729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c073920 msgr2=0x7f708c19f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f708be00640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c073920 0x7f708c19f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f708be00640 1 -- 172.21.15.8:0/1291660729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708c10dba0 msgr2=0x7f708c199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f708be00640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708c10dba0 0x7f708c199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f708be00640 1 -- 172.21.15.8:0/1291660729 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078009490 con 0x7f708c074240 2024-03-16T21:04:54.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.944+0000 7f7091800640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708c10dba0 0x7f708c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:54.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.945+0000 7f708be00640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708c074240 0x7f708c19fe60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7080000c00 tx=0x7f7080004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.945+0000 7f7089600640 1 -- 172.21.15.8:0/1291660729 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708002cb60 con 0x7f708c074240 2024-03-16T21:04:54.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.945+0000 7f7089600640 1 -- 172.21.15.8:0/1291660729 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f708002ccc0 con 0x7f708c074240 2024-03-16T21:04:54.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.945+0000 7f7092200640 1 -- 172.21.15.8:0/1291660729 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7080009560 con 0x7f708c074240 2024-03-16T21:04:54.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.945+0000 7f7089600640 1 -- 172.21.15.8:0/1291660729 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080003bb0 con 0x7f708c074240 2024-03-16T21:04:54.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.945+0000 7f7092200640 1 -- 172.21.15.8:0/1291660729 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708c1a67e0 con 0x7f708c074240 2024-03-16T21:04:54.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.948+0000 7f70965d1740 1 Processor -- start 2024-03-16T21:04:54.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.948+0000 7f70965d1740 1 -- start start 2024-03-16T21:04:54.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.948+0000 7f70965d1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 0x55e7886c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f70965d1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 0x55e7886c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f70965d1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886ca2f0 0x55e7886cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f70965d1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78862f210 con 0x55e7886c0df0 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f70965d1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e78862c740 con 0x55e7886ca2f0 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f70965d1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e788627f20 con 0x55e7886c1710 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f7091800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 0x55e7886c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f7089600640 1 -- 172.21.15.8:0/1291660729 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7080003d10 con 0x7f708c074240 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f7091800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 0x55e7886c11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55870/0 (socket says 172.21.15.8:55870) 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f7091800640 1 -- 172.21.15.8:0/614901628 learned_addr learned my addr 172.21.15.8:0/614901628 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f7090e00640 1 --2- 172.21.15.8:0/614901628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 0x55e7886c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f708be00640 1 --2- 172.21.15.8:0/614901628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886ca2f0 0x55e7886cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f7091800640 1 -- 172.21.15.8:0/614901628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 msgr2=0x55e7886c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f7091800640 1 --2- 172.21.15.8:0/614901628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 0x55e7886c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f7091800640 1 -- 172.21.15.8:0/614901628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886ca2f0 msgr2=0x55e7886cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f7091800640 1 --2- 172.21.15.8:0/614901628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886ca2f0 0x55e7886cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f7091800640 1 -- 172.21.15.8:0/614901628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7885e9df0 con 0x55e7886c0df0 2024-03-16T21:04:54.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f708be00640 1 --2- 172.21.15.8:0/614901628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886ca2f0 0x55e7886cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:04:54.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.949+0000 7f7090e00640 1 --2- 172.21.15.8:0/614901628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 0x55e7886c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:54.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.950+0000 7f7091800640 1 --2- 172.21.15.8:0/614901628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 0x55e7886c11d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7084011790 tx=0x7f7084011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985122548c0791b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.950+0000 7f707e000640 1 -- 172.21.15.8:0/614901628 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084011ea0 con 0x55e7886c0df0 2024-03-16T21:04:54.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.950+0000 7f707e000640 1 -- 172.21.15.8:0/614901628 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f708400fea0 con 0x55e7886c0df0 2024-03-16T21:04:54.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.950+0000 7f707e000640 1 -- 172.21.15.8:0/614901628 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840047e0 con 0x55e7886c0df0 2024-03-16T21:04:54.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.950+0000 7f7089600640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70740a1ba0 0x7f70740a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.951+0000 7f70965d1740 1 -- 172.21.15.8:0/614901628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 msgr2=0x55e7886c11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.951+0000 7f70965d1740 1 --2- 172.21.15.8:0/614901628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 0x55e7886c11d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7084011790 tx=0x7f7084011c50 comp rx=0 tx=0).stop 2024-03-16T21:04:54.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.951+0000 7f7089600640 1 -- 172.21.15.8:0/1291660729 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f70800ef920 con 0x7f708c074240 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.951+0000 7f70965d1740 1 -- 172.21.15.8:0/614901628 shutdown_connections 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.951+0000 7f70965d1740 1 --2- 172.21.15.8:0/614901628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886ca2f0 0x55e7886cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.951+0000 7f70965d1740 1 --2- 172.21.15.8:0/614901628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 0x55e7886c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.951+0000 7f70965d1740 1 --2- 172.21.15.8:0/614901628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 0x55e7886c11d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.951+0000 7f70965d1740 1 -- 172.21.15.8:0/614901628 >> 172.21.15.8:0/614901628 conn(0x55e7886bb520 msgr2=0x55e7886bb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.951+0000 7f7090e00640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70740a1ba0 0x7f70740a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.951+0000 7f70965d1740 1 -- 172.21.15.8:0/614901628 shutdown_connections 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.951+0000 7f70965d1740 1 -- 172.21.15.8:0/614901628 wait complete. 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.952+0000 7f7090e00640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70740a1ba0 0x7f70740a4060 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55e7886c08c0 tx=0x7f7078005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.952+0000 7f70965d1740 1 -- start start 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.952+0000 7f70965d1740 1 Processor -- start 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.952+0000 7f70965d1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c0df0 0x55e7886c7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.952+0000 7f70965d1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 0x55e7886c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.952+0000 7f70965d1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886ca2f0 0x55e7886c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.952+0000 7f70965d1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7885cd150 con 0x55e7886ca2f0 2024-03-16T21:04:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.952+0000 7f70965d1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7885ccdf0 con 0x55e7886c0df0 2024-03-16T21:04:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.952+0000 7f70965d1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7883961c0 con 0x55e7886c1710 2024-03-16T21:04:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.952+0000 7f70965d1740 10 client.0 _ll_register_callbacks cb 0x55e78861c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f7090e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c0df0 0x55e7886c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f7090e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c0df0 0x55e7886c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37734/0 (socket says 172.21.15.8:37734) 2024-03-16T21:04:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f7090e00640 1 -- 172.21.15.8:0/450023521 learned_addr learned my addr 172.21.15.8:0/450023521 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f708be00640 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 0x55e7886c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f7091800640 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886ca2f0 0x55e7886c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f7090e00640 1 -- 172.21.15.8:0/450023521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 msgr2=0x55e7886c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f7090e00640 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 0x55e7886c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f7090e00640 1 -- 172.21.15.8:0/450023521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886ca2f0 msgr2=0x55e7886c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f7090e00640 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886ca2f0 0x55e7886c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f7090e00640 1 -- 172.21.15.8:0/450023521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7084011440 con 0x55e7886c0df0 2024-03-16T21:04:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f708be00640 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 0x55e7886c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f7090e00640 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c0df0 0x55e7886c7390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7078009fd0 tx=0x7f7078004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3759e94e82615844 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.953+0000 7f7072a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:04:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.954+0000 7f7072a00640 1 -- 172.21.15.8:0/450023521 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078017070 con 0x55e7886c0df0 2024-03-16T21:04:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.954+0000 7f7072a00640 1 -- 172.21.15.8:0/450023521 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f70780206e0 con 0x55e7886c0df0 2024-03-16T21:04:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.954+0000 7f70965d1740 1 -- 172.21.15.8:0/450023521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7883277e0 con 0x55e7886c0df0 2024-03-16T21:04:54.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.954+0000 7f7072a00640 1 -- 172.21.15.8:0/450023521 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70780208a0 con 0x55e7886c0df0 2024-03-16T21:04:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.954+0000 7f70965d1740 10 client.27140 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.954+0000 7f70965d1740 1 -- 172.21.15.8:0/450023521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e7886265a0 con 0x55e7886c0df0 2024-03-16T21:04:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.954+0000 7f7072a00640 1 -- 172.21.15.8:0/450023521 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7078035020 con 0x55e7886c0df0 2024-03-16T21:04:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.954+0000 7f7072a00640 1 -- 172.21.15.8:0/450023521 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f707801d3d0 con 0x55e7886c0df0 2024-03-16T21:04:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.954+0000 7f70965d1740 10 client.27140 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.955+0000 7f70965d1740 10 client.27140 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:04:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.955+0000 7f70965d1740 20 client.27140 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.955+0000 7f70965d1740 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e7886da3e0 0x55e7886dc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.955+0000 7f70965d1740 4 client.27140 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.955+0000 7f70965d1740 1 -- 172.21.15.8:0/450023521 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e788364720 con 0x55e7886da3e0 2024-03-16T21:04:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.955+0000 7f708be00640 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e7886da3e0 0x55e7886dc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.955+0000 7f708be00640 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e7886da3e0 0x55e7886dc820 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c12f80f526d0806 server_cookie=15e14f141e986fe0 in_seq=0 out_seq=0 2024-03-16T21:04:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.955+0000 7f7072a00640 10 client.27140 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:04:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.956+0000 7f7072a00640 1 -- 172.21.15.8:0/450023521 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55e788364720 con 0x55e7886da3e0 2024-03-16T21:04:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.956+0000 7f7072a00640 10 client.27140 handle_command_reply: tid=0 2024-03-16T21:04:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.956+0000 7f70965d1740 1 client.27140 shutdown 2024-03-16T21:04:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f70965d1740 1 -- 172.21.15.8:0/450023521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c0df0 msgr2=0x55e7886c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f70965d1740 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c0df0 0x55e7886c7390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7078009fd0 tx=0x7f7078004730 comp rx=0 tx=0).stop 2024-03-16T21:04:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f70965d1740 1 -- 172.21.15.8:0/450023521 shutdown_connections 2024-03-16T21:04:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f70965d1740 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e7886da3e0 0x55e7886dc820 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f70965d1740 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886ca2f0 0x55e7886c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f70965d1740 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c1710 0x55e7886c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f70965d1740 1 --2- 172.21.15.8:0/450023521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c0df0 0x55e7886c7390 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f7072a00640 0 client.27140 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:04:54.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f70965d1740 1 -- 172.21.15.8:0/450023521 >> 172.21.15.8:0/450023521 conn(0x55e7886bb520 msgr2=0x55e7886bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f70965d1740 1 -- 172.21.15.8:0/450023521 shutdown_connections 2024-03-16T21:04:54.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f70965d1740 1 -- 172.21.15.8:0/450023521 wait complete. 2024-03-16T21:04:54.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.957+0000 7f70965d1740 20 client.27140 trim_cache size 0 max 16384 2024-03-16T21:04:54.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.971+0000 7f70965d1740 1 Processor -- start 2024-03-16T21:04:54.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.971+0000 7f70965d1740 1 -- start start 2024-03-16T21:04:54.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.971+0000 7f70965d1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c0df0 0x55e7886c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.971+0000 7f70965d1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c1710 0x55e7886c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.971+0000 7f70965d1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886ca2f0 0x55e7886d5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.971+0000 7f70965d1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7886bd880 con 0x55e7886c1710 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.971+0000 7f70965d1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7886bc0f0 con 0x55e7886ca2f0 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.971+0000 7f70965d1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7886c58e0 con 0x55e7886c0df0 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.971+0000 7f7090e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c0df0 0x55e7886c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.971+0000 7f7090e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c0df0 0x55e7886c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47510/0 (socket says 172.21.15.8:47510) 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.971+0000 7f7090e00640 1 -- 172.21.15.8:0/1687690482 learned_addr learned my addr 172.21.15.8:0/1687690482 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.972+0000 7f7091800640 1 --2- 172.21.15.8:0/1687690482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886ca2f0 0x55e7886d5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.972+0000 7f708be00640 1 --2- 172.21.15.8:0/1687690482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c1710 0x55e7886c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.972+0000 7f7090e00640 1 -- 172.21.15.8:0/1687690482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886ca2f0 msgr2=0x55e7886d5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.972+0000 7f7090e00640 1 --2- 172.21.15.8:0/1687690482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886ca2f0 0x55e7886d5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.972+0000 7f7090e00640 1 -- 172.21.15.8:0/1687690482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c1710 msgr2=0x55e7886c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.972+0000 7f7090e00640 1 --2- 172.21.15.8:0/1687690482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c1710 0x55e7886c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.972+0000 7f7090e00640 1 -- 172.21.15.8:0/1687690482 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7885c2ab0 con 0x55e7886c0df0 2024-03-16T21:04:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.972+0000 7f7090e00640 1 --2- 172.21.15.8:0/1687690482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c0df0 0x55e7886c9ac0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7078000c00 tx=0x7f70780045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e79af76f3fb8ba server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.972+0000 7f707d600640 1 -- 172.21.15.8:0/1687690482 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780043d0 con 0x55e7886c0df0 2024-03-16T21:04:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.972+0000 7f707d600640 1 -- 172.21.15.8:0/1687690482 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7078035070 con 0x55e7886c0df0 2024-03-16T21:04:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.972+0000 7f707d600640 1 -- 172.21.15.8:0/1687690482 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078020e40 con 0x55e7886c0df0 2024-03-16T21:04:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.973+0000 7f70965d1740 1 -- 172.21.15.8:0/1687690482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c0df0 msgr2=0x55e7886c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.973+0000 7f70965d1740 1 --2- 172.21.15.8:0/1687690482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c0df0 0x55e7886c9ac0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7078000c00 tx=0x7f70780045e0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.973+0000 7f70965d1740 1 -- 172.21.15.8:0/1687690482 shutdown_connections 2024-03-16T21:04:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.973+0000 7f70965d1740 1 --2- 172.21.15.8:0/1687690482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886ca2f0 0x55e7886d5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.973+0000 7f70965d1740 1 --2- 172.21.15.8:0/1687690482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c1710 0x55e7886c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.973+0000 7f70965d1740 1 --2- 172.21.15.8:0/1687690482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886c0df0 0x55e7886c9ac0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.973+0000 7f70965d1740 1 -- 172.21.15.8:0/1687690482 >> 172.21.15.8:0/1687690482 conn(0x55e7886bb520 msgr2=0x55e7886ba6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.973+0000 7f70965d1740 1 -- 172.21.15.8:0/1687690482 shutdown_connections 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.973+0000 7f70965d1740 1 -- 172.21.15.8:0/1687690482 wait complete. 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.974+0000 7f70965d1740 1 -- start start 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.974+0000 7f70965d1740 1 Processor -- start 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.974+0000 7f70965d1740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 0x55e7886d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.974+0000 7f70965d1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c1710 0x55e7886ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.974+0000 7f70965d1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886ca2f0 0x55e7886ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.974+0000 7f70965d1740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7886ceb10 con 0x55e7886c0df0 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.974+0000 7f70965d1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7886cec80 con 0x55e7886c1710 2024-03-16T21:04:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.974+0000 7f70965d1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7886cee40 con 0x55e7886ca2f0 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.974+0000 7f70965d1740 10 client.0 _ll_register_callbacks cb 0x7f7078009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f7091800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886ca2f0 0x55e7886ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f708be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c1710 0x55e7886ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f7091800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886ca2f0 0x55e7886ce5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47524/0 (socket says 172.21.15.8:47524) 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f7091800640 1 -- 172.21.15.8:0/322734501 learned_addr learned my addr 172.21.15.8:0/322734501 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f7090e00640 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 0x55e7886d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f708be00640 1 -- 172.21.15.8:0/322734501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886ca2f0 msgr2=0x55e7886ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f708be00640 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886ca2f0 0x55e7886ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f708be00640 1 -- 172.21.15.8:0/322734501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 msgr2=0x55e7886d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f708be00640 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 0x55e7886d1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f708be00640 1 -- 172.21.15.8:0/322734501 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7886265a0 con 0x55e7886c1710 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f7090e00640 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 0x55e7886d1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f708be00640 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c1710 0x55e7886ce090 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f70800ed120 tx=0x7f70800035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e15a814374525fa8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f7072a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f7072a00640 1 -- 172.21.15.8:0/322734501 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800bc600 con 0x55e7886c1710 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f7072a00640 1 -- 172.21.15.8:0/322734501 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f70800c0750 con 0x55e7886c1710 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.975+0000 7f70965d1740 1 -- 172.21.15.8:0/322734501 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f708400fea0 con 0x55e7886c1710 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f7072a00640 1 -- 172.21.15.8:0/322734501 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70800c4da0 con 0x55e7886c1710 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f70965d1740 10 client.27146 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f70965d1740 1 -- 172.21.15.8:0/322734501 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e7885e8650 con 0x55e7886c1710 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f7072a00640 1 -- 172.21.15.8:0/322734501 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f708400fea0 con 0x55e7886c1710 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f7072a00640 1 -- 172.21.15.8:0/322734501 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f708003c070 con 0x55e7886c1710 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f70965d1740 10 client.27146 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f70965d1740 10 client.27146 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f70965d1740 20 client.27146 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f70965d1740 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e78873f6f0 0x55e788741b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f70965d1740 4 client.27146 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:04:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f70965d1740 1 -- 172.21.15.8:0/322734501 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e7883b3890 con 0x55e78873f6f0 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.976+0000 7f7090e00640 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e78873f6f0 0x55e788741b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f7090e00640 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e78873f6f0 0x55e788741b10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8f6dba2c9bfef507 server_cookie=354daf59a9303658 in_seq=0 out_seq=0 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f7072a00640 10 client.27146 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f7072a00640 1 -- 172.21.15.8:0/322734501 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e7883b3890 con 0x55e78873f6f0 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f7072a00640 10 client.27146 handle_command_reply: tid=0 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 1 client.27146 shutdown 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 1 -- 172.21.15.8:0/322734501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c1710 msgr2=0x55e7886ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c1710 0x55e7886ce090 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f70800ed120 tx=0x7f70800035f0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 1 -- 172.21.15.8:0/322734501 shutdown_connections 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55e78873f6f0 0x55e788741b10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e7886ca2f0 0x55e7886ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7886c1710 0x55e7886ce090 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 1 --2- 172.21.15.8:0/322734501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e7886c0df0 0x55e7886d1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f7072a00640 0 client.27146 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:04:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 1 -- 172.21.15.8:0/322734501 >> 172.21.15.8:0/322734501 conn(0x55e7886bb520 msgr2=0x55e7886bc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 1 -- 172.21.15.8:0/322734501 shutdown_connections 2024-03-16T21:04:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 1 -- 172.21.15.8:0/322734501 wait complete. 2024-03-16T21:04:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.977+0000 7f70965d1740 20 client.27146 trim_cache size 0 max 16384 2024-03-16T21:04:54.988 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 -- 172.21.15.8:0/1291660729 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70740a1ba0 msgr2=0x7f70740a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70740a1ba0 0x7f70740a4060 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55e7886c08c0 tx=0x7f7078005f90 comp rx=0 tx=0).stop 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 -- 172.21.15.8:0/1291660729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708c074240 msgr2=0x7f708c19fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708c074240 0x7f708c19fe60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7080000c00 tx=0x7f7080004390 comp rx=0 tx=0).stop 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 -- 172.21.15.8:0/1291660729 shutdown_connections 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f70740a1ba0 0x7f70740a4060 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708c10dba0 0x7f708c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f708c074240 0x7f708c19fe60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 --2- 172.21.15.8:0/1291660729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c073920 0x7f708c19f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 -- 172.21.15.8:0/1291660729 >> 172.21.15.8:0/1291660729 conn(0x7f708c0fce50 msgr2=0x7f708c0fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 -- 172.21.15.8:0/1291660729 shutdown_connections 2024-03-16T21:04:54.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:54.978+0000 7f7092200640 1 -- 172.21.15.8:0/1291660729 wait complete. 2024-03-16T21:04:54.999 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:04:55.000 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:04:55.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.211+0000 7f1c26400640 1 -- 172.21.15.8:0/152056842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c201066a0 msgr2=0x7f1c2010e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.211+0000 7f1c26400640 1 --2- 172.21.15.8:0/152056842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c201066a0 0x7f1c2010e270 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009cd0 tx=0x7f1c1802c0e0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.211+0000 7f1c26400640 1 -- 172.21.15.8:0/152056842 shutdown_connections 2024-03-16T21:04:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.211+0000 7f1c26400640 1 --2- 172.21.15.8:0/152056842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c201066a0 0x7f1c2010e270 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.211+0000 7f1c26400640 1 --2- 172.21.15.8:0/152056842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c20101f80 0x7f1c20105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.211+0000 7f1c26400640 1 --2- 172.21.15.8:0/152056842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c201015d0 0x7f1c201019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.211+0000 7f1c26400640 1 -- 172.21.15.8:0/152056842 >> 172.21.15.8:0/152056842 conn(0x7f1c200fce50 msgr2=0x7f1c200ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.211+0000 7f1c26400640 1 -- 172.21.15.8:0/152056842 shutdown_connections 2024-03-16T21:04:55.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.211+0000 7f1c26400640 1 -- 172.21.15.8:0/152056842 wait complete. 2024-03-16T21:04:55.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.212+0000 7f1c26400640 1 Processor -- start 2024-03-16T21:04:55.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.213+0000 7f1c26400640 1 -- start start 2024-03-16T21:04:55.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.213+0000 7f1c26400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c201015d0 0x7f1c200737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.213+0000 7f1c26400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c201066a0 0x7f1c20073d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.213+0000 7f1c26400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c20074270 0x7f1c201a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.213+0000 7f1c26400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c201a6260 con 0x7f1c20074270 2024-03-16T21:04:55.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.213+0000 7f1c26400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c201a63d0 con 0x7f1c201015d0 2024-03-16T21:04:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.213+0000 7f1c26400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c201a6590 con 0x7f1c201066a0 2024-03-16T21:04:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.213+0000 7f1c25000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c201015d0 0x7f1c200737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.214+0000 7f1c25000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c201015d0 0x7f1c200737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37794/0 (socket says 172.21.15.8:37794) 2024-03-16T21:04:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.214+0000 7f1c25000640 1 -- 172.21.15.8:0/1197731796 learned_addr learned my addr 172.21.15.8:0/1197731796 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.214+0000 7f1c1fe00640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c201066a0 0x7f1c20073d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.214+0000 7f1c25a00640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c20074270 0x7f1c201a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.214+0000 7f1c25000640 1 -- 172.21.15.8:0/1197731796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c201066a0 msgr2=0x7f1c20073d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.214+0000 7f1c25000640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c201066a0 0x7f1c20073d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.214+0000 7f1c25000640 1 -- 172.21.15.8:0/1197731796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c20074270 msgr2=0x7f1c201a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.214+0000 7f1c25000640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c20074270 0x7f1c201a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.214+0000 7f1c25000640 1 -- 172.21.15.8:0/1197731796 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c18009900 con 0x7f1c201015d0 2024-03-16T21:04:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.214+0000 7f1c25000640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c201015d0 0x7f1c200737f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e9f0 tx=0x7f1c1400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.214+0000 7f1c1d600640 1 -- 172.21.15.8:0/1197731796 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14009700 con 0x7f1c201015d0 2024-03-16T21:04:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.215+0000 7f1c26400640 1 -- 172.21.15.8:0/1197731796 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c201a6870 con 0x7f1c201015d0 2024-03-16T21:04:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.215+0000 7f1c1d600640 1 -- 172.21.15.8:0/1197731796 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1c1400cd80 con 0x7f1c201015d0 2024-03-16T21:04:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.215+0000 7f1c1d600640 1 -- 172.21.15.8:0/1197731796 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140189c0 con 0x7f1c201015d0 2024-03-16T21:04:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.215+0000 7f1c26400640 1 -- 172.21.15.8:0/1197731796 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c201a6d80 con 0x7f1c201015d0 2024-03-16T21:04:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c2a64e740 1 Processor -- start 2024-03-16T21:04:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c1d600640 1 -- 172.21.15.8:0/1197731796 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f1c14018b20 con 0x7f1c201015d0 2024-03-16T21:04:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c2a64e740 1 -- start start 2024-03-16T21:04:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab8df0 0x5557acab91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab9710 0x5557acac1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acac22f0 0x5557acac46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557aca27210 con 0x5557acac22f0 2024-03-16T21:04:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557aca24740 con 0x5557acab8df0 2024-03-16T21:04:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557aca1ff20 con 0x5557acab9710 2024-03-16T21:04:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c25a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab8df0 0x5557acab91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c25000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab9710 0x5557acac1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.218+0000 7f1c25a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab8df0 0x5557acab91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37804/0 (socket says 172.21.15.8:37804) 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.219+0000 7f1c25a00640 1 -- 172.21.15.8:0/226415214 learned_addr learned my addr 172.21.15.8:0/226415214 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.219+0000 7f1c1fe00640 1 --2- 172.21.15.8:0/226415214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acac22f0 0x5557acac46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.219+0000 7f1c25a00640 1 -- 172.21.15.8:0/226415214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab9710 msgr2=0x5557acac1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.219+0000 7f1c25a00640 1 --2- 172.21.15.8:0/226415214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab9710 0x5557acac1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.219+0000 7f1c25a00640 1 -- 172.21.15.8:0/226415214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acac22f0 msgr2=0x5557acac46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.219+0000 7f1c25a00640 1 --2- 172.21.15.8:0/226415214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acac22f0 0x5557acac46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.219+0000 7f1c25a00640 1 -- 172.21.15.8:0/226415214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557ac9e1df0 con 0x5557acab8df0 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.219+0000 7f1c1fe00640 1 --2- 172.21.15.8:0/226415214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acac22f0 0x5557acac46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.219+0000 7f1c25a00640 1 --2- 172.21.15.8:0/226415214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab8df0 0x5557acab91d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1c18004af0 tx=0x7f1c18005f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76331a1051528f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.219+0000 7f1c1d600640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c080a1bd0 0x7f1c080a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.219+0000 7f1c12000640 1 -- 172.21.15.8:0/226415214 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18032540 con 0x5557acab8df0 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c12000640 1 -- 172.21.15.8:0/226415214 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1c18034ab0 con 0x5557acab8df0 2024-03-16T21:04:55.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c12000640 1 -- 172.21.15.8:0/226415214 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18003bd0 con 0x5557acab8df0 2024-03-16T21:04:55.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c1d600640 1 -- 172.21.15.8:0/1197731796 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1c14014070 con 0x7f1c201015d0 2024-03-16T21:04:55.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c25000640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c080a1bd0 0x7f1c080a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c2a64e740 1 -- 172.21.15.8:0/226415214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab8df0 msgr2=0x5557acab91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/226415214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab8df0 0x5557acab91d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1c18004af0 tx=0x7f1c18005f80 comp rx=0 tx=0).stop 2024-03-16T21:04:55.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c25000640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c080a1bd0 0x7f1c080a4090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c140cb300 tx=0x7f1c140d3550 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c2a64e740 1 -- 172.21.15.8:0/226415214 shutdown_connections 2024-03-16T21:04:55.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/226415214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acac22f0 0x5557acac46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/226415214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab9710 0x5557acac1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/226415214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab8df0 0x5557acab91d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.220+0000 7f1c2a64e740 1 -- 172.21.15.8:0/226415214 >> 172.21.15.8:0/226415214 conn(0x5557acab3520 msgr2=0x5557acab3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.221+0000 7f1c2a64e740 1 -- 172.21.15.8:0/226415214 shutdown_connections 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.221+0000 7f1c2a64e740 1 -- 172.21.15.8:0/226415214 wait complete. 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.221+0000 7f1c2a64e740 1 -- start start 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.221+0000 7f1c2a64e740 1 Processor -- start 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acab8df0 0x5557acabf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acabf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 0x5557acabfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ac9c5150 con 0x5557acab8df0 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ac9c4df0 con 0x5557acab9710 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ac78e1c0 con 0x5557acac22f0 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c2a64e740 10 client.0 _ll_register_callbacks cb 0x5557aca142b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c25a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acab8df0 0x5557acabf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c1fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acabf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c25a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acab8df0 0x5557acabf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55928/0 (socket says 172.21.15.8:55928) 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c25a00640 1 -- 172.21.15.8:0/4179649119 learned_addr learned my addr 172.21.15.8:0/4179649119 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c25a00640 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 0x5557acabfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c1fe00640 1 -- 172.21.15.8:0/4179649119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 msgr2=0x5557acabfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c1fe00640 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 0x5557acabfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c1fe00640 1 -- 172.21.15.8:0/4179649119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acab8df0 msgr2=0x5557acabf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c1fe00640 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acab8df0 0x5557acabf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c1fe00640 1 -- 172.21.15.8:0/4179649119 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2010ea80 con 0x5557acab9710 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.222+0000 7f1c25a00640 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 0x5557acabfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.223+0000 7f1c1fe00640 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acabf900 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1c20075280 tx=0x7f1c0c012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62e201993c276ee6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.223+0000 7f1c06a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.223+0000 7f1c06a00640 1 -- 172.21.15.8:0/4179649119 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c017070 con 0x5557acab9710 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.223+0000 7f1c06a00640 1 -- 172.21.15.8:0/4179649119 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1c0c00fa30 con 0x5557acab9710 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.223+0000 7f1c2a64e740 1 -- 172.21.15.8:0/4179649119 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557ac71f7e0 con 0x5557acab9710 2024-03-16T21:04:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.223+0000 7f1c06a00640 1 -- 172.21.15.8:0/4179649119 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c0c00fbf0 con 0x5557acab9710 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.223+0000 7f1c2a64e740 10 client.27158 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.223+0000 7f1c2a64e740 1 -- 172.21.15.8:0/4179649119 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5557aca1e5a0 con 0x5557acab9710 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.224+0000 7f1c06a00640 1 -- 172.21.15.8:0/4179649119 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5557ac71f7e0 con 0x5557acab9710 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.224+0000 7f1c06a00640 1 -- 172.21.15.8:0/4179649119 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f1c0c003ae0 con 0x5557acab9710 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.224+0000 7f1c2a64e740 10 client.27158 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.224+0000 7f1c2a64e740 10 client.27158 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.224+0000 7f1c2a64e740 20 client.27158 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.224+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5557acad2440 0x5557acad4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.224+0000 7f1c2a64e740 4 client.27158 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.224+0000 7f1c2a64e740 1 -- 172.21.15.8:0/4179649119 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557ac75c720 con 0x5557acad2440 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.224+0000 7f1c25a00640 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5557acad2440 0x5557acad4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.225+0000 7f1c25a00640 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5557acad2440 0x5557acad4860 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f0e02650546a0dfc server_cookie=27be1d2e45e3a55c in_seq=0 out_seq=0 2024-03-16T21:04:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.225+0000 7f1c06a00640 10 client.27158 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.225+0000 7f1c06a00640 1 -- 172.21.15.8:0/4179649119 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5557ac75c720 con 0x5557acad2440 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.225+0000 7f1c06a00640 10 client.27158 handle_command_reply: tid=0 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 1 client.27158 shutdown 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 1 -- 172.21.15.8:0/4179649119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 msgr2=0x5557acabf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acabf900 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1c20075280 tx=0x7f1c0c012b60 comp rx=0 tx=0).stop 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 1 -- 172.21.15.8:0/4179649119 shutdown_connections 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5557acad2440 0x5557acad4860 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 0x5557acabfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acabf900 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/4179649119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acab8df0 0x5557acabf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c06a00640 0 client.27158 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 1 -- 172.21.15.8:0/4179649119 >> 172.21.15.8:0/4179649119 conn(0x5557acab3520 msgr2=0x5557acab5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 1 -- 172.21.15.8:0/4179649119 shutdown_connections 2024-03-16T21:04:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 1 -- 172.21.15.8:0/4179649119 wait complete. 2024-03-16T21:04:55.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.226+0000 7f1c2a64e740 20 client.27158 trim_cache size 0 max 16384 2024-03-16T21:04:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c2a64e740 1 Processor -- start 2024-03-16T21:04:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c2a64e740 1 -- start start 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab8df0 0x5557acac1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acaae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acac22f0 0x5557acacd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acaaea90 con 0x5557acac22f0 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acac0710 con 0x5557acab9710 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acabf1b0 con 0x5557acab8df0 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c25a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab8df0 0x5557acac1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c1fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acaae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c25a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab8df0 0x5557acac1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47566/0 (socket says 172.21.15.8:47566) 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.240+0000 7f1c25a00640 1 -- 172.21.15.8:0/2007778071 learned_addr learned my addr 172.21.15.8:0/2007778071 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.241+0000 7f1c25a00640 1 --2- 172.21.15.8:0/2007778071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acac22f0 0x5557acacd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.241+0000 7f1c1fe00640 1 -- 172.21.15.8:0/2007778071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab8df0 msgr2=0x5557acac1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.241+0000 7f1c1fe00640 1 --2- 172.21.15.8:0/2007778071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab8df0 0x5557acac1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.241+0000 7f1c1fe00640 1 -- 172.21.15.8:0/2007778071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acac22f0 msgr2=0x5557acacd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.241+0000 7f1c1fe00640 1 --2- 172.21.15.8:0/2007778071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acac22f0 0x5557acacd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.241+0000 7f1c1fe00640 1 -- 172.21.15.8:0/2007778071 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557ac9baab0 con 0x5557acab9710 2024-03-16T21:04:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.241+0000 7f1c25a00640 1 --2- 172.21.15.8:0/2007778071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab8df0 0x5557acac1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.241+0000 7f1c1fe00640 1 --2- 172.21.15.8:0/2007778071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acaae550 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c003ec0 tx=0x7f1c0c009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=573b686f1d9e5d29 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.241+0000 7f1c11600640 1 -- 172.21.15.8:0/2007778071 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c017070 con 0x5557acab9710 2024-03-16T21:04:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.241+0000 7f1c11600640 1 -- 172.21.15.8:0/2007778071 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1c0c018040 con 0x5557acab9710 2024-03-16T21:04:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.241+0000 7f1c11600640 1 -- 172.21.15.8:0/2007778071 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c005630 con 0x5557acab9710 2024-03-16T21:04:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.242+0000 7f1c2a64e740 1 -- 172.21.15.8:0/2007778071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 msgr2=0x5557acaae550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.242+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/2007778071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acaae550 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c003ec0 tx=0x7f1c0c009300 comp rx=0 tx=0).stop 2024-03-16T21:04:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.242+0000 7f1c2a64e740 1 -- 172.21.15.8:0/2007778071 shutdown_connections 2024-03-16T21:04:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.242+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/2007778071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acac22f0 0x5557acacd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.242+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/2007778071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acaae550 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.242+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/2007778071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acab8df0 0x5557acac1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.242+0000 7f1c2a64e740 1 -- 172.21.15.8:0/2007778071 >> 172.21.15.8:0/2007778071 conn(0x5557acab3520 msgr2=0x5557acab26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.242+0000 7f1c2a64e740 1 -- 172.21.15.8:0/2007778071 shutdown_connections 2024-03-16T21:04:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.242+0000 7f1c2a64e740 1 -- 172.21.15.8:0/2007778071 wait complete. 2024-03-16T21:04:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.242+0000 7f1c2a64e740 1 -- start start 2024-03-16T21:04:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.243+0000 7f1c2a64e740 1 Processor -- start 2024-03-16T21:04:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.243+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acab8df0 0x5557acac9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.243+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acac6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.243+0000 7f1c2a64e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 0x5557acac6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.243+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acac6bb0 con 0x5557acab8df0 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.243+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acac6cf0 con 0x5557acab9710 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.243+0000 7f1c2a64e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557acac6eb0 con 0x5557acac22f0 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.243+0000 7f1c2a64e740 10 client.0 _ll_register_callbacks cb 0x7f1c0c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c25a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 0x5557acac6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c25a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 0x5557acac6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47580/0 (socket says 172.21.15.8:47580) 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c25a00640 1 -- 172.21.15.8:0/1504194982 learned_addr learned my addr 172.21.15.8:0/1504194982 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c1fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acac6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c25a00640 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acab8df0 0x5557acac9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c25a00640 1 -- 172.21.15.8:0/1504194982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 msgr2=0x5557acac6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c25a00640 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acac6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c25a00640 1 -- 172.21.15.8:0/1504194982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acab8df0 msgr2=0x5557acac9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c25a00640 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acab8df0 0x5557acac9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c25a00640 1 -- 172.21.15.8:0/1504194982 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557ac9e1df0 con 0x5557acac22f0 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c25a00640 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 0x5557acac6670 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1c1802c120 tx=0x7f1c18058040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=734946045204494d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.244+0000 7f1c06a00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c06a00640 1 -- 172.21.15.8:0/1504194982 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1805b040 con 0x5557acac22f0 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c2a64e740 1 -- 172.21.15.8:0/1504194982 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557acaaec30 con 0x5557acac22f0 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c06a00640 1 -- 172.21.15.8:0/1504194982 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1c18032590 con 0x5557acac22f0 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c06a00640 1 -- 172.21.15.8:0/1504194982 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c18003970 con 0x5557acac22f0 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c2a64e740 10 client.27172 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c2a64e740 1 -- 172.21.15.8:0/1504194982 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5557aca1e5a0 con 0x5557acac22f0 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c06a00640 1 -- 172.21.15.8:0/1504194982 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5557acaaec30 con 0x5557acac22f0 2024-03-16T21:04:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c06a00640 1 -- 172.21.15.8:0/1504194982 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f1c18055040 con 0x5557acac22f0 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c2a64e740 10 client.27172 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c2a64e740 10 client.27172 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c2a64e740 20 client.27172 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5557acb2eec0 0x5557acb312e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c2a64e740 4 client.27172 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.245+0000 7f1c2a64e740 1 -- 172.21.15.8:0/1504194982 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f1c18034ab0 con 0x5557acb2eec0 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.246+0000 7f1c1fe00640 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5557acb2eec0 0x5557acb312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.246+0000 7f1c1fe00640 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5557acb2eec0 0x5557acb312e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ea9a621ad109f2 server_cookie=4662ee30787cfa51 in_seq=0 out_seq=0 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.246+0000 7f1c06a00640 10 client.27172 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.246+0000 7f1c06a00640 1 -- 172.21.15.8:0/1504194982 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f1c18034ab0 con 0x5557acb2eec0 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.246+0000 7f1c06a00640 10 client.27172 handle_command_reply: tid=0 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.246+0000 7f1c2a64e740 1 client.27172 shutdown 2024-03-16T21:04:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c2a64e740 1 -- 172.21.15.8:0/1504194982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 msgr2=0x5557acac6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 0x5557acac6670 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1c1802c120 tx=0x7f1c18058040 comp rx=0 tx=0).stop 2024-03-16T21:04:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c2a64e740 1 -- 172.21.15.8:0/1504194982 shutdown_connections 2024-03-16T21:04:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5557acb2eec0 0x5557acb312e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5557acac22f0 0x5557acac6670 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5557acab9710 0x5557acac6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c06a00640 0 client.27172 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:04:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c2a64e740 1 --2- 172.21.15.8:0/1504194982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557acab8df0 0x5557acac9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c2a64e740 1 -- 172.21.15.8:0/1504194982 >> 172.21.15.8:0/1504194982 conn(0x5557acab3520 msgr2=0x5557acabf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c2a64e740 1 -- 172.21.15.8:0/1504194982 shutdown_connections 2024-03-16T21:04:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c2a64e740 1 -- 172.21.15.8:0/1504194982 wait complete. 2024-03-16T21:04:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c2a64e740 20 client.27172 trim_cache size 0 max 16384 2024-03-16T21:04:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:04:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c26400640 1 -- 172.21.15.8:0/1197731796 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c080a1bd0 msgr2=0x7f1c080a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c26400640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c080a1bd0 0x7f1c080a4090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c140cb300 tx=0x7f1c140d3550 comp rx=0 tx=0).stop 2024-03-16T21:04:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c26400640 1 -- 172.21.15.8:0/1197731796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c201015d0 msgr2=0x7f1c200737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.247+0000 7f1c26400640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c201015d0 0x7f1c200737f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e9f0 tx=0x7f1c1400eeb0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.248+0000 7f1c26400640 1 -- 172.21.15.8:0/1197731796 shutdown_connections 2024-03-16T21:04:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.248+0000 7f1c26400640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c080a1bd0 0x7f1c080a4090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.248+0000 7f1c26400640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c20074270 0x7f1c201a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.248+0000 7f1c26400640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c201066a0 0x7f1c20073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.248+0000 7f1c26400640 1 --2- 172.21.15.8:0/1197731796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c201015d0 0x7f1c200737f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.248+0000 7f1c26400640 1 -- 172.21.15.8:0/1197731796 >> 172.21.15.8:0/1197731796 conn(0x7f1c200fce50 msgr2=0x7f1c200ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.248+0000 7f1c26400640 1 -- 172.21.15.8:0/1197731796 shutdown_connections 2024-03-16T21:04:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.248+0000 7f1c26400640 1 -- 172.21.15.8:0/1197731796 wait complete. 2024-03-16T21:04:55.267 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:55 smithi008 ceph-mon[31434]: pgmap v217: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:55.267 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:55 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1471327638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:04:55.270 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:04:55.270 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:04:55.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:55 smithi170 ceph-mon[35947]: pgmap v217: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:55.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:55 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1471327638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:04:55.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:55 smithi186 ceph-mon[36391]: pgmap v217: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:04:55.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:55 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1471327638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:04:55.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.472+0000 7f12afa00640 1 -- 172.21.15.8:0/2574312025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a8112330 msgr2=0x7f12a8114720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.472+0000 7f12afa00640 1 --2- 172.21.15.8:0/2574312025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a8112330 0x7f12a8114720 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009cd0 tx=0x7f12a002c0e0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.472+0000 7f12afa00640 1 -- 172.21.15.8:0/2574312025 shutdown_connections 2024-03-16T21:04:55.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.472+0000 7f12afa00640 1 --2- 172.21.15.8:0/2574312025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a8112330 0x7f12a8114720 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.472+0000 7f12afa00640 1 --2- 172.21.15.8:0/2574312025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12a8076340 0x7f12a8111df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.472+0000 7f12afa00640 1 --2- 172.21.15.8:0/2574312025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a8075a20 0x7f12a8075e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.473+0000 7f12afa00640 1 -- 172.21.15.8:0/2574312025 >> 172.21.15.8:0/2574312025 conn(0x7f12a80ff140 msgr2=0x7f12a8101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.473+0000 7f12afa00640 1 -- 172.21.15.8:0/2574312025 shutdown_connections 2024-03-16T21:04:55.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.473+0000 7f12afa00640 1 -- 172.21.15.8:0/2574312025 wait complete. 2024-03-16T21:04:55.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.474+0000 7f12afa00640 1 Processor -- start 2024-03-16T21:04:55.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.474+0000 7f12afa00640 1 -- start start 2024-03-16T21:04:55.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.474+0000 7f12afa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a8075a20 0x7f12a819e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.474+0000 7f12afa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12a8076340 0x7f12a819e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.474+0000 7f12afa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a8112330 0x7f12a81a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.474+0000 7f12afa00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a81a3150 con 0x7f12a8112330 2024-03-16T21:04:55.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.474+0000 7f12afa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a81a32c0 con 0x7f12a8076340 2024-03-16T21:04:55.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.474+0000 7f12afa00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a81a3480 con 0x7f12a8075a20 2024-03-16T21:04:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12ad000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a8075a20 0x7f12a819e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12a7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12a8076340 0x7f12a819e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12ad000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a8075a20 0x7f12a819e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47600/0 (socket says 172.21.15.8:47600) 2024-03-16T21:04:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12a7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12a8076340 0x7f12a819e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37844/0 (socket says 172.21.15.8:37844) 2024-03-16T21:04:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12ad000640 1 -- 172.21.15.8:0/3274096975 learned_addr learned my addr 172.21.15.8:0/3274096975 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12ada00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a8112330 0x7f12a81a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12a7e00640 1 -- 172.21.15.8:0/3274096975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a8075a20 msgr2=0x7f12a819e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12a7e00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a8075a20 0x7f12a819e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12a7e00640 1 -- 172.21.15.8:0/3274096975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a8112330 msgr2=0x7f12a81a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12a7e00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a8112330 0x7f12a81a2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12a7e00640 1 -- 172.21.15.8:0/3274096975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a0009900 con 0x7f12a8076340 2024-03-16T21:04:55.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.475+0000 7f12a7e00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12a8076340 0x7f12a819e7d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f129400e9f0 tx=0x7f129400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.476+0000 7f12a5600640 1 -- 172.21.15.8:0/3274096975 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129400ccc0 con 0x7f12a8076340 2024-03-16T21:04:55.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.476+0000 7f12afa00640 1 -- 172.21.15.8:0/3274096975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a81a3760 con 0x7f12a8076340 2024-03-16T21:04:55.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.476+0000 7f12a5600640 1 -- 172.21.15.8:0/3274096975 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f129400ce20 con 0x7f12a8076340 2024-03-16T21:04:55.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.476+0000 7f12a5600640 1 -- 172.21.15.8:0/3274096975 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12940189c0 con 0x7f12a8076340 2024-03-16T21:04:55.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.476+0000 7f12afa00640 1 -- 172.21.15.8:0/3274096975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a81aafe0 con 0x7f12a8076340 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.479+0000 7f12b27e8740 1 Processor -- start 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.479+0000 7f12a5600640 1 -- 172.21.15.8:0/3274096975 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f1294018b20 con 0x7f12a8076340 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.479+0000 7f12b27e8740 1 -- start start 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.479+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 0x564312221020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.479+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312229c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.479+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56431222a140 0x56431222c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.479+0000 7f12b27e8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56431218f210 con 0x56431222a140 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.479+0000 7f12b27e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56431218c740 con 0x564312221560 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.479+0000 7f12b27e8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564312187f20 con 0x564312220c40 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.480+0000 7f12ad000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312229c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.480+0000 7f12ad000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312229c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37848/0 (socket says 172.21.15.8:37848) 2024-03-16T21:04:55.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.480+0000 7f12ada00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 0x564312221020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.480+0000 7f12ad000640 1 -- 172.21.15.8:0/604559552 learned_addr learned my addr 172.21.15.8:0/604559552 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:55.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.480+0000 7f12a7e00640 1 --2- 172.21.15.8:0/604559552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56431222a140 0x56431222c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.480+0000 7f12ad000640 1 -- 172.21.15.8:0/604559552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 msgr2=0x564312221020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.480+0000 7f12ad000640 1 --2- 172.21.15.8:0/604559552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 0x564312221020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.480+0000 7f12ad000640 1 -- 172.21.15.8:0/604559552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56431222a140 msgr2=0x56431222c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.480+0000 7f12ad000640 1 --2- 172.21.15.8:0/604559552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56431222a140 0x56431222c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.480+0000 7f12ad000640 1 -- 172.21.15.8:0/604559552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564312149df0 con 0x564312221560 2024-03-16T21:04:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.480+0000 7f12ad000640 1 --2- 172.21.15.8:0/604559552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312229c00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f129c00bda0 tx=0x7f129c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63901317816c39aa server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.481+0000 7f129a000640 1 -- 172.21.15.8:0/604559552 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c01c680 con 0x564312221560 2024-03-16T21:04:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.481+0000 7f12a5600640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f12900a1ba0 0x7f12900a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.481+0000 7f129a000640 1 -- 172.21.15.8:0/604559552 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f129c015070 con 0x564312221560 2024-03-16T21:04:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.481+0000 7f129a000640 1 -- 172.21.15.8:0/604559552 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c01a7d0 con 0x564312221560 2024-03-16T21:04:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.481+0000 7f12a5600640 1 -- 172.21.15.8:0/3274096975 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1294014070 con 0x7f12a8076340 2024-03-16T21:04:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.481+0000 7f12ada00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f12900a1ba0 0x7f12900a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.481+0000 7f12b27e8740 1 -- 172.21.15.8:0/604559552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 msgr2=0x564312229c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.481+0000 7f12b27e8740 1 --2- 172.21.15.8:0/604559552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312229c00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f129c00bda0 tx=0x7f129c0107a0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.482+0000 7f12b27e8740 1 -- 172.21.15.8:0/604559552 shutdown_connections 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.482+0000 7f12b27e8740 1 --2- 172.21.15.8:0/604559552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56431222a140 0x56431222c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.482+0000 7f12b27e8740 1 --2- 172.21.15.8:0/604559552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312229c00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.482+0000 7f12b27e8740 1 --2- 172.21.15.8:0/604559552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 0x564312221020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.482+0000 7f12b27e8740 1 -- 172.21.15.8:0/604559552 >> 172.21.15.8:0/604559552 conn(0x56431221b370 msgr2=0x56431221b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.482+0000 7f12b27e8740 1 -- 172.21.15.8:0/604559552 shutdown_connections 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.482+0000 7f12ada00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f12900a1ba0 0x7f12900a4060 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009bf0 tx=0x7f12a0004a40 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.482+0000 7f12b27e8740 1 -- 172.21.15.8:0/604559552 wait complete. 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.482+0000 7f12b27e8740 1 -- start start 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.482+0000 7f12b27e8740 1 Processor -- start 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 0x564312227120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312221560 0x564312227660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56431222a140 0x564312227ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12b27e8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56431212d150 con 0x564312221560 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12b27e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56431212cdf0 con 0x56431222a140 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12b27e8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564311ef61c0 con 0x564312220c40 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12b27e8740 10 client.0 _ll_register_callbacks cb 0x56431217c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12ad000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 0x564312227120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12a7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312221560 0x564312227660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12ad000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 0x564312227120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47612/0 (socket says 172.21.15.8:47612) 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12ada00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56431222a140 0x564312227ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.483+0000 7f12ad000640 1 -- 172.21.15.8:0/3834992820 learned_addr learned my addr 172.21.15.8:0/3834992820 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f12ad000640 1 -- 172.21.15.8:0/3834992820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56431222a140 msgr2=0x564312227ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f12ad000640 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56431222a140 0x564312227ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f12ad000640 1 -- 172.21.15.8:0/3834992820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312221560 msgr2=0x564312227660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f12ad000640 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312221560 0x564312227660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f12ad000640 1 -- 172.21.15.8:0/3834992820 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c00b9d0 con 0x564312220c40 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f12ada00640 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56431222a140 0x564312227ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f12ad000640 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 0x564312227120 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f129c000c00 tx=0x7f129c005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=593be968f3c3957b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f128ea00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:04:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f128ea00640 1 -- 172.21.15.8:0/3834992820 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c011640 con 0x564312220c40 2024-03-16T21:04:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f128ea00640 1 -- 172.21.15.8:0/3834992820 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f129c017070 con 0x564312220c40 2024-03-16T21:04:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f12b27e8740 1 -- 172.21.15.8:0/3834992820 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564311e877e0 con 0x564312220c40 2024-03-16T21:04:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f128ea00640 1 -- 172.21.15.8:0/3834992820 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f129c011dd0 con 0x564312220c40 2024-03-16T21:04:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f12b27e8740 10 client.27184 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.484+0000 7f12b27e8740 1 -- 172.21.15.8:0/3834992820 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5643121865a0 con 0x564312220c40 2024-03-16T21:04:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.485+0000 7f128ea00640 1 -- 172.21.15.8:0/3834992820 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f129c032080 con 0x564312220c40 2024-03-16T21:04:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.485+0000 7f128ea00640 1 -- 172.21.15.8:0/3834992820 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f129c01a4d0 con 0x564312220c40 2024-03-16T21:04:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.485+0000 7f12b27e8740 10 client.27184 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.485+0000 7f12b27e8740 10 client.27184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.485+0000 7f12b27e8740 20 client.27184 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.485+0000 7f12b27e8740 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56431223a100 0x56431223c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.485+0000 7f12b27e8740 4 client.27184 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.485+0000 7f12b27e8740 1 -- 172.21.15.8:0/3834992820 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564311ec4720 con 0x56431223a100 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.485+0000 7f12a7e00640 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56431223a100 0x56431223c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.486+0000 7f12a7e00640 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56431223a100 0x56431223c510 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6697961939cb292 server_cookie=2ccd14abe4dcaef9 in_seq=0 out_seq=0 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.486+0000 7f128ea00640 10 client.27184 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f128ea00640 1 -- 172.21.15.8:0/3834992820 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x564311ec4720 con 0x56431223a100 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f128ea00640 10 client.27184 handle_command_reply: tid=0 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 1 client.27184 shutdown 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 1 -- 172.21.15.8:0/3834992820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 msgr2=0x564312227120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 0x564312227120 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f129c000c00 tx=0x7f129c005270 comp rx=0 tx=0).stop 2024-03-16T21:04:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 1 -- 172.21.15.8:0/3834992820 shutdown_connections 2024-03-16T21:04:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56431222a140 0x564312227ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56431223a100 0x56431223c510 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312221560 0x564312227660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 1 --2- 172.21.15.8:0/3834992820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564312220c40 0x564312227120 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 1 -- 172.21.15.8:0/3834992820 >> 172.21.15.8:0/3834992820 conn(0x56431221b370 msgr2=0x56431221d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f128ea00640 0 client.27184 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 1 -- 172.21.15.8:0/3834992820 shutdown_connections 2024-03-16T21:04:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 1 -- 172.21.15.8:0/3834992820 wait complete. 2024-03-16T21:04:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.487+0000 7f12b27e8740 20 client.27184 trim_cache size 0 max 16384 2024-03-16T21:04:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.501+0000 7f12b27e8740 1 Processor -- start 2024-03-16T21:04:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.501+0000 7f12b27e8740 1 -- start start 2024-03-16T21:04:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.501+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312220c40 0x564312229850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.501+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x5643122279c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.501+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56431222a140 0x5643122354c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.501+0000 7f12b27e8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564312216ae0 con 0x564312220c40 2024-03-16T21:04:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.501+0000 7f12b27e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56431221abf0 con 0x564312221560 2024-03-16T21:04:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.501+0000 7f12b27e8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56431221c370 con 0x56431222a140 2024-03-16T21:04:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f12a7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x5643122279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f12ad000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312220c40 0x564312229850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f12a7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x5643122279c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37858/0 (socket says 172.21.15.8:37858) 2024-03-16T21:04:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f12a7e00640 1 -- 172.21.15.8:0/2891511005 learned_addr learned my addr 172.21.15.8:0/2891511005 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f12ada00640 1 --2- 172.21.15.8:0/2891511005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56431222a140 0x5643122354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f12a7e00640 1 -- 172.21.15.8:0/2891511005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56431222a140 msgr2=0x5643122354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f12a7e00640 1 --2- 172.21.15.8:0/2891511005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56431222a140 0x5643122354c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f12a7e00640 1 -- 172.21.15.8:0/2891511005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312220c40 msgr2=0x564312229850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f12a7e00640 1 --2- 172.21.15.8:0/2891511005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312220c40 0x564312229850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f12a7e00640 1 -- 172.21.15.8:0/2891511005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564312122ab0 con 0x564312221560 2024-03-16T21:04:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f12a7e00640 1 --2- 172.21.15.8:0/2891511005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x5643122279c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f129409a430 tx=0x7f1294085040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3af276f91d340d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f1299600640 1 -- 172.21.15.8:0/2891511005 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12940b8ea0 con 0x564312221560 2024-03-16T21:04:55.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f1299600640 1 -- 172.21.15.8:0/2891511005 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f12940cfe90 con 0x564312221560 2024-03-16T21:04:55.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.502+0000 7f1299600640 1 -- 172.21.15.8:0/2891511005 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12940cb4d0 con 0x564312221560 2024-03-16T21:04:55.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.503+0000 7f12b27e8740 1 -- 172.21.15.8:0/2891511005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 msgr2=0x5643122279c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.503+0000 7f12b27e8740 1 --2- 172.21.15.8:0/2891511005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x5643122279c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f129409a430 tx=0x7f1294085040 comp rx=0 tx=0).stop 2024-03-16T21:04:55.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.503+0000 7f12b27e8740 1 -- 172.21.15.8:0/2891511005 shutdown_connections 2024-03-16T21:04:55.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.503+0000 7f12b27e8740 1 --2- 172.21.15.8:0/2891511005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56431222a140 0x5643122354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.503+0000 7f12b27e8740 1 --2- 172.21.15.8:0/2891511005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x5643122279c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.503+0000 7f12b27e8740 1 --2- 172.21.15.8:0/2891511005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312220c40 0x564312229850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.503+0000 7f12b27e8740 1 -- 172.21.15.8:0/2891511005 >> 172.21.15.8:0/2891511005 conn(0x56431221b370 msgr2=0x56431221b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.503+0000 7f12b27e8740 1 -- 172.21.15.8:0/2891511005 shutdown_connections 2024-03-16T21:04:55.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.503+0000 7f12b27e8740 1 -- 172.21.15.8:0/2891511005 wait complete. 2024-03-16T21:04:55.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.504+0000 7f12b27e8740 1 -- start start 2024-03-16T21:04:55.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.504+0000 7f12b27e8740 1 Processor -- start 2024-03-16T21:04:55.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.504+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312220c40 0x564312223a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.504+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312223f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.504+0000 7f12b27e8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56431222a140 0x5643122949e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.504+0000 7f12b27e8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564312224710 con 0x564312220c40 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.504+0000 7f12b27e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564312224880 con 0x564312221560 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.504+0000 7f12b27e8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564312294f20 con 0x56431222a140 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.504+0000 7f12b27e8740 10 client.0 _ll_register_callbacks cb 0x7f12a0037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12a7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312223f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12ad000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312220c40 0x564312223a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12a7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312223f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37860/0 (socket says 172.21.15.8:37860) 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12a7e00640 1 -- 172.21.15.8:0/1017529687 learned_addr learned my addr 172.21.15.8:0/1017529687 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12ada00640 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56431222a140 0x5643122949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12a7e00640 1 -- 172.21.15.8:0/1017529687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56431222a140 msgr2=0x5643122949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12a7e00640 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56431222a140 0x5643122949e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12a7e00640 1 -- 172.21.15.8:0/1017529687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312220c40 msgr2=0x564312223a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12a7e00640 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312220c40 0x564312223a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12a7e00640 1 -- 172.21.15.8:0/1017529687 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a81aafe0 con 0x564312221560 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12a7e00640 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312223f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f129400e9c0 tx=0x7f12940d3120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7689d2bf4ab0abb1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f128ea00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f128ea00640 1 -- 172.21.15.8:0/1017529687 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12940b8ea0 con 0x564312221560 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f128ea00640 1 -- 172.21.15.8:0/1017529687 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f12940a2ed0 con 0x564312221560 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.505+0000 7f12b27e8740 1 -- 172.21.15.8:0/1017529687 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f129c015070 con 0x564312221560 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f128ea00640 1 -- 172.21.15.8:0/1017529687 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12940b3220 con 0x564312221560 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f12b27e8740 10 client.27182 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f12b27e8740 1 -- 172.21.15.8:0/1017529687 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564312148650 con 0x564312221560 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f128ea00640 1 -- 172.21.15.8:0/1017529687 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f129c015070 con 0x564312221560 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f128ea00640 1 -- 172.21.15.8:0/1017529687 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f12940ba0e0 con 0x564312221560 2024-03-16T21:04:55.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f12b27e8740 10 client.27182 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:55.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f12b27e8740 10 client.27182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:55.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f12b27e8740 20 client.27182 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:55.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f12b27e8740 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5643122964b0 0x5643122988d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:55.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f12b27e8740 4 client.27182 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:04:55.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f12b27e8740 1 -- 172.21.15.8:0/1017529687 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564311f13890 con 0x5643122964b0 2024-03-16T21:04:55.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.506+0000 7f12ad000640 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5643122964b0 0x5643122988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:55.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12ad000640 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5643122964b0 0x5643122988d0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99b78580585fc1dd server_cookie=d3fdbd981f6289d in_seq=0 out_seq=0 2024-03-16T21:04:55.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f128ea00640 10 client.27182 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:55.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f128ea00640 1 -- 172.21.15.8:0/1017529687 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564311f13890 con 0x5643122964b0 2024-03-16T21:04:55.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f128ea00640 10 client.27182 handle_command_reply: tid=0 2024-03-16T21:04:55.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12b27e8740 1 client.27182 shutdown 2024-03-16T21:04:55.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12b27e8740 1 -- 172.21.15.8:0/1017529687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 msgr2=0x564312223f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12b27e8740 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312223f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f129400e9c0 tx=0x7f12940d3120 comp rx=0 tx=0).stop 2024-03-16T21:04:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12b27e8740 1 -- 172.21.15.8:0/1017529687 shutdown_connections 2024-03-16T21:04:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12b27e8740 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56431222a140 0x5643122949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12b27e8740 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564312221560 0x564312223f90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12b27e8740 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5643122964b0 0x5643122988d0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12b27e8740 1 --2- 172.21.15.8:0/1017529687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564312220c40 0x564312223a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f128ea00640 0 client.27182 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12b27e8740 1 -- 172.21.15.8:0/1017529687 >> 172.21.15.8:0/1017529687 conn(0x56431221b370 msgr2=0x564312219be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12b27e8740 1 -- 172.21.15.8:0/1017529687 shutdown_connections 2024-03-16T21:04:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.507+0000 7f12b27e8740 1 -- 172.21.15.8:0/1017529687 wait complete. 2024-03-16T21:04:55.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12b27e8740 20 client.27182 trim_cache size 0 max 16384 2024-03-16T21:04:55.518 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:04:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 -- 172.21.15.8:0/3274096975 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f12900a1ba0 msgr2=0x7f12900a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f12900a1ba0 0x7f12900a4060 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009bf0 tx=0x7f12a0004a40 comp rx=0 tx=0).stop 2024-03-16T21:04:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 -- 172.21.15.8:0/3274096975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12a8076340 msgr2=0x7f12a819e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12a8076340 0x7f12a819e7d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f129400e9f0 tx=0x7f129400eeb0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 -- 172.21.15.8:0/3274096975 shutdown_connections 2024-03-16T21:04:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f12900a1ba0 0x7f12900a4060 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12a8112330 0x7f12a81a2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12a8076340 0x7f12a819e7d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 --2- 172.21.15.8:0/3274096975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a8075a20 0x7f12a819e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 -- 172.21.15.8:0/3274096975 >> 172.21.15.8:0/3274096975 conn(0x7f12a80ff140 msgr2=0x7f12a8101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 -- 172.21.15.8:0/3274096975 shutdown_connections 2024-03-16T21:04:55.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:55.508+0000 7f12afa00640 1 -- 172.21.15.8:0/3274096975 wait complete. 2024-03-16T21:04:56.531 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:04:56.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:04:56.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:04:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.766+0000 7f0fd0600640 1 -- 172.21.15.8:0/4055156496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc8107a90 msgr2=0x7f0fc8107f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.766+0000 7f0fd0600640 1 --2- 172.21.15.8:0/4055156496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc8107a90 0x7f0fc8107f10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009900 tx=0x7f0fb402bc40 comp rx=0 tx=0).stop 2024-03-16T21:04:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.766+0000 7f0fd0600640 1 -- 172.21.15.8:0/4055156496 shutdown_connections 2024-03-16T21:04:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.766+0000 7f0fd0600640 1 --2- 172.21.15.8:0/4055156496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc8108450 0x7f0fc8114960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.766+0000 7f0fd0600640 1 --2- 172.21.15.8:0/4055156496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc8107a90 0x7f0fc8107f10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.766+0000 7f0fd0600640 1 --2- 172.21.15.8:0/4055156496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc810daa0 0x7f0fc810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.766+0000 7f0fd0600640 1 -- 172.21.15.8:0/4055156496 >> 172.21.15.8:0/4055156496 conn(0x7f0fc8075a30 msgr2=0x7f0fc8077e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:56.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.767+0000 7f0fd0600640 1 -- 172.21.15.8:0/4055156496 shutdown_connections 2024-03-16T21:04:56.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.767+0000 7f0fd0600640 1 -- 172.21.15.8:0/4055156496 wait complete. 2024-03-16T21:04:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fd0600640 1 Processor -- start 2024-03-16T21:04:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fd0600640 1 -- start start 2024-03-16T21:04:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fd0600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc8107a90 0x7f0fc819e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fd0600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc8108450 0x7f0fc819e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fd0600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc810daa0 0x7f0fc81a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fd0600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81a3130 con 0x7f0fc810daa0 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fd0600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81a32a0 con 0x7f0fc8108450 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fd0600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81a3460 con 0x7f0fc8107a90 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fcd200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc8108450 0x7f0fc819e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fcdc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc8107a90 0x7f0fc819e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fcd200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc8108450 0x7f0fc819e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37882/0 (socket says 172.21.15.8:37882) 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.768+0000 7f0fcd200640 1 -- 172.21.15.8:0/810207231 learned_addr learned my addr 172.21.15.8:0/810207231 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.769+0000 7f0fce600640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc810daa0 0x7f0fc81a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.769+0000 7f0fcd200640 1 -- 172.21.15.8:0/810207231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc8107a90 msgr2=0x7f0fc819e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.769+0000 7f0fcd200640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc8107a90 0x7f0fc819e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.769+0000 7f0fcd200640 1 -- 172.21.15.8:0/810207231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc810daa0 msgr2=0x7f0fc81a2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.769+0000 7f0fcd200640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc810daa0 0x7f0fc81a2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.769+0000 7f0fcd200640 1 -- 172.21.15.8:0/810207231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb4009560 con 0x7f0fc8108450 2024-03-16T21:04:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.769+0000 7f0fce600640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc810daa0 0x7f0fc81a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:04:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.769+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc8107a90 0x7f0fc819e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.769+0000 7f0fcd200640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc8108450 0x7f0fc819e7b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0fb402c250 tx=0x7f0fb402c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.769+0000 7f0fc6000640 1 -- 172.21.15.8:0/810207231 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40042d0 con 0x7f0fc8108450 2024-03-16T21:04:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.770+0000 7f0fc6000640 1 -- 172.21.15.8:0/810207231 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0fb4004430 con 0x7f0fc8108450 2024-03-16T21:04:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.770+0000 7f0fd0600640 1 -- 172.21.15.8:0/810207231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc81a36e0 con 0x7f0fc8108450 2024-03-16T21:04:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.770+0000 7f0fc6000640 1 -- 172.21.15.8:0/810207231 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4003cf0 con 0x7f0fc8108450 2024-03-16T21:04:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.770+0000 7f0fd0600640 1 -- 172.21.15.8:0/810207231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc81aafc0 con 0x7f0fc8108450 2024-03-16T21:04:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.774+0000 7f0fd325c740 1 Processor -- start 2024-03-16T21:04:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.774+0000 7f0fd325c740 1 -- start start 2024-03-16T21:04:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.774+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a861320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.774+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a869f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 0x56517a86c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fd325c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a81c300 con 0x56517a861860 2024-03-16T21:04:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fd325c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a7cee50 con 0x56517a86a440 2024-03-16T21:04:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fd325c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a7cc380 con 0x56517a860f40 2024-03-16T21:04:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fc6000640 1 -- 172.21.15.8:0/810207231 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f0fb4004e10 con 0x7f0fc8108450 2024-03-16T21:04:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fce600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a861320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fcdc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a869f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fce600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a861320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47654/0 (socket says 172.21.15.8:47654) 2024-03-16T21:04:56.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fce600640 1 -- 172.21.15.8:0/1359881885 learned_addr learned my addr 172.21.15.8:0/1359881885 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fcd200640 1 --2- 172.21.15.8:0/1359881885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 0x56517a86c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fce600640 1 -- 172.21.15.8:0/1359881885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 msgr2=0x56517a86c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fce600640 1 --2- 172.21.15.8:0/1359881885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 0x56517a86c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fce600640 1 -- 172.21.15.8:0/1359881885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 msgr2=0x56517a869f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fce600640 1 --2- 172.21.15.8:0/1359881885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a869f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fce600640 1 -- 172.21.15.8:0/1359881885 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56517a790c80 con 0x56517a860f40 2024-03-16T21:04:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.775+0000 7f0fcd200640 1 --2- 172.21.15.8:0/1359881885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 0x56517a86c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:04:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.776+0000 7f0fce600640 1 --2- 172.21.15.8:0/1359881885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a861320 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009fb0 tx=0x7f0fc0010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a41e5c32f9f77547 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.776+0000 7f0fbaa00640 1 -- 172.21.15.8:0/1359881885 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0012710 con 0x56517a860f40 2024-03-16T21:04:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.776+0000 7f0fbaa00640 1 -- 172.21.15.8:0/1359881885 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0fc0012d70 con 0x56517a860f40 2024-03-16T21:04:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.776+0000 7f0fbaa00640 1 -- 172.21.15.8:0/1359881885 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc00113e0 con 0x56517a860f40 2024-03-16T21:04:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.776+0000 7f0fc6000640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fb00a1c20 0x7f0fb00a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.776+0000 7f0fc6000640 1 -- 172.21.15.8:0/810207231 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0fb40efeb0 con 0x7f0fc8108450 2024-03-16T21:04:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.776+0000 7f0fd325c740 1 -- 172.21.15.8:0/1359881885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 msgr2=0x56517a861320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.776+0000 7f0fd325c740 1 --2- 172.21.15.8:0/1359881885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a861320 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009fb0 tx=0x7f0fc0010800 comp rx=0 tx=0).stop 2024-03-16T21:04:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.777+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fb00a1c20 0x7f0fb00a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.777+0000 7f0fd325c740 1 -- 172.21.15.8:0/1359881885 shutdown_connections 2024-03-16T21:04:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.777+0000 7f0fd325c740 1 --2- 172.21.15.8:0/1359881885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 0x56517a86c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.777+0000 7f0fd325c740 1 --2- 172.21.15.8:0/1359881885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a869f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.777+0000 7f0fd325c740 1 --2- 172.21.15.8:0/1359881885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a861320 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.777+0000 7f0fd325c740 1 -- 172.21.15.8:0/1359881885 >> 172.21.15.8:0/1359881885 conn(0x56517a85b670 msgr2=0x56517a85ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.777+0000 7f0fd325c740 1 -- 172.21.15.8:0/1359881885 shutdown_connections 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.777+0000 7f0fd325c740 1 -- 172.21.15.8:0/1359881885 wait complete. 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.777+0000 7f0fd325c740 1 -- start start 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.777+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fb00a1c20 0x7f0fb00a40e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x56517a860a10 tx=0x7f0fbc00b390 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.778+0000 7f0fd325c740 1 Processor -- start 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.778+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a867400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.778+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a867940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.778+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a86a440 0x56517a867e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.778+0000 7f0fd325c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a7c7b60 con 0x56517a861860 2024-03-16T21:04:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.778+0000 7f0fd325c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a76cfd0 con 0x56517a860f40 2024-03-16T21:04:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.778+0000 7f0fd325c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a76cc70 con 0x56517a86a440 2024-03-16T21:04:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.778+0000 7f0fd325c740 10 client.0 _ll_register_callbacks cb 0x56517a4d8c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.778+0000 7f0fcdc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a867400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.778+0000 7f0fcd200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a867940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.779+0000 7f0fce600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a86a440 0x56517a867e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.779+0000 7f0fcdc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a867400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37898/0 (socket says 172.21.15.8:37898) 2024-03-16T21:04:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.779+0000 7f0fcd200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a867940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56024/0 (socket says 172.21.15.8:56024) 2024-03-16T21:04:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.779+0000 7f0fcdc00640 1 -- 172.21.15.8:0/133500956 learned_addr learned my addr 172.21.15.8:0/133500956 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.779+0000 7f0fcdc00640 1 -- 172.21.15.8:0/133500956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a86a440 msgr2=0x56517a867e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.779+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/133500956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a86a440 0x56517a867e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.779+0000 7f0fcdc00640 1 -- 172.21.15.8:0/133500956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 msgr2=0x56517a867940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:56.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.779+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/133500956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a867940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.779+0000 7f0fcdc00640 1 -- 172.21.15.8:0/133500956 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc0009be0 con 0x56517a860f40 2024-03-16T21:04:56.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.779+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/133500956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a867400 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc010980 tx=0x7f0fbc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6831cfad1bad4221 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:56.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.779+0000 7f0faf400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:04:56.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.780+0000 7f0faf400640 1 -- 172.21.15.8:0/133500956 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc016070 con 0x56517a860f40 2024-03-16T21:04:56.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.780+0000 7f0faf400640 1 -- 172.21.15.8:0/133500956 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0fbc01fbc0 con 0x56517a860f40 2024-03-16T21:04:56.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.780+0000 7f0fd325c740 1 -- 172.21.15.8:0/133500956 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56517a4c7860 con 0x56517a860f40 2024-03-16T21:04:56.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.780+0000 7f0faf400640 1 -- 172.21.15.8:0/133500956 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fbc01fd80 con 0x56517a860f40 2024-03-16T21:04:56.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.780+0000 7f0fd325c740 10 client.27191 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:56.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.780+0000 7f0fd325c740 1 -- 172.21.15.8:0/133500956 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56517a7c61e0 con 0x56517a860f40 2024-03-16T21:04:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.780+0000 7f0faf400640 1 -- 172.21.15.8:0/133500956 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0fbc034080 con 0x56517a860f40 2024-03-16T21:04:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.780+0000 7f0faf400640 1 -- 172.21.15.8:0/133500956 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0fbc02e030 con 0x56517a860f40 2024-03-16T21:04:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.781+0000 7f0fd325c740 10 client.27191 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.781+0000 7f0fd325c740 10 client.27191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.781+0000 7f0fd325c740 20 client.27191 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.781+0000 7f0fd325c740 1 --2- 172.21.15.8:0/133500956 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56517a87a8f0 0x56517a87cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.781+0000 7f0fd325c740 4 client.27191 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.781+0000 7f0fd325c740 1 -- 172.21.15.8:0/133500956 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56517a518410 con 0x56517a87a8f0 2024-03-16T21:04:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.781+0000 7f0fcd200640 1 --2- 172.21.15.8:0/133500956 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56517a87a8f0 0x56517a87cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.781+0000 7f0faf400640 10 client.27191 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:56.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.781+0000 7f0fcd200640 1 --2- 172.21.15.8:0/133500956 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56517a87a8f0 0x56517a87cd10 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f72414a066ffe789 server_cookie=95b0bbd93538fe76 in_seq=0 out_seq=0 2024-03-16T21:04:56.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.782+0000 7f0faf400640 1 -- 172.21.15.8:0/133500956 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56517a518410 con 0x56517a87a8f0 2024-03-16T21:04:56.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.782+0000 7f0faf400640 10 client.27191 handle_command_reply: tid=0 2024-03-16T21:04:56.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.782+0000 7f0fd325c740 1 client.27191 shutdown 2024-03-16T21:04:56.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0fd325c740 1 -- 172.21.15.8:0/133500956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 msgr2=0x56517a867400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:56.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0fd325c740 1 --2- 172.21.15.8:0/133500956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a867400 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc010980 tx=0x7f0fbc004730 comp rx=0 tx=0).stop 2024-03-16T21:04:56.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0fd325c740 1 -- 172.21.15.8:0/133500956 shutdown_connections 2024-03-16T21:04:56.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0fd325c740 1 --2- 172.21.15.8:0/133500956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a86a440 0x56517a867e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0fd325c740 1 --2- 172.21.15.8:0/133500956 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56517a87a8f0 0x56517a87cd10 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0fd325c740 1 --2- 172.21.15.8:0/133500956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a867940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0fd325c740 1 --2- 172.21.15.8:0/133500956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a867400 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0faf400640 0 client.27191 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:56.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0fd325c740 1 -- 172.21.15.8:0/133500956 >> 172.21.15.8:0/133500956 conn(0x56517a85b670 msgr2=0x56517a85d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:56.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0fd325c740 1 -- 172.21.15.8:0/133500956 shutdown_connections 2024-03-16T21:04:56.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0fd325c740 1 -- 172.21.15.8:0/133500956 wait complete. 2024-03-16T21:04:56.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.783+0000 7f0fd325c740 20 client.27191 trim_cache size 0 max 16384 2024-03-16T21:04:56.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.801+0000 7f0fd325c740 1 Processor -- start 2024-03-16T21:04:56.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.801+0000 7f0fd325c740 1 -- start start 2024-03-16T21:04:56.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.801+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a869b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.801+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a867ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.801+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a86a440 0x56517a875850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.801+0000 7f0fd325c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a5100c0 con 0x56517a861860 2024-03-16T21:04:56.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.801+0000 7f0fd325c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a856f60 con 0x56517a860f40 2024-03-16T21:04:56.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.801+0000 7f0fd325c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a85c400 con 0x56517a86a440 2024-03-16T21:04:56.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.801+0000 7f0fcdc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a869b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.801+0000 7f0fcdc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a869b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37900/0 (socket says 172.21.15.8:37900) 2024-03-16T21:04:56.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.801+0000 7f0fcdc00640 1 -- 172.21.15.8:0/153066315 learned_addr learned my addr 172.21.15.8:0/153066315 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:56.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.802+0000 7f0fce600640 1 --2- 172.21.15.8:0/153066315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a86a440 0x56517a875850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.802+0000 7f0fcd200640 1 --2- 172.21.15.8:0/153066315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a867ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.802+0000 7f0fcdc00640 1 -- 172.21.15.8:0/153066315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a86a440 msgr2=0x56517a875850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:56.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.802+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/153066315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a86a440 0x56517a875850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.802+0000 7f0fcdc00640 1 -- 172.21.15.8:0/153066315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 msgr2=0x56517a867ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:56.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.802+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/153066315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a867ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.802+0000 7f0fcdc00640 1 -- 172.21.15.8:0/153066315 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56517a762a90 con 0x56517a860f40 2024-03-16T21:04:56.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.802+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/153066315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a869b30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc000c00 tx=0x7f0fbc004680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8b32df294512a3e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.802+0000 7f0fba000640 1 -- 172.21.15.8:0/153066315 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc030400 con 0x56517a860f40 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.803+0000 7f0fba000640 1 -- 172.21.15.8:0/153066315 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x56517a4c7860 con 0x56517a860f40 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.803+0000 7f0fba000640 1 -- 172.21.15.8:0/153066315 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc028e00 con 0x56517a860f40 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.803+0000 7f0fd325c740 1 -- 172.21.15.8:0/153066315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 msgr2=0x56517a869b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.803+0000 7f0fd325c740 1 --2- 172.21.15.8:0/153066315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a869b30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc000c00 tx=0x7f0fbc004680 comp rx=0 tx=0).stop 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.803+0000 7f0fd325c740 1 -- 172.21.15.8:0/153066315 shutdown_connections 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.803+0000 7f0fd325c740 1 --2- 172.21.15.8:0/153066315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a86a440 0x56517a875850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.803+0000 7f0fd325c740 1 --2- 172.21.15.8:0/153066315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a867ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.803+0000 7f0fd325c740 1 --2- 172.21.15.8:0/153066315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a860f40 0x56517a869b30 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.803+0000 7f0fd325c740 1 -- 172.21.15.8:0/153066315 >> 172.21.15.8:0/153066315 conn(0x56517a85b670 msgr2=0x56517a85d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.803+0000 7f0fd325c740 1 -- 172.21.15.8:0/153066315 shutdown_connections 2024-03-16T21:04:56.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.803+0000 7f0fd325c740 1 -- 172.21.15.8:0/153066315 wait complete. 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.804+0000 7f0fd325c740 1 -- start start 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.804+0000 7f0fd325c740 1 Processor -- start 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.804+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a86f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.804+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a86f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.804+0000 7f0fd325c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 0x56517a86fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.804+0000 7f0fd325c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a8d6310 con 0x56517a861860 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.804+0000 7f0fd325c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a8d6480 con 0x56517a86a440 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.804+0000 7f0fd325c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56517a8d6640 con 0x56517a860f40 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fd325c740 10 client.0 _ll_register_callbacks cb 0x7f0fbc0105d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fcdc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a86f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fce600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 0x56517a86fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fcdc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a86f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47676/0 (socket says 172.21.15.8:47676) 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fcdc00640 1 -- 172.21.15.8:0/3713320312 learned_addr learned my addr 172.21.15.8:0/3713320312 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fcd200640 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a86f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fcdc00640 1 -- 172.21.15.8:0/3713320312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 msgr2=0x56517a86fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 0x56517a86fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fcdc00640 1 -- 172.21.15.8:0/3713320312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 msgr2=0x56517a86f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a86f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fcdc00640 1 -- 172.21.15.8:0/3713320312 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56517a7c61e0 con 0x56517a860f40 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fce600640 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 0x56517a86fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0fcdc00640 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a86f360 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc018040 tx=0x7f0fbc01fdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1357e7b992fd3d9d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.805+0000 7f0faf400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0faf400640 1 -- 172.21.15.8:0/3713320312 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc042070 con 0x56517a860f40 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0faf400640 1 -- 172.21.15.8:0/3713320312 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0fbc030400 con 0x56517a860f40 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0fd325c740 1 -- 172.21.15.8:0/3713320312 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0fc0012d70 con 0x56517a860f40 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0faf400640 1 -- 172.21.15.8:0/3713320312 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fbc028d90 con 0x56517a860f40 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0fd325c740 10 client.27208 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0fd325c740 1 -- 172.21.15.8:0/3713320312 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56517a7886a0 con 0x56517a860f40 2024-03-16T21:04:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0faf400640 1 -- 172.21.15.8:0/3713320312 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0fc0012d70 con 0x56517a860f40 2024-03-16T21:04:56.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0faf400640 1 -- 172.21.15.8:0/3713320312 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0fbc0035f0 con 0x56517a860f40 2024-03-16T21:04:56.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0fd325c740 10 client.27208 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:56.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0fd325c740 10 client.27208 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:56.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0fd325c740 20 client.27208 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:56.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.806+0000 7f0fd325c740 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56517a8d7a80 0x56517a8d9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:56.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.807+0000 7f0fd325c740 4 client.27208 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:04:56.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.807+0000 7f0fd325c740 1 -- 172.21.15.8:0/3713320312 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56517a5047b0 con 0x56517a8d7a80 2024-03-16T21:04:56.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.807+0000 7f0fcd200640 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56517a8d7a80 0x56517a8d9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.807+0000 7f0fcd200640 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56517a8d7a80 0x56517a8d9e70 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7c69e4c226d5f41 server_cookie=bd1e14058ef3aaea in_seq=0 out_seq=0 2024-03-16T21:04:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.807+0000 7f0faf400640 10 client.27208 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0faf400640 1 -- 172.21.15.8:0/3713320312 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56517a5047b0 con 0x56517a8d7a80 2024-03-16T21:04:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0faf400640 10 client.27208 handle_command_reply: tid=0 2024-03-16T21:04:56.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0fd325c740 1 client.27208 shutdown 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0fd325c740 1 -- 172.21.15.8:0/3713320312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 msgr2=0x56517a86f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0fd325c740 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a86f360 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc018040 tx=0x7f0fbc01fdf0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0fd325c740 1 -- 172.21.15.8:0/3713320312 shutdown_connections 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0fd325c740 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56517a86a440 0x56517a86fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0fd325c740 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56517a8d7a80 0x56517a8d9e70 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0fd325c740 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56517a861860 0x56517a86f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0fd325c740 1 --2- 172.21.15.8:0/3713320312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56517a860f40 0x56517a86f360 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0faf400640 0 client.27208 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.808+0000 7f0fd325c740 1 -- 172.21.15.8:0/3713320312 >> 172.21.15.8:0/3713320312 conn(0x56517a85b670 msgr2=0x56517a859e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd325c740 1 -- 172.21.15.8:0/3713320312 shutdown_connections 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd325c740 1 -- 172.21.15.8:0/3713320312 wait complete. 2024-03-16T21:04:56.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd325c740 20 client.27208 trim_cache size 0 max 16384 2024-03-16T21:04:56.818 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:04:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:04:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "502745c9-d837-4727-8bb4-4aa3feaf78a0", 2024-03-16T21:04:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:04:56.818 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:04:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd0600640 1 -- 172.21.15.8:0/810207231 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fb00a1c20 msgr2=0x7f0fb00a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd0600640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fb00a1c20 0x7f0fb00a40e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x56517a860a10 tx=0x7f0fbc00b390 comp rx=0 tx=0).stop 2024-03-16T21:04:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd0600640 1 -- 172.21.15.8:0/810207231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc8108450 msgr2=0x7f0fc819e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd0600640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc8108450 0x7f0fc819e7b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0fb402c250 tx=0x7f0fb402c720 comp rx=0 tx=0).stop 2024-03-16T21:04:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd0600640 1 -- 172.21.15.8:0/810207231 shutdown_connections 2024-03-16T21:04:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd0600640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0fb00a1c20 0x7f0fb00a40e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd0600640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc810daa0 0x7f0fc81a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd0600640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0fc8108450 0x7f0fc819e7b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd0600640 1 --2- 172.21.15.8:0/810207231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0fc8107a90 0x7f0fc819e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.809+0000 7f0fd0600640 1 -- 172.21.15.8:0/810207231 >> 172.21.15.8:0/810207231 conn(0x7f0fc8075a30 msgr2=0x7f0fc8075f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.810+0000 7f0fd0600640 1 -- 172.21.15.8:0/810207231 shutdown_connections 2024-03-16T21:04:56.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:56.810+0000 7f0fd0600640 1 -- 172.21.15.8:0/810207231 wait complete. 2024-03-16T21:04:56.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:04:56.833 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:04:57.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.054+0000 7f35a9a00640 1 -- 172.21.15.8:0/2788494975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a41096a0 msgr2=0x7f35a4109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:57.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.054+0000 7f35a9a00640 1 --2- 172.21.15.8:0/2788494975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a41096a0 0x7f35a4109a80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3594009cd0 tx=0x7f359402c0f0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.054+0000 7f35a9a00640 1 -- 172.21.15.8:0/2788494975 shutdown_connections 2024-03-16T21:04:57.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.054+0000 7f35a9a00640 1 --2- 172.21.15.8:0/2788494975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35a4104050 0x7f35a4110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.054+0000 7f35a9a00640 1 --2- 172.21.15.8:0/2788494975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35a4103690 0x7f35a4103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.054+0000 7f35a9a00640 1 --2- 172.21.15.8:0/2788494975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a41096a0 0x7f35a4109a80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.054+0000 7f35a9a00640 1 -- 172.21.15.8:0/2788494975 >> 172.21.15.8:0/2788494975 conn(0x7f35a40ff160 msgr2=0x7f35a4101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:57.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.054+0000 7f35a9a00640 1 -- 172.21.15.8:0/2788494975 shutdown_connections 2024-03-16T21:04:57.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.054+0000 7f35a9a00640 1 -- 172.21.15.8:0/2788494975 wait complete. 2024-03-16T21:04:57.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.055+0000 7f35a9a00640 1 Processor -- start 2024-03-16T21:04:57.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a9a00640 1 -- start start 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a9a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35a4103690 0x7f35a4199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a9a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a4104050 0x7f35a419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a9a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35a41096a0 0x7f35a419e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a9a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a419ecd0 con 0x7f35a41096a0 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a9a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a419ee40 con 0x7f35a4103690 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a9a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a419f000 con 0x7f35a4104050 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35a4103690 0x7f35a4199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a2000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a4104050 0x7f35a419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35a41096a0 0x7f35a419e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a2000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a4104050 0x7f35a419a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47696/0 (socket says 172.21.15.8:47696) 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35a4103690 0x7f35a4199e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37922/0 (socket says 172.21.15.8:37922) 2024-03-16T21:04:57.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.056+0000 7f35a2000640 1 -- 172.21.15.8:0/1812884396 learned_addr learned my addr 172.21.15.8:0/1812884396 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:57.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.057+0000 7f35a2000640 1 -- 172.21.15.8:0/1812884396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35a4103690 msgr2=0x7f35a4199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:57.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.057+0000 7f35a2000640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35a4103690 0x7f35a4199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.057+0000 7f35a2000640 1 -- 172.21.15.8:0/1812884396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35a41096a0 msgr2=0x7f35a419e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:57.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.057+0000 7f35a2000640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35a41096a0 0x7f35a419e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.057+0000 7f35a2000640 1 -- 172.21.15.8:0/1812884396 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594009900 con 0x7f35a4104050 2024-03-16T21:04:57.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.057+0000 7f35a2a00640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35a4103690 0x7f35a4199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:57.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.057+0000 7f35a2000640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a4104050 0x7f35a419a350 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e9f0 tx=0x7f358c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:57.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.057+0000 7f359b400640 1 -- 172.21.15.8:0/1812884396 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c009700 con 0x7f35a4104050 2024-03-16T21:04:57.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.058+0000 7f359b400640 1 -- 172.21.15.8:0/1812884396 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f358c00cd80 con 0x7f35a4104050 2024-03-16T21:04:57.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.058+0000 7f359b400640 1 -- 172.21.15.8:0/1812884396 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0189c0 con 0x7f35a4104050 2024-03-16T21:04:57.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.058+0000 7f35a9a00640 1 -- 172.21.15.8:0/1812884396 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a419f2e0 con 0x7f35a4104050 2024-03-16T21:04:57.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.058+0000 7f35a9a00640 1 -- 172.21.15.8:0/1812884396 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a41a6b60 con 0x7f35a4104050 2024-03-16T21:04:57.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.061+0000 7f359b400640 1 -- 172.21.15.8:0/1812884396 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f358c018b20 con 0x7f35a4104050 2024-03-16T21:04:57.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.061+0000 7f35ac646740 1 Processor -- start 2024-03-16T21:04:57.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.061+0000 7f35ac646740 1 -- start start 2024-03-16T21:04:57.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.061+0000 7f35ac646740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7dccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.061+0000 7f35ac646740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.061+0000 7f35ac646740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35ac646740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a74c150 con 0x56314a7ddfa0 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35ac646740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a749680 con 0x56314a7dd2c0 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35ac646740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a744e60 con 0x56314a7e6630 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35a3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7dccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35a2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35a2000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35a2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37928/0 (socket says 172.21.15.8:37928) 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35a2a00640 1 -- 172.21.15.8:0/1475842795 learned_addr learned my addr 172.21.15.8:0/1475842795 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35a3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7dccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56068/0 (socket says 172.21.15.8:56068) 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35a2a00640 1 -- 172.21.15.8:0/1475842795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 msgr2=0x56314a7e8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35a2a00640 1 --2- 172.21.15.8:0/1475842795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35a2a00640 1 -- 172.21.15.8:0/1475842795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 msgr2=0x56314a7dccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35a2a00640 1 --2- 172.21.15.8:0/1475842795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7dccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.062+0000 7f35a2a00640 1 -- 172.21.15.8:0/1475842795 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56314a6fe060 con 0x56314a7dd2c0 2024-03-16T21:04:57.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.063+0000 7f35a2a00640 1 --2- 172.21.15.8:0/1475842795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dd740 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f359402c700 tx=0x7f3594005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84e18ba4d3a9dee5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.063+0000 7f3593e00640 1 -- 172.21.15.8:0/1475842795 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594034640 con 0x56314a7dd2c0 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.063+0000 7f3593e00640 1 -- 172.21.15.8:0/1475842795 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f35940347a0 con 0x56314a7dd2c0 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.063+0000 7f3593e00640 1 -- 172.21.15.8:0/1475842795 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594004040 con 0x56314a7dd2c0 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.063+0000 7f359b400640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35880a1ba0 0x7f35880a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.063+0000 7f359b400640 1 -- 172.21.15.8:0/1812884396 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f358c014070 con 0x7f35a4104050 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.063+0000 7f35a3400640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35880a1ba0 0x7f35880a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.064+0000 7f35ac646740 1 -- 172.21.15.8:0/1475842795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 msgr2=0x56314a7dd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.064+0000 7f35ac646740 1 --2- 172.21.15.8:0/1475842795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dd740 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f359402c700 tx=0x7f3594005ef0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.064+0000 7f35ac646740 1 -- 172.21.15.8:0/1475842795 shutdown_connections 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.064+0000 7f35ac646740 1 --2- 172.21.15.8:0/1475842795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.064+0000 7f35ac646740 1 --2- 172.21.15.8:0/1475842795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dd740 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.064+0000 7f35ac646740 1 --2- 172.21.15.8:0/1475842795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7dccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.064+0000 7f35ac646740 1 -- 172.21.15.8:0/1475842795 >> 172.21.15.8:0/1475842795 conn(0x56314a7a45a0 msgr2=0x56314a7d7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.064+0000 7f35ac646740 1 -- 172.21.15.8:0/1475842795 shutdown_connections 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.064+0000 7f35ac646740 1 -- 172.21.15.8:0/1475842795 wait complete. 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.064+0000 7f35a3400640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35880a1ba0 0x7f35880a4060 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f359c009d20 tx=0x7f359c005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.065+0000 7f35ac646740 1 -- start start 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.065+0000 7f35ac646740 1 Processor -- start 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.065+0000 7f35ac646740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7e3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.065+0000 7f35ac646740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.065+0000 7f35ac646740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.065+0000 7f35ac646740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a6e9ec0 con 0x56314a7ddfa0 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.065+0000 7f35ac646740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a6e9b60 con 0x56314a7dd2c0 2024-03-16T21:04:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.065+0000 7f35ac646740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a4b31c0 con 0x56314a7e6630 2024-03-16T21:04:57.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.065+0000 7f35ac646740 10 client.0 _ll_register_callbacks cb 0x56314a6fd960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:57.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.065+0000 7f35a2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7e3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f35a2000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f35a3400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f35a2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7e3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37932/0 (socket says 172.21.15.8:37932) 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f35a2a00640 1 -- 172.21.15.8:0/1181547581 learned_addr learned my addr 172.21.15.8:0/1181547581 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f35a2a00640 1 -- 172.21.15.8:0/1181547581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 msgr2=0x56314a7e4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f35a2a00640 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f35a2a00640 1 -- 172.21.15.8:0/1181547581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 msgr2=0x56314a7e3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f35a2a00640 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7e3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f35a2a00640 1 -- 172.21.15.8:0/1181547581 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a4110e60 con 0x56314a7dd2c0 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f35a2000640 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f35a2a00640 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7e3580 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3594009430 tx=0x7f3594003af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=642a9f7c43f03cd5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.066+0000 7f3590c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f3590c00640 1 -- 172.21.15.8:0/1181547581 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594032bc0 con 0x56314a7dd2c0 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f3590c00640 1 -- 172.21.15.8:0/1181547581 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f359404a450 con 0x56314a7dd2c0 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f35ac646740 1 -- 172.21.15.8:0/1181547581 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56314a4447e0 con 0x56314a7dd2c0 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f3590c00640 1 -- 172.21.15.8:0/1181547581 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f359404a610 con 0x56314a7dd2c0 2024-03-16T21:04:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f35ac646740 10 client.27209 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f35ac646740 1 -- 172.21.15.8:0/1181547581 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56314a7434e0 con 0x56314a7dd2c0 2024-03-16T21:04:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f3590c00640 1 -- 172.21.15.8:0/1181547581 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3594060080 con 0x56314a7dd2c0 2024-03-16T21:04:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f3590c00640 1 -- 172.21.15.8:0/1181547581 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f359405a030 con 0x56314a7dd2c0 2024-03-16T21:04:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f35ac646740 10 client.27209 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f35ac646740 10 client.27209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f35ac646740 20 client.27209 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.067+0000 7f35ac646740 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56314a7f62d0 0x56314a7f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.068+0000 7f35ac646740 4 client.27209 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:04:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.068+0000 7f35ac646740 1 -- 172.21.15.8:0/1181547581 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56314a481720 con 0x56314a7f62d0 2024-03-16T21:04:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.068+0000 7f35a2000640 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56314a7f62d0 0x56314a7f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.068+0000 7f35a2000640 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56314a7f62d0 0x56314a7f86e0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94b66af455786c5 server_cookie=6601a3e1535732ea in_seq=0 out_seq=0 2024-03-16T21:04:57.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.068+0000 7f3590c00640 10 client.27209 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:57.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f3590c00640 1 -- 172.21.15.8:0/1181547581 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56314a481720 con 0x56314a7f62d0 2024-03-16T21:04:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f3590c00640 10 client.27209 handle_command_reply: tid=0 2024-03-16T21:04:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f35ac646740 1 client.27209 shutdown 2024-03-16T21:04:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f35ac646740 1 -- 172.21.15.8:0/1181547581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 msgr2=0x56314a7e3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f35ac646740 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7e3580 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3594009430 tx=0x7f3594003af0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f35ac646740 1 -- 172.21.15.8:0/1181547581 shutdown_connections 2024-03-16T21:04:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f35ac646740 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f35ac646740 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56314a7f62d0 0x56314a7f86e0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f35ac646740 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f35ac646740 1 --2- 172.21.15.8:0/1181547581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7e3580 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f3590c00640 0 client.27209 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:57.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f35ac646740 1 -- 172.21.15.8:0/1181547581 >> 172.21.15.8:0/1181547581 conn(0x56314a7a45a0 msgr2=0x56314a7d9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:57.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.069+0000 7f35ac646740 1 -- 172.21.15.8:0/1181547581 shutdown_connections 2024-03-16T21:04:57.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.070+0000 7f35ac646740 1 -- 172.21.15.8:0/1181547581 wait complete. 2024-03-16T21:04:57.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.070+0000 7f35ac646740 20 client.27209 trim_cache size 0 max 16384 2024-03-16T21:04:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.087+0000 7f35ac646740 1 Processor -- start 2024-03-16T21:04:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35ac646740 1 -- start start 2024-03-16T21:04:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35ac646740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7dd2c0 0x56314a7e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35ac646740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7d97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35ac646740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7e6630 0x56314a7f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35ac646740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a7dc2f0 con 0x56314a7ddfa0 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35ac646740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a7d35e0 con 0x56314a7e6630 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35ac646740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a7e1ad0 con 0x56314a7dd2c0 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35a2a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7dd2c0 0x56314a7e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35a2a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7dd2c0 0x56314a7e5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:47718/0 (socket says 172.21.15.8:47718) 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35a2a00640 1 -- 172.21.15.8:0/2355006133 learned_addr learned my addr 172.21.15.8:0/2355006133 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35a3400640 1 --2- 172.21.15.8:0/2355006133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7e6630 0x56314a7f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.088+0000 7f35a2000640 1 --2- 172.21.15.8:0/2355006133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7d97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.089+0000 7f35a2a00640 1 -- 172.21.15.8:0/2355006133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7e6630 msgr2=0x56314a7f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.089+0000 7f35a2a00640 1 --2- 172.21.15.8:0/2355006133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7e6630 0x56314a7f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.089+0000 7f35a2a00640 1 -- 172.21.15.8:0/2355006133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 msgr2=0x56314a7d97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.089+0000 7f35a2a00640 1 --2- 172.21.15.8:0/2355006133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7d97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.089+0000 7f35a2a00640 1 -- 172.21.15.8:0/2355006133 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56314a6df950 con 0x56314a7dd2c0 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.089+0000 7f35a2a00640 1 --2- 172.21.15.8:0/2355006133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7dd2c0 0x56314a7e5cb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3594002230 tx=0x7f35940326f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=110e113f20e48c5b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.089+0000 7f3593400640 1 -- 172.21.15.8:0/2355006133 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594003970 con 0x56314a7dd2c0 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.089+0000 7f3593400640 1 -- 172.21.15.8:0/2355006133 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x56314a4447e0 con 0x56314a7dd2c0 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.089+0000 7f3593400640 1 -- 172.21.15.8:0/2355006133 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359404a950 con 0x56314a7dd2c0 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.090+0000 7f35ac646740 1 -- 172.21.15.8:0/2355006133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7dd2c0 msgr2=0x56314a7e5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.090+0000 7f35ac646740 1 --2- 172.21.15.8:0/2355006133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7dd2c0 0x56314a7e5cb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3594002230 tx=0x7f35940326f0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.090+0000 7f35ac646740 1 -- 172.21.15.8:0/2355006133 shutdown_connections 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.090+0000 7f35ac646740 1 --2- 172.21.15.8:0/2355006133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7e6630 0x56314a7f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.090+0000 7f35ac646740 1 --2- 172.21.15.8:0/2355006133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7d97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.090+0000 7f35ac646740 1 --2- 172.21.15.8:0/2355006133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7dd2c0 0x56314a7e5cb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.090+0000 7f35ac646740 1 -- 172.21.15.8:0/2355006133 >> 172.21.15.8:0/2355006133 conn(0x56314a7a45a0 msgr2=0x56314a7d90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.090+0000 7f35ac646740 1 -- 172.21.15.8:0/2355006133 shutdown_connections 2024-03-16T21:04:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.090+0000 7f35ac646740 1 -- 172.21.15.8:0/2355006133 wait complete. 2024-03-16T21:04:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.090+0000 7f35ac646740 1 -- start start 2024-03-16T21:04:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.090+0000 7f35ac646740 1 Processor -- start 2024-03-16T21:04:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35ac646740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35ac646740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7e0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35ac646740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35ac646740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a850b50 con 0x56314a7ddfa0 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35ac646740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a850c90 con 0x56314a7dd2c0 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35ac646740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314a850e50 con 0x56314a7e6630 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35ac646740 10 client.0 _ll_register_callbacks cb 0x7f359c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35a2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35a2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37952/0 (socket says 172.21.15.8:37952) 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35a2a00640 1 -- 172.21.15.8:0/4228017032 learned_addr learned my addr 172.21.15.8:0/4228017032 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35a2000640 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.091+0000 7f35a3400640 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f35a2a00640 1 -- 172.21.15.8:0/4228017032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 msgr2=0x56314a7e0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f35a2a00640 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f35a2a00640 1 -- 172.21.15.8:0/4228017032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 msgr2=0x56314a7e0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f35a2a00640 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7e0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f35a2a00640 1 -- 172.21.15.8:0/4228017032 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56314a7434e0 con 0x56314a7dd2c0 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f35a2a00640 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dfdf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3594034770 tx=0x7f3594032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eae68a29df5b313a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f3590c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f3590c00640 1 -- 172.21.15.8:0/4228017032 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359403f420 con 0x56314a7dd2c0 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f3590c00640 1 -- 172.21.15.8:0/4228017032 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3594032e70 con 0x56314a7dd2c0 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f35ac646740 1 -- 172.21.15.8:0/4228017032 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f35940347a0 con 0x56314a7dd2c0 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f3590c00640 1 -- 172.21.15.8:0/4228017032 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3594003b80 con 0x56314a7dd2c0 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f35ac646740 10 client.27215 fetch_fsmap learned FSMap version 36 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.092+0000 7f35ac646740 1 -- 172.21.15.8:0/4228017032 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56314a705430 con 0x56314a7dd2c0 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.093+0000 7f3590c00640 1 -- 172.21.15.8:0/4228017032 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f35940347a0 con 0x56314a7dd2c0 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.093+0000 7f3590c00640 1 -- 172.21.15.8:0/4228017032 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f3594071780 con 0x56314a7dd2c0 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.093+0000 7f35ac646740 10 client.27215 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:04:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.093+0000 7f35ac646740 10 client.27215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.093+0000 7f35ac646740 20 client.27215 populate_metadata read hostname 'smithi008' 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.093+0000 7f35ac646740 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56314a8520f0 0x56314a8544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.093+0000 7f35ac646740 4 client.27215 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.093+0000 7f35ac646740 1 -- 172.21.15.8:0/4228017032 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56314a4d0890 con 0x56314a8520f0 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.093+0000 7f35a2000640 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56314a8520f0 0x56314a8544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35a2000640 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56314a8520f0 0x56314a8544e0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d47fa9f740e43281 server_cookie=d634e0d37a58a3d9 in_seq=0 out_seq=0 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f3590c00640 10 client.27215 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f3590c00640 1 -- 172.21.15.8:0/4228017032 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56314a4d0890 con 0x56314a8520f0 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f3590c00640 10 client.27215 handle_command_reply: tid=0 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 1 client.27215 shutdown 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 1 -- 172.21.15.8:0/4228017032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 msgr2=0x56314a7dfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dfdf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3594034770 tx=0x7f3594032ce0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 1 -- 172.21.15.8:0/4228017032 shutdown_connections 2024-03-16T21:04:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56314a7e6630 0x56314a7e0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x56314a8520f0 0x56314a8544e0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56314a7ddfa0 0x56314a7e0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 1 --2- 172.21.15.8:0/4228017032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56314a7dd2c0 0x56314a7dfdf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 1 -- 172.21.15.8:0/4228017032 >> 172.21.15.8:0/4228017032 conn(0x56314a7a45a0 msgr2=0x56314a7d6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f3590c00640 0 client.27215 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:04:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 1 -- 172.21.15.8:0/4228017032 shutdown_connections 2024-03-16T21:04:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 1 -- 172.21.15.8:0/4228017032 wait complete. 2024-03-16T21:04:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.094+0000 7f35ac646740 20 client.27215 trim_cache size 0 max 16384 2024-03-16T21:04:57.105 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:04:57.105 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:04:57.106 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:04:57.106 INFO:teuthology.orchestra.run.smithi008.stdout: "502745c9-d837-4727-8bb4-4aa3feaf78a0": { 2024-03-16T21:04:57.106 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:04:57.106 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "502745c9-d837-4727-8bb4-4aa3feaf78a0", 2024-03-16T21:04:57.106 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:04:57.106 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:04:57.106 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:04:57.106 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:04:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 -- 172.21.15.8:0/1812884396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35880a1ba0 msgr2=0x7f35880a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35880a1ba0 0x7f35880a4060 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f359c009d20 tx=0x7f359c005f90 comp rx=0 tx=0).stop 2024-03-16T21:04:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 -- 172.21.15.8:0/1812884396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a4104050 msgr2=0x7f35a419a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:04:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a4104050 0x7f35a419a350 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e9f0 tx=0x7f358c00eeb0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 -- 172.21.15.8:0/1812884396 shutdown_connections 2024-03-16T21:04:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f35880a1ba0 0x7f35880a4060 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35a41096a0 0x7f35a419e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a4104050 0x7f35a419a350 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 --2- 172.21.15.8:0/1812884396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35a4103690 0x7f35a4199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:04:57.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 -- 172.21.15.8:0/1812884396 >> 172.21.15.8:0/1812884396 conn(0x7f35a40ff160 msgr2=0x7f35a40ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:04:57.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 -- 172.21.15.8:0/1812884396 shutdown_connections 2024-03-16T21:04:57.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:04:57.095+0000 7f35a9a00640 1 -- 172.21.15.8:0/1812884396 wait complete. 2024-03-16T21:04:57.117 INFO:tasks.cephfs.filesystem:scrub status for tag:502745c9-d837-4727-8bb4-4aa3feaf78a0 - {'path': '/', 'tag': '502745c9-d837-4727-8bb4-4aa3feaf78a0', 'options': 'recursive,force'} 2024-03-16T21:04:57.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:57 smithi008 ceph-mon[31434]: pgmap v218: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:04:57.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:57 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:04:57.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:57 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:57.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:57 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:04:57.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:57 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:57.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:57 smithi170 ceph-mon[35947]: pgmap v218: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:04:57.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:57 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:04:57.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:57 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:57.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:57 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:04:57.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:57 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:57.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:57 smithi186 ceph-mon[36391]: pgmap v218: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-16T21:04:57.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:57 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:04:57.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:57 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:57.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:57 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:04:57.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:57 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:04:58.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:58 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:04:58.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:58 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:04:58.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:58 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:04:59.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:04:59 smithi170 ceph-mon[35947]: pgmap v219: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:04:59.395 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:04:59 smithi186 ceph-mon[36391]: pgmap v219: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:04:59.501 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:04:59 smithi008 ceph-mon[31434]: pgmap v219: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:05:01.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:01 smithi170 ceph-mon[35947]: pgmap v220: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:01.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:01 smithi186 ceph-mon[36391]: pgmap v220: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:01.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:01 smithi008 ceph-mon[31434]: pgmap v220: 97 pgs: 97 active+clean; 172 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:03.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:03 smithi170 ceph-mon[35947]: pgmap v221: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-16T21:05:03.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:03 smithi186 ceph-mon[36391]: pgmap v221: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-16T21:05:03.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:03 smithi008 ceph-mon[31434]: pgmap v221: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-16T21:05:05.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:05 smithi170 ceph-mon[35947]: pgmap v222: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:05:05.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:05 smithi186 ceph-mon[36391]: pgmap v222: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:05:05.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:05 smithi008 ceph-mon[31434]: pgmap v222: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-16T21:05:07.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:07 smithi170 ceph-mon[35947]: pgmap v223: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:05:07.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:07 smithi186 ceph-mon[36391]: pgmap v223: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:05:07.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:07 smithi008 ceph-mon[31434]: pgmap v223: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:05:08.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:08 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:05:08.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:08 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:05:08.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:08 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:05:09.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:09 smithi170 ceph-mon[35947]: pgmap v224: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:05:09.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:09 smithi186 ceph-mon[36391]: pgmap v224: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:05:09.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:09 smithi008 ceph-mon[31434]: pgmap v224: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-03-16T21:05:10.370 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:10 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:05:10.370 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:10 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:05:10.370 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:10 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:05:10.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:10 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:05:10.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:10 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:05:10.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:10 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:05:10.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:10 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:05:10.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:10 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:05:10.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:10 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:05:11.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:11 smithi170 ceph-mon[35947]: pgmap v225: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:05:11.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:11 smithi186 ceph-mon[36391]: pgmap v225: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:05:11.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:11 smithi008 ceph-mon[31434]: pgmap v225: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-03-16T21:05:13.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:13 smithi170 ceph-mon[35947]: pgmap v226: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-16T21:05:13.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:13 smithi186 ceph-mon[36391]: pgmap v226: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-16T21:05:13.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:13 smithi008 ceph-mon[31434]: pgmap v226: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-16T21:05:15.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:15 smithi170 ceph-mon[35947]: pgmap v227: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-16T21:05:15.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:15 smithi186 ceph-mon[36391]: pgmap v227: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-16T21:05:15.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:15 smithi008 ceph-mon[31434]: pgmap v227: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-16T21:05:17.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:17 smithi170 ceph-mon[35947]: pgmap v228: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-16T21:05:17.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:17 smithi186 ceph-mon[36391]: pgmap v228: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-16T21:05:17.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:17 smithi008 ceph-mon[31434]: pgmap v228: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-16T21:05:19.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:19 smithi170 ceph-mon[35947]: pgmap v229: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:05:19.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:19 smithi186 ceph-mon[36391]: pgmap v229: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:05:19.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:19 smithi008 ceph-mon[31434]: pgmap v229: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:05:21.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:21 smithi170 ceph-mon[35947]: pgmap v230: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-16T21:05:21.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:21 smithi186 ceph-mon[36391]: pgmap v230: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-16T21:05:21.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:21 smithi008 ceph-mon[31434]: pgmap v230: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-16T21:05:23.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:23 smithi170 ceph-mon[35947]: pgmap v231: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-16T21:05:23.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:23 smithi186 ceph-mon[36391]: pgmap v231: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-16T21:05:23.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:23 smithi008 ceph-mon[31434]: pgmap v231: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-16T21:05:25.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:25 smithi170 ceph-mon[35947]: pgmap v232: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:25.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:25 smithi186 ceph-mon[36391]: pgmap v232: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:25.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:25 smithi008 ceph-mon[31434]: pgmap v232: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:27.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:05:27.119 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:05:27.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.345+0000 7f8e71e00640 1 -- 172.21.15.8:0/4085653312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e6c103590 msgr2=0x7f8e6c103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.345+0000 7f8e71e00640 1 --2- 172.21.15.8:0/4085653312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e6c103590 0x7f8e6c103a10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009930 tx=0x7f8e5802bc20 comp rx=0 tx=0).stop 2024-03-16T21:05:27.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.345+0000 7f8e71e00640 1 -- 172.21.15.8:0/4085653312 shutdown_connections 2024-03-16T21:05:27.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.345+0000 7f8e71e00640 1 --2- 172.21.15.8:0/4085653312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e6c103f50 0x7f8e6c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.345+0000 7f8e71e00640 1 --2- 172.21.15.8:0/4085653312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e6c103590 0x7f8e6c103a10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.345+0000 7f8e71e00640 1 --2- 172.21.15.8:0/4085653312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c109650 0x7f8e6c109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.345+0000 7f8e71e00640 1 -- 172.21.15.8:0/4085653312 >> 172.21.15.8:0/4085653312 conn(0x7f8e6c0ff020 msgr2=0x7f8e6c101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:27.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.345+0000 7f8e71e00640 1 -- 172.21.15.8:0/4085653312 shutdown_connections 2024-03-16T21:05:27.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.345+0000 7f8e71e00640 1 -- 172.21.15.8:0/4085653312 wait complete. 2024-03-16T21:05:27.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.346+0000 7f8e71e00640 1 Processor -- start 2024-03-16T21:05:27.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.346+0000 7f8e71e00640 1 -- start start 2024-03-16T21:05:27.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.347+0000 7f8e71e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e6c103590 0x7f8e6c19f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.347+0000 7f8e71e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e6c103f50 0x7f8e6c19fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.347+0000 7f8e71e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c109650 0x7f8e6c199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.347+0000 7f8e71e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c19a1a0 con 0x7f8e6c109650 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.347+0000 7f8e71e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c19a310 con 0x7f8e6c103590 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.347+0000 7f8e71e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c19a4d0 con 0x7f8e6c103f50 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.347+0000 7f8e70a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e6c103590 0x7f8e6c19f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.347+0000 7f8e70a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e6c103590 0x7f8e6c19f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45402/0 (socket says 172.21.15.8:45402) 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.347+0000 7f8e70a00640 1 -- 172.21.15.8:0/3510945494 learned_addr learned my addr 172.21.15.8:0/3510945494 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.347+0000 7f8e6be00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e6c103f50 0x7f8e6c19fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.347+0000 7f8e71400640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c109650 0x7f8e6c199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.348+0000 7f8e70a00640 1 -- 172.21.15.8:0/3510945494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e6c103f50 msgr2=0x7f8e6c19fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.348+0000 7f8e70a00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e6c103f50 0x7f8e6c19fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.348+0000 7f8e70a00640 1 -- 172.21.15.8:0/3510945494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c109650 msgr2=0x7f8e6c199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.348+0000 7f8e70a00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c109650 0x7f8e6c199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.348+0000 7f8e70a00640 1 -- 172.21.15.8:0/3510945494 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60009490 con 0x7f8e6c103590 2024-03-16T21:05:27.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.348+0000 7f8e70a00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e6c103590 0x7f8e6c19f950 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000ea60 tx=0x7f8e6000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:27.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.348+0000 7f8e69600640 1 -- 172.21.15.8:0/3510945494 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000cde0 con 0x7f8e6c103590 2024-03-16T21:05:27.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.348+0000 7f8e69600640 1 -- 172.21.15.8:0/3510945494 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8e600035f0 con 0x7f8e6c103590 2024-03-16T21:05:27.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.348+0000 7f8e69600640 1 -- 172.21.15.8:0/3510945494 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60010690 con 0x7f8e6c103590 2024-03-16T21:05:27.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.348+0000 7f8e71e00640 1 -- 172.21.15.8:0/3510945494 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e58009560 con 0x7f8e6c103590 2024-03-16T21:05:27.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.348+0000 7f8e71e00640 1 -- 172.21.15.8:0/3510945494 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c1a6810 con 0x7f8e6c103590 2024-03-16T21:05:27.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.352+0000 7f8e69600640 1 -- 172.21.15.8:0/3510945494 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f8e60003b80 con 0x7f8e6c103590 2024-03-16T21:05:27.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.352+0000 7f8e761a2740 1 Processor -- start 2024-03-16T21:05:27.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.352+0000 7f8e761a2740 1 -- start start 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.352+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db8690ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.352+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db8691910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.352+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db869a800 0x561db869cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.352+0000 7f8e761a2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db8600150 con 0x561db869a800 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e761a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db85fd680 con 0x561db8692170 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e761a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db85f8e60 con 0x561db8691490 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e71400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db8690ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e71400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db8690ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45418/0 (socket says 172.21.15.8:45418) 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e71400640 1 -- 172.21.15.8:0/1524121113 learned_addr learned my addr 172.21.15.8:0/1524121113 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e70a00640 1 --2- 172.21.15.8:0/1524121113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db8691910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e6be00640 1 --2- 172.21.15.8:0/1524121113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db869a800 0x561db869cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e71400640 1 -- 172.21.15.8:0/1524121113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 msgr2=0x561db8691910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e71400640 1 --2- 172.21.15.8:0/1524121113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db8691910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e71400640 1 -- 172.21.15.8:0/1524121113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db869a800 msgr2=0x561db869cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e71400640 1 --2- 172.21.15.8:0/1524121113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db869a800 0x561db869cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e71400640 1 -- 172.21.15.8:0/1524121113 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561db85b2060 con 0x561db8692170 2024-03-16T21:05:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.353+0000 7f8e70a00640 1 --2- 172.21.15.8:0/1524121113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db8691910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:05:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.354+0000 7f8e71400640 1 --2- 172.21.15.8:0/1524121113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db8690ec0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009fd0 tx=0x7f8e640118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66da44076c1d82c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.354+0000 7f8e5dc00640 1 -- 172.21.15.8:0/1524121113 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64004d20 con 0x561db8692170 2024-03-16T21:05:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.354+0000 7f8e5dc00640 1 -- 172.21.15.8:0/1524121113 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8e64004e80 con 0x561db8692170 2024-03-16T21:05:27.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.354+0000 7f8e5dc00640 1 -- 172.21.15.8:0/1524121113 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64005240 con 0x561db8692170 2024-03-16T21:05:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.354+0000 7f8e69600640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e540a1c20 0x7f8e540a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e70a00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e540a1c20 0x7f8e540a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e69600640 1 -- 172.21.15.8:0/3510945494 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8e60014070 con 0x7f8e6c103590 2024-03-16T21:05:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e761a2740 1 -- 172.21.15.8:0/1524121113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 msgr2=0x561db8690ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e761a2740 1 --2- 172.21.15.8:0/1524121113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db8690ec0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009fd0 tx=0x7f8e640118d0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e761a2740 1 -- 172.21.15.8:0/1524121113 shutdown_connections 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e761a2740 1 --2- 172.21.15.8:0/1524121113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db869a800 0x561db869cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e761a2740 1 --2- 172.21.15.8:0/1524121113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db8691910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e761a2740 1 --2- 172.21.15.8:0/1524121113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db8690ec0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e761a2740 1 -- 172.21.15.8:0/1524121113 >> 172.21.15.8:0/1524121113 conn(0x561db86585a0 msgr2=0x561db868bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e761a2740 1 -- 172.21.15.8:0/1524121113 shutdown_connections 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e761a2740 1 -- 172.21.15.8:0/1524121113 wait complete. 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.355+0000 7f8e70a00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e540a1c20 0x7f8e540a40e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x561db86926c0 tx=0x7f8e6000ef90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.356+0000 7f8e761a2740 1 -- start start 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.356+0000 7f8e761a2740 1 Processor -- start 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.356+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db86977d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.356+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db8692170 0x561db8697d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.356+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db869a800 0x561db8698250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.356+0000 7f8e761a2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db859dec0 con 0x561db8692170 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.356+0000 7f8e761a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db859db60 con 0x561db869a800 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.356+0000 7f8e761a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db83671c0 con 0x561db8691490 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.356+0000 7f8e761a2740 10 client.0 _ll_register_callbacks cb 0x561db85b1960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.357+0000 7f8e71400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db86977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.357+0000 7f8e6be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db8692170 0x561db8697d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.357+0000 7f8e71400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db86977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53264/0 (socket says 172.21.15.8:53264) 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.357+0000 7f8e71400640 1 -- 172.21.15.8:0/4000895252 learned_addr learned my addr 172.21.15.8:0/4000895252 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.357+0000 7f8e71400640 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db869a800 0x561db8698250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.357+0000 7f8e6be00640 1 -- 172.21.15.8:0/4000895252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 msgr2=0x561db86977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.357+0000 7f8e6be00640 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db86977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.357+0000 7f8e6be00640 1 -- 172.21.15.8:0/4000895252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db869a800 msgr2=0x561db8698250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.357+0000 7f8e6be00640 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db869a800 0x561db8698250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.357+0000 7f8e6be00640 1 -- 172.21.15.8:0/4000895252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e64009c80 con 0x561db8692170 2024-03-16T21:05:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.357+0000 7f8e6be00640 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db8692170 0x561db8697d10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009230 tx=0x7f8e5802c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4d6fd8b89ecfd9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.358+0000 7f8e52000640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:05:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.358+0000 7f8e52000640 1 -- 172.21.15.8:0/4000895252 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5802cba0 con 0x561db8692170 2024-03-16T21:05:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.358+0000 7f8e52000640 1 -- 172.21.15.8:0/4000895252 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8e58004040 con 0x561db8692170 2024-03-16T21:05:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.358+0000 7f8e761a2740 1 -- 172.21.15.8:0/4000895252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561db8335720 con 0x561db8692170 2024-03-16T21:05:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.358+0000 7f8e52000640 1 -- 172.21.15.8:0/4000895252 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e5802cd00 con 0x561db8692170 2024-03-16T21:05:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.358+0000 7f8e761a2740 10 client.17052 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:27.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.358+0000 7f8e761a2740 1 -- 172.21.15.8:0/4000895252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561db85f74e0 con 0x561db8692170 2024-03-16T21:05:27.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.358+0000 7f8e52000640 1 -- 172.21.15.8:0/4000895252 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x561db8335720 con 0x561db8692170 2024-03-16T21:05:27.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.359+0000 7f8e52000640 1 -- 172.21.15.8:0/4000895252 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f8e5804d070 con 0x561db8692170 2024-03-16T21:05:27.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.359+0000 7f8e761a2740 10 client.17052 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:27.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.359+0000 7f8e761a2740 10 client.17052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:05:27.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.359+0000 7f8e761a2740 20 client.17052 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:27.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.359+0000 7f8e761a2740 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561db86aa9d0 0x561db86acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.359+0000 7f8e761a2740 4 client.17052 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:05:27.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.359+0000 7f8e761a2740 1 -- 172.21.15.8:0/4000895252 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561db8384890 con 0x561db86aa9d0 2024-03-16T21:05:27.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.359+0000 7f8e71400640 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561db86aa9d0 0x561db86acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.360+0000 7f8e71400640 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561db86aa9d0 0x561db86acdf0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e234cd866872b4e6 server_cookie=1124bc3b40f12ef0 in_seq=0 out_seq=0 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.360+0000 7f8e52000640 10 client.17052 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.360+0000 7f8e52000640 1 -- 172.21.15.8:0/4000895252 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561db8384890 con 0x561db86aa9d0 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.360+0000 7f8e52000640 10 client.17052 handle_command_reply: tid=0 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.360+0000 7f8e761a2740 1 client.17052 shutdown 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e761a2740 1 -- 172.21.15.8:0/4000895252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db8692170 msgr2=0x561db8697d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e761a2740 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db8692170 0x561db8697d10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009230 tx=0x7f8e5802c7f0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e761a2740 1 -- 172.21.15.8:0/4000895252 shutdown_connections 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e761a2740 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db869a800 0x561db8698250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e761a2740 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561db86aa9d0 0x561db86acdf0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e761a2740 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db8692170 0x561db8697d10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e761a2740 1 --2- 172.21.15.8:0/4000895252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db86977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e52000640 0 client.17052 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:27.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e761a2740 1 -- 172.21.15.8:0/4000895252 >> 172.21.15.8:0/4000895252 conn(0x561db86585a0 msgr2=0x561db868dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:27.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e761a2740 1 -- 172.21.15.8:0/4000895252 shutdown_connections 2024-03-16T21:05:27.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e761a2740 1 -- 172.21.15.8:0/4000895252 wait complete. 2024-03-16T21:05:27.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.361+0000 7f8e761a2740 20 client.17052 trim_cache size 0 max 16384 2024-03-16T21:05:27.371 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:27 smithi170 ceph-mon[35947]: pgmap v233: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:05:27.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.379+0000 7f8e761a2740 1 Processor -- start 2024-03-16T21:05:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.379+0000 7f8e761a2740 1 -- start start 2024-03-16T21:05:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.379+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8691490 0x561db8699f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.379+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db8692170 0x561db8698070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.379+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db869a800 0x561db868d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.379+0000 7f8e761a2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db8686360 con 0x561db8692170 2024-03-16T21:05:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.379+0000 7f8e761a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db8690d30 con 0x561db8691490 2024-03-16T21:05:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.379+0000 7f8e761a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db869d550 con 0x561db869a800 2024-03-16T21:05:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.380+0000 7f8e71400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8691490 0x561db8699f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.380+0000 7f8e71400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8691490 0x561db8699f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45424/0 (socket says 172.21.15.8:45424) 2024-03-16T21:05:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.380+0000 7f8e71400640 1 -- 172.21.15.8:0/1431945107 learned_addr learned my addr 172.21.15.8:0/1431945107 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:27.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.380+0000 7f8e71400640 1 --2- 172.21.15.8:0/1431945107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db869a800 0x561db868d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.380+0000 7f8e6be00640 1 --2- 172.21.15.8:0/1431945107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db8692170 0x561db8698070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.380+0000 7f8e71400640 1 -- 172.21.15.8:0/1431945107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db869a800 msgr2=0x561db868d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.380+0000 7f8e71400640 1 --2- 172.21.15.8:0/1431945107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db869a800 0x561db868d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.380+0000 7f8e71400640 1 -- 172.21.15.8:0/1431945107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db8692170 msgr2=0x561db8698070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.380+0000 7f8e71400640 1 --2- 172.21.15.8:0/1431945107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db8692170 0x561db8698070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.380+0000 7f8e71400640 1 -- 172.21.15.8:0/1431945107 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561db8593950 con 0x561db8691490 2024-03-16T21:05:27.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.381+0000 7f8e71400640 1 --2- 172.21.15.8:0/1431945107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8691490 0x561db8699f00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400a010 tx=0x7f8e64004b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1663a4c1761cfd0d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:27.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.381+0000 7f8e5d200640 1 -- 172.21.15.8:0/1431945107 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6402d2b0 con 0x561db8691490 2024-03-16T21:05:27.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.381+0000 7f8e5d200640 1 -- 172.21.15.8:0/1431945107 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8e64033070 con 0x561db8691490 2024-03-16T21:05:27.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.381+0000 7f8e5d200640 1 -- 172.21.15.8:0/1431945107 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e640043d0 con 0x561db8691490 2024-03-16T21:05:27.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.381+0000 7f8e761a2740 1 -- 172.21.15.8:0/1431945107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8691490 msgr2=0x561db8699f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.381+0000 7f8e761a2740 1 --2- 172.21.15.8:0/1431945107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8691490 0x561db8699f00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400a010 tx=0x7f8e64004b60 comp rx=0 tx=0).stop 2024-03-16T21:05:27.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.381+0000 7f8e761a2740 1 -- 172.21.15.8:0/1431945107 shutdown_connections 2024-03-16T21:05:27.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.381+0000 7f8e761a2740 1 --2- 172.21.15.8:0/1431945107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db869a800 0x561db868d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.381+0000 7f8e761a2740 1 --2- 172.21.15.8:0/1431945107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db8692170 0x561db8698070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.381+0000 7f8e761a2740 1 --2- 172.21.15.8:0/1431945107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8691490 0x561db8699f00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.381+0000 7f8e761a2740 1 -- 172.21.15.8:0/1431945107 >> 172.21.15.8:0/1431945107 conn(0x561db86585a0 msgr2=0x561db868d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:27.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.382+0000 7f8e761a2740 1 -- 172.21.15.8:0/1431945107 shutdown_connections 2024-03-16T21:05:27.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.382+0000 7f8e761a2740 1 -- 172.21.15.8:0/1431945107 wait complete. 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.382+0000 7f8e761a2740 1 -- start start 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.382+0000 7f8e761a2740 1 Processor -- start 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.382+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db8695180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.382+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db869b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e761a2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db869a800 0x561db869bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e761a2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db8695880 con 0x561db869a800 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e761a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db869c1b0 con 0x561db8692170 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e761a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db869c370 con 0x561db8691490 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e761a2740 10 client.0 _ll_register_callbacks cb 0x7f8e58004b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e6be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db869b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e6be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db869b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45436/0 (socket says 172.21.15.8:45436) 2024-03-16T21:05:27.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e6be00640 1 -- 172.21.15.8:0/3686646561 learned_addr learned my addr 172.21.15.8:0/3686646561 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e71400640 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db8695180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e71400640 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db869a800 0x561db869bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e6be00640 1 -- 172.21.15.8:0/3686646561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 msgr2=0x561db8695180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e6be00640 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db8695180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e6be00640 1 -- 172.21.15.8:0/3686646561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db869a800 msgr2=0x561db869bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e6be00640 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db869a800 0x561db869bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e6be00640 1 -- 172.21.15.8:0/3686646561 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561db85b2060 con 0x561db8692170 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e6be00640 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db869b730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8e5802c160 tx=0x7f8e58003a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88c2f66f4c7860e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.383+0000 7f8e52000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e52000640 1 -- 172.21.15.8:0/3686646561 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5802ccb0 con 0x561db8692170 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e52000640 1 -- 172.21.15.8:0/3686646561 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8e58000e40 con 0x561db8692170 2024-03-16T21:05:27.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e761a2740 1 -- 172.21.15.8:0/3686646561 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561db82f87e0 con 0x561db8692170 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e52000640 1 -- 172.21.15.8:0/3686646561 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e58004e10 con 0x561db8692170 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e761a2740 10 client.27233 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e761a2740 1 -- 172.21.15.8:0/3686646561 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561db85b9430 con 0x561db8692170 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e52000640 1 -- 172.21.15.8:0/3686646561 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x561db82f87e0 con 0x561db8692170 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e52000640 1 -- 172.21.15.8:0/3686646561 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f8e58004030 con 0x561db8692170 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e761a2740 10 client.27233 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e761a2740 10 client.27233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e761a2740 20 client.27233 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e761a2740 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561db8707330 0x561db8709750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.384+0000 7f8e761a2740 4 client.27233 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.385+0000 7f8e761a2740 1 -- 172.21.15.8:0/3686646561 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561db82a4700 con 0x561db8707330 2024-03-16T21:05:27.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.385+0000 7f8e71400640 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561db8707330 0x561db8709750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.385+0000 7f8e71400640 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561db8707330 0x561db8709750 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c1dcb493fa7035 server_cookie=527405b2347516a0 in_seq=0 out_seq=0 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.385+0000 7f8e52000640 10 client.27233 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.385+0000 7f8e52000640 1 -- 172.21.15.8:0/3686646561 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561db82a4700 con 0x561db8707330 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.385+0000 7f8e52000640 10 client.27233 handle_command_reply: tid=0 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.385+0000 7f8e761a2740 1 client.27233 shutdown 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e761a2740 1 -- 172.21.15.8:0/3686646561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 msgr2=0x561db869b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e761a2740 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db869b730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8e5802c160 tx=0x7f8e58003a90 comp rx=0 tx=0).stop 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e761a2740 1 -- 172.21.15.8:0/3686646561 shutdown_connections 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e761a2740 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561db8707330 0x561db8709750 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e761a2740 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561db869a800 0x561db869bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e761a2740 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561db8692170 0x561db869b730 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e52000640 0 client.27233 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:27.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e761a2740 1 --2- 172.21.15.8:0/3686646561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561db8691490 0x561db8695180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e761a2740 1 -- 172.21.15.8:0/3686646561 >> 172.21.15.8:0/3686646561 conn(0x561db86585a0 msgr2=0x561db868da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:27.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e761a2740 1 -- 172.21.15.8:0/3686646561 shutdown_connections 2024-03-16T21:05:27.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e761a2740 1 -- 172.21.15.8:0/3686646561 wait complete. 2024-03-16T21:05:27.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.386+0000 7f8e761a2740 20 client.27233 trim_cache size 0 max 16384 2024-03-16T21:05:27.398 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:05:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:05:27.398 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:05:27.399 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:05:27.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 -- 172.21.15.8:0/3510945494 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e540a1c20 msgr2=0x7f8e540a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e540a1c20 0x7f8e540a40e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x561db86926c0 tx=0x7f8e6000ef90 comp rx=0 tx=0).stop 2024-03-16T21:05:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 -- 172.21.15.8:0/3510945494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e6c103590 msgr2=0x7f8e6c19f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e6c103590 0x7f8e6c19f950 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000ea60 tx=0x7f8e6000ef20 comp rx=0 tx=0).stop 2024-03-16T21:05:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 -- 172.21.15.8:0/3510945494 shutdown_connections 2024-03-16T21:05:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f8e540a1c20 0x7f8e540a40e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c109650 0x7f8e6c199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e6c103f50 0x7f8e6c19fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 --2- 172.21.15.8:0/3510945494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e6c103590 0x7f8e6c19f950 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 -- 172.21.15.8:0/3510945494 >> 172.21.15.8:0/3510945494 conn(0x7f8e6c0ff020 msgr2=0x7f8e6c1006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 -- 172.21.15.8:0/3510945494 shutdown_connections 2024-03-16T21:05:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.387+0000 7f8e71e00640 1 -- 172.21.15.8:0/3510945494 wait complete. 2024-03-16T21:05:27.401 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:27 smithi186 ceph-mon[36391]: pgmap v233: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:05:27.408 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:27 smithi008 ceph-mon[31434]: pgmap v233: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:05:27.410 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:05:27.410 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:05:27.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.608+0000 7f7682c00640 1 -- 172.21.15.8:0/217659736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c1096b0 msgr2=0x7f767c109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.608+0000 7f7682c00640 1 --2- 172.21.15.8:0/217659736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c1096b0 0x7f767c109a90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f766c009930 tx=0x7f766c02bc20 comp rx=0 tx=0).stop 2024-03-16T21:05:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.608+0000 7f7682c00640 1 -- 172.21.15.8:0/217659736 shutdown_connections 2024-03-16T21:05:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.608+0000 7f7682c00640 1 --2- 172.21.15.8:0/217659736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c104060 0x7f767c110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.608+0000 7f7682c00640 1 --2- 172.21.15.8:0/217659736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f767c1036a0 0x7f767c103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.608+0000 7f7682c00640 1 --2- 172.21.15.8:0/217659736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c1096b0 0x7f767c109a90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.608+0000 7f7682c00640 1 -- 172.21.15.8:0/217659736 >> 172.21.15.8:0/217659736 conn(0x7f767c0ff170 msgr2=0x7f767c101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.608+0000 7f7682c00640 1 -- 172.21.15.8:0/217659736 shutdown_connections 2024-03-16T21:05:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.608+0000 7f7682c00640 1 -- 172.21.15.8:0/217659736 wait complete. 2024-03-16T21:05:27.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.610+0000 7f7682c00640 1 Processor -- start 2024-03-16T21:05:27.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.610+0000 7f7682c00640 1 -- start start 2024-03-16T21:05:27.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.610+0000 7f7682c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f767c1036a0 0x7f767c199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.610+0000 7f7682c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c104060 0x7f767c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.610+0000 7f7682c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1096b0 0x7f767c19e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.610+0000 7f7682c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c19ece0 con 0x7f767c104060 2024-03-16T21:05:27.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.610+0000 7f7682c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c19ee50 con 0x7f767c1036a0 2024-03-16T21:05:27.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.610+0000 7f7682c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c19f010 con 0x7f767c1096b0 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f7673400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c104060 0x7f767c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f767be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f767c1036a0 0x7f767c199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f7680c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1096b0 0x7f767c19e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f7680c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1096b0 0x7f767c19e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53300/0 (socket says 172.21.15.8:53300) 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f767be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f767c1036a0 0x7f767c199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45456/0 (socket says 172.21.15.8:45456) 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f7680c00640 1 -- 172.21.15.8:0/3087985353 learned_addr learned my addr 172.21.15.8:0/3087985353 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f7680c00640 1 -- 172.21.15.8:0/3087985353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f767c1036a0 msgr2=0x7f767c199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f7680c00640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f767c1036a0 0x7f767c199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f7680c00640 1 -- 172.21.15.8:0/3087985353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c104060 msgr2=0x7f767c19a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f7680c00640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c104060 0x7f767c19a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f7680c00640 1 -- 172.21.15.8:0/3087985353 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7664009490 con 0x7f767c1096b0 2024-03-16T21:05:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.611+0000 7f7680c00640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1096b0 0x7f767c19e6e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f767400eb10 tx=0x7f767400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.612+0000 7f7679600640 1 -- 172.21.15.8:0/3087985353 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674004b20 con 0x7f767c1096b0 2024-03-16T21:05:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.612+0000 7f7679600640 1 -- 172.21.15.8:0/3087985353 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7674004c80 con 0x7f767c1096b0 2024-03-16T21:05:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.612+0000 7f7679600640 1 -- 172.21.15.8:0/3087985353 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674010760 con 0x7f767c1096b0 2024-03-16T21:05:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.612+0000 7f7682c00640 1 -- 172.21.15.8:0/3087985353 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c009560 con 0x7f767c1096b0 2024-03-16T21:05:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.612+0000 7f7682c00640 1 -- 172.21.15.8:0/3087985353 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c1a6990 con 0x7f767c1096b0 2024-03-16T21:05:27.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.613+0000 7f7682c00640 1 -- 172.21.15.8:0/3087985353 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c068730 con 0x7f767c1096b0 2024-03-16T21:05:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.615+0000 7f7679600640 1 -- 172.21.15.8:0/3087985353 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7674005020 con 0x7f767c1096b0 2024-03-16T21:05:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.616+0000 7f7679600640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76600a1c20 0x7f76600a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.616+0000 7f7679600640 1 -- 172.21.15.8:0/3087985353 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7674014070 con 0x7f767c1096b0 2024-03-16T21:05:27.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.617+0000 7f767be00640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76600a1c20 0x7f76600a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:27.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.617+0000 7f767be00640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76600a1c20 0x7f76600a40e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f766c005ab0 tx=0x7f766c000bc0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:27.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.620+0000 7f7679600640 1 -- 172.21.15.8:0/3087985353 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7674096b30 con 0x7f767c1096b0 2024-03-16T21:05:27.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.861+0000 7f7682c00640 1 -- 172.21.15.8:0/3087985353 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f767c19b170 con 0x7f767c1096b0 2024-03-16T21:05:27.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.862+0000 7f7679600640 1 -- 172.21.15.8:0/3087985353 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f767409a1f0 con 0x7f767c1096b0 2024-03-16T21:05:27.869 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:05:27.869 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:27.879028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:05:27.869 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-03-16T21:05:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.864+0000 7f7682c00640 1 -- 172.21.15.8:0/3087985353 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76600a1c20 msgr2=0x7f76600a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.864+0000 7f7682c00640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76600a1c20 0x7f76600a40e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f766c005ab0 tx=0x7f766c000bc0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.864+0000 7f7682c00640 1 -- 172.21.15.8:0/3087985353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1096b0 msgr2=0x7f767c19e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.864+0000 7f7682c00640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1096b0 0x7f767c19e6e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f767400eb10 tx=0x7f767400c2d0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.865+0000 7f7682c00640 1 -- 172.21.15.8:0/3087985353 shutdown_connections 2024-03-16T21:05:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.865+0000 7f7682c00640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76600a1c20 0x7f76600a40e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.865+0000 7f7682c00640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1096b0 0x7f767c19e6e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.865+0000 7f7682c00640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f767c104060 0x7f767c19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.865+0000 7f7682c00640 1 --2- 172.21.15.8:0/3087985353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f767c1036a0 0x7f767c199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.865+0000 7f7682c00640 1 -- 172.21.15.8:0/3087985353 >> 172.21.15.8:0/3087985353 conn(0x7f767c0ff170 msgr2=0x7f767c0ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.865+0000 7f7682c00640 1 -- 172.21.15.8:0/3087985353 shutdown_connections 2024-03-16T21:05:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:27.865+0000 7f7682c00640 1 -- 172.21.15.8:0/3087985353 wait complete. 2024-03-16T21:05:27.892 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:05:27.892 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:05:28.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.130+0000 7f1141200640 1 -- 172.21.15.8:0/2057238554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f113c1064b0 msgr2=0x7f113c106890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.130+0000 7f1141200640 1 --2- 172.21.15.8:0/2057238554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f113c1064b0 0x7f113c106890 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f112c009ca0 tx=0x7f112c02c100 comp rx=0 tx=0).stop 2024-03-16T21:05:28.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.131+0000 7f1141200640 1 -- 172.21.15.8:0/2057238554 shutdown_connections 2024-03-16T21:05:28.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.131+0000 7f1141200640 1 --2- 172.21.15.8:0/2057238554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f113c100dd0 0x7f113c10d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.131+0000 7f1141200640 1 --2- 172.21.15.8:0/2057238554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f113c100410 0x7f113c100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.131+0000 7f1141200640 1 --2- 172.21.15.8:0/2057238554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f113c1064b0 0x7f113c106890 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.131+0000 7f1141200640 1 -- 172.21.15.8:0/2057238554 >> 172.21.15.8:0/2057238554 conn(0x7f113c077550 msgr2=0x7f113c077960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.131+0000 7f1141200640 1 -- 172.21.15.8:0/2057238554 shutdown_connections 2024-03-16T21:05:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.131+0000 7f1141200640 1 -- 172.21.15.8:0/2057238554 wait complete. 2024-03-16T21:05:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.132+0000 7f1141200640 1 Processor -- start 2024-03-16T21:05:28.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.132+0000 7f1141200640 1 -- start start 2024-03-16T21:05:28.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1141200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f113c100410 0x7f113c19c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1141200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f113c100dd0 0x7f113c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1141200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f113c1064b0 0x7f113c1969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1141200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c196ff0 con 0x7f113c1064b0 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1141200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c197160 con 0x7f113c100dd0 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1141200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c197320 con 0x7f113c100410 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1139e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f113c100410 0x7f113c19c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1139400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f113c100dd0 0x7f113c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1139400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f113c100dd0 0x7f113c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41462/0 (socket says 172.21.15.8:41462) 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1139400640 1 -- 172.21.15.8:0/4066437090 learned_addr learned my addr 172.21.15.8:0/4066437090 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f113a800640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f113c1064b0 0x7f113c1969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1139400640 1 -- 172.21.15.8:0/4066437090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f113c100410 msgr2=0x7f113c19c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1139400640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f113c100410 0x7f113c19c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1139400640 1 -- 172.21.15.8:0/4066437090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f113c1064b0 msgr2=0x7f113c1969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1139400640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f113c1064b0 0x7f113c1969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f1139400640 1 -- 172.21.15.8:0/4066437090 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1124009490 con 0x7f113c100dd0 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.133+0000 7f113a800640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f113c1064b0 0x7f113c1969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:05:28.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.134+0000 7f1139400640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f113c100dd0 0x7f113c19cd30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f112400ea60 tx=0x7f112400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.134+0000 7f1132a00640 1 -- 172.21.15.8:0/4066437090 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112400cde0 con 0x7f113c100dd0 2024-03-16T21:05:28.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.134+0000 7f1132a00640 1 -- 172.21.15.8:0/4066437090 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f11240035f0 con 0x7f113c100dd0 2024-03-16T21:05:28.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.134+0000 7f1132a00640 1 -- 172.21.15.8:0/4066437090 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124010690 con 0x7f113c100dd0 2024-03-16T21:05:28.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.134+0000 7f1141200640 1 -- 172.21.15.8:0/4066437090 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1134009490 con 0x7f113c100dd0 2024-03-16T21:05:28.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.134+0000 7f1141200640 1 -- 172.21.15.8:0/4066437090 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c009900 con 0x7f113c100dd0 2024-03-16T21:05:28.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.137+0000 7f1132a00640 1 -- 172.21.15.8:0/4066437090 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f1124003b80 con 0x7f113c100dd0 2024-03-16T21:05:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.137+0000 7f1143e51740 1 Processor -- start 2024-03-16T21:05:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f1143e51740 1 -- start start 2024-03-16T21:05:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f1143e51740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 0x55c8b5af7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f1143e51740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5b00010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f1143e51740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5b02940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f1143e51740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b5a61210 con 0x55c8b5af7970 2024-03-16T21:05:28.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f1143e51740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b5a5e740 con 0x55c8b5b00550 2024-03-16T21:05:28.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f1143e51740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b5a59f20 con 0x55c8b5af7050 2024-03-16T21:05:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f1139e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5b00010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f1139400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5b02940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f113a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 0x55c8b5af7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f1139e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5b00010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34716/0 (socket says 172.21.15.8:34716) 2024-03-16T21:05:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.138+0000 7f1139e00640 1 -- 172.21.15.8:0/2343452522 learned_addr learned my addr 172.21.15.8:0/2343452522 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.139+0000 7f113a800640 1 -- 172.21.15.8:0/2343452522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 msgr2=0x55c8b5b02940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.139+0000 7f113a800640 1 --2- 172.21.15.8:0/2343452522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5b02940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.139+0000 7f113a800640 1 -- 172.21.15.8:0/2343452522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 msgr2=0x55c8b5b00010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.139+0000 7f113a800640 1 --2- 172.21.15.8:0/2343452522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5b00010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.139+0000 7f113a800640 1 -- 172.21.15.8:0/2343452522 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b5a1bdf0 con 0x55c8b5af7050 2024-03-16T21:05:28.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.139+0000 7f1139e00640 1 --2- 172.21.15.8:0/2343452522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5b00010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:05:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.139+0000 7f1139400640 1 --2- 172.21.15.8:0/2343452522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5b02940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:05:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.139+0000 7f1132a00640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f11200a1c20 0x7f11200a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.139+0000 7f1132a00640 1 -- 172.21.15.8:0/4066437090 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1124014070 con 0x7f113c100dd0 2024-03-16T21:05:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.139+0000 7f1139e00640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f11200a1c20 0x7f11200a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.139+0000 7f113a800640 1 --2- 172.21.15.8:0/2343452522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 0x55c8b5af7430 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1134009cc0 tx=0x7f11340117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c025a556ce806416 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f112b400640 1 -- 172.21.15.8:0/2343452522 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134005020 con 0x55c8b5af7050 2024-03-16T21:05:28.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f112b400640 1 -- 172.21.15.8:0/2343452522 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1134005680 con 0x55c8b5af7050 2024-03-16T21:05:28.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f112b400640 1 -- 172.21.15.8:0/2343452522 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11340128f0 con 0x55c8b5af7050 2024-03-16T21:05:28.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f1143e51740 1 -- 172.21.15.8:0/2343452522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 msgr2=0x55c8b5af7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f1139e00640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f11200a1c20 0x7f11200a40e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f112c033000 tx=0x7f112c032e70 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f1143e51740 1 --2- 172.21.15.8:0/2343452522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 0x55c8b5af7430 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1134009cc0 tx=0x7f11340117b0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f1143e51740 1 -- 172.21.15.8:0/2343452522 shutdown_connections 2024-03-16T21:05:28.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f1143e51740 1 --2- 172.21.15.8:0/2343452522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5b02940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f1143e51740 1 --2- 172.21.15.8:0/2343452522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5b00010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f1143e51740 1 --2- 172.21.15.8:0/2343452522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 0x55c8b5af7430 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f1143e51740 1 -- 172.21.15.8:0/2343452522 >> 172.21.15.8:0/2343452522 conn(0x55c8b5af1780 msgr2=0x55c8b5af1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.140+0000 7f1143e51740 1 -- 172.21.15.8:0/2343452522 shutdown_connections 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.141+0000 7f1143e51740 1 -- 172.21.15.8:0/2343452522 wait complete. 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.141+0000 7f1143e51740 1 -- start start 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.141+0000 7f1143e51740 1 Processor -- start 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1143e51740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7050 0x55c8b5afd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1143e51740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7970 0x55c8b5afdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1143e51740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5afe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1143e51740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b59ff150 con 0x55c8b5af7050 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1143e51740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b59fedf0 con 0x55c8b5b00550 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1143e51740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b57c81c0 con 0x55c8b5af7970 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1143e51740 10 client.0 _ll_register_callbacks cb 0x55c8b5a4e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1139e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7050 0x55c8b5afd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1139400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7970 0x55c8b5afdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1139e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7050 0x55c8b5afd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34728/0 (socket says 172.21.15.8:34728) 2024-03-16T21:05:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1139e00640 1 -- 172.21.15.8:0/3485182674 learned_addr learned my addr 172.21.15.8:0/3485182674 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f113a800640 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5afe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1139400640 1 -- 172.21.15.8:0/3485182674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 msgr2=0x55c8b5afe0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1139400640 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5afe0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1139400640 1 -- 172.21.15.8:0/3485182674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7050 msgr2=0x55c8b5afd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1139400640 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7050 0x55c8b5afd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.142+0000 7f1139400640 1 -- 172.21.15.8:0/3485182674 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11340098f0 con 0x55c8b5af7970 2024-03-16T21:05:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.143+0000 7f1139400640 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7970 0x55c8b5afdb70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f11240cb470 tx=0x7f11240d11a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39595967cc94ce30 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.143+0000 7f111fe00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:05:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.143+0000 7f111fe00640 1 -- 172.21.15.8:0/3485182674 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11240cb8f0 con 0x55c8b5af7970 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.143+0000 7f111fe00640 1 -- 172.21.15.8:0/3485182674 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f112409b050 con 0x55c8b5af7970 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.143+0000 7f1143e51740 1 -- 172.21.15.8:0/3485182674 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8b57597e0 con 0x55c8b5af7970 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.143+0000 7f111fe00640 1 -- 172.21.15.8:0/3485182674 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f112409a2b0 con 0x55c8b5af7970 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.143+0000 7f1143e51740 10 client.27262 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.143+0000 7f1143e51740 1 -- 172.21.15.8:0/3485182674 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c8b5a585a0 con 0x55c8b5af7970 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.143+0000 7f111fe00640 1 -- 172.21.15.8:0/3485182674 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55c8b57597e0 con 0x55c8b5af7970 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.144+0000 7f111fe00640 1 -- 172.21.15.8:0/3485182674 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f11240a2d80 con 0x55c8b5af7970 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.144+0000 7f1143e51740 10 client.27262 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.144+0000 7f1143e51740 10 client.27262 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.144+0000 7f1143e51740 20 client.27262 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.144+0000 7f1143e51740 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c8b5b10600 0x55c8b5b12a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.144+0000 7f1143e51740 4 client.27262 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:05:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.144+0000 7f1143e51740 1 -- 172.21.15.8:0/3485182674 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8b5796720 con 0x55c8b5b10600 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.144+0000 7f1139e00640 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c8b5b10600 0x55c8b5b12a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.145+0000 7f1139e00640 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c8b5b10600 0x55c8b5b12a20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70d043cb2ee635a4 server_cookie=12a2b245a4416d5b in_seq=0 out_seq=0 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.145+0000 7f111fe00640 10 client.27262 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f111fe00640 1 -- 172.21.15.8:0/3485182674 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55c8b5796720 con 0x55c8b5b10600 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f111fe00640 10 client.27262 handle_command_reply: tid=0 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 1 client.27262 shutdown 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 1 -- 172.21.15.8:0/3485182674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7970 msgr2=0x55c8b5afdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7970 0x55c8b5afdb70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f11240cb470 tx=0x7f11240d11a0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 1 -- 172.21.15.8:0/3485182674 shutdown_connections 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c8b5b10600 0x55c8b5b12a20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5afe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7970 0x55c8b5afdb70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 1 --2- 172.21.15.8:0/3485182674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7050 0x55c8b5afd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 1 -- 172.21.15.8:0/3485182674 >> 172.21.15.8:0/3485182674 conn(0x55c8b5af1780 msgr2=0x55c8b5aec470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f111fe00640 0 client.27262 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:05:28.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 1 -- 172.21.15.8:0/3485182674 shutdown_connections 2024-03-16T21:05:28.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 1 -- 172.21.15.8:0/3485182674 wait complete. 2024-03-16T21:05:28.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.146+0000 7f1143e51740 20 client.27262 trim_cache size 0 max 16384 2024-03-16T21:05:28.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.160+0000 7f1143e51740 1 Processor -- start 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.160+0000 7f1143e51740 1 -- start start 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.160+0000 7f1143e51740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5af7050 0x55c8b5affd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.160+0000 7f1143e51740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5afded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.160+0000 7f1143e51740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5b00550 0x55c8b5b0b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.160+0000 7f1143e51740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b5af6ac0 con 0x55c8b5af7970 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.160+0000 7f1143e51740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b5af27b0 con 0x55c8b5af7050 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.160+0000 7f1143e51740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b5af3ac0 con 0x55c8b5b00550 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f1139e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5af7050 0x55c8b5affd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f1139400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5afded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f1139e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5af7050 0x55c8b5affd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41492/0 (socket says 172.21.15.8:41492) 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f1139e00640 1 -- 172.21.15.8:0/15204616 learned_addr learned my addr 172.21.15.8:0/15204616 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f113a800640 1 --2- 172.21.15.8:0/15204616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5b00550 0x55c8b5b0b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f1139e00640 1 -- 172.21.15.8:0/15204616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5b00550 msgr2=0x55c8b5b0b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f1139e00640 1 --2- 172.21.15.8:0/15204616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5b00550 0x55c8b5b0b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f1139e00640 1 -- 172.21.15.8:0/15204616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 msgr2=0x55c8b5afded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f1139e00640 1 --2- 172.21.15.8:0/15204616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5afded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f1139e00640 1 -- 172.21.15.8:0/15204616 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b59f4ab0 con 0x55c8b5af7050 2024-03-16T21:05:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f1139e00640 1 --2- 172.21.15.8:0/15204616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5af7050 0x55c8b5affd60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f112c037040 tx=0x7f112c041040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6751b876af3b823 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f112aa00640 1 -- 172.21.15.8:0/15204616 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c04f070 con 0x55c8b5af7050 2024-03-16T21:05:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f112aa00640 1 -- 172.21.15.8:0/15204616 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f112c003e70 con 0x55c8b5af7050 2024-03-16T21:05:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.161+0000 7f112aa00640 1 -- 172.21.15.8:0/15204616 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c0544b0 con 0x55c8b5af7050 2024-03-16T21:05:28.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.162+0000 7f1143e51740 1 -- 172.21.15.8:0/15204616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5af7050 msgr2=0x55c8b5affd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.162+0000 7f1143e51740 1 --2- 172.21.15.8:0/15204616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5af7050 0x55c8b5affd60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f112c037040 tx=0x7f112c041040 comp rx=0 tx=0).stop 2024-03-16T21:05:28.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.162+0000 7f1143e51740 1 -- 172.21.15.8:0/15204616 shutdown_connections 2024-03-16T21:05:28.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.162+0000 7f1143e51740 1 --2- 172.21.15.8:0/15204616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5b00550 0x55c8b5b0b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.162+0000 7f1143e51740 1 --2- 172.21.15.8:0/15204616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5afded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.162+0000 7f1143e51740 1 --2- 172.21.15.8:0/15204616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5af7050 0x55c8b5affd60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.162+0000 7f1143e51740 1 -- 172.21.15.8:0/15204616 >> 172.21.15.8:0/15204616 conn(0x55c8b5af1780 msgr2=0x55c8b5aec470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.162+0000 7f1143e51740 1 -- 172.21.15.8:0/15204616 shutdown_connections 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.162+0000 7f1143e51740 1 -- 172.21.15.8:0/15204616 wait complete. 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.163+0000 7f1143e51740 1 -- start start 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.163+0000 7f1143e51740 1 Processor -- start 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.163+0000 7f1143e51740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 0x55c8b5b07e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.163+0000 7f1143e51740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5afa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.163+0000 7f1143e51740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5afac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.163+0000 7f1143e51740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b5b08740 con 0x55c8b5af7970 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.163+0000 7f1143e51740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b5afb180 con 0x55c8b5b00550 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.163+0000 7f1143e51740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b5afb340 con 0x55c8b5af7050 2024-03-16T21:05:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.163+0000 7f1143e51740 10 client.0 _ll_register_callbacks cb 0x7f11240d1320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.163+0000 7f1139e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 0x55c8b5b07e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f1139e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 0x55c8b5b07e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39222/0 (socket says 172.21.15.8:39222) 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f1139400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5afa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f1139e00640 1 -- 172.21.15.8:0/4232870363 learned_addr learned my addr 172.21.15.8:0/4232870363 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f113a800640 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5afac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f1139e00640 1 -- 172.21.15.8:0/4232870363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 msgr2=0x55c8b5afac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f1139e00640 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5afac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f1139e00640 1 -- 172.21.15.8:0/4232870363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 msgr2=0x55c8b5afa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f1139e00640 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5afa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f1139e00640 1 -- 172.21.15.8:0/4232870363 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c030070 con 0x55c8b5af7050 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f1139e00640 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 0x55c8b5b07e70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f112c009bf0 tx=0x7f112c004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f73344cf310be22f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f111fe00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f111fe00640 1 -- 172.21.15.8:0/4232870363 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c04f040 con 0x55c8b5af7050 2024-03-16T21:05:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.164+0000 7f111fe00640 1 -- 172.21.15.8:0/4232870363 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f112c003b70 con 0x55c8b5af7050 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f1143e51740 1 -- 172.21.15.8:0/4232870363 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1134005680 con 0x55c8b5af7050 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f111fe00640 1 -- 172.21.15.8:0/4232870363 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f112c034890 con 0x55c8b5af7050 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f1143e51740 10 client.27268 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f1143e51740 1 -- 172.21.15.8:0/4232870363 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c8b5a1a650 con 0x55c8b5af7050 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f111fe00640 1 -- 172.21.15.8:0/4232870363 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1134005680 con 0x55c8b5af7050 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f111fe00640 1 -- 172.21.15.8:0/4232870363 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f112c054c20 con 0x55c8b5af7050 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f1143e51740 10 client.27268 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f1143e51740 10 client.27268 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f1143e51740 20 client.27268 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f1143e51740 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c8b5b6cfd0 0x55c8b5b6f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f1143e51740 4 client.27268 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.165+0000 7f1143e51740 1 -- 172.21.15.8:0/4232870363 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c8b57e5890 con 0x55c8b5b6cfd0 2024-03-16T21:05:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f1139400640 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c8b5b6cfd0 0x55c8b5b6f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f1139400640 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c8b5b6cfd0 0x55c8b5b6f3f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f56caa530c9582df server_cookie=59cee8ccd6f194fa in_seq=0 out_seq=0 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f111fe00640 10 client.27268 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f111fe00640 1 -- 172.21.15.8:0/4232870363 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c8b57e5890 con 0x55c8b5b6cfd0 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f111fe00640 10 client.27268 handle_command_reply: tid=0 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f1143e51740 1 client.27268 shutdown 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f1143e51740 1 -- 172.21.15.8:0/4232870363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 msgr2=0x55c8b5b07e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f1143e51740 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 0x55c8b5b07e70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f112c009bf0 tx=0x7f112c004040 comp rx=0 tx=0).stop 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f1143e51740 1 -- 172.21.15.8:0/4232870363 shutdown_connections 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f1143e51740 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55c8b5b6cfd0 0x55c8b5b6f3f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f1143e51740 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c8b5b00550 0x55c8b5afac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f111fe00640 0 client.27268 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f1143e51740 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c8b5af7970 0x55c8b5afa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f1143e51740 1 --2- 172.21.15.8:0/4232870363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c8b5af7050 0x55c8b5b07e70 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.166+0000 7f1143e51740 1 -- 172.21.15.8:0/4232870363 >> 172.21.15.8:0/4232870363 conn(0x55c8b5af1780 msgr2=0x55c8b5af2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1143e51740 1 -- 172.21.15.8:0/4232870363 shutdown_connections 2024-03-16T21:05:28.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1143e51740 1 -- 172.21.15.8:0/4232870363 wait complete. 2024-03-16T21:05:28.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1143e51740 20 client.27268 trim_cache size 0 max 16384 2024-03-16T21:05:28.178 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:05:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1141200640 1 -- 172.21.15.8:0/4066437090 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f11200a1c20 msgr2=0x7f11200a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1141200640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f11200a1c20 0x7f11200a40e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f112c033000 tx=0x7f112c032e70 comp rx=0 tx=0).stop 2024-03-16T21:05:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1141200640 1 -- 172.21.15.8:0/4066437090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f113c100dd0 msgr2=0x7f113c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1141200640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f113c100dd0 0x7f113c19cd30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f112400ea60 tx=0x7f112400ef20 comp rx=0 tx=0).stop 2024-03-16T21:05:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1141200640 1 -- 172.21.15.8:0/4066437090 shutdown_connections 2024-03-16T21:05:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1141200640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f11200a1c20 0x7f11200a40e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1141200640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f113c1064b0 0x7f113c1969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1141200640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f113c100dd0 0x7f113c19cd30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.167+0000 7f1141200640 1 --2- 172.21.15.8:0/4066437090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f113c100410 0x7f113c19c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.168+0000 7f1141200640 1 -- 172.21.15.8:0/4066437090 >> 172.21.15.8:0/4066437090 conn(0x7f113c077550 msgr2=0x7f113c102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.168+0000 7f1141200640 1 -- 172.21.15.8:0/4066437090 shutdown_connections 2024-03-16T21:05:28.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.168+0000 7f1141200640 1 -- 172.21.15.8:0/4066437090 wait complete. 2024-03-16T21:05:28.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:28 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3087985353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:05:28.193 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:05:28.194 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:05:28.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:28 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3087985353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:05:28.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.413+0000 7ff357400640 1 -- 172.21.15.8:0/2491186684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350076340 msgr2=0x7ff350111df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.413+0000 7ff357400640 1 --2- 172.21.15.8:0/2491186684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350076340 0x7ff350111df0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009930 tx=0x7ff33c02bc20 comp rx=0 tx=0).stop 2024-03-16T21:05:28.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.413+0000 7ff357400640 1 -- 172.21.15.8:0/2491186684 shutdown_connections 2024-03-16T21:05:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.413+0000 7ff357400640 1 --2- 172.21.15.8:0/2491186684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff350112330 0x7ff350114720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.413+0000 7ff357400640 1 --2- 172.21.15.8:0/2491186684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350076340 0x7ff350111df0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.413+0000 7ff357400640 1 --2- 172.21.15.8:0/2491186684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff350075a20 0x7ff350075e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.413+0000 7ff357400640 1 -- 172.21.15.8:0/2491186684 >> 172.21.15.8:0/2491186684 conn(0x7ff3500ff1a0 msgr2=0x7ff3501015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.413+0000 7ff357400640 1 -- 172.21.15.8:0/2491186684 shutdown_connections 2024-03-16T21:05:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.413+0000 7ff357400640 1 -- 172.21.15.8:0/2491186684 wait complete. 2024-03-16T21:05:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.414+0000 7ff357400640 1 Processor -- start 2024-03-16T21:05:28.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff357400640 1 -- start start 2024-03-16T21:05:28.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff357400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350075a20 0x7ff35019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff357400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff350076340 0x7ff35019e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff357400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff350112330 0x7ff3501a2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff357400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3501a3120 con 0x7ff350076340 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff357400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3501a3290 con 0x7ff350112330 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff357400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3501a3450 con 0x7ff350075a20 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff347e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff350076340 0x7ff35019e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff355400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff350112330 0x7ff3501a2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff347e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff350076340 0x7ff35019e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34764/0 (socket says 172.21.15.8:34764) 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff347e00640 1 -- 172.21.15.8:0/3602868965 learned_addr learned my addr 172.21.15.8:0/3602868965 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.415+0000 7ff355400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff350112330 0x7ff3501a2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41520/0 (socket says 172.21.15.8:41520) 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff354a00640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350075a20 0x7ff35019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff355400640 1 -- 172.21.15.8:0/3602868965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350075a20 msgr2=0x7ff35019e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff355400640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350075a20 0x7ff35019e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff355400640 1 -- 172.21.15.8:0/3602868965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff350076340 msgr2=0x7ff35019e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff355400640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff350076340 0x7ff35019e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff355400640 1 -- 172.21.15.8:0/3602868965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c009560 con 0x7ff350112330 2024-03-16T21:05:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff354a00640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350075a20 0x7ff35019e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:05:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff347e00640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff350076340 0x7ff35019e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:05:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff355400640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff350112330 0x7ff3501a2b20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff348005fd0 tx=0x7ff34800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff34e000640 1 -- 172.21.15.8:0/3602868965 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34800cdf0 con 0x7ff350112330 2024-03-16T21:05:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff34e000640 1 -- 172.21.15.8:0/3602868965 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff348004b20 con 0x7ff350112330 2024-03-16T21:05:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.416+0000 7ff357400640 1 -- 172.21.15.8:0/3602868965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3501a3730 con 0x7ff350112330 2024-03-16T21:05:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.417+0000 7ff34e000640 1 -- 172.21.15.8:0/3602868965 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348010720 con 0x7ff350112330 2024-03-16T21:05:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.417+0000 7ff357400640 1 -- 172.21.15.8:0/3602868965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3501aafb0 con 0x7ff350112330 2024-03-16T21:05:28.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.420+0000 7ff35a1a3740 1 Processor -- start 2024-03-16T21:05:28.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.420+0000 7ff34e000640 1 -- 172.21.15.8:0/3602868965 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7ff348004c90 con 0x7ff350112330 2024-03-16T21:05:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.420+0000 7ff35a1a3740 1 -- start start 2024-03-16T21:05:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.420+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd5049c40 0x55cfd504a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 0x55cfd5052c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5053140 0x55cfd5055530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd4fb8210 con 0x55cfd5049c40 2024-03-16T21:05:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd4fb5740 con 0x55cfd5053140 2024-03-16T21:05:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd4fb0f20 con 0x55cfd504a560 2024-03-16T21:05:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff347e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd5049c40 0x55cfd504a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff354a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 0x55cfd5052c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff354a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 0x55cfd5052c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39250/0 (socket says 172.21.15.8:39250) 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff354a00640 1 -- 172.21.15.8:0/3413234117 learned_addr learned my addr 172.21.15.8:0/3413234117 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff347e00640 1 --2- 172.21.15.8:0/3413234117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5053140 0x55cfd5055530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff354a00640 1 -- 172.21.15.8:0/3413234117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5053140 msgr2=0x55cfd5055530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff354a00640 1 --2- 172.21.15.8:0/3413234117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5053140 0x55cfd5055530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff354a00640 1 -- 172.21.15.8:0/3413234117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd5049c40 msgr2=0x55cfd504a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff354a00640 1 --2- 172.21.15.8:0/3413234117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd5049c40 0x55cfd504a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff354a00640 1 -- 172.21.15.8:0/3413234117 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfd4f72df0 con 0x55cfd504a560 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.421+0000 7ff347e00640 1 --2- 172.21.15.8:0/3413234117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd5049c40 0x55cfd504a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.422+0000 7ff354a00640 1 --2- 172.21.15.8:0/3413234117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 0x55cfd5052c00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff340009d50 tx=0x7ff3400117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d68f934781c764 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.422+0000 7ff34e000640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff3340a1ba0 0x7ff3340a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.422+0000 7ff34e000640 1 -- 172.21.15.8:0/3602868965 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff348014070 con 0x7ff350112330 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.422+0000 7ff345c00640 1 -- 172.21.15.8:0/3413234117 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340012650 con 0x55cfd504a560 2024-03-16T21:05:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.422+0000 7ff345c00640 1 -- 172.21.15.8:0/3413234117 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff340009e40 con 0x55cfd504a560 2024-03-16T21:05:28.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.422+0000 7ff345c00640 1 -- 172.21.15.8:0/3413234117 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000fce0 con 0x55cfd504a560 2024-03-16T21:05:28.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.422+0000 7ff347e00640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff3340a1ba0 0x7ff3340a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.423+0000 7ff35a1a3740 1 -- 172.21.15.8:0/3413234117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 msgr2=0x55cfd5052c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.423+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/3413234117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 0x55cfd5052c00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff340009d50 tx=0x7ff3400117b0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.423+0000 7ff347e00640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff3340a1ba0 0x7ff3340a4060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff350102da0 tx=0x7ff33c005a20 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.423+0000 7ff35a1a3740 1 -- 172.21.15.8:0/3413234117 shutdown_connections 2024-03-16T21:05:28.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.423+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/3413234117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5053140 0x55cfd5055530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.423+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/3413234117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 0x55cfd5052c00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.423+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/3413234117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd5049c40 0x55cfd504a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.423+0000 7ff35a1a3740 1 -- 172.21.15.8:0/3413234117 >> 172.21.15.8:0/3413234117 conn(0x55cfd5044370 msgr2=0x55cfd5044750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.423+0000 7ff35a1a3740 1 -- 172.21.15.8:0/3413234117 shutdown_connections 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.423+0000 7ff35a1a3740 1 -- 172.21.15.8:0/3413234117 wait complete. 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.423+0000 7ff35a1a3740 1 -- start start 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff35a1a3740 1 Processor -- start 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 0x55cfd5050220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 0x55cfd5050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd5053140 0x55cfd5050ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd4f56150 con 0x55cfd5053140 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd4f55df0 con 0x55cfd5049c40 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd4d1f1c0 con 0x55cfd504a560 2024-03-16T21:05:28.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff35a1a3740 10 client.0 _ll_register_callbacks cb 0x55cfd4fa52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff354a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 0x55cfd5050220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff347e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 0x55cfd5050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff354a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 0x55cfd5050220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41530/0 (socket says 172.21.15.8:41530) 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.424+0000 7ff354a00640 1 -- 172.21.15.8:0/888258264 learned_addr learned my addr 172.21.15.8:0/888258264 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.425+0000 7ff355400640 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd5053140 0x55cfd5050ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.425+0000 7ff347e00640 1 -- 172.21.15.8:0/888258264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 msgr2=0x55cfd5050220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.425+0000 7ff347e00640 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 0x55cfd5050220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.425+0000 7ff347e00640 1 -- 172.21.15.8:0/888258264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd5053140 msgr2=0x55cfd5050ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.425+0000 7ff347e00640 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd5053140 0x55cfd5050ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.425+0000 7ff347e00640 1 -- 172.21.15.8:0/888258264 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff340009980 con 0x55cfd504a560 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.425+0000 7ff354a00640 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 0x55cfd5050220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.425+0000 7ff347e00640 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 0x55cfd5050760 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff33c000c00 tx=0x7ff33c02bc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9855cd16f0c27573 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.425+0000 7ff33a000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff33a000640 1 -- 172.21.15.8:0/888258264 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c005020 con 0x55cfd504a560 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff33a000640 1 -- 172.21.15.8:0/888258264 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff33c04b040 con 0x55cfd504a560 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff35a1a3740 1 -- 172.21.15.8:0/888258264 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cfd4cb07e0 con 0x55cfd504a560 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff33a000640 1 -- 172.21.15.8:0/888258264 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff33c005180 con 0x55cfd504a560 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff35a1a3740 10 client.27280 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff35a1a3740 1 -- 172.21.15.8:0/888258264 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55cfd4faf5a0 con 0x55cfd504a560 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff33a000640 1 -- 172.21.15.8:0/888258264 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55cfd4cb07e0 con 0x55cfd504a560 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff33a000640 1 -- 172.21.15.8:0/888258264 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7ff33c043480 con 0x55cfd504a560 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff35a1a3740 10 client.27280 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff35a1a3740 10 client.27280 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff35a1a3740 20 client.27280 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cfd5063220 0x55cfd5065610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff35a1a3740 4 client.27280 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.426+0000 7ff35a1a3740 1 -- 172.21.15.8:0/888258264 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cfd4ced720 con 0x55cfd5063220 2024-03-16T21:05:28.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.427+0000 7ff354a00640 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cfd5063220 0x55cfd5065610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.427+0000 7ff354a00640 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cfd5063220 0x55cfd5065610 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=44e277c4ccc1798e server_cookie=ddad747156bd312f in_seq=0 out_seq=0 2024-03-16T21:05:28.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.427+0000 7ff33a000640 10 client.27280 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:05:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.428+0000 7ff33a000640 1 -- 172.21.15.8:0/888258264 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55cfd4ced720 con 0x55cfd5063220 2024-03-16T21:05:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.428+0000 7ff33a000640 10 client.27280 handle_command_reply: tid=0 2024-03-16T21:05:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 1 client.27280 shutdown 2024-03-16T21:05:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 1 -- 172.21.15.8:0/888258264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 msgr2=0x55cfd5050760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 0x55cfd5050760 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff33c000c00 tx=0x7ff33c02bc20 comp rx=0 tx=0).stop 2024-03-16T21:05:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 1 -- 172.21.15.8:0/888258264 shutdown_connections 2024-03-16T21:05:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cfd5063220 0x55cfd5065610 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd5053140 0x55cfd5050ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd504a560 0x55cfd5050760 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/888258264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 0x55cfd5050220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff33a000640 0 client.27280 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:05:28.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 1 -- 172.21.15.8:0/888258264 >> 172.21.15.8:0/888258264 conn(0x55cfd5044370 msgr2=0x55cfd50460c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 1 -- 172.21.15.8:0/888258264 shutdown_connections 2024-03-16T21:05:28.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 1 -- 172.21.15.8:0/888258264 wait complete. 2024-03-16T21:05:28.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.429+0000 7ff35a1a3740 20 client.27280 trim_cache size 0 max 16384 2024-03-16T21:05:28.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.443+0000 7ff35a1a3740 1 Processor -- start 2024-03-16T21:05:28.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.443+0000 7ff35a1a3740 1 -- start start 2024-03-16T21:05:28.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.443+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 0x55cfd5052950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.443+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 0x55cfd5050ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.443+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5053140 0x55cfd505e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.443+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd5045370 con 0x55cfd504a560 2024-03-16T21:05:28.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.443+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd5043ea0 con 0x55cfd5049c40 2024-03-16T21:05:28.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.443+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd5055860 con 0x55cfd5053140 2024-03-16T21:05:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.444+0000 7ff347e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 0x55cfd5050ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.444+0000 7ff347e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 0x55cfd5050ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34808/0 (socket says 172.21.15.8:34808) 2024-03-16T21:05:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.444+0000 7ff347e00640 1 -- 172.21.15.8:0/1482705652 learned_addr learned my addr 172.21.15.8:0/1482705652 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.444+0000 7ff355400640 1 --2- 172.21.15.8:0/1482705652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5053140 0x55cfd505e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.444+0000 7ff354a00640 1 --2- 172.21.15.8:0/1482705652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 0x55cfd5052950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.444+0000 7ff347e00640 1 -- 172.21.15.8:0/1482705652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5053140 msgr2=0x55cfd505e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.444+0000 7ff347e00640 1 --2- 172.21.15.8:0/1482705652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5053140 0x55cfd505e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.444+0000 7ff347e00640 1 -- 172.21.15.8:0/1482705652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 msgr2=0x55cfd5052950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.444+0000 7ff347e00640 1 --2- 172.21.15.8:0/1482705652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 0x55cfd5052950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.444+0000 7ff347e00640 1 -- 172.21.15.8:0/1482705652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfd4f4bab0 con 0x55cfd504a560 2024-03-16T21:05:28.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.444+0000 7ff347e00640 1 --2- 172.21.15.8:0/1482705652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 0x55cfd5050ac0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff33c005940 tx=0x7ff33c02c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69aabaf46906dccf server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.445+0000 7ff345200640 1 -- 172.21.15.8:0/1482705652 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c009780 con 0x55cfd504a560 2024-03-16T21:05:28.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.445+0000 7ff345200640 1 -- 172.21.15.8:0/1482705652 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff33c005520 con 0x55cfd504a560 2024-03-16T21:05:28.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.445+0000 7ff345200640 1 -- 172.21.15.8:0/1482705652 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c003b40 con 0x55cfd504a560 2024-03-16T21:05:28.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.445+0000 7ff35a1a3740 1 -- 172.21.15.8:0/1482705652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 msgr2=0x55cfd5050ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.445+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/1482705652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 0x55cfd5050ac0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff33c005940 tx=0x7ff33c02c8a0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.445+0000 7ff35a1a3740 1 -- 172.21.15.8:0/1482705652 shutdown_connections 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.445+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/1482705652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5053140 0x55cfd505e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.445+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/1482705652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 0x55cfd5050ac0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.445+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/1482705652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5049c40 0x55cfd5052950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.446+0000 7ff35a1a3740 1 -- 172.21.15.8:0/1482705652 >> 172.21.15.8:0/1482705652 conn(0x55cfd5044370 msgr2=0x55cfd504b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.446+0000 7ff35a1a3740 1 -- 172.21.15.8:0/1482705652 shutdown_connections 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.446+0000 7ff35a1a3740 1 -- 172.21.15.8:0/1482705652 wait complete. 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.446+0000 7ff35a1a3740 1 -- start start 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.446+0000 7ff35a1a3740 1 Processor -- start 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5049c40 0x55cfd505ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 0x55cfd5056390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff35a1a3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5053140 0x55cfd50569c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd5057060 con 0x55cfd504a560 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd50571d0 con 0x55cfd5053140 2024-03-16T21:05:28.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff35a1a3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd50bdac0 con 0x55cfd5049c40 2024-03-16T21:05:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff35a1a3740 10 client.0 _ll_register_callbacks cb 0x7ff3480093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff354a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5049c40 0x55cfd505ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff354a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5049c40 0x55cfd505ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39286/0 (socket says 172.21.15.8:39286) 2024-03-16T21:05:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff354a00640 1 -- 172.21.15.8:0/2457261377 learned_addr learned my addr 172.21.15.8:0/2457261377 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff347e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 0x55cfd5056390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff355400640 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5053140 0x55cfd50569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff354a00640 1 -- 172.21.15.8:0/2457261377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5053140 msgr2=0x55cfd50569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff354a00640 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5053140 0x55cfd50569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff354a00640 1 -- 172.21.15.8:0/2457261377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 msgr2=0x55cfd5056390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff354a00640 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 0x55cfd5056390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.447+0000 7ff354a00640 1 -- 172.21.15.8:0/2457261377 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cfd4faf5a0 con 0x55cfd5049c40 2024-03-16T21:05:28.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.448+0000 7ff354a00640 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5049c40 0x55cfd505ae20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff340011cb0 tx=0x7ff340009cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59f9744ca8a0eb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.448+0000 7ff33a000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:05:28.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.448+0000 7ff33a000640 1 -- 172.21.15.8:0/2457261377 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340029070 con 0x55cfd5049c40 2024-03-16T21:05:28.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.448+0000 7ff33a000640 1 -- 172.21.15.8:0/2457261377 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff340009530 con 0x55cfd5049c40 2024-03-16T21:05:28.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.448+0000 7ff35a1a3740 1 -- 172.21.15.8:0/2457261377 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff340009e40 con 0x55cfd5049c40 2024-03-16T21:05:28.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.448+0000 7ff33a000640 1 -- 172.21.15.8:0/2457261377 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3400096f0 con 0x55cfd5049c40 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.448+0000 7ff35a1a3740 10 client.27286 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.448+0000 7ff35a1a3740 1 -- 172.21.15.8:0/2457261377 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55cfd4f71650 con 0x55cfd5049c40 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.449+0000 7ff33a000640 1 -- 172.21.15.8:0/2457261377 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff340036080 con 0x55cfd5049c40 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.449+0000 7ff33a000640 1 -- 172.21.15.8:0/2457261377 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7ff340022040 con 0x55cfd5049c40 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.449+0000 7ff35a1a3740 10 client.27286 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.449+0000 7ff35a1a3740 10 client.27286 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.449+0000 7ff35a1a3740 20 client.27286 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.449+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cfd50bf2e0 0x55cfd50c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.449+0000 7ff35a1a3740 4 client.27286 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.449+0000 7ff35a1a3740 1 -- 172.21.15.8:0/2457261377 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cfd4d3c890 con 0x55cfd50bf2e0 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.449+0000 7ff347e00640 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cfd50bf2e0 0x55cfd50c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff347e00640 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cfd50bf2e0 0x55cfd50c1700 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d8568776d0711a1 server_cookie=8a7d071d82ca80a0 in_seq=0 out_seq=0 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff33a000640 10 client.27286 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:05:28.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff33a000640 1 -- 172.21.15.8:0/2457261377 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cfd4d3c890 con 0x55cfd50bf2e0 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff33a000640 10 client.27286 handle_command_reply: tid=0 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff35a1a3740 1 client.27286 shutdown 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff35a1a3740 1 -- 172.21.15.8:0/2457261377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5049c40 msgr2=0x55cfd505ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5049c40 0x55cfd505ae20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff340011cb0 tx=0x7ff340009cb0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff35a1a3740 1 -- 172.21.15.8:0/2457261377 shutdown_connections 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55cfd50bf2e0 0x55cfd50c1700 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cfd5053140 0x55cfd50569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cfd504a560 0x55cfd5056390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff33a000640 0 client.27286 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff35a1a3740 1 --2- 172.21.15.8:0/2457261377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cfd5049c40 0x55cfd505ae20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff35a1a3740 1 -- 172.21.15.8:0/2457261377 >> 172.21.15.8:0/2457261377 conn(0x55cfd5044370 msgr2=0x55cfd5042be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff35a1a3740 1 -- 172.21.15.8:0/2457261377 shutdown_connections 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.450+0000 7ff35a1a3740 1 -- 172.21.15.8:0/2457261377 wait complete. 2024-03-16T21:05:28.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff35a1a3740 20 client.27286 trim_cache size 0 max 16384 2024-03-16T21:05:28.461 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:05:28.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff357400640 1 -- 172.21.15.8:0/3602868965 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff3340a1ba0 msgr2=0x7ff3340a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff357400640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff3340a1ba0 0x7ff3340a4060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff350102da0 tx=0x7ff33c005a20 comp rx=0 tx=0).stop 2024-03-16T21:05:28.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff357400640 1 -- 172.21.15.8:0/3602868965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff350112330 msgr2=0x7ff3501a2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff357400640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff350112330 0x7ff3501a2b20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff348005fd0 tx=0x7ff34800ef10 comp rx=0 tx=0).stop 2024-03-16T21:05:28.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff357400640 1 -- 172.21.15.8:0/3602868965 shutdown_connections 2024-03-16T21:05:28.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff357400640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff3340a1ba0 0x7ff3340a4060 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff357400640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff350112330 0x7ff3501a2b20 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff357400640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff350076340 0x7ff35019e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff357400640 1 --2- 172.21.15.8:0/3602868965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350075a20 0x7ff35019e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff357400640 1 -- 172.21.15.8:0/3602868965 >> 172.21.15.8:0/3602868965 conn(0x7ff3500ff1a0 msgr2=0x7ff350101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.451+0000 7ff357400640 1 -- 172.21.15.8:0/3602868965 shutdown_connections 2024-03-16T21:05:28.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.452+0000 7ff357400640 1 -- 172.21.15.8:0/3602868965 wait complete. 2024-03-16T21:05:28.475 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:05:28.476 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:05:28.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:28 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3087985353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:05:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.694+0000 7f7837e00640 1 -- 172.21.15.8:0/3413755038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78381004c0 msgr2=0x7f78381008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.694+0000 7f7837e00640 1 --2- 172.21.15.8:0/3413755038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78381004c0 0x7f78381008a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f782800d910 tx=0x7f782802dbb0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.694+0000 7f7837e00640 1 -- 172.21.15.8:0/3413755038 shutdown_connections 2024-03-16T21:05:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.694+0000 7f7837e00640 1 --2- 172.21.15.8:0/3413755038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7838105590 0x7f783810d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.694+0000 7f7837e00640 1 --2- 172.21.15.8:0/3413755038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7838100e70 0x7f7838104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.695+0000 7f7837e00640 1 --2- 172.21.15.8:0/3413755038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78381004c0 0x7f78381008a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.695+0000 7f7837e00640 1 -- 172.21.15.8:0/3413755038 >> 172.21.15.8:0/3413755038 conn(0x7f78380fbd40 msgr2=0x7f78380fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.695+0000 7f7837e00640 1 -- 172.21.15.8:0/3413755038 shutdown_connections 2024-03-16T21:05:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.695+0000 7f7837e00640 1 -- 172.21.15.8:0/3413755038 wait complete. 2024-03-16T21:05:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.696+0000 7f7837e00640 1 Processor -- start 2024-03-16T21:05:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.696+0000 7f7837e00640 1 -- start start 2024-03-16T21:05:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.696+0000 7f7837e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78381004c0 0x7f783819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7837e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7838105590 0x7f783819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7837e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7838199ac0 0x7f7838199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7837e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783819a4b0 con 0x7f7838105590 2024-03-16T21:05:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7837e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783819a620 con 0x7f78381004c0 2024-03-16T21:05:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7837e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783819a7e0 con 0x7f7838199ac0 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7836a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78381004c0 0x7f783819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7836a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78381004c0 0x7f783819f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41560/0 (socket says 172.21.15.8:41560) 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7836a00640 1 -- 172.21.15.8:0/2396789174 learned_addr learned my addr 172.21.15.8:0/2396789174 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7836000640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7838105590 0x7f783819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7836a00640 1 -- 172.21.15.8:0/2396789174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7838199ac0 msgr2=0x7f7838199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7837400640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7838199ac0 0x7f7838199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7836a00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7838199ac0 0x7f7838199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7836a00640 1 -- 172.21.15.8:0/2396789174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7838105590 msgr2=0x7f783819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7836a00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7838105590 0x7f783819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7836a00640 1 -- 172.21.15.8:0/2396789174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782800d570 con 0x7f78381004c0 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.697+0000 7f7837400640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7838199ac0 0x7f7838199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.698+0000 7f7836a00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78381004c0 0x7f783819f910 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f782800da30 tx=0x7f78280048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.698+0000 7f783ca00640 1 -- 172.21.15.8:0/2396789174 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828005390 con 0x7f78381004c0 2024-03-16T21:05:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.698+0000 7f783ca00640 1 -- 172.21.15.8:0/2396789174 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7828004d20 con 0x7f78381004c0 2024-03-16T21:05:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.698+0000 7f783ca00640 1 -- 172.21.15.8:0/2396789174 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782802e7d0 con 0x7f78381004c0 2024-03-16T21:05:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.698+0000 7f7837e00640 1 -- 172.21.15.8:0/2396789174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78381a67d0 con 0x7f78381004c0 2024-03-16T21:05:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.698+0000 7f7837e00640 1 -- 172.21.15.8:0/2396789174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78381a6c00 con 0x7f78381004c0 2024-03-16T21:05:28.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.701+0000 7f7840beb740 1 Processor -- start 2024-03-16T21:05:28.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.701+0000 7f7840beb740 1 -- start start 2024-03-16T21:05:28.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f783ca00640 1 -- 172.21.15.8:0/2396789174 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7828003880 con 0x7f78381004c0 2024-03-16T21:05:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7840beb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 0x556c71a931d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7840beb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a93710 0x556c71a9bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7840beb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a9c2f0 0x556c71a9e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7840beb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c71a01210 con 0x556c71a9c2f0 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7840beb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c719fe740 con 0x556c71a92df0 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7840beb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c719f9f20 con 0x556c71a93710 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7837400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 0x556c71a931d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7837400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 0x556c71a931d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41564/0 (socket says 172.21.15.8:41564) 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7837400640 1 -- 172.21.15.8:0/2954205627 learned_addr learned my addr 172.21.15.8:0/2954205627 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7836a00640 1 --2- 172.21.15.8:0/2954205627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a93710 0x556c71a9bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7836000640 1 --2- 172.21.15.8:0/2954205627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a9c2f0 0x556c71a9e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.702+0000 7f7837400640 1 -- 172.21.15.8:0/2954205627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a93710 msgr2=0x556c71a9bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.703+0000 7f7837400640 1 --2- 172.21.15.8:0/2954205627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a93710 0x556c71a9bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.703+0000 7f7837400640 1 -- 172.21.15.8:0/2954205627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a9c2f0 msgr2=0x556c71a9e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.703+0000 7f7837400640 1 --2- 172.21.15.8:0/2954205627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a9c2f0 0x556c71a9e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.703+0000 7f7837400640 1 -- 172.21.15.8:0/2954205627 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c719bbdf0 con 0x556c71a92df0 2024-03-16T21:05:28.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.703+0000 7f7836000640 1 --2- 172.21.15.8:0/2954205627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a9c2f0 0x556c71a9e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:05:28.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.703+0000 7f7837400640 1 --2- 172.21.15.8:0/2954205627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 0x556c71a931d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7830009c00 tx=0x7f7830010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a429e0f2e25022a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.703+0000 7f7823e00640 1 -- 172.21.15.8:0/2954205627 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830004030 con 0x556c71a92df0 2024-03-16T21:05:28.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.703+0000 7f783ca00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f781c0a1ba0 0x7f781c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.703+0000 7f7823e00640 1 -- 172.21.15.8:0/2954205627 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7830004190 con 0x556c71a92df0 2024-03-16T21:05:28.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.703+0000 7f7823e00640 1 -- 172.21.15.8:0/2954205627 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78300126b0 con 0x556c71a92df0 2024-03-16T21:05:28.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.703+0000 7f783ca00640 1 -- 172.21.15.8:0/2396789174 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f78280ef170 con 0x7f78381004c0 2024-03-16T21:05:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.704+0000 7f7836a00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f781c0a1ba0 0x7f781c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.704+0000 7f7840beb740 1 -- 172.21.15.8:0/2954205627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 msgr2=0x556c71a931d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.704+0000 7f7840beb740 1 --2- 172.21.15.8:0/2954205627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 0x556c71a931d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7830009c00 tx=0x7f7830010740 comp rx=0 tx=0).stop 2024-03-16T21:05:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.704+0000 7f7840beb740 1 -- 172.21.15.8:0/2954205627 shutdown_connections 2024-03-16T21:05:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.704+0000 7f7840beb740 1 --2- 172.21.15.8:0/2954205627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a9c2f0 0x556c71a9e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.704+0000 7f7840beb740 1 --2- 172.21.15.8:0/2954205627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a93710 0x556c71a9bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.704+0000 7f7840beb740 1 --2- 172.21.15.8:0/2954205627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 0x556c71a931d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.704+0000 7f7840beb740 1 -- 172.21.15.8:0/2954205627 >> 172.21.15.8:0/2954205627 conn(0x556c71a8d520 msgr2=0x556c71a8d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.704+0000 7f7840beb740 1 -- 172.21.15.8:0/2954205627 shutdown_connections 2024-03-16T21:05:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.704+0000 7f7840beb740 1 -- 172.21.15.8:0/2954205627 wait complete. 2024-03-16T21:05:28.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.704+0000 7f7836a00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f781c0a1ba0 0x7f781c0a4060 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f78280eca80 tx=0x7f7828003c20 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.705+0000 7f7840beb740 1 -- start start 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.705+0000 7f7840beb740 1 Processor -- start 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.705+0000 7f7840beb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a92df0 0x556c71a993c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.705+0000 7f7840beb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a99900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.705+0000 7f7840beb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a9c2f0 0x556c71a99e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.705+0000 7f7840beb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7199f150 con 0x556c71a9c2f0 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.705+0000 7f7840beb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7199edf0 con 0x556c71a93710 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.705+0000 7f7840beb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c717681c0 con 0x556c71a92df0 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.705+0000 7f7840beb740 10 client.0 _ll_register_callbacks cb 0x556c719ee2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.706+0000 7f7836000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a99900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.706+0000 7f7836000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a99900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41570/0 (socket says 172.21.15.8:41570) 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.706+0000 7f7836000640 1 -- 172.21.15.8:0/661546528 learned_addr learned my addr 172.21.15.8:0/661546528 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.706+0000 7f7837400640 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a92df0 0x556c71a993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.706+0000 7f7837400640 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a9c2f0 0x556c71a99e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.706+0000 7f7836000640 1 -- 172.21.15.8:0/661546528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a92df0 msgr2=0x556c71a993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.706+0000 7f7836000640 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a92df0 0x556c71a993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.706+0000 7f7836000640 1 -- 172.21.15.8:0/661546528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a9c2f0 msgr2=0x556c71a99e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.706+0000 7f7836000640 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a9c2f0 0x556c71a99e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.706+0000 7f7836000640 1 -- 172.21.15.8:0/661546528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78300098b0 con 0x556c71a93710 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.707+0000 7f7836000640 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a99900 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f78240109f0 tx=0x7f7824010eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af308baafb83a152 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.707+0000 7f7820c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.707+0000 7f7820c00640 1 -- 172.21.15.8:0/661546528 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782400ec50 con 0x556c71a93710 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.707+0000 7f7820c00640 1 -- 172.21.15.8:0/661546528 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f782400edb0 con 0x556c71a93710 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.707+0000 7f7840beb740 1 -- 172.21.15.8:0/661546528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c716f97e0 con 0x556c71a93710 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.707+0000 7f7820c00640 1 -- 172.21.15.8:0/661546528 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7824003970 con 0x556c71a93710 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.707+0000 7f7840beb740 10 client.27287 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.707+0000 7f7840beb740 1 -- 172.21.15.8:0/661546528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x556c719f85a0 con 0x556c71a93710 2024-03-16T21:05:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.708+0000 7f7820c00640 1 -- 172.21.15.8:0/661546528 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x556c716f97e0 con 0x556c71a93710 2024-03-16T21:05:28.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.708+0000 7f7820c00640 1 -- 172.21.15.8:0/661546528 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f7824020030 con 0x556c71a93710 2024-03-16T21:05:28.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.708+0000 7f7840beb740 10 client.27287 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:28.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.708+0000 7f7840beb740 10 client.27287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:05:28.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.708+0000 7f7840beb740 20 client.27287 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:28.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.708+0000 7f7840beb740 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c71aac540 0x556c71aae960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.708+0000 7f7840beb740 4 client.27287 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:05:28.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.708+0000 7f7840beb740 1 -- 172.21.15.8:0/661546528 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c71736720 con 0x556c71aac540 2024-03-16T21:05:28.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.708+0000 7f7837400640 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c71aac540 0x556c71aae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.709+0000 7f7837400640 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c71aac540 0x556c71aae960 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5761ba80c4b14c85 server_cookie=e2603b08ae0a244c in_seq=0 out_seq=0 2024-03-16T21:05:28.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.709+0000 7f7820c00640 10 client.27287 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:28.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.709+0000 7f7820c00640 1 -- 172.21.15.8:0/661546528 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556c71736720 con 0x556c71aac540 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.709+0000 7f7820c00640 10 client.27287 handle_command_reply: tid=0 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.709+0000 7f7840beb740 1 client.27287 shutdown 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7840beb740 1 -- 172.21.15.8:0/661546528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 msgr2=0x556c71a99900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7840beb740 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a99900 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f78240109f0 tx=0x7f7824010eb0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7840beb740 1 -- 172.21.15.8:0/661546528 shutdown_connections 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7840beb740 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c71aac540 0x556c71aae960 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7840beb740 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a9c2f0 0x556c71a99e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7820c00640 0 client.27287 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7840beb740 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a99900 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7840beb740 1 --2- 172.21.15.8:0/661546528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a92df0 0x556c71a993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7840beb740 1 -- 172.21.15.8:0/661546528 >> 172.21.15.8:0/661546528 conn(0x556c71a8d520 msgr2=0x556c71a8f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7840beb740 1 -- 172.21.15.8:0/661546528 shutdown_connections 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7840beb740 1 -- 172.21.15.8:0/661546528 wait complete. 2024-03-16T21:05:28.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.710+0000 7f7840beb740 20 client.27287 trim_cache size 0 max 16384 2024-03-16T21:05:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7840beb740 1 Processor -- start 2024-03-16T21:05:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7840beb740 1 -- start start 2024-03-16T21:05:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7840beb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a92df0 0x556c71a9baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7840beb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a88550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7840beb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a9c2f0 0x556c71a99c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7840beb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c71a92170 con 0x556c71a92df0 2024-03-16T21:05:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7840beb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c71a88a90 con 0x556c71a93710 2024-03-16T21:05:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7840beb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c71a8e520 con 0x556c71a9c2f0 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7836000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a88550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7837400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a92df0 0x556c71a9baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7836000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a88550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41586/0 (socket says 172.21.15.8:41586) 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.724+0000 7f7836000640 1 -- 172.21.15.8:0/4134410534 learned_addr learned my addr 172.21.15.8:0/4134410534 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.725+0000 7f7837400640 1 --2- 172.21.15.8:0/4134410534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a9c2f0 0x556c71a99c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.725+0000 7f7836000640 1 -- 172.21.15.8:0/4134410534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a9c2f0 msgr2=0x556c71a99c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.725+0000 7f7836000640 1 --2- 172.21.15.8:0/4134410534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a9c2f0 0x556c71a99c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.725+0000 7f7836000640 1 -- 172.21.15.8:0/4134410534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a92df0 msgr2=0x556c71a9baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.725+0000 7f7836000640 1 --2- 172.21.15.8:0/4134410534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a92df0 0x556c71a9baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.725+0000 7f7836000640 1 -- 172.21.15.8:0/4134410534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c71994ab0 con 0x556c71a93710 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.725+0000 7f7836000640 1 --2- 172.21.15.8:0/4134410534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a88550 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7824011500 tx=0x7f782400e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aca45d9183673ed6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7823400640 1 -- 172.21.15.8:0/4134410534 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782400ea50 con 0x556c71a93710 2024-03-16T21:05:28.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7823400640 1 -- 172.21.15.8:0/4134410534 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7824015070 con 0x556c71a93710 2024-03-16T21:05:28.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7823400640 1 -- 172.21.15.8:0/4134410534 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824011cc0 con 0x556c71a93710 2024-03-16T21:05:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7840beb740 1 -- 172.21.15.8:0/4134410534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 msgr2=0x556c71a88550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7840beb740 1 --2- 172.21.15.8:0/4134410534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a88550 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7824011500 tx=0x7f782400e720 comp rx=0 tx=0).stop 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7840beb740 1 -- 172.21.15.8:0/4134410534 shutdown_connections 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7840beb740 1 --2- 172.21.15.8:0/4134410534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a9c2f0 0x556c71a99c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7840beb740 1 --2- 172.21.15.8:0/4134410534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a93710 0x556c71a88550 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7840beb740 1 --2- 172.21.15.8:0/4134410534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a92df0 0x556c71a9baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7840beb740 1 -- 172.21.15.8:0/4134410534 >> 172.21.15.8:0/4134410534 conn(0x556c71a8d520 msgr2=0x556c71a8c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7840beb740 1 -- 172.21.15.8:0/4134410534 shutdown_connections 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.726+0000 7f7840beb740 1 -- 172.21.15.8:0/4134410534 wait complete. 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.727+0000 7f7840beb740 1 -- start start 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.727+0000 7f7840beb740 1 Processor -- start 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.727+0000 7f7840beb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 0x556c71aa3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.727+0000 7f7840beb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a93710 0x556c71aa3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.727+0000 7f7840beb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a9c2f0 0x556c71a9fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.727+0000 7f7840beb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c71aa0370 con 0x556c71a93710 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.727+0000 7f7840beb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c71aa04e0 con 0x556c71a92df0 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.727+0000 7f7840beb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c71aa06a0 con 0x556c71a9c2f0 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.727+0000 7f7840beb740 10 client.0 _ll_register_callbacks cb 0x7f7824007680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7836000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a93710 0x556c71aa3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7837400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 0x556c71aa3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7836000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a93710 0x556c71aa3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34858/0 (socket says 172.21.15.8:34858) 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7836000640 1 -- 172.21.15.8:0/2257294943 learned_addr learned my addr 172.21.15.8:0/2257294943 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7837400640 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a9c2f0 0x556c71a9fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7836000640 1 -- 172.21.15.8:0/2257294943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a9c2f0 msgr2=0x556c71a9fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7836000640 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a9c2f0 0x556c71a9fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7836000640 1 -- 172.21.15.8:0/2257294943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 msgr2=0x556c71aa3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7836000640 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 0x556c71aa3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7836000640 1 -- 172.21.15.8:0/2257294943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c719f85a0 con 0x556c71a93710 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7837400640 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 0x556c71aa3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7836000640 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a93710 0x556c71aa3dd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7824000f80 tx=0x7f7824011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89689f0ac1a2b106 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.728+0000 7f7820c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.729+0000 7f7820c00640 1 -- 172.21.15.8:0/2257294943 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782400ec60 con 0x556c71a93710 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.729+0000 7f7840beb740 1 -- 172.21.15.8:0/2257294943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c71a88c30 con 0x556c71a93710 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.729+0000 7f7820c00640 1 -- 172.21.15.8:0/2257294943 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f782400edc0 con 0x556c71a93710 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.729+0000 7f7820c00640 1 -- 172.21.15.8:0/2257294943 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7824003970 con 0x556c71a93710 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.729+0000 7f7840beb740 10 client.17112 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.729+0000 7f7840beb740 1 -- 172.21.15.8:0/2257294943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x556c719ba650 con 0x556c71a93710 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.729+0000 7f7820c00640 1 -- 172.21.15.8:0/2257294943 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f782403f080 con 0x556c71a93710 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.729+0000 7f7820c00640 1 -- 172.21.15.8:0/2257294943 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f7824039030 con 0x556c71a93710 2024-03-16T21:05:28.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.730+0000 7f7840beb740 10 client.17112 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:28.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.730+0000 7f7840beb740 10 client.17112 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:05:28.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.730+0000 7f7840beb740 20 client.17112 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:28.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.730+0000 7f7840beb740 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c71b08cf0 0x556c71b0b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:28.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.730+0000 7f7840beb740 4 client.17112 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:05:28.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.730+0000 7f7840beb740 1 -- 172.21.15.8:0/2257294943 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f7830004190 con 0x556c71b08cf0 2024-03-16T21:05:28.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.730+0000 7f7837400640 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c71b08cf0 0x556c71b0b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:28.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.730+0000 7f7837400640 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c71b08cf0 0x556c71b0b110 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c361530e47a584f2 server_cookie=2d4e7a6e41565f91 in_seq=0 out_seq=0 2024-03-16T21:05:28.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.730+0000 7f7820c00640 10 client.17112 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:28.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7820c00640 1 -- 172.21.15.8:0/2257294943 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f7830004190 con 0x556c71b08cf0 2024-03-16T21:05:28.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7820c00640 10 client.17112 handle_command_reply: tid=0 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 1 client.17112 shutdown 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 1 -- 172.21.15.8:0/2257294943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a93710 msgr2=0x556c71aa3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a93710 0x556c71aa3dd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7824000f80 tx=0x7f7824011ef0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 1 -- 172.21.15.8:0/2257294943 shutdown_connections 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c71a9c2f0 0x556c71a9fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x556c71b08cf0 0x556c71b0b110 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71a93710 0x556c71aa3dd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 1 --2- 172.21.15.8:0/2257294943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c71a92df0 0x556c71aa3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7820c00640 0 client.17112 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 1 -- 172.21.15.8:0/2257294943 >> 172.21.15.8:0/2257294943 conn(0x556c71a8d520 msgr2=0x556c71a8e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 1 -- 172.21.15.8:0/2257294943 shutdown_connections 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 1 -- 172.21.15.8:0/2257294943 wait complete. 2024-03-16T21:05:28.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.731+0000 7f7840beb740 20 client.17112 trim_cache size 0 max 16384 2024-03-16T21:05:28.742 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:05:28.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 -- 172.21.15.8:0/2396789174 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f781c0a1ba0 msgr2=0x7f781c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f781c0a1ba0 0x7f781c0a4060 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f78280eca80 tx=0x7f7828003c20 comp rx=0 tx=0).stop 2024-03-16T21:05:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 -- 172.21.15.8:0/2396789174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78381004c0 msgr2=0x7f783819f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78381004c0 0x7f783819f910 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f782800da30 tx=0x7f78280048f0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 -- 172.21.15.8:0/2396789174 shutdown_connections 2024-03-16T21:05:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f781c0a1ba0 0x7f781c0a4060 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7838199ac0 0x7f7838199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7838105590 0x7f783819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 --2- 172.21.15.8:0/2396789174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78381004c0 0x7f783819f910 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 -- 172.21.15.8:0/2396789174 >> 172.21.15.8:0/2396789174 conn(0x7f78380fbd40 msgr2=0x7f78380fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 -- 172.21.15.8:0/2396789174 shutdown_connections 2024-03-16T21:05:28.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:28.732+0000 7f7837e00640 1 -- 172.21.15.8:0/2396789174 wait complete. 2024-03-16T21:05:29.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:29 smithi186 ceph-mon[36391]: pgmap v234: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:05:29.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:29 smithi008 ceph-mon[31434]: pgmap v234: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:05:29.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:29 smithi170 ceph-mon[35947]: pgmap v234: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-16T21:05:29.758 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:05:29.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:05:29.758 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:05:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.989+0000 7f4230600640 1 -- 172.21.15.8:0/3583359798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4228073890 msgr2=0x7f4228073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.989+0000 7f4230600640 1 --2- 172.21.15.8:0/3583359798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4228073890 0x7f4228073c70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4218009900 tx=0x7f421802bcc0 comp rx=0 tx=0).stop 2024-03-16T21:05:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.990+0000 7f4230600640 1 -- 172.21.15.8:0/3583359798 shutdown_connections 2024-03-16T21:05:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.990+0000 7f4230600640 1 --2- 172.21.15.8:0/3583359798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4228112490 0x7f4228114880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.990+0000 7f4230600640 1 --2- 172.21.15.8:0/3583359798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42280741b0 0x7f4228111f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.990+0000 7f4230600640 1 --2- 172.21.15.8:0/3583359798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4228073890 0x7f4228073c70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.990+0000 7f4230600640 1 -- 172.21.15.8:0/3583359798 >> 172.21.15.8:0/3583359798 conn(0x7f42280fcf90 msgr2=0x7f42280ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.990+0000 7f4230600640 1 -- 172.21.15.8:0/3583359798 shutdown_connections 2024-03-16T21:05:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.990+0000 7f4230600640 1 -- 172.21.15.8:0/3583359798 wait complete. 2024-03-16T21:05:29.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f4230600640 1 Processor -- start 2024-03-16T21:05:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f4230600640 1 -- start start 2024-03-16T21:05:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f4230600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4228073890 0x7f422819e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f4230600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42280741b0 0x7f422819e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f4230600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4228112490 0x7f42281a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f4230600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42281a3140 con 0x7f4228112490 2024-03-16T21:05:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f4230600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42281a32b0 con 0x7f42280741b0 2024-03-16T21:05:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f4230600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42281a3470 con 0x7f4228073890 2024-03-16T21:05:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f422dc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4228073890 0x7f422819e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f422dc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4228073890 0x7f422819e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39356/0 (socket says 172.21.15.8:39356) 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f422dc00640 1 -- 172.21.15.8:0/3953693260 learned_addr learned my addr 172.21.15.8:0/3953693260 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.991+0000 7f422d200640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42280741b0 0x7f422819e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.992+0000 7f422e600640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4228112490 0x7f42281a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.992+0000 7f422dc00640 1 -- 172.21.15.8:0/3953693260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42280741b0 msgr2=0x7f422819e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.992+0000 7f422dc00640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42280741b0 0x7f422819e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.992+0000 7f422dc00640 1 -- 172.21.15.8:0/3953693260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4228112490 msgr2=0x7f42281a2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.992+0000 7f422dc00640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4228112490 0x7f42281a2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.992+0000 7f422dc00640 1 -- 172.21.15.8:0/3953693260 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218009560 con 0x7f4228073890 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.992+0000 7f422d200640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42280741b0 0x7f422819e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.992+0000 7f422dc00640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4228073890 0x7f422819e280 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4218000c00 tx=0x7f421802c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.993+0000 7f4226000640 1 -- 172.21.15.8:0/3953693260 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421802dca0 con 0x7f4228073890 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.993+0000 7f4226000640 1 -- 172.21.15.8:0/3953693260 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f421802de00 con 0x7f4228073890 2024-03-16T21:05:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.993+0000 7f4230600640 1 -- 172.21.15.8:0/3953693260 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42281a36f0 con 0x7f4228073890 2024-03-16T21:05:30.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.993+0000 7f4226000640 1 -- 172.21.15.8:0/3953693260 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218003c90 con 0x7f4228073890 2024-03-16T21:05:30.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.993+0000 7f4230600640 1 -- 172.21.15.8:0/3953693260 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42281aafd0 con 0x7f4228073890 2024-03-16T21:05:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.996+0000 7f4226000640 1 -- 172.21.15.8:0/3953693260 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f4218004e10 con 0x7f4228073890 2024-03-16T21:05:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.996+0000 7f42333f0740 1 Processor -- start 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.996+0000 7f42333f0740 1 -- start start 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f42333f0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 0x55fec1ea1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f42333f0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 0x55fec1ea9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f42333f0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1eaa440 0x55fec1eac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f42333f0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1e5c300 con 0x55fec1ea1860 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f42333f0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1e0ee50 con 0x55fec1eaa440 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f42333f0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1e0c380 con 0x55fec1ea0f40 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f422e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 0x55fec1ea1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f422e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 0x55fec1ea1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39362/0 (socket says 172.21.15.8:39362) 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f422e600640 1 -- 172.21.15.8:0/760176702 learned_addr learned my addr 172.21.15.8:0/760176702 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f422dc00640 1 --2- 172.21.15.8:0/760176702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 0x55fec1ea9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f422d200640 1 --2- 172.21.15.8:0/760176702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1eaa440 0x55fec1eac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f422e600640 1 -- 172.21.15.8:0/760176702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1eaa440 msgr2=0x55fec1eac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f422e600640 1 --2- 172.21.15.8:0/760176702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1eaa440 0x55fec1eac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f422e600640 1 -- 172.21.15.8:0/760176702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 msgr2=0x55fec1ea9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f422e600640 1 --2- 172.21.15.8:0/760176702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 0x55fec1ea9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f422e600640 1 -- 172.21.15.8:0/760176702 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fec1dd0c80 con 0x55fec1ea0f40 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.997+0000 7f422dc00640 1 --2- 172.21.15.8:0/760176702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 0x55fec1ea9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.998+0000 7f4226000640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f420c0a1c20 0x7f420c0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.998+0000 7f422e600640 1 --2- 172.21.15.8:0/760176702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 0x55fec1ea1320 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4220009f30 tx=0x7f42200118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41fa9ec9d1b44d05 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.998+0000 7f4226000640 1 -- 172.21.15.8:0/3953693260 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f42180efc60 con 0x7f4228073890 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.998+0000 7f421ea00640 1 -- 172.21.15.8:0/760176702 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220004d20 con 0x55fec1ea0f40 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.998+0000 7f422dc00640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f420c0a1c20 0x7f420c0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.998+0000 7f421ea00640 1 -- 172.21.15.8:0/760176702 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4220004e80 con 0x55fec1ea0f40 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.998+0000 7f421ea00640 1 -- 172.21.15.8:0/760176702 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220005280 con 0x55fec1ea0f40 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.998+0000 7f42333f0740 1 -- 172.21.15.8:0/760176702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 msgr2=0x55fec1ea1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.998+0000 7f42333f0740 1 --2- 172.21.15.8:0/760176702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 0x55fec1ea1320 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4220009f30 tx=0x7f42200118d0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.999+0000 7f422dc00640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f420c0a1c20 0x7f420c0a40e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55fec1ea0a10 tx=0x7f421802bcc0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.999+0000 7f42333f0740 1 -- 172.21.15.8:0/760176702 shutdown_connections 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.999+0000 7f42333f0740 1 --2- 172.21.15.8:0/760176702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1eaa440 0x55fec1eac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.999+0000 7f42333f0740 1 --2- 172.21.15.8:0/760176702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 0x55fec1ea9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.999+0000 7f42333f0740 1 --2- 172.21.15.8:0/760176702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 0x55fec1ea1320 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.999+0000 7f42333f0740 1 -- 172.21.15.8:0/760176702 >> 172.21.15.8:0/760176702 conn(0x55fec1e9b670 msgr2=0x55fec1e9ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.999+0000 7f42333f0740 1 -- 172.21.15.8:0/760176702 shutdown_connections 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.999+0000 7f42333f0740 1 -- 172.21.15.8:0/760176702 wait complete. 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.999+0000 7f42333f0740 1 -- start start 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:29.999+0000 7f42333f0740 1 Processor -- start 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f42333f0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1ea0f40 0x55fec1ea7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f42333f0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 0x55fec1ea79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f42333f0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 0x55fec1ea7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f42333f0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1e07b60 con 0x55fec1eaa440 2024-03-16T21:05:30.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f42333f0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1dacfd0 con 0x55fec1ea0f40 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f42333f0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1dacc70 con 0x55fec1ea1860 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f42333f0740 10 client.0 _ll_register_callbacks cb 0x55fec1b18c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f422d200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 0x55fec1ea79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f422e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1ea0f40 0x55fec1ea7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f422d200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 0x55fec1ea79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39370/0 (socket says 172.21.15.8:39370) 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f422d200640 1 -- 172.21.15.8:0/23391448 learned_addr learned my addr 172.21.15.8:0/23391448 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.000+0000 7f422e600640 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 0x55fec1ea7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f422d200640 1 -- 172.21.15.8:0/23391448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1ea0f40 msgr2=0x55fec1ea7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f422d200640 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1ea0f40 0x55fec1ea7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f422d200640 1 -- 172.21.15.8:0/23391448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 msgr2=0x55fec1ea7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f422d200640 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 0x55fec1ea7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f422d200640 1 -- 172.21.15.8:0/23391448 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4220009be0 con 0x55fec1ea1860 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f422e600640 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 0x55fec1ea7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:05:30.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f422d200640 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 0x55fec1ea79b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4214011790 tx=0x7f4214011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=655d8657a8c94c03 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f4213400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f4213400640 1 -- 172.21.15.8:0/23391448 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214011ea0 con 0x55fec1ea1860 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f4213400640 1 -- 172.21.15.8:0/23391448 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4214010c60 con 0x55fec1ea1860 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f42333f0740 1 -- 172.21.15.8:0/23391448 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fec1b58410 con 0x55fec1ea1860 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f4213400640 1 -- 172.21.15.8:0/23391448 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4214016070 con 0x55fec1ea1860 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f42333f0740 10 client.27313 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.001+0000 7f42333f0740 1 -- 172.21.15.8:0/23391448 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55fec1e061e0 con 0x55fec1ea1860 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.002+0000 7f4213400640 1 -- 172.21.15.8:0/23391448 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55fec1b58410 con 0x55fec1ea1860 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.002+0000 7f4213400640 1 -- 172.21.15.8:0/23391448 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f421400f450 con 0x55fec1ea1860 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.002+0000 7f42333f0740 10 client.27313 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.002+0000 7f42333f0740 10 client.27313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:05:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.002+0000 7f42333f0740 20 client.27313 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.002+0000 7f42333f0740 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fec1eba960 0x55fec1ebcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.002+0000 7f42333f0740 4 client.27313 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.002+0000 7f42333f0740 1 -- 172.21.15.8:0/23391448 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fec1b447b0 con 0x55fec1eba960 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.002+0000 7f422e600640 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fec1eba960 0x55fec1ebcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.003+0000 7f422e600640 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fec1eba960 0x55fec1ebcd80 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c12a79da92bb2b7 server_cookie=dec1cf6111284bab in_seq=0 out_seq=0 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.003+0000 7f4213400640 10 client.27313 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.003+0000 7f4213400640 1 -- 172.21.15.8:0/23391448 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55fec1b447b0 con 0x55fec1eba960 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.003+0000 7f4213400640 10 client.27313 handle_command_reply: tid=0 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 1 client.27313 shutdown 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 1 -- 172.21.15.8:0/23391448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 msgr2=0x55fec1ea79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 0x55fec1ea79b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4214011790 tx=0x7f4214011c50 comp rx=0 tx=0).stop 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 1 -- 172.21.15.8:0/23391448 shutdown_connections 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fec1eba960 0x55fec1ebcd80 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 0x55fec1ea7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 0x55fec1ea79b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 1 --2- 172.21.15.8:0/23391448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1ea0f40 0x55fec1ea7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 1 -- 172.21.15.8:0/23391448 >> 172.21.15.8:0/23391448 conn(0x55fec1e9b670 msgr2=0x55fec1e9d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f4213400640 0 client.27313 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 1 -- 172.21.15.8:0/23391448 shutdown_connections 2024-03-16T21:05:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 1 -- 172.21.15.8:0/23391448 wait complete. 2024-03-16T21:05:30.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.004+0000 7f42333f0740 20 client.27313 trim_cache size 0 max 16384 2024-03-16T21:05:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.022+0000 7f42333f0740 1 Processor -- start 2024-03-16T21:05:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.022+0000 7f42333f0740 1 -- start start 2024-03-16T21:05:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f42333f0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1ea0f40 0x55fec1ea9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f42333f0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 0x55fec1e9d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f42333f0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 0x55fec1e9d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f42333f0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1b500c0 con 0x55fec1eaa440 2024-03-16T21:05:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f42333f0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1e8d390 con 0x55fec1ea0f40 2024-03-16T21:05:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f42333f0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1e96a70 con 0x55fec1ea1860 2024-03-16T21:05:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f422e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1ea0f40 0x55fec1ea9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f422e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 0x55fec1e9d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f422e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 0x55fec1e9d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34898/0 (socket says 172.21.15.8:34898) 2024-03-16T21:05:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f422e600640 1 -- 172.21.15.8:0/148211669 learned_addr learned my addr 172.21.15.8:0/148211669 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f422d200640 1 --2- 172.21.15.8:0/148211669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 0x55fec1e9d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f422e600640 1 -- 172.21.15.8:0/148211669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 msgr2=0x55fec1e9d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f422e600640 1 --2- 172.21.15.8:0/148211669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 0x55fec1e9d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f422e600640 1 -- 172.21.15.8:0/148211669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1ea0f40 msgr2=0x55fec1ea9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f422e600640 1 --2- 172.21.15.8:0/148211669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1ea0f40 0x55fec1ea9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.023+0000 7f422e600640 1 -- 172.21.15.8:0/148211669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fec1da2a90 con 0x55fec1eaa440 2024-03-16T21:05:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.024+0000 7f422e600640 1 --2- 172.21.15.8:0/148211669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 0x55fec1e9d570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4220014040 tx=0x7f42200118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e113b4e22545a856 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.024+0000 7f421e000640 1 -- 172.21.15.8:0/148211669 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200048a0 con 0x55fec1eaa440 2024-03-16T21:05:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.024+0000 7f421e000640 1 -- 172.21.15.8:0/148211669 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4220035070 con 0x55fec1eaa440 2024-03-16T21:05:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.024+0000 7f421e000640 1 -- 172.21.15.8:0/148211669 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422002f810 con 0x55fec1eaa440 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.025+0000 7f42333f0740 1 -- 172.21.15.8:0/148211669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 msgr2=0x55fec1e9d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.025+0000 7f42333f0740 1 --2- 172.21.15.8:0/148211669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 0x55fec1e9d570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4220014040 tx=0x7f42200118d0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.025+0000 7f42333f0740 1 -- 172.21.15.8:0/148211669 shutdown_connections 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.025+0000 7f42333f0740 1 --2- 172.21.15.8:0/148211669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1eaa440 0x55fec1e9d570 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.025+0000 7f42333f0740 1 --2- 172.21.15.8:0/148211669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea1860 0x55fec1e9d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.025+0000 7f42333f0740 1 --2- 172.21.15.8:0/148211669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1ea0f40 0x55fec1ea9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.025+0000 7f42333f0740 1 -- 172.21.15.8:0/148211669 >> 172.21.15.8:0/148211669 conn(0x55fec1e9b670 msgr2=0x55fec1e9c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.025+0000 7f42333f0740 1 -- 172.21.15.8:0/148211669 shutdown_connections 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.025+0000 7f42333f0740 1 -- 172.21.15.8:0/148211669 wait complete. 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f42333f0740 1 -- start start 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f42333f0740 1 Processor -- start 2024-03-16T21:05:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f42333f0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 0x55fec1eaf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f42333f0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 0x55fec1eafa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f42333f0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1eaa440 0x55fec1f101f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f42333f0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1f10730 con 0x55fec1ea1860 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f42333f0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1f10870 con 0x55fec1eaa440 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f42333f0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1f10a30 con 0x55fec1ea0f40 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f42333f0740 10 client.0 _ll_register_callbacks cb 0x7f421400bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f422d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 0x55fec1eafa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f422e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 0x55fec1eaf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.026+0000 7f422e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 0x55fec1eaf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39378/0 (socket says 172.21.15.8:39378) 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f422e600640 1 -- 172.21.15.8:0/3544361011 learned_addr learned my addr 172.21.15.8:0/3544361011 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f422e600640 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1eaa440 0x55fec1f101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f422d200640 1 -- 172.21.15.8:0/3544361011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 msgr2=0x55fec1eaf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f422d200640 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 0x55fec1eaf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f422d200640 1 -- 172.21.15.8:0/3544361011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1eaa440 msgr2=0x55fec1f101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f422d200640 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1eaa440 0x55fec1f101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f422d200640 1 -- 172.21.15.8:0/3544361011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fec1dd0c80 con 0x55fec1ea1860 2024-03-16T21:05:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f422d200640 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 0x55fec1eafa30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f421400f830 tx=0x7f4214005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6e1acc058ae33a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f4213400640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:05:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f4213400640 1 -- 172.21.15.8:0/3544361011 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214016040 con 0x55fec1ea1860 2024-03-16T21:05:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f4213400640 1 -- 172.21.15.8:0/3544361011 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f421400fc20 con 0x55fec1ea1860 2024-03-16T21:05:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.027+0000 7f42333f0740 1 -- 172.21.15.8:0/3544361011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fec1b07860 con 0x55fec1ea1860 2024-03-16T21:05:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.028+0000 7f4213400640 1 -- 172.21.15.8:0/3544361011 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4214011ea0 con 0x55fec1ea1860 2024-03-16T21:05:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.028+0000 7f42333f0740 10 client.17130 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.028+0000 7f42333f0740 1 -- 172.21.15.8:0/3544361011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55fec1dc86a0 con 0x55fec1ea1860 2024-03-16T21:05:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.028+0000 7f4213400640 1 -- 172.21.15.8:0/3544361011 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f4214039020 con 0x55fec1ea1860 2024-03-16T21:05:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.028+0000 7f4213400640 1 -- 172.21.15.8:0/3544361011 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f4214004960 con 0x55fec1ea1860 2024-03-16T21:05:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.028+0000 7f42333f0740 10 client.17130 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.028+0000 7f42333f0740 10 client.17130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:05:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.028+0000 7f42333f0740 20 client.17130 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.028+0000 7f42333f0740 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fec1f18210 0x55fec1f1a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.028+0000 7f42333f0740 4 client.17130 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:05:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.028+0000 7f42333f0740 1 -- 172.21.15.8:0/3544361011 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55fec1ab3990 con 0x55fec1f18210 2024-03-16T21:05:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.029+0000 7f422e600640 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fec1f18210 0x55fec1f1a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.029+0000 7f422e600640 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fec1f18210 0x55fec1f1a630 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48d3246898ab5101 server_cookie=24382d54376fbebb in_seq=0 out_seq=0 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.029+0000 7f4213400640 10 client.17130 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.030+0000 7f4213400640 1 -- 172.21.15.8:0/3544361011 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55fec1ab3990 con 0x55fec1f18210 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.030+0000 7f4213400640 10 client.17130 handle_command_reply: tid=0 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.030+0000 7f42333f0740 1 client.17130 shutdown 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f42333f0740 1 -- 172.21.15.8:0/3544361011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 msgr2=0x55fec1eafa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f42333f0740 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 0x55fec1eafa30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f421400f830 tx=0x7f4214005c10 comp rx=0 tx=0).stop 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f42333f0740 1 -- 172.21.15.8:0/3544361011 shutdown_connections 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f42333f0740 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fec1eaa440 0x55fec1f101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f42333f0740 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55fec1f18210 0x55fec1f1a630 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f42333f0740 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fec1ea1860 0x55fec1eafa30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f42333f0740 1 --2- 172.21.15.8:0/3544361011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55fec1ea0f40 0x55fec1eaf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f4213400640 0 client.17130 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f42333f0740 1 -- 172.21.15.8:0/3544361011 >> 172.21.15.8:0/3544361011 conn(0x55fec1e9b670 msgr2=0x55fec1e9a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:30.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f42333f0740 1 -- 172.21.15.8:0/3544361011 shutdown_connections 2024-03-16T21:05:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f42333f0740 1 -- 172.21.15.8:0/3544361011 wait complete. 2024-03-16T21:05:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.031+0000 7f42333f0740 20 client.17130 trim_cache size 0 max 16384 2024-03-16T21:05:30.040 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:05:30.040 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:05:30.040 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "e41a8048-13d5-4a80-8c8d-2a3d34ed4beb", 2024-03-16T21:05:30.040 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:05:30.040 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:05:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 -- 172.21.15.8:0/3953693260 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f420c0a1c20 msgr2=0x7f420c0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f420c0a1c20 0x7f420c0a40e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55fec1ea0a10 tx=0x7f421802bcc0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 -- 172.21.15.8:0/3953693260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4228073890 msgr2=0x7f422819e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4228073890 0x7f422819e280 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4218000c00 tx=0x7f421802c730 comp rx=0 tx=0).stop 2024-03-16T21:05:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 -- 172.21.15.8:0/3953693260 shutdown_connections 2024-03-16T21:05:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f420c0a1c20 0x7f420c0a40e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4228112490 0x7f42281a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42280741b0 0x7f422819e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 --2- 172.21.15.8:0/3953693260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4228073890 0x7f422819e280 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 -- 172.21.15.8:0/3953693260 >> 172.21.15.8:0/3953693260 conn(0x7f42280fcf90 msgr2=0x7f42280fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:30.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 -- 172.21.15.8:0/3953693260 shutdown_connections 2024-03-16T21:05:30.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.032+0000 7f4230600640 1 -- 172.21.15.8:0/3953693260 wait complete. 2024-03-16T21:05:30.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:05:30.058 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:05:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.277+0000 7f7b9e000640 1 -- 172.21.15.8:0/3038759787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b981066a0 msgr2=0x7f7b9810e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.277+0000 7f7b9e000640 1 --2- 172.21.15.8:0/3038759787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b981066a0 0x7f7b9810e270 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009c10 tx=0x7f7b9002bef0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.278+0000 7f7b9e000640 1 -- 172.21.15.8:0/3038759787 shutdown_connections 2024-03-16T21:05:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.278+0000 7f7b9e000640 1 --2- 172.21.15.8:0/3038759787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b981066a0 0x7f7b9810e270 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.278+0000 7f7b9e000640 1 --2- 172.21.15.8:0/3038759787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b98101f80 0x7f7b98105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.278+0000 7f7b9e000640 1 --2- 172.21.15.8:0/3038759787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b981015d0 0x7f7b981019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.278+0000 7f7b9e000640 1 -- 172.21.15.8:0/3038759787 >> 172.21.15.8:0/3038759787 conn(0x7f7b980fce90 msgr2=0x7f7b980ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:30.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.278+0000 7f7b9e000640 1 -- 172.21.15.8:0/3038759787 shutdown_connections 2024-03-16T21:05:30.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.278+0000 7f7b9e000640 1 -- 172.21.15.8:0/3038759787 wait complete. 2024-03-16T21:05:30.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.279+0000 7f7b9e000640 1 Processor -- start 2024-03-16T21:05:30.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.279+0000 7f7b9e000640 1 -- start start 2024-03-16T21:05:30.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.279+0000 7f7b9e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b981015d0 0x7f7b9819f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.279+0000 7f7b9e000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b981066a0 0x7f7b9819fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.279+0000 7f7b9e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b98199b30 0x7f7b98199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.279+0000 7f7b9e000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9819a520 con 0x7f7b981015d0 2024-03-16T21:05:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.279+0000 7f7b9e000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9819a690 con 0x7f7b98199b30 2024-03-16T21:05:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.279+0000 7f7b9e000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9819a850 con 0x7f7b981066a0 2024-03-16T21:05:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.280+0000 7f7b9cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b981015d0 0x7f7b9819f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.280+0000 7f7b9cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b981015d0 0x7f7b9819f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34918/0 (socket says 172.21.15.8:34918) 2024-03-16T21:05:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.280+0000 7f7b9cc00640 1 -- 172.21.15.8:0/1326687488 learned_addr learned my addr 172.21.15.8:0/1326687488 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.280+0000 7f7b9d600640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b98199b30 0x7f7b98199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.280+0000 7f7b97e00640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b981066a0 0x7f7b9819fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.280+0000 7f7b9cc00640 1 -- 172.21.15.8:0/1326687488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b981066a0 msgr2=0x7f7b9819fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.280+0000 7f7b9cc00640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b981066a0 0x7f7b9819fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.280+0000 7f7b9cc00640 1 -- 172.21.15.8:0/1326687488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b98199b30 msgr2=0x7f7b98199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.280+0000 7f7b9cc00640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b98199b30 0x7f7b98199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.280+0000 7f7b9cc00640 1 -- 172.21.15.8:0/1326687488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b90009840 con 0x7f7b981015d0 2024-03-16T21:05:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.280+0000 7f7b9d600640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b98199b30 0x7f7b98199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:05:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.281+0000 7f7b9cc00640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b981015d0 0x7f7b9819f930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800e9f0 tx=0x7f7b8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.281+0000 7f7b95600640 1 -- 172.21.15.8:0/1326687488 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88009720 con 0x7f7b981015d0 2024-03-16T21:05:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.281+0000 7f7b95600640 1 -- 172.21.15.8:0/1326687488 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7b8800cd80 con 0x7f7b981015d0 2024-03-16T21:05:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.281+0000 7f7b9e000640 1 -- 172.21.15.8:0/1326687488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b981a67f0 con 0x7f7b981015d0 2024-03-16T21:05:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.281+0000 7f7b95600640 1 -- 172.21.15.8:0/1326687488 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88010690 con 0x7f7b981015d0 2024-03-16T21:05:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.281+0000 7f7b9e000640 1 -- 172.21.15.8:0/1326687488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b981a6cb0 con 0x7f7b981015d0 2024-03-16T21:05:30.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.285+0000 7f7ba237c740 1 Processor -- start 2024-03-16T21:05:30.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.285+0000 7f7b95600640 1 -- 172.21.15.8:0/1326687488 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7b880046c0 con 0x7f7b981015d0 2024-03-16T21:05:30.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.285+0000 7f7ba237c740 1 -- start start 2024-03-16T21:05:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.285+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8b170 0x559954e89ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.285+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8a490 0x559954e8a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.285+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 0x559954e95bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.285+0000 7f7ba237c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954df9150 con 0x559954e8a490 2024-03-16T21:05:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.285+0000 7f7ba237c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954df6680 con 0x559954e93800 2024-03-16T21:05:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.285+0000 7f7ba237c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954df1e60 con 0x559954e8b170 2024-03-16T21:05:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.285+0000 7f7b9d600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8b170 0x559954e89ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.285+0000 7f7b97e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 0x559954e95bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b9d600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8b170 0x559954e89ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39412/0 (socket says 172.21.15.8:39412) 2024-03-16T21:05:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b9cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8a490 0x559954e8a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b9d600640 1 -- 172.21.15.8:0/4272724585 learned_addr learned my addr 172.21.15.8:0/4272724585 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b97e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 0x559954e95bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41670/0 (socket says 172.21.15.8:41670) 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b9d600640 1 -- 172.21.15.8:0/4272724585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 msgr2=0x559954e95bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b9d600640 1 --2- 172.21.15.8:0/4272724585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 0x559954e95bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b9d600640 1 -- 172.21.15.8:0/4272724585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8a490 msgr2=0x559954e8a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b9d600640 1 --2- 172.21.15.8:0/4272724585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8a490 0x559954e8a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b9d600640 1 -- 172.21.15.8:0/4272724585 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559954dab060 con 0x559954e8b170 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b97e00640 1 --2- 172.21.15.8:0/4272724585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 0x559954e95bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b9d600640 1 --2- 172.21.15.8:0/4272724585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8b170 0x559954e89ec0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7b90033420 tx=0x7f7b9002c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed150f1eced70149 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.286+0000 7f7b95600640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7b7c0a1ba0 0x7f7b7c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.287+0000 7f7b95600640 1 -- 172.21.15.8:0/1326687488 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7b88014070 con 0x7f7b981015d0 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.287+0000 7f7b8dc00640 1 -- 172.21.15.8:0/4272724585 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90033d40 con 0x559954e8b170 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.287+0000 7f7b9cc00640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7b7c0a1ba0 0x7f7b7c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.287+0000 7f7b8dc00640 1 -- 172.21.15.8:0/4272724585 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7b90033ea0 con 0x559954e8b170 2024-03-16T21:05:30.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.287+0000 7f7b8dc00640 1 -- 172.21.15.8:0/4272724585 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90004500 con 0x559954e8b170 2024-03-16T21:05:30.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7ba237c740 1 -- 172.21.15.8:0/4272724585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8b170 msgr2=0x559954e89ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7ba237c740 1 --2- 172.21.15.8:0/4272724585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8b170 0x559954e89ec0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7b90033420 tx=0x7f7b9002c930 comp rx=0 tx=0).stop 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7b9cc00640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7b7c0a1ba0 0x7f7b7c0a4060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x559954e8b6c0 tx=0x7f7b880d1620 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7ba237c740 1 -- 172.21.15.8:0/4272724585 shutdown_connections 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7ba237c740 1 --2- 172.21.15.8:0/4272724585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 0x559954e95bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7ba237c740 1 --2- 172.21.15.8:0/4272724585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8a490 0x559954e8a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7ba237c740 1 --2- 172.21.15.8:0/4272724585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8b170 0x559954e89ec0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7ba237c740 1 -- 172.21.15.8:0/4272724585 >> 172.21.15.8:0/4272724585 conn(0x559954e515a0 msgr2=0x559954e84ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7ba237c740 1 -- 172.21.15.8:0/4272724585 shutdown_connections 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7ba237c740 1 -- 172.21.15.8:0/4272724585 wait complete. 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7ba237c740 1 -- start start 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.288+0000 7f7ba237c740 1 Processor -- start 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8a490 0x559954e90810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e90d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e93800 0x559954e91290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7ba237c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954d96ec0 con 0x559954e93800 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7ba237c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954d96b60 con 0x559954e8b170 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7ba237c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954b601c0 con 0x559954e8a490 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7ba237c740 10 client.0 _ll_register_callbacks cb 0x559954daa960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7b97e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e90d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7b97e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e90d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41682/0 (socket says 172.21.15.8:41682) 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7b97e00640 1 -- 172.21.15.8:0/3028654992 learned_addr learned my addr 172.21.15.8:0/3028654992 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7b9d600640 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8a490 0x559954e90810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.289+0000 7f7b9d600640 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e93800 0x559954e91290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7b97e00640 1 -- 172.21.15.8:0/3028654992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8a490 msgr2=0x559954e90810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7b97e00640 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8a490 0x559954e90810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7b97e00640 1 -- 172.21.15.8:0/3028654992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e93800 msgr2=0x559954e91290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7b97e00640 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e93800 0x559954e91290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7b97e00640 1 -- 172.21.15.8:0/3028654992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9810ea80 con 0x559954e8b170 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7b9d600640 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e93800 0x559954e91290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7b97e00640 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e90d50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009b80 tx=0x7f7b800039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7bb0031cd2b74c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7b86000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7b86000640 1 -- 172.21.15.8:0/3028654992 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80016070 con 0x559954e8b170 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7b86000640 1 -- 172.21.15.8:0/3028654992 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7b80011650 con 0x559954e8b170 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7ba237c740 1 -- 172.21.15.8:0/3028654992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559954b2e720 con 0x559954e8b170 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7b86000640 1 -- 172.21.15.8:0/3028654992 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b80009e70 con 0x559954e8b170 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7ba237c740 10 client.27323 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.290+0000 7f7ba237c740 1 -- 172.21.15.8:0/3028654992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x559954df04e0 con 0x559954e8b170 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.291+0000 7f7b86000640 1 -- 172.21.15.8:0/3028654992 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7b80027080 con 0x559954e8b170 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.291+0000 7f7b86000640 1 -- 172.21.15.8:0/3028654992 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f7b80021030 con 0x559954e8b170 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.291+0000 7f7ba237c740 10 client.27323 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.291+0000 7f7ba237c740 10 client.27323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:05:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.291+0000 7f7ba237c740 20 client.27323 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.291+0000 7f7ba237c740 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559954ea3ad0 0x559954ea5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.291+0000 7f7ba237c740 4 client.27323 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:05:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.291+0000 7f7ba237c740 1 -- 172.21.15.8:0/3028654992 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559954b7d890 con 0x559954ea3ad0 2024-03-16T21:05:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.291+0000 7f7b9d600640 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559954ea3ad0 0x559954ea5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.292+0000 7f7b9d600640 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559954ea3ad0 0x559954ea5ef0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1341db8e4463b819 server_cookie=5534a4441147a5a7 in_seq=0 out_seq=0 2024-03-16T21:05:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.292+0000 7f7b86000640 10 client.27323 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7b86000640 1 -- 172.21.15.8:0/3028654992 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x559954b7d890 con 0x559954ea3ad0 2024-03-16T21:05:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7b86000640 10 client.27323 handle_command_reply: tid=0 2024-03-16T21:05:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 1 client.27323 shutdown 2024-03-16T21:05:30.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 1 -- 172.21.15.8:0/3028654992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 msgr2=0x559954e90d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e90d50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009b80 tx=0x7f7b800039c0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 1 -- 172.21.15.8:0/3028654992 shutdown_connections 2024-03-16T21:05:30.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559954ea3ad0 0x559954ea5ef0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e93800 0x559954e91290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e90d50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7b86000640 0 client.27323 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:30.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 1 --2- 172.21.15.8:0/3028654992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8a490 0x559954e90810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 1 -- 172.21.15.8:0/3028654992 >> 172.21.15.8:0/3028654992 conn(0x559954e515a0 msgr2=0x559954e86c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:30.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 1 -- 172.21.15.8:0/3028654992 shutdown_connections 2024-03-16T21:05:30.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 1 -- 172.21.15.8:0/3028654992 wait complete. 2024-03-16T21:05:30.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.293+0000 7f7ba237c740 20 client.27323 trim_cache size 0 max 16384 2024-03-16T21:05:30.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.311+0000 7f7ba237c740 1 Processor -- start 2024-03-16T21:05:30.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.311+0000 7f7ba237c740 1 -- start start 2024-03-16T21:05:30.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.311+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8a490 0x559954e92f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.311+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8b170 0x559954e869b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.311+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 0x559954e9ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7ba237c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954e89710 con 0x559954e8b170 2024-03-16T21:05:30.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7ba237c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954e8add0 con 0x559954e93800 2024-03-16T21:05:30.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7ba237c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954e894c0 con 0x559954e8a490 2024-03-16T21:05:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7b97e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8b170 0x559954e869b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7b9d600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8a490 0x559954e92f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7b97e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8b170 0x559954e869b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34944/0 (socket says 172.21.15.8:34944) 2024-03-16T21:05:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7b97e00640 1 -- 172.21.15.8:0/6256067 learned_addr learned my addr 172.21.15.8:0/6256067 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7b9d600640 1 --2- 172.21.15.8:0/6256067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 0x559954e9ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7b97e00640 1 -- 172.21.15.8:0/6256067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8a490 msgr2=0x559954e92f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7b97e00640 1 --2- 172.21.15.8:0/6256067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8a490 0x559954e92f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7b97e00640 1 -- 172.21.15.8:0/6256067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 msgr2=0x559954e9ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7b97e00640 1 --2- 172.21.15.8:0/6256067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 0x559954e9ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.312+0000 7f7b97e00640 1 -- 172.21.15.8:0/6256067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559954d8c950 con 0x559954e8b170 2024-03-16T21:05:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.313+0000 7f7b97e00640 1 --2- 172.21.15.8:0/6256067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8b170 0x559954e869b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7b80005a70 tx=0x7f7b80005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911d29a4debfd917 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.313+0000 7f7b8d200640 1 -- 172.21.15.8:0/6256067 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8002a070 con 0x559954e8b170 2024-03-16T21:05:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.313+0000 7f7b8d200640 1 -- 172.21.15.8:0/6256067 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x559954b2e720 con 0x559954e8b170 2024-03-16T21:05:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.313+0000 7f7b8d200640 1 -- 172.21.15.8:0/6256067 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80016030 con 0x559954e8b170 2024-03-16T21:05:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.314+0000 7f7ba237c740 1 -- 172.21.15.8:0/6256067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8b170 msgr2=0x559954e869b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.314+0000 7f7ba237c740 1 --2- 172.21.15.8:0/6256067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8b170 0x559954e869b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7b80005a70 tx=0x7f7b80005670 comp rx=0 tx=0).stop 2024-03-16T21:05:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.314+0000 7f7ba237c740 1 -- 172.21.15.8:0/6256067 shutdown_connections 2024-03-16T21:05:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.314+0000 7f7ba237c740 1 --2- 172.21.15.8:0/6256067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e93800 0x559954e9ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.314+0000 7f7ba237c740 1 --2- 172.21.15.8:0/6256067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8b170 0x559954e869b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.314+0000 7f7ba237c740 1 --2- 172.21.15.8:0/6256067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e8a490 0x559954e92f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.314+0000 7f7ba237c740 1 -- 172.21.15.8:0/6256067 >> 172.21.15.8:0/6256067 conn(0x559954e515a0 msgr2=0x559954e862a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.314+0000 7f7ba237c740 1 -- 172.21.15.8:0/6256067 shutdown_connections 2024-03-16T21:05:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.314+0000 7f7ba237c740 1 -- 172.21.15.8:0/6256067 wait complete. 2024-03-16T21:05:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.314+0000 7f7ba237c740 1 -- start start 2024-03-16T21:05:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.314+0000 7f7ba237c740 1 Processor -- start 2024-03-16T21:05:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.315+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8a490 0x559954e8caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.315+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e8cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.315+0000 7f7ba237c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e93800 0x559954e8d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.315+0000 7f7ba237c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954e8db30 con 0x559954e8a490 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.315+0000 7f7ba237c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954e8dca0 con 0x559954e8b170 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.315+0000 7f7ba237c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559954e8de60 con 0x559954e93800 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.315+0000 7f7ba237c740 10 client.0 _ll_register_callbacks cb 0x7f7b80004540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.315+0000 7f7b97e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e8cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.315+0000 7f7b97e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e8cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41696/0 (socket says 172.21.15.8:41696) 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.315+0000 7f7b97e00640 1 -- 172.21.15.8:0/440197790 learned_addr learned my addr 172.21.15.8:0/440197790 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.315+0000 7f7b9d600640 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8a490 0x559954e8caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7b9d600640 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e93800 0x559954e8d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7b97e00640 1 -- 172.21.15.8:0/440197790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e93800 msgr2=0x559954e8d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7b97e00640 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e93800 0x559954e8d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7b97e00640 1 -- 172.21.15.8:0/440197790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8a490 msgr2=0x559954e8caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:05:30.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7b97e00640 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8a490 0x559954e8caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7b97e00640 1 -- 172.21.15.8:0/440197790 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559954df04e0 con 0x559954e8b170 2024-03-16T21:05:30.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7b9d600640 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e93800 0x559954e8d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:05:30.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7b97e00640 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e8cfe0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7b80000c00 tx=0x7f7b80024e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfb2f23dfbcd3d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:05:30.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7b86000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:05:30.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7b86000640 1 -- 172.21.15.8:0/440197790 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80016030 con 0x559954e8b170 2024-03-16T21:05:30.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7b86000640 1 -- 172.21.15.8:0/440197790 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7b80017070 con 0x559954e8b170 2024-03-16T21:05:30.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.316+0000 7f7ba237c740 1 -- 172.21.15.8:0/440197790 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559954e90640 con 0x559954e8b170 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7b86000640 1 -- 172.21.15.8:0/440197790 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b8002a040 con 0x559954e8b170 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7ba237c740 10 client.27329 fetch_fsmap learned FSMap version 36 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7ba237c740 1 -- 172.21.15.8:0/440197790 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x559954db2430 con 0x559954e8b170 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7b86000640 1 -- 172.21.15.8:0/440197790 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x559954e90640 con 0x559954e8b170 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7b86000640 1 -- 172.21.15.8:0/440197790 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f7b80011ce0 con 0x559954e8b170 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7ba237c740 10 client.27329 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7ba237c740 10 client.27329 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7ba237c740 20 client.27329 populate_metadata read hostname 'smithi008' 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7ba237c740 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559954f00be0 0x559954f03000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7ba237c740 4 client.27329 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7ba237c740 1 -- 172.21.15.8:0/440197790 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559954af17e0 con 0x559954f00be0 2024-03-16T21:05:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.317+0000 7f7b9d600640 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559954f00be0 0x559954f03000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:05:30.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7b9d600640 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559954f00be0 0x559954f03000 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e15d8d0d043c2610 server_cookie=866a06d89c291980 in_seq=0 out_seq=0 2024-03-16T21:05:30.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7b86000640 10 client.27329 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:30.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7b86000640 1 -- 172.21.15.8:0/440197790 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559954af17e0 con 0x559954f00be0 2024-03-16T21:05:30.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7b86000640 10 client.27329 handle_command_reply: tid=0 2024-03-16T21:05:30.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7ba237c740 1 client.27329 shutdown 2024-03-16T21:05:30.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7ba237c740 1 -- 172.21.15.8:0/440197790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 msgr2=0x559954e8cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7ba237c740 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e8cfe0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7b80000c00 tx=0x7f7b80024e10 comp rx=0 tx=0).stop 2024-03-16T21:05:30.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7ba237c740 1 -- 172.21.15.8:0/440197790 shutdown_connections 2024-03-16T21:05:30.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7ba237c740 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559954e93800 0x559954e8d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7ba237c740 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559954e8b170 0x559954e8cfe0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7ba237c740 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559954f00be0 0x559954f03000 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7ba237c740 1 --2- 172.21.15.8:0/440197790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559954e8a490 0x559954e8caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7b86000640 0 client.27329 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:05:30.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7ba237c740 1 -- 172.21.15.8:0/440197790 >> 172.21.15.8:0/440197790 conn(0x559954e515a0 msgr2=0x559954e91060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:30.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.318+0000 7f7ba237c740 1 -- 172.21.15.8:0/440197790 shutdown_connections 2024-03-16T21:05:30.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7ba237c740 1 -- 172.21.15.8:0/440197790 wait complete. 2024-03-16T21:05:30.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7ba237c740 20 client.27329 trim_cache size 0 max 16384 2024-03-16T21:05:30.330 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:05:30.330 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:05:30.330 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:05:30.330 INFO:teuthology.orchestra.run.smithi008.stdout: "e41a8048-13d5-4a80-8c8d-2a3d34ed4beb": { 2024-03-16T21:05:30.331 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:05:30.331 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "e41a8048-13d5-4a80-8c8d-2a3d34ed4beb", 2024-03-16T21:05:30.331 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:05:30.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:05:30.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:05:30.331 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:05:30.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7b9e000640 1 -- 172.21.15.8:0/1326687488 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7b7c0a1ba0 msgr2=0x7f7b7c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7b9e000640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7b7c0a1ba0 0x7f7b7c0a4060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x559954e8b6c0 tx=0x7f7b880d1620 comp rx=0 tx=0).stop 2024-03-16T21:05:30.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7b9e000640 1 -- 172.21.15.8:0/1326687488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b981015d0 msgr2=0x7f7b9819f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:05:30.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7b9e000640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b981015d0 0x7f7b9819f930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800e9f0 tx=0x7f7b8800edf0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7b9e000640 1 -- 172.21.15.8:0/1326687488 shutdown_connections 2024-03-16T21:05:30.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7b9e000640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f7b7c0a1ba0 0x7f7b7c0a4060 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7b9e000640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b98199b30 0x7f7b98199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7b9e000640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b981066a0 0x7f7b9819fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7b9e000640 1 --2- 172.21.15.8:0/1326687488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b981015d0 0x7f7b9819f930 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:05:30.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.319+0000 7f7b9e000640 1 -- 172.21.15.8:0/1326687488 >> 172.21.15.8:0/1326687488 conn(0x7f7b980fce90 msgr2=0x7f7b980fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:05:30.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.320+0000 7f7b9e000640 1 -- 172.21.15.8:0/1326687488 shutdown_connections 2024-03-16T21:05:30.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:05:30.320+0000 7f7b9e000640 1 -- 172.21.15.8:0/1326687488 wait complete. 2024-03-16T21:05:30.343 INFO:tasks.cephfs.filesystem:scrub status for tag:e41a8048-13d5-4a80-8c8d-2a3d34ed4beb - {'path': '/', 'tag': 'e41a8048-13d5-4a80-8c8d-2a3d34ed4beb', 'options': 'recursive,force'} 2024-03-16T21:05:31.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:31 smithi186 ceph-mon[36391]: pgmap v235: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:31.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:31 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:05:31.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:31 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:05:31.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:31 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:05:31.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:31 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:05:31.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:31 smithi008 ceph-mon[31434]: pgmap v235: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:31.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:31 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:05:31.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:31 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:05:31.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:31 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:05:31.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:31 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:05:31.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:31 smithi170 ceph-mon[35947]: pgmap v235: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:31.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:31 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:05:31.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:31 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:05:31.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:31 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:05:31.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:31 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:05:33.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:33 smithi186 ceph-mon[36391]: pgmap v236: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:05:33.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:33 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:05:33.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:33 smithi008 ceph-mon[31434]: pgmap v236: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:05:33.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:33 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:05:33.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:33 smithi170 ceph-mon[35947]: pgmap v236: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:05:33.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:33 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:05:35.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:35 smithi186 ceph-mon[36391]: pgmap v237: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:05:35.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:35 smithi008 ceph-mon[31434]: pgmap v237: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:05:35.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:35 smithi170 ceph-mon[35947]: pgmap v237: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:05:37.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:37 smithi186 ceph-mon[36391]: pgmap v238: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-16T21:05:37.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:37 smithi008 ceph-mon[31434]: pgmap v238: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-16T21:05:37.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:37 smithi170 ceph-mon[35947]: pgmap v238: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-16T21:05:39.420 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:39 smithi170 ceph-mon[35947]: pgmap v239: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-16T21:05:39.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:39 smithi008 ceph-mon[31434]: pgmap v239: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-16T21:05:39.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:39 smithi186 ceph-mon[36391]: pgmap v239: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-16T21:05:41.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:41 smithi008 ceph-mon[31434]: pgmap v240: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:05:41.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:41 smithi170 ceph-mon[35947]: pgmap v240: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:05:41.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:41 smithi186 ceph-mon[36391]: pgmap v240: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:05:43.446 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:43 smithi186 ceph-mon[36391]: pgmap v241: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:05:43.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:43 smithi008 ceph-mon[31434]: pgmap v241: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:05:43.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:43 smithi170 ceph-mon[35947]: pgmap v241: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:05:45.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:45 smithi008 ceph-mon[31434]: pgmap v242: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:45.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:45 smithi170 ceph-mon[35947]: pgmap v242: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:45.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:45 smithi186 ceph-mon[36391]: pgmap v242: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:47.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:47 smithi008 ceph-mon[31434]: pgmap v243: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:05:47.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:47 smithi170 ceph-mon[35947]: pgmap v243: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:05:47.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:47 smithi186 ceph-mon[36391]: pgmap v243: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:05:49.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:49 smithi008 ceph-mon[31434]: pgmap v244: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:05:49.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:49 smithi170 ceph-mon[35947]: pgmap v244: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:05:49.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:49 smithi186 ceph-mon[36391]: pgmap v244: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:05:51.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:51 smithi008 ceph-mon[31434]: pgmap v245: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:51.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:51 smithi170 ceph-mon[35947]: pgmap v245: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:51.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:51 smithi186 ceph-mon[36391]: pgmap v245: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:53.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:53 smithi008 ceph-mon[31434]: pgmap v246: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:05:53.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:53 smithi170 ceph-mon[35947]: pgmap v246: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:05:53.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:53 smithi186 ceph-mon[36391]: pgmap v246: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:05:55.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:55 smithi008 ceph-mon[31434]: pgmap v247: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:55.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:55 smithi170 ceph-mon[35947]: pgmap v247: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:55.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:55 smithi186 ceph-mon[36391]: pgmap v247: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:05:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:56 smithi008 ceph-mon[31434]: pgmap v248: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:05:56.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:56 smithi170 ceph-mon[35947]: pgmap v248: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:05:56.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:56 smithi186 ceph-mon[36391]: pgmap v248: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:05:58.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:05:58 smithi170 ceph-mon[35947]: pgmap v249: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:05:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:05:58 smithi186 ceph-mon[36391]: pgmap v249: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:05:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:05:58 smithi008 ceph-mon[31434]: pgmap v249: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:06:00.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:06:00.344 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:06:00.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.573+0000 7f16f9400640 1 -- 172.21.15.8:0/3991571997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f4075a20 msgr2=0x7f16f4075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.573+0000 7f16f9400640 1 --2- 172.21.15.8:0/3991571997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f4075a20 0x7f16f4075e00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009930 tx=0x7f16e402bc20 comp rx=0 tx=0).stop 2024-03-16T21:06:00.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.573+0000 7f16f9400640 1 -- 172.21.15.8:0/3991571997 shutdown_connections 2024-03-16T21:06:00.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.573+0000 7f16f9400640 1 --2- 172.21.15.8:0/3991571997 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4112210 0x7f16f4114600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.573+0000 7f16f9400640 1 --2- 172.21.15.8:0/3991571997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4076340 0x7f16f4111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.573+0000 7f16f9400640 1 --2- 172.21.15.8:0/3991571997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f4075a20 0x7f16f4075e00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.573+0000 7f16f9400640 1 -- 172.21.15.8:0/3991571997 >> 172.21.15.8:0/3991571997 conn(0x7f16f40ff000 msgr2=0x7f16f4101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:00.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.573+0000 7f16f9400640 1 -- 172.21.15.8:0/3991571997 shutdown_connections 2024-03-16T21:06:00.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.573+0000 7f16f9400640 1 -- 172.21.15.8:0/3991571997 wait complete. 2024-03-16T21:06:00.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.574+0000 7f16f9400640 1 Processor -- start 2024-03-16T21:06:00.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.574+0000 7f16f9400640 1 -- start start 2024-03-16T21:06:00.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.574+0000 7f16f9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4075a20 0x7f16f419e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16f9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f4076340 0x7f16f419e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16f9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4112210 0x7f16f41a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16f9400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f41a3330 con 0x7f16f4075a20 2024-03-16T21:06:00.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16f9400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f41a34a0 con 0x7f16f4076340 2024-03-16T21:06:00.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16f9400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f41a3660 con 0x7f16f4112210 2024-03-16T21:06:00.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4075a20 0x7f16f419e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16eb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f4076340 0x7f16f419e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16f8a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4112210 0x7f16f41a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16eb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f4076340 0x7f16f419e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45404/0 (socket says 172.21.15.8:45404) 2024-03-16T21:06:00.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16eb400640 1 -- 172.21.15.8:0/1794084964 learned_addr learned my addr 172.21.15.8:0/1794084964 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:00.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16eb400640 1 -- 172.21.15.8:0/1794084964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4112210 msgr2=0x7f16f41a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16eb400640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4112210 0x7f16f41a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16eb400640 1 -- 172.21.15.8:0/1794084964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4075a20 msgr2=0x7f16f419e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16eb400640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4075a20 0x7f16f419e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16eb400640 1 -- 172.21.15.8:0/1794084964 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4009560 con 0x7f16f4076340 2024-03-16T21:06:00.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.575+0000 7f16f8a00640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4112210 0x7f16f41a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:00.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.576+0000 7f16eb400640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f4076340 0x7f16f419e9b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00e9f0 tx=0x7f16dc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:00.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.576+0000 7f16f1600640 1 -- 172.21.15.8:0/1794084964 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc009700 con 0x7f16f4076340 2024-03-16T21:06:00.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.576+0000 7f16f1600640 1 -- 172.21.15.8:0/1794084964 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f16dc00cd80 con 0x7f16f4076340 2024-03-16T21:06:00.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.576+0000 7f16f9400640 1 -- 172.21.15.8:0/1794084964 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f41a3940 con 0x7f16f4076340 2024-03-16T21:06:00.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.576+0000 7f16f1600640 1 -- 172.21.15.8:0/1794084964 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc0189c0 con 0x7f16f4076340 2024-03-16T21:06:00.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.576+0000 7f16f9400640 1 -- 172.21.15.8:0/1794084964 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f41ab1c0 con 0x7f16f4076340 2024-03-16T21:06:00.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.579+0000 7f16f1600640 1 -- 172.21.15.8:0/1794084964 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f16dc018b20 con 0x7f16f4076340 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.579+0000 7f16fd819740 1 Processor -- start 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.579+0000 7f16fd819740 1 -- start start 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.580+0000 7f16fd819740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d9170 0x55a0c12d7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.580+0000 7f16fd819740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 0x55a0c12d8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.580+0000 7f16fd819740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12e3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.580+0000 7f16fd819740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c1247150 con 0x55a0c12d9170 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.580+0000 7f16fd819740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c1244680 con 0x55a0c12e1800 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.580+0000 7f16fd819740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c123fe60 con 0x55a0c12d8490 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.580+0000 7f16f8a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d9170 0x55a0c12d7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.580+0000 7f16eb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12e3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.580+0000 7f16f8a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d9170 0x55a0c12d7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48146/0 (socket says 172.21.15.8:48146) 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.580+0000 7f16f8a00640 1 -- 172.21.15.8:0/189528602 learned_addr learned my addr 172.21.15.8:0/189528602 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:00.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.580+0000 7f16f3e00640 1 --2- 172.21.15.8:0/189528602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 0x55a0c12d8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16f8a00640 1 -- 172.21.15.8:0/189528602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 msgr2=0x55a0c12d8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16f8a00640 1 --2- 172.21.15.8:0/189528602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 0x55a0c12d8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16f8a00640 1 -- 172.21.15.8:0/189528602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 msgr2=0x55a0c12e3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16f8a00640 1 --2- 172.21.15.8:0/189528602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12e3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16f8a00640 1 -- 172.21.15.8:0/189528602 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0c11f9060 con 0x55a0c12d9170 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16f1600640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f16d80a1c20 0x7f16d80a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16f8a00640 1 --2- 172.21.15.8:0/189528602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d9170 0x55a0c12d7ec0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f16ec011760 tx=0x7f16ec011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af3afe5dd75e48f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16f1600640 1 -- 172.21.15.8:0/1794084964 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f16dc014070 con 0x7f16f4076340 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16f3e00640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f16d80a1c20 0x7f16d80a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16e9200640 1 -- 172.21.15.8:0/189528602 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec004d20 con 0x55a0c12d9170 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16e9200640 1 -- 172.21.15.8:0/189528602 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f16ec004e80 con 0x55a0c12d9170 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.581+0000 7f16e9200640 1 -- 172.21.15.8:0/189528602 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec004550 con 0x55a0c12d9170 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.582+0000 7f16f3e00640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f16d80a1c20 0x7f16d80a40e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009900 tx=0x7f16e4005a20 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.582+0000 7f16fd819740 1 -- 172.21.15.8:0/189528602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d9170 msgr2=0x55a0c12d7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.582+0000 7f16fd819740 1 --2- 172.21.15.8:0/189528602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d9170 0x55a0c12d7ec0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f16ec011760 tx=0x7f16ec011c20 comp rx=0 tx=0).stop 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.582+0000 7f16fd819740 1 -- 172.21.15.8:0/189528602 shutdown_connections 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.582+0000 7f16fd819740 1 --2- 172.21.15.8:0/189528602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12e3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.582+0000 7f16fd819740 1 --2- 172.21.15.8:0/189528602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 0x55a0c12d8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.582+0000 7f16fd819740 1 --2- 172.21.15.8:0/189528602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d9170 0x55a0c12d7ec0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.582+0000 7f16fd819740 1 -- 172.21.15.8:0/189528602 >> 172.21.15.8:0/189528602 conn(0x55a0c129f5a0 msgr2=0x55a0c12d2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.582+0000 7f16fd819740 1 -- 172.21.15.8:0/189528602 shutdown_connections 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.582+0000 7f16fd819740 1 -- 172.21.15.8:0/189528602 wait complete. 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.583+0000 7f16fd819740 1 -- start start 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.583+0000 7f16fd819740 1 Processor -- start 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.583+0000 7f16fd819740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 0x55a0c12de7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16fd819740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12d9170 0x55a0c12ded20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16fd819740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12e1800 0x55a0c12df260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16fd819740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c11e4ec0 con 0x55a0c12e1800 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16fd819740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c11e4b60 con 0x55a0c12d9170 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16fd819740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c0fae1c0 con 0x55a0c12d8490 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16fd819740 10 client.0 _ll_register_callbacks cb 0x55a0c11f8960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 0x55a0c12de7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16eb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12d9170 0x55a0c12ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 0x55a0c12de7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38686/0 (socket says 172.21.15.8:38686) 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16f3e00640 1 -- 172.21.15.8:0/3342590578 learned_addr learned my addr 172.21.15.8:0/3342590578 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16f8a00640 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12e1800 0x55a0c12df260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16eb400640 1 -- 172.21.15.8:0/3342590578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 msgr2=0x55a0c12de7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16eb400640 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 0x55a0c12de7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16eb400640 1 -- 172.21.15.8:0/3342590578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12e1800 msgr2=0x55a0c12df260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16eb400640 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12e1800 0x55a0c12df260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16eb400640 1 -- 172.21.15.8:0/3342590578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec011440 con 0x55a0c12d9170 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.584+0000 7f16f3e00640 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 0x55a0c12de7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:00.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.585+0000 7f16eb400640 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12d9170 0x55a0c12ded20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0cb1d0 tx=0x7f16dc096af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d1afb8c9886f1cd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.585+0000 7f16e1600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.585+0000 7f16e1600640 1 -- 172.21.15.8:0/3342590578 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc0cb680 con 0x55a0c12d9170 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.585+0000 7f16e1600640 1 -- 172.21.15.8:0/3342590578 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f16dc0cfe40 con 0x55a0c12d9170 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.585+0000 7f16fd819740 1 -- 172.21.15.8:0/3342590578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a0c0f7c720 con 0x55a0c12d9170 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.585+0000 7f16e1600640 1 -- 172.21.15.8:0/3342590578 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16dc09a790 con 0x55a0c12d9170 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.585+0000 7f16fd819740 10 client.27341 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.585+0000 7f16fd819740 1 -- 172.21.15.8:0/3342590578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a0c123e4e0 con 0x55a0c12d9170 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.585+0000 7f16e1600640 1 -- 172.21.15.8:0/3342590578 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a0c0f7c720 con 0x55a0c12d9170 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.586+0000 7f16e1600640 1 -- 172.21.15.8:0/3342590578 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f16dc085180 con 0x55a0c12d9170 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.586+0000 7f16fd819740 10 client.27341 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.586+0000 7f16fd819740 10 client.27341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.586+0000 7f16fd819740 20 client.27341 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.586+0000 7f16fd819740 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a0c12f1830 0x55a0c12f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.586+0000 7f16fd819740 4 client.27341 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:00.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.586+0000 7f16fd819740 1 -- 172.21.15.8:0/3342590578 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0c0fcb890 con 0x55a0c12f1830 2024-03-16T21:06:00.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.586+0000 7f16f3e00640 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a0c12f1830 0x55a0c12f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.587+0000 7f16f3e00640 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a0c12f1830 0x55a0c12f3c50 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a1555dd151c9df1 server_cookie=b95006b4849318f3 in_seq=0 out_seq=0 2024-03-16T21:06:00.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.587+0000 7f16e1600640 10 client.27341 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:00.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.587+0000 7f16e1600640 1 -- 172.21.15.8:0/3342590578 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a0c0fcb890 con 0x55a0c12f1830 2024-03-16T21:06:00.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.587+0000 7f16e1600640 10 client.27341 handle_command_reply: tid=0 2024-03-16T21:06:00.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.587+0000 7f16fd819740 1 client.27341 shutdown 2024-03-16T21:06:00.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.587+0000 7f16fd819740 1 -- 172.21.15.8:0/3342590578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12d9170 msgr2=0x55a0c12ded20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.587+0000 7f16fd819740 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12d9170 0x55a0c12ded20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0cb1d0 tx=0x7f16dc096af0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.588+0000 7f16fd819740 1 -- 172.21.15.8:0/3342590578 shutdown_connections 2024-03-16T21:06:00.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.588+0000 7f16fd819740 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a0c12f1830 0x55a0c12f3c50 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.588+0000 7f16fd819740 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12e1800 0x55a0c12df260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.588+0000 7f16fd819740 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12d9170 0x55a0c12ded20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.588+0000 7f16fd819740 1 --2- 172.21.15.8:0/3342590578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d8490 0x55a0c12de7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.588+0000 7f16e1600640 0 client.27341 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:00.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.588+0000 7f16fd819740 1 -- 172.21.15.8:0/3342590578 >> 172.21.15.8:0/3342590578 conn(0x55a0c129f5a0 msgr2=0x55a0c12d4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:00.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.588+0000 7f16fd819740 1 -- 172.21.15.8:0/3342590578 shutdown_connections 2024-03-16T21:06:00.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.588+0000 7f16fd819740 1 -- 172.21.15.8:0/3342590578 wait complete. 2024-03-16T21:06:00.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.588+0000 7f16fd819740 20 client.27341 trim_cache size 0 max 16384 2024-03-16T21:06:00.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.606+0000 7f16fd819740 1 Processor -- start 2024-03-16T21:06:00.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.606+0000 7f16fd819740 1 -- start start 2024-03-16T21:06:00.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.606+0000 7f16fd819740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12e0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.606+0000 7f16fd819740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d9170 0x55a0c12df080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.606+0000 7f16fd819740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12ecc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.606+0000 7f16fd819740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c12d7710 con 0x55a0c12d8490 2024-03-16T21:06:00.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.606+0000 7f16fd819740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c12ce7b0 con 0x55a0c12e1800 2024-03-16T21:06:00.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.606+0000 7f16fd819740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c12f42b0 con 0x55a0c12d9170 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.606+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12e0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.607+0000 7f16f8a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12ecc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.607+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12e0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48156/0 (socket says 172.21.15.8:48156) 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.607+0000 7f16f3e00640 1 -- 172.21.15.8:0/1360111044 learned_addr learned my addr 172.21.15.8:0/1360111044 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.607+0000 7f16eb400640 1 --2- 172.21.15.8:0/1360111044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d9170 0x55a0c12df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.607+0000 7f16f3e00640 1 -- 172.21.15.8:0/1360111044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d9170 msgr2=0x55a0c12df080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.607+0000 7f16f3e00640 1 --2- 172.21.15.8:0/1360111044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d9170 0x55a0c12df080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.607+0000 7f16f3e00640 1 -- 172.21.15.8:0/1360111044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 msgr2=0x55a0c12ecc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.607+0000 7f16f3e00640 1 --2- 172.21.15.8:0/1360111044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12ecc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.607+0000 7f16f3e00640 1 -- 172.21.15.8:0/1360111044 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0c12da440 con 0x55a0c12d8490 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.607+0000 7f16f3e00640 1 --2- 172.21.15.8:0/1360111044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12e0ea0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f16e4000c00 tx=0x7f16e4042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9842c2b22cf006d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:00.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.607+0000 7f16e3e00640 1 -- 172.21.15.8:0/1360111044 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4051040 con 0x55a0c12d8490 2024-03-16T21:06:00.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.608+0000 7f16e3e00640 1 -- 172.21.15.8:0/1360111044 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f16e4044070 con 0x55a0c12d8490 2024-03-16T21:06:00.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.608+0000 7f16e3e00640 1 -- 172.21.15.8:0/1360111044 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4058cb0 con 0x55a0c12d8490 2024-03-16T21:06:00.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.608+0000 7f16fd819740 1 -- 172.21.15.8:0/1360111044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 msgr2=0x55a0c12e0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.608+0000 7f16fd819740 1 --2- 172.21.15.8:0/1360111044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12e0ea0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f16e4000c00 tx=0x7f16e4042000 comp rx=0 tx=0).stop 2024-03-16T21:06:00.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.608+0000 7f16fd819740 1 -- 172.21.15.8:0/1360111044 shutdown_connections 2024-03-16T21:06:00.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.608+0000 7f16fd819740 1 --2- 172.21.15.8:0/1360111044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12ecc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.608+0000 7f16fd819740 1 --2- 172.21.15.8:0/1360111044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d9170 0x55a0c12df080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.608+0000 7f16fd819740 1 --2- 172.21.15.8:0/1360111044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12e0ea0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.608+0000 7f16fd819740 1 -- 172.21.15.8:0/1360111044 >> 172.21.15.8:0/1360111044 conn(0x55a0c129f5a0 msgr2=0x55a0c12dd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:00.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.608+0000 7f16fd819740 1 -- 172.21.15.8:0/1360111044 shutdown_connections 2024-03-16T21:06:00.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.608+0000 7f16fd819740 1 -- 172.21.15.8:0/1360111044 wait complete. 2024-03-16T21:06:00.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.609+0000 7f16fd819740 1 -- start start 2024-03-16T21:06:00.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.609+0000 7f16fd819740 1 Processor -- start 2024-03-16T21:06:00.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.609+0000 7f16fd819740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12daa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.609+0000 7f16fd819740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d9170 0x55a0c12dafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.609+0000 7f16fd819740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12db4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.609+0000 7f16fd819740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c12e37d0 con 0x55a0c12d8490 2024-03-16T21:06:00.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.609+0000 7f16fd819740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c12dba30 con 0x55a0c12e1800 2024-03-16T21:06:00.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.609+0000 7f16fd819740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0c12dbbf0 con 0x55a0c12d9170 2024-03-16T21:06:00.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.609+0000 7f16fd819740 10 client.0 _ll_register_callbacks cb 0x7f16dc00cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:00.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12daa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16eb400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d9170 0x55a0c12dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12daa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48170/0 (socket says 172.21.15.8:48170) 2024-03-16T21:06:00.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16f8a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12db4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16f3e00640 1 -- 172.21.15.8:0/667834073 learned_addr learned my addr 172.21.15.8:0/667834073 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:00.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16eb400640 1 -- 172.21.15.8:0/667834073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 msgr2=0x55a0c12db4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:00.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16eb400640 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12db4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16eb400640 1 -- 172.21.15.8:0/667834073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 msgr2=0x55a0c12daa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16eb400640 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12daa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16eb400640 1 -- 172.21.15.8:0/667834073 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f4115090 con 0x55a0c12d9170 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16f3e00640 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12daa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16eb400640 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d9170 0x55a0c12dafb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f16dc097160 tx=0x7f16dc085320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7de31e7d9c4313cc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.610+0000 7f16e1600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16e1600640 1 -- 172.21.15.8:0/667834073 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc0966e0 con 0x55a0c12d9170 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16e1600640 1 -- 172.21.15.8:0/667834073 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f16dc0a2e80 con 0x55a0c12d9170 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16fd819740 1 -- 172.21.15.8:0/667834073 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a0c0f3f7e0 con 0x55a0c12d9170 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16e1600640 1 -- 172.21.15.8:0/667834073 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16dc099f40 con 0x55a0c12d9170 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16fd819740 10 client.27352 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16fd819740 1 -- 172.21.15.8:0/667834073 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a0c11da950 con 0x55a0c12d9170 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16e1600640 1 -- 172.21.15.8:0/667834073 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a0c0f3f7e0 con 0x55a0c12d9170 2024-03-16T21:06:00.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16e1600640 1 -- 172.21.15.8:0/667834073 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f16dc09f750 con 0x55a0c12d9170 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16fd819740 10 client.27352 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16fd819740 10 client.27352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16fd819740 20 client.27352 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16fd819740 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a0c134e650 0x55a0c1350a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16fd819740 4 client.27352 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.611+0000 7f16fd819740 1 -- 172.21.15.8:0/667834073 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a0c0eeb700 con 0x55a0c134e650 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.612+0000 7f16f3e00640 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a0c134e650 0x55a0c1350a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.612+0000 7f16f3e00640 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a0c134e650 0x55a0c1350a70 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6340e4b765cd6ff3 server_cookie=6343181406b8dfd8 in_seq=0 out_seq=0 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.612+0000 7f16e1600640 10 client.27352 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.612+0000 7f16e1600640 1 -- 172.21.15.8:0/667834073 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a0c0eeb700 con 0x55a0c134e650 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.612+0000 7f16e1600640 10 client.27352 handle_command_reply: tid=0 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.612+0000 7f16fd819740 1 client.27352 shutdown 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16fd819740 1 -- 172.21.15.8:0/667834073 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d9170 msgr2=0x55a0c12dafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16fd819740 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d9170 0x55a0c12dafb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f16dc097160 tx=0x7f16dc085320 comp rx=0 tx=0).stop 2024-03-16T21:06:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16fd819740 1 -- 172.21.15.8:0/667834073 shutdown_connections 2024-03-16T21:06:00.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16fd819740 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a0c12e1800 0x55a0c12db4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16fd819740 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a0c12d9170 0x55a0c12dafb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16fd819740 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a0c134e650 0x55a0c1350a70 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16fd819740 1 --2- 172.21.15.8:0/667834073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a0c12d8490 0x55a0c12daa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16e1600640 0 client.27352 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:00.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16fd819740 1 -- 172.21.15.8:0/667834073 >> 172.21.15.8:0/667834073 conn(0x55a0c129f5a0 msgr2=0x55a0c12d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:00.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16fd819740 1 -- 172.21.15.8:0/667834073 shutdown_connections 2024-03-16T21:06:00.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16fd819740 1 -- 172.21.15.8:0/667834073 wait complete. 2024-03-16T21:06:00.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.613+0000 7f16fd819740 20 client.27352 trim_cache size 0 max 16384 2024-03-16T21:06:00.626 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:06:00.627 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:06:00.627 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:06:00.627 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:06:00.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 -- 172.21.15.8:0/1794084964 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f16d80a1c20 msgr2=0x7f16d80a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f16d80a1c20 0x7f16d80a40e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009900 tx=0x7f16e4005a20 comp rx=0 tx=0).stop 2024-03-16T21:06:00.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 -- 172.21.15.8:0/1794084964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f4076340 msgr2=0x7f16f419e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f4076340 0x7f16f419e9b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00e9f0 tx=0x7f16dc00eeb0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 -- 172.21.15.8:0/1794084964 shutdown_connections 2024-03-16T21:06:00.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f16d80a1c20 0x7f16d80a40e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16f4112210 0x7f16f41a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f4076340 0x7f16f419e9b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 --2- 172.21.15.8:0/1794084964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4075a20 0x7f16f419e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 -- 172.21.15.8:0/1794084964 >> 172.21.15.8:0/1794084964 conn(0x7f16f40ff000 msgr2=0x7f16f4113020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:00.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 -- 172.21.15.8:0/1794084964 shutdown_connections 2024-03-16T21:06:00.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.614+0000 7f16f9400640 1 -- 172.21.15.8:0/1794084964 wait complete. 2024-03-16T21:06:00.637 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:06:00.637 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:06:00.708 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:00 smithi008 ceph-mon[31434]: pgmap v250: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.842+0000 7fc4fd400640 1 -- 172.21.15.8:0/13850350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4f8106240 msgr2=0x7fc4f8068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.842+0000 7fc4fd400640 1 --2- 172.21.15.8:0/13850350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4f8106240 0x7fc4f8068650 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009900 tx=0x7fc4e802bc40 comp rx=0 tx=0).stop 2024-03-16T21:06:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.842+0000 7fc4fd400640 1 -- 172.21.15.8:0/13850350 shutdown_connections 2024-03-16T21:06:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.842+0000 7fc4fd400640 1 --2- 172.21.15.8:0/13850350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f8103d40 0x7fc4f81041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.842+0000 7fc4fd400640 1 --2- 172.21.15.8:0/13850350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f81066b0 0x7fc4f8068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.842+0000 7fc4fd400640 1 --2- 172.21.15.8:0/13850350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4f8106240 0x7fc4f8068650 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.842+0000 7fc4fd400640 1 -- 172.21.15.8:0/13850350 >> 172.21.15.8:0/13850350 conn(0x7fc4f8075e00 msgr2=0x7fc4f8076210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.842+0000 7fc4fd400640 1 -- 172.21.15.8:0/13850350 shutdown_connections 2024-03-16T21:06:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.842+0000 7fc4fd400640 1 -- 172.21.15.8:0/13850350 wait complete. 2024-03-16T21:06:00.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.843+0000 7fc4fd400640 1 Processor -- start 2024-03-16T21:06:00.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4fd400640 1 -- start start 2024-03-16T21:06:00.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4fd400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4f8103d40 0x7fc4f819e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4fd400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f8106240 0x7fc4f819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4fd400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f81066b0 0x7fc4f81a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4fd400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f81a2fc0 con 0x7fc4f8106240 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4fd400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f81a3130 con 0x7fc4f8103d40 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4fd400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f81a32f0 con 0x7fc4f81066b0 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4f7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4f8103d40 0x7fc4f819e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4fca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f81066b0 0x7fc4f81a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4f7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4f8103d40 0x7fc4f819e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45456/0 (socket says 172.21.15.8:45456) 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4fca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f81066b0 0x7fc4f81a29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38716/0 (socket says 172.21.15.8:38716) 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4f7e00640 1 -- 172.21.15.8:0/1376874525 learned_addr learned my addr 172.21.15.8:0/1376874525 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.844+0000 7fc4f7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f8106240 0x7fc4f819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.845+0000 7fc4f7e00640 1 -- 172.21.15.8:0/1376874525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f81066b0 msgr2=0x7fc4f81a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.845+0000 7fc4f7e00640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f81066b0 0x7fc4f81a29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.845+0000 7fc4f7e00640 1 -- 172.21.15.8:0/1376874525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f8106240 msgr2=0x7fc4f819e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.845+0000 7fc4f7e00640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f8106240 0x7fc4f819e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.845+0000 7fc4f7e00640 1 -- 172.21.15.8:0/1376874525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e8009560 con 0x7fc4f8103d40 2024-03-16T21:06:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.845+0000 7fc4fca00640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f81066b0 0x7fc4f81a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:00.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.845+0000 7fc4f7e00640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4f8103d40 0x7fc4f819e150 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc4e802c250 tx=0x7fc4e802ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:00.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.845+0000 7fc4f4c00640 1 -- 172.21.15.8:0/1376874525 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8004250 con 0x7fc4f8103d40 2024-03-16T21:06:00.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.846+0000 7fc4f4c00640 1 -- 172.21.15.8:0/1376874525 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc4e80043b0 con 0x7fc4f8103d40 2024-03-16T21:06:00.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.846+0000 7fc4f4c00640 1 -- 172.21.15.8:0/1376874525 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8003c50 con 0x7fc4f8103d40 2024-03-16T21:06:00.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.846+0000 7fc4fd400640 1 -- 172.21.15.8:0/1376874525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f81a3570 con 0x7fc4f8103d40 2024-03-16T21:06:00.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.846+0000 7fc4fd400640 1 -- 172.21.15.8:0/1376874525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f81aae50 con 0x7fc4f8103d40 2024-03-16T21:06:00.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.847+0000 7fc4fd400640 1 -- 172.21.15.8:0/1376874525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f8068200 con 0x7fc4f8103d40 2024-03-16T21:06:00.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.849+0000 7fc4f4c00640 1 -- 172.21.15.8:0/1376874525 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fc4e8004e10 con 0x7fc4f8103d40 2024-03-16T21:06:00.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.850+0000 7fc4f4c00640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4dc0a1c20 0x7fc4dc0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:00.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.850+0000 7fc4f4c00640 1 -- 172.21.15.8:0/1376874525 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc4e80efdd0 con 0x7fc4f8103d40 2024-03-16T21:06:00.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.850+0000 7fc4f7400640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4dc0a1c20 0x7fc4dc0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:00.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.851+0000 7fc4f7400640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4dc0a1c20 0x7fc4dc0a40e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8076620 tx=0x7fc4e4005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:00.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:00.854+0000 7fc4f4c00640 1 -- 172.21.15.8:0/1376874525 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc4e80b8d50 con 0x7fc4f8103d40 2024-03-16T21:06:00.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:00 smithi170 ceph-mon[35947]: pgmap v250: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:00.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:00 smithi186 ceph-mon[36391]: pgmap v250: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:01.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.097+0000 7fc4fd400640 1 -- 172.21.15.8:0/1376874525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4f819f450 con 0x7fc4f8103d40 2024-03-16T21:06:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.098+0000 7fc4f4c00640 1 -- 172.21.15.8:0/1376874525 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11387 (secure 0 0 0) 0x7fc4e8043090 con 0x7fc4f8103d40 2024-03-16T21:06:01.104 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:06:01.104 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:27.879028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:06:01.104 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.101+0000 7fc4fd400640 1 -- 172.21.15.8:0/1376874525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4dc0a1c20 msgr2=0x7fc4dc0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.101+0000 7fc4fd400640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4dc0a1c20 0x7fc4dc0a40e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8076620 tx=0x7fc4e4005f90 comp rx=0 tx=0).stop 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.101+0000 7fc4fd400640 1 -- 172.21.15.8:0/1376874525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4f8103d40 msgr2=0x7fc4f819e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.101+0000 7fc4fd400640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4f8103d40 0x7fc4f819e150 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc4e802c250 tx=0x7fc4e802ccb0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.101+0000 7fc4fd400640 1 -- 172.21.15.8:0/1376874525 shutdown_connections 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.101+0000 7fc4fd400640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4dc0a1c20 0x7fc4dc0a40e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.101+0000 7fc4fd400640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4f81066b0 0x7fc4f81a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.101+0000 7fc4fd400640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f8106240 0x7fc4f819e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.101+0000 7fc4fd400640 1 --2- 172.21.15.8:0/1376874525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4f8103d40 0x7fc4f819e150 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.101+0000 7fc4fd400640 1 -- 172.21.15.8:0/1376874525 >> 172.21.15.8:0/1376874525 conn(0x7fc4f8075e00 msgr2=0x7fc4f81011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.102+0000 7fc4fd400640 1 -- 172.21.15.8:0/1376874525 shutdown_connections 2024-03-16T21:06:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.102+0000 7fc4fd400640 1 -- 172.21.15.8:0/1376874525 wait complete. 2024-03-16T21:06:01.127 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:06:01.127 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:06:01.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.349+0000 7ff6b1a00640 1 -- 172.21.15.8:0/4042066489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ac1066a0 msgr2=0x7ff6ac10e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.349+0000 7ff6b1a00640 1 --2- 172.21.15.8:0/4042066489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ac1066a0 0x7ff6ac10e270 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009c10 tx=0x7ff6a402bef0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.349+0000 7ff6b1a00640 1 -- 172.21.15.8:0/4042066489 shutdown_connections 2024-03-16T21:06:01.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.349+0000 7ff6b1a00640 1 --2- 172.21.15.8:0/4042066489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ac1066a0 0x7ff6ac10e270 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.349+0000 7ff6b1a00640 1 --2- 172.21.15.8:0/4042066489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6ac101f80 0x7ff6ac105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.349+0000 7ff6b1a00640 1 --2- 172.21.15.8:0/4042066489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ac1015d0 0x7ff6ac1019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.349+0000 7ff6b1a00640 1 -- 172.21.15.8:0/4042066489 >> 172.21.15.8:0/4042066489 conn(0x7ff6ac0fce90 msgr2=0x7ff6ac0ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.349+0000 7ff6b1a00640 1 -- 172.21.15.8:0/4042066489 shutdown_connections 2024-03-16T21:06:01.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.349+0000 7ff6b1a00640 1 -- 172.21.15.8:0/4042066489 wait complete. 2024-03-16T21:06:01.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.350+0000 7ff6b1a00640 1 Processor -- start 2024-03-16T21:06:01.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.350+0000 7ff6b1a00640 1 -- start start 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6b1a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ac1015d0 0x7ff6ac19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6b1a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6ac1066a0 0x7ff6ac19dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6b1a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ac1978b0 0x7ff6ac197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6b1a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac1982a0 con 0x7ff6ac1066a0 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6b1a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac198410 con 0x7ff6ac1015d0 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6b1a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac1985d0 con 0x7ff6ac1978b0 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6a3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6ac1066a0 0x7ff6ac19dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6abe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ac1015d0 0x7ff6ac19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6b1000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ac1978b0 0x7ff6ac197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6abe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ac1015d0 0x7ff6ac19d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45468/0 (socket says 172.21.15.8:45468) 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6abe00640 1 -- 172.21.15.8:0/3671658348 learned_addr learned my addr 172.21.15.8:0/3671658348 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6a3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6ac1066a0 0x7ff6ac19dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48194/0 (socket says 172.21.15.8:48194) 2024-03-16T21:06:01.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6abe00640 1 -- 172.21.15.8:0/3671658348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ac1978b0 msgr2=0x7ff6ac197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.351+0000 7ff6abe00640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ac1978b0 0x7ff6ac197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.352+0000 7ff6abe00640 1 -- 172.21.15.8:0/3671658348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6ac1066a0 msgr2=0x7ff6ac19dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.352+0000 7ff6abe00640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6ac1066a0 0x7ff6ac19dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.352+0000 7ff6abe00640 1 -- 172.21.15.8:0/3671658348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c009560 con 0x7ff6ac1015d0 2024-03-16T21:06:01.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.352+0000 7ff6abe00640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ac1015d0 0x7ff6ac19d700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00e9c0 tx=0x7ff69c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.352+0000 7ff6a9600640 1 -- 172.21.15.8:0/3671658348 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00cde0 con 0x7ff6ac1015d0 2024-03-16T21:06:01.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.352+0000 7ff6a9600640 1 -- 172.21.15.8:0/3671658348 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff69c0035f0 con 0x7ff6ac1015d0 2024-03-16T21:06:01.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.352+0000 7ff6a9600640 1 -- 172.21.15.8:0/3671658348 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c010690 con 0x7ff6ac1015d0 2024-03-16T21:06:01.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.352+0000 7ff6b1a00640 1 -- 172.21.15.8:0/3671658348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a4009840 con 0x7ff6ac1015d0 2024-03-16T21:06:01.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.352+0000 7ff6b1a00640 1 -- 172.21.15.8:0/3671658348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac073a50 con 0x7ff6ac1015d0 2024-03-16T21:06:01.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.357+0000 7ff6b5da4740 1 Processor -- start 2024-03-16T21:06:01.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.357+0000 7ff6b5da4740 1 -- start start 2024-03-16T21:06:01.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.357+0000 7ff6a9600640 1 -- 172.21.15.8:0/3671658348 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7ff69c003b60 con 0x7ff6ac1015d0 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.357+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b9651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b965710 0x563b1b96ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b96e2f0 0x563b1b9706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b8d3210 con 0x563b1b964df0 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b8d0740 con 0x563b1b965710 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b8cbf20 con 0x563b1b96e2f0 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6abe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b965710 0x563b1b96ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6abe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b965710 0x563b1b96ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45480/0 (socket says 172.21.15.8:45480) 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6abe00640 1 -- 172.21.15.8:0/1561516585 learned_addr learned my addr 172.21.15.8:0/1561516585 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6a3400640 1 --2- 172.21.15.8:0/1561516585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b96e2f0 0x563b1b9706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6b1000640 1 --2- 172.21.15.8:0/1561516585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b9651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6abe00640 1 -- 172.21.15.8:0/1561516585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b96e2f0 msgr2=0x563b1b9706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6abe00640 1 --2- 172.21.15.8:0/1561516585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b96e2f0 0x563b1b9706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6abe00640 1 -- 172.21.15.8:0/1561516585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 msgr2=0x563b1b9651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6abe00640 1 --2- 172.21.15.8:0/1561516585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b9651d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6abe00640 1 -- 172.21.15.8:0/1561516585 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b1b88ddf0 con 0x563b1b965710 2024-03-16T21:06:01.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.358+0000 7ff6b1000640 1 --2- 172.21.15.8:0/1561516585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b9651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:06:01.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.359+0000 7ff6abe00640 1 --2- 172.21.15.8:0/1561516585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b965710 0x563b1b96ddb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0cb220 tx=0x7ff69c0d3f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e40b8ade53697a39 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.359+0000 7ff6a1600640 1 -- 172.21.15.8:0/1561516585 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0d5de0 con 0x563b1b965710 2024-03-16T21:06:01.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.359+0000 7ff6a9600640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff6900a1c20 0x7ff6900a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.359+0000 7ff6a1600640 1 -- 172.21.15.8:0/1561516585 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff69c0d2030 con 0x563b1b965710 2024-03-16T21:06:01.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.359+0000 7ff6a1600640 1 -- 172.21.15.8:0/1561516585 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0d7980 con 0x563b1b965710 2024-03-16T21:06:01.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.359+0000 7ff6a9600640 1 -- 172.21.15.8:0/3671658348 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff69c014070 con 0x7ff6ac1015d0 2024-03-16T21:06:01.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.360+0000 7ff6b1000640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff6900a1c20 0x7ff6900a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.360+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1561516585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b965710 msgr2=0x563b1b96ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.360+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/1561516585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b965710 0x563b1b96ddb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0cb220 tx=0x7ff69c0d3f10 comp rx=0 tx=0).stop 2024-03-16T21:06:01.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.360+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1561516585 shutdown_connections 2024-03-16T21:06:01.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.360+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/1561516585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b96e2f0 0x563b1b9706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.360+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/1561516585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b965710 0x563b1b96ddb0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.360+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/1561516585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b9651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.360+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1561516585 >> 172.21.15.8:0/1561516585 conn(0x563b1b95f520 msgr2=0x563b1b95f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.360+0000 7ff6b1000640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff6900a1c20 0x7ff6900a40e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4033420 tx=0x7ff6a403e040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.361+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1561516585 shutdown_connections 2024-03-16T21:06:01.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.361+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1561516585 wait complete. 2024-03-16T21:06:01.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.361+0000 7ff6b5da4740 1 -- start start 2024-03-16T21:06:01.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.361+0000 7ff6b5da4740 1 Processor -- start 2024-03-16T21:06:01.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b964df0 0x563b1b96b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b965710 0x563b1b96b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b96e2f0 0x563b1b96be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b871150 con 0x563b1b965710 2024-03-16T21:06:01.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b870df0 con 0x563b1b964df0 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b63a1c0 con 0x563b1b96e2f0 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6b5da4740 10 client.0 _ll_register_callbacks cb 0x563b1b8c02b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6abe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b964df0 0x563b1b96b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6abe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b964df0 0x563b1b96b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45494/0 (socket says 172.21.15.8:45494) 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6abe00640 1 -- 172.21.15.8:0/210883423 learned_addr learned my addr 172.21.15.8:0/210883423 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6b1000640 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b96e2f0 0x563b1b96be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.362+0000 7ff6a3400640 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b965710 0x563b1b96b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.363+0000 7ff6abe00640 1 -- 172.21.15.8:0/210883423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b96e2f0 msgr2=0x563b1b96be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.363+0000 7ff6abe00640 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b96e2f0 0x563b1b96be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.363+0000 7ff6abe00640 1 -- 172.21.15.8:0/210883423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b965710 msgr2=0x563b1b96b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.363+0000 7ff6abe00640 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b965710 0x563b1b96b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.363+0000 7ff6abe00640 1 -- 172.21.15.8:0/210883423 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac073a50 con 0x563b1b964df0 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.363+0000 7ff6abe00640 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b964df0 0x563b1b96b390 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0cb360 tx=0x7ff69c0d73a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a71cf79424cf07 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.363+0000 7ff69a000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:01.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.363+0000 7ff69a000640 1 -- 172.21.15.8:0/210883423 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c096a30 con 0x563b1b964df0 2024-03-16T21:06:01.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.363+0000 7ff69a000640 1 -- 172.21.15.8:0/210883423 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff69c09ae90 con 0x563b1b964df0 2024-03-16T21:06:01.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.363+0000 7ff6b5da4740 1 -- 172.21.15.8:0/210883423 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b1b5cb7e0 con 0x563b1b964df0 2024-03-16T21:06:01.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.364+0000 7ff69a000640 1 -- 172.21.15.8:0/210883423 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff69c09a560 con 0x563b1b964df0 2024-03-16T21:06:01.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.364+0000 7ff6b5da4740 10 client.27365 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:01.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.364+0000 7ff6b5da4740 1 -- 172.21.15.8:0/210883423 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x563b1b8ca5a0 con 0x563b1b964df0 2024-03-16T21:06:01.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.364+0000 7ff69a000640 1 -- 172.21.15.8:0/210883423 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x563b1b5cb7e0 con 0x563b1b964df0 2024-03-16T21:06:01.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.364+0000 7ff69a000640 1 -- 172.21.15.8:0/210883423 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7ff69c01f060 con 0x563b1b964df0 2024-03-16T21:06:01.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.364+0000 7ff6b5da4740 10 client.27365 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:01.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.364+0000 7ff6b5da4740 10 client.27365 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:06:01.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.364+0000 7ff6b5da4740 20 client.27365 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:01.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.364+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563b1b97df50 0x563b1b980370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.364+0000 7ff6b5da4740 4 client.27365 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:01.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.364+0000 7ff6b5da4740 1 -- 172.21.15.8:0/210883423 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b1b608720 con 0x563b1b97df50 2024-03-16T21:06:01.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.365+0000 7ff6a3400640 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563b1b97df50 0x563b1b980370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.365+0000 7ff6a3400640 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563b1b97df50 0x563b1b980370 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2f9af6c80f5063b server_cookie=34a379285e417880 in_seq=0 out_seq=0 2024-03-16T21:06:01.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.365+0000 7ff69a000640 10 client.27365 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:06:01.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.366+0000 7ff69a000640 1 -- 172.21.15.8:0/210883423 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563b1b608720 con 0x563b1b97df50 2024-03-16T21:06:01.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.366+0000 7ff69a000640 10 client.27365 handle_command_reply: tid=0 2024-03-16T21:06:01.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.366+0000 7ff6b5da4740 1 client.27365 shutdown 2024-03-16T21:06:01.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.366+0000 7ff6b5da4740 1 -- 172.21.15.8:0/210883423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b964df0 msgr2=0x563b1b96b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.366+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b964df0 0x563b1b96b390 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0cb360 tx=0x7ff69c0d73a0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.367+0000 7ff6b5da4740 1 -- 172.21.15.8:0/210883423 shutdown_connections 2024-03-16T21:06:01.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.367+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563b1b97df50 0x563b1b980370 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.367+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b96e2f0 0x563b1b96be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.367+0000 7ff69a000640 0 client.27365 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:06:01.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.367+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b965710 0x563b1b96b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.367+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/210883423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b964df0 0x563b1b96b390 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.367+0000 7ff6b5da4740 1 -- 172.21.15.8:0/210883423 >> 172.21.15.8:0/210883423 conn(0x563b1b95f520 msgr2=0x563b1b961270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.367+0000 7ff6b5da4740 1 -- 172.21.15.8:0/210883423 shutdown_connections 2024-03-16T21:06:01.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.367+0000 7ff6b5da4740 1 -- 172.21.15.8:0/210883423 wait complete. 2024-03-16T21:06:01.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.367+0000 7ff6b5da4740 20 client.27365 trim_cache size 0 max 16384 2024-03-16T21:06:01.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.381+0000 7ff6b5da4740 1 Processor -- start 2024-03-16T21:06:01.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.381+0000 7ff6b5da4740 1 -- start start 2024-03-16T21:06:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.381+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b96dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.381+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b96bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.381+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b96e2f0 0x563b1b9796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.381+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b9661c0 con 0x563b1b964df0 2024-03-16T21:06:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.381+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b959ad0 con 0x563b1b96e2f0 2024-03-16T21:06:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.381+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b95adf0 con 0x563b1b965710 2024-03-16T21:06:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6abe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b96dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6a3400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b96bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6b1000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b96e2f0 0x563b1b9796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6abe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b96dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48234/0 (socket says 172.21.15.8:48234) 2024-03-16T21:06:01.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6abe00640 1 -- 172.21.15.8:0/7472972 learned_addr learned my addr 172.21.15.8:0/7472972 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6a3400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b96bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38758/0 (socket says 172.21.15.8:38758) 2024-03-16T21:06:01.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6b1000640 1 -- 172.21.15.8:0/7472972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 msgr2=0x563b1b96bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6b1000640 1 --2- 172.21.15.8:0/7472972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b96bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6b1000640 1 -- 172.21.15.8:0/7472972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 msgr2=0x563b1b96dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6b1000640 1 --2- 172.21.15.8:0/7472972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b96dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6b1000640 1 -- 172.21.15.8:0/7472972 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b1b866ab0 con 0x563b1b96e2f0 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.382+0000 7ff6a3400640 1 --2- 172.21.15.8:0/7472972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b96bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.383+0000 7ff6b1000640 1 --2- 172.21.15.8:0/7472972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b96e2f0 0x563b1b9796a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4036040 tx=0x7ff6a4048000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ccc3a1034c15497 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.383+0000 7ff6a0c00640 1 -- 172.21.15.8:0/7472972 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4042040 con 0x563b1b96e2f0 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.383+0000 7ff6a0c00640 1 -- 172.21.15.8:0/7472972 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff6a4050040 con 0x563b1b96e2f0 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.383+0000 7ff6a0c00640 1 -- 172.21.15.8:0/7472972 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a403cb10 con 0x563b1b96e2f0 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.384+0000 7ff6b5da4740 1 -- 172.21.15.8:0/7472972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b96e2f0 msgr2=0x563b1b9796a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.384+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/7472972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b96e2f0 0x563b1b9796a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4036040 tx=0x7ff6a4048000 comp rx=0 tx=0).stop 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.384+0000 7ff6b5da4740 1 -- 172.21.15.8:0/7472972 shutdown_connections 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.384+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/7472972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b96e2f0 0x563b1b9796a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.384+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/7472972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b96bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.384+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/7472972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b96dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.384+0000 7ff6b5da4740 1 -- 172.21.15.8:0/7472972 >> 172.21.15.8:0/7472972 conn(0x563b1b95f520 msgr2=0x563b1b96a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.384+0000 7ff6b5da4740 1 -- 172.21.15.8:0/7472972 shutdown_connections 2024-03-16T21:06:01.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.384+0000 7ff6b5da4740 1 -- 172.21.15.8:0/7472972 wait complete. 2024-03-16T21:06:01.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.384+0000 7ff6b5da4740 1 -- start start 2024-03-16T21:06:01.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.384+0000 7ff6b5da4740 1 Processor -- start 2024-03-16T21:06:01.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b967c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b968160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6b5da4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b96e2f0 0x563b1b9686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b9d88d0 con 0x563b1b964df0 2024-03-16T21:06:01.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b9d8a40 con 0x563b1b96e2f0 2024-03-16T21:06:01.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6b5da4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1b9d8c00 con 0x563b1b965710 2024-03-16T21:06:01.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6b5da4740 10 client.0 _ll_register_callbacks cb 0x7ff6940097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6a3400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b968160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6b1000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b96e2f0 0x563b1b9686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6a3400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b968160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38760/0 (socket says 172.21.15.8:38760) 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6a3400640 1 -- 172.21.15.8:0/1321489635 learned_addr learned my addr 172.21.15.8:0/1321489635 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.385+0000 7ff6abe00640 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b967c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff6a3400640 1 -- 172.21.15.8:0/1321489635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b96e2f0 msgr2=0x563b1b9686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff6a3400640 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b96e2f0 0x563b1b9686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff6a3400640 1 -- 172.21.15.8:0/1321489635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 msgr2=0x563b1b967c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff6a3400640 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b967c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff6a3400640 1 -- 172.21.15.8:0/1321489635 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff694009b00 con 0x563b1b965710 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff6a3400640 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b968160 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff694004700 tx=0x7ff694004490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=766556d014bc1c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff69a000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:06:01.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff69a000640 1 -- 172.21.15.8:0/1321489635 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694017040 con 0x563b1b965710 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff69a000640 1 -- 172.21.15.8:0/1321489635 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff694020770 con 0x563b1b965710 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1321489635 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff69c0d2030 con 0x563b1b965710 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff69a000640 1 -- 172.21.15.8:0/1321489635 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff694020930 con 0x563b1b965710 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff6b5da4740 10 client.27376 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.386+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1321489635 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7ff6ac10ea80 con 0x563b1b965710 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.387+0000 7ff69a000640 1 -- 172.21.15.8:0/1321489635 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff69c0d2030 con 0x563b1b965710 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.387+0000 7ff69a000640 1 -- 172.21.15.8:0/1321489635 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7ff694010cb0 con 0x563b1b965710 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.387+0000 7ff6b5da4740 10 client.27376 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.387+0000 7ff6b5da4740 10 client.27376 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.387+0000 7ff6b5da4740 20 client.27376 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.387+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563b1b9da510 0x563b1b9dc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.387+0000 7ff6b5da4740 4 client.27376 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.387+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1321489635 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563b1b657890 con 0x563b1b9da510 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.387+0000 7ff6abe00640 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563b1b9da510 0x563b1b9dc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6abe00640 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563b1b9da510 0x563b1b9dc930 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2377e2ed99c7c8d5 server_cookie=306cb2d19eed9a07 in_seq=0 out_seq=0 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff69a000640 10 client.27376 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff69a000640 1 -- 172.21.15.8:0/1321489635 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563b1b657890 con 0x563b1b9da510 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff69a000640 10 client.27376 handle_command_reply: tid=0 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6b5da4740 1 client.27376 shutdown 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1321489635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 msgr2=0x563b1b968160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b968160 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff694004700 tx=0x7ff694004490 comp rx=0 tx=0).stop 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1321489635 shutdown_connections 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x563b1b9da510 0x563b1b9dc930 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563b1b96e2f0 0x563b1b9686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563b1b965710 0x563b1b968160 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6b5da4740 1 --2- 172.21.15.8:0/1321489635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b1b964df0 0x563b1b967c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1321489635 >> 172.21.15.8:0/1321489635 conn(0x563b1b95f520 msgr2=0x563b1b95de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff69a000640 0 client.27376 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1321489635 shutdown_connections 2024-03-16T21:06:01.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.388+0000 7ff6b5da4740 1 -- 172.21.15.8:0/1321489635 wait complete. 2024-03-16T21:06:01.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b5da4740 20 client.27376 trim_cache size 0 max 16384 2024-03-16T21:06:01.398 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 -- 172.21.15.8:0/3671658348 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff6900a1c20 msgr2=0x7ff6900a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff6900a1c20 0x7ff6900a40e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4033420 tx=0x7ff6a403e040 comp rx=0 tx=0).stop 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 -- 172.21.15.8:0/3671658348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ac1015d0 msgr2=0x7ff6ac19d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ac1015d0 0x7ff6ac19d700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00e9c0 tx=0x7ff69c00ee80 comp rx=0 tx=0).stop 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 -- 172.21.15.8:0/3671658348 shutdown_connections 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff6900a1c20 0x7ff6900a40e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ac1978b0 0x7ff6ac197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6ac1066a0 0x7ff6ac19dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 --2- 172.21.15.8:0/3671658348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ac1015d0 0x7ff6ac19d700 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 -- 172.21.15.8:0/3671658348 >> 172.21.15.8:0/3671658348 conn(0x7ff6ac0fce90 msgr2=0x7ff6ac0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 -- 172.21.15.8:0/3671658348 shutdown_connections 2024-03-16T21:06:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.389+0000 7ff6b1a00640 1 -- 172.21.15.8:0/3671658348 wait complete. 2024-03-16T21:06:01.411 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:06:01.411 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:06:01.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.619+0000 7f0f9be00640 1 -- 172.21.15.8:0/3255656708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f9c1003a0 msgr2=0x7f0f9c100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.619+0000 7f0f9be00640 1 --2- 172.21.15.8:0/3255656708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f9c1003a0 0x7f0f9c100780 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009900 tx=0x7f0f8c02bcd0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.619+0000 7f0f9be00640 1 -- 172.21.15.8:0/3255656708 shutdown_connections 2024-03-16T21:06:01.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.619+0000 7f0f9be00640 1 --2- 172.21.15.8:0/3255656708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c1057a0 0x7f0f9c105c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.619+0000 7f0f9be00640 1 --2- 172.21.15.8:0/3255656708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f9c100cc0 0x7f0f9c105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.619+0000 7f0f9be00640 1 --2- 172.21.15.8:0/3255656708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f9c1003a0 0x7f0f9c100780 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.619+0000 7f0f9be00640 1 -- 172.21.15.8:0/3255656708 >> 172.21.15.8:0/3255656708 conn(0x7f0f9c0fbdf0 msgr2=0x7f0f9c0fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.619+0000 7f0f9be00640 1 -- 172.21.15.8:0/3255656708 shutdown_connections 2024-03-16T21:06:01.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.619+0000 7f0f9be00640 1 -- 172.21.15.8:0/3255656708 wait complete. 2024-03-16T21:06:01.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.620+0000 7f0f9be00640 1 Processor -- start 2024-03-16T21:06:01.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.620+0000 7f0f9be00640 1 -- start start 2024-03-16T21:06:01.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.621+0000 7f0f9be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f9c1003a0 0x7f0f9c19e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.621+0000 7f0f9be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c100cc0 0x7f0f9c19e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.621+0000 7f0f9be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f9c1057a0 0x7f0f9c1a2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.621+0000 7f0f9be00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1a2f80 con 0x7f0f9c100cc0 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.621+0000 7f0f9be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1a30f0 con 0x7f0f9c1003a0 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.621+0000 7f0f9be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1a32b0 con 0x7f0f9c1057a0 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.621+0000 7f0f9aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f9c1003a0 0x7f0f9c19e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.621+0000 7f0f9aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f9c1003a0 0x7f0f9c19e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45522/0 (socket says 172.21.15.8:45522) 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.621+0000 7f0f9aa00640 1 -- 172.21.15.8:0/1583763500 learned_addr learned my addr 172.21.15.8:0/1583763500 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.621+0000 7f0f9a000640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c100cc0 0x7f0f9c19e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.621+0000 7f0f9b400640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f9c1057a0 0x7f0f9c1a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.622+0000 7f0f9aa00640 1 -- 172.21.15.8:0/1583763500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f9c1057a0 msgr2=0x7f0f9c1a2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.622+0000 7f0f9aa00640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f9c1057a0 0x7f0f9c1a2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.622+0000 7f0f9aa00640 1 -- 172.21.15.8:0/1583763500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c100cc0 msgr2=0x7f0f9c19e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.622+0000 7f0f9aa00640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c100cc0 0x7f0f9c19e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.622+0000 7f0f9aa00640 1 -- 172.21.15.8:0/1583763500 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f88009490 con 0x7f0f9c1003a0 2024-03-16T21:06:01.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.622+0000 7f0f9aa00640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f9c1003a0 0x7f0f9c19e0c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c005ab0 tx=0x7f0f8c02c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.622+0000 7f0f93400640 1 -- 172.21.15.8:0/1583763500 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c004e10 con 0x7f0f9c1003a0 2024-03-16T21:06:01.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.622+0000 7f0f93400640 1 -- 172.21.15.8:0/1583763500 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0f8c005470 con 0x7f0f9c1003a0 2024-03-16T21:06:01.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.622+0000 7f0f9be00640 1 -- 172.21.15.8:0/1583763500 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8c009560 con 0x7f0f9c1003a0 2024-03-16T21:06:01.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.622+0000 7f0f93400640 1 -- 172.21.15.8:0/1583763500 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c003e90 con 0x7f0f9c1003a0 2024-03-16T21:06:01.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.622+0000 7f0f9be00640 1 -- 172.21.15.8:0/1583763500 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c1aac30 con 0x7f0f9c1003a0 2024-03-16T21:06:01.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.627+0000 7f0f93400640 1 -- 172.21.15.8:0/1583763500 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f0f8c004f70 con 0x7f0f9c1003a0 2024-03-16T21:06:01.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.627+0000 7f0fa43b0740 1 Processor -- start 2024-03-16T21:06:01.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.627+0000 7f0fa43b0740 1 -- start start 2024-03-16T21:06:01.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.627+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 0x56286982e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.627+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 0x562869836db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.627+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x5628698396e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.627+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286979c210 con 0x56286982ddf0 2024-03-16T21:06:01.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.627+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562869799740 con 0x56286982e710 2024-03-16T21:06:01.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.627+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562869794f20 con 0x5628698372f0 2024-03-16T21:06:01.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f9b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 0x56286982e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f9b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 0x56286982e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48258/0 (socket says 172.21.15.8:48258) 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f9b400640 1 -- 172.21.15.8:0/1111624164 learned_addr learned my addr 172.21.15.8:0/1111624164 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f9a000640 1 --2- 172.21.15.8:0/1111624164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x5628698396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f9aa00640 1 --2- 172.21.15.8:0/1111624164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 0x562869836db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f9b400640 1 -- 172.21.15.8:0/1111624164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 msgr2=0x5628698396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f9b400640 1 --2- 172.21.15.8:0/1111624164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x5628698396e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f9b400640 1 -- 172.21.15.8:0/1111624164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 msgr2=0x562869836db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f9b400640 1 --2- 172.21.15.8:0/1111624164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 0x562869836db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f9b400640 1 -- 172.21.15.8:0/1111624164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562869756df0 con 0x56286982ddf0 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f93400640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0f800a1ba0 0x7f0f800a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.628+0000 7f0f9b400640 1 --2- 172.21.15.8:0/1111624164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 0x56286982e1d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009f70 tx=0x7f0f94010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18314a93b769a540 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.629+0000 7f0f93400640 1 -- 172.21.15.8:0/1583763500 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0f8c0efb80 con 0x7f0f9c1003a0 2024-03-16T21:06:01.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.629+0000 7f0f9aa00640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0f800a1ba0 0x7f0f800a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.629+0000 7f0f87400640 1 -- 172.21.15.8:0/1111624164 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94004d20 con 0x56286982ddf0 2024-03-16T21:06:01.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.629+0000 7f0f87400640 1 -- 172.21.15.8:0/1111624164 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0f94004e80 con 0x56286982ddf0 2024-03-16T21:06:01.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.629+0000 7f0f87400640 1 -- 172.21.15.8:0/1111624164 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94012a80 con 0x56286982ddf0 2024-03-16T21:06:01.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.630+0000 7f0fa43b0740 1 -- 172.21.15.8:0/1111624164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 msgr2=0x56286982e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.630+0000 7f0f9aa00640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0f800a1ba0 0x7f0f800a4060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0ed490 tx=0x7f0f8c0f3690 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.630+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/1111624164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 0x56286982e1d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009f70 tx=0x7f0f94010800 comp rx=0 tx=0).stop 2024-03-16T21:06:01.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.630+0000 7f0fa43b0740 1 -- 172.21.15.8:0/1111624164 shutdown_connections 2024-03-16T21:06:01.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.630+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/1111624164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x5628698396e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.630+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/1111624164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 0x562869836db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.630+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/1111624164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 0x56286982e1d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.630+0000 7f0fa43b0740 1 -- 172.21.15.8:0/1111624164 >> 172.21.15.8:0/1111624164 conn(0x562869828520 msgr2=0x562869828900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.630+0000 7f0fa43b0740 1 -- 172.21.15.8:0/1111624164 shutdown_connections 2024-03-16T21:06:01.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.630+0000 7f0fa43b0740 1 -- 172.21.15.8:0/1111624164 wait complete. 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.630+0000 7f0fa43b0740 1 -- start start 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0fa43b0740 1 Processor -- start 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 0x5628698343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 0x5628698348f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x562869834e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286973a150 con 0x56286982ddf0 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562869739df0 con 0x56286982e710 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628695031c0 con 0x5628698372f0 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0fa43b0740 10 client.0 _ll_register_callbacks cb 0x5628697892b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0f9a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 0x5628698348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0f9b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 0x5628698343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0f9a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 0x5628698348f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45542/0 (socket says 172.21.15.8:45542) 2024-03-16T21:06:01.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.631+0000 7f0f9a000640 1 -- 172.21.15.8:0/92237082 learned_addr learned my addr 172.21.15.8:0/92237082 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.632+0000 7f0f9b400640 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x562869834e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.632+0000 7f0f9a000640 1 -- 172.21.15.8:0/92237082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 msgr2=0x562869834e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.632+0000 7f0f9a000640 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x562869834e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.632+0000 7f0f9a000640 1 -- 172.21.15.8:0/92237082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 msgr2=0x5628698343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.632+0000 7f0f9a000640 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 0x5628698343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.632+0000 7f0f9a000640 1 -- 172.21.15.8:0/92237082 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f94009bd0 con 0x56286982e710 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.632+0000 7f0f9b400640 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 0x5628698343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.632+0000 7f0f9a000640 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 0x5628698348f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0f88012810 tx=0x7f0f88012cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bbcaa5a2fb702c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.632+0000 7f0f7be00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0f7be00640 1 -- 172.21.15.8:0/92237082 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88017070 con 0x56286982e710 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0f7be00640 1 -- 172.21.15.8:0/92237082 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0f8800f920 con 0x56286982e710 2024-03-16T21:06:01.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0fa43b0740 1 -- 172.21.15.8:0/92237082 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628694d1720 con 0x56286982e710 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0f7be00640 1 -- 172.21.15.8:0/92237082 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f880122e0 con 0x56286982e710 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0fa43b0740 10 client.27383 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0fa43b0740 1 -- 172.21.15.8:0/92237082 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5628697935a0 con 0x56286982e710 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0f7be00640 1 -- 172.21.15.8:0/92237082 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0f88028080 con 0x56286982e710 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0f7be00640 1 -- 172.21.15.8:0/92237082 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0f88022030 con 0x56286982e710 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0fa43b0740 10 client.27383 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0fa43b0740 10 client.27383 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0fa43b0740 20 client.27383 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.633+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5628698474a0 0x5628698498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.634+0000 7f0fa43b0740 4 client.27383 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.634+0000 7f0fa43b0740 1 -- 172.21.15.8:0/92237082 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562869520890 con 0x5628698474a0 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.634+0000 7f0f9b400640 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5628698474a0 0x5628698498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.634+0000 7f0f9b400640 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5628698474a0 0x5628698498c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dffc5cf4e287b410 server_cookie=600b6151961a8e1 in_seq=0 out_seq=0 2024-03-16T21:06:01.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.634+0000 7f0f7be00640 10 client.27383 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:06:01.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0f7be00640 1 -- 172.21.15.8:0/92237082 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x562869520890 con 0x5628698474a0 2024-03-16T21:06:01.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0f7be00640 10 client.27383 handle_command_reply: tid=0 2024-03-16T21:06:01.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0fa43b0740 1 client.27383 shutdown 2024-03-16T21:06:01.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0fa43b0740 1 -- 172.21.15.8:0/92237082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 msgr2=0x5628698348f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 0x5628698348f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0f88012810 tx=0x7f0f88012cd0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0fa43b0740 1 -- 172.21.15.8:0/92237082 shutdown_connections 2024-03-16T21:06:01.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5628698474a0 0x5628698498c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x562869834e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982e710 0x5628698348f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0f7be00640 0 client.27383 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:06:01.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/92237082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982ddf0 0x5628698343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.635+0000 7f0fa43b0740 1 -- 172.21.15.8:0/92237082 >> 172.21.15.8:0/92237082 conn(0x562869828520 msgr2=0x56286982a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.636+0000 7f0fa43b0740 1 -- 172.21.15.8:0/92237082 shutdown_connections 2024-03-16T21:06:01.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.636+0000 7f0fa43b0740 1 -- 172.21.15.8:0/92237082 wait complete. 2024-03-16T21:06:01.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.636+0000 7f0fa43b0740 20 client.27383 trim_cache size 0 max 16384 2024-03-16T21:06:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.649+0000 7f0fa43b0740 1 Processor -- start 2024-03-16T21:06:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.649+0000 7f0fa43b0740 1 -- start start 2024-03-16T21:06:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.650+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 0x562869836ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.650+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982e710 0x562869823550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.650+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x562869842670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.650+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286982e570 con 0x56286982e710 2024-03-16T21:06:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.650+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562869823a90 con 0x56286982ddf0 2024-03-16T21:06:01.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.650+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562869823df0 con 0x5628698372f0 2024-03-16T21:06:01.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.650+0000 7f0f9b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 0x562869836ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.650+0000 7f0f9a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982e710 0x562869823550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.650+0000 7f0f9b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 0x562869836ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45550/0 (socket says 172.21.15.8:45550) 2024-03-16T21:06:01.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.650+0000 7f0f9b400640 1 -- 172.21.15.8:0/563696855 learned_addr learned my addr 172.21.15.8:0/563696855 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.650+0000 7f0f9b400640 1 --2- 172.21.15.8:0/563696855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x562869842670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.651+0000 7f0f9b400640 1 -- 172.21.15.8:0/563696855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 msgr2=0x562869842670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.651+0000 7f0f9b400640 1 --2- 172.21.15.8:0/563696855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x562869842670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.651+0000 7f0f9b400640 1 -- 172.21.15.8:0/563696855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982e710 msgr2=0x562869823550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.651+0000 7f0f9b400640 1 --2- 172.21.15.8:0/563696855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982e710 0x562869823550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.651+0000 7f0f9b400640 1 -- 172.21.15.8:0/563696855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56286972fab0 con 0x56286982ddf0 2024-03-16T21:06:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.651+0000 7f0f9b400640 1 --2- 172.21.15.8:0/563696855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 0x562869836ae0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0f94000f80 tx=0x7f0f94004c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899355af2971aa3f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.651+0000 7f0f86a00640 1 -- 172.21.15.8:0/563696855 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9402f300 con 0x56286982ddf0 2024-03-16T21:06:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.651+0000 7f0f86a00640 1 -- 172.21.15.8:0/563696855 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0f9401f040 con 0x56286982ddf0 2024-03-16T21:06:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.651+0000 7f0f86a00640 1 -- 172.21.15.8:0/563696855 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94005260 con 0x56286982ddf0 2024-03-16T21:06:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.652+0000 7f0fa43b0740 1 -- 172.21.15.8:0/563696855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 msgr2=0x562869836ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.652+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/563696855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 0x562869836ae0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0f94000f80 tx=0x7f0f94004c00 comp rx=0 tx=0).stop 2024-03-16T21:06:01.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.652+0000 7f0fa43b0740 1 -- 172.21.15.8:0/563696855 shutdown_connections 2024-03-16T21:06:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.652+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/563696855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628698372f0 0x562869842670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.652+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/563696855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56286982e710 0x562869823550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.652+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/563696855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 0x562869836ae0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.652+0000 7f0fa43b0740 1 -- 172.21.15.8:0/563696855 >> 172.21.15.8:0/563696855 conn(0x562869828520 msgr2=0x5628698276c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.652+0000 7f0fa43b0740 1 -- 172.21.15.8:0/563696855 shutdown_connections 2024-03-16T21:06:01.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.652+0000 7f0fa43b0740 1 -- 172.21.15.8:0/563696855 wait complete. 2024-03-16T21:06:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.652+0000 7f0fa43b0740 1 -- start start 2024-03-16T21:06:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0fa43b0740 1 Processor -- start 2024-03-16T21:06:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 0x562869832000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56286982e710 0x56286983c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0fa43b0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628698372f0 0x56286983c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286983cca0 con 0x5628698372f0 2024-03-16T21:06:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286983ce10 con 0x56286982ddf0 2024-03-16T21:06:01.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0fa43b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286983cfd0 con 0x56286982e710 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0fa43b0740 10 client.0 _ll_register_callbacks cb 0x7f0f880099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0f9a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56286982e710 0x56286983c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0f9a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56286982e710 0x56286983c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38808/0 (socket says 172.21.15.8:38808) 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0f9a000640 1 -- 172.21.15.8:0/3121076869 learned_addr learned my addr 172.21.15.8:0/3121076869 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.653+0000 7f0f9b400640 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 0x562869832000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f9a000640 1 -- 172.21.15.8:0/3121076869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 msgr2=0x562869832000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f9a000640 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 0x562869832000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f9a000640 1 -- 172.21.15.8:0/3121076869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628698372f0 msgr2=0x56286983c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f9b400640 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628698372f0 0x56286983c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f9a000640 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628698372f0 0x56286983c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f9a000640 1 -- 172.21.15.8:0/3121076869 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562869756df0 con 0x56286982e710 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f9b400640 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628698372f0 0x56286983c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:06:01.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f9a000640 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56286982e710 0x56286983c180 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x562869835980 tx=0x7f0f88012510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bef050fb2aeaec3f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f7be00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f7be00640 1 -- 172.21.15.8:0/3121076869 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88017040 con 0x56286982e710 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f7be00640 1 -- 172.21.15.8:0/3121076869 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0f88005520 con 0x56286982e710 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0fa43b0740 1 -- 172.21.15.8:0/3121076869 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562869823c30 con 0x56286982e710 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.654+0000 7f0f7be00640 1 -- 172.21.15.8:0/3121076869 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f8800fed0 con 0x56286982e710 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.655+0000 7f0fa43b0740 10 client.27394 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.655+0000 7f0fa43b0740 1 -- 172.21.15.8:0/3121076869 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562869755650 con 0x56286982e710 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.655+0000 7f0f7be00640 1 -- 172.21.15.8:0/3121076869 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0f88033080 con 0x56286982e710 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.655+0000 7f0f7be00640 1 -- 172.21.15.8:0/3121076869 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0f88003820 con 0x56286982e710 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.655+0000 7f0fa43b0740 10 client.27394 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.655+0000 7f0fa43b0740 10 client.27394 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.655+0000 7f0fa43b0740 20 client.27394 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.655+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5628698a4430 0x5628698a6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.655+0000 7f0fa43b0740 4 client.27394 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:06:01.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.655+0000 7f0fa43b0740 1 -- 172.21.15.8:0/3121076869 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5628694947e0 con 0x5628698a4430 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.655+0000 7f0f9b400640 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5628698a4430 0x5628698a6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0f9b400640 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5628698a4430 0x5628698a6850 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3604fcff2ae89b11 server_cookie=8ed86fe48bd4a39e in_seq=0 out_seq=0 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0f7be00640 10 client.27394 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0f7be00640 1 -- 172.21.15.8:0/3121076869 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5628694947e0 con 0x5628698a4430 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0f7be00640 10 client.27394 handle_command_reply: tid=0 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0fa43b0740 1 client.27394 shutdown 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0fa43b0740 1 -- 172.21.15.8:0/3121076869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56286982e710 msgr2=0x56286983c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56286982e710 0x56286983c180 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x562869835980 tx=0x7f0f88012510 comp rx=0 tx=0).stop 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0fa43b0740 1 -- 172.21.15.8:0/3121076869 shutdown_connections 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5628698a4430 0x5628698a6850 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628698372f0 0x56286983c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56286982e710 0x56286983c180 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0f7be00640 0 client.27394 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:06:01.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0fa43b0740 1 --2- 172.21.15.8:0/3121076869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56286982ddf0 0x562869832000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0fa43b0740 1 -- 172.21.15.8:0/3121076869 >> 172.21.15.8:0/3121076869 conn(0x562869828520 msgr2=0x562869834350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.656+0000 7f0fa43b0740 1 -- 172.21.15.8:0/3121076869 shutdown_connections 2024-03-16T21:06:01.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0fa43b0740 1 -- 172.21.15.8:0/3121076869 wait complete. 2024-03-16T21:06:01.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0fa43b0740 20 client.27394 trim_cache size 0 max 16384 2024-03-16T21:06:01.667 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:06:01.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0f9be00640 1 -- 172.21.15.8:0/1583763500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0f800a1ba0 msgr2=0x7f0f800a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0f9be00640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0f800a1ba0 0x7f0f800a4060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0ed490 tx=0x7f0f8c0f3690 comp rx=0 tx=0).stop 2024-03-16T21:06:01.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0f9be00640 1 -- 172.21.15.8:0/1583763500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f9c1003a0 msgr2=0x7f0f9c19e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0f9be00640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f9c1003a0 0x7f0f9c19e0c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c005ab0 tx=0x7f0f8c02c760 comp rx=0 tx=0).stop 2024-03-16T21:06:01.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0f9be00640 1 -- 172.21.15.8:0/1583763500 shutdown_connections 2024-03-16T21:06:01.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0f9be00640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0f800a1ba0 0x7f0f800a4060 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0f9be00640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f9c1057a0 0x7f0f9c1a2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0f9be00640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c100cc0 0x7f0f9c19e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0f9be00640 1 --2- 172.21.15.8:0/1583763500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f9c1003a0 0x7f0f9c19e0c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0f9be00640 1 -- 172.21.15.8:0/1583763500 >> 172.21.15.8:0/1583763500 conn(0x7f0f9c0fbdf0 msgr2=0x7f0f9c103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.657+0000 7f0f9be00640 1 -- 172.21.15.8:0/1583763500 shutdown_connections 2024-03-16T21:06:01.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.658+0000 7f0f9be00640 1 -- 172.21.15.8:0/1583763500 wait complete. 2024-03-16T21:06:01.678 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:01 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1376874525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:06:01.680 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:06:01.680 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:06:01.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:01 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1376874525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:06:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.886+0000 7f81c1e00640 1 -- 172.21.15.8:0/3349843065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81bc10daa0 msgr2=0x7f81bc10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.886+0000 7f81c1e00640 1 --2- 172.21.15.8:0/3349843065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81bc10daa0 0x7f81bc10de80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009900 tx=0x7f81ac02bc40 comp rx=0 tx=0).stop 2024-03-16T21:06:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.887+0000 7f81c1e00640 1 -- 172.21.15.8:0/3349843065 shutdown_connections 2024-03-16T21:06:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.887+0000 7f81c1e00640 1 --2- 172.21.15.8:0/3349843065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81bc108450 0x7f81bc114960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.887+0000 7f81c1e00640 1 --2- 172.21.15.8:0/3349843065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81bc107a90 0x7f81bc107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.887+0000 7f81c1e00640 1 --2- 172.21.15.8:0/3349843065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81bc10daa0 0x7f81bc10de80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.887+0000 7f81c1e00640 1 -- 172.21.15.8:0/3349843065 >> 172.21.15.8:0/3349843065 conn(0x7f81bc075a30 msgr2=0x7f81bc077e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.887+0000 7f81c1e00640 1 -- 172.21.15.8:0/3349843065 shutdown_connections 2024-03-16T21:06:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.887+0000 7f81c1e00640 1 -- 172.21.15.8:0/3349843065 wait complete. 2024-03-16T21:06:01.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.888+0000 7f81c1e00640 1 Processor -- start 2024-03-16T21:06:01.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.888+0000 7f81c1e00640 1 -- start start 2024-03-16T21:06:01.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.888+0000 7f81c1e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81bc107a90 0x7f81bc19e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.888+0000 7f81c1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81bc108450 0x7f81bc19e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81c1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81bc10daa0 0x7f81bc1a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81c1e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc1a30c0 con 0x7f81bc10daa0 2024-03-16T21:06:01.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81c1e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc1a3230 con 0x7f81bc108450 2024-03-16T21:06:01.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81c1e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc1a33f0 con 0x7f81bc107a90 2024-03-16T21:06:01.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81bc108450 0x7f81bc19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81baa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81bc107a90 0x7f81bc19e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81bc108450 0x7f81bc19e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45570/0 (socket says 172.21.15.8:45570) 2024-03-16T21:06:01.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81baa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81bc107a90 0x7f81bc19e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38828/0 (socket says 172.21.15.8:38828) 2024-03-16T21:06:01.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81b3e00640 1 -- 172.21.15.8:0/4125127092 learned_addr learned my addr 172.21.15.8:0/4125127092 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81bb400640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81bc10daa0 0x7f81bc1a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.896 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:01 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1376874525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:06:01.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81baa00640 1 -- 172.21.15.8:0/4125127092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81bc108450 msgr2=0x7f81bc19e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81baa00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81bc108450 0x7f81bc19e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81baa00640 1 -- 172.21.15.8:0/4125127092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81bc10daa0 msgr2=0x7f81bc1a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81baa00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81bc10daa0 0x7f81bc1a2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81baa00640 1 -- 172.21.15.8:0/4125127092 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac009560 con 0x7f81bc107a90 2024-03-16T21:06:01.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.889+0000 7f81b3e00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81bc108450 0x7f81bc19e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:01.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.890+0000 7f81baa00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81bc107a90 0x7f81bc19e200 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f81ac02c180 tx=0x7f81ac02c690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.890+0000 7f81c0a00640 1 -- 172.21.15.8:0/4125127092 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac0042d0 con 0x7f81bc107a90 2024-03-16T21:06:01.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.890+0000 7f81c0a00640 1 -- 172.21.15.8:0/4125127092 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f81ac004430 con 0x7f81bc107a90 2024-03-16T21:06:01.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.890+0000 7f81c1e00640 1 -- 172.21.15.8:0/4125127092 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81bc1a3670 con 0x7f81bc107a90 2024-03-16T21:06:01.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.890+0000 7f81c0a00640 1 -- 172.21.15.8:0/4125127092 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac003ce0 con 0x7f81bc107a90 2024-03-16T21:06:01.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.890+0000 7f81c1e00640 1 -- 172.21.15.8:0/4125127092 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81bc1aaf50 con 0x7f81bc107a90 2024-03-16T21:06:01.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.893+0000 7f81c0a00640 1 -- 172.21.15.8:0/4125127092 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f81ac004e10 con 0x7f81bc107a90 2024-03-16T21:06:01.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.894+0000 7f81c4a3b740 1 Processor -- start 2024-03-16T21:06:01.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.894+0000 7f81c4a3b740 1 -- start start 2024-03-16T21:06:01.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.894+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 0x5630b4a97020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.894+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4a9fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.894+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 0x5630b4aa2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.894+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b4a05210 con 0x5630b4aa0140 2024-03-16T21:06:01.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.894+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b4a02740 con 0x5630b4a96c40 2024-03-16T21:06:01.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.894+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b49fdf20 con 0x5630b4a97560 2024-03-16T21:06:01.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81bb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 0x5630b4a97020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81baa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4a9fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81bb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 0x5630b4a97020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45572/0 (socket says 172.21.15.8:45572) 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81bb400640 1 -- 172.21.15.8:0/13578241 learned_addr learned my addr 172.21.15.8:0/13578241 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81b3e00640 1 --2- 172.21.15.8:0/13578241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 0x5630b4aa2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81bb400640 1 -- 172.21.15.8:0/13578241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 msgr2=0x5630b4a9fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81bb400640 1 --2- 172.21.15.8:0/13578241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4a9fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81bb400640 1 -- 172.21.15.8:0/13578241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 msgr2=0x5630b4aa2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81bb400640 1 --2- 172.21.15.8:0/13578241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 0x5630b4aa2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81bb400640 1 -- 172.21.15.8:0/13578241 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630b49bfdf0 con 0x5630b4a96c40 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81bb400640 1 --2- 172.21.15.8:0/13578241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 0x5630b4a97020 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009f50 tx=0x7f81b40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f46a6a8e9b4d8589 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.895+0000 7f81c0a00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81a00a1c20 0x7f81a00a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.896+0000 7f81abe00640 1 -- 172.21.15.8:0/13578241 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4004d20 con 0x5630b4a96c40 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.896+0000 7f81abe00640 1 -- 172.21.15.8:0/13578241 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f81b4004e80 con 0x5630b4a96c40 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.896+0000 7f81abe00640 1 -- 172.21.15.8:0/13578241 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4005260 con 0x5630b4a96c40 2024-03-16T21:06:01.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.896+0000 7f81c0a00640 1 -- 172.21.15.8:0/4125127092 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f81ac0efc30 con 0x7f81bc107a90 2024-03-16T21:06:01.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.896+0000 7f81baa00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81a00a1c20 0x7f81a00a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.896+0000 7f81c4a3b740 1 -- 172.21.15.8:0/13578241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 msgr2=0x5630b4a97020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.896+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/13578241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 0x5630b4a97020 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009f50 tx=0x7f81b40118d0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.896+0000 7f81baa00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81a00a1c20 0x7f81a00a40e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5630b4a96710 tx=0x7f81ac0f36a0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.897+0000 7f81c4a3b740 1 -- 172.21.15.8:0/13578241 shutdown_connections 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.897+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/13578241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 0x5630b4aa2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.897+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/13578241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4a9fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.897+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/13578241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 0x5630b4a97020 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.897+0000 7f81c4a3b740 1 -- 172.21.15.8:0/13578241 >> 172.21.15.8:0/13578241 conn(0x5630b4a91370 msgr2=0x5630b4a91750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.897+0000 7f81c4a3b740 1 -- 172.21.15.8:0/13578241 shutdown_connections 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.897+0000 7f81c4a3b740 1 -- 172.21.15.8:0/13578241 wait complete. 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.897+0000 7f81c4a3b740 1 -- start start 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.897+0000 7f81c4a3b740 1 Processor -- start 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4a96c40 0x5630b4a9d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a97560 0x5630b4a9d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4aa0140 0x5630b4a9dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b49a3150 con 0x5630b4a96c40 2024-03-16T21:06:01.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b49a2df0 con 0x5630b4a97560 2024-03-16T21:06:01.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b476c1c0 con 0x5630b4aa0140 2024-03-16T21:06:01.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81c4a3b740 10 client.0 _ll_register_callbacks cb 0x5630b49f22b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:01.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a97560 0x5630b4a9d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4a96c40 0x5630b4a9d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a97560 0x5630b4a9d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45578/0 (socket says 172.21.15.8:45578) 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81b3e00640 1 -- 172.21.15.8:0/2931742346 learned_addr learned my addr 172.21.15.8:0/2931742346 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.898+0000 7f81bb400640 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4aa0140 0x5630b4a9dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81b3e00640 1 -- 172.21.15.8:0/2931742346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4aa0140 msgr2=0x5630b4a9dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81b3e00640 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4aa0140 0x5630b4a9dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81b3e00640 1 -- 172.21.15.8:0/2931742346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4a96c40 msgr2=0x5630b4a9d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81b3e00640 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4a96c40 0x5630b4a9d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81b3e00640 1 -- 172.21.15.8:0/2931742346 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b4009c00 con 0x5630b4a97560 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81bb400640 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4a96c40 0x5630b4a9d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81b3e00640 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a97560 0x5630b4a9d740 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f81a4004470 tx=0x7f81a40039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c329e7d6dbc3202e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81a8c00640 1 -- 172.21.15.8:0/2931742346 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4016070 con 0x5630b4a97560 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81a8c00640 1 -- 172.21.15.8:0/2931742346 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f81a4011830 con 0x5630b4a97560 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2931742346 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630b473a720 con 0x5630b4a97560 2024-03-16T21:06:01.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81a8c00640 1 -- 172.21.15.8:0/2931742346 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81a40119f0 con 0x5630b4a97560 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81c4a3b740 10 client.27401 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.899+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2931742346 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5630b49fc5a0 con 0x5630b4a97560 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.900+0000 7f81a8c00640 1 -- 172.21.15.8:0/2931742346 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5630b473a720 con 0x5630b4a97560 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.900+0000 7f81a8c00640 1 -- 172.21.15.8:0/2931742346 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f81a401b470 con 0x5630b4a97560 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.900+0000 7f81c4a3b740 10 client.27401 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.900+0000 7f81c4a3b740 10 client.27401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.900+0000 7f81c4a3b740 20 client.27401 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.900+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5630b4ab01c0 0x5630b4ab25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.900+0000 7f81c4a3b740 4 client.27401 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.900+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2931742346 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630b4789890 con 0x5630b4ab01c0 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.900+0000 7f81bb400640 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5630b4ab01c0 0x5630b4ab25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.901+0000 7f81bb400640 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5630b4ab01c0 0x5630b4ab25e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d64a518f793b6e47 server_cookie=3c14c2807d88bb92 in_seq=0 out_seq=0 2024-03-16T21:06:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.901+0000 7f81a8c00640 10 client.27401 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:01.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.901+0000 7f81a8c00640 1 -- 172.21.15.8:0/2931742346 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5630b4789890 con 0x5630b4ab01c0 2024-03-16T21:06:01.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.901+0000 7f81a8c00640 10 client.27401 handle_command_reply: tid=0 2024-03-16T21:06:01.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 1 client.27401 shutdown 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2931742346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a97560 msgr2=0x5630b4a9d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a97560 0x5630b4a9d740 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f81a4004470 tx=0x7f81a40039c0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2931742346 shutdown_connections 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4aa0140 0x5630b4a9dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a97560 0x5630b4a9d740 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5630b4ab01c0 0x5630b4ab25e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2931742346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4a96c40 0x5630b4a9d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81a8c00640 0 client.27401 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2931742346 >> 172.21.15.8:0/2931742346 conn(0x5630b4a91370 msgr2=0x5630b4a930c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2931742346 shutdown_connections 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2931742346 wait complete. 2024-03-16T21:06:01.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.902+0000 7f81c4a3b740 20 client.27401 trim_cache size 0 max 16384 2024-03-16T21:06:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.916+0000 7f81c4a3b740 1 Processor -- start 2024-03-16T21:06:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.916+0000 7f81c4a3b740 1 -- start start 2024-03-16T21:06:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.916+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4a96c40 0x5630b4a9f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.916+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4a97940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.916+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4aa0140 0x5630b4aab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.916+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b4a9b750 con 0x5630b4a96c40 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.916+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b4a935b0 con 0x5630b4aa0140 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.916+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b4a97e80 con 0x5630b4a97560 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.917+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4a97940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.917+0000 7f81bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4a96c40 0x5630b4a9f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.917+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4a97940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38856/0 (socket says 172.21.15.8:38856) 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.917+0000 7f81b3e00640 1 -- 172.21.15.8:0/3501459295 learned_addr learned my addr 172.21.15.8:0/3501459295 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.917+0000 7f81b3e00640 1 -- 172.21.15.8:0/3501459295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4aa0140 msgr2=0x5630b4aab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.917+0000 7f81b3e00640 1 --2- 172.21.15.8:0/3501459295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4aa0140 0x5630b4aab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.917+0000 7f81b3e00640 1 -- 172.21.15.8:0/3501459295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4a96c40 msgr2=0x5630b4a9f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.917+0000 7f81b3e00640 1 --2- 172.21.15.8:0/3501459295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4a96c40 0x5630b4a9f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.917+0000 7f81b3e00640 1 -- 172.21.15.8:0/3501459295 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630b4998ab0 con 0x5630b4a97560 2024-03-16T21:06:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.917+0000 7f81b3e00640 1 --2- 172.21.15.8:0/3501459295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4a97940 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f81a401b800 tx=0x7f81a400bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c40eacb92ea3f212 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.918+0000 7f81ab400640 1 -- 172.21.15.8:0/3501459295 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4016070 con 0x5630b4a97560 2024-03-16T21:06:01.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.918+0000 7f81ab400640 1 -- 172.21.15.8:0/3501459295 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f81a4017040 con 0x5630b4a97560 2024-03-16T21:06:01.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.918+0000 7f81ab400640 1 -- 172.21.15.8:0/3501459295 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4011a90 con 0x5630b4a97560 2024-03-16T21:06:01.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.918+0000 7f81c4a3b740 1 -- 172.21.15.8:0/3501459295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 msgr2=0x5630b4a97940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.918+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/3501459295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4a97940 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f81a401b800 tx=0x7f81a400bd20 comp rx=0 tx=0).stop 2024-03-16T21:06:01.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.918+0000 7f81c4a3b740 1 -- 172.21.15.8:0/3501459295 shutdown_connections 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.918+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/3501459295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4aa0140 0x5630b4aab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.918+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/3501459295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4a97940 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.918+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/3501459295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4a96c40 0x5630b4a9f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.918+0000 7f81c4a3b740 1 -- 172.21.15.8:0/3501459295 >> 172.21.15.8:0/3501459295 conn(0x5630b4a91370 msgr2=0x5630b4a91750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.918+0000 7f81c4a3b740 1 -- 172.21.15.8:0/3501459295 shutdown_connections 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.919+0000 7f81c4a3b740 1 -- 172.21.15.8:0/3501459295 wait complete. 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.919+0000 7f81c4a3b740 1 -- start start 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.919+0000 7f81c4a3b740 1 Processor -- start 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.919+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 0x5630b4aa79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.919+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4aa7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.919+0000 7f81c4a3b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 0x5630b4aa3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b4aa4630 con 0x5630b4aa0140 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b4aa47a0 con 0x5630b4a96c40 2024-03-16T21:06:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81c4a3b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b4aa4960 con 0x5630b4a97560 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81c4a3b740 10 client.0 _ll_register_callbacks cb 0x7f81a400be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81bb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 0x5630b4aa79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 0x5630b4aa3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4aa7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 0x5630b4aa3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48350/0 (socket says 172.21.15.8:48350) 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81bb400640 1 -- 172.21.15.8:0/2566706129 learned_addr learned my addr 172.21.15.8:0/2566706129 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4aa7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38862/0 (socket says 172.21.15.8:38862) 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81b3e00640 1 -- 172.21.15.8:0/2566706129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 msgr2=0x5630b4aa79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81b3e00640 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 0x5630b4aa79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81b3e00640 1 -- 172.21.15.8:0/2566706129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 msgr2=0x5630b4aa3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81b3e00640 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 0x5630b4aa3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81b3e00640 1 -- 172.21.15.8:0/2566706129 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630b49fc5a0 con 0x5630b4a97560 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.920+0000 7f81bb400640 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 0x5630b4aa3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:01.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.921+0000 7f81b3e00640 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4aa7f20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f81a4000c00 tx=0x7f81a400bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9b0c01c7f69df95 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:01.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.921+0000 7f81a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:06:01.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.921+0000 7f81a8c00640 1 -- 172.21.15.8:0/2566706129 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4016070 con 0x5630b4a97560 2024-03-16T21:06:01.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.921+0000 7f81a8c00640 1 -- 172.21.15.8:0/2566706129 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f81a4029070 con 0x5630b4a97560 2024-03-16T21:06:01.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.921+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2566706129 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630b46fd7e0 con 0x5630b4a97560 2024-03-16T21:06:01.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.921+0000 7f81a8c00640 1 -- 172.21.15.8:0/2566706129 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81a4033070 con 0x5630b4a97560 2024-03-16T21:06:01.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.922+0000 7f81c4a3b740 10 client.27412 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:01.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.922+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2566706129 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5630b49be650 con 0x5630b4a97560 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.922+0000 7f81a8c00640 1 -- 172.21.15.8:0/2566706129 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5630b46fd7e0 con 0x5630b4a97560 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.922+0000 7f81a8c00640 1 -- 172.21.15.8:0/2566706129 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f81a4024780 con 0x5630b4a97560 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.922+0000 7f81c4a3b740 10 client.27412 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.922+0000 7f81c4a3b740 10 client.27412 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.922+0000 7f81c4a3b740 20 client.27412 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.922+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5630b4b0cab0 0x5630b4b0eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.922+0000 7f81c4a3b740 4 client.27412 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.922+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2566706129 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5630b46ec4e0 con 0x5630b4b0cab0 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.922+0000 7f81bb400640 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5630b4b0cab0 0x5630b4b0eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81bb400640 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5630b4b0cab0 0x5630b4b0eed0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9107def0f3912d1 server_cookie=1a6135ac5e912613 in_seq=0 out_seq=0 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81a8c00640 10 client.27412 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81a8c00640 1 -- 172.21.15.8:0/2566706129 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5630b46ec4e0 con 0x5630b4b0cab0 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81a8c00640 10 client.27412 handle_command_reply: tid=0 2024-03-16T21:06:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81c4a3b740 1 client.27412 shutdown 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2566706129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 msgr2=0x5630b4aa7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4aa7f20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f81a4000c00 tx=0x7f81a400bd90 comp rx=0 tx=0).stop 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2566706129 shutdown_connections 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5630b4b0cab0 0x5630b4b0eed0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630b4aa0140 0x5630b4aa3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630b4a97560 0x5630b4aa7f20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81a8c00640 0 client.27412 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81c4a3b740 1 --2- 172.21.15.8:0/2566706129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5630b4a96c40 0x5630b4aa79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2566706129 >> 172.21.15.8:0/2566706129 conn(0x5630b4a91370 msgr2=0x5630b4a8fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2566706129 shutdown_connections 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.923+0000 7f81c4a3b740 1 -- 172.21.15.8:0/2566706129 wait complete. 2024-03-16T21:06:01.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c4a3b740 20 client.27412 trim_cache size 0 max 16384 2024-03-16T21:06:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:06:01.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 -- 172.21.15.8:0/4125127092 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81a00a1c20 msgr2=0x7f81a00a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81a00a1c20 0x7f81a00a40e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5630b4a96710 tx=0x7f81ac0f36a0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 -- 172.21.15.8:0/4125127092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81bc107a90 msgr2=0x7f81bc19e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81bc107a90 0x7f81bc19e200 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f81ac02c180 tx=0x7f81ac02c690 comp rx=0 tx=0).stop 2024-03-16T21:06:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 -- 172.21.15.8:0/4125127092 shutdown_connections 2024-03-16T21:06:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f81a00a1c20 0x7f81a00a40e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81bc10daa0 0x7f81bc1a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81bc108450 0x7f81bc19e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 --2- 172.21.15.8:0/4125127092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81bc107a90 0x7f81bc19e200 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 -- 172.21.15.8:0/4125127092 >> 172.21.15.8:0/4125127092 conn(0x7f81bc075a30 msgr2=0x7f81bc075f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 -- 172.21.15.8:0/4125127092 shutdown_connections 2024-03-16T21:06:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:01.924+0000 7f81c1e00640 1 -- 172.21.15.8:0/4125127092 wait complete. 2024-03-16T21:06:02.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:02 smithi170 ceph-mon[35947]: pgmap v251: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-03-16T21:06:02.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:02 smithi186 ceph-mon[36391]: pgmap v251: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-03-16T21:06:02.950 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:06:02.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:06:02.950 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:06:02.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:02 smithi008 ceph-mon[31434]: pgmap v251: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-03-16T21:06:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.188+0000 7f095be00640 1 -- 172.21.15.8:0/451825551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0954104040 msgr2=0x7f0954110550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.188+0000 7f095be00640 1 --2- 172.21.15.8:0/451825551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0954104040 0x7f0954110550 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f094c009cd0 tx=0x7f094c02c0f0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.188+0000 7f095be00640 1 -- 172.21.15.8:0/451825551 shutdown_connections 2024-03-16T21:06:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.188+0000 7f095be00640 1 --2- 172.21.15.8:0/451825551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0954104040 0x7f0954110550 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.188+0000 7f095be00640 1 --2- 172.21.15.8:0/451825551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0954103680 0x7f0954103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.188+0000 7f095be00640 1 --2- 172.21.15.8:0/451825551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0954109690 0x7f0954109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.188+0000 7f095be00640 1 -- 172.21.15.8:0/451825551 >> 172.21.15.8:0/451825551 conn(0x7f09540ff170 msgr2=0x7f0954101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.188+0000 7f095be00640 1 -- 172.21.15.8:0/451825551 shutdown_connections 2024-03-16T21:06:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.188+0000 7f095be00640 1 -- 172.21.15.8:0/451825551 wait complete. 2024-03-16T21:06:03.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.189+0000 7f095be00640 1 Processor -- start 2024-03-16T21:06:03.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.189+0000 7f095be00640 1 -- start start 2024-03-16T21:06:03.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f095be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0954103680 0x7f0954199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f095be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0954104040 0x7f095419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f095be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0954109690 0x7f095419e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f095be00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095419ec50 con 0x7f0954109690 2024-03-16T21:06:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f095be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095419edc0 con 0x7f0954103680 2024-03-16T21:06:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f095be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095419ef80 con 0x7f0954104040 2024-03-16T21:06:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f0959400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0954103680 0x7f0954199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f0958a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0954104040 0x7f095419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f0959400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0954103680 0x7f0954199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45604/0 (socket says 172.21.15.8:45604) 2024-03-16T21:06:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f0959400640 1 -- 172.21.15.8:0/3281554252 learned_addr learned my addr 172.21.15.8:0/3281554252 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f0959e00640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0954109690 0x7f095419e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.190+0000 7f0959400640 1 -- 172.21.15.8:0/3281554252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0954104040 msgr2=0x7f095419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.191+0000 7f0959400640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0954104040 0x7f095419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.191+0000 7f0959400640 1 -- 172.21.15.8:0/3281554252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0954109690 msgr2=0x7f095419e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.191+0000 7f0959400640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0954109690 0x7f095419e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.191+0000 7f0959400640 1 -- 172.21.15.8:0/3281554252 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0940009490 con 0x7f0954103680 2024-03-16T21:06:03.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.191+0000 7f0958a00640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0954104040 0x7f095419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:03.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.191+0000 7f0959400640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0954103680 0x7f0954199de0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f094800e9f0 tx=0x7f094800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.191+0000 7f0952000640 1 -- 172.21.15.8:0/3281554252 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948009700 con 0x7f0954103680 2024-03-16T21:06:03.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.191+0000 7f0952000640 1 -- 172.21.15.8:0/3281554252 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f094800cd80 con 0x7f0954103680 2024-03-16T21:06:03.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.191+0000 7f0952000640 1 -- 172.21.15.8:0/3281554252 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09480189c0 con 0x7f0954103680 2024-03-16T21:06:03.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.191+0000 7f095be00640 1 -- 172.21.15.8:0/3281554252 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c009900 con 0x7f0954103680 2024-03-16T21:06:03.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.191+0000 7f095be00640 1 -- 172.21.15.8:0/3281554252 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09541a6900 con 0x7f0954103680 2024-03-16T21:06:03.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.194+0000 7f0952000640 1 -- 172.21.15.8:0/3281554252 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f0948018b20 con 0x7f0954103680 2024-03-16T21:06:03.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.194+0000 7f095e9f3740 1 Processor -- start 2024-03-16T21:06:03.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f095e9f3740 1 -- start start 2024-03-16T21:06:03.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b5c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b64f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b65440 0x55ee42b67830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f095e9f3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee42b17300 con 0x55ee42b5c860 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f095e9f3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee42ac9e50 con 0x55ee42b65440 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f095e9f3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee42ac7380 con 0x55ee42b5bf40 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f0959e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b5c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f0959e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b5c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38900/0 (socket says 172.21.15.8:38900) 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f0959e00640 1 -- 172.21.15.8:0/2282057056 learned_addr learned my addr 172.21.15.8:0/2282057056 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f0959400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b64f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.195+0000 7f0958a00640 1 --2- 172.21.15.8:0/2282057056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b65440 0x55ee42b67830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0959e00640 1 -- 172.21.15.8:0/2282057056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b65440 msgr2=0x55ee42b67830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0959e00640 1 --2- 172.21.15.8:0/2282057056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b65440 0x55ee42b67830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0959e00640 1 -- 172.21.15.8:0/2282057056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 msgr2=0x55ee42b64f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0959e00640 1 --2- 172.21.15.8:0/2282057056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b64f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0959e00640 1 -- 172.21.15.8:0/2282057056 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee42a8bc80 con 0x55ee42b5bf40 2024-03-16T21:06:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0959e00640 1 --2- 172.21.15.8:0/2282057056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b5c320 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f094c004af0 tx=0x7f094c005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9fce3ec0bbe61c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0952000640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f093c0a1c20 0x7f093c0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0946600640 1 -- 172.21.15.8:0/2282057056 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c032540 con 0x55ee42b5bf40 2024-03-16T21:06:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0946600640 1 -- 172.21.15.8:0/2282057056 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f094c034ab0 con 0x55ee42b5bf40 2024-03-16T21:06:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0946600640 1 -- 172.21.15.8:0/2282057056 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c003b70 con 0x55ee42b5bf40 2024-03-16T21:06:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0952000640 1 -- 172.21.15.8:0/3281554252 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0948014070 con 0x7f0954103680 2024-03-16T21:06:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.196+0000 7f0959400640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f093c0a1c20 0x7f093c0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.197+0000 7f095e9f3740 1 -- 172.21.15.8:0/2282057056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 msgr2=0x55ee42b5c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.197+0000 7f095e9f3740 1 --2- 172.21.15.8:0/2282057056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b5c320 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f094c004af0 tx=0x7f094c005f80 comp rx=0 tx=0).stop 2024-03-16T21:06:03.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.197+0000 7f0959400640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f093c0a1c20 0x7f093c0a40e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f09480cb220 tx=0x7f09480d3550 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.197+0000 7f095e9f3740 1 -- 172.21.15.8:0/2282057056 shutdown_connections 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.197+0000 7f095e9f3740 1 --2- 172.21.15.8:0/2282057056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b65440 0x55ee42b67830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.197+0000 7f095e9f3740 1 --2- 172.21.15.8:0/2282057056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b64f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.197+0000 7f095e9f3740 1 --2- 172.21.15.8:0/2282057056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b5c320 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.197+0000 7f095e9f3740 1 -- 172.21.15.8:0/2282057056 >> 172.21.15.8:0/2282057056 conn(0x55ee42b56670 msgr2=0x55ee42b56a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.197+0000 7f095e9f3740 1 -- 172.21.15.8:0/2282057056 shutdown_connections 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.197+0000 7f095e9f3740 1 -- 172.21.15.8:0/2282057056 wait complete. 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.198+0000 7f095e9f3740 1 -- start start 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.198+0000 7f095e9f3740 1 Processor -- start 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.198+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b623b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.198+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.198+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b65440 0x55ee42b62e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.198+0000 7f095e9f3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee42ac2b60 con 0x55ee42b5c860 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.198+0000 7f095e9f3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee42a67fd0 con 0x55ee42b5bf40 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.198+0000 7f095e9f3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee42a67c70 con 0x55ee42b65440 2024-03-16T21:06:03.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f095e9f3740 10 client.0 _ll_register_callbacks cb 0x55ee427d3c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0959e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0959e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b623b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45632/0 (socket says 172.21.15.8:45632) 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0959e00640 1 -- 172.21.15.8:0/1716941133 learned_addr learned my addr 172.21.15.8:0/1716941133 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0958a00640 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0959e00640 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b65440 0x55ee42b62e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0959e00640 1 -- 172.21.15.8:0/1716941133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b65440 msgr2=0x55ee42b62e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0959e00640 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b65440 0x55ee42b62e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0959e00640 1 -- 172.21.15.8:0/1716941133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 msgr2=0x55ee42b628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0959e00640 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b628f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0959e00640 1 -- 172.21.15.8:0/1716941133 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0954110e50 con 0x55ee42b5bf40 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0958a00640 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f0959e00640 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b623b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f094c02c130 tx=0x7f094c032a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d4ea7deb8a4032d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.199+0000 7f093aa00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:03.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f093aa00640 1 -- 172.21.15.8:0/1716941133 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c034ea0 con 0x55ee42b5bf40 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f093aa00640 1 -- 172.21.15.8:0/1716941133 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f094c003e20 con 0x55ee42b5bf40 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f095e9f3740 1 -- 172.21.15.8:0/1716941133 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee427c2860 con 0x55ee42b5bf40 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f093aa00640 1 -- 172.21.15.8:0/1716941133 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f094c032550 con 0x55ee42b5bf40 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f095e9f3740 10 client.27416 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f095e9f3740 1 -- 172.21.15.8:0/1716941133 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ee42ac11e0 con 0x55ee42b5bf40 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f093aa00640 1 -- 172.21.15.8:0/1716941133 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55ee427c2860 con 0x55ee42b5bf40 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f093aa00640 1 -- 172.21.15.8:0/1716941133 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f094c04a450 con 0x55ee42b5bf40 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f095e9f3740 10 client.27416 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f095e9f3740 10 client.27416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f095e9f3740 20 client.27416 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.200+0000 7f095e9f3740 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ee42b75310 0x55ee42b77700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.201+0000 7f095e9f3740 4 client.27416 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.201+0000 7f095e9f3740 1 -- 172.21.15.8:0/1716941133 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee42813410 con 0x55ee42b75310 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.201+0000 7f0958a00640 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ee42b75310 0x55ee42b77700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.201+0000 7f0958a00640 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ee42b75310 0x55ee42b77700 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1b882dfca51383d server_cookie=7f107e7d2b80935c in_seq=0 out_seq=0 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.201+0000 7f093aa00640 10 client.27416 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.202+0000 7f093aa00640 1 -- 172.21.15.8:0/1716941133 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ee42813410 con 0x55ee42b75310 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f093aa00640 10 client.27416 handle_command_reply: tid=0 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 1 client.27416 shutdown 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 1 -- 172.21.15.8:0/1716941133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 msgr2=0x55ee42b623b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b623b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f094c02c130 tx=0x7f094c032a10 comp rx=0 tx=0).stop 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 1 -- 172.21.15.8:0/1716941133 shutdown_connections 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b65440 0x55ee42b62e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ee42b75310 0x55ee42b77700 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 1 --2- 172.21.15.8:0/1716941133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b623b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f093aa00640 0 client.27416 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 1 -- 172.21.15.8:0/1716941133 >> 172.21.15.8:0/1716941133 conn(0x55ee42b56670 msgr2=0x55ee42b583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 1 -- 172.21.15.8:0/1716941133 shutdown_connections 2024-03-16T21:06:03.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 1 -- 172.21.15.8:0/1716941133 wait complete. 2024-03-16T21:06:03.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.203+0000 7f095e9f3740 20 client.27416 trim_cache size 0 max 16384 2024-03-16T21:06:03.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.221+0000 7f095e9f3740 1 Processor -- start 2024-03-16T21:06:03.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.221+0000 7f095e9f3740 1 -- start start 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.221+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b64ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.221+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b58160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.221+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b65440 0x55ee42b70790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.221+0000 7f095e9f3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4280b0c0 con 0x55ee42b5c860 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.221+0000 7f095e9f3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee42b77d30 con 0x55ee42b5bf40 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.221+0000 7f095e9f3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee42b57670 con 0x55ee42b65440 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.222+0000 7f0959e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b64ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.222+0000 7f0959e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b64ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45644/0 (socket says 172.21.15.8:45644) 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.222+0000 7f0958a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b58160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.222+0000 7f0959e00640 1 -- 172.21.15.8:0/1028987737 learned_addr learned my addr 172.21.15.8:0/1028987737 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.222+0000 7f0959e00640 1 --2- 172.21.15.8:0/1028987737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b65440 0x55ee42b70790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.222+0000 7f0958a00640 1 -- 172.21.15.8:0/1028987737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b65440 msgr2=0x55ee42b70790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.222+0000 7f0958a00640 1 --2- 172.21.15.8:0/1028987737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b65440 0x55ee42b70790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.222+0000 7f0958a00640 1 -- 172.21.15.8:0/1028987737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 msgr2=0x55ee42b64ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.222+0000 7f0958a00640 1 --2- 172.21.15.8:0/1028987737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b64ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.222+0000 7f0958a00640 1 -- 172.21.15.8:0/1028987737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee42a5da90 con 0x55ee42b5c860 2024-03-16T21:06:03.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.222+0000 7f0959e00640 1 --2- 172.21.15.8:0/1028987737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b64ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:03.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.223+0000 7f0958a00640 1 --2- 172.21.15.8:0/1028987737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b58160 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55ee42b77ed0 tx=0x7f0940005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fde4b2776b95f72 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.223+0000 7f0945c00640 1 -- 172.21.15.8:0/1028987737 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940017040 con 0x55ee42b5c860 2024-03-16T21:06:03.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.223+0000 7f0945c00640 1 -- 172.21.15.8:0/1028987737 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0940018040 con 0x55ee42b5c860 2024-03-16T21:06:03.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.223+0000 7f0945c00640 1 -- 172.21.15.8:0/1028987737 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400047a0 con 0x55ee42b5c860 2024-03-16T21:06:03.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.223+0000 7f095e9f3740 1 -- 172.21.15.8:0/1028987737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 msgr2=0x55ee42b58160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.223+0000 7f095e9f3740 1 --2- 172.21.15.8:0/1028987737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b58160 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55ee42b77ed0 tx=0x7f0940005f90 comp rx=0 tx=0).stop 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.224+0000 7f095e9f3740 1 -- 172.21.15.8:0/1028987737 shutdown_connections 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.224+0000 7f095e9f3740 1 --2- 172.21.15.8:0/1028987737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b65440 0x55ee42b70790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.224+0000 7f095e9f3740 1 --2- 172.21.15.8:0/1028987737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b5c860 0x55ee42b58160 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.224+0000 7f095e9f3740 1 --2- 172.21.15.8:0/1028987737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5bf40 0x55ee42b64ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.224+0000 7f095e9f3740 1 -- 172.21.15.8:0/1028987737 >> 172.21.15.8:0/1028987737 conn(0x55ee42b56670 msgr2=0x55ee42b57a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.224+0000 7f095e9f3740 1 -- 172.21.15.8:0/1028987737 shutdown_connections 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.224+0000 7f095e9f3740 1 -- 172.21.15.8:0/1028987737 wait complete. 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.224+0000 7f095e9f3740 1 -- start start 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.224+0000 7f095e9f3740 1 Processor -- start 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b6ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b65440 0x55ee42b5f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f095e9f3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5f9a0 0x55ee42b5fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f095e9f3740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee42b6d4d0 con 0x55ee42b65440 2024-03-16T21:06:03.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f095e9f3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee42bd0b30 con 0x55ee42b5f9a0 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f095e9f3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee42bd0c70 con 0x55ee42b5bf40 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f095e9f3740 10 client.0 _ll_register_callbacks cb 0x7f09480d3420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0959e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b6ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0958a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b65440 0x55ee42b5f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0959e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b6ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38914/0 (socket says 172.21.15.8:38914) 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0958a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b65440 0x55ee42b5f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48396/0 (socket says 172.21.15.8:48396) 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0959e00640 1 -- 172.21.15.8:0/2183971938 learned_addr learned my addr 172.21.15.8:0/2183971938 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0959e00640 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5f9a0 0x55ee42b5fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0958a00640 1 -- 172.21.15.8:0/2183971938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 msgr2=0x55ee42b6ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0958a00640 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b6ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0958a00640 1 -- 172.21.15.8:0/2183971938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5f9a0 msgr2=0x55ee42b5fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0958a00640 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5f9a0 0x55ee42b5fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0958a00640 1 -- 172.21.15.8:0/2183971938 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee42ac11e0 con 0x55ee42b65440 2024-03-16T21:06:03.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.225+0000 7f0959e00640 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b6ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.226+0000 7f0958a00640 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b65440 0x55ee42b5f460 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55ee42b71c30 tx=0x7f09400222f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb31825292034443 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.226+0000 7f093aa00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.226+0000 7f093aa00640 1 -- 172.21.15.8:0/2183971938 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094002f070 con 0x55ee42b65440 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.226+0000 7f093aa00640 1 -- 172.21.15.8:0/2183971938 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0940012150 con 0x55ee42b65440 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.226+0000 7f095e9f3740 1 -- 172.21.15.8:0/2183971938 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f094c034ab0 con 0x55ee42b65440 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.226+0000 7f093aa00640 1 -- 172.21.15.8:0/2183971938 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0940017070 con 0x55ee42b65440 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.226+0000 7f095e9f3740 10 client.17241 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.226+0000 7f095e9f3740 1 -- 172.21.15.8:0/2183971938 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f0940012c00 con 0x55ee42b65440 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.227+0000 7f093aa00640 1 -- 172.21.15.8:0/2183971938 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f094c034ab0 con 0x55ee42b65440 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.227+0000 7f093aa00640 1 -- 172.21.15.8:0/2183971938 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f09400039c0 con 0x55ee42b65440 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.227+0000 7f095e9f3740 10 client.17241 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.227+0000 7f095e9f3740 10 client.17241 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.227+0000 7f095e9f3740 20 client.17241 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.227+0000 7f095e9f3740 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ee42bd22c0 0x55ee42bd46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.227+0000 7f095e9f3740 4 client.17241 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:06:03.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.227+0000 7f095e9f3740 1 -- 172.21.15.8:0/2183971938 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ee427ff7b0 con 0x55ee42bd22c0 2024-03-16T21:06:03.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.227+0000 7f0959e00640 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ee42bd22c0 0x55ee42bd46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.228+0000 7f0959e00640 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ee42bd22c0 0x55ee42bd46e0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11293fb111844f6b server_cookie=d77bee8434e42d53 in_seq=0 out_seq=0 2024-03-16T21:06:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.228+0000 7f093aa00640 10 client.17241 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f093aa00640 1 -- 172.21.15.8:0/2183971938 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ee427ff7b0 con 0x55ee42bd22c0 2024-03-16T21:06:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f093aa00640 10 client.17241 handle_command_reply: tid=0 2024-03-16T21:06:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 1 client.17241 shutdown 2024-03-16T21:06:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 1 -- 172.21.15.8:0/2183971938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b65440 msgr2=0x55ee42b5f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b65440 0x55ee42b5f460 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55ee42b71c30 tx=0x7f09400222f0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 1 -- 172.21.15.8:0/2183971938 shutdown_connections 2024-03-16T21:06:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ee42b5f9a0 0x55ee42b5fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55ee42bd22c0 0x55ee42bd46e0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ee42b65440 0x55ee42b5f460 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 1 --2- 172.21.15.8:0/2183971938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ee42b5bf40 0x55ee42b6ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 1 -- 172.21.15.8:0/2183971938 >> 172.21.15.8:0/2183971938 conn(0x55ee42b56670 msgr2=0x55ee42b582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f093aa00640 0 client.17241 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 1 -- 172.21.15.8:0/2183971938 shutdown_connections 2024-03-16T21:06:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 1 -- 172.21.15.8:0/2183971938 wait complete. 2024-03-16T21:06:03.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.229+0000 7f095e9f3740 20 client.17241 trim_cache size 0 max 16384 2024-03-16T21:06:03.238 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:06:03.238 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:06:03.238 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "344ed7ba-0b25-44d2-a5c7-6575b8d6657d", 2024-03-16T21:06:03.238 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:06:03.239 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:06:03.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 -- 172.21.15.8:0/3281554252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f093c0a1c20 msgr2=0x7f093c0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f093c0a1c20 0x7f093c0a40e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f09480cb220 tx=0x7f09480d3550 comp rx=0 tx=0).stop 2024-03-16T21:06:03.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 -- 172.21.15.8:0/3281554252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0954103680 msgr2=0x7f0954199de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0954103680 0x7f0954199de0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f094800e9f0 tx=0x7f094800eeb0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 -- 172.21.15.8:0/3281554252 shutdown_connections 2024-03-16T21:06:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f093c0a1c20 0x7f093c0a40e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0954109690 0x7f095419e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0954104040 0x7f095419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 --2- 172.21.15.8:0/3281554252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0954103680 0x7f0954199de0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 -- 172.21.15.8:0/3281554252 >> 172.21.15.8:0/3281554252 conn(0x7f09540ff170 msgr2=0x7f09540ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 -- 172.21.15.8:0/3281554252 shutdown_connections 2024-03-16T21:06:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.230+0000 7f095be00640 1 -- 172.21.15.8:0/3281554252 wait complete. 2024-03-16T21:06:03.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:06:03.254 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:06:03.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.526+0000 7f0deca00640 1 -- 172.21.15.8:0/368608692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0de810db90 msgr2=0x7f0de810ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.526+0000 7f0deca00640 1 --2- 172.21.15.8:0/368608692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0de810db90 0x7f0de810ffe0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009ca0 tx=0x7f0de002c180 comp rx=0 tx=0).stop 2024-03-16T21:06:03.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.526+0000 7f0deca00640 1 -- 172.21.15.8:0/368608692 shutdown_connections 2024-03-16T21:06:03.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.526+0000 7f0deca00640 1 --2- 172.21.15.8:0/368608692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0de810db90 0x7f0de810ffe0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.526+0000 7f0deca00640 1 --2- 172.21.15.8:0/368608692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0de8074240 0x7f0de810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.526+0000 7f0deca00640 1 --2- 172.21.15.8:0/368608692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0de8073920 0x7f0de8073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.526+0000 7f0deca00640 1 -- 172.21.15.8:0/368608692 >> 172.21.15.8:0/368608692 conn(0x7f0de80fce60 msgr2=0x7f0de80ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.527+0000 7f0deca00640 1 -- 172.21.15.8:0/368608692 shutdown_connections 2024-03-16T21:06:03.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.527+0000 7f0deca00640 1 -- 172.21.15.8:0/368608692 wait complete. 2024-03-16T21:06:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.527+0000 7f0deca00640 1 Processor -- start 2024-03-16T21:06:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.528+0000 7f0deca00640 1 -- start start 2024-03-16T21:06:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.528+0000 7f0deca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0de8073920 0x7f0de819f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.528+0000 7f0deca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0de8074240 0x7f0de819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.528+0000 7f0deca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0de810db90 0x7f0de8199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.528+0000 7f0deca00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de819a080 con 0x7f0de8073920 2024-03-16T21:06:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.528+0000 7f0deca00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de819a1f0 con 0x7f0de810db90 2024-03-16T21:06:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.528+0000 7f0deca00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de819a3b0 con 0x7f0de8074240 2024-03-16T21:06:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.528+0000 7f0de6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0de8074240 0x7f0de819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.528+0000 7f0de6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0de8074240 0x7f0de819fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38926/0 (socket says 172.21.15.8:38926) 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.528+0000 7f0de6a00640 1 -- 172.21.15.8:0/3660435614 learned_addr learned my addr 172.21.15.8:0/3660435614 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.528+0000 7f0de7e00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0de810db90 0x7f0de8199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0de7400640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0de8073920 0x7f0de819f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0de6a00640 1 -- 172.21.15.8:0/3660435614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0de810db90 msgr2=0x7f0de8199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0de6a00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0de810db90 0x7f0de8199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0de6a00640 1 -- 172.21.15.8:0/3660435614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0de8073920 msgr2=0x7f0de819f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0de6a00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0de8073920 0x7f0de819f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0de6a00640 1 -- 172.21.15.8:0/3660435614 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de0009900 con 0x7f0de8074240 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0de7400640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0de8073920 0x7f0de819f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0de6a00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0de8074240 0x7f0de819fdc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000e9f0 tx=0x7f0dd000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0ddfe00640 1 -- 172.21.15.8:0/3660435614 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0009700 con 0x7f0de8074240 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0ddfe00640 1 -- 172.21.15.8:0/3660435614 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0dd000cd80 con 0x7f0de8074240 2024-03-16T21:06:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0ddfe00640 1 -- 172.21.15.8:0/3660435614 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd00189c0 con 0x7f0de8074240 2024-03-16T21:06:03.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0deca00640 1 -- 172.21.15.8:0/3660435614 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de819a690 con 0x7f0de8074240 2024-03-16T21:06:03.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.529+0000 7f0deca00640 1 -- 172.21.15.8:0/3660435614 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de81a6920 con 0x7f0de8074240 2024-03-16T21:06:03.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.532+0000 7f0df0d74740 1 Processor -- start 2024-03-16T21:06:03.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0ddfe00640 1 -- 172.21.15.8:0/3660435614 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f0dd0018b20 con 0x7f0de8074240 2024-03-16T21:06:03.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0df0d74740 1 -- start start 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 0x55c9e185bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e185c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e1865800 0x55c9e1867bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0df0d74740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e17cb150 con 0x55c9e185d170 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0df0d74740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e17c8680 con 0x55c9e1865800 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0df0d74740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e17c3e60 con 0x55c9e185c490 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0de6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e1865800 0x55c9e1867bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0de7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e185c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0de7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e185c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38934/0 (socket says 172.21.15.8:38934) 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0de6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e1865800 0x55c9e1867bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45676/0 (socket says 172.21.15.8:45676) 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0de6a00640 1 -- 172.21.15.8:0/3641618261 learned_addr learned my addr 172.21.15.8:0/3641618261 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:03.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.533+0000 7f0de7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 0x55c9e185bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.534+0000 7f0de6a00640 1 -- 172.21.15.8:0/3641618261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 msgr2=0x55c9e185c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.534+0000 7f0de6a00640 1 --2- 172.21.15.8:0/3641618261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e185c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.534+0000 7f0de6a00640 1 -- 172.21.15.8:0/3641618261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 msgr2=0x55c9e185bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.534+0000 7f0de6a00640 1 --2- 172.21.15.8:0/3641618261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 0x55c9e185bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.534+0000 7f0de6a00640 1 -- 172.21.15.8:0/3641618261 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9e177d060 con 0x55c9e1865800 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.534+0000 7f0de7400640 1 --2- 172.21.15.8:0/3641618261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e185c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.534+0000 7f0de6a00640 1 --2- 172.21.15.8:0/3641618261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e1865800 0x55c9e1867bf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00cb180 tx=0x7f0dd00d3ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd8496a84181e1e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.534+0000 7f0ddfe00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0dcc0a1c20 0x7f0dcc0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.535+0000 7f0dd7e00640 1 -- 172.21.15.8:0/3641618261 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd00969c0 con 0x55c9e1865800 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.535+0000 7f0de7e00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0dcc0a1c20 0x7f0dcc0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.535+0000 7f0ddfe00640 1 -- 172.21.15.8:0/3660435614 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0dd0014070 con 0x7f0de8074240 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.535+0000 7f0dd7e00640 1 -- 172.21.15.8:0/3641618261 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0dd00d36d0 con 0x55c9e1865800 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.535+0000 7f0dd7e00640 1 -- 172.21.15.8:0/3641618261 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd005bf10 con 0x55c9e1865800 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.535+0000 7f0df0d74740 1 -- 172.21.15.8:0/3641618261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e1865800 msgr2=0x55c9e1867bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.535+0000 7f0df0d74740 1 --2- 172.21.15.8:0/3641618261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e1865800 0x55c9e1867bf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00cb180 tx=0x7f0dd00d3ef0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.535+0000 7f0de7e00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0dcc0a1c20 0x7f0dcc0a40e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0de0005e30 tx=0x7f0de0005d80 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.536+0000 7f0df0d74740 1 -- 172.21.15.8:0/3641618261 shutdown_connections 2024-03-16T21:06:03.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.536+0000 7f0df0d74740 1 --2- 172.21.15.8:0/3641618261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e1865800 0x55c9e1867bf0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.536+0000 7f0df0d74740 1 --2- 172.21.15.8:0/3641618261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e185c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.536+0000 7f0df0d74740 1 --2- 172.21.15.8:0/3641618261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 0x55c9e185bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.536+0000 7f0df0d74740 1 -- 172.21.15.8:0/3641618261 >> 172.21.15.8:0/3641618261 conn(0x55c9e18235a0 msgr2=0x55c9e1856ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.536+0000 7f0df0d74740 1 -- 172.21.15.8:0/3641618261 shutdown_connections 2024-03-16T21:06:03.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.536+0000 7f0df0d74740 1 -- 172.21.15.8:0/3641618261 wait complete. 2024-03-16T21:06:03.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.536+0000 7f0df0d74740 1 -- start start 2024-03-16T21:06:03.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.536+0000 7f0df0d74740 1 Processor -- start 2024-03-16T21:06:03.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1862790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185d170 0x55c9e1862cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e1865800 0x55c9e1863210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0df0d74740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e1768ec0 con 0x55c9e1865800 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0df0d74740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e1768b60 con 0x55c9e185c490 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0df0d74740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e15321c0 con 0x55c9e185d170 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0df0d74740 10 client.0 _ll_register_callbacks cb 0x55c9e177c960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0de7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1862790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0de7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e1865800 0x55c9e1863210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0de6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185d170 0x55c9e1862cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0de7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1862790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45692/0 (socket says 172.21.15.8:45692) 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.537+0000 7f0de7400640 1 -- 172.21.15.8:0/172103156 learned_addr learned my addr 172.21.15.8:0/172103156 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.538+0000 7f0de7400640 1 -- 172.21.15.8:0/172103156 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185d170 msgr2=0x55c9e1862cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.538+0000 7f0de7400640 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185d170 0x55c9e1862cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.538+0000 7f0de7400640 1 -- 172.21.15.8:0/172103156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e1865800 msgr2=0x55c9e1863210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.538+0000 7f0de7400640 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e1865800 0x55c9e1863210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.538+0000 7f0de7400640 1 -- 172.21.15.8:0/172103156 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de81a6920 con 0x55c9e185c490 2024-03-16T21:06:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.538+0000 7f0de6a00640 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185d170 0x55c9e1862cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.538+0000 7f0de7400640 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1862790 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80136e0 tx=0x7f0dd8013ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4475206bb973ae64 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.538+0000 7f0dd4c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.538+0000 7f0dd4c00640 1 -- 172.21.15.8:0/172103156 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8011dd0 con 0x55c9e185c490 2024-03-16T21:06:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.538+0000 7f0dd4c00640 1 -- 172.21.15.8:0/172103156 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0dd8004030 con 0x55c9e185c490 2024-03-16T21:06:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.538+0000 7f0df0d74740 1 -- 172.21.15.8:0/172103156 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9e1500720 con 0x55c9e185c490 2024-03-16T21:06:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0dd4c00640 1 -- 172.21.15.8:0/172103156 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dd8004230 con 0x55c9e185c490 2024-03-16T21:06:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0df0d74740 10 client.27434 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0df0d74740 1 -- 172.21.15.8:0/172103156 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c9e17c24e0 con 0x55c9e185c490 2024-03-16T21:06:03.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0dd4c00640 1 -- 172.21.15.8:0/172103156 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55c9e1500720 con 0x55c9e185c490 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0dd4c00640 1 -- 172.21.15.8:0/172103156 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0dd801c5a0 con 0x55c9e185c490 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0df0d74740 10 client.27434 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0df0d74740 10 client.27434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0df0d74740 20 client.27434 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0df0d74740 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9e1875980 0x55c9e1877da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0df0d74740 4 client.27434 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0df0d74740 1 -- 172.21.15.8:0/172103156 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c9e154f890 con 0x55c9e1875980 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.539+0000 7f0de6a00640 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9e1875980 0x55c9e1877da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.540+0000 7f0de6a00640 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9e1875980 0x55c9e1877da0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=625f0aa591ed717d server_cookie=236e3d9fa767163f in_seq=0 out_seq=0 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.540+0000 7f0dd4c00640 10 client.27434 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.540+0000 7f0dd4c00640 1 -- 172.21.15.8:0/172103156 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55c9e154f890 con 0x55c9e1875980 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.540+0000 7f0dd4c00640 10 client.27434 handle_command_reply: tid=0 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 1 client.27434 shutdown 2024-03-16T21:06:03.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 1 -- 172.21.15.8:0/172103156 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 msgr2=0x55c9e1862790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1862790 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80136e0 tx=0x7f0dd8013ba0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 1 -- 172.21.15.8:0/172103156 shutdown_connections 2024-03-16T21:06:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9e1875980 0x55c9e1877da0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e1865800 0x55c9e1863210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185d170 0x55c9e1862cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 1 --2- 172.21.15.8:0/172103156 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1862790 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 1 -- 172.21.15.8:0/172103156 >> 172.21.15.8:0/172103156 conn(0x55c9e18235a0 msgr2=0x55c9e1858c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0dd4c00640 0 client.27434 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 1 -- 172.21.15.8:0/172103156 shutdown_connections 2024-03-16T21:06:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 1 -- 172.21.15.8:0/172103156 wait complete. 2024-03-16T21:06:03.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.541+0000 7f0df0d74740 20 client.27434 trim_cache size 0 max 16384 2024-03-16T21:06:03.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.559+0000 7f0df0d74740 1 Processor -- start 2024-03-16T21:06:03.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.559+0000 7f0df0d74740 1 -- start start 2024-03-16T21:06:03.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.559+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1864ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.559+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 0x55c9e1863030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.559+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e1865800 0x55c9e1855de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.559+0000 7f0df0d74740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e185b4c0 con 0x55c9e185d170 2024-03-16T21:06:03.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.559+0000 7f0df0d74740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e1878400 con 0x55c9e185c490 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.559+0000 7f0df0d74740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e1860d20 con 0x55c9e1865800 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.559+0000 7f0de6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 0x55c9e1863030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.559+0000 7f0de7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1864ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.559+0000 7f0de7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e1865800 0x55c9e1855de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.560+0000 7f0de6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 0x55c9e1863030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48426/0 (socket says 172.21.15.8:48426) 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.560+0000 7f0de6a00640 1 -- 172.21.15.8:0/132473018 learned_addr learned my addr 172.21.15.8:0/132473018 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.560+0000 7f0de7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1864ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45708/0 (socket says 172.21.15.8:45708) 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.560+0000 7f0de7400640 1 -- 172.21.15.8:0/132473018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e1865800 msgr2=0x55c9e1855de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.560+0000 7f0de7400640 1 --2- 172.21.15.8:0/132473018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e1865800 0x55c9e1855de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.560+0000 7f0de7400640 1 -- 172.21.15.8:0/132473018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 msgr2=0x55c9e1863030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.560+0000 7f0de7400640 1 --2- 172.21.15.8:0/132473018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 0x55c9e1863030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.560+0000 7f0de7400640 1 -- 172.21.15.8:0/132473018 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9e175e950 con 0x55c9e185c490 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.560+0000 7f0de6a00640 1 --2- 172.21.15.8:0/132473018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 0x55c9e1863030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:03.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.560+0000 7f0de7400640 1 --2- 172.21.15.8:0/132473018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1864ec0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0dd801c9d0 tx=0x7f0dd8009fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3c6b6ccc6fed5eb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.560+0000 7f0dd7400640 1 -- 172.21.15.8:0/132473018 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8005c50 con 0x55c9e185c490 2024-03-16T21:06:03.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.561+0000 7f0dd7400640 1 -- 172.21.15.8:0/132473018 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0dd8005610 con 0x55c9e185c490 2024-03-16T21:06:03.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.561+0000 7f0dd7400640 1 -- 172.21.15.8:0/132473018 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8003850 con 0x55c9e185c490 2024-03-16T21:06:03.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.561+0000 7f0df0d74740 1 -- 172.21.15.8:0/132473018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 msgr2=0x55c9e1864ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.561+0000 7f0df0d74740 1 --2- 172.21.15.8:0/132473018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1864ec0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0dd801c9d0 tx=0x7f0dd8009fd0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.561+0000 7f0df0d74740 1 -- 172.21.15.8:0/132473018 shutdown_connections 2024-03-16T21:06:03.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.561+0000 7f0df0d74740 1 --2- 172.21.15.8:0/132473018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e1865800 0x55c9e1855de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.561+0000 7f0df0d74740 1 --2- 172.21.15.8:0/132473018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e185d170 0x55c9e1863030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.561+0000 7f0df0d74740 1 --2- 172.21.15.8:0/132473018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185c490 0x55c9e1864ec0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.561+0000 7f0df0d74740 1 -- 172.21.15.8:0/132473018 >> 172.21.15.8:0/132473018 conn(0x55c9e18235a0 msgr2=0x55c9e18556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.561+0000 7f0df0d74740 1 -- 172.21.15.8:0/132473018 shutdown_connections 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.561+0000 7f0df0d74740 1 -- 172.21.15.8:0/132473018 wait complete. 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.562+0000 7f0df0d74740 1 -- start start 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.562+0000 7f0df0d74740 1 Processor -- start 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.562+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e1860210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.562+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185d170 0x55c9e1866800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.562+0000 7f0df0d74740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e1865800 0x55c9e1866d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.562+0000 7f0df0d74740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e1867280 con 0x55c9e1865800 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.562+0000 7f0df0d74740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e18673f0 con 0x55c9e185d170 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.562+0000 7f0df0d74740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9e18675b0 con 0x55c9e185c490 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.562+0000 7f0df0d74740 10 client.0 _ll_register_callbacks cb 0x7f0dd8009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185d170 0x55c9e1866800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e1860210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185d170 0x55c9e1866800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:45714/0 (socket says 172.21.15.8:45714) 2024-03-16T21:06:03.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de6a00640 1 -- 172.21.15.8:0/2011822366 learned_addr learned my addr 172.21.15.8:0/2011822366 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e1860210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:38950/0 (socket says 172.21.15.8:38950) 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de7e00640 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e1865800 0x55c9e1866d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de6a00640 1 -- 172.21.15.8:0/2011822366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 msgr2=0x55c9e1860210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de6a00640 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e1860210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de6a00640 1 -- 172.21.15.8:0/2011822366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e1865800 msgr2=0x55c9e1866d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de6a00640 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e1865800 0x55c9e1866d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de6a00640 1 -- 172.21.15.8:0/2011822366 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9e177d060 con 0x55c9e185d170 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de7400640 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e1860210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0de6a00640 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185d170 0x55c9e1866800 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000c6a0 tx=0x7f0dd00ba040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c21f61dbac28f38f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0dd4c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.563+0000 7f0dd4c00640 1 -- 172.21.15.8:0/2011822366 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0083ea0 con 0x55c9e185d170 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0dd4c00640 1 -- 172.21.15.8:0/2011822366 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0dd009ae20 con 0x55c9e185d170 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0df0d74740 1 -- 172.21.15.8:0/2011822366 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9e14c37e0 con 0x55c9e185d170 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0dd4c00640 1 -- 172.21.15.8:0/2011822366 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dd00969c0 con 0x55c9e185d170 2024-03-16T21:06:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0df0d74740 10 client.27440 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0df0d74740 1 -- 172.21.15.8:0/2011822366 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c9e17c24e0 con 0x55c9e185d170 2024-03-16T21:06:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0dd4c00640 1 -- 172.21.15.8:0/2011822366 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55c9e14c37e0 con 0x55c9e185d170 2024-03-16T21:06:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0dd4c00640 1 -- 172.21.15.8:0/2011822366 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0dd00cb4c0 con 0x55c9e185d170 2024-03-16T21:06:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0df0d74740 10 client.27440 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0df0d74740 10 client.27440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0df0d74740 20 client.27440 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0df0d74740 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9e18d2260 0x55c9e18d4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0df0d74740 4 client.27440 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:06:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.564+0000 7f0df0d74740 1 -- 172.21.15.8:0/2011822366 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c9e146f700 con 0x55c9e18d2260 2024-03-16T21:06:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.565+0000 7f0de7400640 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9e18d2260 0x55c9e18d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.565+0000 7f0de7400640 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9e18d2260 0x55c9e18d4680 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b42e9ab7eed2bd server_cookie=b25b18b42bfc042b in_seq=0 out_seq=0 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.565+0000 7f0dd4c00640 10 client.27440 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.565+0000 7f0dd4c00640 1 -- 172.21.15.8:0/2011822366 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c9e146f700 con 0x55c9e18d2260 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.565+0000 7f0dd4c00640 10 client.27440 handle_command_reply: tid=0 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.565+0000 7f0df0d74740 1 client.27440 shutdown 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.565+0000 7f0df0d74740 1 -- 172.21.15.8:0/2011822366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185d170 msgr2=0x55c9e1866800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.565+0000 7f0df0d74740 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185d170 0x55c9e1866800 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000c6a0 tx=0x7f0dd00ba040 comp rx=0 tx=0).stop 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.566+0000 7f0df0d74740 1 -- 172.21.15.8:0/2011822366 shutdown_connections 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.566+0000 7f0df0d74740 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c9e18d2260 0x55c9e18d4680 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.566+0000 7f0df0d74740 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9e1865800 0x55c9e1866d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.566+0000 7f0df0d74740 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9e185d170 0x55c9e1866800 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.566+0000 7f0df0d74740 1 --2- 172.21.15.8:0/2011822366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c9e185c490 0x55c9e1860210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.566+0000 7f0dd4c00640 0 client.27440 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.566+0000 7f0df0d74740 1 -- 172.21.15.8:0/2011822366 >> 172.21.15.8:0/2011822366 conn(0x55c9e18235a0 msgr2=0x55c9e1855f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.566+0000 7f0df0d74740 1 -- 172.21.15.8:0/2011822366 shutdown_connections 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.566+0000 7f0df0d74740 1 -- 172.21.15.8:0/2011822366 wait complete. 2024-03-16T21:06:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.566+0000 7f0df0d74740 20 client.27440 trim_cache size 0 max 16384 2024-03-16T21:06:03.576 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:06:03.576 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:06:03.576 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:06:03.576 INFO:teuthology.orchestra.run.smithi008.stdout: "344ed7ba-0b25-44d2-a5c7-6575b8d6657d": { 2024-03-16T21:06:03.576 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:06:03.576 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "344ed7ba-0b25-44d2-a5c7-6575b8d6657d", 2024-03-16T21:06:03.576 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:06:03.576 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:06:03.576 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:06:03.576 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:06:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 -- 172.21.15.8:0/3660435614 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0dcc0a1c20 msgr2=0x7f0dcc0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0dcc0a1c20 0x7f0dcc0a40e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0de0005e30 tx=0x7f0de0005d80 comp rx=0 tx=0).stop 2024-03-16T21:06:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 -- 172.21.15.8:0/3660435614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0de8074240 msgr2=0x7f0de819fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0de8074240 0x7f0de819fdc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000e9f0 tx=0x7f0dd000eeb0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 -- 172.21.15.8:0/3660435614 shutdown_connections 2024-03-16T21:06:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0dcc0a1c20 0x7f0dcc0a40e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0de810db90 0x7f0de8199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0de8074240 0x7f0de819fdc0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 --2- 172.21.15.8:0/3660435614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0de8073920 0x7f0de819f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 -- 172.21.15.8:0/3660435614 >> 172.21.15.8:0/3660435614 conn(0x7f0de80fce60 msgr2=0x7f0de80fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 -- 172.21.15.8:0/3660435614 shutdown_connections 2024-03-16T21:06:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:03.567+0000 7f0deca00640 1 -- 172.21.15.8:0/3660435614 wait complete. 2024-03-16T21:06:03.590 INFO:tasks.cephfs.filesystem:scrub status for tag:344ed7ba-0b25-44d2-a5c7-6575b8d6657d - {'path': '/', 'tag': '344ed7ba-0b25-44d2-a5c7-6575b8d6657d', 'options': 'recursive,force'} 2024-03-16T21:06:04.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:04 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:06:04.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:04 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:04.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:04 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:06:04.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:04 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:04.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:04 smithi170 ceph-mon[35947]: pgmap v252: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-03-16T21:06:04.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:04 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:06:04.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:04 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:04.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:04 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:06:04.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:04 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:04.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:04 smithi186 ceph-mon[36391]: pgmap v252: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-03-16T21:06:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:04 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:06:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:04 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:04 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:06:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:04 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:04 smithi008 ceph-mon[31434]: pgmap v252: 97 pgs: 97 active+clean; 172 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-03-16T21:06:06.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:06 smithi170 ceph-mon[35947]: pgmap v253: 97 pgs: 97 active+clean; 172 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-03-16T21:06:06.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:06 smithi186 ceph-mon[36391]: pgmap v253: 97 pgs: 97 active+clean; 172 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-03-16T21:06:06.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:06 smithi008 ceph-mon[31434]: pgmap v253: 97 pgs: 97 active+clean; 172 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-03-16T21:06:08.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:08 smithi170 ceph-mon[35947]: pgmap v254: 97 pgs: 97 active+clean; 172 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-03-16T21:06:08.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:08 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:06:08.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:08 smithi186 ceph-mon[36391]: pgmap v254: 97 pgs: 97 active+clean; 172 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-03-16T21:06:08.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:08 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:06:08.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:08 smithi008 ceph-mon[31434]: pgmap v254: 97 pgs: 97 active+clean; 172 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-03-16T21:06:08.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:08 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:06:09.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:09 smithi170 ceph-mon[35947]: osdmap e92: 12 total, 12 up, 12 in 2024-03-16T21:06:09.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:09 smithi186 ceph-mon[36391]: osdmap e92: 12 total, 12 up, 12 in 2024-03-16T21:06:09.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:09 smithi008 ceph-mon[31434]: osdmap e92: 12 total, 12 up, 12 in 2024-03-16T21:06:10.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:10 smithi170 ceph-mon[35947]: pgmap v256: 97 pgs: 97 active+clean; 172 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-03-16T21:06:10.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:10 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:06:10.893 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:10 smithi186 ceph-mon[36391]: pgmap v256: 97 pgs: 97 active+clean; 172 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-03-16T21:06:10.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:10 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:06:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:10 smithi008 ceph-mon[31434]: pgmap v256: 97 pgs: 97 active+clean; 172 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-03-16T21:06:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:10 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:06:11.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:11 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:06:11.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:11 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:06:11.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:11 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:06:11.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:11 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:06:11.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:11 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:06:11.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:11 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:06:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:11 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:06:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:11 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:06:11.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:11 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:06:13.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:12 smithi008 ceph-mon[31434]: pgmap v257: 97 pgs: 97 active+clean; 52 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-03-16T21:06:13.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:12 smithi008 ceph-mon[31434]: osdmap e93: 12 total, 12 up, 12 in 2024-03-16T21:06:13.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:12 smithi170 ceph-mon[35947]: pgmap v257: 97 pgs: 97 active+clean; 52 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-03-16T21:06:13.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:12 smithi170 ceph-mon[35947]: osdmap e93: 12 total, 12 up, 12 in 2024-03-16T21:06:13.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:12 smithi186 ceph-mon[36391]: pgmap v257: 97 pgs: 97 active+clean; 52 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-03-16T21:06:13.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:12 smithi186 ceph-mon[36391]: osdmap e93: 12 total, 12 up, 12 in 2024-03-16T21:06:15.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:14 smithi008 ceph-mon[31434]: pgmap v259: 97 pgs: 97 active+clean; 52 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 127 B/s wr, 5 op/s 2024-03-16T21:06:15.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:14 smithi170 ceph-mon[35947]: pgmap v259: 97 pgs: 97 active+clean; 52 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 127 B/s wr, 5 op/s 2024-03-16T21:06:15.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:14 smithi186 ceph-mon[36391]: pgmap v259: 97 pgs: 97 active+clean; 52 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 127 B/s wr, 5 op/s 2024-03-16T21:06:17.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:16 smithi008 ceph-mon[31434]: pgmap v260: 97 pgs: 97 active+clean; 52 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T21:06:17.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:16 smithi170 ceph-mon[35947]: pgmap v260: 97 pgs: 97 active+clean; 52 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T21:06:17.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:16 smithi186 ceph-mon[36391]: pgmap v260: 97 pgs: 97 active+clean; 52 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T21:06:19.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:18 smithi008 ceph-mon[31434]: pgmap v261: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-03-16T21:06:19.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:18 smithi170 ceph-mon[35947]: pgmap v261: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-03-16T21:06:19.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:18 smithi186 ceph-mon[36391]: pgmap v261: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-03-16T21:06:21.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:20 smithi008 ceph-mon[31434]: pgmap v262: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-03-16T21:06:21.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:20 smithi170 ceph-mon[35947]: pgmap v262: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-03-16T21:06:21.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:20 smithi186 ceph-mon[36391]: pgmap v262: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-03-16T21:06:23.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:22 smithi008 ceph-mon[31434]: pgmap v263: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:06:23.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:22 smithi170 ceph-mon[35947]: pgmap v263: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:06:23.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:22 smithi186 ceph-mon[36391]: pgmap v263: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:06:25.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:24 smithi008 ceph-mon[31434]: pgmap v264: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-03-16T21:06:25.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:24 smithi170 ceph-mon[35947]: pgmap v264: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-03-16T21:06:25.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:24 smithi186 ceph-mon[36391]: pgmap v264: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-03-16T21:06:27.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:26 smithi008 ceph-mon[31434]: pgmap v265: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:06:27.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:26 smithi170 ceph-mon[35947]: pgmap v265: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:06:27.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:26 smithi186 ceph-mon[36391]: pgmap v265: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:06:29.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:28 smithi008 ceph-mon[31434]: pgmap v266: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:06:29.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:28 smithi170 ceph-mon[35947]: pgmap v266: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:06:29.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:28 smithi186 ceph-mon[36391]: pgmap v266: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:06:31.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:30 smithi008 ceph-mon[31434]: pgmap v267: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:31.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:30 smithi170 ceph-mon[35947]: pgmap v267: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:31.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:30 smithi186 ceph-mon[36391]: pgmap v267: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:33.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:32 smithi008 ceph-mon[31434]: pgmap v268: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:06:33.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:32 smithi170 ceph-mon[35947]: pgmap v268: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:06:33.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:32 smithi186 ceph-mon[36391]: pgmap v268: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:06:33.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:06:33.591 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:06:33.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.823+0000 7f840e000640 1 -- 172.21.15.8:0/293396471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8408103690 msgr2=0x7f8408103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:33.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.823+0000 7f840e000640 1 --2- 172.21.15.8:0/293396471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8408103690 0x7f8408103b10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009930 tx=0x7f83f002bc30 comp rx=0 tx=0).stop 2024-03-16T21:06:33.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.824+0000 7f840e000640 1 -- 172.21.15.8:0/293396471 shutdown_connections 2024-03-16T21:06:33.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.824+0000 7f840e000640 1 --2- 172.21.15.8:0/293396471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8408104050 0x7f8408110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.824+0000 7f840e000640 1 --2- 172.21.15.8:0/293396471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8408103690 0x7f8408103b10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.824+0000 7f840e000640 1 --2- 172.21.15.8:0/293396471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84081096a0 0x7f8408109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.824+0000 7f840e000640 1 -- 172.21.15.8:0/293396471 >> 172.21.15.8:0/293396471 conn(0x7f84080ff160 msgr2=0x7f8408101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:33.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.824+0000 7f840e000640 1 -- 172.21.15.8:0/293396471 shutdown_connections 2024-03-16T21:06:33.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.824+0000 7f840e000640 1 -- 172.21.15.8:0/293396471 wait complete. 2024-03-16T21:06:33.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.825+0000 7f840e000640 1 Processor -- start 2024-03-16T21:06:33.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.825+0000 7f840e000640 1 -- start start 2024-03-16T21:06:33.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.825+0000 7f840e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8408103690 0x7f8408075a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.825+0000 7f840e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8408104050 0x7f8408075f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.825+0000 7f840e000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84081096a0 0x7f8408076480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.825+0000 7f840e000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84081aa4b0 con 0x7f8408104050 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.825+0000 7f840e000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84081aa5f0 con 0x7f8408103690 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.825+0000 7f840e000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84081aa780 con 0x7f84081096a0 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.825+0000 7f8407400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8408103690 0x7f8408075a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.825+0000 7f8407400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8408103690 0x7f8408075a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44698/0 (socket says 172.21.15.8:44698) 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.825+0000 7f8407400640 1 -- 172.21.15.8:0/2674122673 learned_addr learned my addr 172.21.15.8:0/2674122673 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.826+0000 7f8407e00640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84081096a0 0x7f8408076480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.826+0000 7f83fea00640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8408104050 0x7f8408075f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.826+0000 7f8407400640 1 -- 172.21.15.8:0/2674122673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84081096a0 msgr2=0x7f8408076480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.826+0000 7f8407400640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84081096a0 0x7f8408076480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.826+0000 7f8407400640 1 -- 172.21.15.8:0/2674122673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8408104050 msgr2=0x7f8408075f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.826+0000 7f8407400640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8408104050 0x7f8408075f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.826+0000 7f8407400640 1 -- 172.21.15.8:0/2674122673 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f0009560 con 0x7f8408103690 2024-03-16T21:06:33.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.826+0000 7f8407e00640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84081096a0 0x7f8408076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:33.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.826+0000 7f83fea00640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8408104050 0x7f8408075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:33.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.826+0000 7f8407400640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8408103690 0x7f8408075a00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f83f800e9f0 tx=0x7f83f800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:33.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.827+0000 7f8404c00640 1 -- 172.21.15.8:0/2674122673 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8009700 con 0x7f8408103690 2024-03-16T21:06:33.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.827+0000 7f8404c00640 1 -- 172.21.15.8:0/2674122673 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f83f800cd80 con 0x7f8408103690 2024-03-16T21:06:33.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.827+0000 7f840e000640 1 -- 172.21.15.8:0/2674122673 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84081aaa60 con 0x7f8408103690 2024-03-16T21:06:33.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.827+0000 7f8404c00640 1 -- 172.21.15.8:0/2674122673 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8018a10 con 0x7f8408103690 2024-03-16T21:06:33.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.827+0000 7f840e000640 1 -- 172.21.15.8:0/2674122673 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84081aaf90 con 0x7f8408103690 2024-03-16T21:06:33.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.830+0000 7f8410c60740 1 Processor -- start 2024-03-16T21:06:33.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.830+0000 7f8410c60740 1 -- start start 2024-03-16T21:06:33.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.830+0000 7f8404c00640 1 -- 172.21.15.8:0/2674122673 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f83f8010c30 con 0x7f8408103690 2024-03-16T21:06:33.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.830+0000 7f8410c60740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bc6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.830+0000 7f8410c60740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bc7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.830+0000 7f8410c60740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bd2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.830+0000 7f8410c60740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b6b36150 con 0x55f7b6bc72c0 2024-03-16T21:06:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.830+0000 7f8410c60740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b6b33680 con 0x55f7b6bd0630 2024-03-16T21:06:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.830+0000 7f8410c60740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b6b2ee60 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f8407e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bc6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f8407400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bc7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f83fea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bd2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f8407e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bc6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57912/0 (socket says 172.21.15.8:57912) 2024-03-16T21:06:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f8407e00640 1 -- 172.21.15.8:0/133797328 learned_addr learned my addr 172.21.15.8:0/133797328 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:33.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f83fea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bd2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44710/0 (socket says 172.21.15.8:44710) 2024-03-16T21:06:33.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f8407e00640 1 -- 172.21.15.8:0/133797328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 msgr2=0x55f7b6bd2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:33.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f8407e00640 1 --2- 172.21.15.8:0/133797328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bd2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f8407e00640 1 -- 172.21.15.8:0/133797328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc72c0 msgr2=0x55f7b6bc7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:33.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f8407e00640 1 --2- 172.21.15.8:0/133797328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bc7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f8407e00640 1 -- 172.21.15.8:0/133797328 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7b6ae8060 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f83fea00640 1 --2- 172.21.15.8:0/133797328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bd2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:33.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.831+0000 7f8407e00640 1 --2- 172.21.15.8:0/133797328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bc6cf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f84000117e0 tx=0x7f8400011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0ae128f65d43286 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:33.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.832+0000 7f83f7e00640 1 -- 172.21.15.8:0/133797328 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400011310 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.832+0000 7f83f7e00640 1 -- 172.21.15.8:0/133797328 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8400003e70 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.832+0000 7f83f7e00640 1 -- 172.21.15.8:0/133797328 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400004690 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.832+0000 7f8404c00640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83ec0a1c20 0x7f83ec0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.832+0000 7f8407400640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83ec0a1c20 0x7f83ec0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.832+0000 7f8404c00640 1 -- 172.21.15.8:0/2674122673 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f83f8014070 con 0x7f8408103690 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.832+0000 7f8410c60740 1 -- 172.21.15.8:0/133797328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 msgr2=0x55f7b6bc6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.832+0000 7f8410c60740 1 --2- 172.21.15.8:0/133797328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bc6cf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f84000117e0 tx=0x7f8400011ca0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.833+0000 7f8410c60740 1 -- 172.21.15.8:0/133797328 shutdown_connections 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.833+0000 7f8410c60740 1 --2- 172.21.15.8:0/133797328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bd2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.833+0000 7f8410c60740 1 --2- 172.21.15.8:0/133797328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bc7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.833+0000 7f8410c60740 1 --2- 172.21.15.8:0/133797328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bc6cf0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.833+0000 7f8410c60740 1 -- 172.21.15.8:0/133797328 >> 172.21.15.8:0/133797328 conn(0x55f7b6b8e5a0 msgr2=0x55f7b6bc1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:33.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.833+0000 7f8407400640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83ec0a1c20 0x7f83ec0a40e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55f7b6bc84f0 tx=0x7f83f80d3530 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:33.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.833+0000 7f8410c60740 1 -- 172.21.15.8:0/133797328 shutdown_connections 2024-03-16T21:06:33.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.833+0000 7f8410c60740 1 -- 172.21.15.8:0/133797328 wait complete. 2024-03-16T21:06:33.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.833+0000 7f8410c60740 1 -- start start 2024-03-16T21:06:33.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.833+0000 7f8410c60740 1 Processor -- start 2024-03-16T21:06:33.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f8410c60740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bcd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f8410c60740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f8410c60740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f8410c60740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b6ad3ec0 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f8410c60740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b6ad3b60 con 0x55f7b6bd0630 2024-03-16T21:06:33.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f8410c60740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b689d1c0 con 0x55f7b6bc72c0 2024-03-16T21:06:33.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f8410c60740 10 client.0 _ll_register_callbacks cb 0x55f7b6ae7960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f8407e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bcd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f83fea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f8407e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bcd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57914/0 (socket says 172.21.15.8:57914) 2024-03-16T21:06:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f8407e00640 1 -- 172.21.15.8:0/1762259435 learned_addr learned my addr 172.21.15.8:0/1762259435 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.834+0000 7f8407e00640 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.835+0000 7f83fea00640 1 -- 172.21.15.8:0/1762259435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc72c0 msgr2=0x55f7b6bcd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:33.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.835+0000 7f83fea00640 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bcd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.835+0000 7f83fea00640 1 -- 172.21.15.8:0/1762259435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 msgr2=0x55f7b6bce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.835+0000 7f83fea00640 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.835+0000 7f83fea00640 1 -- 172.21.15.8:0/1762259435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84000114c0 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.835+0000 7f83fea00640 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcdae0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f83f0036040 tx=0x7f83f002c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acedf9fc43b8f56a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.835+0000 7f83f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:06:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.835+0000 7f83f4c00640 1 -- 172.21.15.8:0/1762259435 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0004250 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.836+0000 7f83f4c00640 1 -- 172.21.15.8:0/1762259435 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f83f0046070 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.836+0000 7f8410c60740 1 -- 172.21.15.8:0/1762259435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7b682e7e0 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.836+0000 7f83f4c00640 1 -- 172.21.15.8:0/1762259435 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83f00043b0 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.836+0000 7f8410c60740 10 client.17268 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:33.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.836+0000 7f8410c60740 1 -- 172.21.15.8:0/1762259435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f7b6b2d4e0 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.836+0000 7f83f4c00640 1 -- 172.21.15.8:0/1762259435 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55f7b682e7e0 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.836+0000 7f83f4c00640 1 -- 172.21.15.8:0/1762259435 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f83f003c040 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.837+0000 7f8410c60740 10 client.17268 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:33.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.837+0000 7f8410c60740 10 client.17268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:33.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.837+0000 7f8410c60740 20 client.17268 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:33.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.837+0000 7f8410c60740 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f7b6be0690 0x55f7b6be2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.837+0000 7f8410c60740 4 client.17268 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:33.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.837+0000 7f8410c60740 1 -- 172.21.15.8:0/1762259435 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7b686b720 con 0x55f7b6be0690 2024-03-16T21:06:33.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.837+0000 7f8407e00640 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f7b6be0690 0x55f7b6be2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.837+0000 7f8407e00640 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f7b6be0690 0x55f7b6be2ab0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7adadf4383bd3e6 server_cookie=161fd5982f811fee in_seq=0 out_seq=0 2024-03-16T21:06:33.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.837+0000 7f83f4c00640 10 client.17268 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:33.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f83f4c00640 1 -- 172.21.15.8:0/1762259435 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55f7b686b720 con 0x55f7b6be0690 2024-03-16T21:06:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f83f4c00640 10 client.17268 handle_command_reply: tid=0 2024-03-16T21:06:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 1 client.17268 shutdown 2024-03-16T21:06:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 1 -- 172.21.15.8:0/1762259435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 msgr2=0x55f7b6bcdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcdae0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f83f0036040 tx=0x7f83f002c800 comp rx=0 tx=0).stop 2024-03-16T21:06:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 1 -- 172.21.15.8:0/1762259435 shutdown_connections 2024-03-16T21:06:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f7b6be0690 0x55f7b6be2ab0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcdae0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 1 --2- 172.21.15.8:0/1762259435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bcd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f83f4c00640 0 client.17268 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 1 -- 172.21.15.8:0/1762259435 >> 172.21.15.8:0/1762259435 conn(0x55f7b6b8e5a0 msgr2=0x55f7b6bc3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 1 -- 172.21.15.8:0/1762259435 shutdown_connections 2024-03-16T21:06:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 1 -- 172.21.15.8:0/1762259435 wait complete. 2024-03-16T21:06:33.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.839+0000 7f8410c60740 20 client.17268 trim_cache size 0 max 16384 2024-03-16T21:06:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.857+0000 7f8410c60740 1 Processor -- start 2024-03-16T21:06:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.857+0000 7f8410c60740 1 -- start start 2024-03-16T21:06:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.857+0000 7f8410c60740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bcfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.857+0000 7f8410c60740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.857+0000 7f8410c60740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bd0630 0x55f7b6bc37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.857+0000 7f8410c60740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b6bc6b30 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.857+0000 7f8410c60740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b6bc15b0 con 0x55f7b6bc72c0 2024-03-16T21:06:33.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.857+0000 7f8410c60740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b6be3110 con 0x55f7b6bd0630 2024-03-16T21:06:33.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.858+0000 7f8407e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bcfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.858+0000 7f83fea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.858+0000 7f8407e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bcfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44730/0 (socket says 172.21.15.8:44730) 2024-03-16T21:06:33.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.858+0000 7f8407e00640 1 -- 172.21.15.8:0/1424214541 learned_addr learned my addr 172.21.15.8:0/1424214541 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:33.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.858+0000 7f8407e00640 1 --2- 172.21.15.8:0/1424214541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bd0630 0x55f7b6bc37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.858+0000 7f83fea00640 1 -- 172.21.15.8:0/1424214541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bd0630 msgr2=0x55f7b6bc37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.858+0000 7f83fea00640 1 --2- 172.21.15.8:0/1424214541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bd0630 0x55f7b6bc37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.858+0000 7f83fea00640 1 -- 172.21.15.8:0/1424214541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bc72c0 msgr2=0x55f7b6bcfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.858+0000 7f83fea00640 1 --2- 172.21.15.8:0/1424214541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bcfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.858+0000 7f83fea00640 1 -- 172.21.15.8:0/1424214541 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7b6ac9950 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.858+0000 7f8407e00640 1 --2- 172.21.15.8:0/1424214541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bcfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.859+0000 7f83fea00640 1 --2- 172.21.15.8:0/1424214541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcde40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83f0006010 tx=0x7f83f0005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82aca1671c80ae5b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.859+0000 7f83f7400640 1 -- 172.21.15.8:0/1424214541 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0004a70 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.859+0000 7f83f7400640 1 -- 172.21.15.8:0/1424214541 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f83f0044070 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.859+0000 7f83f7400640 1 -- 172.21.15.8:0/1424214541 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00044b0 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.860+0000 7f8410c60740 1 -- 172.21.15.8:0/1424214541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 msgr2=0x55f7b6bcde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.860+0000 7f8410c60740 1 --2- 172.21.15.8:0/1424214541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcde40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83f0006010 tx=0x7f83f0005e00 comp rx=0 tx=0).stop 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.860+0000 7f8410c60740 1 -- 172.21.15.8:0/1424214541 shutdown_connections 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.860+0000 7f8410c60740 1 --2- 172.21.15.8:0/1424214541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bd0630 0x55f7b6bc37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.860+0000 7f8410c60740 1 --2- 172.21.15.8:0/1424214541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcde40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.860+0000 7f8410c60740 1 --2- 172.21.15.8:0/1424214541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bcfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.860+0000 7f8410c60740 1 -- 172.21.15.8:0/1424214541 >> 172.21.15.8:0/1424214541 conn(0x55f7b6b8e5a0 msgr2=0x55f7b6bc30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.860+0000 7f8410c60740 1 -- 172.21.15.8:0/1424214541 shutdown_connections 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.860+0000 7f8410c60740 1 -- 172.21.15.8:0/1424214541 wait complete. 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.860+0000 7f8410c60740 1 -- start start 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.860+0000 7f8410c60740 1 Processor -- start 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f8410c60740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f8410c60740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f8410c60740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bcb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f8410c60740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b6bd0da0 con 0x55f7b6bc72c0 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f8410c60740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b6bd0f10 con 0x55f7b6bd0630 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f8410c60740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7b6bd10d0 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f8410c60740 10 client.0 _ll_register_callbacks cb 0x7f83f002cdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f83fea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f8407e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f83fea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57936/0 (socket says 172.21.15.8:57936) 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f83fea00640 1 -- 172.21.15.8:0/1178285312 learned_addr learned my addr 172.21.15.8:0/1178285312 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f8407e00640 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bcb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f83fea00640 1 -- 172.21.15.8:0/1178285312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 msgr2=0x55f7b6bcb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f83fea00640 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bcb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f83fea00640 1 -- 172.21.15.8:0/1178285312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc72c0 msgr2=0x55f7b6bca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.861+0000 7f83fea00640 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.862+0000 7f83fea00640 1 -- 172.21.15.8:0/1178285312 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8400021040 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.862+0000 7f8407e00640 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:33.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.862+0000 7f83fea00640 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcad80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f83f0005cd0 tx=0x7f83f002c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcef35a4059c42fd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:33.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.862+0000 7f83f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:06:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.862+0000 7f83f4c00640 1 -- 172.21.15.8:0/1178285312 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f002c2b0 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.862+0000 7f83f4c00640 1 -- 172.21.15.8:0/1178285312 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f83f0000e40 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.862+0000 7f8410c60740 1 -- 172.21.15.8:0/1178285312 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8400003e70 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.862+0000 7f83f4c00640 1 -- 172.21.15.8:0/1178285312 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83f0004e10 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.862+0000 7f8410c60740 10 client.27466 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.863+0000 7f8410c60740 1 -- 172.21.15.8:0/1178285312 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f7b6b2d4e0 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.863+0000 7f83f4c00640 1 -- 172.21.15.8:0/1178285312 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f8400003e70 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.863+0000 7f83f4c00640 1 -- 172.21.15.8:0/1178285312 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f83f003c070 con 0x55f7b6bc7fa0 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.863+0000 7f8410c60740 10 client.27466 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.863+0000 7f8410c60740 10 client.27466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.863+0000 7f8410c60740 20 client.27466 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.863+0000 7f8410c60740 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f7b6c3c6b0 0x55f7b6c3ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.863+0000 7f8410c60740 4 client.27466 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.863+0000 7f8410c60740 1 -- 172.21.15.8:0/1178285312 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f7b68ba890 con 0x55f7b6c3c6b0 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.863+0000 7f8407e00640 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f7b6c3c6b0 0x55f7b6c3ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8407e00640 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f7b6c3c6b0 0x55f7b6c3ead0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deb3cf69e320a791 server_cookie=c5957a411ac7f4f3 in_seq=0 out_seq=0 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f83f4c00640 10 client.27466 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f83f4c00640 1 -- 172.21.15.8:0/1178285312 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f7b68ba890 con 0x55f7b6c3c6b0 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f83f4c00640 10 client.27466 handle_command_reply: tid=0 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8410c60740 1 client.27466 shutdown 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8410c60740 1 -- 172.21.15.8:0/1178285312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 msgr2=0x55f7b6bcad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8410c60740 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcad80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f83f0005cd0 tx=0x7f83f002c7e0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8410c60740 1 -- 172.21.15.8:0/1178285312 shutdown_connections 2024-03-16T21:06:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8410c60740 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f7b6bd0630 0x55f7b6bcb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8410c60740 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f7b6bc7fa0 0x55f7b6bcad80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8410c60740 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55f7b6c3c6b0 0x55f7b6c3ead0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8410c60740 1 --2- 172.21.15.8:0/1178285312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7b6bc72c0 0x55f7b6bca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f83f4c00640 0 client.27466 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8410c60740 1 -- 172.21.15.8:0/1178285312 >> 172.21.15.8:0/1178285312 conn(0x55f7b6b8e5a0 msgr2=0x55f7b6bc0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8410c60740 1 -- 172.21.15.8:0/1178285312 shutdown_connections 2024-03-16T21:06:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.864+0000 7f8410c60740 1 -- 172.21.15.8:0/1178285312 wait complete. 2024-03-16T21:06:33.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f8410c60740 20 client.27466 trim_cache size 0 max 16384 2024-03-16T21:06:33.875 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:06:33.875 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:06:33.875 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:06:33.875 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 -- 172.21.15.8:0/2674122673 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83ec0a1c20 msgr2=0x7f83ec0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83ec0a1c20 0x7f83ec0a40e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55f7b6bc84f0 tx=0x7f83f80d3530 comp rx=0 tx=0).stop 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 -- 172.21.15.8:0/2674122673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8408103690 msgr2=0x7f8408075a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8408103690 0x7f8408075a00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f83f800e9f0 tx=0x7f83f800eeb0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 -- 172.21.15.8:0/2674122673 shutdown_connections 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f83ec0a1c20 0x7f83ec0a40e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84081096a0 0x7f8408076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8408104050 0x7f8408075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 --2- 172.21.15.8:0/2674122673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8408103690 0x7f8408075a00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 -- 172.21.15.8:0/2674122673 >> 172.21.15.8:0/2674122673 conn(0x7f84080ff160 msgr2=0x7f84080ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 -- 172.21.15.8:0/2674122673 shutdown_connections 2024-03-16T21:06:33.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:33.865+0000 7f840e000640 1 -- 172.21.15.8:0/2674122673 wait complete. 2024-03-16T21:06:33.890 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:06:33.890 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:06:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.110+0000 7fb1e6600640 1 -- 172.21.15.8:0/2225714338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e0075a20 msgr2=0x7fb1e0075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.110+0000 7fb1e6600640 1 --2- 172.21.15.8:0/2225714338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e0075a20 0x7fb1e0075e00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009930 tx=0x7fb1d002bc20 comp rx=0 tx=0).stop 2024-03-16T21:06:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.110+0000 7fb1e6600640 1 -- 172.21.15.8:0/2225714338 shutdown_connections 2024-03-16T21:06:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.110+0000 7fb1e6600640 1 --2- 172.21.15.8:0/2225714338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e0112340 0x7fb1e0114730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.110+0000 7fb1e6600640 1 --2- 172.21.15.8:0/2225714338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0076340 0x7fb1e0111e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.110+0000 7fb1e6600640 1 --2- 172.21.15.8:0/2225714338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e0075a20 0x7fb1e0075e00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.110+0000 7fb1e6600640 1 -- 172.21.15.8:0/2225714338 >> 172.21.15.8:0/2225714338 conn(0x7fb1e00ff130 msgr2=0x7fb1e0101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.110+0000 7fb1e6600640 1 -- 172.21.15.8:0/2225714338 shutdown_connections 2024-03-16T21:06:34.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.110+0000 7fb1e6600640 1 -- 172.21.15.8:0/2225714338 wait complete. 2024-03-16T21:06:34.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.111+0000 7fb1e6600640 1 Processor -- start 2024-03-16T21:06:34.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1e6600640 1 -- start start 2024-03-16T21:06:34.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1e6600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e0075a20 0x7fb1e019e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1e6600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0076340 0x7fb1e019e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1e6600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e0112340 0x7fb1e01a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1e6600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e01a3160 con 0x7fb1e0112340 2024-03-16T21:06:34.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1e6600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e01a32d0 con 0x7fb1e0075a20 2024-03-16T21:06:34.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1e6600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e01a3490 con 0x7fb1e0076340 2024-03-16T21:06:34.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1df400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e0075a20 0x7fb1e019e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1d6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0076340 0x7fb1e019e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1dfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e0112340 0x7fb1e01a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1df400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e0075a20 0x7fb1e019e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44764/0 (socket says 172.21.15.8:44764) 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1df400640 1 -- 172.21.15.8:0/2602275859 learned_addr learned my addr 172.21.15.8:0/2602275859 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.112+0000 7fb1d6a00640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0076340 0x7fb1e019e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57948/0 (socket says 172.21.15.8:57948) 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.113+0000 7fb1df400640 1 -- 172.21.15.8:0/2602275859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0076340 msgr2=0x7fb1e019e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.113+0000 7fb1df400640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0076340 0x7fb1e019e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.113+0000 7fb1df400640 1 -- 172.21.15.8:0/2602275859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e0112340 msgr2=0x7fb1e01a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.113+0000 7fb1df400640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e0112340 0x7fb1e01a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.113+0000 7fb1df400640 1 -- 172.21.15.8:0/2602275859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d0009560 con 0x7fb1e0075a20 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.113+0000 7fb1d6a00640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0076340 0x7fb1e019e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.113+0000 7fb1df400640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e0075a20 0x7fb1e019e2a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009230 tx=0x7fb1d0004c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.113+0000 7fb1dcc00640 1 -- 172.21.15.8:0/2602275859 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d00044d0 con 0x7fb1e0075a20 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.113+0000 7fb1dcc00640 1 -- 172.21.15.8:0/2602275859 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb1d0005310 con 0x7fb1e0075a20 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.113+0000 7fb1e6600640 1 -- 172.21.15.8:0/2602275859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e01a3710 con 0x7fb1e0075a20 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.113+0000 7fb1dcc00640 1 -- 172.21.15.8:0/2602275859 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0003e60 con 0x7fb1e0075a20 2024-03-16T21:06:34.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.114+0000 7fb1e6600640 1 -- 172.21.15.8:0/2602275859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e01aaff0 con 0x7fb1e0075a20 2024-03-16T21:06:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.115+0000 7fb1e6600640 1 -- 172.21.15.8:0/2602275859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e00682e0 con 0x7fb1e0075a20 2024-03-16T21:06:34.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.116+0000 7fb1dcc00640 1 -- 172.21.15.8:0/2602275859 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fb1d00035f0 con 0x7fb1e0075a20 2024-03-16T21:06:34.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.118+0000 7fb1dcc00640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1c40a1c20 0x7fb1c40a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.118+0000 7fb1dcc00640 1 -- 172.21.15.8:0/2602275859 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb1d00ef640 con 0x7fb1e0075a20 2024-03-16T21:06:34.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.118+0000 7fb1d6a00640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1c40a1c20 0x7fb1c40a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.119+0000 7fb1d6a00640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1c40a1c20 0x7fb1c40a40e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0101600 tx=0x7fb1c8005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.122+0000 7fb1dcc00640 1 -- 172.21.15.8:0/2602275859 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb1d00b8670 con 0x7fb1e0075a20 2024-03-16T21:06:34.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.365+0000 7fb1e6600640 1 -- 172.21.15.8:0/2602275859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1e019f5f0 con 0x7fb1e0075a20 2024-03-16T21:06:34.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.366+0000 7fb1dcc00640 1 -- 172.21.15.8:0/2602275859 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11387 (secure 0 0 0) 0x7fb1d00bbd30 con 0x7fb1e0075a20 2024-03-16T21:06:34.371 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:06:34.372 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:27.879028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:06:34.372 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-03-16T21:06:34.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.368+0000 7fb1e6600640 1 -- 172.21.15.8:0/2602275859 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1c40a1c20 msgr2=0x7fb1c40a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.368+0000 7fb1e6600640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1c40a1c20 0x7fb1c40a40e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0101600 tx=0x7fb1c8005f90 comp rx=0 tx=0).stop 2024-03-16T21:06:34.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.369+0000 7fb1e6600640 1 -- 172.21.15.8:0/2602275859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e0075a20 msgr2=0x7fb1e019e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.369+0000 7fb1e6600640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e0075a20 0x7fb1e019e2a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009230 tx=0x7fb1d0004c20 comp rx=0 tx=0).stop 2024-03-16T21:06:34.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.369+0000 7fb1e6600640 1 -- 172.21.15.8:0/2602275859 shutdown_connections 2024-03-16T21:06:34.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.369+0000 7fb1e6600640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb1c40a1c20 0x7fb1c40a40e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.369+0000 7fb1e6600640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1e0112340 0x7fb1e01a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.369+0000 7fb1e6600640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb1e0076340 0x7fb1e019e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.369+0000 7fb1e6600640 1 --2- 172.21.15.8:0/2602275859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e0075a20 0x7fb1e019e2a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.369+0000 7fb1e6600640 1 -- 172.21.15.8:0/2602275859 >> 172.21.15.8:0/2602275859 conn(0x7fb1e00ff130 msgr2=0x7fb1e0113a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.369+0000 7fb1e6600640 1 -- 172.21.15.8:0/2602275859 shutdown_connections 2024-03-16T21:06:34.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.369+0000 7fb1e6600640 1 -- 172.21.15.8:0/2602275859 wait complete. 2024-03-16T21:06:34.395 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:06:34.395 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:06:34.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.619+0000 7fd9aa200640 1 -- 172.21.15.8:0/1761255550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a41083d0 msgr2=0x7fd9a4114820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.619+0000 7fd9aa200640 1 --2- 172.21.15.8:0/1761255550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a41083d0 0x7fd9a4114820 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd99c009cd0 tx=0x7fd99c02c180 comp rx=0 tx=0).stop 2024-03-16T21:06:34.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.619+0000 7fd9aa200640 1 -- 172.21.15.8:0/1761255550 shutdown_connections 2024-03-16T21:06:34.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.619+0000 7fd9aa200640 1 --2- 172.21.15.8:0/1761255550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a41083d0 0x7fd9a4114820 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.619+0000 7fd9aa200640 1 --2- 172.21.15.8:0/1761255550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9a4107a30 0x7fd9a4107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.619+0000 7fd9aa200640 1 --2- 172.21.15.8:0/1761255550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a410d9d0 0x7fd9a410ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.619+0000 7fd9aa200640 1 -- 172.21.15.8:0/1761255550 >> 172.21.15.8:0/1761255550 conn(0x7fd9a4077310 msgr2=0x7fd9a4106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.619+0000 7fd9aa200640 1 -- 172.21.15.8:0/1761255550 shutdown_connections 2024-03-16T21:06:34.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.619+0000 7fd9aa200640 1 -- 172.21.15.8:0/1761255550 wait complete. 2024-03-16T21:06:34.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.620+0000 7fd9aa200640 1 Processor -- start 2024-03-16T21:06:34.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.620+0000 7fd9aa200640 1 -- start start 2024-03-16T21:06:34.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.620+0000 7fd9aa200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a4107a30 0x7fd9a419e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9aa200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41083d0 0x7fd9a419e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9aa200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9a410d9d0 0x7fd9a41a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9aa200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41a2fc0 con 0x7fd9a41083d0 2024-03-16T21:06:34.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9aa200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41a3130 con 0x7fd9a410d9d0 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9aa200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41a32f0 con 0x7fd9a4107a30 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9a8e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a4107a30 0x7fd9a419e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9a3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41083d0 0x7fd9a419e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9a8e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a4107a30 0x7fd9a419e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57960/0 (socket says 172.21.15.8:57960) 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9a8e00640 1 -- 172.21.15.8:0/1604311906 learned_addr learned my addr 172.21.15.8:0/1604311906 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9a9800640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9a410d9d0 0x7fd9a41a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9a8e00640 1 -- 172.21.15.8:0/1604311906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9a410d9d0 msgr2=0x7fd9a41a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9a8e00640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9a410d9d0 0x7fd9a41a29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9a8e00640 1 -- 172.21.15.8:0/1604311906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41083d0 msgr2=0x7fd9a419e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9a8e00640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41083d0 0x7fd9a419e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9a8e00640 1 -- 172.21.15.8:0/1604311906 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c009900 con 0x7fd9a4107a30 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.621+0000 7fd9a3e00640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41083d0 0x7fd9a419e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.622+0000 7fd9a8e00640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a4107a30 0x7fd9a419e150 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd99800e9f0 tx=0x7fd99800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.622+0000 7fd9a1600640 1 -- 172.21.15.8:0/1604311906 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd998009700 con 0x7fd9a4107a30 2024-03-16T21:06:34.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.622+0000 7fd9a1600640 1 -- 172.21.15.8:0/1604311906 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd99800cd80 con 0x7fd9a4107a30 2024-03-16T21:06:34.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.622+0000 7fd9a1600640 1 -- 172.21.15.8:0/1604311906 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980189c0 con 0x7fd9a4107a30 2024-03-16T21:06:34.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.622+0000 7fd9aa200640 1 -- 172.21.15.8:0/1604311906 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a41a35d0 con 0x7fd9a4107a30 2024-03-16T21:06:34.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.622+0000 7fd9aa200640 1 -- 172.21.15.8:0/1604311906 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a41aae50 con 0x7fd9a4107a30 2024-03-16T21:06:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.625+0000 7fd9ae5be740 1 Processor -- start 2024-03-16T21:06:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.625+0000 7fd9a1600640 1 -- 172.21.15.8:0/1604311906 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fd998018b20 con 0x7fd9a4107a30 2024-03-16T21:06:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.625+0000 7fd9ae5be740 1 -- start start 2024-03-16T21:06:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.625+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e2891d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.625+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e291db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e2922f0 0x560e8e2946e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8e1f7210 con 0x560e8e2922f0 2024-03-16T21:06:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8e1f4740 con 0x560e8e289710 2024-03-16T21:06:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8e1eff20 con 0x560e8e288df0 2024-03-16T21:06:34.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9a8e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e291db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9a9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e2891d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9a9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e2891d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57976/0 (socket says 172.21.15.8:57976) 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9a8e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e291db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44788/0 (socket says 172.21.15.8:44788) 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9a9800640 1 -- 172.21.15.8:0/788142949 learned_addr learned my addr 172.21.15.8:0/788142949 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9a3e00640 1 --2- 172.21.15.8:0/788142949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e2922f0 0x560e8e2946e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9a9800640 1 -- 172.21.15.8:0/788142949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 msgr2=0x560e8e291db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9a9800640 1 --2- 172.21.15.8:0/788142949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e291db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9a9800640 1 -- 172.21.15.8:0/788142949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e2922f0 msgr2=0x560e8e2946e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9a9800640 1 --2- 172.21.15.8:0/788142949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e2922f0 0x560e8e2946e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.626+0000 7fd9a9800640 1 -- 172.21.15.8:0/788142949 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e8e1b1df0 con 0x560e8e288df0 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.627+0000 7fd9a9800640 1 --2- 172.21.15.8:0/788142949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e2891d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd99c004af0 tx=0x7fd99c005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75d12e3a99210d81 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.627+0000 7fd9a1600640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd98c0a1ba0 0x7fd98c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.627+0000 7fd996000640 1 -- 172.21.15.8:0/788142949 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c032580 con 0x560e8e288df0 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.627+0000 7fd996000640 1 -- 172.21.15.8:0/788142949 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd99c003970 con 0x560e8e288df0 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.627+0000 7fd996000640 1 -- 172.21.15.8:0/788142949 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c032cc0 con 0x560e8e288df0 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.627+0000 7fd9a8e00640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd98c0a1ba0 0x7fd98c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9ae5be740 1 -- 172.21.15.8:0/788142949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 msgr2=0x560e8e2891d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/788142949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e2891d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd99c004af0 tx=0x7fd99c005fa0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9a1600640 1 -- 172.21.15.8:0/1604311906 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd998014070 con 0x7fd9a4107a30 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9a8e00640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd98c0a1ba0 0x7fd98c0a4060 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x560e8e2888c0 tx=0x7fd9980d3530 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9ae5be740 1 -- 172.21.15.8:0/788142949 shutdown_connections 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/788142949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e2922f0 0x560e8e2946e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/788142949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e291db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/788142949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e2891d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9ae5be740 1 -- 172.21.15.8:0/788142949 >> 172.21.15.8:0/788142949 conn(0x560e8e283520 msgr2=0x560e8e283900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9ae5be740 1 -- 172.21.15.8:0/788142949 shutdown_connections 2024-03-16T21:06:34.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9ae5be740 1 -- 172.21.15.8:0/788142949 wait complete. 2024-03-16T21:06:34.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.628+0000 7fd9ae5be740 1 -- start start 2024-03-16T21:06:34.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.629+0000 7fd9ae5be740 1 Processor -- start 2024-03-16T21:06:34.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.629+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e288df0 0x560e8e28f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.629+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e28f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.629+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e2922f0 0x560e8e28fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.629+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8e195150 con 0x560e8e288df0 2024-03-16T21:06:34.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.629+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8e194df0 con 0x560e8e289710 2024-03-16T21:06:34.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.629+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8df5e1c0 con 0x560e8e2922f0 2024-03-16T21:06:34.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.629+0000 7fd9ae5be740 10 client.0 _ll_register_callbacks cb 0x560e8e1e42b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:34.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.629+0000 7fd9a9800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e288df0 0x560e8e28f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.629+0000 7fd9a3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e28f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd9a3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e28f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44792/0 (socket says 172.21.15.8:44792) 2024-03-16T21:06:34.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd9a9800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e288df0 0x560e8e28f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43894/0 (socket says 172.21.15.8:43894) 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd9a3e00640 1 -- 172.21.15.8:0/2503684309 learned_addr learned my addr 172.21.15.8:0/2503684309 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd9a9800640 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e2922f0 0x560e8e28fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd9a3e00640 1 -- 172.21.15.8:0/2503684309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e2922f0 msgr2=0x560e8e28fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd9a3e00640 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e2922f0 0x560e8e28fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd9a3e00640 1 -- 172.21.15.8:0/2503684309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e288df0 msgr2=0x560e8e28f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd9a3e00640 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e288df0 0x560e8e28f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd9a3e00640 1 -- 172.21.15.8:0/2503684309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a41150b0 con 0x560e8e289710 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd9a9800640 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e288df0 0x560e8e28f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd9a3e00640 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e28f860 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd990012d00 tx=0x7fd99000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a09e9f019940d62 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd98aa00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.630+0000 7fd98aa00640 1 -- 172.21.15.8:0/2503684309 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990017070 con 0x560e8e289710 2024-03-16T21:06:34.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd98aa00640 1 -- 172.21.15.8:0/2503684309 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd990009d90 con 0x560e8e289710 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2503684309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e8deef7e0 con 0x560e8e289710 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd98aa00640 1 -- 172.21.15.8:0/2503684309 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd990012110 con 0x560e8e289710 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd9ae5be740 10 client.27476 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2503684309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560e8e1ee5a0 con 0x560e8e289710 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd98aa00640 1 -- 172.21.15.8:0/2503684309 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x560e8deef7e0 con 0x560e8e289710 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd98aa00640 1 -- 172.21.15.8:0/2503684309 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fd990003d10 con 0x560e8e289710 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd9ae5be740 10 client.27476 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd9ae5be740 10 client.27476 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd9ae5be740 20 client.27476 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x560e8e2a2390 0x560e8e2a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.631+0000 7fd9ae5be740 4 client.27476 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.632+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2503684309 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e8df2c720 con 0x560e8e2a2390 2024-03-16T21:06:34.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.632+0000 7fd9a9800640 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x560e8e2a2390 0x560e8e2a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.632+0000 7fd9a9800640 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x560e8e2a2390 0x560e8e2a47b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ef2bae9f7cffe012 server_cookie=bd5985528b1cd269 in_seq=0 out_seq=0 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.632+0000 7fd98aa00640 10 client.27476 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.633+0000 7fd98aa00640 1 -- 172.21.15.8:0/2503684309 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560e8df2c720 con 0x560e8e2a2390 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.633+0000 7fd98aa00640 10 client.27476 handle_command_reply: tid=0 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.633+0000 7fd9ae5be740 1 client.27476 shutdown 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.633+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2503684309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 msgr2=0x560e8e28f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.633+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e28f860 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd990012d00 tx=0x7fd99000f790 comp rx=0 tx=0).stop 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.634+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2503684309 shutdown_connections 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.634+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x560e8e2a2390 0x560e8e2a47b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.634+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e2922f0 0x560e8e28fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.634+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e28f860 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.634+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2503684309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e288df0 0x560e8e28f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.634+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2503684309 >> 172.21.15.8:0/2503684309 conn(0x560e8e283520 msgr2=0x560e8e285270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.634+0000 7fd98aa00640 0 client.27476 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:06:34.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.634+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2503684309 shutdown_connections 2024-03-16T21:06:34.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.634+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2503684309 wait complete. 2024-03-16T21:06:34.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.634+0000 7fd9ae5be740 20 client.27476 trim_cache size 0 max 16384 2024-03-16T21:06:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.647+0000 7fd9ae5be740 1 Processor -- start 2024-03-16T21:06:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9ae5be740 1 -- start start 2024-03-16T21:06:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e291a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e29d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e2922f0 0x560e8e29db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8e290670 con 0x560e8e2922f0 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8e29e0c0 con 0x560e8e289710 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8e28af60 con 0x560e8e288df0 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9a3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e29d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9a3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e29d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44808/0 (socket says 172.21.15.8:44808) 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9a3e00640 1 -- 172.21.15.8:0/903104729 learned_addr learned my addr 172.21.15.8:0/903104729 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9a9800640 1 --2- 172.21.15.8:0/903104729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e291a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.648+0000 7fd9a9800640 1 --2- 172.21.15.8:0/903104729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e2922f0 0x560e8e29db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.649+0000 7fd9a3e00640 1 -- 172.21.15.8:0/903104729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 msgr2=0x560e8e291a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.649+0000 7fd9a3e00640 1 --2- 172.21.15.8:0/903104729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e291a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.649+0000 7fd9a3e00640 1 -- 172.21.15.8:0/903104729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e2922f0 msgr2=0x560e8e29db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.649+0000 7fd9a3e00640 1 --2- 172.21.15.8:0/903104729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e2922f0 0x560e8e29db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.649+0000 7fd9a3e00640 1 -- 172.21.15.8:0/903104729 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e8e18aab0 con 0x560e8e289710 2024-03-16T21:06:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.649+0000 7fd9a9800640 1 --2- 172.21.15.8:0/903104729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e2922f0 0x560e8e29db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:06:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.649+0000 7fd9a3e00640 1 --2- 172.21.15.8:0/903104729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e29d640 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd990010480 tx=0x7fd990005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e64f8e6648e119dc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.649+0000 7fd995600640 1 -- 172.21.15.8:0/903104729 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990017070 con 0x560e8e289710 2024-03-16T21:06:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.649+0000 7fd995600640 1 -- 172.21.15.8:0/903104729 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd990009d90 con 0x560e8e289710 2024-03-16T21:06:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.649+0000 7fd995600640 1 -- 172.21.15.8:0/903104729 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990005470 con 0x560e8e289710 2024-03-16T21:06:34.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.650+0000 7fd9ae5be740 1 -- 172.21.15.8:0/903104729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 msgr2=0x560e8e29d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.650+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/903104729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e29d640 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd990010480 tx=0x7fd990005850 comp rx=0 tx=0).stop 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.650+0000 7fd9ae5be740 1 -- 172.21.15.8:0/903104729 shutdown_connections 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.650+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/903104729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e2922f0 0x560e8e29db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.650+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/903104729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e289710 0x560e8e29d640 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.650+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/903104729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e291a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.650+0000 7fd9ae5be740 1 -- 172.21.15.8:0/903104729 >> 172.21.15.8:0/903104729 conn(0x560e8e283520 msgr2=0x560e8e2826c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.650+0000 7fd9ae5be740 1 -- 172.21.15.8:0/903104729 shutdown_connections 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.650+0000 7fd9ae5be740 1 -- 172.21.15.8:0/903104729 wait complete. 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.650+0000 7fd9ae5be740 1 -- start start 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9ae5be740 1 Processor -- start 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e2965e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e289710 0x560e8e296b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9ae5be740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e2922f0 0x560e8e297060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8e2fdc70 con 0x560e8e289710 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8e2fddb0 con 0x560e8e2922f0 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9ae5be740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e8e2fdef0 con 0x560e8e288df0 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9ae5be740 10 client.0 _ll_register_callbacks cb 0x7fd990009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9a9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e2965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9a3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e289710 0x560e8e296b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9a3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e289710 0x560e8e296b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43916/0 (socket says 172.21.15.8:43916) 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9a3e00640 1 -- 172.21.15.8:0/2000284959 learned_addr learned my addr 172.21.15.8:0/2000284959 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.651+0000 7fd9a9800640 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e2922f0 0x560e8e297060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.652+0000 7fd9a3e00640 1 -- 172.21.15.8:0/2000284959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 msgr2=0x560e8e2965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.652+0000 7fd9a3e00640 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e2965e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.652+0000 7fd9a3e00640 1 -- 172.21.15.8:0/2000284959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e2922f0 msgr2=0x560e8e297060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.652+0000 7fd9a3e00640 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e2922f0 0x560e8e297060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.652+0000 7fd9a3e00640 1 -- 172.21.15.8:0/2000284959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e8e1ee5a0 con 0x560e8e289710 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.652+0000 7fd9a9800640 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e2922f0 0x560e8e297060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.652+0000 7fd9a3e00640 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e289710 0x560e8e296b20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd990010870 tx=0x7fd9900108a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887e0abd73f06ad4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.652+0000 7fd98aa00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.652+0000 7fd98aa00640 1 -- 172.21.15.8:0/2000284959 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990017070 con 0x560e8e289710 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.652+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2000284959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd99c003970 con 0x560e8e289710 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.652+0000 7fd98aa00640 1 -- 172.21.15.8:0/2000284959 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd990000e40 con 0x560e8e289710 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.653+0000 7fd98aa00640 1 -- 172.21.15.8:0/2000284959 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd990011f10 con 0x560e8e289710 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.653+0000 7fd9ae5be740 10 client.17298 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.653+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2000284959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560e8e1b0650 con 0x560e8e289710 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.653+0000 7fd98aa00640 1 -- 172.21.15.8:0/2000284959 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd99c003970 con 0x560e8e289710 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.653+0000 7fd98aa00640 1 -- 172.21.15.8:0/2000284959 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fd99002ebd0 con 0x560e8e289710 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.653+0000 7fd9ae5be740 10 client.17298 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.653+0000 7fd9ae5be740 10 client.17298 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:06:34.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.653+0000 7fd9ae5be740 20 client.17298 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.653+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x560e8e2ff340 0x560e8e301760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.653+0000 7fd9ae5be740 4 client.17298 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.653+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2000284959 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560e8df7b890 con 0x560e8e2ff340 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.654+0000 7fd9a9800640 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x560e8e2ff340 0x560e8e301760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.654+0000 7fd9a9800640 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x560e8e2ff340 0x560e8e301760 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=64889b72770a35f7 server_cookie=26bc546e11a55cd4 in_seq=0 out_seq=0 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.654+0000 7fd98aa00640 10 client.17298 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.654+0000 7fd98aa00640 1 -- 172.21.15.8:0/2000284959 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560e8df7b890 con 0x560e8e2ff340 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.654+0000 7fd98aa00640 10 client.17298 handle_command_reply: tid=0 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.654+0000 7fd9ae5be740 1 client.17298 shutdown 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.654+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2000284959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e289710 msgr2=0x560e8e296b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.654+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e289710 0x560e8e296b20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd990010870 tx=0x7fd9900108a0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.655+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2000284959 shutdown_connections 2024-03-16T21:06:34.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.655+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x560e8e2ff340 0x560e8e301760 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.655+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560e8e2922f0 0x560e8e297060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.655+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560e8e289710 0x560e8e296b20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.655+0000 7fd9ae5be740 1 --2- 172.21.15.8:0/2000284959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560e8e288df0 0x560e8e2965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.655+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2000284959 >> 172.21.15.8:0/2000284959 conn(0x560e8e283520 msgr2=0x560e8e28f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.655+0000 7fd98aa00640 0 client.17298 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:06:34.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.655+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2000284959 shutdown_connections 2024-03-16T21:06:34.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.655+0000 7fd9ae5be740 1 -- 172.21.15.8:0/2000284959 wait complete. 2024-03-16T21:06:34.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.655+0000 7fd9ae5be740 20 client.17298 trim_cache size 0 max 16384 2024-03-16T21:06:34.665 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:06:34.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 -- 172.21.15.8:0/1604311906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd98c0a1ba0 msgr2=0x7fd98c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd98c0a1ba0 0x7fd98c0a4060 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x560e8e2888c0 tx=0x7fd9980d3530 comp rx=0 tx=0).stop 2024-03-16T21:06:34.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 -- 172.21.15.8:0/1604311906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a4107a30 msgr2=0x7fd9a419e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a4107a30 0x7fd9a419e150 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd99800e9f0 tx=0x7fd99800eeb0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 -- 172.21.15.8:0/1604311906 shutdown_connections 2024-03-16T21:06:34.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd98c0a1ba0 0x7fd98c0a4060 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9a410d9d0 0x7fd9a41a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41083d0 0x7fd9a419e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 --2- 172.21.15.8:0/1604311906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9a4107a30 0x7fd9a419e150 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 -- 172.21.15.8:0/1604311906 >> 172.21.15.8:0/1604311906 conn(0x7fd9a4077310 msgr2=0x7fd9a4078390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 -- 172.21.15.8:0/1604311906 shutdown_connections 2024-03-16T21:06:34.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.656+0000 7fd9aa200640 1 -- 172.21.15.8:0/1604311906 wait complete. 2024-03-16T21:06:34.682 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:06:34.682 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:06:34.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.900+0000 7f084b000640 1 -- 172.21.15.8:0/3489091061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0844109650 msgr2=0x7f0844109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.900+0000 7f084b000640 1 --2- 172.21.15.8:0/3489091061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0844109650 0x7f0844109a30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0838009930 tx=0x7f083802bc30 comp rx=0 tx=0).stop 2024-03-16T21:06:34.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.900+0000 7f084b000640 1 -- 172.21.15.8:0/3489091061 shutdown_connections 2024-03-16T21:06:34.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.900+0000 7f084b000640 1 --2- 172.21.15.8:0/3489091061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0844103f50 0x7f0844110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.900+0000 7f084b000640 1 --2- 172.21.15.8:0/3489091061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0844103590 0x7f0844103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.900+0000 7f084b000640 1 --2- 172.21.15.8:0/3489091061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0844109650 0x7f0844109a30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.900+0000 7f084b000640 1 -- 172.21.15.8:0/3489091061 >> 172.21.15.8:0/3489091061 conn(0x7f08440ff020 msgr2=0x7f0844101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.900+0000 7f084b000640 1 -- 172.21.15.8:0/3489091061 shutdown_connections 2024-03-16T21:06:34.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.900+0000 7f084b000640 1 -- 172.21.15.8:0/3489091061 wait complete. 2024-03-16T21:06:34.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.901+0000 7f084b000640 1 Processor -- start 2024-03-16T21:06:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.901+0000 7f084b000640 1 -- start start 2024-03-16T21:06:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.901+0000 7f084b000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0844103590 0x7f084419f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.901+0000 7f084b000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0844103f50 0x7f084419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.901+0000 7f084b000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0844109650 0x7f0844199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.901+0000 7f084b000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084419a110 con 0x7f0844103f50 2024-03-16T21:06:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.901+0000 7f084b000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084419a280 con 0x7f0844103590 2024-03-16T21:06:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.901+0000 7f084b000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084419a440 con 0x7f0844109650 2024-03-16T21:06:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f0849c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0844103590 0x7f084419f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f0849200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0844103f50 0x7f084419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f0849c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0844103590 0x7f084419f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44834/0 (socket says 172.21.15.8:44834) 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f0849c00640 1 -- 172.21.15.8:0/2105898711 learned_addr learned my addr 172.21.15.8:0/2105898711 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f084a600640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0844109650 0x7f0844199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f0849c00640 1 -- 172.21.15.8:0/2105898711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0844109650 msgr2=0x7f0844199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f0849c00640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0844109650 0x7f0844199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f0849c00640 1 -- 172.21.15.8:0/2105898711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0844103f50 msgr2=0x7f084419fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f0849c00640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0844103f50 0x7f084419fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f0849c00640 1 -- 172.21.15.8:0/2105898711 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838009560 con 0x7f0844103590 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f084a600640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0844109650 0x7f0844199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f0849200640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0844103f50 0x7f084419fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.902+0000 7f0849c00640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0844103590 0x7f084419f910 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0838000c00 tx=0x7f083802cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.903+0000 7f0842000640 1 -- 172.21.15.8:0/2105898711 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838004250 con 0x7f0844103590 2024-03-16T21:06:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.903+0000 7f0842000640 1 -- 172.21.15.8:0/2105898711 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f08380043b0 con 0x7f0844103590 2024-03-16T21:06:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.903+0000 7f084b000640 1 -- 172.21.15.8:0/2105898711 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084419a6c0 con 0x7f0844103590 2024-03-16T21:06:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.903+0000 7f0842000640 1 -- 172.21.15.8:0/2105898711 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838003be0 con 0x7f0844103590 2024-03-16T21:06:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.903+0000 7f084b000640 1 -- 172.21.15.8:0/2105898711 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08441a69b0 con 0x7f0844103590 2024-03-16T21:06:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.906+0000 7f0842000640 1 -- 172.21.15.8:0/2105898711 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f0838003d40 con 0x7f0844103590 2024-03-16T21:06:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.906+0000 7f084f3a0740 1 Processor -- start 2024-03-16T21:06:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.906+0000 7f084f3a0740 1 -- start start 2024-03-16T21:06:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 0x5563574cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cb710 0x5563574d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574d42f0 0x5563574d66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f084f3a0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556357439210 con 0x5563574cadf0 2024-03-16T21:06:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f084f3a0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556357436740 con 0x5563574d42f0 2024-03-16T21:06:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f084f3a0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556357431f20 con 0x5563574cb710 2024-03-16T21:06:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f084a600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 0x5563574cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f084a600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 0x5563574cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43932/0 (socket says 172.21.15.8:43932) 2024-03-16T21:06:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f084a600640 1 -- 172.21.15.8:0/3997926966 learned_addr learned my addr 172.21.15.8:0/3997926966 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f0849200640 1 --2- 172.21.15.8:0/3997926966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574d42f0 0x5563574d66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f0849c00640 1 --2- 172.21.15.8:0/3997926966 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cb710 0x5563574d3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.907+0000 7f084a600640 1 -- 172.21.15.8:0/3997926966 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cb710 msgr2=0x5563574d3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f084a600640 1 --2- 172.21.15.8:0/3997926966 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cb710 0x5563574d3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f084a600640 1 -- 172.21.15.8:0/3997926966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574d42f0 msgr2=0x5563574d66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f084a600640 1 --2- 172.21.15.8:0/3997926966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574d42f0 0x5563574d66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f084a600640 1 -- 172.21.15.8:0/3997926966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563573f3df0 con 0x5563574cadf0 2024-03-16T21:06:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f0849c00640 1 --2- 172.21.15.8:0/3997926966 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cb710 0x5563574d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:06:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f0849200640 1 --2- 172.21.15.8:0/3997926966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574d42f0 0x5563574d66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f0842000640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f082c0a1ba0 0x7f082c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f084a600640 1 --2- 172.21.15.8:0/3997926966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 0x5563574cb1d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f083c0117e0 tx=0x7f083c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76684d9719dc7459 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f0842000640 1 -- 172.21.15.8:0/2105898711 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f08380efcb0 con 0x7f0844103590 2024-03-16T21:06:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f0849c00640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f082c0a1ba0 0x7f082c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f0836a00640 1 -- 172.21.15.8:0/3997926966 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c011310 con 0x5563574cadf0 2024-03-16T21:06:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f0836a00640 1 -- 172.21.15.8:0/3997926966 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f083c003e70 con 0x5563574cadf0 2024-03-16T21:06:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.908+0000 7f0836a00640 1 -- 172.21.15.8:0/3997926966 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c004620 con 0x5563574cadf0 2024-03-16T21:06:34.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.909+0000 7f084f3a0740 1 -- 172.21.15.8:0/3997926966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 msgr2=0x5563574cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.909+0000 7f0849c00640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f082c0a1ba0 0x7f082c0a4060 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5563574ca8c0 tx=0x7f0838009260 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.909+0000 7f084f3a0740 1 --2- 172.21.15.8:0/3997926966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 0x5563574cb1d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f083c0117e0 tx=0x7f083c011ca0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.909+0000 7f084f3a0740 1 -- 172.21.15.8:0/3997926966 shutdown_connections 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.909+0000 7f084f3a0740 1 --2- 172.21.15.8:0/3997926966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574d42f0 0x5563574d66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.909+0000 7f084f3a0740 1 --2- 172.21.15.8:0/3997926966 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cb710 0x5563574d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.909+0000 7f084f3a0740 1 --2- 172.21.15.8:0/3997926966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 0x5563574cb1d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.909+0000 7f084f3a0740 1 -- 172.21.15.8:0/3997926966 >> 172.21.15.8:0/3997926966 conn(0x5563574c5520 msgr2=0x5563574c5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.909+0000 7f084f3a0740 1 -- 172.21.15.8:0/3997926966 shutdown_connections 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.909+0000 7f084f3a0740 1 -- 172.21.15.8:0/3997926966 wait complete. 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.910+0000 7f084f3a0740 1 -- start start 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.910+0000 7f084f3a0740 1 Processor -- start 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.910+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 0x5563574d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 0x5563574d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574d42f0 0x5563574d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f084f3a0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563573d7150 con 0x5563574cadf0 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f084f3a0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563573d6df0 con 0x5563574cb710 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f084f3a0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563571a01c0 con 0x5563574d42f0 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f084f3a0740 10 client.0 _ll_register_callbacks cb 0x5563574262b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f084a600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 0x5563574d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f0849200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 0x5563574d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f084a600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 0x5563574d1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43936/0 (socket says 172.21.15.8:43936) 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f084a600640 1 -- 172.21.15.8:0/358536349 learned_addr learned my addr 172.21.15.8:0/358536349 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f084a600640 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574d42f0 0x5563574d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f0849200640 1 -- 172.21.15.8:0/358536349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574d42f0 msgr2=0x5563574d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f0849200640 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574d42f0 0x5563574d1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f0849200640 1 -- 172.21.15.8:0/358536349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 msgr2=0x5563574d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f0849200640 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 0x5563574d1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.911+0000 7f0849200640 1 -- 172.21.15.8:0/358536349 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083c0114c0 con 0x5563574cb710 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.912+0000 7f0849200640 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 0x5563574d18c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0844108c10 tx=0x7f083000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8b9eebb4aec637f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.912+0000 7f082b400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.912+0000 7f082b400640 1 -- 172.21.15.8:0/358536349 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830017070 con 0x5563574cb710 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.912+0000 7f082b400640 1 -- 172.21.15.8:0/358536349 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f08300120d0 con 0x5563574cb710 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.912+0000 7f084f3a0740 1 -- 172.21.15.8:0/358536349 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563571317e0 con 0x5563574cb710 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.912+0000 7f082b400640 1 -- 172.21.15.8:0/358536349 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0830012290 con 0x5563574cb710 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.912+0000 7f084f3a0740 10 client.27494 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.912+0000 7f084f3a0740 1 -- 172.21.15.8:0/358536349 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5563574305a0 con 0x5563574cb710 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.912+0000 7f082b400640 1 -- 172.21.15.8:0/358536349 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5563571317e0 con 0x5563574cb710 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.913+0000 7f082b400640 1 -- 172.21.15.8:0/358536349 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f083001c460 con 0x5563574cb710 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.913+0000 7f084f3a0740 10 client.27494 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.913+0000 7f084f3a0740 10 client.27494 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:06:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.913+0000 7f084f3a0740 20 client.27494 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.913+0000 7f084f3a0740 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5563574e44d0 0x5563574e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.913+0000 7f084f3a0740 4 client.27494 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.913+0000 7f084f3a0740 1 -- 172.21.15.8:0/358536349 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55635716e720 con 0x5563574e44d0 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.913+0000 7f084a600640 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5563574e44d0 0x5563574e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.914+0000 7f084a600640 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5563574e44d0 0x5563574e68f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=49177f29a6de5011 server_cookie=ab6e09e65ce28d2a in_seq=0 out_seq=0 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.914+0000 7f082b400640 10 client.27494 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f082b400640 1 -- 172.21.15.8:0/358536349 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55635716e720 con 0x5563574e44d0 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f082b400640 10 client.27494 handle_command_reply: tid=0 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 1 client.27494 shutdown 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 1 -- 172.21.15.8:0/358536349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 msgr2=0x5563574d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 0x5563574d18c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0844108c10 tx=0x7f083000f790 comp rx=0 tx=0).stop 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 1 -- 172.21.15.8:0/358536349 shutdown_connections 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5563574e44d0 0x5563574e68f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574d42f0 0x5563574d1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 0x5563574d18c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 1 --2- 172.21.15.8:0/358536349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cadf0 0x5563574d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 1 -- 172.21.15.8:0/358536349 >> 172.21.15.8:0/358536349 conn(0x5563574c5520 msgr2=0x5563574c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f082b400640 0 client.27494 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:06:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 1 -- 172.21.15.8:0/358536349 shutdown_connections 2024-03-16T21:06:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 1 -- 172.21.15.8:0/358536349 wait complete. 2024-03-16T21:06:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.915+0000 7f084f3a0740 20 client.27494 trim_cache size 0 max 16384 2024-03-16T21:06:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.929+0000 7f084f3a0740 1 Processor -- start 2024-03-16T21:06:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.929+0000 7f084f3a0740 1 -- start start 2024-03-16T21:06:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.929+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 0x5563574d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.929+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cb710 0x5563574cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.929+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574d42f0 0x5563574d1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.929+0000 7f084f3a0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563574c7830 con 0x5563574cb710 2024-03-16T21:06:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.929+0000 7f084f3a0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563574ccf60 con 0x5563574d42f0 2024-03-16T21:06:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.929+0000 7f084f3a0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563574c5050 con 0x5563574cadf0 2024-03-16T21:06:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.930+0000 7f084a600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 0x5563574d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.930+0000 7f0849200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cb710 0x5563574cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.930+0000 7f084a600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 0x5563574d3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58046/0 (socket says 172.21.15.8:58046) 2024-03-16T21:06:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.930+0000 7f084a600640 1 -- 172.21.15.8:0/4232999394 learned_addr learned my addr 172.21.15.8:0/4232999394 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.930+0000 7f084a600640 1 --2- 172.21.15.8:0/4232999394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574d42f0 0x5563574d1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.930+0000 7f084a600640 1 -- 172.21.15.8:0/4232999394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574d42f0 msgr2=0x5563574d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.930+0000 7f084a600640 1 --2- 172.21.15.8:0/4232999394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574d42f0 0x5563574d1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.930+0000 7f084a600640 1 -- 172.21.15.8:0/4232999394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cb710 msgr2=0x5563574cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.930+0000 7f084a600640 1 --2- 172.21.15.8:0/4232999394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cb710 0x5563574cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.930+0000 7f084a600640 1 -- 172.21.15.8:0/4232999394 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563573ccab0 con 0x5563574cadf0 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.930+0000 7f0849200640 1 --2- 172.21.15.8:0/4232999394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cb710 0x5563574cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.931+0000 7f084a600640 1 --2- 172.21.15.8:0/4232999394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 0x5563574d3ab0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f083c004270 tx=0x7f083c004200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee67520448d9c97b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.931+0000 7f0836000640 1 -- 172.21.15.8:0/4232999394 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00f9a0 con 0x5563574cadf0 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.931+0000 7f0836000640 1 -- 172.21.15.8:0/4232999394 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f083c033070 con 0x5563574cadf0 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.931+0000 7f0836000640 1 -- 172.21.15.8:0/4232999394 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c02d9c0 con 0x5563574cadf0 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.931+0000 7f084f3a0740 1 -- 172.21.15.8:0/4232999394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 msgr2=0x5563574d3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.931+0000 7f084f3a0740 1 --2- 172.21.15.8:0/4232999394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 0x5563574d3ab0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f083c004270 tx=0x7f083c004200 comp rx=0 tx=0).stop 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.931+0000 7f084f3a0740 1 -- 172.21.15.8:0/4232999394 shutdown_connections 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.931+0000 7f084f3a0740 1 --2- 172.21.15.8:0/4232999394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574d42f0 0x5563574d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.931+0000 7f084f3a0740 1 --2- 172.21.15.8:0/4232999394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574cb710 0x5563574cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.931+0000 7f084f3a0740 1 --2- 172.21.15.8:0/4232999394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 0x5563574d3ab0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.931+0000 7f084f3a0740 1 -- 172.21.15.8:0/4232999394 >> 172.21.15.8:0/4232999394 conn(0x5563574c5520 msgr2=0x5563574c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.932+0000 7f084f3a0740 1 -- 172.21.15.8:0/4232999394 shutdown_connections 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.932+0000 7f084f3a0740 1 -- 172.21.15.8:0/4232999394 wait complete. 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.932+0000 7f084f3a0740 1 -- start start 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.932+0000 7f084f3a0740 1 Processor -- start 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 0x5563574d91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 0x5563574d96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f084f3a0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574d42f0 0x5563574d9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f084f3a0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563574cf200 con 0x5563574d42f0 2024-03-16T21:06:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f084f3a0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563574cf370 con 0x5563574cb710 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f084f3a0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55635753fdb0 con 0x5563574cadf0 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f084f3a0740 10 client.0 _ll_register_callbacks cb 0x7f0830009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f084a600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 0x5563574d91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f0849200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 0x5563574d96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f0849200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 0x5563574d96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44868/0 (socket says 172.21.15.8:44868) 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f084a600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 0x5563574d91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58058/0 (socket says 172.21.15.8:58058) 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f0849200640 1 -- 172.21.15.8:0/4149645171 learned_addr learned my addr 172.21.15.8:0/4149645171 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f084a600640 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574d42f0 0x5563574d9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f0849200640 1 -- 172.21.15.8:0/4149645171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 msgr2=0x5563574d91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f0849200640 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 0x5563574d91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f0849200640 1 -- 172.21.15.8:0/4149645171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574d42f0 msgr2=0x5563574d9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f0849200640 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574d42f0 0x5563574d9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f0849200640 1 -- 172.21.15.8:0/4149645171 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563574305a0 con 0x5563574cb710 2024-03-16T21:06:34.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.933+0000 7f084a600640 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574d42f0 0x5563574d9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:06:34.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.934+0000 7f0849200640 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 0x5563574d96f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x5563574d0be0 tx=0x7f083000fd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba7101473854c19a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:34.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.934+0000 7f082b400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:34.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.934+0000 7f082b400640 1 -- 172.21.15.8:0/4149645171 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830017070 con 0x5563574cb710 2024-03-16T21:06:34.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.934+0000 7f082b400640 1 -- 172.21.15.8:0/4149645171 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f083001cb70 con 0x5563574cb710 2024-03-16T21:06:34.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.934+0000 7f084f3a0740 1 -- 172.21.15.8:0/4149645171 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563574c0c30 con 0x5563574cb710 2024-03-16T21:06:34.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.934+0000 7f082b400640 1 -- 172.21.15.8:0/4149645171 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08300122d0 con 0x5563574cb710 2024-03-16T21:06:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.934+0000 7f084f3a0740 10 client.27500 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.934+0000 7f084f3a0740 1 -- 172.21.15.8:0/4149645171 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5563573f3df0 con 0x5563574cb710 2024-03-16T21:06:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.935+0000 7f082b400640 1 -- 172.21.15.8:0/4149645171 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5563574c0c30 con 0x5563574cb710 2024-03-16T21:06:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.935+0000 7f082b400640 1 -- 172.21.15.8:0/4149645171 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f08300038c0 con 0x5563574cb710 2024-03-16T21:06:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.935+0000 7f084f3a0740 10 client.27500 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.935+0000 7f084f3a0740 10 client.27500 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:06:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.935+0000 7f084f3a0740 20 client.27500 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.935+0000 7f084f3a0740 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x556357541580 0x5563575439a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.935+0000 7f084f3a0740 4 client.27500 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.935+0000 7f084f3a0740 1 -- 172.21.15.8:0/4149645171 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f083c003e70 con 0x556357541580 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.935+0000 7f084a600640 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x556357541580 0x5563575439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084a600640 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x556357541580 0x5563575439a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3503fa155c200465 server_cookie=4719fc05d97af99e in_seq=0 out_seq=0 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f082b400640 10 client.27500 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f082b400640 1 -- 172.21.15.8:0/4149645171 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f083c003e70 con 0x556357541580 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f082b400640 10 client.27500 handle_command_reply: tid=0 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084f3a0740 1 client.27500 shutdown 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084f3a0740 1 -- 172.21.15.8:0/4149645171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 msgr2=0x5563574d96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084f3a0740 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 0x5563574d96f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x5563574d0be0 tx=0x7f083000fd00 comp rx=0 tx=0).stop 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084f3a0740 1 -- 172.21.15.8:0/4149645171 shutdown_connections 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084f3a0740 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x556357541580 0x5563575439a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084f3a0740 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5563574d42f0 0x5563574d9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084f3a0740 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563574cb710 0x5563574d96f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084f3a0740 1 --2- 172.21.15.8:0/4149645171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5563574cadf0 0x5563574d91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f082b400640 0 client.27500 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:06:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084f3a0740 1 -- 172.21.15.8:0/4149645171 >> 172.21.15.8:0/4149645171 conn(0x5563574c5520 msgr2=0x5563574c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084f3a0740 1 -- 172.21.15.8:0/4149645171 shutdown_connections 2024-03-16T21:06:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.936+0000 7f084f3a0740 1 -- 172.21.15.8:0/4149645171 wait complete. 2024-03-16T21:06:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084f3a0740 20 client.27500 trim_cache size 0 max 16384 2024-03-16T21:06:34.947 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:06:34.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 -- 172.21.15.8:0/2105898711 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f082c0a1ba0 msgr2=0x7f082c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f082c0a1ba0 0x7f082c0a4060 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5563574ca8c0 tx=0x7f0838009260 comp rx=0 tx=0).stop 2024-03-16T21:06:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 -- 172.21.15.8:0/2105898711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0844103590 msgr2=0x7f084419f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0844103590 0x7f084419f910 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0838000c00 tx=0x7f083802cc20 comp rx=0 tx=0).stop 2024-03-16T21:06:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 -- 172.21.15.8:0/2105898711 shutdown_connections 2024-03-16T21:06:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f082c0a1ba0 0x7f082c0a4060 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0844109650 0x7f0844199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0844103f50 0x7f084419fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 --2- 172.21.15.8:0/2105898711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0844103590 0x7f084419f910 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 -- 172.21.15.8:0/2105898711 >> 172.21.15.8:0/2105898711 conn(0x7f08440ff020 msgr2=0x7f08441005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 -- 172.21.15.8:0/2105898711 shutdown_connections 2024-03-16T21:06:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:34.937+0000 7f084b000640 1 -- 172.21.15.8:0/2105898711 wait complete. 2024-03-16T21:06:34.961 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:06:34.961 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:06:35.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.171+0000 7f0bf6e00640 1 -- 172.21.15.8:0/3460331221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bf0112490 msgr2=0x7f0bf0114880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:35.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.171+0000 7f0bf6e00640 1 --2- 172.21.15.8:0/3460331221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bf0112490 0x7f0bf0114880 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009900 tx=0x7f0be802bcd0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.171+0000 7f0bf6e00640 1 -- 172.21.15.8:0/3460331221 shutdown_connections 2024-03-16T21:06:35.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.171+0000 7f0bf6e00640 1 --2- 172.21.15.8:0/3460331221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bf0112490 0x7f0bf0114880 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.171+0000 7f0bf6e00640 1 --2- 172.21.15.8:0/3460331221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bf00741b0 0x7f0bf0111f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.171+0000 7f0bf6e00640 1 --2- 172.21.15.8:0/3460331221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf0073890 0x7f0bf0073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.171+0000 7f0bf6e00640 1 -- 172.21.15.8:0/3460331221 >> 172.21.15.8:0/3460331221 conn(0x7f0bf00788f0 msgr2=0x7f0bf0078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:35.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.172+0000 7f0bf6e00640 1 -- 172.21.15.8:0/3460331221 shutdown_connections 2024-03-16T21:06:35.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.172+0000 7f0bf6e00640 1 -- 172.21.15.8:0/3460331221 wait complete. 2024-03-16T21:06:35.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.173+0000 7f0bf6e00640 1 Processor -- start 2024-03-16T21:06:35.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.173+0000 7f0bf6e00640 1 -- start start 2024-03-16T21:06:35.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.173+0000 7f0bf6e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf0073890 0x7f0bf019e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.173+0000 7f0bf6e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bf00741b0 0x7f0bf019e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.173+0000 7f0bf6e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bf0112490 0x7f0bf01a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.173+0000 7f0bf6e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf01a3060 con 0x7f0bf00741b0 2024-03-16T21:06:35.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.173+0000 7f0bf6e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf01a31d0 con 0x7f0bf0112490 2024-03-16T21:06:35.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.173+0000 7f0bf6e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf01a3390 con 0x7f0bf0073890 2024-03-16T21:06:35.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.174+0000 7f0befe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf0073890 0x7f0bf019e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.174+0000 7f0bef400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bf00741b0 0x7f0bf019e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.174+0000 7f0befe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf0073890 0x7f0bf019e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58074/0 (socket says 172.21.15.8:58074) 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.174+0000 7f0befe00640 1 -- 172.21.15.8:0/4033880017 learned_addr learned my addr 172.21.15.8:0/4033880017 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.174+0000 7f0bf4e00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bf0112490 0x7f0bf01a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.174+0000 7f0befe00640 1 -- 172.21.15.8:0/4033880017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bf0112490 msgr2=0x7f0bf01a2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.174+0000 7f0befe00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bf0112490 0x7f0bf01a2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.174+0000 7f0befe00640 1 -- 172.21.15.8:0/4033880017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bf00741b0 msgr2=0x7f0bf019e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.174+0000 7f0befe00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bf00741b0 0x7f0bf019e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.174+0000 7f0befe00640 1 -- 172.21.15.8:0/4033880017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be8009560 con 0x7f0bf0073890 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.174+0000 7f0bf4e00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bf0112490 0x7f0bf01a2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.175+0000 7f0befe00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf0073890 0x7f0bf019e1a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0be000e9f0 tx=0x7f0be000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.175+0000 7f0becc00640 1 -- 172.21.15.8:0/4033880017 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be0009700 con 0x7f0bf0073890 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.175+0000 7f0becc00640 1 -- 172.21.15.8:0/4033880017 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0be000cd80 con 0x7f0bf0073890 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.175+0000 7f0becc00640 1 -- 172.21.15.8:0/4033880017 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be00189c0 con 0x7f0bf0073890 2024-03-16T21:06:35.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.175+0000 7f0bf6e00640 1 -- 172.21.15.8:0/4033880017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf01a3670 con 0x7f0bf0073890 2024-03-16T21:06:35.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.175+0000 7f0bf6e00640 1 -- 172.21.15.8:0/4033880017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf01aaef0 con 0x7f0bf0073890 2024-03-16T21:06:35.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.178+0000 7f0bf9bae740 1 Processor -- start 2024-03-16T21:06:35.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.178+0000 7f0bf9bae740 1 -- start start 2024-03-16T21:06:35.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0becc00640 1 -- 172.21.15.8:0/4033880017 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f0be0018b20 con 0x7f0bf0073890 2024-03-16T21:06:35.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 0x562cc09ff020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 0x562cc0a07c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a0a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc096d210 con 0x562cc09ff560 2024-03-16T21:06:35.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc096a740 con 0x562cc09fec40 2024-03-16T21:06:35.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc0965f20 con 0x562cc0a08140 2024-03-16T21:06:35.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bf4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 0x562cc09ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bef400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a0a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bef400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a0a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58086/0 (socket says 172.21.15.8:58086) 2024-03-16T21:06:35.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bf4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 0x562cc09ff020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44894/0 (socket says 172.21.15.8:44894) 2024-03-16T21:06:35.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bef400640 1 -- 172.21.15.8:0/2624961971 learned_addr learned my addr 172.21.15.8:0/2624961971 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:35.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0befe00640 1 --2- 172.21.15.8:0/2624961971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 0x562cc0a07c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bef400640 1 -- 172.21.15.8:0/2624961971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 msgr2=0x562cc09ff020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:35.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bef400640 1 --2- 172.21.15.8:0/2624961971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 0x562cc09ff020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bef400640 1 -- 172.21.15.8:0/2624961971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 msgr2=0x562cc0a07c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:35.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.179+0000 7f0bef400640 1 --2- 172.21.15.8:0/2624961971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 0x562cc0a07c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.180+0000 7f0bef400640 1 -- 172.21.15.8:0/2624961971 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cc0927df0 con 0x562cc0a08140 2024-03-16T21:06:35.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.180+0000 7f0bef400640 1 --2- 172.21.15.8:0/2624961971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a0a530 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009fd0 tx=0x7f0bd80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=611d06a3eccb419e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:35.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.180+0000 7f0be5600640 1 -- 172.21.15.8:0/2624961971 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8003c30 con 0x562cc0a08140 2024-03-16T21:06:35.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.180+0000 7f0be5600640 1 -- 172.21.15.8:0/2624961971 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0bd8003d90 con 0x562cc0a08140 2024-03-16T21:06:35.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.180+0000 7f0be5600640 1 -- 172.21.15.8:0/2624961971 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd800fb50 con 0x562cc0a08140 2024-03-16T21:06:35.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.180+0000 7f0becc00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0bd00a1c20 0x7f0bd00a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.180+0000 7f0becc00640 1 -- 172.21.15.8:0/4033880017 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0be0014070 con 0x7f0bf0073890 2024-03-16T21:06:35.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.181+0000 7f0bf4e00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0bd00a1c20 0x7f0bd00a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.181+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2624961971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 msgr2=0x562cc0a0a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:35.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.181+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/2624961971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a0a530 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009fd0 tx=0x7f0bd80118d0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.181+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2624961971 shutdown_connections 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.181+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/2624961971 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a0a530 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.181+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/2624961971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 0x562cc0a07c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.181+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/2624961971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 0x562cc09ff020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.181+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2624961971 >> 172.21.15.8:0/2624961971 conn(0x562cc09f9370 msgr2=0x562cc09f9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.181+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2624961971 shutdown_connections 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.181+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2624961971 wait complete. 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.181+0000 7f0bf4e00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0bd00a1c20 0x7f0bd00a40e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0be802c210 tx=0x7f0be802e040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.182+0000 7f0bf9bae740 1 -- start start 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.182+0000 7f0bf9bae740 1 Processor -- start 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.182+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 0x562cc0a05140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.182+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 0x562cc0a05680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.182+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a05bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc090b150 con 0x562cc09ff560 2024-03-16T21:06:35.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc090adf0 con 0x562cc09fec40 2024-03-16T21:06:35.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc06d41c0 con 0x562cc0a08140 2024-03-16T21:06:35.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bf9bae740 10 client.0 _ll_register_callbacks cb 0x562cc095a2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:35.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bef400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 0x562cc0a05680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0befe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 0x562cc0a05140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bef400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 0x562cc0a05680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44006/0 (socket says 172.21.15.8:44006) 2024-03-16T21:06:35.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bef400640 1 -- 172.21.15.8:0/2735894779 learned_addr learned my addr 172.21.15.8:0/2735894779 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:35.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bf4e00640 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a05bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bef400640 1 -- 172.21.15.8:0/2735894779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 msgr2=0x562cc0a05bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:35.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bef400640 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a05bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bef400640 1 -- 172.21.15.8:0/2735894779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 msgr2=0x562cc0a05140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:35.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bef400640 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 0x562cc0a05140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0bef400640 1 -- 172.21.15.8:0/2735894779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd8009c00 con 0x562cc09ff560 2024-03-16T21:06:35.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.183+0000 7f0befe00640 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 0x562cc0a05140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:35.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.184+0000 7f0bef400640 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 0x562cc0a05680 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80049a0 tx=0x7f0bd8004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5873b4abc6e79f0c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:35.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.184+0000 7f0bde000640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:06:35.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.184+0000 7f0bde000640 1 -- 172.21.15.8:0/2735894779 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd800fce0 con 0x562cc09ff560 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.184+0000 7f0bde000640 1 -- 172.21.15.8:0/2735894779 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0bd800f480 con 0x562cc09ff560 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.184+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2735894779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562cc06657e0 con 0x562cc09ff560 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.184+0000 7f0bde000640 1 -- 172.21.15.8:0/2735894779 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bd8004e60 con 0x562cc09ff560 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.184+0000 7f0bf9bae740 10 client.17328 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.184+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2735894779 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562cc09645a0 con 0x562cc09ff560 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.184+0000 7f0bde000640 1 -- 172.21.15.8:0/2735894779 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x562cc06657e0 con 0x562cc09ff560 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.185+0000 7f0bde000640 1 -- 172.21.15.8:0/2735894779 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0bd8005410 con 0x562cc09ff560 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.185+0000 7f0bf9bae740 10 client.17328 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.185+0000 7f0bf9bae740 10 client.17328 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.185+0000 7f0bf9bae740 20 client.17328 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.185+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562cc0a18110 0x562cc0a1a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.185+0000 7f0bf9bae740 4 client.17328 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.185+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2735894779 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562cc06a2720 con 0x562cc0a18110 2024-03-16T21:06:35.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.185+0000 7f0befe00640 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562cc0a18110 0x562cc0a1a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.186+0000 7f0befe00640 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562cc0a18110 0x562cc0a1a550 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e391e5277075c00 server_cookie=67314f8d0ff7d7da in_seq=0 out_seq=0 2024-03-16T21:06:35.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.186+0000 7f0bde000640 10 client.17328 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:35.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bde000640 1 -- 172.21.15.8:0/2735894779 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x562cc06a2720 con 0x562cc0a18110 2024-03-16T21:06:35.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bde000640 10 client.17328 handle_command_reply: tid=0 2024-03-16T21:06:35.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 1 client.17328 shutdown 2024-03-16T21:06:35.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2735894779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 msgr2=0x562cc0a05680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:35.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 0x562cc0a05680 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80049a0 tx=0x7f0bd8004c70 comp rx=0 tx=0).stop 2024-03-16T21:06:35.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2735894779 shutdown_connections 2024-03-16T21:06:35.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a05bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562cc0a18110 0x562cc0a1a550 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09ff560 0x562cc0a05680 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/2735894779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09fec40 0x562cc0a05140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bde000640 0 client.17328 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:35.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2735894779 >> 172.21.15.8:0/2735894779 conn(0x562cc09f9370 msgr2=0x562cc09fb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:35.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2735894779 shutdown_connections 2024-03-16T21:06:35.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 1 -- 172.21.15.8:0/2735894779 wait complete. 2024-03-16T21:06:35.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.187+0000 7f0bf9bae740 20 client.17328 trim_cache size 0 max 16384 2024-03-16T21:06:35.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.201+0000 7f0bf9bae740 1 Processor -- start 2024-03-16T21:06:35.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.201+0000 7f0bf9bae740 1 -- start start 2024-03-16T21:06:35.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.201+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 0x562cc0a07870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.201+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc09ff560 0x562cc0a059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.201+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc0a08140 0x562cc09f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.201+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc0a14c80 con 0x562cc09fec40 2024-03-16T21:06:35.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.201+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc09fa370 con 0x562cc0a08140 2024-03-16T21:06:35.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.201+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc0a0a530 con 0x562cc09ff560 2024-03-16T21:06:35.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0bef400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc09ff560 0x562cc0a059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0bef400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc09ff560 0x562cc0a059e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58106/0 (socket says 172.21.15.8:58106) 2024-03-16T21:06:35.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0bef400640 1 -- 172.21.15.8:0/3101765891 learned_addr learned my addr 172.21.15.8:0/3101765891 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:35.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0bf4e00640 1 --2- 172.21.15.8:0/3101765891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc0a08140 0x562cc09f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0befe00640 1 --2- 172.21.15.8:0/3101765891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 0x562cc0a07870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0bef400640 1 -- 172.21.15.8:0/3101765891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc0a08140 msgr2=0x562cc09f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:35.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0bef400640 1 --2- 172.21.15.8:0/3101765891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc0a08140 0x562cc09f82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0bef400640 1 -- 172.21.15.8:0/3101765891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 msgr2=0x562cc0a07870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:35.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0bef400640 1 --2- 172.21.15.8:0/3101765891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 0x562cc0a07870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0bef400640 1 -- 172.21.15.8:0/3101765891 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cc0900ab0 con 0x562cc09ff560 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0bf4e00640 1 --2- 172.21.15.8:0/3101765891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc0a08140 0x562cc09f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0befe00640 1 --2- 172.21.15.8:0/3101765891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 0x562cc0a07870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0bef400640 1 --2- 172.21.15.8:0/3101765891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc09ff560 0x562cc0a059e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8006010 tx=0x7f0bd8012f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9b3600c7802f4c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.202+0000 7f0be4c00640 1 -- 172.21.15.8:0/3101765891 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8004840 con 0x562cc09ff560 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.203+0000 7f0be4c00640 1 -- 172.21.15.8:0/3101765891 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0bd8023440 con 0x562cc09ff560 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.203+0000 7f0be4c00640 1 -- 172.21.15.8:0/3101765891 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80238b0 con 0x562cc09ff560 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.203+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3101765891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc09ff560 msgr2=0x562cc0a059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.203+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/3101765891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc09ff560 0x562cc0a059e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8006010 tx=0x7f0bd8012f90 comp rx=0 tx=0).stop 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.203+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3101765891 shutdown_connections 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.203+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/3101765891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc0a08140 0x562cc09f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.203+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/3101765891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc09ff560 0x562cc0a059e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.203+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/3101765891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 0x562cc0a07870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.203+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3101765891 >> 172.21.15.8:0/3101765891 conn(0x562cc09f9370 msgr2=0x562cc09f7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:35.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.203+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3101765891 shutdown_connections 2024-03-16T21:06:35.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.203+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3101765891 wait complete. 2024-03-16T21:06:35.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.204+0000 7f0bf9bae740 1 -- start start 2024-03-16T21:06:35.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.204+0000 7f0bf9bae740 1 Processor -- start 2024-03-16T21:06:35.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.204+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 0x562cc0a01ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.204+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09ff560 0x562cc0a01ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.204+0000 7f0bf9bae740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a02570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.204+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc0a72be0 con 0x562cc09fec40 2024-03-16T21:06:35.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.204+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc0a72d50 con 0x562cc09ff560 2024-03-16T21:06:35.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.204+0000 7f0bf9bae740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cc0a72f10 con 0x562cc0a08140 2024-03-16T21:06:35.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.204+0000 7f0bf9bae740 10 client.0 _ll_register_callbacks cb 0x7f0bd801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:35.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bef400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09ff560 0x562cc0a01ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bef400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09ff560 0x562cc0a01ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44916/0 (socket says 172.21.15.8:44916) 2024-03-16T21:06:35.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bef400640 1 -- 172.21.15.8:0/3122782134 learned_addr learned my addr 172.21.15.8:0/3122782134 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0befe00640 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 0x562cc0a01ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bf4e00640 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a02570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bef400640 1 -- 172.21.15.8:0/3122782134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 msgr2=0x562cc0a02570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bef400640 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a02570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bef400640 1 -- 172.21.15.8:0/3122782134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 msgr2=0x562cc0a01ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bef400640 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 0x562cc0a01ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bef400640 1 -- 172.21.15.8:0/3122782134 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562cc09645a0 con 0x562cc09ff560 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0befe00640 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 0x562cc0a01ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bef400640 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09ff560 0x562cc0a01ff0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005960 tx=0x7f0bd8004870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cafd48b1c96d3883 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bde000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bde000640 1 -- 172.21.15.8:0/3122782134 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8005e30 con 0x562cc09ff560 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bde000640 1 -- 172.21.15.8:0/3122782134 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0bd800f480 con 0x562cc09ff560 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.205+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3122782134 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0bd8003d90 con 0x562cc09ff560 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.206+0000 7f0bde000640 1 -- 172.21.15.8:0/3122782134 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bd8004110 con 0x562cc09ff560 2024-03-16T21:06:35.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.206+0000 7f0bf9bae740 10 client.27518 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.206+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3122782134 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562cc0926650 con 0x562cc09ff560 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.206+0000 7f0bde000640 1 -- 172.21.15.8:0/3122782134 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0bd8003d90 con 0x562cc09ff560 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.206+0000 7f0bde000640 1 -- 172.21.15.8:0/3122782134 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0bd8004c50 con 0x562cc09ff560 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.206+0000 7f0bf9bae740 10 client.27518 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.206+0000 7f0bf9bae740 10 client.27518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.206+0000 7f0bf9bae740 20 client.27518 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.206+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562cc0a74280 0x562cc0a76670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.206+0000 7f0bf9bae740 4 client.27518 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.206+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3122782134 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562cc06f1890 con 0x562cc0a74280 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.207+0000 7f0befe00640 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562cc0a74280 0x562cc0a76670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.207+0000 7f0bde000640 10 client.27518 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.207+0000 7f0befe00640 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562cc0a74280 0x562cc0a76670 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2f5ad8bd2d647c3 server_cookie=57ce6a2601fd81a6 in_seq=0 out_seq=0 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.207+0000 7f0bde000640 1 -- 172.21.15.8:0/3122782134 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562cc06f1890 con 0x562cc0a74280 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.207+0000 7f0bde000640 10 client.27518 handle_command_reply: tid=0 2024-03-16T21:06:35.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.207+0000 7f0bf9bae740 1 client.27518 shutdown 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.207+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3122782134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09ff560 msgr2=0x562cc0a01ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.207+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09ff560 0x562cc0a01ff0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005960 tx=0x7f0bd8004870 comp rx=0 tx=0).stop 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.208+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3122782134 shutdown_connections 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.208+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cc0a08140 0x562cc0a02570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.208+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562cc09ff560 0x562cc0a01ff0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.208+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x562cc0a74280 0x562cc0a76670 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.208+0000 7f0bf9bae740 1 --2- 172.21.15.8:0/3122782134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cc09fec40 0x562cc0a01ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.208+0000 7f0bde000640 0 client.27518 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.208+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3122782134 >> 172.21.15.8:0/3122782134 conn(0x562cc09f9370 msgr2=0x562cc09f8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.208+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3122782134 shutdown_connections 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.208+0000 7f0bf9bae740 1 -- 172.21.15.8:0/3122782134 wait complete. 2024-03-16T21:06:35.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.208+0000 7f0bf9bae740 20 client.27518 trim_cache size 0 max 16384 2024-03-16T21:06:35.218 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 -- 172.21.15.8:0/4033880017 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0bd00a1c20 msgr2=0x7f0bd00a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0bd00a1c20 0x7f0bd00a40e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0be802c210 tx=0x7f0be802e040 comp rx=0 tx=0).stop 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 -- 172.21.15.8:0/4033880017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf0073890 msgr2=0x7f0bf019e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf0073890 0x7f0bf019e1a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0be000e9f0 tx=0x7f0be000eeb0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 -- 172.21.15.8:0/4033880017 shutdown_connections 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f0bd00a1c20 0x7f0bd00a40e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bf0112490 0x7f0bf01a2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bf00741b0 0x7f0bf019e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 --2- 172.21.15.8:0/4033880017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf0073890 0x7f0bf019e1a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 -- 172.21.15.8:0/4033880017 >> 172.21.15.8:0/4033880017 conn(0x7f0bf00788f0 msgr2=0x7f0bf010df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 -- 172.21.15.8:0/4033880017 shutdown_connections 2024-03-16T21:06:35.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:35.209+0000 7f0bf6e00640 1 -- 172.21.15.8:0/4033880017 wait complete. 2024-03-16T21:06:35.229 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:34 smithi008 ceph-mon[31434]: pgmap v269: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:35.229 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:34 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2602275859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:06:35.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:34 smithi170 ceph-mon[35947]: pgmap v269: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:35.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:34 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2602275859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:06:35.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:34 smithi186 ceph-mon[36391]: pgmap v269: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:35.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:34 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2602275859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:06:36.232 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:06:36.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:06:36.233 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:06:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.467+0000 7ff8dee00640 1 -- 172.21.15.8:0/55483390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8d8107560 msgr2=0x7ff8d8107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.467+0000 7ff8dee00640 1 --2- 172.21.15.8:0/55483390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8d8107560 0x7ff8d8107940 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009cd0 tx=0x7ff8c802c0f0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.467+0000 7ff8dee00640 1 -- 172.21.15.8:0/55483390 shutdown_connections 2024-03-16T21:06:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.467+0000 7ff8dee00640 1 --2- 172.21.15.8:0/55483390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8101e60 0x7ff8d810e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.467+0000 7ff8dee00640 1 --2- 172.21.15.8:0/55483390 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8d81014a0 0x7ff8d8101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.467+0000 7ff8dee00640 1 --2- 172.21.15.8:0/55483390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8d8107560 0x7ff8d8107940 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.467+0000 7ff8dee00640 1 -- 172.21.15.8:0/55483390 >> 172.21.15.8:0/55483390 conn(0x7ff8d80788f0 msgr2=0x7ff8d8078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.468+0000 7ff8dee00640 1 -- 172.21.15.8:0/55483390 shutdown_connections 2024-03-16T21:06:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.468+0000 7ff8dee00640 1 -- 172.21.15.8:0/55483390 wait complete. 2024-03-16T21:06:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.469+0000 7ff8dee00640 1 Processor -- start 2024-03-16T21:06:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.469+0000 7ff8dee00640 1 -- start start 2024-03-16T21:06:36.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8dee00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8d81014a0 0x7ff8d8199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8dee00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8101e60 0x7ff8d819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8dee00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8d8107560 0x7ff8d819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8dee00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d819ecb0 con 0x7ff8d8101e60 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8dee00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d819ee20 con 0x7ff8d8107560 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8dee00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d819efe0 con 0x7ff8d81014a0 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8d7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8d81014a0 0x7ff8d8199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8d7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8d81014a0 0x7ff8d8199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58132/0 (socket says 172.21.15.8:58132) 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8d7e00640 1 -- 172.21.15.8:0/475387302 learned_addr learned my addr 172.21.15.8:0/475387302 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8d7400640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8101e60 0x7ff8d819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8dce00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8d8107560 0x7ff8d819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8d7e00640 1 -- 172.21.15.8:0/475387302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8d8107560 msgr2=0x7ff8d819e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8d8107560 0x7ff8d819e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8d7e00640 1 -- 172.21.15.8:0/475387302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8101e60 msgr2=0x7ff8d819a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8101e60 0x7ff8d819a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.470+0000 7ff8d7e00640 1 -- 172.21.15.8:0/475387302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c8009900 con 0x7ff8d81014a0 2024-03-16T21:06:36.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.471+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8d81014a0 0x7ff8d8199df0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8004af0 tx=0x7ff8c8034670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.471+0000 7ff8d4c00640 1 -- 172.21.15.8:0/475387302 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8032bc0 con 0x7ff8d81014a0 2024-03-16T21:06:36.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.471+0000 7ff8d4c00640 1 -- 172.21.15.8:0/475387302 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff8c8003e70 con 0x7ff8d81014a0 2024-03-16T21:06:36.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.471+0000 7ff8d4c00640 1 -- 172.21.15.8:0/475387302 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8004790 con 0x7ff8d81014a0 2024-03-16T21:06:36.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.471+0000 7ff8dee00640 1 -- 172.21.15.8:0/475387302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d819f260 con 0x7ff8d81014a0 2024-03-16T21:06:36.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.471+0000 7ff8dee00640 1 -- 172.21.15.8:0/475387302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d81a6960 con 0x7ff8d81014a0 2024-03-16T21:06:36.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.474+0000 7ff8d4c00640 1 -- 172.21.15.8:0/475387302 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7ff8c800a040 con 0x7ff8d81014a0 2024-03-16T21:06:36.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.474+0000 7ff8e1bd5740 1 Processor -- start 2024-03-16T21:06:36.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8e1bd5740 1 -- start start 2024-03-16T21:06:36.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d5ff40 0x55c590d60320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d68f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d69440 0x55c590d6b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590d1b300 con 0x55c590d60860 2024-03-16T21:06:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590ccde50 con 0x55c590d5ff40 2024-03-16T21:06:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590ccb380 con 0x55c590d69440 2024-03-16T21:06:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8d7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d68f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8dce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d5ff40 0x55c590d60320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8d7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d69440 0x55c590d6b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8dce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d5ff40 0x55c590d60320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:44942/0 (socket says 172.21.15.8:44942) 2024-03-16T21:06:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.475+0000 7ff8dce00640 1 -- 172.21.15.8:0/490388293 learned_addr learned my addr 172.21.15.8:0/490388293 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8d7400640 1 -- 172.21.15.8:0/490388293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d5ff40 msgr2=0x55c590d60320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8d7400640 1 --2- 172.21.15.8:0/490388293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d5ff40 0x55c590d60320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8d7400640 1 -- 172.21.15.8:0/490388293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 msgr2=0x55c590d68f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8d7400640 1 --2- 172.21.15.8:0/490388293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d68f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8d7400640 1 -- 172.21.15.8:0/490388293 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c590c8fc80 con 0x55c590d69440 2024-03-16T21:06:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8d7400640 1 --2- 172.21.15.8:0/490388293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d69440 0x55c590d6b830 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009bd0 tx=0x7ff8c0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3c8c602b55f8b79 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8d4c00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8bc0a1c20 0x7ff8bc0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8cd600640 1 -- 172.21.15.8:0/490388293 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0004230 con 0x55c590d69440 2024-03-16T21:06:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8d4c00640 1 -- 172.21.15.8:0/475387302 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff8c80eff50 con 0x7ff8d81014a0 2024-03-16T21:06:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8cd600640 1 -- 172.21.15.8:0/490388293 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff8c0009e40 con 0x55c590d69440 2024-03-16T21:06:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8cd600640 1 -- 172.21.15.8:0/490388293 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0004de0 con 0x55c590d69440 2024-03-16T21:06:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.476+0000 7ff8dce00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8bc0a1c20 0x7ff8bc0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.477+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/490388293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d69440 msgr2=0x55c590d6b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.477+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/490388293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d69440 0x55c590d6b830 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009bd0 tx=0x7ff8c0011810 comp rx=0 tx=0).stop 2024-03-16T21:06:36.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.477+0000 7ff8dce00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8bc0a1c20 0x7ff8bc0a40e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009ee0 tx=0x7ff8d0005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.477+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/490388293 shutdown_connections 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.477+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/490388293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d69440 0x55c590d6b830 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.477+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/490388293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d68f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.477+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/490388293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d5ff40 0x55c590d60320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.477+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/490388293 >> 172.21.15.8:0/490388293 conn(0x55c590d5a670 msgr2=0x55c590d5aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.477+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/490388293 shutdown_connections 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.477+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/490388293 wait complete. 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.478+0000 7ff8e1bd5740 1 -- start start 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.478+0000 7ff8e1bd5740 1 Processor -- start 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.478+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d663f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.478+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d66930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.478+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d69440 0x55c590d66e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.478+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590cc6b60 con 0x55c590d60860 2024-03-16T21:06:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.478+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590c6bfd0 con 0x55c590d69440 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.478+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590c6bc70 con 0x55c590d5ff40 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8e1bd5740 10 client.0 _ll_register_callbacks cb 0x55c5909d7c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8d7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8d7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d66930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8d7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d663f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58152/0 (socket says 172.21.15.8:58152) 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8d7e00640 1 -- 172.21.15.8:0/1286998601 learned_addr learned my addr 172.21.15.8:0/1286998601 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8dce00640 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d69440 0x55c590d66e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8d7e00640 1 -- 172.21.15.8:0/1286998601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d69440 msgr2=0x55c590d66e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d69440 0x55c590d66e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8d7e00640 1 -- 172.21.15.8:0/1286998601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 msgr2=0x55c590d66930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d66930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8d7e00640 1 -- 172.21.15.8:0/1286998601 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c0009830 con 0x55c590d5ff40 2024-03-16T21:06:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d663f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80ed7b0 tx=0x7ff8c8032fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b490ae8e3b3120d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.479+0000 7ff8c6000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8c6000640 1 -- 172.21.15.8:0/1286998601 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80edac0 con 0x55c590d5ff40 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8c6000640 1 -- 172.21.15.8:0/1286998601 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff8c8034d90 con 0x55c590d5ff40 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/1286998601 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5909c6860 con 0x55c590d5ff40 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8c6000640 1 -- 172.21.15.8:0/1286998601 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8c80bc590 con 0x55c590d5ff40 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8e1bd5740 10 client.27538 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/1286998601 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c590cc51e0 con 0x55c590d5ff40 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8c6000640 1 -- 172.21.15.8:0/1286998601 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55c5909c6860 con 0x55c590d5ff40 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8c6000640 1 -- 172.21.15.8:0/1286998601 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7ff8c80bce90 con 0x55c590d5ff40 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8e1bd5740 10 client.27538 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8e1bd5740 10 client.27538 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8e1bd5740 20 client.27538 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c590d79630 0x55c590d7ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8e1bd5740 4 client.27538 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.480+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/1286998601 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c590a17410 con 0x55c590d79630 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.481+0000 7ff8d7400640 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c590d79630 0x55c590d7ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.481+0000 7ff8d7400640 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c590d79630 0x55c590d7ba70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a87a5235cb6fddf8 server_cookie=852443980b14a60d in_seq=0 out_seq=0 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.481+0000 7ff8c6000640 10 client.27538 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.482+0000 7ff8c6000640 1 -- 172.21.15.8:0/1286998601 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55c590a17410 con 0x55c590d79630 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.482+0000 7ff8c6000640 10 client.27538 handle_command_reply: tid=0 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.482+0000 7ff8e1bd5740 1 client.27538 shutdown 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.482+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/1286998601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 msgr2=0x55c590d663f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.482+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d663f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80ed7b0 tx=0x7ff8c8032fa0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.483+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/1286998601 shutdown_connections 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.483+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d69440 0x55c590d66e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.483+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c590d79630 0x55c590d7ba70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.483+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d66930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.483+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/1286998601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d663f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.483+0000 7ff8c6000640 0 client.27538 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.483+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/1286998601 >> 172.21.15.8:0/1286998601 conn(0x55c590d5a670 msgr2=0x55c590d5c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.483+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/1286998601 shutdown_connections 2024-03-16T21:06:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.483+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/1286998601 wait complete. 2024-03-16T21:06:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.483+0000 7ff8e1bd5740 20 client.27538 trim_cache size 0 max 16384 2024-03-16T21:06:36.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8e1bd5740 1 Processor -- start 2024-03-16T21:06:36.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8e1bd5740 1 -- start start 2024-03-16T21:06:36.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d74850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d74d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d69440 0x55c590d636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590d61f30 con 0x55c590d60860 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590a0f0c0 con 0x55c590d69440 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590d55f60 con 0x55c590d5ff40 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8d7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d74850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8d7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d74850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58158/0 (socket says 172.21.15.8:58158) 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8d7e00640 1 -- 172.21.15.8:0/657873138 learned_addr learned my addr 172.21.15.8:0/657873138 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.501+0000 7ff8d7400640 1 --2- 172.21.15.8:0/657873138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d74d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.502+0000 7ff8dce00640 1 --2- 172.21.15.8:0/657873138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d69440 0x55c590d636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.502+0000 7ff8d7e00640 1 -- 172.21.15.8:0/657873138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d69440 msgr2=0x55c590d636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.502+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/657873138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d69440 0x55c590d636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.502+0000 7ff8d7e00640 1 -- 172.21.15.8:0/657873138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 msgr2=0x55c590d74d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.502+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/657873138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d74d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.502+0000 7ff8d7e00640 1 -- 172.21.15.8:0/657873138 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c590d62070 con 0x55c590d5ff40 2024-03-16T21:06:36.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.502+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/657873138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d74850 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80bc930 tx=0x7ff8c802c0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2752169adf4c43ca server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.502+0000 7ff8ccc00640 1 -- 172.21.15.8:0/657873138 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80bca00 con 0x55c590d5ff40 2024-03-16T21:06:36.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.502+0000 7ff8ccc00640 1 -- 172.21.15.8:0/657873138 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff8c8034d90 con 0x55c590d5ff40 2024-03-16T21:06:36.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.502+0000 7ff8ccc00640 1 -- 172.21.15.8:0/657873138 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80ed830 con 0x55c590d5ff40 2024-03-16T21:06:36.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.503+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/657873138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 msgr2=0x55c590d74850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.503+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/657873138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d74850 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80bc930 tx=0x7ff8c802c0f0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.503+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/657873138 shutdown_connections 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.503+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/657873138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d69440 0x55c590d636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.503+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/657873138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d60860 0x55c590d74d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.503+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/657873138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d5ff40 0x55c590d74850 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.503+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/657873138 >> 172.21.15.8:0/657873138 conn(0x55c590d5a670 msgr2=0x55c590d5c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.503+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/657873138 shutdown_connections 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.503+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/657873138 wait complete. 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.503+0000 7ff8e1bd5740 1 -- start start 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8e1bd5740 1 Processor -- start 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d5ff40 0x55c590d63f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d60860 0x55c590d6e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8e1bd5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d69440 0x55c590d6e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590d6ede0 con 0x55c590d5ff40 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590d6ef50 con 0x55c590d60860 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8e1bd5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590d6f110 con 0x55c590d69440 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8e1bd5740 10 client.0 _ll_register_callbacks cb 0x7ff8c8004910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8d7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d5ff40 0x55c590d63f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8d7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d60860 0x55c590d6e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8d7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d5ff40 0x55c590d63f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44060/0 (socket says 172.21.15.8:44060) 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8d7e00640 1 -- 172.21.15.8:0/3915878563 learned_addr learned my addr 172.21.15.8:0/3915878563 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.504+0000 7ff8dce00640 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d69440 0x55c590d6e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8d7400640 1 -- 172.21.15.8:0/3915878563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d69440 msgr2=0x55c590d6e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8d7400640 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d69440 0x55c590d6e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8d7400640 1 -- 172.21.15.8:0/3915878563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d5ff40 msgr2=0x55c590d63f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8d7400640 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d5ff40 0x55c590d63f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8d7400640 1 -- 172.21.15.8:0/3915878563 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c590cc51e0 con 0x55c590d60860 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d5ff40 0x55c590d63f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8d7400640 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d60860 0x55c590d6e360 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00096e0 tx=0x7ff8c0009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ae33c1c0d741e83 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8c6000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8c6000640 1 -- 172.21.15.8:0/3915878563 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0004420 con 0x55c590d60860 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/3915878563 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8c0009e40 con 0x55c590d60860 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8c6000640 1 -- 172.21.15.8:0/3915878563 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff8c00035f0 con 0x55c590d60860 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.505+0000 7ff8c6000640 1 -- 172.21.15.8:0/3915878563 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8c0004580 con 0x55c590d60860 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.506+0000 7ff8e1bd5740 10 client.27536 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.506+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/3915878563 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c590c61a90 con 0x55c590d60860 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.506+0000 7ff8c6000640 1 -- 172.21.15.8:0/3915878563 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7ff8c0037080 con 0x55c590d60860 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.506+0000 7ff8c6000640 1 -- 172.21.15.8:0/3915878563 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7ff8c00247d0 con 0x55c590d60860 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.506+0000 7ff8e1bd5740 10 client.27536 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:36.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.506+0000 7ff8e1bd5740 10 client.27536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:36.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.506+0000 7ff8e1bd5740 20 client.27536 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:36.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.506+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c590ddecf0 0x55c590de1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.506+0000 7ff8e1bd5740 4 client.27536 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:06:36.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.506+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/3915878563 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c590a037b0 con 0x55c590ddecf0 2024-03-16T21:06:36.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.506+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c590ddecf0 0x55c590de1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.507+0000 7ff8d7e00640 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c590ddecf0 0x55c590de1110 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1a32476d4d432cd server_cookie=81ec8923988f1f93 in_seq=0 out_seq=0 2024-03-16T21:06:36.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.507+0000 7ff8c6000640 10 client.27536 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:36.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8c6000640 1 -- 172.21.15.8:0/3915878563 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c590a037b0 con 0x55c590ddecf0 2024-03-16T21:06:36.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8c6000640 10 client.27536 handle_command_reply: tid=0 2024-03-16T21:06:36.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8e1bd5740 1 client.27536 shutdown 2024-03-16T21:06:36.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/3915878563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d60860 msgr2=0x55c590d6e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d60860 0x55c590d6e360 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00096e0 tx=0x7ff8c0009620 comp rx=0 tx=0).stop 2024-03-16T21:06:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/3915878563 shutdown_connections 2024-03-16T21:06:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c590d69440 0x55c590d6e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c590d60860 0x55c590d6e360 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55c590ddecf0 0x55c590de1110 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8e1bd5740 1 --2- 172.21.15.8:0/3915878563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c590d5ff40 0x55c590d63f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/3915878563 >> 172.21.15.8:0/3915878563 conn(0x55c590d5a670 msgr2=0x55c590d66390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8c6000640 0 client.27536 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/3915878563 shutdown_connections 2024-03-16T21:06:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.508+0000 7ff8e1bd5740 1 -- 172.21.15.8:0/3915878563 wait complete. 2024-03-16T21:06:36.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8e1bd5740 20 client.27536 trim_cache size 0 max 16384 2024-03-16T21:06:36.517 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:06:36.518 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:06:36.518 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "47e45a40-65fe-4c6e-b168-48f97cce489a", 2024-03-16T21:06:36.518 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:06:36.518 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8dee00640 1 -- 172.21.15.8:0/475387302 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8bc0a1c20 msgr2=0x7ff8bc0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8dee00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8bc0a1c20 0x7ff8bc0a40e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009ee0 tx=0x7ff8d0005f90 comp rx=0 tx=0).stop 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8dee00640 1 -- 172.21.15.8:0/475387302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8d81014a0 msgr2=0x7ff8d8199df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8dee00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8d81014a0 0x7ff8d8199df0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8004af0 tx=0x7ff8c8034670 comp rx=0 tx=0).stop 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8dee00640 1 -- 172.21.15.8:0/475387302 shutdown_connections 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8dee00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7ff8bc0a1c20 0x7ff8bc0a40e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8dee00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8d8107560 0x7ff8d819e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8dee00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8101e60 0x7ff8d819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8dee00640 1 --2- 172.21.15.8:0/475387302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8d81014a0 0x7ff8d8199df0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8dee00640 1 -- 172.21.15.8:0/475387302 >> 172.21.15.8:0/475387302 conn(0x7ff8d80788f0 msgr2=0x7ff8d80ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.509+0000 7ff8dee00640 1 -- 172.21.15.8:0/475387302 shutdown_connections 2024-03-16T21:06:36.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.510+0000 7ff8dee00640 1 -- 172.21.15.8:0/475387302 wait complete. 2024-03-16T21:06:36.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:06:36.532 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:06:36.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.735+0000 7efce8600640 1 -- 172.21.15.8:0/3511877645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010dcc0 msgr2=0x7efce0110110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.735+0000 7efce8600640 1 --2- 172.21.15.8:0/3511877645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010dcc0 0x7efce0110110 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009ca0 tx=0x7efcd802c190 comp rx=0 tx=0).stop 2024-03-16T21:06:36.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.735+0000 7efce8600640 1 -- 172.21.15.8:0/3511877645 shutdown_connections 2024-03-16T21:06:36.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.735+0000 7efce8600640 1 --2- 172.21.15.8:0/3511877645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010dcc0 0x7efce0110110 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.735+0000 7efce8600640 1 --2- 172.21.15.8:0/3511877645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce0074240 0x7efce010d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.735+0000 7efce8600640 1 --2- 172.21.15.8:0/3511877645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce0073920 0x7efce0073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.735+0000 7efce8600640 1 -- 172.21.15.8:0/3511877645 >> 172.21.15.8:0/3511877645 conn(0x7efce00fcf90 msgr2=0x7efce00ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.735+0000 7efce8600640 1 -- 172.21.15.8:0/3511877645 shutdown_connections 2024-03-16T21:06:36.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.735+0000 7efce8600640 1 -- 172.21.15.8:0/3511877645 wait complete. 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.736+0000 7efce8600640 1 Processor -- start 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.736+0000 7efce8600640 1 -- start start 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.736+0000 7efce8600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce0073920 0x7efce0199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.736+0000 7efce8600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce0074240 0x7efce019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce8600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010dcc0 0x7efce019e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce8600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce019ecb0 con 0x7efce0073920 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce8600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce019ee20 con 0x7efce0074240 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce8600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce019efe0 con 0x7efce010dcc0 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce5c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce0073920 0x7efce0199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce0074240 0x7efce019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce6600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010dcc0 0x7efce019e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce5c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce0073920 0x7efce0199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44088/0 (socket says 172.21.15.8:44088) 2024-03-16T21:06:36.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce5c00640 1 -- 172.21.15.8:0/414343128 learned_addr learned my addr 172.21.15.8:0/414343128 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:36.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce6600640 1 -- 172.21.15.8:0/414343128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce0074240 msgr2=0x7efce019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce6600640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce0074240 0x7efce019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce6600640 1 -- 172.21.15.8:0/414343128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce0073920 msgr2=0x7efce0199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce6600640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce0073920 0x7efce0199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.737+0000 7efce6600640 1 -- 172.21.15.8:0/414343128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd8009900 con 0x7efce010dcc0 2024-03-16T21:06:36.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.738+0000 7efce6600640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010dcc0 0x7efce019e6b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009bf0 tx=0x7efcd80346e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.738+0000 7efcde000640 1 -- 172.21.15.8:0/414343128 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8003d80 con 0x7efce010dcc0 2024-03-16T21:06:36.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.738+0000 7efce8600640 1 -- 172.21.15.8:0/414343128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce019f260 con 0x7efce010dcc0 2024-03-16T21:06:36.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.738+0000 7efcde000640 1 -- 172.21.15.8:0/414343128 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7efcd80348d0 con 0x7efce010dcc0 2024-03-16T21:06:36.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.738+0000 7efcde000640 1 -- 172.21.15.8:0/414343128 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd803f440 con 0x7efce010dcc0 2024-03-16T21:06:36.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.738+0000 7efce8600640 1 -- 172.21.15.8:0/414343128 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce01a6b40 con 0x7efce010dcc0 2024-03-16T21:06:36.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.741+0000 7efceb390740 1 Processor -- start 2024-03-16T21:06:36.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.741+0000 7efcde000640 1 -- 172.21.15.8:0/414343128 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7efcd803b040 con 0x7efce010dcc0 2024-03-16T21:06:36.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efceb390740 1 -- start start 2024-03-16T21:06:36.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efceb390740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656dfefa0 0x561656dfdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efceb390740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656dfe740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efceb390740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 0x561656e09a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efceb390740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656d6d150 con 0x561656dfefa0 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efceb390740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656d6a680 con 0x561656e07630 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efceb390740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656d65e60 con 0x561656dfe2c0 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efce5c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656dfe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efce5200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656dfefa0 0x561656dfdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efce5c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656dfe740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58192/0 (socket says 172.21.15.8:58192) 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efce5c00640 1 -- 172.21.15.8:0/3719900699 learned_addr learned my addr 172.21.15.8:0/3719900699 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.742+0000 7efce5200640 1 --2- 172.21.15.8:0/3719900699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 0x561656e09a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efce5c00640 1 -- 172.21.15.8:0/3719900699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 msgr2=0x561656e09a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efce5c00640 1 --2- 172.21.15.8:0/3719900699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 0x561656e09a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efce5c00640 1 -- 172.21.15.8:0/3719900699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656dfefa0 msgr2=0x561656dfdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efce5c00640 1 --2- 172.21.15.8:0/3719900699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656dfefa0 0x561656dfdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efce5c00640 1 -- 172.21.15.8:0/3719900699 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561656d1f060 con 0x561656dfe2c0 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efce5200640 1 --2- 172.21.15.8:0/3719900699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 0x561656e09a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efce5c00640 1 --2- 172.21.15.8:0/3719900699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656dfe740 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efcd400bda0 tx=0x7efcd40107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47b2acd82819ce94 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efcde000640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efcc80a1c20 0x7efcc80a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efcd2a00640 1 -- 172.21.15.8:0/3719900699 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd401c680 con 0x561656dfe2c0 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efcd2a00640 1 -- 172.21.15.8:0/3719900699 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7efcd4015070 con 0x561656dfe2c0 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efcd2a00640 1 -- 172.21.15.8:0/3719900699 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd401a7d0 con 0x561656dfe2c0 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efcde000640 1 -- 172.21.15.8:0/414343128 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7efcd80efff0 con 0x7efce010dcc0 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.743+0000 7efce5200640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efcc80a1c20 0x7efcc80a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.744+0000 7efceb390740 1 -- 172.21.15.8:0/3719900699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 msgr2=0x561656dfe740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.744+0000 7efceb390740 1 --2- 172.21.15.8:0/3719900699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656dfe740 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efcd400bda0 tx=0x7efcd40107a0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.744+0000 7efceb390740 1 -- 172.21.15.8:0/3719900699 shutdown_connections 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.744+0000 7efceb390740 1 --2- 172.21.15.8:0/3719900699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 0x561656e09a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.744+0000 7efceb390740 1 --2- 172.21.15.8:0/3719900699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656dfe740 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.744+0000 7efceb390740 1 --2- 172.21.15.8:0/3719900699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656dfefa0 0x561656dfdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.744+0000 7efceb390740 1 -- 172.21.15.8:0/3719900699 >> 172.21.15.8:0/3719900699 conn(0x561656dc55a0 msgr2=0x561656df8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.744+0000 7efceb390740 1 -- 172.21.15.8:0/3719900699 shutdown_connections 2024-03-16T21:06:36.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.744+0000 7efce5200640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efcc80a1c20 0x7efcc80a40e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efccc00b620 tx=0x7efccc014040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.744+0000 7efceb390740 1 -- 172.21.15.8:0/3719900699 wait complete. 2024-03-16T21:06:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.745+0000 7efceb390740 1 -- start start 2024-03-16T21:06:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.745+0000 7efceb390740 1 Processor -- start 2024-03-16T21:06:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.745+0000 7efceb390740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656dfe2c0 0x561656e04650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.745+0000 7efceb390740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfefa0 0x561656e04b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.745+0000 7efceb390740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 0x561656e050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.745+0000 7efceb390740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656d0aec0 con 0x561656dfe2c0 2024-03-16T21:06:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.745+0000 7efceb390740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656d0ab60 con 0x561656e07630 2024-03-16T21:06:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.745+0000 7efceb390740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656ad41c0 con 0x561656dfefa0 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.745+0000 7efceb390740 10 client.0 _ll_register_callbacks cb 0x561656d1e960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce5200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfefa0 0x561656e04b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce5c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656dfe2c0 0x561656e04650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce5200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfefa0 0x561656e04b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58200/0 (socket says 172.21.15.8:58200) 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce5200640 1 -- 172.21.15.8:0/1958906803 learned_addr learned my addr 172.21.15.8:0/1958906803 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce6600640 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 0x561656e050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce6600640 1 -- 172.21.15.8:0/1958906803 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfefa0 msgr2=0x561656e04b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce6600640 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfefa0 0x561656e04b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce6600640 1 -- 172.21.15.8:0/1958906803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656dfe2c0 msgr2=0x561656e04650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce6600640 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656dfe2c0 0x561656e04650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce6600640 1 -- 172.21.15.8:0/1958906803 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd400b9d0 con 0x561656e07630 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce5200640 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfefa0 0x561656e04b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce5c00640 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656dfe2c0 0x561656e04650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efce6600640 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 0x561656e050d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efcd80ed7f0 tx=0x7efcd80bc630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5ea6fa6ace9d521 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.746+0000 7efcc7400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efcc7400640 1 -- 172.21.15.8:0/1958906803 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8004240 con 0x561656e07630 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efcc7400640 1 -- 172.21.15.8:0/1958906803 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7efcd80c0e20 con 0x561656e07630 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efceb390740 1 -- 172.21.15.8:0/1958906803 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561656a657e0 con 0x561656e07630 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efcc7400640 1 -- 172.21.15.8:0/1958906803 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcd80c5470 con 0x561656e07630 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efceb390740 10 client.27545 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efceb390740 1 -- 172.21.15.8:0/1958906803 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561656d644e0 con 0x561656e07630 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efcc7400640 1 -- 172.21.15.8:0/1958906803 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x561656a657e0 con 0x561656e07630 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efcc7400640 1 -- 172.21.15.8:0/1958906803 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7efcd80d0d20 con 0x561656e07630 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efceb390740 10 client.27545 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efceb390740 10 client.27545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efceb390740 20 client.27545 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efceb390740 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561656e174c0 0x561656e198e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efceb390740 4 client.27545 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:06:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.747+0000 7efceb390740 1 -- 172.21.15.8:0/1958906803 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561656aa2720 con 0x561656e174c0 2024-03-16T21:06:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.748+0000 7efce5c00640 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561656e174c0 0x561656e198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.748+0000 7efce5c00640 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561656e174c0 0x561656e198e0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f979b0b362a15e2 server_cookie=5ab34c8877ff5c97 in_seq=0 out_seq=0 2024-03-16T21:06:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.748+0000 7efcc7400640 10 client.27545 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.749+0000 7efcc7400640 1 -- 172.21.15.8:0/1958906803 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561656aa2720 con 0x561656e174c0 2024-03-16T21:06:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.749+0000 7efcc7400640 10 client.27545 handle_command_reply: tid=0 2024-03-16T21:06:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.749+0000 7efceb390740 1 client.27545 shutdown 2024-03-16T21:06:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efceb390740 1 -- 172.21.15.8:0/1958906803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 msgr2=0x561656e050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efceb390740 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 0x561656e050d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efcd80ed7f0 tx=0x7efcd80bc630 comp rx=0 tx=0).stop 2024-03-16T21:06:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efceb390740 1 -- 172.21.15.8:0/1958906803 shutdown_connections 2024-03-16T21:06:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efceb390740 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656e07630 0x561656e050d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efceb390740 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfefa0 0x561656e04b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efceb390740 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561656e174c0 0x561656e198e0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efceb390740 1 --2- 172.21.15.8:0/1958906803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656dfe2c0 0x561656e04650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efceb390740 1 -- 172.21.15.8:0/1958906803 >> 172.21.15.8:0/1958906803 conn(0x561656dc55a0 msgr2=0x561656dfaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efcc7400640 0 client.27545 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:36.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efceb390740 1 -- 172.21.15.8:0/1958906803 shutdown_connections 2024-03-16T21:06:36.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efceb390740 1 -- 172.21.15.8:0/1958906803 wait complete. 2024-03-16T21:06:36.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.750+0000 7efceb390740 20 client.27545 trim_cache size 0 max 16384 2024-03-16T21:06:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.767+0000 7efceb390740 1 Processor -- start 2024-03-16T21:06:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efceb390740 1 -- start start 2024-03-16T21:06:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efceb390740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e06d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efceb390740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656dfefa0 0x561656e12a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efceb390740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 0x561656e12fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efceb390740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656e134f0 con 0x561656e07630 2024-03-16T21:06:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efceb390740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656a657e0 con 0x561656dfefa0 2024-03-16T21:06:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efceb390740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656dfd540 con 0x561656dfe2c0 2024-03-16T21:06:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efce5c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e06d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efce5c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e06d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58208/0 (socket says 172.21.15.8:58208) 2024-03-16T21:06:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efce5c00640 1 -- 172.21.15.8:0/1592617315 learned_addr learned my addr 172.21.15.8:0/1592617315 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efce5200640 1 --2- 172.21.15.8:0/1592617315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656dfefa0 0x561656e12a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.768+0000 7efce6600640 1 --2- 172.21.15.8:0/1592617315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 0x561656e12fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.769+0000 7efce5c00640 1 -- 172.21.15.8:0/1592617315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656dfefa0 msgr2=0x561656e12a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.769+0000 7efce5c00640 1 --2- 172.21.15.8:0/1592617315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656dfefa0 0x561656e12a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.769+0000 7efce5c00640 1 -- 172.21.15.8:0/1592617315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 msgr2=0x561656e12fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.769+0000 7efce5c00640 1 --2- 172.21.15.8:0/1592617315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 0x561656e12fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.769+0000 7efce5c00640 1 -- 172.21.15.8:0/1592617315 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561656d00950 con 0x561656dfe2c0 2024-03-16T21:06:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.769+0000 7efce5c00640 1 --2- 172.21.15.8:0/1592617315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e06d80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efcd400bcc0 tx=0x7efcd4005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c0da5c357c6bc81 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.769+0000 7efcd2000640 1 -- 172.21.15.8:0/1592617315 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd400be90 con 0x561656dfe2c0 2024-03-16T21:06:36.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.769+0000 7efcd2000640 1 -- 172.21.15.8:0/1592617315 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7efcd4021040 con 0x561656dfe2c0 2024-03-16T21:06:36.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.769+0000 7efcd2000640 1 -- 172.21.15.8:0/1592617315 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4011440 con 0x561656dfe2c0 2024-03-16T21:06:36.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.770+0000 7efceb390740 1 -- 172.21.15.8:0/1592617315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 msgr2=0x561656e06d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.770+0000 7efceb390740 1 --2- 172.21.15.8:0/1592617315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e06d80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efcd400bcc0 tx=0x7efcd4005e50 comp rx=0 tx=0).stop 2024-03-16T21:06:36.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.770+0000 7efceb390740 1 -- 172.21.15.8:0/1592617315 shutdown_connections 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.770+0000 7efceb390740 1 --2- 172.21.15.8:0/1592617315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 0x561656e12fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.770+0000 7efceb390740 1 --2- 172.21.15.8:0/1592617315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656dfefa0 0x561656e12a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.770+0000 7efceb390740 1 --2- 172.21.15.8:0/1592617315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e06d80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.770+0000 7efceb390740 1 -- 172.21.15.8:0/1592617315 >> 172.21.15.8:0/1592617315 conn(0x561656dc55a0 msgr2=0x561656df8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.770+0000 7efceb390740 1 -- 172.21.15.8:0/1592617315 shutdown_connections 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.770+0000 7efceb390740 1 -- 172.21.15.8:0/1592617315 wait complete. 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.770+0000 7efceb390740 1 -- start start 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efceb390740 1 Processor -- start 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efceb390740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e08280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efceb390740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656dfefa0 0x561656e087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efceb390740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 0x561656e08d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efceb390740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656e0e760 con 0x561656e07630 2024-03-16T21:06:36.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efceb390740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656e0e8d0 con 0x561656dfefa0 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efceb390740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561656e0ea90 con 0x561656dfe2c0 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efceb390740 10 client.0 _ll_register_callbacks cb 0x7efcd80b8ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efce6600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 0x561656e08d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efce5c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e08280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efce6600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 0x561656e08d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44122/0 (socket says 172.21.15.8:44122) 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efce6600640 1 -- 172.21.15.8:0/310797735 learned_addr learned my addr 172.21.15.8:0/310797735 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efce5c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e08280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:58220/0 (socket says 172.21.15.8:58220) 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.771+0000 7efce5200640 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656dfefa0 0x561656e087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efce6600640 1 -- 172.21.15.8:0/310797735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 msgr2=0x561656e08280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efce6600640 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e08280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efce6600640 1 -- 172.21.15.8:0/310797735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656dfefa0 msgr2=0x561656e087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efce6600640 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656dfefa0 0x561656e087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efce6600640 1 -- 172.21.15.8:0/310797735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561656d1f060 con 0x561656e07630 2024-03-16T21:06:36.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efce5c00640 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e08280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efce6600640 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 0x561656e08d00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efcd80b96a0 tx=0x7efcd80bc760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9a2aa8d268333d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efcc7400640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efcc7400640 1 -- 172.21.15.8:0/310797735 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd80bd3d0 con 0x561656e07630 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efcc7400640 1 -- 172.21.15.8:0/310797735 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7efcd80c0e20 con 0x561656e07630 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efceb390740 1 -- 172.21.15.8:0/310797735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efcd4015070 con 0x561656e07630 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efcc7400640 1 -- 172.21.15.8:0/310797735 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcd80c5470 con 0x561656e07630 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efceb390740 10 client.17367 fetch_fsmap learned FSMap version 36 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.772+0000 7efceb390740 1 -- 172.21.15.8:0/310797735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561656d26430 con 0x561656e07630 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.773+0000 7efcc7400640 1 -- 172.21.15.8:0/310797735 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7efcd4015070 con 0x561656e07630 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.773+0000 7efcc7400640 1 -- 172.21.15.8:0/310797735 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7efcd80d0d20 con 0x561656e07630 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.773+0000 7efceb390740 10 client.17367 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.773+0000 7efceb390740 10 client.17367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:06:36.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.773+0000 7efceb390740 20 client.17367 populate_metadata read hostname 'smithi008' 2024-03-16T21:06:36.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.773+0000 7efceb390740 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561656e734a0 0x561656e75890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:06:36.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.773+0000 7efceb390740 4 client.17367 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:06:36.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.773+0000 7efceb390740 1 -- 172.21.15.8:0/310797735 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561656af1890 con 0x561656e734a0 2024-03-16T21:06:36.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.773+0000 7efce5c00640 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561656e734a0 0x561656e75890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:06:36.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efce5c00640 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561656e734a0 0x561656e75890 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa1bf9d09d07522 server_cookie=c4f30f9acf41ecab in_seq=0 out_seq=0 2024-03-16T21:06:36.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efcc7400640 10 client.17367 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:36.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efcc7400640 1 -- 172.21.15.8:0/310797735 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561656af1890 con 0x561656e734a0 2024-03-16T21:06:36.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efcc7400640 10 client.17367 handle_command_reply: tid=0 2024-03-16T21:06:36.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efceb390740 1 client.17367 shutdown 2024-03-16T21:06:36.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efceb390740 1 -- 172.21.15.8:0/310797735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 msgr2=0x561656e08d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efceb390740 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 0x561656e08d00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efcd80b96a0 tx=0x7efcd80bc760 comp rx=0 tx=0).stop 2024-03-16T21:06:36.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efceb390740 1 -- 172.21.15.8:0/310797735 shutdown_connections 2024-03-16T21:06:36.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efceb390740 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x561656e734a0 0x561656e75890 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efceb390740 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561656e07630 0x561656e08d00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efceb390740 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561656dfefa0 0x561656e087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efceb390740 1 --2- 172.21.15.8:0/310797735 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561656dfe2c0 0x561656e08280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efcc7400640 0 client.17367 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:06:36.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efceb390740 1 -- 172.21.15.8:0/310797735 >> 172.21.15.8:0/310797735 conn(0x561656dc55a0 msgr2=0x561656e04610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.774+0000 7efceb390740 1 -- 172.21.15.8:0/310797735 shutdown_connections 2024-03-16T21:06:36.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efceb390740 1 -- 172.21.15.8:0/310797735 wait complete. 2024-03-16T21:06:36.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efceb390740 20 client.17367 trim_cache size 0 max 16384 2024-03-16T21:06:36.785 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:06:36.785 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:06:36.785 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:06:36.785 INFO:teuthology.orchestra.run.smithi008.stdout: "47e45a40-65fe-4c6e-b168-48f97cce489a": { 2024-03-16T21:06:36.785 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:06:36.785 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "47e45a40-65fe-4c6e-b168-48f97cce489a", 2024-03-16T21:06:36.786 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:06:36.786 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:06:36.786 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:06:36.786 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:06:36.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efce8600640 1 -- 172.21.15.8:0/414343128 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efcc80a1c20 msgr2=0x7efcc80a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efce8600640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efcc80a1c20 0x7efcc80a40e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efccc00b620 tx=0x7efccc014040 comp rx=0 tx=0).stop 2024-03-16T21:06:36.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efce8600640 1 -- 172.21.15.8:0/414343128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010dcc0 msgr2=0x7efce019e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:06:36.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efce8600640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010dcc0 0x7efce019e6b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009bf0 tx=0x7efcd80346e0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efce8600640 1 -- 172.21.15.8:0/414343128 shutdown_connections 2024-03-16T21:06:36.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efce8600640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7efcc80a1c20 0x7efcc80a40e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efce8600640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce010dcc0 0x7efce019e6b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efce8600640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efce0074240 0x7efce019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efce8600640 1 --2- 172.21.15.8:0/414343128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efce0073920 0x7efce0199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:06:36.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efce8600640 1 -- 172.21.15.8:0/414343128 >> 172.21.15.8:0/414343128 conn(0x7efce00fcf90 msgr2=0x7efce00fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:06:36.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.775+0000 7efce8600640 1 -- 172.21.15.8:0/414343128 shutdown_connections 2024-03-16T21:06:36.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:06:36.776+0000 7efce8600640 1 -- 172.21.15.8:0/414343128 wait complete. 2024-03-16T21:06:36.799 INFO:tasks.cephfs.filesystem:scrub status for tag:47e45a40-65fe-4c6e-b168-48f97cce489a - {'path': '/', 'tag': '47e45a40-65fe-4c6e-b168-48f97cce489a', 'options': 'recursive,force'} 2024-03-16T21:06:37.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:36 smithi008 ceph-mon[31434]: pgmap v270: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:06:37.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:36 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:06:37.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:36 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:37.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:36 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:06:37.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:36 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:37.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:36 smithi170 ceph-mon[35947]: pgmap v270: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:06:37.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:36 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:06:37.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:36 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:37.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:36 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:06:37.369 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:36 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:37.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:36 smithi186 ceph-mon[36391]: pgmap v270: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:06:37.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:36 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:06:37.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:36 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:37.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:36 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:06:37.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:36 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:06:38.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:37 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:06:38.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:37 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:06:38.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:37 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:06:39.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:38 smithi008 ceph-mon[31434]: pgmap v271: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:06:39.269 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:38 smithi170 ceph-mon[35947]: pgmap v271: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:06:39.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:38 smithi186 ceph-mon[36391]: pgmap v271: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:06:41.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:40 smithi008 ceph-mon[31434]: pgmap v272: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:41.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:40 smithi170 ceph-mon[35947]: pgmap v272: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:41.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:40 smithi186 ceph-mon[36391]: pgmap v272: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:43.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:42 smithi008 ceph-mon[31434]: pgmap v273: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:06:43.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:42 smithi170 ceph-mon[35947]: pgmap v273: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:06:43.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:42 smithi186 ceph-mon[36391]: pgmap v273: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:06:45.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:44 smithi008 ceph-mon[31434]: pgmap v274: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:06:45.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:44 smithi170 ceph-mon[35947]: pgmap v274: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:06:45.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:44 smithi186 ceph-mon[36391]: pgmap v274: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:06:47.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:46 smithi008 ceph-mon[31434]: pgmap v275: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-16T21:06:47.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:46 smithi170 ceph-mon[35947]: pgmap v275: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-16T21:06:47.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:46 smithi186 ceph-mon[36391]: pgmap v275: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-16T21:06:49.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:48 smithi008 ceph-mon[31434]: pgmap v276: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-16T21:06:49.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:48 smithi170 ceph-mon[35947]: pgmap v276: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-16T21:06:49.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:48 smithi186 ceph-mon[36391]: pgmap v276: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-16T21:06:51.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:50 smithi008 ceph-mon[31434]: pgmap v277: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:06:51.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:50 smithi170 ceph-mon[35947]: pgmap v277: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:06:51.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:50 smithi186 ceph-mon[36391]: pgmap v277: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:06:53.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:52 smithi008 ceph-mon[31434]: pgmap v278: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:06:53.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:52 smithi170 ceph-mon[35947]: pgmap v278: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:06:53.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:52 smithi186 ceph-mon[36391]: pgmap v278: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:06:55.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:54 smithi170 ceph-mon[35947]: pgmap v279: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:55.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:54 smithi186 ceph-mon[36391]: pgmap v279: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:55.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:54 smithi008 ceph-mon[31434]: pgmap v279: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:06:57.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:56 smithi170 ceph-mon[35947]: pgmap v280: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:06:57.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:56 smithi186 ceph-mon[36391]: pgmap v280: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:06:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:56 smithi008 ceph-mon[31434]: pgmap v280: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:06:59.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:06:59 smithi170 ceph-mon[35947]: pgmap v281: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:06:59.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:06:59 smithi186 ceph-mon[36391]: pgmap v281: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:06:59.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:06:59 smithi008 ceph-mon[31434]: pgmap v281: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:07:01.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:01 smithi170 ceph-mon[35947]: pgmap v282: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:01.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:01 smithi186 ceph-mon[36391]: pgmap v282: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:01.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:01 smithi008 ceph-mon[31434]: pgmap v282: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:03.298 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:03 smithi008 ceph-mon[31434]: pgmap v283: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-16T21:07:03.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:03 smithi170 ceph-mon[35947]: pgmap v283: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-16T21:07:03.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:03 smithi186 ceph-mon[36391]: pgmap v283: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-16T21:07:05.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:05 smithi170 ceph-mon[35947]: pgmap v284: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 4 op/s 2024-03-16T21:07:05.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:05 smithi186 ceph-mon[36391]: pgmap v284: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 4 op/s 2024-03-16T21:07:05.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:05 smithi008 ceph-mon[31434]: pgmap v284: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 4 op/s 2024-03-16T21:07:06.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:07:06.801 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:07:07.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.033+0000 7f1c47200640 1 -- 172.21.15.8:0/2751659495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c40069010 msgr2=0x7f1c4010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.033+0000 7f1c47200640 1 --2- 172.21.15.8:0/2751659495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c40069010 0x7f1c4010d950 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009900 tx=0x7f1c2c02bcd0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.033+0000 7f1c47200640 1 -- 172.21.15.8:0/2751659495 shutdown_connections 2024-03-16T21:07:07.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.033+0000 7f1c47200640 1 --2- 172.21.15.8:0/2751659495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c4010de90 0x7f1c40110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.033+0000 7f1c47200640 1 --2- 172.21.15.8:0/2751659495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c40069010 0x7f1c4010d950 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.033+0000 7f1c47200640 1 --2- 172.21.15.8:0/2751659495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c400686f0 0x7f1c40068ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.033+0000 7f1c47200640 1 -- 172.21.15.8:0/2751659495 >> 172.21.15.8:0/2751659495 conn(0x7f1c400774f0 msgr2=0x7f1c40077900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.033+0000 7f1c47200640 1 -- 172.21.15.8:0/2751659495 shutdown_connections 2024-03-16T21:07:07.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.033+0000 7f1c47200640 1 -- 172.21.15.8:0/2751659495 wait complete. 2024-03-16T21:07:07.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.034+0000 7f1c47200640 1 Processor -- start 2024-03-16T21:07:07.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c47200640 1 -- start start 2024-03-16T21:07:07.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c47200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c400686f0 0x7f1c40199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c47200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c40069010 0x7f1c4019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c47200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c4010de90 0x7f1c4019e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c47200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4019ece0 con 0x7f1c4010de90 2024-03-16T21:07:07.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c47200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4019ee50 con 0x7f1c40069010 2024-03-16T21:07:07.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c47200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4019f010 con 0x7f1c400686f0 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c400686f0 0x7f1c40199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c3f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c40069010 0x7f1c4019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c3f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c40069010 0x7f1c4019a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37080/0 (socket says 172.21.15.8:37080) 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c45200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c4010de90 0x7f1c4019e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c3f400640 1 -- 172.21.15.8:0/1625356265 learned_addr learned my addr 172.21.15.8:0/1625356265 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.035+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c400686f0 0x7f1c40199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:50742/0 (socket says 172.21.15.8:50742) 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.036+0000 7f1c3f400640 1 -- 172.21.15.8:0/1625356265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c400686f0 msgr2=0x7f1c40199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.036+0000 7f1c3f400640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c400686f0 0x7f1c40199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.036+0000 7f1c3f400640 1 -- 172.21.15.8:0/1625356265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c4010de90 msgr2=0x7f1c4019e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.036+0000 7f1c3f400640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c4010de90 0x7f1c4019e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.036+0000 7f1c3f400640 1 -- 172.21.15.8:0/1625356265 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c38009840 con 0x7f1c40069010 2024-03-16T21:07:07.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.036+0000 7f1c3f400640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c40069010 0x7f1c4019a360 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c036040 tx=0x7f1c2c02c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.036+0000 7f1c3cc00640 1 -- 172.21.15.8:0/1625356265 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c0042d0 con 0x7f1c40069010 2024-03-16T21:07:07.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.036+0000 7f1c3cc00640 1 -- 172.21.15.8:0/1625356265 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1c2c004430 con 0x7f1c40069010 2024-03-16T21:07:07.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.036+0000 7f1c47200640 1 -- 172.21.15.8:0/1625356265 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c009560 con 0x7f1c40069010 2024-03-16T21:07:07.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.036+0000 7f1c3cc00640 1 -- 172.21.15.8:0/1625356265 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c003cc0 con 0x7f1c40069010 2024-03-16T21:07:07.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.036+0000 7f1c47200640 1 -- 172.21.15.8:0/1625356265 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c401a6990 con 0x7f1c40069010 2024-03-16T21:07:07.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.039+0000 7f1c3cc00640 1 -- 172.21.15.8:0/1625356265 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f1c2c004e10 con 0x7f1c40069010 2024-03-16T21:07:07.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c49dfb740 1 Processor -- start 2024-03-16T21:07:07.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c49dfb740 1 -- start start 2024-03-16T21:07:07.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b9fa0 0x55b0c99b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99b9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99c2630 0x55b0c99c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c9928150 con 0x55b0c99b92c0 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c9925680 con 0x55b0c99b9fa0 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c9920e60 con 0x55b0c99c2630 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c45200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b9fa0 0x55b0c99b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c45200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b9fa0 0x55b0c99b8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37094/0 (socket says 172.21.15.8:37094) 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.041+0000 7f1c45200640 1 -- 172.21.15.8:0/3975420402 learned_addr learned my addr 172.21.15.8:0/3975420402 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.040+0000 7f1c3f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99c2630 0x55b0c99c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.041+0000 7f1c45200640 1 -- 172.21.15.8:0/3975420402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99c2630 msgr2=0x55b0c99c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.041+0000 7f1c45200640 1 --2- 172.21.15.8:0/3975420402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99c2630 0x55b0c99c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.041+0000 7f1c45200640 1 -- 172.21.15.8:0/3975420402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 msgr2=0x55b0c99b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.041+0000 7f1c45200640 1 --2- 172.21.15.8:0/3975420402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99b9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.041+0000 7f1c45200640 1 -- 172.21.15.8:0/3975420402 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0c98da060 con 0x55b0c99b9fa0 2024-03-16T21:07:07.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.041+0000 7f1c3fe00640 1 --2- 172.21.15.8:0/3975420402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:07.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.041+0000 7f1c3cc00640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c240a1ba0 0x7f1c240a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.041+0000 7f1c45200640 1 --2- 172.21.15.8:0/3975420402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b9fa0 0x55b0c99b8cf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1c38011570 tx=0x7f1c38011a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97841bb966625715 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.041+0000 7f1c3cc00640 1 -- 172.21.15.8:0/1625356265 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1c2c0efd60 con 0x7f1c40069010 2024-03-16T21:07:07.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.042+0000 7f1c3fe00640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c240a1ba0 0x7f1c240a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.042+0000 7f1c35600640 1 -- 172.21.15.8:0/3975420402 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38004d20 con 0x55b0c99b9fa0 2024-03-16T21:07:07.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.042+0000 7f1c35600640 1 -- 172.21.15.8:0/3975420402 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1c38004e80 con 0x55b0c99b9fa0 2024-03-16T21:07:07.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.042+0000 7f1c35600640 1 -- 172.21.15.8:0/3975420402 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800f8a0 con 0x55b0c99b9fa0 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.042+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3975420402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b9fa0 msgr2=0x55b0c99b8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.042+0000 7f1c3fe00640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c240a1ba0 0x7f1c240a4060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55b0c99ba4f0 tx=0x7f1c3000b410 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.042+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/3975420402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b9fa0 0x55b0c99b8cf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1c38011570 tx=0x7f1c38011a30 comp rx=0 tx=0).stop 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.042+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3975420402 shutdown_connections 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.042+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/3975420402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99c2630 0x55b0c99c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.043+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/3975420402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.043+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/3975420402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b9fa0 0x55b0c99b8cf0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.043+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3975420402 >> 172.21.15.8:0/3975420402 conn(0x55b0c99805a0 msgr2=0x55b0c99b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.043+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3975420402 shutdown_connections 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.043+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3975420402 wait complete. 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.043+0000 7f1c49dfb740 1 -- start start 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.043+0000 7f1c49dfb740 1 Processor -- start 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99bf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 0x55b0c99c0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c98c5ec0 con 0x55b0c99b92c0 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c98c5b60 con 0x55b0c99c2630 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c968f1c0 con 0x55b0c99b9fa0 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c49dfb740 10 client.0 _ll_register_callbacks cb 0x55b0c98d9960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c45200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 0x55b0c99c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c3f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c45200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 0x55b0c99c0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37096/0 (socket says 172.21.15.8:37096) 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c45200640 1 -- 172.21.15.8:0/3488014589 learned_addr learned my addr 172.21.15.8:0/3488014589 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c3fe00640 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c45200640 1 -- 172.21.15.8:0/3488014589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 msgr2=0x55b0c99bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c45200640 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99bfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c45200640 1 -- 172.21.15.8:0/3488014589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 msgr2=0x55b0c99bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c45200640 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99bf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.044+0000 7f1c45200640 1 -- 172.21.15.8:0/3488014589 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c38009da0 con 0x55b0c99c2630 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.045+0000 7f1c45200640 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 0x55b0c99c0100 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f80 tx=0x7f1c38004cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aefa0b520814fc60 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.045+0000 7f1c2a000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.045+0000 7f1c2a000640 1 -- 172.21.15.8:0/3488014589 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38003e40 con 0x55b0c99c2630 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.045+0000 7f1c2a000640 1 -- 172.21.15.8:0/3488014589 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1c3800f640 con 0x55b0c99c2630 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.045+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3488014589 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0c965d720 con 0x55b0c99c2630 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.045+0000 7f1c2a000640 1 -- 172.21.15.8:0/3488014589 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c38004500 con 0x55b0c99c2630 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.045+0000 7f1c49dfb740 10 client.27563 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.045+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3488014589 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b0c991f4e0 con 0x55b0c99c2630 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.046+0000 7f1c2a000640 1 -- 172.21.15.8:0/3488014589 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55b0c965d720 con 0x55b0c99c2630 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.046+0000 7f1c2a000640 1 -- 172.21.15.8:0/3488014589 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f1c38021040 con 0x55b0c99c2630 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.046+0000 7f1c49dfb740 10 client.27563 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.046+0000 7f1c49dfb740 10 client.27563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.046+0000 7f1c49dfb740 20 client.27563 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:07.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.046+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b0c99d26c0 0x55b0c99d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.046+0000 7f1c49dfb740 4 client.27563 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.046+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3488014589 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0c96ac890 con 0x55b0c99d26c0 2024-03-16T21:07:07.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.046+0000 7f1c3fe00640 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b0c99d26c0 0x55b0c99d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.047+0000 7f1c3fe00640 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b0c99d26c0 0x55b0c99d4ab0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a20a9aae47784b server_cookie=905cd15cb9f939dc in_seq=0 out_seq=0 2024-03-16T21:07:07.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.047+0000 7f1c2a000640 10 client.27563 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:07.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.047+0000 7f1c2a000640 1 -- 172.21.15.8:0/3488014589 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55b0c96ac890 con 0x55b0c99d26c0 2024-03-16T21:07:07.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.047+0000 7f1c2a000640 10 client.27563 handle_command_reply: tid=0 2024-03-16T21:07:07.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.047+0000 7f1c49dfb740 1 client.27563 shutdown 2024-03-16T21:07:07.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3488014589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 msgr2=0x55b0c99c0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 0x55b0c99c0100 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f80 tx=0x7f1c38004cf0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3488014589 shutdown_connections 2024-03-16T21:07:07.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 0x55b0c99c0100 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99bfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b0c99d26c0 0x55b0c99d4ab0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/3488014589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c2a000640 0 client.27563 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:07.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3488014589 >> 172.21.15.8:0/3488014589 conn(0x55b0c99805a0 msgr2=0x55b0c99b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3488014589 shutdown_connections 2024-03-16T21:07:07.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c49dfb740 1 -- 172.21.15.8:0/3488014589 wait complete. 2024-03-16T21:07:07.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.048+0000 7f1c49dfb740 20 client.27563 trim_cache size 0 max 16384 2024-03-16T21:07:07.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c49dfb740 1 Processor -- start 2024-03-16T21:07:07.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c49dfb740 1 -- start start 2024-03-16T21:07:07.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 0x55b0c99bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c99c09d0 con 0x55b0c99b92c0 2024-03-16T21:07:07.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c99d24c0 con 0x55b0c99c2630 2024-03-16T21:07:07.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c99b8540 con 0x55b0c99b9fa0 2024-03-16T21:07:07.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53632/0 (socket says 172.21.15.8:53632) 2024-03-16T21:07:07.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c3fe00640 1 -- 172.21.15.8:0/65847983 learned_addr learned my addr 172.21.15.8:0/65847983 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:07.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c45200640 1 --2- 172.21.15.8:0/65847983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 0x55b0c99bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.066+0000 7f1c3f400640 1 --2- 172.21.15.8:0/65847983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.067+0000 7f1c45200640 1 -- 172.21.15.8:0/65847983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 msgr2=0x55b0c99b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.067+0000 7f1c45200640 1 --2- 172.21.15.8:0/65847983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99b57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.067+0000 7f1c45200640 1 -- 172.21.15.8:0/65847983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 msgr2=0x55b0c99c1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.067+0000 7f1c45200640 1 --2- 172.21.15.8:0/65847983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99c1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.067+0000 7f1c45200640 1 -- 172.21.15.8:0/65847983 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0c98bb950 con 0x55b0c99c2630 2024-03-16T21:07:07.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.067+0000 7f1c3fe00640 1 --2- 172.21.15.8:0/65847983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:07.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.067+0000 7f1c45200640 1 --2- 172.21.15.8:0/65847983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 0x55b0c99bfbd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f80 tx=0x7f1c380114f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5345dee8d36e917 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.067+0000 7f1c34c00640 1 -- 172.21.15.8:0/65847983 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38022e80 con 0x55b0c99c2630 2024-03-16T21:07:07.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.067+0000 7f1c34c00640 1 -- 172.21.15.8:0/65847983 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1c38004360 con 0x55b0c99c2630 2024-03-16T21:07:07.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.067+0000 7f1c34c00640 1 -- 172.21.15.8:0/65847983 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38003e80 con 0x55b0c99c2630 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.068+0000 7f1c49dfb740 1 -- 172.21.15.8:0/65847983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 msgr2=0x55b0c99bfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.068+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/65847983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 0x55b0c99bfbd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f80 tx=0x7f1c380114f0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.068+0000 7f1c49dfb740 1 -- 172.21.15.8:0/65847983 shutdown_connections 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.068+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/65847983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99c2630 0x55b0c99bfbd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.068+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/65847983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.068+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/65847983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99b92c0 0x55b0c99c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.068+0000 7f1c49dfb740 1 -- 172.21.15.8:0/65847983 >> 172.21.15.8:0/65847983 conn(0x55b0c99805a0 msgr2=0x55b0c99b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.068+0000 7f1c49dfb740 1 -- 172.21.15.8:0/65847983 shutdown_connections 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.068+0000 7f1c49dfb740 1 -- 172.21.15.8:0/65847983 wait complete. 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.068+0000 7f1c49dfb740 1 -- start start 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.068+0000 7f1c49dfb740 1 Processor -- start 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b92c0 0x55b0c99c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c49dfb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99c2630 0x55b0c99c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c99c3650 con 0x55b0c99c2630 2024-03-16T21:07:07.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c99c37c0 con 0x55b0c99b92c0 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c49dfb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0c99c95b0 con 0x55b0c99b9fa0 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c49dfb740 10 client.0 _ll_register_callbacks cb 0x7f1c38011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c45200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99c2630 0x55b0c99c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b92c0 0x55b0c99c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b92c0 0x55b0c99c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37114/0 (socket says 172.21.15.8:37114) 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c3fe00640 1 -- 172.21.15.8:0/4078924919 learned_addr learned my addr 172.21.15.8:0/4078924919 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.069+0000 7f1c3f400640 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.070+0000 7f1c3fe00640 1 -- 172.21.15.8:0/4078924919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 msgr2=0x55b0c99c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.070+0000 7f1c3fe00640 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.070+0000 7f1c3fe00640 1 -- 172.21.15.8:0/4078924919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99c2630 msgr2=0x55b0c99c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.070+0000 7f1c3fe00640 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99c2630 0x55b0c99c2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.070+0000 7f1c3fe00640 1 -- 172.21.15.8:0/4078924919 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3002a680 con 0x55b0c99b92c0 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.070+0000 7f1c45200640 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99c2630 0x55b0c99c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.070+0000 7f1c3fe00640 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b92c0 0x55b0c99c4180 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1c3002aa80 tx=0x7f1c30004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e0a3cf5ec27e193 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.070+0000 7f1c2a000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:07:07.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.070+0000 7f1c2a000640 1 -- 172.21.15.8:0/4078924919 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c30024040 con 0x55b0c99b92c0 2024-03-16T21:07:07.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.070+0000 7f1c49dfb740 1 -- 172.21.15.8:0/4078924919 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0c96207e0 con 0x55b0c99b92c0 2024-03-16T21:07:07.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.070+0000 7f1c2a000640 1 -- 172.21.15.8:0/4078924919 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1c30010a80 con 0x55b0c99b92c0 2024-03-16T21:07:07.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c2a000640 1 -- 172.21.15.8:0/4078924919 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c30016070 con 0x55b0c99b92c0 2024-03-16T21:07:07.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c49dfb740 10 client.27569 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:07.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c49dfb740 1 -- 172.21.15.8:0/4078924919 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b0c991f4e0 con 0x55b0c99b92c0 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c2a000640 1 -- 172.21.15.8:0/4078924919 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55b0c96207e0 con 0x55b0c99b92c0 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c2a000640 1 -- 172.21.15.8:0/4078924919 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f1c30032410 con 0x55b0c99b92c0 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c49dfb740 10 client.27569 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c49dfb740 10 client.27569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c49dfb740 20 client.27569 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b0c9a2e700 0x55b0c9a30af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c49dfb740 4 client.27569 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c49dfb740 1 -- 172.21.15.8:0/4078924919 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b0c95cc700 con 0x55b0c9a2e700 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.071+0000 7f1c3f400640 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b0c9a2e700 0x55b0c9a30af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c3f400640 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b0c9a2e700 0x55b0c9a30af0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13868852fca636ac server_cookie=140ebf0cd80736fc in_seq=0 out_seq=0 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c2a000640 10 client.27569 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c2a000640 1 -- 172.21.15.8:0/4078924919 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b0c95cc700 con 0x55b0c9a2e700 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c2a000640 10 client.27569 handle_command_reply: tid=0 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c49dfb740 1 client.27569 shutdown 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c49dfb740 1 -- 172.21.15.8:0/4078924919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b92c0 msgr2=0x55b0c99c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b92c0 0x55b0c99c4180 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1c3002aa80 tx=0x7f1c30004730 comp rx=0 tx=0).stop 2024-03-16T21:07:07.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c49dfb740 1 -- 172.21.15.8:0/4078924919 shutdown_connections 2024-03-16T21:07:07.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b0c9a2e700 0x55b0c9a30af0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0c99c2630 0x55b0c99c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b0c99b9fa0 0x55b0c99c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c2a000640 0 client.27569 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:07.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c49dfb740 1 --2- 172.21.15.8:0/4078924919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b0c99b92c0 0x55b0c99c4180 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c49dfb740 1 -- 172.21.15.8:0/4078924919 >> 172.21.15.8:0/4078924919 conn(0x55b0c99805a0 msgr2=0x55b0c99b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c49dfb740 1 -- 172.21.15.8:0/4078924919 shutdown_connections 2024-03-16T21:07:07.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.072+0000 7f1c49dfb740 1 -- 172.21.15.8:0/4078924919 wait complete. 2024-03-16T21:07:07.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c49dfb740 20 client.27569 trim_cache size 0 max 16384 2024-03-16T21:07:07.082 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:07:07.083 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:07:07.083 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:07:07.083 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:07:07.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 -- 172.21.15.8:0/1625356265 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c240a1ba0 msgr2=0x7f1c240a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c240a1ba0 0x7f1c240a4060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55b0c99ba4f0 tx=0x7f1c3000b410 comp rx=0 tx=0).stop 2024-03-16T21:07:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 -- 172.21.15.8:0/1625356265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c40069010 msgr2=0x7f1c4019a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c40069010 0x7f1c4019a360 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c036040 tx=0x7f1c2c02c720 comp rx=0 tx=0).stop 2024-03-16T21:07:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 -- 172.21.15.8:0/1625356265 shutdown_connections 2024-03-16T21:07:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1c240a1ba0 0x7f1c240a4060 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c4010de90 0x7f1c4019e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c40069010 0x7f1c4019a360 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 --2- 172.21.15.8:0/1625356265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c400686f0 0x7f1c40199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 -- 172.21.15.8:0/1625356265 >> 172.21.15.8:0/1625356265 conn(0x7f1c400774f0 msgr2=0x7f1c4010f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 -- 172.21.15.8:0/1625356265 shutdown_connections 2024-03-16T21:07:07.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.073+0000 7f1c47200640 1 -- 172.21.15.8:0/1625356265 wait complete. 2024-03-16T21:07:07.099 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:07:07.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:07:07.181 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:07 smithi008 ceph-mon[31434]: pgmap v285: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-03-16T21:07:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.314+0000 7f944e600640 1 -- 172.21.15.8:0/3893820862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94481078b0 msgr2=0x7f9448107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.314+0000 7f944e600640 1 --2- 172.21.15.8:0/3893820862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94481078b0 0x7f9448107d30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9434009900 tx=0x7f943402bc40 comp rx=0 tx=0).stop 2024-03-16T21:07:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.314+0000 7f944e600640 1 -- 172.21.15.8:0/3893820862 shutdown_connections 2024-03-16T21:07:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.314+0000 7f944e600640 1 --2- 172.21.15.8:0/3893820862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9448108270 0x7f9448114780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.314+0000 7f944e600640 1 --2- 172.21.15.8:0/3893820862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94481078b0 0x7f9448107d30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.314+0000 7f944e600640 1 --2- 172.21.15.8:0/3893820862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f944810d8c0 0x7f944810dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.314+0000 7f944e600640 1 -- 172.21.15.8:0/3893820862 >> 172.21.15.8:0/3893820862 conn(0x7f9448077010 msgr2=0x7f9448079430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.314+0000 7f944e600640 1 -- 172.21.15.8:0/3893820862 shutdown_connections 2024-03-16T21:07:07.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.314+0000 7f944e600640 1 -- 172.21.15.8:0/3893820862 wait complete. 2024-03-16T21:07:07.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.315+0000 7f944e600640 1 Processor -- start 2024-03-16T21:07:07.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.316+0000 7f944e600640 1 -- start start 2024-03-16T21:07:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.316+0000 7f944e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94481078b0 0x7f944819dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.316+0000 7f944e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9448108270 0x7f944819e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.316+0000 7f944e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f944810d8c0 0x7f94481a2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.316+0000 7f944e600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94481a2e80 con 0x7f9448108270 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.316+0000 7f944e600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94481a2ff0 con 0x7f94481078b0 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.316+0000 7f944e600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94481a31b0 con 0x7f944810d8c0 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f944d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94481078b0 0x7f944819dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f944dc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f944810d8c0 0x7f94481a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f944d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94481078b0 0x7f944819dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37124/0 (socket says 172.21.15.8:37124) 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f944d200640 1 -- 172.21.15.8:0/2005724286 learned_addr learned my addr 172.21.15.8:0/2005724286 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f9447e00640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9448108270 0x7f944819e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f944d200640 1 -- 172.21.15.8:0/2005724286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f944810d8c0 msgr2=0x7f94481a2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f944d200640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f944810d8c0 0x7f94481a2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f944d200640 1 -- 172.21.15.8:0/2005724286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9448108270 msgr2=0x7f944819e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f944d200640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9448108270 0x7f944819e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f944d200640 1 -- 172.21.15.8:0/2005724286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9440009840 con 0x7f94481078b0 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f944dc00640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f944810d8c0 0x7f94481a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f944d200640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94481078b0 0x7f944819dfc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f943c00e9f0 tx=0x7f943c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.317+0000 7f9445600640 1 -- 172.21.15.8:0/2005724286 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c009700 con 0x7f94481078b0 2024-03-16T21:07:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.318+0000 7f9445600640 1 -- 172.21.15.8:0/2005724286 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f943c00ccc0 con 0x7f94481078b0 2024-03-16T21:07:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.318+0000 7f944e600640 1 -- 172.21.15.8:0/2005724286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9434009560 con 0x7f94481078b0 2024-03-16T21:07:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.318+0000 7f9445600640 1 -- 172.21.15.8:0/2005724286 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c0188c0 con 0x7f94481078b0 2024-03-16T21:07:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.318+0000 7f944e600640 1 -- 172.21.15.8:0/2005724286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94481aab30 con 0x7f94481078b0 2024-03-16T21:07:07.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.319+0000 7f944e600640 1 -- 172.21.15.8:0/2005724286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9448068650 con 0x7f94481078b0 2024-03-16T21:07:07.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.321+0000 7f9445600640 1 -- 172.21.15.8:0/2005724286 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f943c010ac0 con 0x7f94481078b0 2024-03-16T21:07:07.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.322+0000 7f9445600640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94300a1ba0 0x7f94300a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.322+0000 7f9445600640 1 -- 172.21.15.8:0/2005724286 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f943c014070 con 0x7f94481078b0 2024-03-16T21:07:07.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.322+0000 7f9447e00640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94300a1ba0 0x7f94300a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.323+0000 7f9447e00640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94300a1ba0 0x7f94300a4060 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9434000c00 tx=0x7f943402df90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.326+0000 7f9445600640 1 -- 172.21.15.8:0/2005724286 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f943c053280 con 0x7f94481078b0 2024-03-16T21:07:07.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:07 smithi170 ceph-mon[35947]: pgmap v285: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-03-16T21:07:07.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:07 smithi186 ceph-mon[36391]: pgmap v285: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-03-16T21:07:07.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.568+0000 7f944e600640 1 -- 172.21.15.8:0/2005724286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9448117c10 con 0x7f94481078b0 2024-03-16T21:07:07.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.569+0000 7f9445600640 1 -- 172.21.15.8:0/2005724286 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f943c096a60 con 0x7f94481078b0 2024-03-16T21:07:07.576 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:07:07.576 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:27.879028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:07:07.576 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-03-16T21:07:07.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 -- 172.21.15.8:0/2005724286 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94300a1ba0 msgr2=0x7f94300a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94300a1ba0 0x7f94300a4060 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9434000c00 tx=0x7f943402df90 comp rx=0 tx=0).stop 2024-03-16T21:07:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 -- 172.21.15.8:0/2005724286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94481078b0 msgr2=0x7f944819dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94481078b0 0x7f944819dfc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f943c00e9f0 tx=0x7f943c00edf0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 -- 172.21.15.8:0/2005724286 shutdown_connections 2024-03-16T21:07:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f94300a1ba0 0x7f94300a4060 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f944810d8c0 0x7f94481a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9448108270 0x7f944819e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 --2- 172.21.15.8:0/2005724286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94481078b0 0x7f944819dfc0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 -- 172.21.15.8:0/2005724286 >> 172.21.15.8:0/2005724286 conn(0x7f9448077010 msgr2=0x7f94480774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 -- 172.21.15.8:0/2005724286 shutdown_connections 2024-03-16T21:07:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.572+0000 7f944e600640 1 -- 172.21.15.8:0/2005724286 wait complete. 2024-03-16T21:07:07.599 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:07:07.599 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:07:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.821+0000 7f6a17600640 1 -- 172.21.15.8:0/976547120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a10112490 msgr2=0x7f6a10114880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.821+0000 7f6a17600640 1 --2- 172.21.15.8:0/976547120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a10112490 0x7f6a10114880 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009900 tx=0x7f6a0802bcd0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.821+0000 7f6a17600640 1 -- 172.21.15.8:0/976547120 shutdown_connections 2024-03-16T21:07:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.821+0000 7f6a17600640 1 --2- 172.21.15.8:0/976547120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a10112490 0x7f6a10114880 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.821+0000 7f6a17600640 1 --2- 172.21.15.8:0/976547120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a100741b0 0x7f6a10111f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.821+0000 7f6a17600640 1 --2- 172.21.15.8:0/976547120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a10073890 0x7f6a10073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.821+0000 7f6a17600640 1 -- 172.21.15.8:0/976547120 >> 172.21.15.8:0/976547120 conn(0x7f6a100788f0 msgr2=0x7f6a10078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.821+0000 7f6a17600640 1 -- 172.21.15.8:0/976547120 shutdown_connections 2024-03-16T21:07:07.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.821+0000 7f6a17600640 1 -- 172.21.15.8:0/976547120 wait complete. 2024-03-16T21:07:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.822+0000 7f6a17600640 1 Processor -- start 2024-03-16T21:07:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.822+0000 7f6a17600640 1 -- start start 2024-03-16T21:07:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a17600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10073890 0x7f6a1019e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a17600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a100741b0 0x7f6a1019e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a17600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a10112490 0x7f6a101a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a17600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a101a30b0 con 0x7f6a10073890 2024-03-16T21:07:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a17600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a101a3220 con 0x7f6a100741b0 2024-03-16T21:07:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a17600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a101a33e0 con 0x7f6a10112490 2024-03-16T21:07:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a100741b0 0x7f6a1019e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a15600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a10112490 0x7f6a101a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a14c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10073890 0x7f6a1019e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a100741b0 0x7f6a1019e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:37146/0 (socket says 172.21.15.8:37146) 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a0fe00640 1 -- 172.21.15.8:0/718607909 learned_addr learned my addr 172.21.15.8:0/718607909 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a15600640 1 -- 172.21.15.8:0/718607909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a100741b0 msgr2=0x7f6a1019e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a15600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a100741b0 0x7f6a1019e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a15600640 1 -- 172.21.15.8:0/718607909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10073890 msgr2=0x7f6a1019e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a15600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10073890 0x7f6a1019e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a15600640 1 -- 172.21.15.8:0/718607909 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f8009490 con 0x7f6a10112490 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a100741b0 0x7f6a1019e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.823+0000 7f6a14c00640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10073890 0x7f6a1019e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.824+0000 7f6a15600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a10112490 0x7f6a101a2ab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6a0802c210 tx=0x7f6a0802ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.824+0000 7f6a0d600640 1 -- 172.21.15.8:0/718607909 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08004250 con 0x7f6a10112490 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.824+0000 7f6a0d600640 1 -- 172.21.15.8:0/718607909 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6a080043b0 con 0x7f6a10112490 2024-03-16T21:07:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.824+0000 7f6a17600640 1 -- 172.21.15.8:0/718607909 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a08009560 con 0x7f6a10112490 2024-03-16T21:07:07.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.824+0000 7f6a0d600640 1 -- 172.21.15.8:0/718607909 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08003b00 con 0x7f6a10112490 2024-03-16T21:07:07.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.824+0000 7f6a17600640 1 -- 172.21.15.8:0/718607909 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a101aad60 con 0x7f6a10112490 2024-03-16T21:07:07.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.829+0000 7f6a1a3c9740 1 Processor -- start 2024-03-16T21:07:07.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.829+0000 7f6a0d600640 1 -- 172.21.15.8:0/718607909 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f6a08003c60 con 0x7f6a10112490 2024-03-16T21:07:07.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.829+0000 7f6a1a3c9740 1 -- start start 2024-03-16T21:07:07.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.829+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x558519274020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.829+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.829+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x55851927f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.829+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585191e2210 con 0x55851927d140 2024-03-16T21:07:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.829+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585191df740 con 0x558519273c40 2024-03-16T21:07:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.829+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585191daf20 con 0x558519274560 2024-03-16T21:07:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x558519274020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x558519274020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:39192/0 (socket says 172.21.15.8:39192) 2024-03-16T21:07:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a0fe00640 1 -- 172.21.15.8:0/133497868 learned_addr learned my addr 172.21.15.8:0/133497868 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a14c00640 1 --2- 172.21.15.8:0/133497868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/133497868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x55851927f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a0d600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f69f40a1ba0 0x7f69f40a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a14c00640 1 -- 172.21.15.8:0/133497868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 msgr2=0x558519274020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a14c00640 1 --2- 172.21.15.8:0/133497868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x558519274020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a14c00640 1 -- 172.21.15.8:0/133497868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 msgr2=0x55851927f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a14c00640 1 --2- 172.21.15.8:0/133497868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x55851927f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a14c00640 1 -- 172.21.15.8:0/133497868 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55851919cdf0 con 0x558519274560 2024-03-16T21:07:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/133497868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x558519274020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.830+0000 7f6a0d600640 1 -- 172.21.15.8:0/718607909 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6a080efd60 con 0x7f6a10112490 2024-03-16T21:07:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.831+0000 7f6a15600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f69f40a1ba0 0x7f69f40a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.831+0000 7f6a14c00640 1 --2- 172.21.15.8:0/133497868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927cc00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6a00005fd0 tx=0x7f6a00011c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2b025fb8a5e15cd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.831+0000 7f6a05c00640 1 -- 172.21.15.8:0/133497868 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00004d20 con 0x558519274560 2024-03-16T21:07:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.831+0000 7f6a05c00640 1 -- 172.21.15.8:0/133497868 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6a00004e80 con 0x558519274560 2024-03-16T21:07:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.831+0000 7f6a05c00640 1 -- 172.21.15.8:0/133497868 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00004510 con 0x558519274560 2024-03-16T21:07:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.832+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/133497868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 msgr2=0x55851927cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.832+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/133497868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927cc00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6a00005fd0 tx=0x7f6a00011c70 comp rx=0 tx=0).stop 2024-03-16T21:07:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.832+0000 7f6a15600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f69f40a1ba0 0x7f69f40a4060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a080b9410 tx=0x7f6a08004520 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.832+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/133497868 shutdown_connections 2024-03-16T21:07:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.832+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/133497868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x55851927f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.832+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/133497868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927cc00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.832+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/133497868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x558519274020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.832+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/133497868 >> 172.21.15.8:0/133497868 conn(0x55851926e370 msgr2=0x55851926e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.832+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/133497868 shutdown_connections 2024-03-16T21:07:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.832+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/133497868 wait complete. 2024-03-16T21:07:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.832+0000 7f6a1a3c9740 1 -- start start 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a1a3c9740 1 Processor -- start 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x55851927ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558519180150 con 0x55851927d140 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55851917fdf0 con 0x558519273c40 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558518f491c0 con 0x558519274560 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a1a3c9740 10 client.0 _ll_register_callbacks cb 0x5585191cf2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a14c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a14c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39556/0 (socket says 172.21.15.8:39556) 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:39196/0 (socket says 172.21.15.8:39196) 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a14c00640 1 -- 172.21.15.8:0/2444203633 learned_addr learned my addr 172.21.15.8:0/2444203633 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.833+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x55851927ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.834+0000 7f6a14c00640 1 -- 172.21.15.8:0/2444203633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 msgr2=0x55851927a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.834+0000 7f6a14c00640 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.834+0000 7f6a14c00640 1 -- 172.21.15.8:0/2444203633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 msgr2=0x55851927ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.834+0000 7f6a14c00640 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x55851927ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.834+0000 7f6a14c00640 1 -- 172.21.15.8:0/2444203633 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a00011440 con 0x558519274560 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.834+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.834+0000 7f6a14c00640 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927a720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6a00005c10 tx=0x7f6a00003c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a1eee11a0c4c61f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.834+0000 7f69fe000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.834+0000 7f69fe000640 1 -- 172.21.15.8:0/2444203633 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00005410 con 0x558519274560 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.835+0000 7f69fe000640 1 -- 172.21.15.8:0/2444203633 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6a00005570 con 0x558519274560 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.835+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/2444203633 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558518f17720 con 0x558519274560 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.835+0000 7f69fe000640 1 -- 172.21.15.8:0/2444203633 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a0000fe90 con 0x558519274560 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.835+0000 7f6a1a3c9740 10 client.27598 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.835+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/2444203633 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5585191d95a0 con 0x558519274560 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.835+0000 7f69fe000640 1 -- 172.21.15.8:0/2444203633 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x558518f17720 con 0x558519274560 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.835+0000 7f69fe000640 1 -- 172.21.15.8:0/2444203633 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6a00024cb0 con 0x558519274560 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.836+0000 7f6a1a3c9740 10 client.27598 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.836+0000 7f6a1a3c9740 10 client.27598 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.836+0000 7f6a1a3c9740 20 client.27598 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.836+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55851928d220 0x55851928f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.836+0000 7f6a1a3c9740 4 client.27598 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.836+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/2444203633 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558518f66890 con 0x55851928d220 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.836+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55851928d220 0x55851928f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.836+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55851928d220 0x55851928f640 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ebcdc9f9f7db1447 server_cookie=f6fbfaf256447114 in_seq=0 out_seq=0 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.836+0000 7f69fe000640 10 client.27598 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f69fe000640 1 -- 172.21.15.8:0/2444203633 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x558518f66890 con 0x55851928d220 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f69fe000640 10 client.27598 handle_command_reply: tid=0 2024-03-16T21:07:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f6a1a3c9740 1 client.27598 shutdown 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/2444203633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 msgr2=0x55851927a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927a720 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6a00005c10 tx=0x7f6a00003c60 comp rx=0 tx=0).stop 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/2444203633 shutdown_connections 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x55851928d220 0x55851928f640 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x55851927ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927a720 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f69fe000640 0 client.27598 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/2444203633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/2444203633 >> 172.21.15.8:0/2444203633 conn(0x55851926e370 msgr2=0x5585192700c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.837+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/2444203633 shutdown_connections 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.838+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/2444203633 wait complete. 2024-03-16T21:07:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.838+0000 7f6a1a3c9740 20 client.27598 trim_cache size 0 max 16384 2024-03-16T21:07:07.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.851+0000 7f6a1a3c9740 1 Processor -- start 2024-03-16T21:07:07.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.851+0000 7f6a1a3c9740 1 -- start start 2024-03-16T21:07:07.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x5585192884c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558519272f70 con 0x55851927d140 2024-03-16T21:07:07.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558519273610 con 0x558519273c40 2024-03-16T21:07:07.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558519278730 con 0x558519274560 2024-03-16T21:07:07.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:39198/0 (socket says 172.21.15.8:39198) 2024-03-16T21:07:07.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a0fe00640 1 -- 172.21.15.8:0/620957606 learned_addr learned my addr 172.21.15.8:0/620957606 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:07.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a14c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/620957606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x5585192884c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a0fe00640 1 -- 172.21.15.8:0/620957606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 msgr2=0x55851927aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/620957606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a0fe00640 1 -- 172.21.15.8:0/620957606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 msgr2=0x5585192884c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/620957606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x5585192884c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a0fe00640 1 -- 172.21.15.8:0/620957606 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558519175ab0 con 0x558519273c40 2024-03-16T21:07:07.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.852+0000 7f6a14c00640 1 --2- 172.21.15.8:0/620957606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:07.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.853+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/620957606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927c910 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f69f80042a0 tx=0x7f69f8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71a689d292ac4b2b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.853+0000 7f6a05200640 1 -- 172.21.15.8:0/620957606 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8016040 con 0x558519273c40 2024-03-16T21:07:07.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.853+0000 7f6a05200640 1 -- 172.21.15.8:0/620957606 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f69f802d070 con 0x558519273c40 2024-03-16T21:07:07.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.853+0000 7f6a05200640 1 -- 172.21.15.8:0/620957606 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8023cf0 con 0x558519273c40 2024-03-16T21:07:07.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.853+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/620957606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 msgr2=0x55851927c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.853+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/620957606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927c910 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f69f80042a0 tx=0x7f69f8005f90 comp rx=0 tx=0).stop 2024-03-16T21:07:07.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.854+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/620957606 shutdown_connections 2024-03-16T21:07:07.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.854+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/620957606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55851927d140 0x5585192884c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.854+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/620957606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519274560 0x55851927aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.854+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/620957606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558519273c40 0x55851927c910 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.854+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/620957606 >> 172.21.15.8:0/620957606 conn(0x55851926e370 msgr2=0x558519269340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.854+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/620957606 shutdown_connections 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.854+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/620957606 wait complete. 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.854+0000 7f6a1a3c9740 1 -- start start 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.854+0000 7f6a1a3c9740 1 Processor -- start 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519273c40 0x558519280600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558519274560 0x558519280b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a1a3c9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55851927d140 0x558519281080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585192e7bf0 con 0x558519274560 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585192e7d60 con 0x55851927d140 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a1a3c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585192e7f20 con 0x558519273c40 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a1a3c9740 10 client.0 _ll_register_callbacks cb 0x7f69f8011930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519273c40 0x558519280600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519273c40 0x558519280600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39576/0 (socket says 172.21.15.8:39576) 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a0fe00640 1 -- 172.21.15.8:0/219238359 learned_addr learned my addr 172.21.15.8:0/219238359 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55851927d140 0x558519281080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a14c00640 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558519274560 0x558519280b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a0fe00640 1 -- 172.21.15.8:0/219238359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55851927d140 msgr2=0x558519281080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55851927d140 0x558519281080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a0fe00640 1 -- 172.21.15.8:0/219238359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558519274560 msgr2=0x558519280b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558519274560 0x558519280b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.855+0000 7f6a0fe00640 1 -- 172.21.15.8:0/219238359 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585191d95a0 con 0x558519273c40 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.856+0000 7f6a0fe00640 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519273c40 0x558519280600 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f69f8005cd0 tx=0x7f69f8029040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff95e8111719e1dd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.856+0000 7f69fe000640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.856+0000 7f69fe000640 1 -- 172.21.15.8:0/219238359 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8016050 con 0x558519273c40 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.856+0000 7f69fe000640 1 -- 172.21.15.8:0/219238359 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f69f8023710 con 0x558519273c40 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.856+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/219238359 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558518eda7e0 con 0x558519273c40 2024-03-16T21:07:07.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.856+0000 7f69fe000640 1 -- 172.21.15.8:0/219238359 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69f8023a70 con 0x558519273c40 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.856+0000 7f6a1a3c9740 10 client.27604 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.856+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/219238359 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f69f8027060 con 0x558519273c40 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.856+0000 7f69fe000640 1 -- 172.21.15.8:0/219238359 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x558518eda7e0 con 0x558519273c40 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.857+0000 7f69fe000640 1 -- 172.21.15.8:0/219238359 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f69f80334e0 con 0x558519273c40 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.857+0000 7f6a1a3c9740 10 client.27604 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.857+0000 7f6a1a3c9740 10 client.27604 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.857+0000 7f6a1a3c9740 20 client.27604 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.857+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5585192e9640 0x5585192eba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.857+0000 7f6a1a3c9740 4 client.27604 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.857+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/219238359 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558518ec94e0 con 0x5585192e9640 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.857+0000 7f6a14c00640 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5585192e9640 0x5585192eba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.857+0000 7f6a14c00640 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5585192e9640 0x5585192eba60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=27d8a6f8e2125b26 server_cookie=a1dc23926fd9b81 in_seq=0 out_seq=0 2024-03-16T21:07:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.857+0000 7f69fe000640 10 client.27604 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f69fe000640 1 -- 172.21.15.8:0/219238359 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558518ec94e0 con 0x5585192e9640 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f69fe000640 10 client.27604 handle_command_reply: tid=0 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 1 client.27604 shutdown 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/219238359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519273c40 msgr2=0x558519280600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519273c40 0x558519280600 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f69f8005cd0 tx=0x7f69f8029040 comp rx=0 tx=0).stop 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/219238359 shutdown_connections 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x5585192e9640 0x5585192eba60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55851927d140 0x558519281080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558519274560 0x558519280b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 1 --2- 172.21.15.8:0/219238359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558519273c40 0x558519280600 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f69fe000640 0 client.27604 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/219238359 >> 172.21.15.8:0/219238359 conn(0x55851926e370 msgr2=0x55851926cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/219238359 shutdown_connections 2024-03-16T21:07:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 1 -- 172.21.15.8:0/219238359 wait complete. 2024-03-16T21:07:07.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.858+0000 7f6a1a3c9740 20 client.27604 trim_cache size 0 max 16384 2024-03-16T21:07:07.870 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:07:07.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 -- 172.21.15.8:0/718607909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f69f40a1ba0 msgr2=0x7f69f40a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f69f40a1ba0 0x7f69f40a4060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a080b9410 tx=0x7f6a08004520 comp rx=0 tx=0).stop 2024-03-16T21:07:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 -- 172.21.15.8:0/718607909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a10112490 msgr2=0x7f6a101a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a10112490 0x7f6a101a2ab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6a0802c210 tx=0x7f6a0802ccc0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 -- 172.21.15.8:0/718607909 shutdown_connections 2024-03-16T21:07:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f69f40a1ba0 0x7f69f40a4060 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a10112490 0x7f6a101a2ab0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a100741b0 0x7f6a1019e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 --2- 172.21.15.8:0/718607909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10073890 0x7f6a1019e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 -- 172.21.15.8:0/718607909 >> 172.21.15.8:0/718607909 conn(0x7f6a100788f0 msgr2=0x7f6a1010df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 -- 172.21.15.8:0/718607909 shutdown_connections 2024-03-16T21:07:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:07.859+0000 7f6a17600640 1 -- 172.21.15.8:0/718607909 wait complete. 2024-03-16T21:07:07.885 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:07:07.885 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:07:08.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.115+0000 7fc4d2600640 1 -- 172.21.15.8:0/4207106820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4cc1002b0 msgr2=0x7fc4cc100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.115+0000 7fc4d2600640 1 --2- 172.21.15.8:0/4207106820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4cc1002b0 0x7fc4cc100690 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc009ca0 tx=0x7fc4bc02c0f0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.115+0000 7fc4d2600640 1 -- 172.21.15.8:0/4207106820 shutdown_connections 2024-03-16T21:07:08.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.115+0000 7fc4d2600640 1 --2- 172.21.15.8:0/4207106820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4cc10de60 0x7fc4cc110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.115+0000 7fc4d2600640 1 --2- 172.21.15.8:0/4207106820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4cc100bd0 0x7fc4cc10d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.115+0000 7fc4d2600640 1 --2- 172.21.15.8:0/4207106820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4cc1002b0 0x7fc4cc100690 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.115+0000 7fc4d2600640 1 -- 172.21.15.8:0/4207106820 >> 172.21.15.8:0/4207106820 conn(0x7fc4cc076770 msgr2=0x7fc4cc076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.115+0000 7fc4d2600640 1 -- 172.21.15.8:0/4207106820 shutdown_connections 2024-03-16T21:07:08.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.115+0000 7fc4d2600640 1 -- 172.21.15.8:0/4207106820 wait complete. 2024-03-16T21:07:08.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.116+0000 7fc4d2600640 1 Processor -- start 2024-03-16T21:07:08.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.117+0000 7fc4d2600640 1 -- start start 2024-03-16T21:07:08.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.117+0000 7fc4d2600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4cc1002b0 0x7fc4cc199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.117+0000 7fc4d2600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4cc100bd0 0x7fc4cc19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.117+0000 7fc4d2600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4cc10de60 0x7fc4cc19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.117+0000 7fc4d2600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc19edc0 con 0x7fc4cc10de60 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.117+0000 7fc4d2600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc19ef30 con 0x7fc4cc1002b0 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.117+0000 7fc4d2600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc19f0f0 con 0x7fc4cc100bd0 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.117+0000 7fc4caa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4cc100bd0 0x7fc4cc19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.117+0000 7fc4cb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4cc1002b0 0x7fc4cc199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.117+0000 7fc4caa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4cc100bd0 0x7fc4cc19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39592/0 (socket says 172.21.15.8:39592) 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.117+0000 7fc4caa00640 1 -- 172.21.15.8:0/4226689549 learned_addr learned my addr 172.21.15.8:0/4226689549 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.118+0000 7fc4cbe00640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4cc10de60 0x7fc4cc19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.118+0000 7fc4caa00640 1 -- 172.21.15.8:0/4226689549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4cc1002b0 msgr2=0x7fc4cc199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.118+0000 7fc4caa00640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4cc1002b0 0x7fc4cc199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.118+0000 7fc4caa00640 1 -- 172.21.15.8:0/4226689549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4cc10de60 msgr2=0x7fc4cc19e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.118+0000 7fc4caa00640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4cc10de60 0x7fc4cc19e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.118+0000 7fc4caa00640 1 -- 172.21.15.8:0/4226689549 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c4009490 con 0x7fc4cc100bd0 2024-03-16T21:07:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.118+0000 7fc4caa00640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4cc100bd0 0x7fc4cc19a440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400d950 tx=0x7fc4b400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.118+0000 7fc4c3e00640 1 -- 172.21.15.8:0/4226689549 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4009a30 con 0x7fc4cc100bd0 2024-03-16T21:07:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.118+0000 7fc4c3e00640 1 -- 172.21.15.8:0/4226689549 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc4b4009b90 con 0x7fc4cc100bd0 2024-03-16T21:07:08.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.118+0000 7fc4c3e00640 1 -- 172.21.15.8:0/4226689549 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4004a00 con 0x7fc4cc100bd0 2024-03-16T21:07:08.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.118+0000 7fc4d2600640 1 -- 172.21.15.8:0/4226689549 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc009900 con 0x7fc4cc100bd0 2024-03-16T21:07:08.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.119+0000 7fc4d2600640 1 -- 172.21.15.8:0/4226689549 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc1a6a70 con 0x7fc4cc100bd0 2024-03-16T21:07:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.122+0000 7fc4c3e00640 1 -- 172.21.15.8:0/4226689549 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fc4b4009d00 con 0x7fc4cc100bd0 2024-03-16T21:07:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.122+0000 7fc4d53c2740 1 Processor -- start 2024-03-16T21:07:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4d53c2740 1 -- start start 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e549c40 0x55e57e54a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e54a560 0x55e57e552c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e553140 0x55e57e555530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e4b8210 con 0x55e57e54a560 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e4b5740 con 0x55e57e553140 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e4b0f20 con 0x55e57e549c40 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4cbe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e549c40 0x55e57e54a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4cb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e54a560 0x55e57e552c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4cbe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e549c40 0x55e57e54a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39602/0 (socket says 172.21.15.8:39602) 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4cbe00640 1 -- 172.21.15.8:0/3613529631 learned_addr learned my addr 172.21.15.8:0/3613529631 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.123+0000 7fc4caa00640 1 --2- 172.21.15.8:0/3613529631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e553140 0x55e57e555530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4cbe00640 1 -- 172.21.15.8:0/3613529631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e553140 msgr2=0x55e57e555530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4cbe00640 1 --2- 172.21.15.8:0/3613529631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e553140 0x55e57e555530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4cbe00640 1 -- 172.21.15.8:0/3613529631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e54a560 msgr2=0x55e57e552c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4cbe00640 1 --2- 172.21.15.8:0/3613529631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e54a560 0x55e57e552c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4cbe00640 1 -- 172.21.15.8:0/3613529631 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e57e472df0 con 0x55e57e549c40 2024-03-16T21:07:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4c3e00640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4b00a1c20 0x7fc4b00a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4cbe00640 1 --2- 172.21.15.8:0/3613529631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e549c40 0x55e57e54a020 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009c80 tx=0x7fc4c40117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beb0464b52f006d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4c3e00640 1 -- 172.21.15.8:0/4226689549 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fc4b40ccbb0 con 0x7fc4cc100bd0 2024-03-16T21:07:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4cb400640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4b00a1c20 0x7fc4b00a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4c0c00640 1 -- 172.21.15.8:0/3613529631 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4012450 con 0x55e57e549c40 2024-03-16T21:07:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4c0c00640 1 -- 172.21.15.8:0/3613529631 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc4c4012ab0 con 0x55e57e549c40 2024-03-16T21:07:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.124+0000 7fc4c0c00640 1 -- 172.21.15.8:0/3613529631 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400fc50 con 0x55e57e549c40 2024-03-16T21:07:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.125+0000 7fc4d53c2740 1 -- 172.21.15.8:0/3613529631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e549c40 msgr2=0x55e57e54a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.125+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/3613529631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e549c40 0x55e57e54a020 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009c80 tx=0x7fc4c40117b0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.125+0000 7fc4cb400640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4b00a1c20 0x7fc4b00a40e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc000f80 tx=0x7fc4bc005ef0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.125+0000 7fc4d53c2740 1 -- 172.21.15.8:0/3613529631 shutdown_connections 2024-03-16T21:07:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.125+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/3613529631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e553140 0x55e57e555530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.125+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/3613529631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e54a560 0x55e57e552c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.125+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/3613529631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e549c40 0x55e57e54a020 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.125+0000 7fc4d53c2740 1 -- 172.21.15.8:0/3613529631 >> 172.21.15.8:0/3613529631 conn(0x55e57e544370 msgr2=0x55e57e544750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.125+0000 7fc4d53c2740 1 -- 172.21.15.8:0/3613529631 shutdown_connections 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.125+0000 7fc4d53c2740 1 -- 172.21.15.8:0/3613529631 wait complete. 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.126+0000 7fc4d53c2740 1 -- start start 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.126+0000 7fc4d53c2740 1 Processor -- start 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 0x55e57e550150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 0x55e57e550690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e553140 0x55e57e550bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e456150 con 0x55e57e549c40 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e455df0 con 0x55e57e553140 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e21f1c0 con 0x55e57e54a560 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4d53c2740 10 client.0 _ll_register_callbacks cb 0x55e57e4a52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4caa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 0x55e57e550690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4caa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 0x55e57e550690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39608/0 (socket says 172.21.15.8:39608) 2024-03-16T21:07:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4caa00640 1 -- 172.21.15.8:0/1153201527 learned_addr learned my addr 172.21.15.8:0/1153201527 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4cb400640 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 0x55e57e550150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4cbe00640 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e553140 0x55e57e550bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4caa00640 1 -- 172.21.15.8:0/1153201527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e553140 msgr2=0x55e57e550bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4caa00640 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e553140 0x55e57e550bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4caa00640 1 -- 172.21.15.8:0/1153201527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 msgr2=0x55e57e550150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4caa00640 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 0x55e57e550150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.127+0000 7fc4caa00640 1 -- 172.21.15.8:0/1153201527 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c4009930 con 0x55e57e54a560 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.128+0000 7fc4caa00640 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 0x55e57e550690 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc4b40994a0 tx=0x7fc4b4095440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94f78b06bbb5295f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.128+0000 7fc4b9600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.128+0000 7fc4b9600640 1 -- 172.21.15.8:0/1153201527 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b40ca740 con 0x55e57e54a560 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.128+0000 7fc4b9600640 1 -- 172.21.15.8:0/1153201527 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fc4b40d1040 con 0x55e57e54a560 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.128+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1153201527 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e57e1b07e0 con 0x55e57e54a560 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.128+0000 7fc4b9600640 1 -- 172.21.15.8:0/1153201527 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4b4095a40 con 0x55e57e54a560 2024-03-16T21:07:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.128+0000 7fc4d53c2740 10 client.27616 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.128+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1153201527 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e57e4af5a0 con 0x55e57e54a560 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.128+0000 7fc4b9600640 1 -- 172.21.15.8:0/1153201527 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55e57e1b07e0 con 0x55e57e54a560 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.129+0000 7fc4b9600640 1 -- 172.21.15.8:0/1153201527 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fc4b4004020 con 0x55e57e54a560 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.129+0000 7fc4d53c2740 10 client.27616 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.129+0000 7fc4d53c2740 10 client.27616 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.129+0000 7fc4d53c2740 20 client.27616 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.129+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55e57e563260 0x55e57e565650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.129+0000 7fc4d53c2740 4 client.27616 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.129+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1153201527 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e57e1ed720 con 0x55e57e563260 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.129+0000 7fc4cb400640 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55e57e563260 0x55e57e565650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.130+0000 7fc4cb400640 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55e57e563260 0x55e57e565650 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c18e382039d7f047 server_cookie=2971b08a283453b3 in_seq=0 out_seq=0 2024-03-16T21:07:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.130+0000 7fc4b9600640 10 client.27616 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:07:08.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.130+0000 7fc4b9600640 1 -- 172.21.15.8:0/1153201527 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55e57e1ed720 con 0x55e57e563260 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.130+0000 7fc4b9600640 10 client.27616 handle_command_reply: tid=0 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.130+0000 7fc4d53c2740 1 client.27616 shutdown 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1153201527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 msgr2=0x55e57e550690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 0x55e57e550690 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc4b40994a0 tx=0x7fc4b4095440 comp rx=0 tx=0).stop 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1153201527 shutdown_connections 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55e57e563260 0x55e57e565650 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e553140 0x55e57e550bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 0x55e57e550690 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4b9600640 0 client.27616 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1153201527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 0x55e57e550150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1153201527 >> 172.21.15.8:0/1153201527 conn(0x55e57e544370 msgr2=0x55e57e5460c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1153201527 shutdown_connections 2024-03-16T21:07:08.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1153201527 wait complete. 2024-03-16T21:07:08.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.131+0000 7fc4d53c2740 20 client.27616 trim_cache size 0 max 16384 2024-03-16T21:07:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.145+0000 7fc4d53c2740 1 Processor -- start 2024-03-16T21:07:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.145+0000 7fc4d53c2740 1 -- start start 2024-03-16T21:07:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.145+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 0x55e57e552880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.145+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e54a560 0x55e57e5509f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.145+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e553140 0x55e57e55e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.145+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e545370 con 0x55e57e549c40 2024-03-16T21:07:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.145+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e5441a0 con 0x55e57e54a560 2024-03-16T21:07:08.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.145+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e565cb0 con 0x55e57e553140 2024-03-16T21:07:08.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.146+0000 7fc4cb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 0x55e57e552880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.146+0000 7fc4cb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 0x55e57e552880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40338/0 (socket says 172.21.15.8:40338) 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.146+0000 7fc4cb400640 1 -- 172.21.15.8:0/3407224830 learned_addr learned my addr 172.21.15.8:0/3407224830 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.146+0000 7fc4cbe00640 1 --2- 172.21.15.8:0/3407224830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e553140 0x55e57e55e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.146+0000 7fc4caa00640 1 --2- 172.21.15.8:0/3407224830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e54a560 0x55e57e5509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.146+0000 7fc4cb400640 1 -- 172.21.15.8:0/3407224830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e553140 msgr2=0x55e57e55e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.146+0000 7fc4cb400640 1 --2- 172.21.15.8:0/3407224830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e553140 0x55e57e55e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.146+0000 7fc4cb400640 1 -- 172.21.15.8:0/3407224830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e54a560 msgr2=0x55e57e5509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.146+0000 7fc4cb400640 1 --2- 172.21.15.8:0/3407224830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e54a560 0x55e57e5509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.146+0000 7fc4cb400640 1 -- 172.21.15.8:0/3407224830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e57e44bab0 con 0x55e57e549c40 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.147+0000 7fc4cb400640 1 --2- 172.21.15.8:0/3407224830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 0x55e57e552880 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc037040 tx=0x7fc4bc042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2ad8a8fd448c20 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.147+0000 7fc4bbe00640 1 -- 172.21.15.8:0/3407224830 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0542d0 con 0x55e57e549c40 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.147+0000 7fc4bbe00640 1 -- 172.21.15.8:0/3407224830 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc4bc044070 con 0x55e57e549c40 2024-03-16T21:07:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.147+0000 7fc4bbe00640 1 -- 172.21.15.8:0/3407224830 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc004280 con 0x55e57e549c40 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.148+0000 7fc4d53c2740 1 -- 172.21.15.8:0/3407224830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 msgr2=0x55e57e552880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.148+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/3407224830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 0x55e57e552880 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc037040 tx=0x7fc4bc042000 comp rx=0 tx=0).stop 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.148+0000 7fc4d53c2740 1 -- 172.21.15.8:0/3407224830 shutdown_connections 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.148+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/3407224830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e553140 0x55e57e55e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.148+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/3407224830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e54a560 0x55e57e5509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.148+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/3407224830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e549c40 0x55e57e552880 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.148+0000 7fc4d53c2740 1 -- 172.21.15.8:0/3407224830 >> 172.21.15.8:0/3407224830 conn(0x55e57e544370 msgr2=0x55e57e545fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.148+0000 7fc4d53c2740 1 -- 172.21.15.8:0/3407224830 shutdown_connections 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.148+0000 7fc4d53c2740 1 -- 172.21.15.8:0/3407224830 wait complete. 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.148+0000 7fc4d53c2740 1 -- start start 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4d53c2740 1 Processor -- start 2024-03-16T21:07:08.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e549c40 0x55e57e5b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 0x55e57e5b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4d53c2740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e553140 0x55e57e54d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e54d610 con 0x55e57e553140 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e54d780 con 0x55e57e549c40 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4d53c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e57e54d940 con 0x55e57e54a560 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4d53c2740 10 client.0 _ll_register_callbacks cb 0x7fc4b40046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4cb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e549c40 0x55e57e5b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4cb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e549c40 0x55e57e5b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:39278/0 (socket says 172.21.15.8:39278) 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4cb400640 1 -- 172.21.15.8:0/1556162195 learned_addr learned my addr 172.21.15.8:0/1556162195 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.149+0000 7fc4cbe00640 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e553140 0x55e57e54d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.150+0000 7fc4caa00640 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 0x55e57e5b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.150+0000 7fc4cb400640 1 -- 172.21.15.8:0/1556162195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 msgr2=0x55e57e5b72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.150+0000 7fc4cb400640 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 0x55e57e5b72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.150+0000 7fc4cb400640 1 -- 172.21.15.8:0/1556162195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e553140 msgr2=0x55e57e54d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.150+0000 7fc4cb400640 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e553140 0x55e57e54d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.150+0000 7fc4cb400640 1 -- 172.21.15.8:0/1556162195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc110de0 con 0x55e57e549c40 2024-03-16T21:07:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.150+0000 7fc4cb400640 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e549c40 0x55e57e5b6d70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc058040 tx=0x7fc4bc005c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3e245e3092ec672 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.150+0000 7fc4b9600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:07:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.151+0000 7fc4b9600640 1 -- 172.21.15.8:0/1556162195 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0327b0 con 0x55e57e549c40 2024-03-16T21:07:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.151+0000 7fc4b9600640 1 -- 172.21.15.8:0/1556162195 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fc4bc032910 con 0x55e57e549c40 2024-03-16T21:07:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.151+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1556162195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4c4012ab0 con 0x55e57e549c40 2024-03-16T21:07:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.151+0000 7fc4b9600640 1 -- 172.21.15.8:0/1556162195 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4bc032ad0 con 0x55e57e549c40 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.152+0000 7fc4d53c2740 10 client.27611 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.152+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1556162195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e57e471650 con 0x55e57e549c40 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.152+0000 7fc4b9600640 1 -- 172.21.15.8:0/1556162195 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc4c4012ab0 con 0x55e57e549c40 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.152+0000 7fc4b9600640 1 -- 172.21.15.8:0/1556162195 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fc4bc048040 con 0x55e57e549c40 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.152+0000 7fc4d53c2740 10 client.27611 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.152+0000 7fc4d53c2740 10 client.27611 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.152+0000 7fc4d53c2740 20 client.27611 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.152+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55e57e5bf9e0 0x55e57e5c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.152+0000 7fc4d53c2740 4 client.27611 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.152+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1556162195 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e57e23c890 con 0x55e57e5bf9e0 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.153+0000 7fc4caa00640 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55e57e5bf9e0 0x55e57e5c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.154+0000 7fc4caa00640 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55e57e5bf9e0 0x55e57e5c1dd0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76a8b1d41fc4a53d server_cookie=76a9c6b92dc62016 in_seq=0 out_seq=0 2024-03-16T21:07:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.154+0000 7fc4b9600640 10 client.27611 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:07:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.154+0000 7fc4b9600640 1 -- 172.21.15.8:0/1556162195 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e57e23c890 con 0x55e57e5bf9e0 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.154+0000 7fc4b9600640 10 client.27611 handle_command_reply: tid=0 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.154+0000 7fc4d53c2740 1 client.27611 shutdown 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1556162195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e549c40 msgr2=0x55e57e5b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e549c40 0x55e57e5b6d70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc058040 tx=0x7fc4bc005c60 comp rx=0 tx=0).stop 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1556162195 shutdown_connections 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x55e57e5bf9e0 0x55e57e5c1dd0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e57e553140 0x55e57e54d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e57e54a560 0x55e57e5b72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4d53c2740 1 --2- 172.21.15.8:0/1556162195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e57e549c40 0x55e57e5b6d70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4b9600640 0 client.27611 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1556162195 >> 172.21.15.8:0/1556162195 conn(0x55e57e544370 msgr2=0x55e57e542be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1556162195 shutdown_connections 2024-03-16T21:07:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4d53c2740 1 -- 172.21.15.8:0/1556162195 wait complete. 2024-03-16T21:07:08.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.155+0000 7fc4d53c2740 20 client.27611 trim_cache size 0 max 16384 2024-03-16T21:07:08.164 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:07:08.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 -- 172.21.15.8:0/4226689549 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4b00a1c20 msgr2=0x7fc4b00a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4b00a1c20 0x7fc4b00a40e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc000f80 tx=0x7fc4bc005ef0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 -- 172.21.15.8:0/4226689549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4cc100bd0 msgr2=0x7fc4cc19a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4cc100bd0 0x7fc4cc19a440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400d950 tx=0x7fc4b400de10 comp rx=0 tx=0).stop 2024-03-16T21:07:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 -- 172.21.15.8:0/4226689549 shutdown_connections 2024-03-16T21:07:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc4b00a1c20 0x7fc4b00a40e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4cc10de60 0x7fc4cc19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4cc100bd0 0x7fc4cc19a440 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 --2- 172.21.15.8:0/4226689549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4cc1002b0 0x7fc4cc199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 -- 172.21.15.8:0/4226689549 >> 172.21.15.8:0/4226689549 conn(0x7fc4cc076770 msgr2=0x7fc4cc10f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 -- 172.21.15.8:0/4226689549 shutdown_connections 2024-03-16T21:07:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.156+0000 7fc4d2600640 1 -- 172.21.15.8:0/4226689549 wait complete. 2024-03-16T21:07:08.178 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:08 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2005724286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:07:08.182 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:07:08.182 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:07:08.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:08 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2005724286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:07:08.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:08 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2005724286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:07:08.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.402+0000 7f6b73200640 1 -- 172.21.15.8:0/3637903216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b741025b0 msgr2=0x7f6b74102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.402+0000 7f6b73200640 1 --2- 172.21.15.8:0/3637903216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b741025b0 0x7f6b74102990 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009900 tx=0x7f6b6402bcd0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.402+0000 7f6b73200640 1 -- 172.21.15.8:0/3637903216 shutdown_connections 2024-03-16T21:07:08.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.402+0000 7f6b73200640 1 --2- 172.21.15.8:0/3637903216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b7410b980 0x7f6b7410ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.402+0000 7f6b73200640 1 --2- 172.21.15.8:0/3637903216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b74102ed0 0x7f6b7410b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.402+0000 7f6b73200640 1 --2- 172.21.15.8:0/3637903216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b741025b0 0x7f6b74102990 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.402+0000 7f6b73200640 1 -- 172.21.15.8:0/3637903216 >> 172.21.15.8:0/3637903216 conn(0x7f6b740fbd50 msgr2=0x7f6b740fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.403+0000 7f6b73200640 1 -- 172.21.15.8:0/3637903216 shutdown_connections 2024-03-16T21:07:08.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.403+0000 7f6b73200640 1 -- 172.21.15.8:0/3637903216 wait complete. 2024-03-16T21:07:08.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.404+0000 7f6b73200640 1 Processor -- start 2024-03-16T21:07:08.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.404+0000 7f6b73200640 1 -- start start 2024-03-16T21:07:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b73200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b741025b0 0x7f6b7419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b73200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b74102ed0 0x7f6b7419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b73200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b7410b980 0x7f6b741978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b73200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74197f20 con 0x7f6b741025b0 2024-03-16T21:07:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b73200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74198090 con 0x7f6b7410b980 2024-03-16T21:07:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b73200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74198250 con 0x7f6b74102ed0 2024-03-16T21:07:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b71e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b741025b0 0x7f6b7419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b71e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b741025b0 0x7f6b7419d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40364/0 (socket says 172.21.15.8:40364) 2024-03-16T21:07:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b71e00640 1 -- 172.21.15.8:0/2948949443 learned_addr learned my addr 172.21.15.8:0/2948949443 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b69400640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b74102ed0 0x7f6b7419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b72800640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b7410b980 0x7f6b741978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b71e00640 1 -- 172.21.15.8:0/2948949443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b74102ed0 msgr2=0x7f6b7419dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b71e00640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b74102ed0 0x7f6b7419dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b71e00640 1 -- 172.21.15.8:0/2948949443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b7410b980 msgr2=0x7f6b741978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b71e00640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b7410b980 0x7f6b741978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b71e00640 1 -- 172.21.15.8:0/2948949443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c009490 con 0x7f6b741025b0 2024-03-16T21:07:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.405+0000 7f6b69400640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b74102ed0 0x7f6b7419dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.406+0000 7f6b71e00640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b741025b0 0x7f6b7419d720 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6b64000c00 tx=0x7f6b64004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.406+0000 7f6b6b400640 1 -- 172.21.15.8:0/2948949443 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6402cb60 con 0x7f6b741025b0 2024-03-16T21:07:08.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.406+0000 7f6b73200640 1 -- 172.21.15.8:0/2948949443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b64009560 con 0x7f6b741025b0 2024-03-16T21:07:08.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.406+0000 7f6b6b400640 1 -- 172.21.15.8:0/2948949443 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6b6402ccc0 con 0x7f6b741025b0 2024-03-16T21:07:08.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.406+0000 7f6b6b400640 1 -- 172.21.15.8:0/2948949443 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64003c30 con 0x7f6b741025b0 2024-03-16T21:07:08.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.406+0000 7f6b73200640 1 -- 172.21.15.8:0/2948949443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b741a45e0 con 0x7f6b741025b0 2024-03-16T21:07:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b7bba8740 1 Processor -- start 2024-03-16T21:07:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b6b400640 1 -- 172.21.15.8:0/2948949443 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f6b64004e10 con 0x7f6b741025b0 2024-03-16T21:07:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b7bba8740 1 -- start start 2024-03-16T21:07:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07200 0x55b7e5b075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 0x55b7e5b101c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b12af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5a71210 con 0x55b7e5b07200 2024-03-16T21:07:08.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5a6e740 con 0x55b7e5b10700 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5a69f20 con 0x55b7e5b07b20 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b69400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b12af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b69400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b12af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:39286/0 (socket says 172.21.15.8:39286) 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b69400640 1 -- 172.21.15.8:0/2668282294 learned_addr learned my addr 172.21.15.8:0/2668282294 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b71e00640 1 --2- 172.21.15.8:0/2668282294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 0x55b7e5b101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.410+0000 7f6b72800640 1 --2- 172.21.15.8:0/2668282294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07200 0x55b7e5b075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.411+0000 7f6b69400640 1 -- 172.21.15.8:0/2668282294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 msgr2=0x55b7e5b101c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.411+0000 7f6b69400640 1 --2- 172.21.15.8:0/2668282294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 0x55b7e5b101c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.411+0000 7f6b69400640 1 -- 172.21.15.8:0/2668282294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07200 msgr2=0x55b7e5b075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.411+0000 7f6b69400640 1 --2- 172.21.15.8:0/2668282294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07200 0x55b7e5b075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.411+0000 7f6b69400640 1 -- 172.21.15.8:0/2668282294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7e5a2bdf0 con 0x55b7e5b10700 2024-03-16T21:07:08.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.411+0000 7f6b69400640 1 --2- 172.21.15.8:0/2668282294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b12af0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c011680 tx=0x7f6b5c011b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4d5617a9693374d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.411+0000 7f6b63400640 1 -- 172.21.15.8:0/2668282294 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00fc00 con 0x55b7e5b10700 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.411+0000 7f6b63400640 1 -- 172.21.15.8:0/2668282294 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6b5c005520 con 0x55b7e5b10700 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.411+0000 7f6b63400640 1 -- 172.21.15.8:0/2668282294 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c019430 con 0x55b7e5b10700 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.411+0000 7f6b6b400640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6b580a1c20 0x7f6b580a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.412+0000 7f6b6b400640 1 -- 172.21.15.8:0/2948949443 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f6b640ef7f0 con 0x7f6b741025b0 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.412+0000 7f6b72800640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6b580a1c20 0x7f6b580a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.412+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2668282294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 msgr2=0x55b7e5b12af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.412+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/2668282294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b12af0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c011680 tx=0x7f6b5c011b40 comp rx=0 tx=0).stop 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.412+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2668282294 shutdown_connections 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.412+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/2668282294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b12af0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.412+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/2668282294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 0x55b7e5b101c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.412+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/2668282294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07200 0x55b7e5b075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.412+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2668282294 >> 172.21.15.8:0/2668282294 conn(0x55b7e5b01930 msgr2=0x55b7e5b01d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.412+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2668282294 shutdown_connections 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.412+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2668282294 wait complete. 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.413+0000 7f6b72800640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6b580a1c20 0x7f6b580a40e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c005fd0 tx=0x7f6b6c009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.413+0000 7f6b7bba8740 1 -- start start 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.413+0000 7f6b7bba8740 1 Processor -- start 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.413+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07200 0x55b7e5b0d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.413+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07b20 0x55b7e5b0dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.413+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b0e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.413+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5a0f150 con 0x55b7e5b07b20 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.413+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5a0edf0 con 0x55b7e5b10700 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e57d81c0 con 0x55b7e5b07200 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b7bba8740 10 client.0 _ll_register_callbacks cb 0x55b7e5a5e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b71e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07200 0x55b7e5b0d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b72800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b0e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b69400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07b20 0x55b7e5b0dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b71e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07200 0x55b7e5b0d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39686/0 (socket says 172.21.15.8:39686) 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b71e00640 1 -- 172.21.15.8:0/2477152092 learned_addr learned my addr 172.21.15.8:0/2477152092 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b72800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b0e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:39292/0 (socket says 172.21.15.8:39292) 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b71e00640 1 -- 172.21.15.8:0/2477152092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 msgr2=0x55b7e5b0e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b71e00640 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b0e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b71e00640 1 -- 172.21.15.8:0/2477152092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07b20 msgr2=0x55b7e5b0dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b71e00640 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07b20 0x55b7e5b0dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b71e00640 1 -- 172.21.15.8:0/2477152092 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5c009e10 con 0x55b7e5b07200 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b72800640 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b0e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.414+0000 7f6b71e00640 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07200 0x55b7e5b0d700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6b64005ab0 tx=0x7f6b640b8850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f7e57ce41746f26 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b57e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b57e00640 1 -- 172.21.15.8:0/2477152092 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6402ce30 con 0x55b7e5b07200 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b57e00640 1 -- 172.21.15.8:0/2477152092 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f6b640bcbf0 con 0x55b7e5b07200 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2477152092 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7e57697e0 con 0x55b7e5b07200 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b57e00640 1 -- 172.21.15.8:0/2477152092 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b640bc4f0 con 0x55b7e5b07200 2024-03-16T21:07:08.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b7bba8740 10 client.27634 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2477152092 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b7e5a685a0 con 0x55b7e5b07200 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b57e00640 1 -- 172.21.15.8:0/2477152092 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55b7e57697e0 con 0x55b7e5b07200 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b57e00640 1 -- 172.21.15.8:0/2477152092 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6b6403c070 con 0x55b7e5b07200 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b7bba8740 10 client.27634 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b7bba8740 10 client.27634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b7bba8740 20 client.27634 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.415+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b7e5b20490 0x55b7e5b228b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.416+0000 7f6b7bba8740 4 client.27634 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.416+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2477152092 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7e57a6720 con 0x55b7e5b20490 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.416+0000 7f6b69400640 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b7e5b20490 0x55b7e5b228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.416+0000 7f6b69400640 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b7e5b20490 0x55b7e5b228b0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bdce9fdd99a64b8 server_cookie=1aab5be5e58f9f7e in_seq=0 out_seq=0 2024-03-16T21:07:08.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.416+0000 7f6b57e00640 10 client.27634 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:08.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.417+0000 7f6b57e00640 1 -- 172.21.15.8:0/2477152092 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55b7e57a6720 con 0x55b7e5b20490 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.417+0000 7f6b57e00640 10 client.27634 handle_command_reply: tid=0 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.417+0000 7f6b7bba8740 1 client.27634 shutdown 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.417+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2477152092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07200 msgr2=0x55b7e5b0d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.417+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07200 0x55b7e5b0d700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6b64005ab0 tx=0x7f6b640b8850 comp rx=0 tx=0).stop 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.417+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2477152092 shutdown_connections 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.417+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b10700 0x55b7e5b0e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.417+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b7e5b20490 0x55b7e5b228b0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.417+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07b20 0x55b7e5b0dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.417+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/2477152092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07200 0x55b7e5b0d700 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.418+0000 7f6b57e00640 0 client.27634 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.418+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2477152092 >> 172.21.15.8:0/2477152092 conn(0x55b7e5b01930 msgr2=0x55b7e5b02df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.418+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2477152092 shutdown_connections 2024-03-16T21:07:08.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.418+0000 7f6b7bba8740 1 -- 172.21.15.8:0/2477152092 wait complete. 2024-03-16T21:07:08.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.418+0000 7f6b7bba8740 20 client.27634 trim_cache size 0 max 16384 2024-03-16T21:07:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b7bba8740 1 Processor -- start 2024-03-16T21:07:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b7bba8740 1 -- start start 2024-03-16T21:07:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b07200 0x55b7e5af8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07b20 0x55b7e5afc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b10700 0x55b7e5b0dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5b06610 con 0x55b7e5b07b20 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5b02930 con 0x55b7e5b07200 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5b02af0 con 0x55b7e5b10700 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b72800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b10700 0x55b7e5b0dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b71e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b07200 0x55b7e5af8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b72800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b10700 0x55b7e5b0dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39702/0 (socket says 172.21.15.8:39702) 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b72800640 1 -- 172.21.15.8:0/3391605328 learned_addr learned my addr 172.21.15.8:0/3391605328 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.432+0000 7f6b69400640 1 --2- 172.21.15.8:0/3391605328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07b20 0x55b7e5afc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.433+0000 7f6b72800640 1 -- 172.21.15.8:0/3391605328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b07200 msgr2=0x55b7e5af8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.433+0000 7f6b72800640 1 --2- 172.21.15.8:0/3391605328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b07200 0x55b7e5af8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.433+0000 7f6b72800640 1 -- 172.21.15.8:0/3391605328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07b20 msgr2=0x55b7e5afc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.433+0000 7f6b72800640 1 --2- 172.21.15.8:0/3391605328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07b20 0x55b7e5afc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.433+0000 7f6b72800640 1 -- 172.21.15.8:0/3391605328 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7e5a04ab0 con 0x55b7e5b10700 2024-03-16T21:07:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.433+0000 7f6b72800640 1 --2- 172.21.15.8:0/3391605328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b10700 0x55b7e5b0dfa0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0043a0 tx=0x7f6b6c01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8e28351bab06b13 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.433+0000 7f6b62a00640 1 -- 172.21.15.8:0/3391605328 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c025040 con 0x55b7e5b10700 2024-03-16T21:07:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.433+0000 7f6b62a00640 1 -- 172.21.15.8:0/3391605328 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6b6c004860 con 0x55b7e5b10700 2024-03-16T21:07:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.433+0000 7f6b62a00640 1 -- 172.21.15.8:0/3391605328 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c017070 con 0x55b7e5b10700 2024-03-16T21:07:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.434+0000 7f6b7bba8740 1 -- 172.21.15.8:0/3391605328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b10700 msgr2=0x55b7e5b0dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.434+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/3391605328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b10700 0x55b7e5b0dfa0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0043a0 tx=0x7f6b6c01a000 comp rx=0 tx=0).stop 2024-03-16T21:07:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.434+0000 7f6b7bba8740 1 -- 172.21.15.8:0/3391605328 shutdown_connections 2024-03-16T21:07:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.434+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/3391605328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b10700 0x55b7e5b0dfa0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.434+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/3391605328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b07b20 0x55b7e5afc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.434+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/3391605328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b07200 0x55b7e5af8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.434+0000 7f6b7bba8740 1 -- 172.21.15.8:0/3391605328 >> 172.21.15.8:0/3391605328 conn(0x55b7e5b01930 msgr2=0x55b7e5b02cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.434+0000 7f6b7bba8740 1 -- 172.21.15.8:0/3391605328 shutdown_connections 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.434+0000 7f6b7bba8740 1 -- 172.21.15.8:0/3391605328 wait complete. 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.435+0000 7f6b7bba8740 1 -- start start 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.435+0000 7f6b7bba8740 1 Processor -- start 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.435+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b07200 0x55b7e5b140f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.435+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 0x55b7e5b14630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.435+0000 7f6b7bba8740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b10700 0x55b7e5b7ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.435+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5b14dd0 con 0x55b7e5b10700 2024-03-16T21:07:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.435+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5b7b2b0 con 0x55b7e5b07200 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.435+0000 7f6b7bba8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5b7b470 con 0x55b7e5b07b20 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.435+0000 7f6b7bba8740 10 client.0 _ll_register_callbacks cb 0x7f6b640b80d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b69400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 0x55b7e5b14630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b69400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 0x55b7e5b14630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39712/0 (socket says 172.21.15.8:39712) 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b69400640 1 -- 172.21.15.8:0/1846589217 learned_addr learned my addr 172.21.15.8:0/1846589217 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b71e00640 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b07200 0x55b7e5b140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b72800640 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b10700 0x55b7e5b7ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b69400640 1 -- 172.21.15.8:0/1846589217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b07200 msgr2=0x55b7e5b140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b69400640 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b07200 0x55b7e5b140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b69400640 1 -- 172.21.15.8:0/1846589217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b10700 msgr2=0x55b7e5b7ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b69400640 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b10700 0x55b7e5b7ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b69400640 1 -- 172.21.15.8:0/1846589217 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c004050 con 0x55b7e5b07b20 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b69400640 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 0x55b7e5b14630 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c004b00 tx=0x7f6b5c009d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a26ab8158f13469 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.436+0000 7f6b57e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b57e00640 1 -- 172.21.15.8:0/1846589217 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c02a040 con 0x55b7e5b07b20 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b57e00640 1 -- 172.21.15.8:0/1846589217 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f6b5c004040 con 0x55b7e5b07b20 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b7bba8740 1 -- 172.21.15.8:0/1846589217 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7e5af8c30 con 0x55b7e5b07b20 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b57e00640 1 -- 172.21.15.8:0/1846589217 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b5c004200 con 0x55b7e5b07b20 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b7bba8740 10 client.27640 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b7bba8740 1 -- 172.21.15.8:0/1846589217 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b7e5a2a650 con 0x55b7e5b07b20 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b57e00640 1 -- 172.21.15.8:0/1846589217 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55b7e5af8c30 con 0x55b7e5b07b20 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b57e00640 1 -- 172.21.15.8:0/1846589217 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6b5c004f70 con 0x55b7e5b07b20 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b7bba8740 10 client.27640 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b7bba8740 10 client.27640 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b7bba8740 20 client.27640 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:08.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b7e5b7ccd0 0x55b7e5b7f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:08.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b7bba8740 4 client.27640 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:07:08.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.437+0000 7f6b7bba8740 1 -- 172.21.15.8:0/1846589217 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f6b5c005520 con 0x55b7e5b7ccd0 2024-03-16T21:07:08.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.438+0000 7f6b71e00640 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b7e5b7ccd0 0x55b7e5b7f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:08.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.438+0000 7f6b71e00640 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b7e5b7ccd0 0x55b7e5b7f0f0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a911b4a26e901916 server_cookie=f2ec0e49038f476a in_seq=0 out_seq=0 2024-03-16T21:07:08.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.438+0000 7f6b57e00640 10 client.27640 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:08.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.438+0000 7f6b57e00640 1 -- 172.21.15.8:0/1846589217 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f6b5c005520 con 0x55b7e5b7ccd0 2024-03-16T21:07:08.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.438+0000 7f6b57e00640 10 client.27640 handle_command_reply: tid=0 2024-03-16T21:07:08.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.438+0000 7f6b7bba8740 1 client.27640 shutdown 2024-03-16T21:07:08.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b7bba8740 1 -- 172.21.15.8:0/1846589217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 msgr2=0x55b7e5b14630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 0x55b7e5b14630 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c004b00 tx=0x7f6b5c009d90 comp rx=0 tx=0).stop 2024-03-16T21:07:08.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b7bba8740 1 -- 172.21.15.8:0/1846589217 shutdown_connections 2024-03-16T21:07:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55b7e5b7ccd0 0x55b7e5b7f0f0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b7e5b10700 0x55b7e5b7ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b7e5b07b20 0x55b7e5b14630 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b57e00640 0 client.27640 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b7bba8740 1 --2- 172.21.15.8:0/1846589217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7e5b07200 0x55b7e5b140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b7bba8740 1 -- 172.21.15.8:0/1846589217 >> 172.21.15.8:0/1846589217 conn(0x55b7e5b01930 msgr2=0x55b7e5b03560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b7bba8740 1 -- 172.21.15.8:0/1846589217 shutdown_connections 2024-03-16T21:07:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b7bba8740 1 -- 172.21.15.8:0/1846589217 wait complete. 2024-03-16T21:07:08.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.439+0000 7f6b7bba8740 20 client.27640 trim_cache size 0 max 16384 2024-03-16T21:07:08.451 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:07:08.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 -- 172.21.15.8:0/2948949443 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6b580a1c20 msgr2=0x7f6b580a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6b580a1c20 0x7f6b580a40e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c005fd0 tx=0x7f6b6c009500 comp rx=0 tx=0).stop 2024-03-16T21:07:08.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 -- 172.21.15.8:0/2948949443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b741025b0 msgr2=0x7f6b7419d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:08.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b741025b0 0x7f6b7419d720 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6b64000c00 tx=0x7f6b64004390 comp rx=0 tx=0).stop 2024-03-16T21:07:08.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 -- 172.21.15.8:0/2948949443 shutdown_connections 2024-03-16T21:07:08.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6b580a1c20 0x7f6b580a40e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b7410b980 0x7f6b741978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b74102ed0 0x7f6b7419dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 --2- 172.21.15.8:0/2948949443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b741025b0 0x7f6b7419d720 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:08.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 -- 172.21.15.8:0/2948949443 >> 172.21.15.8:0/2948949443 conn(0x7f6b740fbd50 msgr2=0x7f6b740fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:08.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 -- 172.21.15.8:0/2948949443 shutdown_connections 2024-03-16T21:07:08.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:08.440+0000 7f6b73200640 1 -- 172.21.15.8:0/2948949443 wait complete. 2024-03-16T21:07:09.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:09 smithi170 ceph-mon[35947]: pgmap v286: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-03-16T21:07:09.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:09 smithi170 ceph-mon[35947]: osdmap e94: 12 total, 12 up, 12 in 2024-03-16T21:07:09.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:09 smithi186 ceph-mon[36391]: pgmap v286: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-03-16T21:07:09.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:09 smithi186 ceph-mon[36391]: osdmap e94: 12 total, 12 up, 12 in 2024-03-16T21:07:09.465 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:07:09.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:07:09.465 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:07:09.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:09 smithi008 ceph-mon[31434]: pgmap v286: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-03-16T21:07:09.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:09 smithi008 ceph-mon[31434]: osdmap e94: 12 total, 12 up, 12 in 2024-03-16T21:07:09.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.700+0000 7f3b31000640 1 -- 172.21.15.8:0/1262706084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c107a90 msgr2=0x7f3b2c107f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:09.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.700+0000 7f3b31000640 1 --2- 172.21.15.8:0/1262706084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c107a90 0x7f3b2c107f10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009930 tx=0x7f3b1402bc30 comp rx=0 tx=0).stop 2024-03-16T21:07:09.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.700+0000 7f3b31000640 1 -- 172.21.15.8:0/1262706084 shutdown_connections 2024-03-16T21:07:09.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.700+0000 7f3b31000640 1 --2- 172.21.15.8:0/1262706084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b2c108450 0x7f3b2c114960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.700+0000 7f3b31000640 1 --2- 172.21.15.8:0/1262706084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c107a90 0x7f3b2c107f10 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.700+0000 7f3b31000640 1 --2- 172.21.15.8:0/1262706084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c10daa0 0x7f3b2c10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.700+0000 7f3b31000640 1 -- 172.21.15.8:0/1262706084 >> 172.21.15.8:0/1262706084 conn(0x7f3b2c075a30 msgr2=0x7f3b2c077e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:09.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.701+0000 7f3b31000640 1 -- 172.21.15.8:0/1262706084 shutdown_connections 2024-03-16T21:07:09.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.701+0000 7f3b31000640 1 -- 172.21.15.8:0/1262706084 wait complete. 2024-03-16T21:07:09.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.702+0000 7f3b31000640 1 Processor -- start 2024-03-16T21:07:09.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.702+0000 7f3b31000640 1 -- start start 2024-03-16T21:07:09.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.702+0000 7f3b31000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b2c107a90 0x7f3b2c19e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.702+0000 7f3b31000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c108450 0x7f3b2c19e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.702+0000 7f3b31000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c10daa0 0x7f3b2c1a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.702+0000 7f3b31000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c1a31a0 con 0x7f3b2c108450 2024-03-16T21:07:09.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.702+0000 7f3b31000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c1a3310 con 0x7f3b2c107a90 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.702+0000 7f3b31000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c1a34d0 con 0x7f3b2c10daa0 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b29e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b2c107a90 0x7f3b2c19e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b2a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c10daa0 0x7f3b2c1a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b29e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b2c107a90 0x7f3b2c19e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:39334/0 (socket says 172.21.15.8:39334) 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b29e00640 1 -- 172.21.15.8:0/4250028253 learned_addr learned my addr 172.21.15.8:0/4250028253 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b21400640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c108450 0x7f3b2c19e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b29e00640 1 -- 172.21.15.8:0/4250028253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c10daa0 msgr2=0x7f3b2c1a2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b29e00640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c10daa0 0x7f3b2c1a2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b29e00640 1 -- 172.21.15.8:0/4250028253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c108450 msgr2=0x7f3b2c19e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b29e00640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c108450 0x7f3b2c19e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b29e00640 1 -- 172.21.15.8:0/4250028253 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14009560 con 0x7f3b2c107a90 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b2a800640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c10daa0 0x7f3b2c1a2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.703+0000 7f3b29e00640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b2c107a90 0x7f3b2c19e330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e9f0 tx=0x7f3b1c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:09.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.704+0000 7f3b23400640 1 -- 172.21.15.8:0/4250028253 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c009700 con 0x7f3b2c107a90 2024-03-16T21:07:09.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.704+0000 7f3b31000640 1 -- 172.21.15.8:0/4250028253 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c1a37b0 con 0x7f3b2c107a90 2024-03-16T21:07:09.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.704+0000 7f3b23400640 1 -- 172.21.15.8:0/4250028253 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3b1c00cd80 con 0x7f3b2c107a90 2024-03-16T21:07:09.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.704+0000 7f3b23400640 1 -- 172.21.15.8:0/4250028253 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c0189c0 con 0x7f3b2c107a90 2024-03-16T21:07:09.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.704+0000 7f3b31000640 1 -- 172.21.15.8:0/4250028253 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c1ab030 con 0x7f3b2c107a90 2024-03-16T21:07:09.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.707+0000 7f3b23400640 1 -- 172.21.15.8:0/4250028253 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f3b1c018b20 con 0x7f3b2c107a90 2024-03-16T21:07:09.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.707+0000 7f3b33e1a740 1 Processor -- start 2024-03-16T21:07:09.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.707+0000 7f3b33e1a740 1 -- start start 2024-03-16T21:07:09.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.707+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244f9f40 0x5635244fa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.707+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244fa860 0x563524502f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.707+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x563524505830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.707+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635244b5300 con 0x563524503440 2024-03-16T21:07:09.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.707+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563524467e50 con 0x5635244fa860 2024-03-16T21:07:09.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.707+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563524465380 con 0x5635244f9f40 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b2a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244f9f40 0x5635244fa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b29e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244fa860 0x563524502f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b2a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244f9f40 0x5635244fa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39738/0 (socket says 172.21.15.8:39738) 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b2a800640 1 -- 172.21.15.8:0/1003695291 learned_addr learned my addr 172.21.15.8:0/1003695291 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b21400640 1 --2- 172.21.15.8:0/1003695291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x563524505830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b2a800640 1 -- 172.21.15.8:0/1003695291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244fa860 msgr2=0x563524502f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b2a800640 1 --2- 172.21.15.8:0/1003695291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244fa860 0x563524502f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b2a800640 1 -- 172.21.15.8:0/1003695291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 msgr2=0x563524505830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b2a800640 1 --2- 172.21.15.8:0/1003695291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x563524505830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b2a800640 1 -- 172.21.15.8:0/1003695291 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563524429c80 con 0x5635244f9f40 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b23400640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3b100a1ba0 0x7f3b100a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.708+0000 7f3b2a800640 1 --2- 172.21.15.8:0/1003695291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244f9f40 0x5635244fa320 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3b240117e0 tx=0x7f3b24011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caee423714c4a98b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.709+0000 7f3b23400640 1 -- 172.21.15.8:0/4250028253 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3b1c014070 con 0x7f3b2c107a90 2024-03-16T21:07:09.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.709+0000 7f3b29e00640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3b100a1ba0 0x7f3b100a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.709+0000 7f3b1b400640 1 -- 172.21.15.8:0/1003695291 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24011310 con 0x5635244f9f40 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.709+0000 7f3b1b400640 1 -- 172.21.15.8:0/1003695291 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3b24003e70 con 0x5635244f9f40 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.709+0000 7f3b1b400640 1 -- 172.21.15.8:0/1003695291 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24004620 con 0x5635244f9f40 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.709+0000 7f3b33e1a740 1 -- 172.21.15.8:0/1003695291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244f9f40 msgr2=0x5635244fa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.709+0000 7f3b29e00640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3b100a1ba0 0x7f3b100a4060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5635244f9a10 tx=0x7f3b1c0d3530 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.709+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/1003695291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244f9f40 0x5635244fa320 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3b240117e0 tx=0x7f3b24011ca0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.709+0000 7f3b33e1a740 1 -- 172.21.15.8:0/1003695291 shutdown_connections 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.710+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/1003695291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x563524505830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.710+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/1003695291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244fa860 0x563524502f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.710+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/1003695291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244f9f40 0x5635244fa320 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.710+0000 7f3b33e1a740 1 -- 172.21.15.8:0/1003695291 >> 172.21.15.8:0/1003695291 conn(0x5635244f4670 msgr2=0x5635244f4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.710+0000 7f3b33e1a740 1 -- 172.21.15.8:0/1003695291 shutdown_connections 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.710+0000 7f3b33e1a740 1 -- 172.21.15.8:0/1003695291 wait complete. 2024-03-16T21:07:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.710+0000 7f3b33e1a740 1 -- start start 2024-03-16T21:07:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.710+0000 7f3b33e1a740 1 Processor -- start 2024-03-16T21:07:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635244f9f40 0x5635245003d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563524503440 0x563524500e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563524460b60 con 0x5635244f9f40 2024-03-16T21:07:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563524405fd0 con 0x563524503440 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563524405c70 con 0x5635244fa860 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b33e1a740 10 client.0 _ll_register_callbacks cb 0x563524171c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b21400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b21400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39750/0 (socket says 172.21.15.8:39750) 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b21400640 1 -- 172.21.15.8:0/923491189 learned_addr learned my addr 172.21.15.8:0/923491189 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b2a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635244f9f40 0x5635245003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b2a800640 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563524503440 0x563524500e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b21400640 1 -- 172.21.15.8:0/923491189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563524503440 msgr2=0x563524500e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b21400640 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563524503440 0x563524500e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b21400640 1 -- 172.21.15.8:0/923491189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635244f9f40 msgr2=0x5635245003d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b21400640 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635244f9f40 0x5635245003d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b21400640 1 -- 172.21.15.8:0/923491189 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b240114c0 con 0x5635244fa860 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.711+0000 7f3b2a800640 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635244f9f40 0x5635245003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:07:09.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.712+0000 7f3b21400640 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500910 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3b14006010 tx=0x7f3b1402c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b436d792a82d0de4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.712+0000 7f3b0fe00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.712+0000 7f3b0fe00640 1 -- 172.21.15.8:0/923491189 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1402ccf0 con 0x5635244fa860 2024-03-16T21:07:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.712+0000 7f3b0fe00640 1 -- 172.21.15.8:0/923491189 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3b14046070 con 0x5635244fa860 2024-03-16T21:07:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.712+0000 7f3b33e1a740 1 -- 172.21.15.8:0/923491189 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563524160860 con 0x5635244fa860 2024-03-16T21:07:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.712+0000 7f3b0fe00640 1 -- 172.21.15.8:0/923491189 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b14004040 con 0x5635244fa860 2024-03-16T21:07:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.712+0000 7f3b33e1a740 10 client.27652 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.712+0000 7f3b33e1a740 1 -- 172.21.15.8:0/923491189 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56352445f1e0 con 0x5635244fa860 2024-03-16T21:07:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.713+0000 7f3b0fe00640 1 -- 172.21.15.8:0/923491189 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x563524160860 con 0x5635244fa860 2024-03-16T21:07:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.713+0000 7f3b0fe00640 1 -- 172.21.15.8:0/923491189 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f3b1403c040 con 0x5635244fa860 2024-03-16T21:07:09.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.713+0000 7f3b33e1a740 10 client.27652 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.713+0000 7f3b33e1a740 10 client.27652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.713+0000 7f3b33e1a740 20 client.27652 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.713+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5635245138b0 0x563524515cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.713+0000 7f3b33e1a740 4 client.27652 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.713+0000 7f3b33e1a740 1 -- 172.21.15.8:0/923491189 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635241b1410 con 0x5635245138b0 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.713+0000 7f3b2a800640 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5635245138b0 0x563524515cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.714+0000 7f3b2a800640 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5635245138b0 0x563524515cd0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb51f96d7858e5ab server_cookie=e55ffec4ed22315d in_seq=0 out_seq=0 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.714+0000 7f3b0fe00640 10 client.27652 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.714+0000 7f3b0fe00640 1 -- 172.21.15.8:0/923491189 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5635241b1410 con 0x5635245138b0 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.714+0000 7f3b0fe00640 10 client.27652 handle_command_reply: tid=0 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 1 client.27652 shutdown 2024-03-16T21:07:09.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 1 -- 172.21.15.8:0/923491189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 msgr2=0x563524500910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500910 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3b14006010 tx=0x7f3b1402c8b0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 1 -- 172.21.15.8:0/923491189 shutdown_connections 2024-03-16T21:07:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563524503440 0x563524500e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500910 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5635245138b0 0x563524515cd0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/923491189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635244f9f40 0x5635245003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 1 -- 172.21.15.8:0/923491189 >> 172.21.15.8:0/923491189 conn(0x5635244f4670 msgr2=0x5635244f63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b0fe00640 0 client.27652 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 1 -- 172.21.15.8:0/923491189 shutdown_connections 2024-03-16T21:07:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 1 -- 172.21.15.8:0/923491189 wait complete. 2024-03-16T21:07:09.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.715+0000 7f3b33e1a740 20 client.27652 trim_cache size 0 max 16384 2024-03-16T21:07:09.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.733+0000 7f3b33e1a740 1 Processor -- start 2024-03-16T21:07:09.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.733+0000 7f3b33e1a740 1 -- start start 2024-03-16T21:07:09.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.733+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244f9f40 0x563524502b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.733+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.733+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x56352450e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.733+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635241a90c0 con 0x563524503440 2024-03-16T21:07:09.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.733+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563524506110 con 0x5635244f9f40 2024-03-16T21:07:09.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.733+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635244f69a0 con 0x5635244fa860 2024-03-16T21:07:09.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.733+0000 7f3b21400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b21400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39756/0 (socket says 172.21.15.8:39756) 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b21400640 1 -- 172.21.15.8:0/3930206063 learned_addr learned my addr 172.21.15.8:0/3930206063 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b2a800640 1 --2- 172.21.15.8:0/3930206063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244f9f40 0x563524502b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b2a800640 1 --2- 172.21.15.8:0/3930206063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x56352450e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b21400640 1 -- 172.21.15.8:0/3930206063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244f9f40 msgr2=0x563524502b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b21400640 1 --2- 172.21.15.8:0/3930206063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244f9f40 0x563524502b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b21400640 1 -- 172.21.15.8:0/3930206063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 msgr2=0x56352450e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b21400640 1 --2- 172.21.15.8:0/3930206063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x56352450e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b21400640 1 -- 172.21.15.8:0/3930206063 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635243fba90 con 0x5635244fa860 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b2a800640 1 --2- 172.21.15.8:0/3930206063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x56352450e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b21400640 1 --2- 172.21.15.8:0/3930206063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500aa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009850 tx=0x7f3b14000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=696b3c5358df9d5e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b1aa00640 1 -- 172.21.15.8:0/3930206063 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140039b0 con 0x5635244fa860 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b1aa00640 1 -- 172.21.15.8:0/3930206063 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3b14044070 con 0x5635244fa860 2024-03-16T21:07:09.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.734+0000 7f3b1aa00640 1 -- 172.21.15.8:0/3930206063 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14003f40 con 0x5635244fa860 2024-03-16T21:07:09.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.735+0000 7f3b33e1a740 1 -- 172.21.15.8:0/3930206063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 msgr2=0x563524500aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:09.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.735+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/3930206063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500aa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009850 tx=0x7f3b14000bc0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.735+0000 7f3b33e1a740 1 -- 172.21.15.8:0/3930206063 shutdown_connections 2024-03-16T21:07:09.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.735+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/3930206063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x56352450e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.735+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/3930206063 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524500aa0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.735+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/3930206063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244f9f40 0x563524502b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.735+0000 7f3b33e1a740 1 -- 172.21.15.8:0/3930206063 >> 172.21.15.8:0/3930206063 conn(0x5635244f4670 msgr2=0x563524500390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.735+0000 7f3b33e1a740 1 -- 172.21.15.8:0/3930206063 shutdown_connections 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.735+0000 7f3b33e1a740 1 -- 172.21.15.8:0/3930206063 wait complete. 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b33e1a740 1 -- start start 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b33e1a740 1 Processor -- start 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244f9f40 0x563524508330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524508870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b33e1a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x56352456f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563524509000 con 0x563524503440 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563524509140 con 0x5635244f9f40 2024-03-16T21:07:09.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b33e1a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352456f6d0 con 0x5635244fa860 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b33e1a740 10 client.0 _ll_register_callbacks cb 0x7f3b14009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b21400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524508870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b21400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524508870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39770/0 (socket says 172.21.15.8:39770) 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b21400640 1 -- 172.21.15.8:0/556567830 learned_addr learned my addr 172.21.15.8:0/556567830 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.736+0000 7f3b2a800640 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244f9f40 0x563524508330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b2a800640 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x56352456f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b21400640 1 -- 172.21.15.8:0/556567830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244f9f40 msgr2=0x563524508330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b21400640 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244f9f40 0x563524508330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b21400640 1 -- 172.21.15.8:0/556567830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 msgr2=0x56352456f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b21400640 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x56352456f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b21400640 1 -- 172.21.15.8:0/556567830 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56352445f1e0 con 0x5635244fa860 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b2a800640 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244f9f40 0x563524508330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b21400640 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524508870 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3b14004c70 tx=0x7f3b1402bc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c83e0c2ea22eaed4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:09.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b0fe00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b0fe00640 1 -- 172.21.15.8:0/556567830 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14005220 con 0x5635244fa860 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b0fe00640 1 -- 172.21.15.8:0/556567830 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3b14046030 con 0x5635244fa860 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.737+0000 7f3b33e1a740 1 -- 172.21.15.8:0/556567830 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b24003e70 con 0x5635244fa860 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b0fe00640 1 -- 172.21.15.8:0/556567830 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b14005d50 con 0x5635244fa860 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b33e1a740 10 client.27658 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b33e1a740 1 -- 172.21.15.8:0/556567830 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5635244216a0 con 0x5635244fa860 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b0fe00640 1 -- 172.21.15.8:0/556567830 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3b14069020 con 0x5635244fa860 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b0fe00640 1 -- 172.21.15.8:0/556567830 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f3b1403c070 con 0x5635244fa860 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b33e1a740 10 client.27658 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b33e1a740 10 client.27658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b33e1a740 20 client.27658 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563524570950 0x563524572d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:09.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b33e1a740 4 client.27658 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:07:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b33e1a740 1 -- 172.21.15.8:0/556567830 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56352419d7b0 con 0x563524570950 2024-03-16T21:07:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.738+0000 7f3b2a800640 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563524570950 0x563524572d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.739+0000 7f3b2a800640 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563524570950 0x563524572d70 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86af587428f5433a server_cookie=eda1abb46b9cc590 in_seq=0 out_seq=0 2024-03-16T21:07:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.739+0000 7f3b0fe00640 10 client.27658 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b0fe00640 1 -- 172.21.15.8:0/556567830 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56352419d7b0 con 0x563524570950 2024-03-16T21:07:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b0fe00640 10 client.27658 handle_command_reply: tid=0 2024-03-16T21:07:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b33e1a740 1 client.27658 shutdown 2024-03-16T21:07:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b33e1a740 1 -- 172.21.15.8:0/556567830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 msgr2=0x563524508870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524508870 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3b14004c70 tx=0x7f3b1402bc30 comp rx=0 tx=0).stop 2024-03-16T21:07:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b33e1a740 1 -- 172.21.15.8:0/556567830 shutdown_connections 2024-03-16T21:07:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x563524570950 0x563524572d70 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563524503440 0x56352456f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5635244fa860 0x563524508870 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b33e1a740 1 --2- 172.21.15.8:0/556567830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635244f9f40 0x563524508330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b0fe00640 0 client.27658 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b33e1a740 1 -- 172.21.15.8:0/556567830 >> 172.21.15.8:0/556567830 conn(0x5635244f4670 msgr2=0x563524500c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b33e1a740 1 -- 172.21.15.8:0/556567830 shutdown_connections 2024-03-16T21:07:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.740+0000 7f3b33e1a740 1 -- 172.21.15.8:0/556567830 wait complete. 2024-03-16T21:07:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.741+0000 7f3b33e1a740 20 client.27658 trim_cache size 0 max 16384 2024-03-16T21:07:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:07:09.751 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:07:09.751 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "454bb3ff-0729-4159-aa54-5a3602111b97", 2024-03-16T21:07:09.751 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:07:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:07:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.741+0000 7f3b31000640 1 -- 172.21.15.8:0/4250028253 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3b100a1ba0 msgr2=0x7f3b100a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.741+0000 7f3b31000640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3b100a1ba0 0x7f3b100a4060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5635244f9a10 tx=0x7f3b1c0d3530 comp rx=0 tx=0).stop 2024-03-16T21:07:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.741+0000 7f3b31000640 1 -- 172.21.15.8:0/4250028253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b2c107a90 msgr2=0x7f3b2c19e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.741+0000 7f3b31000640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b2c107a90 0x7f3b2c19e330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e9f0 tx=0x7f3b1c00eeb0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.741+0000 7f3b31000640 1 -- 172.21.15.8:0/4250028253 shutdown_connections 2024-03-16T21:07:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.741+0000 7f3b31000640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3b100a1ba0 0x7f3b100a4060 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.741+0000 7f3b31000640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c10daa0 0x7f3b2c1a2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.741+0000 7f3b31000640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b2c108450 0x7f3b2c19e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.741+0000 7f3b31000640 1 --2- 172.21.15.8:0/4250028253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b2c107a90 0x7f3b2c19e330 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.741+0000 7f3b31000640 1 -- 172.21.15.8:0/4250028253 >> 172.21.15.8:0/4250028253 conn(0x7f3b2c075a30 msgr2=0x7f3b2c076030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.742+0000 7f3b31000640 1 -- 172.21.15.8:0/4250028253 shutdown_connections 2024-03-16T21:07:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:09.742+0000 7f3b31000640 1 -- 172.21.15.8:0/4250028253 wait complete. 2024-03-16T21:07:09.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:07:09.766 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:07:10.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.031+0000 7fb271000640 1 -- 172.21.15.8:0/562508002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb26c103f50 msgr2=0x7fb26c110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:10.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.031+0000 7fb271000640 1 --2- 172.21.15.8:0/562508002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb26c103f50 0x7fb26c110410 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb264009cd0 tx=0x7fb26402c0f0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.031+0000 7fb271000640 1 -- 172.21.15.8:0/562508002 shutdown_connections 2024-03-16T21:07:10.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.031+0000 7fb271000640 1 --2- 172.21.15.8:0/562508002 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb26c103f50 0x7fb26c110410 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.031+0000 7fb271000640 1 --2- 172.21.15.8:0/562508002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb26c103590 0x7fb26c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.031+0000 7fb271000640 1 --2- 172.21.15.8:0/562508002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb26c109650 0x7fb26c109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.031+0000 7fb271000640 1 -- 172.21.15.8:0/562508002 >> 172.21.15.8:0/562508002 conn(0x7fb26c0ff020 msgr2=0x7fb26c101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:10.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.031+0000 7fb271000640 1 -- 172.21.15.8:0/562508002 shutdown_connections 2024-03-16T21:07:10.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.031+0000 7fb271000640 1 -- 172.21.15.8:0/562508002 wait complete. 2024-03-16T21:07:10.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.032+0000 7fb271000640 1 Processor -- start 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.032+0000 7fb271000640 1 -- start start 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.032+0000 7fb271000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb26c103590 0x7fb26c19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.032+0000 7fb271000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb26c103f50 0x7fb26c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.032+0000 7fb271000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb26c109650 0x7fb26c199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb271000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c19a060 con 0x7fb26c103590 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb271000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c19a1d0 con 0x7fb26c103f50 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb271000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c19a390 con 0x7fb26c109650 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb26aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb26c103f50 0x7fb26c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb26b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb26c103590 0x7fb26c19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb26aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb26c103f50 0x7fb26c19fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:39392/0 (socket says 172.21.15.8:39392) 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb26aa00640 1 -- 172.21.15.8:0/831804920 learned_addr learned my addr 172.21.15.8:0/831804920 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb26be00640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb26c109650 0x7fb26c199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb26aa00640 1 -- 172.21.15.8:0/831804920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb26c109650 msgr2=0x7fb26c199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:10.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb26aa00640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb26c109650 0x7fb26c199a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb26aa00640 1 -- 172.21.15.8:0/831804920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb26c103590 msgr2=0x7fb26c19f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:10.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb26aa00640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb26c103590 0x7fb26c19f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.033+0000 7fb26aa00640 1 -- 172.21.15.8:0/831804920 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb264009900 con 0x7fb26c103f50 2024-03-16T21:07:10.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.034+0000 7fb26aa00640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb26c103f50 0x7fb26c19fda0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb25800d950 tx=0x7fb25800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:10.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.034+0000 7fb263e00640 1 -- 172.21.15.8:0/831804920 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258009a30 con 0x7fb26c103f50 2024-03-16T21:07:10.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.034+0000 7fb263e00640 1 -- 172.21.15.8:0/831804920 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb258009b90 con 0x7fb26c103f50 2024-03-16T21:07:10.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.034+0000 7fb263e00640 1 -- 172.21.15.8:0/831804920 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258004a00 con 0x7fb26c103f50 2024-03-16T21:07:10.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.034+0000 7fb271000640 1 -- 172.21.15.8:0/831804920 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c19a670 con 0x7fb26c103f50 2024-03-16T21:07:10.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.034+0000 7fb271000640 1 -- 172.21.15.8:0/831804920 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c1a6900 con 0x7fb26c103f50 2024-03-16T21:07:10.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.038+0000 7fb2753ad740 1 Processor -- start 2024-03-16T21:07:10.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.038+0000 7fb263e00640 1 -- 172.21.15.8:0/831804920 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fb258009d00 con 0x7fb26c103f50 2024-03-16T21:07:10.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.038+0000 7fb2753ad740 1 -- start start 2024-03-16T21:07:10.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.038+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 0x55bd0d46dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.038+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46e490 0x55bd0d46e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.038+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 0x55bd0d479bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.038+0000 7fb2753ad740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d3dd150 con 0x55bd0d46e490 2024-03-16T21:07:10.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.038+0000 7fb2753ad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d3da680 con 0x55bd0d477800 2024-03-16T21:07:10.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.038+0000 7fb2753ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d3d5e60 con 0x55bd0d46f170 2024-03-16T21:07:10.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.039+0000 7fb26be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 0x55bd0d46dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.039+0000 7fb26be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 0x55bd0d46dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:39806/0 (socket says 172.21.15.8:39806) 2024-03-16T21:07:10.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.039+0000 7fb26be00640 1 -- 172.21.15.8:0/2790570017 learned_addr learned my addr 172.21.15.8:0/2790570017 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:10.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.039+0000 7fb26b400640 1 --2- 172.21.15.8:0/2790570017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46e490 0x55bd0d46e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.039+0000 7fb26aa00640 1 --2- 172.21.15.8:0/2790570017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 0x55bd0d479bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.039+0000 7fb26be00640 1 -- 172.21.15.8:0/2790570017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 msgr2=0x55bd0d479bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:10.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.039+0000 7fb26be00640 1 --2- 172.21.15.8:0/2790570017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 0x55bd0d479bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.039+0000 7fb26be00640 1 -- 172.21.15.8:0/2790570017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46e490 msgr2=0x55bd0d46e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:10.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.039+0000 7fb26be00640 1 --2- 172.21.15.8:0/2790570017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46e490 0x55bd0d46e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.039+0000 7fb26be00640 1 -- 172.21.15.8:0/2790570017 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd0d38f060 con 0x55bd0d46f170 2024-03-16T21:07:10.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.040+0000 7fb26be00640 1 --2- 172.21.15.8:0/2790570017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 0x55bd0d46dec0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb264004af0 tx=0x7fb264005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0c9305d8deb9ca6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:10.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.040+0000 7fb263e00640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 0x7fb2500a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.040+0000 7fb263e00640 1 -- 172.21.15.8:0/831804920 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fb2580cd170 con 0x7fb26c103f50 2024-03-16T21:07:10.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.040+0000 7fb26b400640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 0x7fb2500a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.041+0000 7fb26b400640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 0x7fb2500a40e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55bd0d46f6c0 tx=0x7fb25c005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:10.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.043+0000 7fb260c00640 1 -- 172.21.15.8:0/2790570017 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264032540 con 0x55bd0d46f170 2024-03-16T21:07:10.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.043+0000 7fb260c00640 1 -- 172.21.15.8:0/2790570017 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb264034ab0 con 0x55bd0d46f170 2024-03-16T21:07:10.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.043+0000 7fb260c00640 1 -- 172.21.15.8:0/2790570017 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264003bd0 con 0x55bd0d46f170 2024-03-16T21:07:10.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.043+0000 7fb2753ad740 1 -- 172.21.15.8:0/2790570017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 msgr2=0x55bd0d46dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:10.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.043+0000 7fb2753ad740 1 --2- 172.21.15.8:0/2790570017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 0x55bd0d46dec0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb264004af0 tx=0x7fb264005f80 comp rx=0 tx=0).stop 2024-03-16T21:07:10.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.044+0000 7fb2753ad740 1 -- 172.21.15.8:0/2790570017 shutdown_connections 2024-03-16T21:07:10.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.044+0000 7fb2753ad740 1 --2- 172.21.15.8:0/2790570017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 0x55bd0d479bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.044+0000 7fb2753ad740 1 --2- 172.21.15.8:0/2790570017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46e490 0x55bd0d46e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.044+0000 7fb2753ad740 1 --2- 172.21.15.8:0/2790570017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 0x55bd0d46dec0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.044+0000 7fb2753ad740 1 -- 172.21.15.8:0/2790570017 >> 172.21.15.8:0/2790570017 conn(0x55bd0d4355a0 msgr2=0x55bd0d468ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:10.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.044+0000 7fb2753ad740 1 -- 172.21.15.8:0/2790570017 shutdown_connections 2024-03-16T21:07:10.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.044+0000 7fb2753ad740 1 -- 172.21.15.8:0/2790570017 wait complete. 2024-03-16T21:07:10.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.044+0000 7fb2753ad740 1 -- start start 2024-03-16T21:07:10.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.044+0000 7fb2753ad740 1 Processor -- start 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46e490 0x55bd0d474810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 0x55bd0d474d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d477800 0x55bd0d475290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb2753ad740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d37aec0 con 0x55bd0d477800 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb2753ad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d37ab60 con 0x55bd0d46e490 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb2753ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d1441c0 con 0x55bd0d46f170 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb2753ad740 10 client.0 _ll_register_callbacks cb 0x55bd0d38e960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb26b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46e490 0x55bd0d474810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb26be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d477800 0x55bd0d475290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb26b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46e490 0x55bd0d474810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:39404/0 (socket says 172.21.15.8:39404) 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb26b400640 1 -- 172.21.15.8:0/2145273605 learned_addr learned my addr 172.21.15.8:0/2145273605 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:10.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.045+0000 7fb26aa00640 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 0x55bd0d474d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb26be00640 1 -- 172.21.15.8:0/2145273605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 msgr2=0x55bd0d474d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb26be00640 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 0x55bd0d474d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb26be00640 1 -- 172.21.15.8:0/2145273605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46e490 msgr2=0x55bd0d474810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb26be00640 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46e490 0x55bd0d474810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb26be00640 1 -- 172.21.15.8:0/2145273605 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c110d10 con 0x55bd0d477800 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb26b400640 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46e490 0x55bd0d474810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb26be00640 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d477800 0x55bd0d475290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb264037040 tx=0x7fb264009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6d02e43601351e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb255600640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb255600640 1 -- 172.21.15.8:0/2145273605 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264003970 con 0x55bd0d477800 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb255600640 1 -- 172.21.15.8:0/2145273605 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fb26404e070 con 0x55bd0d477800 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb2753ad740 1 -- 172.21.15.8:0/2145273605 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bd0d0d57e0 con 0x55bd0d477800 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb255600640 1 -- 172.21.15.8:0/2145273605 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb264003ad0 con 0x55bd0d477800 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.046+0000 7fb2753ad740 10 client.17472 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:10.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.047+0000 7fb2753ad740 1 -- 172.21.15.8:0/2145273605 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55bd0d3d44e0 con 0x55bd0d477800 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.047+0000 7fb255600640 1 -- 172.21.15.8:0/2145273605 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55bd0d0d57e0 con 0x55bd0d477800 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.047+0000 7fb255600640 1 -- 172.21.15.8:0/2145273605 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fb26404a450 con 0x55bd0d477800 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.047+0000 7fb2753ad740 10 client.17472 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.047+0000 7fb2753ad740 10 client.17472 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.047+0000 7fb2753ad740 20 client.17472 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.047+0000 7fb2753ad740 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd0d4874b0 0x55bd0d4898a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.047+0000 7fb2753ad740 4 client.17472 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.047+0000 7fb2753ad740 1 -- 172.21.15.8:0/2145273605 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bd0d112720 con 0x55bd0d4874b0 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.048+0000 7fb26b400640 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd0d4874b0 0x55bd0d4898a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.048+0000 7fb26b400640 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd0d4874b0 0x55bd0d4898a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55ac4a466dd0ea5b server_cookie=82efc77a0c65691e in_seq=0 out_seq=0 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.048+0000 7fb255600640 10 client.17472 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:10.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb255600640 1 -- 172.21.15.8:0/2145273605 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55bd0d112720 con 0x55bd0d4874b0 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb255600640 10 client.17472 handle_command_reply: tid=0 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 1 client.17472 shutdown 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 1 -- 172.21.15.8:0/2145273605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d477800 msgr2=0x55bd0d475290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d477800 0x55bd0d475290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb264037040 tx=0x7fb264009bd0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 1 -- 172.21.15.8:0/2145273605 shutdown_connections 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd0d4874b0 0x55bd0d4898a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d477800 0x55bd0d475290 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46f170 0x55bd0d474d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 1 --2- 172.21.15.8:0/2145273605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46e490 0x55bd0d474810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb255600640 0 client.17472 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 1 -- 172.21.15.8:0/2145273605 >> 172.21.15.8:0/2145273605 conn(0x55bd0d4355a0 msgr2=0x55bd0d46ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 1 -- 172.21.15.8:0/2145273605 shutdown_connections 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 1 -- 172.21.15.8:0/2145273605 wait complete. 2024-03-16T21:07:10.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.049+0000 7fb2753ad740 20 client.17472 trim_cache size 0 max 16384 2024-03-16T21:07:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.067+0000 7fb2753ad740 1 Processor -- start 2024-03-16T21:07:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.067+0000 7fb2753ad740 1 -- start start 2024-03-16T21:07:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.067+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46e490 0x55bd0d476ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.067+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46f170 0x55bd0d474d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.067+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d477800 0x55bd0d4752c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.067+0000 7fb2753ad740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d112720 con 0x55bd0d46e490 2024-03-16T21:07:10.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.067+0000 7fb2753ad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d0d57e0 con 0x55bd0d46f170 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.067+0000 7fb2753ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d489ed0 con 0x55bd0d477800 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46f170 0x55bd0d474d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46e490 0x55bd0d476ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46f170 0x55bd0d474d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:39420/0 (socket says 172.21.15.8:39420) 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26aa00640 1 -- 172.21.15.8:0/361734197 learned_addr learned my addr 172.21.15.8:0/361734197 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26be00640 1 --2- 172.21.15.8:0/361734197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d477800 0x55bd0d4752c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26aa00640 1 -- 172.21.15.8:0/361734197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d477800 msgr2=0x55bd0d4752c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26aa00640 1 --2- 172.21.15.8:0/361734197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d477800 0x55bd0d4752c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26aa00640 1 -- 172.21.15.8:0/361734197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46e490 msgr2=0x55bd0d476ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26aa00640 1 --2- 172.21.15.8:0/361734197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46e490 0x55bd0d476ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26aa00640 1 -- 172.21.15.8:0/361734197 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd0d370950 con 0x55bd0d46f170 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26be00640 1 --2- 172.21.15.8:0/361734197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d477800 0x55bd0d4752c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb26aa00640 1 --2- 172.21.15.8:0/361734197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46f170 0x55bd0d474d80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb2580961e0 tx=0x7fb2580cd330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=128bb506da053db3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:10.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.068+0000 7fb257e00640 1 -- 172.21.15.8:0/361734197 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2580056d0 con 0x55bd0d46f170 2024-03-16T21:07:10.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.069+0000 7fb257e00640 1 -- 172.21.15.8:0/361734197 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb258096020 con 0x55bd0d46f170 2024-03-16T21:07:10.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.069+0000 7fb257e00640 1 -- 172.21.15.8:0/361734197 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258099e10 con 0x55bd0d46f170 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.069+0000 7fb2753ad740 1 -- 172.21.15.8:0/361734197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46f170 msgr2=0x55bd0d474d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.069+0000 7fb2753ad740 1 --2- 172.21.15.8:0/361734197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46f170 0x55bd0d474d80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb2580961e0 tx=0x7fb2580cd330 comp rx=0 tx=0).stop 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.069+0000 7fb2753ad740 1 -- 172.21.15.8:0/361734197 shutdown_connections 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.069+0000 7fb2753ad740 1 --2- 172.21.15.8:0/361734197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d477800 0x55bd0d4752c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.069+0000 7fb2753ad740 1 --2- 172.21.15.8:0/361734197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d46f170 0x55bd0d474d80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.069+0000 7fb2753ad740 1 --2- 172.21.15.8:0/361734197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46e490 0x55bd0d476ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.069+0000 7fb2753ad740 1 -- 172.21.15.8:0/361734197 >> 172.21.15.8:0/361734197 conn(0x55bd0d4355a0 msgr2=0x55bd0d473100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.069+0000 7fb2753ad740 1 -- 172.21.15.8:0/361734197 shutdown_connections 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.069+0000 7fb2753ad740 1 -- 172.21.15.8:0/361734197 wait complete. 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.070+0000 7fb2753ad740 1 -- start start 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.070+0000 7fb2753ad740 1 Processor -- start 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.070+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46e490 0x55bd0d470aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46f170 0x55bd0d470fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb2753ad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 0x55bd0d471520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb2753ad740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d4796f0 con 0x55bd0d46f170 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb2753ad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d479860 con 0x55bd0d477800 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb2753ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd0d471ae0 con 0x55bd0d46e490 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb2753ad740 10 client.0 _ll_register_callbacks cb 0x7fb264009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46f170 0x55bd0d470fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 0x55bd0d471520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 0x55bd0d471520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:39434/0 (socket says 172.21.15.8:39434) 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26be00640 1 -- 172.21.15.8:0/3688391869 learned_addr learned my addr 172.21.15.8:0/3688391869 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26b400640 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46e490 0x55bd0d470aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26be00640 1 -- 172.21.15.8:0/3688391869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46e490 msgr2=0x55bd0d470aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26be00640 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46e490 0x55bd0d470aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26be00640 1 -- 172.21.15.8:0/3688391869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46f170 msgr2=0x55bd0d470fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26be00640 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46f170 0x55bd0d470fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26be00640 1 -- 172.21.15.8:0/3688391869 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c1a6900 con 0x55bd0d477800 2024-03-16T21:07:10.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26aa00640 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46f170 0x55bd0d470fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.071+0000 7fb26be00640 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 0x55bd0d471520 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb26404a7b0 tx=0x7fb264032bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d29b633a64d61ba server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.072+0000 7fb255600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.072+0000 7fb255600640 1 -- 172.21.15.8:0/3688391869 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26404aba0 con 0x55bd0d477800 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.072+0000 7fb255600640 1 -- 172.21.15.8:0/3688391869 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fb26404e040 con 0x55bd0d477800 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.072+0000 7fb2753ad740 1 -- 172.21.15.8:0/3688391869 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb264034ab0 con 0x55bd0d477800 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.072+0000 7fb255600640 1 -- 172.21.15.8:0/3688391869 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2640329c0 con 0x55bd0d477800 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.072+0000 7fb2753ad740 10 client.27665 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.072+0000 7fb2753ad740 1 -- 172.21.15.8:0/3688391869 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55bd0d396430 con 0x55bd0d477800 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.072+0000 7fb255600640 1 -- 172.21.15.8:0/3688391869 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fb264034ab0 con 0x55bd0d477800 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.072+0000 7fb255600640 1 -- 172.21.15.8:0/3688391869 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fb264004400 con 0x55bd0d477800 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.073+0000 7fb2753ad740 10 client.27665 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.073+0000 7fb2753ad740 10 client.27665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.073+0000 7fb2753ad740 20 client.27665 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.073+0000 7fb2753ad740 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd0d4e4110 0x55bd0d4e6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.073+0000 7fb2753ad740 4 client.27665 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:07:10.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.073+0000 7fb2753ad740 1 -- 172.21.15.8:0/3688391869 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bd0d161890 con 0x55bd0d4e4110 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.073+0000 7fb26b400640 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd0d4e4110 0x55bd0d4e6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.073+0000 7fb26b400640 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd0d4e4110 0x55bd0d4e6500 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65bec7168907c09d server_cookie=24eea49ecb395a7f in_seq=0 out_seq=0 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.073+0000 7fb255600640 10 client.27665 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb255600640 1 -- 172.21.15.8:0/3688391869 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55bd0d161890 con 0x55bd0d4e4110 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb255600640 10 client.27665 handle_command_reply: tid=0 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 1 client.27665 shutdown 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 1 -- 172.21.15.8:0/3688391869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 msgr2=0x55bd0d471520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 0x55bd0d471520 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb26404a7b0 tx=0x7fb264032bc0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 1 -- 172.21.15.8:0/3688391869 shutdown_connections 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bd0d477800 0x55bd0d471520 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55bd0d4e4110 0x55bd0d4e6500 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd0d46f170 0x55bd0d470fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 1 --2- 172.21.15.8:0/3688391869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd0d46e490 0x55bd0d470aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb255600640 0 client.27665 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 1 -- 172.21.15.8:0/3688391869 >> 172.21.15.8:0/3688391869 conn(0x55bd0d4355a0 msgr2=0x55bd0d46a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 1 -- 172.21.15.8:0/3688391869 shutdown_connections 2024-03-16T21:07:10.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 1 -- 172.21.15.8:0/3688391869 wait complete. 2024-03-16T21:07:10.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.074+0000 7fb2753ad740 20 client.27665 trim_cache size 0 max 16384 2024-03-16T21:07:10.086 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:07:10.086 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:07:10.086 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:07:10.086 INFO:teuthology.orchestra.run.smithi008.stdout: "454bb3ff-0729-4159-aa54-5a3602111b97": { 2024-03-16T21:07:10.086 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:07:10.086 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "454bb3ff-0729-4159-aa54-5a3602111b97", 2024-03-16T21:07:10.086 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:07:10.086 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:07:10.086 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:07:10.087 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:07:10.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 -- 172.21.15.8:0/831804920 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 msgr2=0x7fb2500a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:10.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 0x7fb2500a40e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55bd0d46f6c0 tx=0x7fb25c005f90 comp rx=0 tx=0).stop 2024-03-16T21:07:10.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 -- 172.21.15.8:0/831804920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb26c103f50 msgr2=0x7fb26c19fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:10.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb26c103f50 0x7fb26c19fda0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb25800d950 tx=0x7fb25800de10 comp rx=0 tx=0).stop 2024-03-16T21:07:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 -- 172.21.15.8:0/831804920 shutdown_connections 2024-03-16T21:07:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fb2500a1c20 0x7fb2500a40e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb26c109650 0x7fb26c199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb26c103f50 0x7fb26c19fda0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 --2- 172.21.15.8:0/831804920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb26c103590 0x7fb26c19f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 -- 172.21.15.8:0/831804920 >> 172.21.15.8:0/831804920 conn(0x7fb26c0ff020 msgr2=0x7fb26c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 -- 172.21.15.8:0/831804920 shutdown_connections 2024-03-16T21:07:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:10.075+0000 7fb271000640 1 -- 172.21.15.8:0/831804920 wait complete. 2024-03-16T21:07:10.100 INFO:tasks.cephfs.filesystem:scrub status for tag:454bb3ff-0729-4159-aa54-5a3602111b97 - {'path': '/', 'tag': '454bb3ff-0729-4159-aa54-5a3602111b97', 'options': 'recursive,force'} 2024-03-16T21:07:10.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:10 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:07:10.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:10 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:10.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:10 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:07:10.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:10 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:10.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:10 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:07:10.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:10 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:10.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:10 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:07:10.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:10 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:10.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:10 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:07:10.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:10 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:10.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:10 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:07:10.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:10 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:11.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:11 smithi170 ceph-mon[35947]: pgmap v288: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-03-16T21:07:11.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:11 smithi186 ceph-mon[36391]: pgmap v288: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-03-16T21:07:11.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:11 smithi008 ceph-mon[31434]: pgmap v288: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-03-16T21:07:12.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:12 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:07:12.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:12 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:07:12.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:12 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:07:13.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:13 smithi170 ceph-mon[35947]: pgmap v289: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-03-16T21:07:13.369 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:13 smithi170 ceph-mon[35947]: osdmap e95: 12 total, 12 up, 12 in 2024-03-16T21:07:13.369 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:13 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:07:13.369 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:13 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:07:13.369 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:13 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:07:13.369 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:13 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:07:13.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:13 smithi186 ceph-mon[36391]: pgmap v289: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-03-16T21:07:13.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:13 smithi186 ceph-mon[36391]: osdmap e95: 12 total, 12 up, 12 in 2024-03-16T21:07:13.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:13 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:07:13.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:13 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:07:13.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:13 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:07:13.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:13 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:07:13.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:13 smithi008 ceph-mon[31434]: pgmap v289: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-03-16T21:07:13.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:13 smithi008 ceph-mon[31434]: osdmap e95: 12 total, 12 up, 12 in 2024-03-16T21:07:13.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:13 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:07:13.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:13 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:07:13.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:13 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:07:13.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:13 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:07:15.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:15 smithi170 ceph-mon[35947]: pgmap v291: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-16T21:07:15.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:15 smithi186 ceph-mon[36391]: pgmap v291: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-16T21:07:15.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:15 smithi008 ceph-mon[31434]: pgmap v291: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-16T21:07:17.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:17 smithi170 ceph-mon[35947]: pgmap v292: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T21:07:17.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:17 smithi186 ceph-mon[36391]: pgmap v292: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T21:07:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:17 smithi008 ceph-mon[31434]: pgmap v292: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T21:07:19.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:19 smithi170 ceph-mon[35947]: pgmap v293: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 215 B/s wr, 7 op/s 2024-03-16T21:07:19.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:19 smithi186 ceph-mon[36391]: pgmap v293: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 215 B/s wr, 7 op/s 2024-03-16T21:07:19.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:19 smithi008 ceph-mon[31434]: pgmap v293: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 215 B/s wr, 7 op/s 2024-03-16T21:07:21.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:21 smithi170 ceph-mon[35947]: pgmap v294: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-03-16T21:07:21.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:21 smithi186 ceph-mon[36391]: pgmap v294: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-03-16T21:07:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:21 smithi008 ceph-mon[31434]: pgmap v294: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-03-16T21:07:23.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:23 smithi170 ceph-mon[35947]: pgmap v295: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:07:23.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:23 smithi186 ceph-mon[36391]: pgmap v295: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:07:23.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:23 smithi008 ceph-mon[31434]: pgmap v295: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:07:25.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:25 smithi170 ceph-mon[35947]: pgmap v296: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 B/s wr, 5 op/s 2024-03-16T21:07:25.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:25 smithi186 ceph-mon[36391]: pgmap v296: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 B/s wr, 5 op/s 2024-03-16T21:07:25.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:25 smithi008 ceph-mon[31434]: pgmap v296: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 B/s wr, 5 op/s 2024-03-16T21:07:27.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:27 smithi170 ceph-mon[35947]: pgmap v297: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:07:27.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:27 smithi186 ceph-mon[36391]: pgmap v297: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:07:27.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:27 smithi008 ceph-mon[31434]: pgmap v297: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:07:29.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:29 smithi170 ceph-mon[35947]: pgmap v298: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:07:29.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:29 smithi186 ceph-mon[36391]: pgmap v298: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:07:29.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:29 smithi008 ceph-mon[31434]: pgmap v298: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:07:31.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:31 smithi170 ceph-mon[35947]: pgmap v299: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:31.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:31 smithi186 ceph-mon[36391]: pgmap v299: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:31.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:31 smithi008 ceph-mon[31434]: pgmap v299: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:33.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:33 smithi170 ceph-mon[35947]: pgmap v300: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:07:33.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:33 smithi186 ceph-mon[36391]: pgmap v300: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:07:33.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:33 smithi008 ceph-mon[31434]: pgmap v300: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:07:35.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:35 smithi170 ceph-mon[35947]: pgmap v301: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:35.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:35 smithi186 ceph-mon[36391]: pgmap v301: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:35.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:35 smithi008 ceph-mon[31434]: pgmap v301: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:37.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:37 smithi170 ceph-mon[35947]: pgmap v302: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:07:37.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:37 smithi186 ceph-mon[36391]: pgmap v302: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:07:37.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:37 smithi008 ceph-mon[31434]: pgmap v302: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:07:39.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:39 smithi170 ceph-mon[35947]: pgmap v303: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:07:39.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:39 smithi186 ceph-mon[36391]: pgmap v303: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:07:39.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:39 smithi008 ceph-mon[31434]: pgmap v303: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:07:40.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:07:40.101 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:07:40.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.332+0000 7f04aea00640 1 -- 172.21.15.8:0/1035299615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04a8103690 msgr2=0x7f04a8103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.332+0000 7f04aea00640 1 --2- 172.21.15.8:0/1035299615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04a8103690 0x7f04a8103b10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0490009890 tx=0x7f049002bb70 comp rx=0 tx=0).stop 2024-03-16T21:07:40.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.332+0000 7f04aea00640 1 -- 172.21.15.8:0/1035299615 shutdown_connections 2024-03-16T21:07:40.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.332+0000 7f04aea00640 1 --2- 172.21.15.8:0/1035299615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a8104050 0x7f04a8110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.332+0000 7f04aea00640 1 --2- 172.21.15.8:0/1035299615 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04a8103690 0x7f04a8103b10 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.332+0000 7f04aea00640 1 --2- 172.21.15.8:0/1035299615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04a81096a0 0x7f04a8109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.332+0000 7f04aea00640 1 -- 172.21.15.8:0/1035299615 >> 172.21.15.8:0/1035299615 conn(0x7f04a80ff140 msgr2=0x7f04a8101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:40.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.332+0000 7f04aea00640 1 -- 172.21.15.8:0/1035299615 shutdown_connections 2024-03-16T21:07:40.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.332+0000 7f04aea00640 1 -- 172.21.15.8:0/1035299615 wait complete. 2024-03-16T21:07:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.333+0000 7f04aea00640 1 Processor -- start 2024-03-16T21:07:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.333+0000 7f04aea00640 1 -- start start 2024-03-16T21:07:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.333+0000 7f04aea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a8103690 0x7f04a8199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.333+0000 7f04aea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04a8104050 0x7f04a819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.333+0000 7f04aea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04a81096a0 0x7f04a819e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.333+0000 7f04aea00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a819ed50 con 0x7f04a8103690 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.333+0000 7f04aea00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a819eec0 con 0x7f04a8104050 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.333+0000 7f04aea00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a819f080 con 0x7f04a81096a0 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04a7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a8103690 0x7f04a8199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04a7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04a8104050 0x7f04a819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04aca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04a81096a0 0x7f04a819e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04a7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a8103690 0x7f04a8199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58404/0 (socket says 172.21.15.8:58404) 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04a7e00640 1 -- 172.21.15.8:0/3445456338 learned_addr learned my addr 172.21.15.8:0/3445456338 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04a7400640 1 -- 172.21.15.8:0/3445456338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04a81096a0 msgr2=0x7f04a819e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04a7400640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04a81096a0 0x7f04a819e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04a7400640 1 -- 172.21.15.8:0/3445456338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a8103690 msgr2=0x7f04a8199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04a7400640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a8103690 0x7f04a8199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04a7400640 1 -- 172.21.15.8:0/3445456338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0490009490 con 0x7f04a8104050 2024-03-16T21:07:40.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04aca00640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04a81096a0 0x7f04a819e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:40.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.334+0000 7f04a7e00640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a8103690 0x7f04a8199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:40.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.335+0000 7f04a7400640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04a8104050 0x7f04a819a3d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f049002c180 tx=0x7f04900045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:40.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.335+0000 7f04a4c00640 1 -- 172.21.15.8:0/3445456338 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490034950 con 0x7f04a8104050 2024-03-16T21:07:40.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.335+0000 7f04a4c00640 1 -- 172.21.15.8:0/3445456338 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f049002ca10 con 0x7f04a8104050 2024-03-16T21:07:40.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.335+0000 7f04aea00640 1 -- 172.21.15.8:0/3445456338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a819f300 con 0x7f04a8104050 2024-03-16T21:07:40.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.335+0000 7f04a4c00640 1 -- 172.21.15.8:0/3445456338 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490032620 con 0x7f04a8104050 2024-03-16T21:07:40.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.335+0000 7f04aea00640 1 -- 172.21.15.8:0/3445456338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a819f5d0 con 0x7f04a8104050 2024-03-16T21:07:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.338+0000 7f04b17cb740 1 Processor -- start 2024-03-16T21:07:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.338+0000 7f04a4c00640 1 -- 172.21.15.8:0/3445456338 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f049003b040 con 0x7f04a8104050 2024-03-16T21:07:40.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.338+0000 7f04b17cb740 1 -- start start 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.339+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 0x55a9855e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.339+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855e52c0 0x55a9855e5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.339+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855ee630 0x55a9855f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.339+0000 7f04b17cb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a985554150 con 0x55a9855e52c0 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.339+0000 7f04b17cb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a985551680 con 0x55a9855e5fa0 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.339+0000 7f04b17cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98554ce60 con 0x55a9855ee630 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.339+0000 7f04aca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 0x55a9855e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.339+0000 7f04a7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855e52c0 0x55a9855e5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.339+0000 7f04aca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 0x55a9855e4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43242/0 (socket says 172.21.15.8:43242) 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.339+0000 7f04aca00640 1 -- 172.21.15.8:0/4223562761 learned_addr learned my addr 172.21.15.8:0/4223562761 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.339+0000 7f04a7400640 1 --2- 172.21.15.8:0/4223562761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855ee630 0x55a9855f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.340+0000 7f04aca00640 1 -- 172.21.15.8:0/4223562761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855ee630 msgr2=0x55a9855f0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:40.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.340+0000 7f04aca00640 1 --2- 172.21.15.8:0/4223562761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855ee630 0x55a9855f0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.340+0000 7f04aca00640 1 -- 172.21.15.8:0/4223562761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855e52c0 msgr2=0x55a9855e5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:40.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.340+0000 7f04aca00640 1 --2- 172.21.15.8:0/4223562761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855e52c0 0x55a9855e5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.340+0000 7f04aca00640 1 -- 172.21.15.8:0/4223562761 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a985506060 con 0x55a9855e5fa0 2024-03-16T21:07:40.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.340+0000 7f04a7400640 1 --2- 172.21.15.8:0/4223562761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855ee630 0x55a9855f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:07:40.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.340+0000 7f04aca00640 1 --2- 172.21.15.8:0/4223562761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 0x55a9855e4cf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f04a0011540 tx=0x7f04a0011940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e508c6c9b2464fd0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:40.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.340+0000 7f049d200640 1 -- 172.21.15.8:0/4223562761 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000f540 con 0x55a9855e5fa0 2024-03-16T21:07:40.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.340+0000 7f049d200640 1 -- 172.21.15.8:0/4223562761 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f04a000fba0 con 0x55a9855e5fa0 2024-03-16T21:07:40.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.340+0000 7f049d200640 1 -- 172.21.15.8:0/4223562761 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0019d20 con 0x55a9855e5fa0 2024-03-16T21:07:40.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.340+0000 7f04a4c00640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f048c0a1ba0 0x7f048c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04a4c00640 1 -- 172.21.15.8:0/3445456338 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f04900ef060 con 0x7f04a8104050 2024-03-16T21:07:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04a7e00640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f048c0a1ba0 0x7f048c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04b17cb740 1 -- 172.21.15.8:0/4223562761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 msgr2=0x55a9855e4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04b17cb740 1 --2- 172.21.15.8:0/4223562761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 0x55a9855e4cf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f04a0011540 tx=0x7f04a0011940 comp rx=0 tx=0).stop 2024-03-16T21:07:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04b17cb740 1 -- 172.21.15.8:0/4223562761 shutdown_connections 2024-03-16T21:07:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04b17cb740 1 --2- 172.21.15.8:0/4223562761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855ee630 0x55a9855f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04b17cb740 1 --2- 172.21.15.8:0/4223562761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855e52c0 0x55a9855e5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04b17cb740 1 --2- 172.21.15.8:0/4223562761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 0x55a9855e4cf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04b17cb740 1 -- 172.21.15.8:0/4223562761 >> 172.21.15.8:0/4223562761 conn(0x55a9855ac5a0 msgr2=0x55a9855dfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04b17cb740 1 -- 172.21.15.8:0/4223562761 shutdown_connections 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04b17cb740 1 -- 172.21.15.8:0/4223562761 wait complete. 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.341+0000 7f04a7e00640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f048c0a1ba0 0x7f048c0a4060 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55a9855e64f0 tx=0x7f0498010040 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.342+0000 7f04b17cb740 1 -- start start 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.342+0000 7f04b17cb740 1 Processor -- start 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.342+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855eb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855e5fa0 0x55a9855ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855ee630 0x55a9855ec020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04b17cb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9854f1ec0 con 0x55a9855e5fa0 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04b17cb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9854f1b60 con 0x55a9855ee630 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04b17cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9852bb1c0 con 0x55a9855e52c0 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04b17cb740 10 client.0 _ll_register_callbacks cb 0x55a985505960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:40.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04a7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855eb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04aca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855ee630 0x55a9855ec020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04a7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855eb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41760/0 (socket says 172.21.15.8:41760) 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04aca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855ee630 0x55a9855ec020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43252/0 (socket says 172.21.15.8:43252) 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04a7e00640 1 -- 172.21.15.8:0/2908647035 learned_addr learned my addr 172.21.15.8:0/2908647035 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04a7400640 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855e5fa0 0x55a9855ebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04aca00640 1 -- 172.21.15.8:0/2908647035 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 msgr2=0x55a9855eb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04aca00640 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855eb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04aca00640 1 -- 172.21.15.8:0/2908647035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855e5fa0 msgr2=0x55a9855ebae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04aca00640 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855e5fa0 0x55a9855ebae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04aca00640 1 -- 172.21.15.8:0/2908647035 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a0009d40 con 0x55a9855ee630 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.343+0000 7f04a7e00640 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855eb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.344+0000 7f04aca00640 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855ee630 0x55a9855ec020 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f04a0004600 tx=0x7f04a001aad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6727c714ac60bb7b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.344+0000 7f0495600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:07:40.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.344+0000 7f0495600640 1 -- 172.21.15.8:0/2908647035 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000f540 con 0x55a9855ee630 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.344+0000 7f0495600640 1 -- 172.21.15.8:0/2908647035 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f04a000f6a0 con 0x55a9855ee630 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.344+0000 7f04b17cb740 1 -- 172.21.15.8:0/2908647035 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a98524c7e0 con 0x55a9855ee630 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.344+0000 7f0495600640 1 -- 172.21.15.8:0/2908647035 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04a000f860 con 0x55a9855ee630 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.344+0000 7f04b17cb740 10 client.27677 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.344+0000 7f04b17cb740 1 -- 172.21.15.8:0/2908647035 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a98554b4e0 con 0x55a9855ee630 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.345+0000 7f0495600640 1 -- 172.21.15.8:0/2908647035 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a98524c7e0 con 0x55a9855ee630 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.345+0000 7f0495600640 1 -- 172.21.15.8:0/2908647035 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f04a00049c0 con 0x55a9855ee630 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.345+0000 7f04b17cb740 10 client.27677 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.345+0000 7f04b17cb740 10 client.27677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.345+0000 7f04b17cb740 20 client.27677 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.345+0000 7f04b17cb740 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a9855fe730 0x55a985600b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.345+0000 7f04b17cb740 4 client.27677 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:40.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.345+0000 7f04b17cb740 1 -- 172.21.15.8:0/2908647035 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a985289720 con 0x55a9855fe730 2024-03-16T21:07:40.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.345+0000 7f04a7e00640 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a9855fe730 0x55a985600b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.346+0000 7f04a7e00640 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a9855fe730 0x55a985600b20 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a049aefb09d9b729 server_cookie=fed12fb233e3f89d in_seq=0 out_seq=0 2024-03-16T21:07:40.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.346+0000 7f0495600640 10 client.27677 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f0495600640 1 -- 172.21.15.8:0/2908647035 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a985289720 con 0x55a9855fe730 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f0495600640 10 client.27677 handle_command_reply: tid=0 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f04b17cb740 1 client.27677 shutdown 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f04b17cb740 1 -- 172.21.15.8:0/2908647035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855ee630 msgr2=0x55a9855ec020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f04b17cb740 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855ee630 0x55a9855ec020 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f04a0004600 tx=0x7f04a001aad0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f04b17cb740 1 -- 172.21.15.8:0/2908647035 shutdown_connections 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f04b17cb740 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855ee630 0x55a9855ec020 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f04b17cb740 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a9855fe730 0x55a985600b20 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f04b17cb740 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855e5fa0 0x55a9855ebae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f04b17cb740 1 --2- 172.21.15.8:0/2908647035 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855eb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f04b17cb740 1 -- 172.21.15.8:0/2908647035 >> 172.21.15.8:0/2908647035 conn(0x55a9855ac5a0 msgr2=0x55a9855e1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f0495600640 0 client.27677 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.347+0000 7f04b17cb740 1 -- 172.21.15.8:0/2908647035 shutdown_connections 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.348+0000 7f04b17cb740 1 -- 172.21.15.8:0/2908647035 wait complete. 2024-03-16T21:07:40.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.348+0000 7f04b17cb740 20 client.27677 trim_cache size 0 max 16384 2024-03-16T21:07:40.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.365+0000 7f04b17cb740 1 Processor -- start 2024-03-16T21:07:40.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.365+0000 7f04b17cb740 1 -- start start 2024-03-16T21:07:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e52c0 0x55a9855edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e5fa0 0x55a9855ebe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855ee630 0x55a9855e17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04b17cb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9855df5b0 con 0x55a9855ee630 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04b17cb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9855e4540 con 0x55a9855e52c0 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04b17cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9855e7190 con 0x55a9855e5fa0 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e5fa0 0x55a9855ebe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04a7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e52c0 0x55a9855edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04a7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e5fa0 0x55a9855ebe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41764/0 (socket says 172.21.15.8:41764) 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04aca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855ee630 0x55a9855e17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04a7400640 1 -- 172.21.15.8:0/4263411649 learned_addr learned my addr 172.21.15.8:0/4263411649 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04a7e00640 1 --2- 172.21.15.8:0/4263411649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e52c0 0x55a9855edcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43264/0 (socket says 172.21.15.8:43264) 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.366+0000 7f04a7400640 1 -- 172.21.15.8:0/4263411649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e52c0 msgr2=0x55a9855edcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.367+0000 7f04a7400640 1 --2- 172.21.15.8:0/4263411649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e52c0 0x55a9855edcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.367+0000 7f04a7400640 1 -- 172.21.15.8:0/4263411649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855ee630 msgr2=0x55a9855e17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.367+0000 7f04a7400640 1 --2- 172.21.15.8:0/4263411649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855ee630 0x55a9855e17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.367+0000 7f04a7400640 1 -- 172.21.15.8:0/4263411649 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9854e7950 con 0x55a9855e5fa0 2024-03-16T21:07:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.367+0000 7f04a7e00640 1 --2- 172.21.15.8:0/4263411649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e52c0 0x55a9855edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.367+0000 7f04a7400640 1 --2- 172.21.15.8:0/4263411649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e5fa0 0x55a9855ebe40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f04900b87c0 tx=0x7f0490003990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7ff93877861c598 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.367+0000 7f0497e00640 1 -- 172.21.15.8:0/4263411649 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900ecea0 con 0x55a9855e5fa0 2024-03-16T21:07:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.367+0000 7f0497e00640 1 -- 172.21.15.8:0/4263411649 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f04900bb750 con 0x55a9855e5fa0 2024-03-16T21:07:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.367+0000 7f0497e00640 1 -- 172.21.15.8:0/4263411649 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900035f0 con 0x55a9855e5fa0 2024-03-16T21:07:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.368+0000 7f04b17cb740 1 -- 172.21.15.8:0/4263411649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e5fa0 msgr2=0x55a9855ebe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.368+0000 7f04b17cb740 1 --2- 172.21.15.8:0/4263411649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e5fa0 0x55a9855ebe40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f04900b87c0 tx=0x7f0490003990 comp rx=0 tx=0).stop 2024-03-16T21:07:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.368+0000 7f04b17cb740 1 -- 172.21.15.8:0/4263411649 shutdown_connections 2024-03-16T21:07:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.368+0000 7f04b17cb740 1 --2- 172.21.15.8:0/4263411649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855ee630 0x55a9855e17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.368+0000 7f04b17cb740 1 --2- 172.21.15.8:0/4263411649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e5fa0 0x55a9855ebe40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.368+0000 7f04b17cb740 1 --2- 172.21.15.8:0/4263411649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e52c0 0x55a9855edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.368+0000 7f04b17cb740 1 -- 172.21.15.8:0/4263411649 >> 172.21.15.8:0/4263411649 conn(0x55a9855ac5a0 msgr2=0x55a9855e10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.368+0000 7f04b17cb740 1 -- 172.21.15.8:0/4263411649 shutdown_connections 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.368+0000 7f04b17cb740 1 -- 172.21.15.8:0/4263411649 wait complete. 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.368+0000 7f04b17cb740 1 -- start start 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.368+0000 7f04b17cb740 1 Processor -- start 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855f6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 0x55a9855f6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04b17cb740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855ee630 0x55a9855ef710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04b17cb740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9855efdb0 con 0x55a9855ee630 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04b17cb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9855eff20 con 0x55a9855e5fa0 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04b17cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9855f00e0 con 0x55a9855e52c0 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04b17cb740 10 client.0 _ll_register_callbacks cb 0x7f04a0019450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04a7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04a7e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855f6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41766/0 (socket says 172.21.15.8:41766) 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04a7e00640 1 -- 172.21.15.8:0/818286547 learned_addr learned my addr 172.21.15.8:0/818286547 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04aca00640 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855ee630 0x55a9855ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04a7400640 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 0x55a9855f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04a7e00640 1 -- 172.21.15.8:0/818286547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 msgr2=0x55a9855f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04a7e00640 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 0x55a9855f6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04a7e00640 1 -- 172.21.15.8:0/818286547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855ee630 msgr2=0x55a9855ef710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.369+0000 7f04a7e00640 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855ee630 0x55a9855ef710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.370+0000 7f04a7e00640 1 -- 172.21.15.8:0/818286547 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049802b890 con 0x55a9855e52c0 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.370+0000 7f04a7e00640 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855f6000 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55a985601320 tx=0x7f0498016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d58a660f8c46cda server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.370+0000 7f0495600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.370+0000 7f0495600640 1 -- 172.21.15.8:0/818286547 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498013040 con 0x55a9855e52c0 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.370+0000 7f0495600640 1 -- 172.21.15.8:0/818286547 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0498004b20 con 0x55a9855e52c0 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.370+0000 7f04b17cb740 1 -- 172.21.15.8:0/818286547 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04a000fba0 con 0x55a9855e52c0 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.370+0000 7f0495600640 1 -- 172.21.15.8:0/818286547 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0498004ce0 con 0x55a9855e52c0 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.370+0000 7f04b17cb740 10 client.27694 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.370+0000 7f04b17cb740 1 -- 172.21.15.8:0/818286547 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f04a819f5d0 con 0x55a9855e52c0 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.371+0000 7f0495600640 1 -- 172.21.15.8:0/818286547 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f0498042020 con 0x55a9855e52c0 2024-03-16T21:07:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.371+0000 7f0495600640 1 -- 172.21.15.8:0/818286547 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f049803eb60 con 0x55a9855e52c0 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.371+0000 7f04b17cb740 10 client.27694 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.371+0000 7f04b17cb740 10 client.27694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.371+0000 7f04b17cb740 20 client.27694 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.371+0000 7f04b17cb740 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a98565b300 0x55a98565d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.371+0000 7f04b17cb740 4 client.27694 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.371+0000 7f04b17cb740 1 -- 172.21.15.8:0/818286547 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a9852d8890 con 0x55a98565b300 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.371+0000 7f04a7400640 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a98565b300 0x55a98565d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04a7400640 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a98565b300 0x55a98565d720 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42ded2ba5a3f62f4 server_cookie=68739debdb3cdbf5 in_seq=0 out_seq=0 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f0495600640 10 client.27694 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f0495600640 1 -- 172.21.15.8:0/818286547 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a9852d8890 con 0x55a98565b300 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f0495600640 10 client.27694 handle_command_reply: tid=0 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 1 client.27694 shutdown 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 1 -- 172.21.15.8:0/818286547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 msgr2=0x55a9855f6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855f6000 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55a985601320 tx=0x7f0498016000 comp rx=0 tx=0).stop 2024-03-16T21:07:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 1 -- 172.21.15.8:0/818286547 shutdown_connections 2024-03-16T21:07:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a98565b300 0x55a98565d720 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9855ee630 0x55a9855ef710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9855e5fa0 0x55a9855f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 1 --2- 172.21.15.8:0/818286547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9855e52c0 0x55a9855f6000 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f0495600640 0 client.27694 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 1 -- 172.21.15.8:0/818286547 >> 172.21.15.8:0/818286547 conn(0x55a9855ac5a0 msgr2=0x55a9855dee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 1 -- 172.21.15.8:0/818286547 shutdown_connections 2024-03-16T21:07:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 1 -- 172.21.15.8:0/818286547 wait complete. 2024-03-16T21:07:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.372+0000 7f04b17cb740 20 client.27694 trim_cache size 0 max 16384 2024-03-16T21:07:40.382 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:07:40.382 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:07:40.383 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:07:40.383 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:07:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 -- 172.21.15.8:0/3445456338 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f048c0a1ba0 msgr2=0x7f048c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f048c0a1ba0 0x7f048c0a4060 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55a9855e64f0 tx=0x7f0498010040 comp rx=0 tx=0).stop 2024-03-16T21:07:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 -- 172.21.15.8:0/3445456338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04a8104050 msgr2=0x7f04a819a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04a8104050 0x7f04a819a3d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f049002c180 tx=0x7f04900045b0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 -- 172.21.15.8:0/3445456338 shutdown_connections 2024-03-16T21:07:40.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f048c0a1ba0 0x7f048c0a4060 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04a81096a0 0x7f04a819e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04a8104050 0x7f04a819a3d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 --2- 172.21.15.8:0/3445456338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04a8103690 0x7f04a8199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 -- 172.21.15.8:0/3445456338 >> 172.21.15.8:0/3445456338 conn(0x7f04a80ff140 msgr2=0x7f04a80ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:40.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 -- 172.21.15.8:0/3445456338 shutdown_connections 2024-03-16T21:07:40.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.373+0000 7f04aea00640 1 -- 172.21.15.8:0/3445456338 wait complete. 2024-03-16T21:07:40.396 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:07:40.396 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:07:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.608+0000 7f8370400640 1 -- 172.21.15.8:0/3231710366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8368075a20 msgr2=0x7f8368075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.608+0000 7f8370400640 1 --2- 172.21.15.8:0/3231710366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8368075a20 0x7f8368075e00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8358009cd0 tx=0x7f835802c0f0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.608+0000 7f8370400640 1 -- 172.21.15.8:0/3231710366 shutdown_connections 2024-03-16T21:07:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.608+0000 7f8370400640 1 --2- 172.21.15.8:0/3231710366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8368112320 0x7f8368114710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.608+0000 7f8370400640 1 --2- 172.21.15.8:0/3231710366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368076340 0x7f8368111de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.608+0000 7f8370400640 1 --2- 172.21.15.8:0/3231710366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8368075a20 0x7f8368075e00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.608+0000 7f8370400640 1 -- 172.21.15.8:0/3231710366 >> 172.21.15.8:0/3231710366 conn(0x7f83680ff150 msgr2=0x7f8368101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.608+0000 7f8370400640 1 -- 172.21.15.8:0/3231710366 shutdown_connections 2024-03-16T21:07:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.608+0000 7f8370400640 1 -- 172.21.15.8:0/3231710366 wait complete. 2024-03-16T21:07:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.609+0000 7f8370400640 1 Processor -- start 2024-03-16T21:07:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.609+0000 7f8370400640 1 -- start start 2024-03-16T21:07:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.610+0000 7f8370400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8368075a20 0x7f836819e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.610+0000 7f8370400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368076340 0x7f836819e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.610+0000 7f8370400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8368112320 0x7f83681a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.610+0000 7f8370400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83681a30c0 con 0x7f8368075a20 2024-03-16T21:07:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.610+0000 7f8370400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83681a3230 con 0x7f8368076340 2024-03-16T21:07:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.610+0000 7f8370400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83681a33f0 con 0x7f8368112320 2024-03-16T21:07:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.610+0000 7f836d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368076340 0x7f836819e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.610+0000 7f836d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368076340 0x7f836819e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43294/0 (socket says 172.21.15.8:43294) 2024-03-16T21:07:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.610+0000 7f836d000640 1 -- 172.21.15.8:0/542827177 learned_addr learned my addr 172.21.15.8:0/542827177 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.610+0000 7f836da00640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8368075a20 0x7f836819e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.610+0000 7f836e400640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8368112320 0x7f83681a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.611+0000 7f836d000640 1 -- 172.21.15.8:0/542827177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8368112320 msgr2=0x7f83681a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.611+0000 7f836d000640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8368112320 0x7f83681a2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.611+0000 7f836d000640 1 -- 172.21.15.8:0/542827177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8368075a20 msgr2=0x7f836819e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.611+0000 7f836d000640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8368075a20 0x7f836819e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.611+0000 7f836d000640 1 -- 172.21.15.8:0/542827177 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8354009490 con 0x7f8368076340 2024-03-16T21:07:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.611+0000 7f836d000640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368076340 0x7f836819e740 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f835400ea60 tx=0x7f835400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.611+0000 7f8366000640 1 -- 172.21.15.8:0/542827177 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835400cde0 con 0x7f8368076340 2024-03-16T21:07:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.611+0000 7f8366000640 1 -- 172.21.15.8:0/542827177 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f83540035f0 con 0x7f8368076340 2024-03-16T21:07:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.611+0000 7f8370400640 1 -- 172.21.15.8:0/542827177 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8358009900 con 0x7f8368076340 2024-03-16T21:07:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.611+0000 7f8366000640 1 -- 172.21.15.8:0/542827177 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354010690 con 0x7f8368076340 2024-03-16T21:07:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.611+0000 7f8370400640 1 -- 172.21.15.8:0/542827177 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83681aad70 con 0x7f8368076340 2024-03-16T21:07:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.612+0000 7f8370400640 1 -- 172.21.15.8:0/542827177 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8368068730 con 0x7f8368076340 2024-03-16T21:07:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.615+0000 7f8366000640 1 -- 172.21.15.8:0/542827177 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f8354003b80 con 0x7f8368076340 2024-03-16T21:07:40.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.616+0000 7f8366000640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f834c0a1ba0 0x7f834c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:40.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.616+0000 7f8366000640 1 -- 172.21.15.8:0/542827177 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8354014070 con 0x7f8368076340 2024-03-16T21:07:40.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.617+0000 7f836da00640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f834c0a1ba0 0x7f834c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:40.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.617+0000 7f836da00640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f834c0a1ba0 0x7f834c0a4060 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8358009ca0 tx=0x7f8358005ef0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:40.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.622+0000 7f8366000640 1 -- 172.21.15.8:0/542827177 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8354096b60 con 0x7f8368076340 2024-03-16T21:07:40.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.866+0000 7f8370400640 1 -- 172.21.15.8:0/542827177 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f836819f550 con 0x7f8368076340 2024-03-16T21:07:40.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.867+0000 7f8366000640 1 -- 172.21.15.8:0/542827177 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f835409a220 con 0x7f8368076340 2024-03-16T21:07:40.873 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:07:40.873 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:27.879028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:07:40.873 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-03-16T21:07:40.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 -- 172.21.15.8:0/542827177 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f834c0a1ba0 msgr2=0x7f834c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f834c0a1ba0 0x7f834c0a4060 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8358009ca0 tx=0x7f8358005ef0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 -- 172.21.15.8:0/542827177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368076340 msgr2=0x7f836819e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368076340 0x7f836819e740 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f835400ea60 tx=0x7f835400ef20 comp rx=0 tx=0).stop 2024-03-16T21:07:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 -- 172.21.15.8:0/542827177 shutdown_connections 2024-03-16T21:07:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f834c0a1ba0 0x7f834c0a4060 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8368112320 0x7f83681a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368076340 0x7f836819e740 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 --2- 172.21.15.8:0/542827177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8368075a20 0x7f836819e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 -- 172.21.15.8:0/542827177 >> 172.21.15.8:0/542827177 conn(0x7f83680ff150 msgr2=0x7f8368113930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 -- 172.21.15.8:0/542827177 shutdown_connections 2024-03-16T21:07:40.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:40.870+0000 7f8370400640 1 -- 172.21.15.8:0/542827177 wait complete. 2024-03-16T21:07:40.897 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:07:40.897 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:07:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.118+0000 7f1c13e00640 1 -- 172.21.15.8:0/3308334862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c14103590 msgr2=0x7f1c14103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.118+0000 7f1c13e00640 1 --2- 172.21.15.8:0/3308334862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c14103590 0x7f1c14103a10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009930 tx=0x7f1c0002bc20 comp rx=0 tx=0).stop 2024-03-16T21:07:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.118+0000 7f1c13e00640 1 -- 172.21.15.8:0/3308334862 shutdown_connections 2024-03-16T21:07:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.118+0000 7f1c13e00640 1 --2- 172.21.15.8:0/3308334862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14103f50 0x7f1c14110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.118+0000 7f1c13e00640 1 --2- 172.21.15.8:0/3308334862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c14103590 0x7f1c14103a10 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.118+0000 7f1c13e00640 1 --2- 172.21.15.8:0/3308334862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c14109650 0x7f1c14109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.118+0000 7f1c13e00640 1 -- 172.21.15.8:0/3308334862 >> 172.21.15.8:0/3308334862 conn(0x7f1c140ff020 msgr2=0x7f1c14101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.118+0000 7f1c13e00640 1 -- 172.21.15.8:0/3308334862 shutdown_connections 2024-03-16T21:07:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.118+0000 7f1c13e00640 1 -- 172.21.15.8:0/3308334862 wait complete. 2024-03-16T21:07:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.119+0000 7f1c13e00640 1 Processor -- start 2024-03-16T21:07:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.119+0000 7f1c13e00640 1 -- start start 2024-03-16T21:07:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.119+0000 7f1c13e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c14103590 0x7f1c1419f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.119+0000 7f1c13e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14103f50 0x7f1c1419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.119+0000 7f1c13e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c14109650 0x7f1c14199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.119+0000 7f1c13e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1419a130 con 0x7f1c14103f50 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.119+0000 7f1c13e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1419a2a0 con 0x7f1c14103590 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.119+0000 7f1c13e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1419a460 con 0x7f1c14109650 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.120+0000 7f1c12a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c14103590 0x7f1c1419f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.120+0000 7f1c12000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14103f50 0x7f1c1419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.120+0000 7f1c12a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c14103590 0x7f1c1419f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43308/0 (socket says 172.21.15.8:43308) 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.120+0000 7f1c12a00640 1 -- 172.21.15.8:0/1711413167 learned_addr learned my addr 172.21.15.8:0/1711413167 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.120+0000 7f1c13400640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c14109650 0x7f1c14199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.120+0000 7f1c12a00640 1 -- 172.21.15.8:0/1711413167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c14109650 msgr2=0x7f1c14199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.120+0000 7f1c12a00640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c14109650 0x7f1c14199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.120+0000 7f1c12a00640 1 -- 172.21.15.8:0/1711413167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14103f50 msgr2=0x7f1c1419fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.120+0000 7f1c12a00640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14103f50 0x7f1c1419fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.120+0000 7f1c12a00640 1 -- 172.21.15.8:0/1711413167 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c00009560 con 0x7f1c14103590 2024-03-16T21:07:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.120+0000 7f1c12a00640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c14103590 0x7f1c1419f8e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400e9f0 tx=0x7f1c0400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.121+0000 7f1c0b400640 1 -- 172.21.15.8:0/1711413167 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04009700 con 0x7f1c14103590 2024-03-16T21:07:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.121+0000 7f1c0b400640 1 -- 172.21.15.8:0/1711413167 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1c0400cd80 con 0x7f1c14103590 2024-03-16T21:07:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.121+0000 7f1c13e00640 1 -- 172.21.15.8:0/1711413167 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1419a740 con 0x7f1c14103590 2024-03-16T21:07:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.121+0000 7f1c0b400640 1 -- 172.21.15.8:0/1711413167 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c040189c0 con 0x7f1c14103590 2024-03-16T21:07:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.121+0000 7f1c13e00640 1 -- 172.21.15.8:0/1711413167 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c141a6980 con 0x7f1c14103590 2024-03-16T21:07:41.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.124+0000 7f1c0b400640 1 -- 172.21.15.8:0/1711413167 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f1c04018b20 con 0x7f1c14103590 2024-03-16T21:07:41.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.124+0000 7f1c1c369740 1 Processor -- start 2024-03-16T21:07:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.124+0000 7f1c1c369740 1 -- start start 2024-03-16T21:07:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1edf0 0x564897a1f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a1f710 0x564897a27db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a282f0 0x564897a2a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c1c369740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489798d210 con 0x564897a1f710 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c1c369740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489798a740 con 0x564897a282f0 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c1c369740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564897985f20 con 0x564897a1edf0 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c13400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1edf0 0x564897a1f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c12000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a282f0 0x564897a2a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c13400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1edf0 0x564897a1f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41800/0 (socket says 172.21.15.8:41800) 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c13400640 1 -- 172.21.15.8:0/1953265350 learned_addr learned my addr 172.21.15.8:0/1953265350 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c12a00640 1 --2- 172.21.15.8:0/1953265350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a1f710 0x564897a27db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c12000640 1 -- 172.21.15.8:0/1953265350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1edf0 msgr2=0x564897a1f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c12000640 1 --2- 172.21.15.8:0/1953265350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1edf0 0x564897a1f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c12000640 1 -- 172.21.15.8:0/1953265350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a1f710 msgr2=0x564897a27db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c12000640 1 --2- 172.21.15.8:0/1953265350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a1f710 0x564897a27db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.125+0000 7f1c12000640 1 -- 172.21.15.8:0/1953265350 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564897947df0 con 0x564897a282f0 2024-03-16T21:07:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.126+0000 7f1c0b400640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1bf80a1c20 0x7f1bf80a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.126+0000 7f1c12000640 1 --2- 172.21.15.8:0/1953265350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a282f0 0x564897a2a6e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1c00036040 tx=0x7f1c0002c640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c865518ec608dcbc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.126+0000 7f1c0b400640 1 -- 172.21.15.8:0/1711413167 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1c04014070 con 0x7f1c14103590 2024-03-16T21:07:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.126+0000 7f1c13400640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1bf80a1c20 0x7f1bf80a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.126+0000 7f1bff400640 1 -- 172.21.15.8:0/1953265350 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00004780 con 0x564897a282f0 2024-03-16T21:07:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.126+0000 7f1bff400640 1 -- 172.21.15.8:0/1953265350 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1c000048e0 con 0x564897a282f0 2024-03-16T21:07:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.126+0000 7f1bff400640 1 -- 172.21.15.8:0/1953265350 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00005070 con 0x564897a282f0 2024-03-16T21:07:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.127+0000 7f1c1c369740 1 -- 172.21.15.8:0/1953265350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a282f0 msgr2=0x564897a2a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.127+0000 7f1c13400640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1bf80a1c20 0x7f1bf80a40e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0116b0 tx=0x7f1c0c009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.127+0000 7f1c1c369740 1 --2- 172.21.15.8:0/1953265350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a282f0 0x564897a2a6e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1c00036040 tx=0x7f1c0002c640 comp rx=0 tx=0).stop 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.127+0000 7f1c1c369740 1 -- 172.21.15.8:0/1953265350 shutdown_connections 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.127+0000 7f1c1c369740 1 --2- 172.21.15.8:0/1953265350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a282f0 0x564897a2a6e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.127+0000 7f1c1c369740 1 --2- 172.21.15.8:0/1953265350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a1f710 0x564897a27db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.127+0000 7f1c1c369740 1 --2- 172.21.15.8:0/1953265350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1edf0 0x564897a1f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.127+0000 7f1c1c369740 1 -- 172.21.15.8:0/1953265350 >> 172.21.15.8:0/1953265350 conn(0x564897a19520 msgr2=0x564897a19900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.127+0000 7f1c1c369740 1 -- 172.21.15.8:0/1953265350 shutdown_connections 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.127+0000 7f1c1c369740 1 -- 172.21.15.8:0/1953265350 wait complete. 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.128+0000 7f1c1c369740 1 -- start start 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.128+0000 7f1c1c369740 1 Processor -- start 2024-03-16T21:07:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.128+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1edf0 0x564897a25320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.128+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1f710 0x564897a25860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.128+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a25da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.128+0000 7f1c1c369740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489792b150 con 0x564897a282f0 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.128+0000 7f1c1c369740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489792adf0 con 0x564897a1f710 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.128+0000 7f1c1c369740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648976f41c0 con 0x564897a1edf0 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.128+0000 7f1c1c369740 10 client.0 _ll_register_callbacks cb 0x56489797a2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c12000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1f710 0x564897a25860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c12000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1f710 0x564897a25860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43320/0 (socket says 172.21.15.8:43320) 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c12000640 1 -- 172.21.15.8:0/3981675413 learned_addr learned my addr 172.21.15.8:0/3981675413 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c12a00640 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1edf0 0x564897a25320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c13400640 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a25da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c12000640 1 -- 172.21.15.8:0/3981675413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1edf0 msgr2=0x564897a25320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c12000640 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1edf0 0x564897a25320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c12000640 1 -- 172.21.15.8:0/3981675413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 msgr2=0x564897a25da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c12000640 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a25da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c12000640 1 -- 172.21.15.8:0/3981675413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c14110d10 con 0x564897a1f710 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c12000640 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1f710 0x564897a25860 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1c0002bc60 tx=0x7f1c00005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdf53b5386424463 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1bf3e00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1bf3e00640 1 -- 172.21.15.8:0/3981675413 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00004780 con 0x564897a1f710 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1bf3e00640 1 -- 172.21.15.8:0/3981675413 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1c00004a50 con 0x564897a1f710 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.129+0000 7f1c1c369740 1 -- 172.21.15.8:0/3981675413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648976857e0 con 0x564897a1f710 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.130+0000 7f1bf3e00640 1 -- 172.21.15.8:0/3981675413 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c0002ccf0 con 0x564897a1f710 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.130+0000 7f1c1c369740 10 client.27701 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.130+0000 7f1c1c369740 1 -- 172.21.15.8:0/3981675413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5648979845a0 con 0x564897a1f710 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.130+0000 7f1bf3e00640 1 -- 172.21.15.8:0/3981675413 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1c0005e080 con 0x564897a1f710 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.130+0000 7f1bf3e00640 1 -- 172.21.15.8:0/3981675413 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f1c00058030 con 0x564897a1f710 2024-03-16T21:07:41.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.130+0000 7f1c1c369740 10 client.27701 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.130+0000 7f1c1c369740 10 client.27701 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:07:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.130+0000 7f1c1c369740 20 client.27701 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.130+0000 7f1c1c369740 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564897a37ff0 0x564897a3a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.130+0000 7f1c1c369740 4 client.27701 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.130+0000 7f1c1c369740 1 -- 172.21.15.8:0/3981675413 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648976c2720 con 0x564897a37ff0 2024-03-16T21:07:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.131+0000 7f1c12a00640 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564897a37ff0 0x564897a3a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.131+0000 7f1c12a00640 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564897a37ff0 0x564897a3a430 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fbdb4e280666e40a server_cookie=e158f8bfab059f24 in_seq=0 out_seq=0 2024-03-16T21:07:41.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.131+0000 7f1bf3e00640 10 client.27701 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:07:41.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1bf3e00640 1 -- 172.21.15.8:0/3981675413 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5648976c2720 con 0x564897a37ff0 2024-03-16T21:07:41.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1bf3e00640 10 client.27701 handle_command_reply: tid=0 2024-03-16T21:07:41.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 1 client.27701 shutdown 2024-03-16T21:07:41.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 1 -- 172.21.15.8:0/3981675413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1f710 msgr2=0x564897a25860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1f710 0x564897a25860 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1c0002bc60 tx=0x7f1c00005040 comp rx=0 tx=0).stop 2024-03-16T21:07:41.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 1 -- 172.21.15.8:0/3981675413 shutdown_connections 2024-03-16T21:07:41.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564897a37ff0 0x564897a3a430 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a25da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1f710 0x564897a25860 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 1 --2- 172.21.15.8:0/3981675413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1edf0 0x564897a25320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 1 -- 172.21.15.8:0/3981675413 >> 172.21.15.8:0/3981675413 conn(0x564897a19520 msgr2=0x564897a1b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1bf3e00640 0 client.27701 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:07:41.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 1 -- 172.21.15.8:0/3981675413 shutdown_connections 2024-03-16T21:07:41.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 1 -- 172.21.15.8:0/3981675413 wait complete. 2024-03-16T21:07:41.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.132+0000 7f1c1c369740 20 client.27701 trim_cache size 0 max 16384 2024-03-16T21:07:41.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.146+0000 7f1c1c369740 1 Processor -- start 2024-03-16T21:07:41.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.146+0000 7f1c1c369740 1 -- start start 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.146+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1edf0 0x564897a27a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.146+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a23c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.146+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a25bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.146+0000 7f1c1c369740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564897a18dd0 con 0x564897a282f0 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.146+0000 7f1c1c369740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564897a34e10 con 0x564897a1edf0 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.146+0000 7f1c1c369740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564897a24150 con 0x564897a1f710 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1c12000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a23c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1c12000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a23c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41814/0 (socket says 172.21.15.8:41814) 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1c12000640 1 -- 172.21.15.8:0/1564002813 learned_addr learned my addr 172.21.15.8:0/1564002813 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1c12a00640 1 --2- 172.21.15.8:0/1564002813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1edf0 0x564897a27a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1c13400640 1 --2- 172.21.15.8:0/1564002813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a25bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1c12000640 1 -- 172.21.15.8:0/1564002813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1edf0 msgr2=0x564897a27a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1c12000640 1 --2- 172.21.15.8:0/1564002813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1edf0 0x564897a27a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1c12000640 1 -- 172.21.15.8:0/1564002813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 msgr2=0x564897a25bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1c12000640 1 --2- 172.21.15.8:0/1564002813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a25bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1c12000640 1 -- 172.21.15.8:0/1564002813 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564897920ab0 con 0x564897a1f710 2024-03-16T21:07:41.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1c12000640 1 --2- 172.21.15.8:0/1564002813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a23c10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1c00001eb0 tx=0x7f1c0002c640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb4b669e39529938 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.147+0000 7f1bfea00640 1 -- 172.21.15.8:0/1564002813 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00004a50 con 0x564897a1f710 2024-03-16T21:07:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.148+0000 7f1bfea00640 1 -- 172.21.15.8:0/1564002813 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5648976857e0 con 0x564897a1f710 2024-03-16T21:07:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.148+0000 7f1bfea00640 1 -- 172.21.15.8:0/1564002813 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00003850 con 0x564897a1f710 2024-03-16T21:07:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.148+0000 7f1c1c369740 1 -- 172.21.15.8:0/1564002813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 msgr2=0x564897a23c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.148+0000 7f1c1c369740 1 --2- 172.21.15.8:0/1564002813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a23c10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1c00001eb0 tx=0x7f1c0002c640 comp rx=0 tx=0).stop 2024-03-16T21:07:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.148+0000 7f1c1c369740 1 -- 172.21.15.8:0/1564002813 shutdown_connections 2024-03-16T21:07:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.148+0000 7f1c1c369740 1 --2- 172.21.15.8:0/1564002813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a25bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.148+0000 7f1c1c369740 1 --2- 172.21.15.8:0/1564002813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a23c10 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.148+0000 7f1c1c369740 1 --2- 172.21.15.8:0/1564002813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1edf0 0x564897a27a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.148+0000 7f1c1c369740 1 -- 172.21.15.8:0/1564002813 >> 172.21.15.8:0/1564002813 conn(0x564897a19520 msgr2=0x564897a186c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.148+0000 7f1c1c369740 1 -- 172.21.15.8:0/1564002813 shutdown_connections 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.148+0000 7f1c1c369740 1 -- 172.21.15.8:0/1564002813 wait complete. 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.149+0000 7f1c1c369740 1 -- start start 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.149+0000 7f1c1c369740 1 Processor -- start 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.149+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1edf0 0x564897a2fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a224c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c1c369740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a22a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c1c369740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564897a22f40 con 0x564897a282f0 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c1c369740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564897a230b0 con 0x564897a1edf0 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c1c369740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564897a23270 con 0x564897a1f710 2024-03-16T21:07:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c1c369740 10 client.0 _ll_register_callbacks cb 0x7f1c040d3400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c12000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c12a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1edf0 0x564897a2fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c12000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a224c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41816/0 (socket says 172.21.15.8:41816) 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c13400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a22a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c12a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1edf0 0x564897a2fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43350/0 (socket says 172.21.15.8:43350) 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c12000640 1 -- 172.21.15.8:0/255861433 learned_addr learned my addr 172.21.15.8:0/255861433 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c12000640 1 -- 172.21.15.8:0/255861433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1edf0 msgr2=0x564897a2fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c12000640 1 --2- 172.21.15.8:0/255861433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1edf0 0x564897a2fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c12000640 1 -- 172.21.15.8:0/255861433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 msgr2=0x564897a22a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c12000640 1 --2- 172.21.15.8:0/255861433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a22a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c12000640 1 -- 172.21.15.8:0/255861433 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648979845a0 con 0x564897a1f710 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1c12000640 1 --2- 172.21.15.8:0/255861433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a224c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1c0003f460 tx=0x7f1c000053c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b3a89cbf370ef34 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.150+0000 7f1bf3e00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1bf3e00640 1 -- 172.21.15.8:0/255861433 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00004780 con 0x564897a1f710 2024-03-16T21:07:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1bf3e00640 1 -- 172.21.15.8:0/255861433 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1c00000e40 con 0x564897a1f710 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1c1c369740 1 -- 172.21.15.8:0/255861433 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c000048e0 con 0x564897a1f710 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1bf3e00640 1 -- 172.21.15.8:0/255861433 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c000055a0 con 0x564897a1f710 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1c1c369740 10 client.27718 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1c1c369740 1 -- 172.21.15.8:0/255861433 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564897946650 con 0x564897a1f710 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1bf3e00640 1 -- 172.21.15.8:0/255861433 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1c000048e0 con 0x564897a1f710 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1bf3e00640 1 -- 172.21.15.8:0/255861433 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f1c00061070 con 0x564897a1f710 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1c1c369740 10 client.27718 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1c1c369740 10 client.27718 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1c1c369740 20 client.27718 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.151+0000 7f1c1c369740 1 --2- 172.21.15.8:0/255861433 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564897a94880 0x564897a96c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.152+0000 7f1c1c369740 4 client.27718 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.152+0000 7f1c1c369740 1 -- 172.21.15.8:0/255861433 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564897711890 con 0x564897a94880 2024-03-16T21:07:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.152+0000 7f1c12a00640 1 --2- 172.21.15.8:0/255861433 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564897a94880 0x564897a96c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.152+0000 7f1c12a00640 1 --2- 172.21.15.8:0/255861433 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564897a94880 0x564897a96c70 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ea0d8e0897ae9a5 server_cookie=eaa8530bf72ae84e in_seq=0 out_seq=0 2024-03-16T21:07:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.152+0000 7f1bf3e00640 10 client.27718 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:07:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.152+0000 7f1bf3e00640 1 -- 172.21.15.8:0/255861433 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564897711890 con 0x564897a94880 2024-03-16T21:07:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.152+0000 7f1bf3e00640 10 client.27718 handle_command_reply: tid=0 2024-03-16T21:07:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.152+0000 7f1c1c369740 1 client.27718 shutdown 2024-03-16T21:07:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1c1c369740 1 -- 172.21.15.8:0/255861433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 msgr2=0x564897a224c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1c1c369740 1 --2- 172.21.15.8:0/255861433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a224c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1c0003f460 tx=0x7f1c000053c0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1c1c369740 1 -- 172.21.15.8:0/255861433 shutdown_connections 2024-03-16T21:07:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1c1c369740 1 --2- 172.21.15.8:0/255861433 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x564897a94880 0x564897a96c70 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1c1c369740 1 --2- 172.21.15.8:0/255861433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564897a282f0 0x564897a22a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1bf3e00640 0 client.27718 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:07:41.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1c1c369740 1 --2- 172.21.15.8:0/255861433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564897a1f710 0x564897a224c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1c1c369740 1 --2- 172.21.15.8:0/255861433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564897a1edf0 0x564897a2fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1c1c369740 1 -- 172.21.15.8:0/255861433 >> 172.21.15.8:0/255861433 conn(0x564897a19520 msgr2=0x564897a1a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1c1c369740 1 -- 172.21.15.8:0/255861433 shutdown_connections 2024-03-16T21:07:41.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1c1c369740 1 -- 172.21.15.8:0/255861433 wait complete. 2024-03-16T21:07:41.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.153+0000 7f1c1c369740 20 client.27718 trim_cache size 0 max 16384 2024-03-16T21:07:41.163 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:07:41.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 -- 172.21.15.8:0/1711413167 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1bf80a1c20 msgr2=0x7f1bf80a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1bf80a1c20 0x7f1bf80a40e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0116b0 tx=0x7f1c0c009500 comp rx=0 tx=0).stop 2024-03-16T21:07:41.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 -- 172.21.15.8:0/1711413167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c14103590 msgr2=0x7f1c1419f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c14103590 0x7f1c1419f8e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400e9f0 tx=0x7f1c0400eeb0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 -- 172.21.15.8:0/1711413167 shutdown_connections 2024-03-16T21:07:41.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1bf80a1c20 0x7f1bf80a40e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c14109650 0x7f1c14199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14103f50 0x7f1c1419fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 --2- 172.21.15.8:0/1711413167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c14103590 0x7f1c1419f8e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 -- 172.21.15.8:0/1711413167 >> 172.21.15.8:0/1711413167 conn(0x7f1c140ff020 msgr2=0x7f1c14100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 -- 172.21.15.8:0/1711413167 shutdown_connections 2024-03-16T21:07:41.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.154+0000 7f1c13e00640 1 -- 172.21.15.8:0/1711413167 wait complete. 2024-03-16T21:07:41.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:41 smithi008 ceph-mon[31434]: pgmap v304: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:41.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:41 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/542827177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:07:41.177 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:07:41.177 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:07:41.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:41 smithi170 ceph-mon[35947]: pgmap v304: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:41.369 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:41 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/542827177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:07:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.387+0000 7fea5f200640 1 -- 172.21.15.8:0/3171107563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea60075a20 msgr2=0x7fea60075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.387+0000 7fea5f200640 1 --2- 172.21.15.8:0/3171107563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea60075a20 0x7fea60075e00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fea50009930 tx=0x7fea5002bc20 comp rx=0 tx=0).stop 2024-03-16T21:07:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.387+0000 7fea5f200640 1 -- 172.21.15.8:0/3171107563 shutdown_connections 2024-03-16T21:07:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.387+0000 7fea5f200640 1 --2- 172.21.15.8:0/3171107563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea60112210 0x7fea60114600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.387+0000 7fea5f200640 1 --2- 172.21.15.8:0/3171107563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea60076340 0x7fea60111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.387+0000 7fea5f200640 1 --2- 172.21.15.8:0/3171107563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea60075a20 0x7fea60075e00 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.387+0000 7fea5f200640 1 -- 172.21.15.8:0/3171107563 >> 172.21.15.8:0/3171107563 conn(0x7fea600ff000 msgr2=0x7fea60101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.387+0000 7fea5f200640 1 -- 172.21.15.8:0/3171107563 shutdown_connections 2024-03-16T21:07:41.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.387+0000 7fea5f200640 1 -- 172.21.15.8:0/3171107563 wait complete. 2024-03-16T21:07:41.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:41 smithi186 ceph-mon[36391]: pgmap v304: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:41.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:41 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/542827177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:07:41.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.388+0000 7fea5f200640 1 Processor -- start 2024-03-16T21:07:41.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.388+0000 7fea5f200640 1 -- start start 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.388+0000 7fea5f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea60075a20 0x7fea6019e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.388+0000 7fea5f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea60076340 0x7fea6019e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.388+0000 7fea5f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea60112210 0x7fea601a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.388+0000 7fea5f200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea601a3300 con 0x7fea60076340 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.388+0000 7fea5f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea601a3470 con 0x7fea60112210 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.388+0000 7fea5f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea601a3630 con 0x7fea60075a20 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea60075a20 0x7fea6019e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea60075a20 0x7fea6019e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41840/0 (socket says 172.21.15.8:41840) 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5de00640 1 -- 172.21.15.8:0/3412148932 learned_addr learned my addr 172.21.15.8:0/3412148932 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5d400640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea60076340 0x7fea6019e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5e800640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea60112210 0x7fea601a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5de00640 1 -- 172.21.15.8:0/3412148932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea60112210 msgr2=0x7fea601a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5de00640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea60112210 0x7fea601a2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5de00640 1 -- 172.21.15.8:0/3412148932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea60076340 msgr2=0x7fea6019e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5de00640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea60076340 0x7fea6019e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5de00640 1 -- 172.21.15.8:0/3412148932 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea58009840 con 0x7fea60075a20 2024-03-16T21:07:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5e800640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea60112210 0x7fea601a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.389+0000 7fea5de00640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea60075a20 0x7fea6019e440 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fea50005ab0 tx=0x7fea5002cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.390+0000 7fea56a00640 1 -- 172.21.15.8:0/3412148932 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50004250 con 0x7fea60075a20 2024-03-16T21:07:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.390+0000 7fea56a00640 1 -- 172.21.15.8:0/3412148932 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fea500043b0 con 0x7fea60075a20 2024-03-16T21:07:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.390+0000 7fea5f200640 1 -- 172.21.15.8:0/3412148932 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea50009560 con 0x7fea60075a20 2024-03-16T21:07:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.390+0000 7fea56a00640 1 -- 172.21.15.8:0/3412148932 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50003ab0 con 0x7fea60075a20 2024-03-16T21:07:41.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.390+0000 7fea5f200640 1 -- 172.21.15.8:0/3412148932 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea601aafb0 con 0x7fea60075a20 2024-03-16T21:07:41.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.393+0000 7fea679a6740 1 Processor -- start 2024-03-16T21:07:41.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.393+0000 7fea56a00640 1 -- 172.21.15.8:0/3412148932 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fea500053a0 con 0x7fea60075a20 2024-03-16T21:07:41.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.393+0000 7fea679a6740 1 -- start start 2024-03-16T21:07:41.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.394+0000 7fea679a6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 0x562e9e3581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.394+0000 7fea679a6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e360db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.394+0000 7fea679a6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 0x562e9e3636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.394+0000 7fea679a6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e2c6210 con 0x562e9e3612f0 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.394+0000 7fea679a6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e2c3740 con 0x562e9e357df0 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.394+0000 7fea679a6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e2bef20 con 0x562e9e358710 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.394+0000 7fea5e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 0x562e9e3581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.394+0000 7fea5de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e360db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.394+0000 7fea5e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 0x562e9e3581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43364/0 (socket says 172.21.15.8:43364) 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.394+0000 7fea5e800640 1 -- 172.21.15.8:0/1069787497 learned_addr learned my addr 172.21.15.8:0/1069787497 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.394+0000 7fea5d400640 1 --2- 172.21.15.8:0/1069787497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 0x562e9e3636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea5e800640 1 -- 172.21.15.8:0/1069787497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 msgr2=0x562e9e360db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea5e800640 1 --2- 172.21.15.8:0/1069787497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e360db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea5e800640 1 -- 172.21.15.8:0/1069787497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 msgr2=0x562e9e3636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea5e800640 1 --2- 172.21.15.8:0/1069787497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 0x562e9e3636e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea5e800640 1 -- 172.21.15.8:0/1069787497 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e9e280df0 con 0x562e9e357df0 2024-03-16T21:07:41.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea5de00640 1 --2- 172.21.15.8:0/1069787497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e360db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:41.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea5d400640 1 --2- 172.21.15.8:0/1069787497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 0x562e9e3636e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:41.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea5e800640 1 --2- 172.21.15.8:0/1069787497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 0x562e9e3581d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fea5800e890 tx=0x7fea5800ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac53fc724a780ce8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea4b000640 1 -- 172.21.15.8:0/1069787497 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58011c20 con 0x562e9e357df0 2024-03-16T21:07:41.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea56a00640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea440a1c20 0x7fea440a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea4b000640 1 -- 172.21.15.8:0/1069787497 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fea58003e70 con 0x562e9e357df0 2024-03-16T21:07:41.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.395+0000 7fea4b000640 1 -- 172.21.15.8:0/1069787497 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58019430 con 0x562e9e357df0 2024-03-16T21:07:41.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea56a00640 1 -- 172.21.15.8:0/3412148932 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fea500efc50 con 0x7fea60075a20 2024-03-16T21:07:41.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea5de00640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea440a1c20 0x7fea440a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea679a6740 1 -- 172.21.15.8:0/1069787497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 msgr2=0x562e9e3581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea679a6740 1 --2- 172.21.15.8:0/1069787497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 0x562e9e3581d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fea5800e890 tx=0x7fea5800ed50 comp rx=0 tx=0).stop 2024-03-16T21:07:41.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea679a6740 1 -- 172.21.15.8:0/1069787497 shutdown_connections 2024-03-16T21:07:41.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea679a6740 1 --2- 172.21.15.8:0/1069787497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 0x562e9e3636e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea679a6740 1 --2- 172.21.15.8:0/1069787497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e360db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea679a6740 1 --2- 172.21.15.8:0/1069787497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 0x562e9e3581d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea679a6740 1 -- 172.21.15.8:0/1069787497 >> 172.21.15.8:0/1069787497 conn(0x562e9e352520 msgr2=0x562e9e352900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea679a6740 1 -- 172.21.15.8:0/1069787497 shutdown_connections 2024-03-16T21:07:41.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea679a6740 1 -- 172.21.15.8:0/1069787497 wait complete. 2024-03-16T21:07:41.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.396+0000 7fea5de00640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea440a1c20 0x7fea440a40e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x562e9e3578c0 tx=0x7fea500f36c0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.397+0000 7fea679a6740 1 -- start start 2024-03-16T21:07:41.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.397+0000 7fea679a6740 1 Processor -- start 2024-03-16T21:07:41.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.397+0000 7fea679a6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 0x562e9e35e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.397+0000 7fea679a6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.397+0000 7fea679a6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e3612f0 0x562e9e35edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.397+0000 7fea679a6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e264150 con 0x562e9e357df0 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.397+0000 7fea679a6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e263df0 con 0x562e9e3612f0 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.397+0000 7fea679a6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e02d1c0 con 0x562e9e358710 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea679a6740 10 client.0 _ll_register_callbacks cb 0x562e9e2b32b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 0x562e9e35e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 0x562e9e35e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58576/0 (socket says 172.21.15.8:58576) 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41864/0 (socket says 172.21.15.8:41864) 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5d400640 1 -- 172.21.15.8:0/1625590504 learned_addr learned my addr 172.21.15.8:0/1625590504 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5e800640 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e3612f0 0x562e9e35edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5d400640 1 -- 172.21.15.8:0/1625590504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e3612f0 msgr2=0x562e9e35edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5d400640 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e3612f0 0x562e9e35edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5d400640 1 -- 172.21.15.8:0/1625590504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 msgr2=0x562e9e35e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5d400640 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 0x562e9e35e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5d400640 1 -- 172.21.15.8:0/1625590504 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5800e540 con 0x562e9e358710 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5e800640 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e3612f0 0x562e9e35edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea5d400640 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35e880 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fea4c012730 tx=0x7fea4c012bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4963fac3e03a1a89 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.398+0000 7fea3f400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.399+0000 7fea3f400640 1 -- 172.21.15.8:0/1625590504 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c017070 con 0x562e9e358710 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.399+0000 7fea3f400640 1 -- 172.21.15.8:0/1625590504 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fea4c012e40 con 0x562e9e358710 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.399+0000 7fea679a6740 1 -- 172.21.15.8:0/1625590504 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e9dfbe7e0 con 0x562e9e358710 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.399+0000 7fea3f400640 1 -- 172.21.15.8:0/1625590504 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea4c004030 con 0x562e9e358710 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.399+0000 7fea679a6740 10 client.27730 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.399+0000 7fea679a6740 1 -- 172.21.15.8:0/1625590504 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562e9e2bd5a0 con 0x562e9e358710 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.399+0000 7fea3f400640 1 -- 172.21.15.8:0/1625590504 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x562e9dfbe7e0 con 0x562e9e358710 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.399+0000 7fea3f400640 1 -- 172.21.15.8:0/1625590504 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fea4c0038f0 con 0x562e9e358710 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.400+0000 7fea679a6740 10 client.27730 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.400+0000 7fea679a6740 10 client.27730 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.400+0000 7fea679a6740 20 client.27730 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.400+0000 7fea679a6740 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562e9e371410 0x562e9e373830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.400+0000 7fea679a6740 4 client.27730 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.400+0000 7fea679a6740 1 -- 172.21.15.8:0/1625590504 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e9dffb720 con 0x562e9e371410 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.400+0000 7fea5e800640 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562e9e371410 0x562e9e373830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.400+0000 7fea5e800640 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562e9e371410 0x562e9e373830 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f1951e3723a7e68 server_cookie=917d615cb712db04 in_seq=0 out_seq=0 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.400+0000 7fea3f400640 10 client.27730 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.401+0000 7fea3f400640 1 -- 172.21.15.8:0/1625590504 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x562e9dffb720 con 0x562e9e371410 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.401+0000 7fea3f400640 10 client.27730 handle_command_reply: tid=0 2024-03-16T21:07:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.401+0000 7fea679a6740 1 client.27730 shutdown 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.401+0000 7fea679a6740 1 -- 172.21.15.8:0/1625590504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 msgr2=0x562e9e35e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.401+0000 7fea679a6740 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35e880 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fea4c012730 tx=0x7fea4c012bf0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.401+0000 7fea679a6740 1 -- 172.21.15.8:0/1625590504 shutdown_connections 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.401+0000 7fea679a6740 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562e9e371410 0x562e9e373830 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.401+0000 7fea679a6740 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e3612f0 0x562e9e35edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.401+0000 7fea679a6740 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35e880 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.402+0000 7fea679a6740 1 --2- 172.21.15.8:0/1625590504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 0x562e9e35e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.402+0000 7fea3f400640 0 client.27730 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.402+0000 7fea679a6740 1 -- 172.21.15.8:0/1625590504 >> 172.21.15.8:0/1625590504 conn(0x562e9e352520 msgr2=0x562e9e354270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.402+0000 7fea679a6740 1 -- 172.21.15.8:0/1625590504 shutdown_connections 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.402+0000 7fea679a6740 1 -- 172.21.15.8:0/1625590504 wait complete. 2024-03-16T21:07:41.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.402+0000 7fea679a6740 20 client.27730 trim_cache size 0 max 16384 2024-03-16T21:07:41.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.416+0000 7fea679a6740 1 Processor -- start 2024-03-16T21:07:41.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.416+0000 7fea679a6740 1 -- start start 2024-03-16T21:07:41.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.416+0000 7fea679a6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 0x562e9e360a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.416+0000 7fea679a6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e36c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.416+0000 7fea679a6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 0x562e9e36cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.416+0000 7fea679a6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e35f690 con 0x562e9e3612f0 2024-03-16T21:07:41.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.416+0000 7fea679a6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e35e130 con 0x562e9e357df0 2024-03-16T21:07:41.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.416+0000 7fea679a6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e353520 con 0x562e9e358710 2024-03-16T21:07:41.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e36c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e36c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41880/0 (socket says 172.21.15.8:41880) 2024-03-16T21:07:41.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 0x562e9e360a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5d400640 1 -- 172.21.15.8:0/569706985 learned_addr learned my addr 172.21.15.8:0/569706985 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5e800640 1 --2- 172.21.15.8:0/569706985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 0x562e9e36cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5d400640 1 -- 172.21.15.8:0/569706985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 msgr2=0x562e9e360a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5d400640 1 --2- 172.21.15.8:0/569706985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 0x562e9e360a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5d400640 1 -- 172.21.15.8:0/569706985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 msgr2=0x562e9e36cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5d400640 1 --2- 172.21.15.8:0/569706985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 0x562e9e36cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5d400640 1 -- 172.21.15.8:0/569706985 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e9e259ab0 con 0x562e9e358710 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5e800640 1 --2- 172.21.15.8:0/569706985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 0x562e9e36cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea5d400640 1 --2- 172.21.15.8:0/569706985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e36c6a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fea4c003d00 tx=0x7fea4c0096f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddf44583a8321851 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.417+0000 7fea4a600640 1 -- 172.21.15.8:0/569706985 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c017040 con 0x562e9e358710 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.418+0000 7fea4a600640 1 -- 172.21.15.8:0/569706985 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fea4c0039f0 con 0x562e9e358710 2024-03-16T21:07:41.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.418+0000 7fea4a600640 1 -- 172.21.15.8:0/569706985 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c010690 con 0x562e9e358710 2024-03-16T21:07:41.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.418+0000 7fea679a6740 1 -- 172.21.15.8:0/569706985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 msgr2=0x562e9e36c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.418+0000 7fea679a6740 1 --2- 172.21.15.8:0/569706985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e36c6a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fea4c003d00 tx=0x7fea4c0096f0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.418+0000 7fea679a6740 1 -- 172.21.15.8:0/569706985 shutdown_connections 2024-03-16T21:07:41.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.418+0000 7fea679a6740 1 --2- 172.21.15.8:0/569706985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e3612f0 0x562e9e36cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.418+0000 7fea679a6740 1 --2- 172.21.15.8:0/569706985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e36c6a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.418+0000 7fea679a6740 1 --2- 172.21.15.8:0/569706985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e357df0 0x562e9e360a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.418+0000 7fea679a6740 1 -- 172.21.15.8:0/569706985 >> 172.21.15.8:0/569706985 conn(0x562e9e352520 msgr2=0x562e9e3516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.418+0000 7fea679a6740 1 -- 172.21.15.8:0/569706985 shutdown_connections 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.419+0000 7fea679a6740 1 -- 172.21.15.8:0/569706985 wait complete. 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.419+0000 7fea679a6740 1 -- start start 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.419+0000 7fea679a6740 1 Processor -- start 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea679a6740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 0x562e9e368c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea679a6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea679a6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e3612f0 0x562e9e35b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea679a6740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e369500 con 0x562e9e357df0 2024-03-16T21:07:41.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea679a6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e35beb0 con 0x562e9e3612f0 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea679a6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e9e35c070 con 0x562e9e358710 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea679a6740 10 client.0 _ll_register_callbacks cb 0x7fea4c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea5e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 0x562e9e368c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea5d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea5e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 0x562e9e368c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58586/0 (socket says 172.21.15.8:58586) 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea5e800640 1 -- 172.21.15.8:0/3009983403 learned_addr learned my addr 172.21.15.8:0/3009983403 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea5d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41890/0 (socket says 172.21.15.8:41890) 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea5e800640 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e3612f0 0x562e9e35b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea5d400640 1 -- 172.21.15.8:0/3009983403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e3612f0 msgr2=0x562e9e35b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea5d400640 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e3612f0 0x562e9e35b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea5d400640 1 -- 172.21.15.8:0/3009983403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 msgr2=0x562e9e368c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea5d400640 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 0x562e9e368c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.420+0000 7fea5d400640 1 -- 172.21.15.8:0/3009983403 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e9e2bd5a0 con 0x562e9e358710 2024-03-16T21:07:41.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.421+0000 7fea5e800640 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 0x562e9e368c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.421+0000 7fea5d400640 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35b430 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x562e9e363fe0 tx=0x7fea4c009280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f0915fa1ee1f896 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.421+0000 7fea3f400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.421+0000 7fea3f400640 1 -- 172.21.15.8:0/3009983403 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c032060 con 0x562e9e358710 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.421+0000 7fea679a6740 1 -- 172.21.15.8:0/3009983403 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea58003e70 con 0x562e9e358710 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.421+0000 7fea3f400640 1 -- 172.21.15.8:0/3009983403 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fea4c000e40 con 0x562e9e358710 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.421+0000 7fea3f400640 1 -- 172.21.15.8:0/3009983403 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea4c017070 con 0x562e9e358710 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.421+0000 7fea679a6740 10 client.27736 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.421+0000 7fea679a6740 1 -- 172.21.15.8:0/3009983403 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562e9e27f650 con 0x562e9e358710 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.422+0000 7fea3f400640 1 -- 172.21.15.8:0/3009983403 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fea58003e70 con 0x562e9e358710 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.422+0000 7fea3f400640 1 -- 172.21.15.8:0/3009983403 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fea4c036ce0 con 0x562e9e358710 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.422+0000 7fea679a6740 10 client.27736 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.422+0000 7fea679a6740 10 client.27736 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.422+0000 7fea679a6740 20 client.27736 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.422+0000 7fea679a6740 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562e9e3cde40 0x562e9e3d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.422+0000 7fea679a6740 4 client.27736 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.422+0000 7fea679a6740 1 -- 172.21.15.8:0/3009983403 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562e9e04a890 con 0x562e9e3cde40 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.422+0000 7fea5e800640 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562e9e3cde40 0x562e9e3d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea5e800640 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562e9e3cde40 0x562e9e3d0230 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a8453d9e928ea51c server_cookie=5a42d91e4c6ec180 in_seq=0 out_seq=0 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea3f400640 10 client.27736 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea3f400640 1 -- 172.21.15.8:0/3009983403 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562e9e04a890 con 0x562e9e3cde40 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea3f400640 10 client.27736 handle_command_reply: tid=0 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 1 client.27736 shutdown 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 1 -- 172.21.15.8:0/3009983403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 msgr2=0x562e9e35b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35b430 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x562e9e363fe0 tx=0x7fea4c009280 comp rx=0 tx=0).stop 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 1 -- 172.21.15.8:0/3009983403 shutdown_connections 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x562e9e3cde40 0x562e9e3d0230 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e9e3612f0 0x562e9e35b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562e9e358710 0x562e9e35b430 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea3f400640 0 client.27736 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:07:41.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 1 --2- 172.21.15.8:0/3009983403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e9e357df0 0x562e9e368c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 1 -- 172.21.15.8:0/3009983403 >> 172.21.15.8:0/3009983403 conn(0x562e9e352520 msgr2=0x562e9e35e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 1 -- 172.21.15.8:0/3009983403 shutdown_connections 2024-03-16T21:07:41.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 1 -- 172.21.15.8:0/3009983403 wait complete. 2024-03-16T21:07:41.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.423+0000 7fea679a6740 20 client.27736 trim_cache size 0 max 16384 2024-03-16T21:07:41.434 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:07:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 -- 172.21.15.8:0/3412148932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea440a1c20 msgr2=0x7fea440a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea440a1c20 0x7fea440a40e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x562e9e3578c0 tx=0x7fea500f36c0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 -- 172.21.15.8:0/3412148932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea60075a20 msgr2=0x7fea6019e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea60075a20 0x7fea6019e440 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fea50005ab0 tx=0x7fea5002cc10 comp rx=0 tx=0).stop 2024-03-16T21:07:41.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 -- 172.21.15.8:0/3412148932 shutdown_connections 2024-03-16T21:07:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fea440a1c20 0x7fea440a40e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea60112210 0x7fea601a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea60076340 0x7fea6019e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 --2- 172.21.15.8:0/3412148932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea60075a20 0x7fea6019e440 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 -- 172.21.15.8:0/3412148932 >> 172.21.15.8:0/3412148932 conn(0x7fea600ff000 msgr2=0x7fea60112f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 -- 172.21.15.8:0/3412148932 shutdown_connections 2024-03-16T21:07:41.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.424+0000 7fea5f200640 1 -- 172.21.15.8:0/3412148932 wait complete. 2024-03-16T21:07:41.447 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:07:41.447 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:07:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.664+0000 7f3c4e200640 1 -- 172.21.15.8:0/3745205731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c48103f50 msgr2=0x7f3c48110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.664+0000 7f3c4e200640 1 --2- 172.21.15.8:0/3745205731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c48103f50 0x7f3c48110410 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009cd0 tx=0x7f3c4002c0e0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.664+0000 7f3c4e200640 1 -- 172.21.15.8:0/3745205731 shutdown_connections 2024-03-16T21:07:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.664+0000 7f3c4e200640 1 --2- 172.21.15.8:0/3745205731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c48103f50 0x7f3c48110410 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.664+0000 7f3c4e200640 1 --2- 172.21.15.8:0/3745205731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c48103590 0x7f3c48103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.664+0000 7f3c4e200640 1 --2- 172.21.15.8:0/3745205731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c48109650 0x7f3c48109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.664+0000 7f3c4e200640 1 -- 172.21.15.8:0/3745205731 >> 172.21.15.8:0/3745205731 conn(0x7f3c480ff020 msgr2=0x7f3c48101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.664+0000 7f3c4e200640 1 -- 172.21.15.8:0/3745205731 shutdown_connections 2024-03-16T21:07:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.664+0000 7f3c4e200640 1 -- 172.21.15.8:0/3745205731 wait complete. 2024-03-16T21:07:41.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.665+0000 7f3c4e200640 1 Processor -- start 2024-03-16T21:07:41.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.665+0000 7f3c4e200640 1 -- start start 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.665+0000 7f3c4e200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c48103590 0x7f3c4819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.665+0000 7f3c4e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c48103f50 0x7f3c4819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.665+0000 7f3c4e200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c48109650 0x7f3c48199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.665+0000 7f3c4e200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4819a0a0 con 0x7f3c48103f50 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.665+0000 7f3c4e200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4819a210 con 0x7f3c48109650 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.665+0000 7f3c4e200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4819a3d0 con 0x7f3c48103590 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c4ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c48103590 0x7f3c4819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c4ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c48103590 0x7f3c4819f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41908/0 (socket says 172.21.15.8:41908) 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c4ce00640 1 -- 172.21.15.8:0/2225906872 learned_addr learned my addr 172.21.15.8:0/2225906872 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c4d800640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c48109650 0x7f3c48199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c47e00640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c48103f50 0x7f3c4819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c4ce00640 1 -- 172.21.15.8:0/2225906872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c48109650 msgr2=0x7f3c48199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c48109650 0x7f3c48199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c4ce00640 1 -- 172.21.15.8:0/2225906872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c48103f50 msgr2=0x7f3c4819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c48103f50 0x7f3c4819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c4ce00640 1 -- 172.21.15.8:0/2225906872 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40009900 con 0x7f3c48103590 2024-03-16T21:07:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c4d800640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c48109650 0x7f3c48199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.666+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c48103590 0x7f3c4819f8a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00d950 tx=0x7f3c3c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.667+0000 7f3c45600640 1 -- 172.21.15.8:0/2225906872 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c009c30 con 0x7f3c48103590 2024-03-16T21:07:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.667+0000 7f3c45600640 1 -- 172.21.15.8:0/2225906872 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3c3c009d90 con 0x7f3c48103590 2024-03-16T21:07:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.667+0000 7f3c4e200640 1 -- 172.21.15.8:0/2225906872 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4819a6b0 con 0x7f3c48103590 2024-03-16T21:07:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.667+0000 7f3c45600640 1 -- 172.21.15.8:0/2225906872 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00f880 con 0x7f3c48103590 2024-03-16T21:07:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.667+0000 7f3c4e200640 1 -- 172.21.15.8:0/2225906872 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c481a6940 con 0x7f3c48103590 2024-03-16T21:07:41.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.670+0000 7f3c525e9740 1 Processor -- start 2024-03-16T21:07:41.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.670+0000 7f3c525e9740 1 -- start start 2024-03-16T21:07:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55607870fdf0 0x5560787101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 0x556078718db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 0x55607871b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c525e9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607867e210 con 0x55607870fdf0 2024-03-16T21:07:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c525e9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607867b740 con 0x556078710710 2024-03-16T21:07:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c525e9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556078676f20 con 0x5560787192f0 2024-03-16T21:07:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c45600640 1 -- 172.21.15.8:0/2225906872 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f3c3c010b80 con 0x7f3c48103590 2024-03-16T21:07:41.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c4d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55607870fdf0 0x5560787101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c47e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 0x55607871b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c4d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55607870fdf0 0x5560787101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58616/0 (socket says 172.21.15.8:58616) 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c47e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 0x55607871b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41912/0 (socket says 172.21.15.8:41912) 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c4d800640 1 -- 172.21.15.8:0/670001995 learned_addr learned my addr 172.21.15.8:0/670001995 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/670001995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 0x556078718db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c47e00640 1 -- 172.21.15.8:0/670001995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 msgr2=0x556078718db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c47e00640 1 --2- 172.21.15.8:0/670001995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 0x556078718db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c47e00640 1 -- 172.21.15.8:0/670001995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55607870fdf0 msgr2=0x5560787101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c47e00640 1 --2- 172.21.15.8:0/670001995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55607870fdf0 0x5560787101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.671+0000 7f3c47e00640 1 -- 172.21.15.8:0/670001995 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556078638df0 con 0x5560787192f0 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.672+0000 7f3c47e00640 1 --2- 172.21.15.8:0/670001995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 0x55607871b6e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3c4819b240 tx=0x7f3c34011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=354c7f930d65d376 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.672+0000 7f3c3a000640 1 -- 172.21.15.8:0/670001995 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34004230 con 0x5560787192f0 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.672+0000 7f3c3a000640 1 -- 172.21.15.8:0/670001995 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3c34009e10 con 0x5560787192f0 2024-03-16T21:07:41.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.672+0000 7f3c3a000640 1 -- 172.21.15.8:0/670001995 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34004d70 con 0x5560787192f0 2024-03-16T21:07:41.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.672+0000 7f3c45600640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3c300a1ba0 0x7f3c300a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.672+0000 7f3c45600640 1 -- 172.21.15.8:0/2225906872 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3c3c0cd460 con 0x7f3c48103590 2024-03-16T21:07:41.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.673+0000 7f3c4d800640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3c300a1ba0 0x7f3c300a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.673+0000 7f3c525e9740 1 -- 172.21.15.8:0/670001995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 msgr2=0x55607871b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.673+0000 7f3c525e9740 1 --2- 172.21.15.8:0/670001995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 0x55607871b6e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3c4819b240 tx=0x7f3c34011810 comp rx=0 tx=0).stop 2024-03-16T21:07:41.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.673+0000 7f3c525e9740 1 -- 172.21.15.8:0/670001995 shutdown_connections 2024-03-16T21:07:41.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.673+0000 7f3c525e9740 1 --2- 172.21.15.8:0/670001995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 0x55607871b6e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.673+0000 7f3c525e9740 1 --2- 172.21.15.8:0/670001995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 0x556078718db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.673+0000 7f3c525e9740 1 --2- 172.21.15.8:0/670001995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55607870fdf0 0x5560787101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.673+0000 7f3c525e9740 1 -- 172.21.15.8:0/670001995 >> 172.21.15.8:0/670001995 conn(0x55607870a520 msgr2=0x55607870a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.673+0000 7f3c525e9740 1 -- 172.21.15.8:0/670001995 shutdown_connections 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.673+0000 7f3c525e9740 1 -- 172.21.15.8:0/670001995 wait complete. 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.673+0000 7f3c4d800640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3c300a1ba0 0x7f3c300a4060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c40006010 tx=0x7f3c40005d80 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.674+0000 7f3c525e9740 1 -- start start 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.674+0000 7f3c525e9740 1 Processor -- start 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.674+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078716350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.674+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556078710710 0x556078716890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.674+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5560787192f0 0x556078716dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.674+0000 7f3c525e9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607861c150 con 0x5560787192f0 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.674+0000 7f3c525e9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607861bdf0 con 0x55607870fdf0 2024-03-16T21:07:41.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.674+0000 7f3c525e9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560783e51c0 con 0x556078710710 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c525e9740 10 client.0 _ll_register_callbacks cb 0x55607866b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c4ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078716350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c47e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556078710710 0x556078716890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c47e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556078710710 0x556078716890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41916/0 (socket says 172.21.15.8:41916) 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c4ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078716350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43434/0 (socket says 172.21.15.8:43434) 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c47e00640 1 -- 172.21.15.8:0/3704013148 learned_addr learned my addr 172.21.15.8:0/3704013148 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c4d800640 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5560787192f0 0x556078716dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c47e00640 1 -- 172.21.15.8:0/3704013148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 msgr2=0x556078716350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c47e00640 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078716350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c47e00640 1 -- 172.21.15.8:0/3704013148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5560787192f0 msgr2=0x556078716dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c47e00640 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5560787192f0 0x556078716dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c47e00640 1 -- 172.21.15.8:0/3704013148 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c34009830 con 0x556078710710 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078716350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.675+0000 7f3c47e00640 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556078710710 0x556078716890 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3c34019ac0 tx=0x7f3c34019af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=418b4a35b93e1dcb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.676+0000 7f3c2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.676+0000 7f3c2ea00640 1 -- 172.21.15.8:0/3704013148 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400e7c0 con 0x556078710710 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.676+0000 7f3c525e9740 1 -- 172.21.15.8:0/3704013148 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560783767e0 con 0x556078710710 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.676+0000 7f3c2ea00640 1 -- 172.21.15.8:0/3704013148 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3c340046c0 con 0x556078710710 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.676+0000 7f3c2ea00640 1 -- 172.21.15.8:0/3704013148 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c3400e920 con 0x556078710710 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.676+0000 7f3c525e9740 10 client.27748 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.676+0000 7f3c525e9740 1 -- 172.21.15.8:0/3704013148 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5560786755a0 con 0x556078710710 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.676+0000 7f3c2ea00640 1 -- 172.21.15.8:0/3704013148 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5560783767e0 con 0x556078710710 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.677+0000 7f3c2ea00640 1 -- 172.21.15.8:0/3704013148 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f3c3402d3b0 con 0x556078710710 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.677+0000 7f3c525e9740 10 client.27748 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.677+0000 7f3c525e9740 10 client.27748 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:41.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.677+0000 7f3c525e9740 20 client.27748 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.677+0000 7f3c525e9740 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5560787292f0 0x55607872b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.677+0000 7f3c525e9740 4 client.27748 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.677+0000 7f3c525e9740 1 -- 172.21.15.8:0/3704013148 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560783b3720 con 0x5560787292f0 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.677+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5560787292f0 0x55607872b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.678+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5560787292f0 0x55607872b710 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=702a4fe813208c5c server_cookie=5acf52c1d74895d3 in_seq=0 out_seq=0 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.678+0000 7f3c2ea00640 10 client.27748 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.678+0000 7f3c2ea00640 1 -- 172.21.15.8:0/3704013148 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x7f3c3c07f4b0 con 0x5560787292f0 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.678+0000 7f3c2ea00640 10 client.27748 handle_command_reply: tid=0 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.678+0000 7f3c525e9740 1 client.27748 shutdown 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.678+0000 7f3c525e9740 1 -- 172.21.15.8:0/3704013148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556078710710 msgr2=0x556078716890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.678+0000 7f3c525e9740 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556078710710 0x556078716890 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3c34019ac0 tx=0x7f3c34019af0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.679+0000 7f3c525e9740 1 -- 172.21.15.8:0/3704013148 shutdown_connections 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.679+0000 7f3c525e9740 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x5560787292f0 0x55607872b710 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.679+0000 7f3c525e9740 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5560787192f0 0x556078716dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.679+0000 7f3c525e9740 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556078710710 0x556078716890 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.679+0000 7f3c525e9740 1 --2- 172.21.15.8:0/3704013148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078716350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.679+0000 7f3c2ea00640 0 client.27748 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.679+0000 7f3c525e9740 1 -- 172.21.15.8:0/3704013148 >> 172.21.15.8:0/3704013148 conn(0x55607870a520 msgr2=0x55607870c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.679+0000 7f3c525e9740 1 -- 172.21.15.8:0/3704013148 shutdown_connections 2024-03-16T21:07:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.679+0000 7f3c525e9740 1 -- 172.21.15.8:0/3704013148 wait complete. 2024-03-16T21:07:41.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.679+0000 7f3c525e9740 20 client.27748 trim_cache size 0 max 16384 2024-03-16T21:07:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.693+0000 7f3c525e9740 1 Processor -- start 2024-03-16T21:07:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.693+0000 7f3c525e9740 1 -- start start 2024-03-16T21:07:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.693+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078718a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.693+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556078710710 0x556078716bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.693+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 0x556078724670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.693+0000 7f3c525e9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607870a050 con 0x556078710710 2024-03-16T21:07:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.693+0000 7f3c525e9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556078705df0 con 0x55607870fdf0 2024-03-16T21:07:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.693+0000 7f3c525e9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560787148a0 con 0x5560787192f0 2024-03-16T21:07:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c4ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078718a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c47e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556078710710 0x556078716bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c4ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078718a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43446/0 (socket says 172.21.15.8:43446) 2024-03-16T21:07:41.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c4ce00640 1 -- 172.21.15.8:0/3431611554 learned_addr learned my addr 172.21.15.8:0/3431611554 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c4d800640 1 --2- 172.21.15.8:0/3431611554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 0x556078724670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c4ce00640 1 -- 172.21.15.8:0/3431611554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 msgr2=0x556078724670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/3431611554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 0x556078724670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c4ce00640 1 -- 172.21.15.8:0/3431611554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556078710710 msgr2=0x556078716bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/3431611554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556078710710 0x556078716bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c4ce00640 1 -- 172.21.15.8:0/3431611554 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556078611ab0 con 0x55607870fdf0 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/3431611554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078718a80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c096540 tx=0x7f3c3c010f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72a6362431c2954 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c39600640 1 -- 172.21.15.8:0/3431611554 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c099a40 con 0x55607870fdf0 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c39600640 1 -- 172.21.15.8:0/3431611554 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5560783b3720 con 0x55607870fdf0 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.694+0000 7f3c39600640 1 -- 172.21.15.8:0/3431611554 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0cadd0 con 0x55607870fdf0 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.695+0000 7f3c525e9740 1 -- 172.21.15.8:0/3431611554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 msgr2=0x556078718a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.695+0000 7f3c525e9740 1 --2- 172.21.15.8:0/3431611554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078718a80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c096540 tx=0x7f3c3c010f20 comp rx=0 tx=0).stop 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.695+0000 7f3c525e9740 1 -- 172.21.15.8:0/3431611554 shutdown_connections 2024-03-16T21:07:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.695+0000 7f3c525e9740 1 --2- 172.21.15.8:0/3431611554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5560787192f0 0x556078724670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.695+0000 7f3c525e9740 1 --2- 172.21.15.8:0/3431611554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556078710710 0x556078716bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.695+0000 7f3c525e9740 1 --2- 172.21.15.8:0/3431611554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55607870fdf0 0x556078718a80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.695+0000 7f3c525e9740 1 -- 172.21.15.8:0/3431611554 >> 172.21.15.8:0/3431611554 conn(0x55607870a520 msgr2=0x5560787096c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.695+0000 7f3c525e9740 1 -- 172.21.15.8:0/3431611554 shutdown_connections 2024-03-16T21:07:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.695+0000 7f3c525e9740 1 -- 172.21.15.8:0/3431611554 wait complete. 2024-03-16T21:07:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.695+0000 7f3c525e9740 1 -- start start 2024-03-16T21:07:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c525e9740 1 Processor -- start 2024-03-16T21:07:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55607870fdf0 0x556078720c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 0x55607871cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c525e9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5560787192f0 0x55607871d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c525e9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556078721510 con 0x5560787192f0 2024-03-16T21:07:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c525e9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607871da40 con 0x556078710710 2024-03-16T21:07:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c525e9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55607871dc00 con 0x55607870fdf0 2024-03-16T21:07:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c525e9740 10 client.0 _ll_register_callbacks cb 0x7f3c34005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c47e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 0x55607871cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c47e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 0x55607871cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43456/0 (socket says 172.21.15.8:43456) 2024-03-16T21:07:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c4ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55607870fdf0 0x556078720c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.696+0000 7f3c47e00640 1 -- 172.21.15.8:0/1281425231 learned_addr learned my addr 172.21.15.8:0/1281425231 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c4d800640 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5560787192f0 0x55607871d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c47e00640 1 -- 172.21.15.8:0/1281425231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55607870fdf0 msgr2=0x556078720c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c47e00640 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55607870fdf0 0x556078720c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c47e00640 1 -- 172.21.15.8:0/1281425231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5560787192f0 msgr2=0x55607871d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c47e00640 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5560787192f0 0x55607871d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c47e00640 1 -- 172.21.15.8:0/1281425231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c481a6940 con 0x556078710710 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c4d800640 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5560787192f0 0x55607871d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c47e00640 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 0x55607871cfc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x556078717920 tx=0x7f3c34009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be493980f99a72aa server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c2ea00640 1 -- 172.21.15.8:0/1281425231 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3402dab0 con 0x556078710710 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c525e9740 1 -- 172.21.15.8:0/1281425231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c34009e10 con 0x556078710710 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.697+0000 7f3c2ea00640 1 -- 172.21.15.8:0/1281425231 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3c340050b0 con 0x556078710710 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.698+0000 7f3c2ea00640 1 -- 172.21.15.8:0/1281425231 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c34005290 con 0x556078710710 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.698+0000 7f3c525e9740 10 client.27743 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.698+0000 7f3c525e9740 1 -- 172.21.15.8:0/1281425231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x556078637650 con 0x556078710710 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.698+0000 7f3c2ea00640 1 -- 172.21.15.8:0/1281425231 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3c34045020 con 0x556078710710 2024-03-16T21:07:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.698+0000 7f3c2ea00640 1 -- 172.21.15.8:0/1281425231 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f3c3400e5c0 con 0x556078710710 2024-03-16T21:07:41.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.698+0000 7f3c525e9740 10 client.27743 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:41.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.698+0000 7f3c525e9740 10 client.27743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:41.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.698+0000 7f3c525e9740 20 client.27743 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:41.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.698+0000 7f3c525e9740 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55607878e4a0 0x5560787908c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:41.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.698+0000 7f3c525e9740 4 client.27743 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:07:41.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.698+0000 7f3c525e9740 1 -- 172.21.15.8:0/1281425231 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556078402890 con 0x55607878e4a0 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.699+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55607878e4a0 0x5560787908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.699+0000 7f3c4ce00640 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55607878e4a0 0x5560787908c0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8da02de8e7cddd2b server_cookie=f412a53917f3b9f8 in_seq=0 out_seq=0 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.699+0000 7f3c2ea00640 10 client.27743 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.699+0000 7f3c2ea00640 1 -- 172.21.15.8:0/1281425231 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556078402890 con 0x55607878e4a0 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.699+0000 7f3c2ea00640 10 client.27743 handle_command_reply: tid=0 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.699+0000 7f3c525e9740 1 client.27743 shutdown 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c525e9740 1 -- 172.21.15.8:0/1281425231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 msgr2=0x55607871cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c525e9740 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 0x55607871cfc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x556078717920 tx=0x7f3c34009310 comp rx=0 tx=0).stop 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c525e9740 1 -- 172.21.15.8:0/1281425231 shutdown_connections 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c525e9740 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55607878e4a0 0x5560787908c0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c525e9740 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5560787192f0 0x55607871d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c525e9740 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556078710710 0x55607871cfc0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c525e9740 1 --2- 172.21.15.8:0/1281425231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55607870fdf0 0x556078720c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c525e9740 1 -- 172.21.15.8:0/1281425231 >> 172.21.15.8:0/1281425231 conn(0x55607870a520 msgr2=0x55607870b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c2ea00640 0 client.27743 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c525e9740 1 -- 172.21.15.8:0/1281425231 shutdown_connections 2024-03-16T21:07:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c525e9740 1 -- 172.21.15.8:0/1281425231 wait complete. 2024-03-16T21:07:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.700+0000 7f3c525e9740 20 client.27743 trim_cache size 0 max 16384 2024-03-16T21:07:41.712 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:07:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 -- 172.21.15.8:0/2225906872 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3c300a1ba0 msgr2=0x7f3c300a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3c300a1ba0 0x7f3c300a4060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c40006010 tx=0x7f3c40005d80 comp rx=0 tx=0).stop 2024-03-16T21:07:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 -- 172.21.15.8:0/2225906872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c48103590 msgr2=0x7f3c4819f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c48103590 0x7f3c4819f8a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00d950 tx=0x7f3c3c00de10 comp rx=0 tx=0).stop 2024-03-16T21:07:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 -- 172.21.15.8:0/2225906872 shutdown_connections 2024-03-16T21:07:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3c300a1ba0 0x7f3c300a4060 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c48109650 0x7f3c48199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c48103f50 0x7f3c4819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 --2- 172.21.15.8:0/2225906872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c48103590 0x7f3c4819f8a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 -- 172.21.15.8:0/2225906872 >> 172.21.15.8:0/2225906872 conn(0x7f3c480ff020 msgr2=0x7f3c481005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 -- 172.21.15.8:0/2225906872 shutdown_connections 2024-03-16T21:07:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:41.701+0000 7f3c4e200640 1 -- 172.21.15.8:0/2225906872 wait complete. 2024-03-16T21:07:42.724 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T21:07:42.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:07:42.724 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T21:07:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.956+0000 7feb05000640 1 -- 172.21.15.8:0/1017334797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb0010dc00 msgr2=0x7feb00110010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.956+0000 7feb05000640 1 --2- 172.21.15.8:0/1017334797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb0010dc00 0x7feb00110010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009ca0 tx=0x7feaf802c180 comp rx=0 tx=0).stop 2024-03-16T21:07:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.956+0000 7feb05000640 1 -- 172.21.15.8:0/1017334797 shutdown_connections 2024-03-16T21:07:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.956+0000 7feb05000640 1 --2- 172.21.15.8:0/1017334797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb0010dc00 0x7feb00110010 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.956+0000 7feb05000640 1 --2- 172.21.15.8:0/1017334797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb000741e0 0x7feb0010d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.956+0000 7feb05000640 1 --2- 172.21.15.8:0/1017334797 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb000738c0 0x7feb00073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.956+0000 7feb05000640 1 -- 172.21.15.8:0/1017334797 >> 172.21.15.8:0/1017334797 conn(0x7feb000fce90 msgr2=0x7feb000ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.956+0000 7feb05000640 1 -- 172.21.15.8:0/1017334797 shutdown_connections 2024-03-16T21:07:42.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.956+0000 7feb05000640 1 -- 172.21.15.8:0/1017334797 wait complete. 2024-03-16T21:07:42.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.957+0000 7feb05000640 1 Processor -- start 2024-03-16T21:07:42.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.957+0000 7feb05000640 1 -- start start 2024-03-16T21:07:42.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feb05000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb000738c0 0x7feb00199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feb05000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb000741e0 0x7feb0019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feb05000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0010dc00 0x7feb0019e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feb05000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0019ebe0 con 0x7feb000738c0 2024-03-16T21:07:42.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feb05000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0019ed50 con 0x7feb0010dc00 2024-03-16T21:07:42.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feb05000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0019ef10 con 0x7feb000741e0 2024-03-16T21:07:42.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feafea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb000741e0 0x7feb0019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feaff400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb000738c0 0x7feb00199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feafea00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb000741e0 0x7feb0019a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:41950/0 (socket says 172.21.15.8:41950) 2024-03-16T21:07:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feafea00640 1 -- 172.21.15.8:0/621432617 learned_addr learned my addr 172.21.15.8:0/621432617 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feaffe00640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0010dc00 0x7feb0019e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feafea00640 1 -- 172.21.15.8:0/621432617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0010dc00 msgr2=0x7feb0019e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feafea00640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0010dc00 0x7feb0019e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feafea00640 1 -- 172.21.15.8:0/621432617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb000738c0 msgr2=0x7feb00199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feafea00640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb000738c0 0x7feb00199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.958+0000 7feafea00640 1 -- 172.21.15.8:0/621432617 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8009900 con 0x7feb000741e0 2024-03-16T21:07:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.959+0000 7feafea00640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb000741e0 0x7feb0019a260 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7feaec00e9f0 tx=0x7feaec00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.959+0000 7feaf7e00640 1 -- 172.21.15.8:0/621432617 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec009720 con 0x7feb000741e0 2024-03-16T21:07:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.959+0000 7feaf7e00640 1 -- 172.21.15.8:0/621432617 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7feaec00cd80 con 0x7feb000741e0 2024-03-16T21:07:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.959+0000 7feb05000640 1 -- 172.21.15.8:0/621432617 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0019f1f0 con 0x7feb000741e0 2024-03-16T21:07:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.959+0000 7feaf7e00640 1 -- 172.21.15.8:0/621432617 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec010690 con 0x7feb000741e0 2024-03-16T21:07:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.959+0000 7feb05000640 1 -- 172.21.15.8:0/621432617 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb001a6a70 con 0x7feb000741e0 2024-03-16T21:07:42.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.962+0000 7feb09226740 1 Processor -- start 2024-03-16T21:07:42.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feb09226740 1 -- start start 2024-03-16T21:07:42.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feb09226740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 0x559e1a7d44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feb09226740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 0x559e1a7dd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feb09226740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feb09226740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a78f300 con 0x559e1a7d4110 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feb09226740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a741e50 con 0x559e1a7d4a30 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feb09226740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a73f380 con 0x559e1a7dd610 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feaf7e00640 1 -- 172.21.15.8:0/621432617 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7feaec0046c0 con 0x7feb000741e0 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feaffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 0x559e1a7d44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feaff400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 0x559e1a7dd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feaffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 0x559e1a7d44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58668/0 (socket says 172.21.15.8:58668) 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feaffe00640 1 -- 172.21.15.8:0/3321338004 learned_addr learned my addr 172.21.15.8:0/3321338004 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.963+0000 7feafea00640 1 --2- 172.21.15.8:0/3321338004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.964+0000 7feaff400640 1 -- 172.21.15.8:0/3321338004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 msgr2=0x559e1a7dfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.964+0000 7feaff400640 1 --2- 172.21.15.8:0/3321338004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7dfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.964+0000 7feaff400640 1 -- 172.21.15.8:0/3321338004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 msgr2=0x559e1a7d44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:42.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.964+0000 7feaff400640 1 --2- 172.21.15.8:0/3321338004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 0x559e1a7d44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.964+0000 7feaff400640 1 -- 172.21.15.8:0/3321338004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e1a703c80 con 0x559e1a7d4a30 2024-03-16T21:07:42.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.964+0000 7feaff400640 1 --2- 172.21.15.8:0/3321338004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 0x559e1a7dd0d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009c20 tx=0x7feaf0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3db9a446d6ba9423 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:42.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.964+0000 7feaf4c00640 1 -- 172.21.15.8:0/3321338004 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0004050 con 0x559e1a7d4a30 2024-03-16T21:07:42.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.964+0000 7feaf4c00640 1 -- 172.21.15.8:0/3321338004 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7feaf0005520 con 0x559e1a7d4a30 2024-03-16T21:07:42.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.964+0000 7feaf4c00640 1 -- 172.21.15.8:0/3321338004 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0004e00 con 0x559e1a7d4a30 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.965+0000 7feaf7e00640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7feae40a1ba0 0x7feae40a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.965+0000 7feaf7e00640 1 -- 172.21.15.8:0/621432617 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7feaec014070 con 0x7feb000741e0 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.965+0000 7feaffe00640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7feae40a1ba0 0x7feae40a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.965+0000 7feb09226740 1 -- 172.21.15.8:0/3321338004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 msgr2=0x559e1a7dd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.965+0000 7feb09226740 1 --2- 172.21.15.8:0/3321338004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 0x559e1a7dd0d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009c20 tx=0x7feaf0011810 comp rx=0 tx=0).stop 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.965+0000 7feb09226740 1 -- 172.21.15.8:0/3321338004 shutdown_connections 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.965+0000 7feb09226740 1 --2- 172.21.15.8:0/3321338004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7dfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.965+0000 7feb09226740 1 --2- 172.21.15.8:0/3321338004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 0x559e1a7dd0d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.965+0000 7feb09226740 1 --2- 172.21.15.8:0/3321338004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 0x559e1a7d44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.965+0000 7feb09226740 1 -- 172.21.15.8:0/3321338004 >> 172.21.15.8:0/3321338004 conn(0x559e1a7ce840 msgr2=0x559e1a7cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.966+0000 7feb09226740 1 -- 172.21.15.8:0/3321338004 shutdown_connections 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.966+0000 7feb09226740 1 -- 172.21.15.8:0/3321338004 wait complete. 2024-03-16T21:07:42.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.966+0000 7feaffe00640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7feae40a1ba0 0x7feae40a4060 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feaf802c6c0 tx=0x7feaf8005d80 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.966+0000 7feb09226740 1 -- start start 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.966+0000 7feb09226740 1 Processor -- start 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feb09226740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7d4110 0x559e1a7da630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feb09226740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4a30 0x559e1a7dab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feb09226740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7dd610 0x559e1a7db0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feb09226740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a73ab60 con 0x559e1a7d4a30 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feb09226740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a6dffd0 con 0x559e1a7dd610 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feb09226740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a6dfc70 con 0x559e1a7d4110 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feb09226740 10 client.0 _ll_register_callbacks cb 0x559e1a44bc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feafea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4a30 0x559e1a7dab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feaffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7dd610 0x559e1a7db0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feaff400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7d4110 0x559e1a7da630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feaffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7dd610 0x559e1a7db0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43476/0 (socket says 172.21.15.8:43476) 2024-03-16T21:07:42.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feaffe00640 1 -- 172.21.15.8:0/1957688373 learned_addr learned my addr 172.21.15.8:0/1957688373 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feafea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4a30 0x559e1a7dab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58678/0 (socket says 172.21.15.8:58678) 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feaffe00640 1 -- 172.21.15.8:0/1957688373 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7d4110 msgr2=0x559e1a7da630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feaffe00640 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7d4110 0x559e1a7da630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feaffe00640 1 -- 172.21.15.8:0/1957688373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4a30 msgr2=0x559e1a7dab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feaffe00640 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4a30 0x559e1a7dab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feaffe00640 1 -- 172.21.15.8:0/1957688373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf0009850 con 0x559e1a7dd610 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.967+0000 7feaff400640 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7d4110 0x559e1a7da630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.968+0000 7feaffe00640 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7dd610 0x559e1a7db0b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feaf8037040 tx=0x7feaf80095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2b995c00161dbe server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.968+0000 7feae9600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.968+0000 7feae9600640 1 -- 172.21.15.8:0/1957688373 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8048660 con 0x559e1a7dd610 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.968+0000 7feae9600640 1 -- 172.21.15.8:0/1957688373 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7feaf80487c0 con 0x559e1a7dd610 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.968+0000 7feb09226740 1 -- 172.21.15.8:0/1957688373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e1a43a860 con 0x559e1a7dd610 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.968+0000 7feae9600640 1 -- 172.21.15.8:0/1957688373 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaf80348f0 con 0x559e1a7dd610 2024-03-16T21:07:42.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.968+0000 7feb09226740 10 client.27755 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:42.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.968+0000 7feb09226740 1 -- 172.21.15.8:0/1957688373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x559e1a7391e0 con 0x559e1a7dd610 2024-03-16T21:07:42.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.969+0000 7feae9600640 1 -- 172.21.15.8:0/1957688373 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7feaf805f080 con 0x559e1a7dd610 2024-03-16T21:07:42.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.969+0000 7feae9600640 1 -- 172.21.15.8:0/1957688373 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7feaf8059030 con 0x559e1a7dd610 2024-03-16T21:07:42.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.969+0000 7feb09226740 10 client.27755 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:42.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.969+0000 7feb09226740 10 client.27755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:42.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.969+0000 7feb09226740 20 client.27755 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:42.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.969+0000 7feb09226740 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559e1a7edae0 0x559e1a7efed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.969+0000 7feb09226740 4 client.27755 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:42.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.969+0000 7feb09226740 1 -- 172.21.15.8:0/1957688373 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e1a48b410 con 0x559e1a7edae0 2024-03-16T21:07:42.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.969+0000 7feaff400640 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559e1a7edae0 0x559e1a7efed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.970+0000 7feaff400640 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559e1a7edae0 0x559e1a7efed0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2739384f9e5ba103 server_cookie=f2edc82266294ccb in_seq=0 out_seq=0 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.970+0000 7feae9600640 10 client.27755 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feae9600640 1 -- 172.21.15.8:0/1957688373 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x559e1a48b410 con 0x559e1a7edae0 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feae9600640 10 client.27755 handle_command_reply: tid=0 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 1 client.27755 shutdown 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 1 -- 172.21.15.8:0/1957688373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7dd610 msgr2=0x559e1a7db0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7dd610 0x559e1a7db0b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feaf8037040 tx=0x7feaf80095c0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 1 -- 172.21.15.8:0/1957688373 shutdown_connections 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7dd610 0x559e1a7db0b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559e1a7edae0 0x559e1a7efed0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4a30 0x559e1a7dab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 1 --2- 172.21.15.8:0/1957688373 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7d4110 0x559e1a7da630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 1 -- 172.21.15.8:0/1957688373 >> 172.21.15.8:0/1957688373 conn(0x559e1a7ce840 msgr2=0x559e1a7d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feae9600640 0 client.27755 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:42.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 1 -- 172.21.15.8:0/1957688373 shutdown_connections 2024-03-16T21:07:42.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 1 -- 172.21.15.8:0/1957688373 wait complete. 2024-03-16T21:07:42.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.971+0000 7feb09226740 20 client.27755 trim_cache size 0 max 16384 2024-03-16T21:07:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.989+0000 7feb09226740 1 Processor -- start 2024-03-16T21:07:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.989+0000 7feb09226740 1 -- start start 2024-03-16T21:07:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feb09226740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4110 0x559e1a7dcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feb09226740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4a30 0x559e1a7daed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feb09226740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7e8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feb09226740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a7c9950 con 0x559e1a7d4a30 2024-03-16T21:07:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feb09226740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a4830c0 con 0x559e1a7d4110 2024-03-16T21:07:42.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feb09226740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a7dfc30 con 0x559e1a7dd610 2024-03-16T21:07:42.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feaff400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4110 0x559e1a7dcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feaff400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4110 0x559e1a7dcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43486/0 (socket says 172.21.15.8:43486) 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feaff400640 1 -- 172.21.15.8:0/3278084065 learned_addr learned my addr 172.21.15.8:0/3278084065 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feaffe00640 1 --2- 172.21.15.8:0/3278084065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7e8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feafea00640 1 --2- 172.21.15.8:0/3278084065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4a30 0x559e1a7daed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feaff400640 1 -- 172.21.15.8:0/3278084065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 msgr2=0x559e1a7e8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feaff400640 1 --2- 172.21.15.8:0/3278084065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7e8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feaff400640 1 -- 172.21.15.8:0/3278084065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4a30 msgr2=0x559e1a7daed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feaff400640 1 --2- 172.21.15.8:0/3278084065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4a30 0x559e1a7daed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.990+0000 7feaff400640 1 -- 172.21.15.8:0/3278084065 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e1a6d5a90 con 0x559e1a7d4110 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.991+0000 7feaffe00640 1 --2- 172.21.15.8:0/3278084065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7e8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.991+0000 7feaff400640 1 --2- 172.21.15.8:0/3278084065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4110 0x559e1a7dcd60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009c20 tx=0x7feaf0004a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=472229ec8b55736d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.991+0000 7feaebe00640 1 -- 172.21.15.8:0/3278084065 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf002a040 con 0x559e1a7d4110 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.991+0000 7feaebe00640 1 -- 172.21.15.8:0/3278084065 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7feaf00047c0 con 0x559e1a7d4110 2024-03-16T21:07:42.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.991+0000 7feaebe00640 1 -- 172.21.15.8:0/3278084065 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf002e800 con 0x559e1a7d4110 2024-03-16T21:07:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.992+0000 7feb09226740 1 -- 172.21.15.8:0/3278084065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4110 msgr2=0x559e1a7dcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.992+0000 7feb09226740 1 --2- 172.21.15.8:0/3278084065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4110 0x559e1a7dcd60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009c20 tx=0x7feaf0004a80 comp rx=0 tx=0).stop 2024-03-16T21:07:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.992+0000 7feb09226740 1 -- 172.21.15.8:0/3278084065 shutdown_connections 2024-03-16T21:07:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.992+0000 7feb09226740 1 --2- 172.21.15.8:0/3278084065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7e8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.992+0000 7feb09226740 1 --2- 172.21.15.8:0/3278084065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4a30 0x559e1a7daed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.992+0000 7feb09226740 1 --2- 172.21.15.8:0/3278084065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4110 0x559e1a7dcd60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.992+0000 7feb09226740 1 -- 172.21.15.8:0/3278084065 >> 172.21.15.8:0/3278084065 conn(0x559e1a7ce840 msgr2=0x559e1a7d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.992+0000 7feb09226740 1 -- 172.21.15.8:0/3278084065 shutdown_connections 2024-03-16T21:07:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.992+0000 7feb09226740 1 -- 172.21.15.8:0/3278084065 wait complete. 2024-03-16T21:07:42.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.992+0000 7feb09226740 1 -- start start 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feb09226740 1 Processor -- start 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feb09226740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 0x559e1a7e24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feb09226740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 0x559e1a7e29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feb09226740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feb09226740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a851ba0 con 0x559e1a7d4110 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feb09226740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a851ce0 con 0x559e1a7d4a30 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feb09226740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e1a851e20 con 0x559e1a7dd610 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feb09226740 10 client.0 _ll_register_callbacks cb 0x7feaec005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feaff400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 0x559e1a7e24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feafea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 0x559e1a7e29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feaff400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 0x559e1a7e24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58700/0 (socket says 172.21.15.8:58700) 2024-03-16T21:07:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feaff400640 1 -- 172.21.15.8:0/1257422761 learned_addr learned my addr 172.21.15.8:0/1257422761 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.993+0000 7feaffe00640 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feafea00640 1 -- 172.21.15.8:0/1257422761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 msgr2=0x559e1a7e2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feafea00640 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7e2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feafea00640 1 -- 172.21.15.8:0/1257422761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 msgr2=0x559e1a7e24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feafea00640 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 0x559e1a7e24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feafea00640 1 -- 172.21.15.8:0/1257422761 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e1a7391e0 con 0x559e1a7d4a30 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feaff400640 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 0x559e1a7e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feafea00640 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 0x559e1a7e29e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feaec0cb210 tx=0x7feaec009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3742d334ab65e84e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feae9600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feae9600640 1 -- 172.21.15.8:0/1257422761 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec083ea0 con 0x559e1a7d4a30 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feae9600640 1 -- 172.21.15.8:0/1257422761 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7feaec09a720 con 0x559e1a7d4a30 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feb09226740 1 -- 172.21.15.8:0/1257422761 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feaf0005520 con 0x559e1a7d4a30 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feae9600640 1 -- 172.21.15.8:0/1257422761 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaec09e870 con 0x559e1a7d4a30 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feb09226740 10 client.27761 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:43.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.994+0000 7feb09226740 1 -- 172.21.15.8:0/1257422761 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x559e1a703c80 con 0x559e1a7d4a30 2024-03-16T21:07:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.995+0000 7feae9600640 1 -- 172.21.15.8:0/1257422761 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7feaf0005520 con 0x559e1a7d4a30 2024-03-16T21:07:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.995+0000 7feae9600640 1 -- 172.21.15.8:0/1257422761 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7feaec01f060 con 0x559e1a7d4a30 2024-03-16T21:07:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.995+0000 7feb09226740 10 client.27761 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.995+0000 7feb09226740 10 client.27761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.995+0000 7feb09226740 20 client.27761 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.995+0000 7feb09226740 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559e1a8536e0 0x559e1a855b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.995+0000 7feb09226740 4 client.27761 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T21:07:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.995+0000 7feb09226740 1 -- 172.21.15.8:0/1257422761 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559e1a4777b0 con 0x559e1a8536e0 2024-03-16T21:07:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.995+0000 7feaff400640 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559e1a8536e0 0x559e1a855b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.996+0000 7feaff400640 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559e1a8536e0 0x559e1a855b00 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9901b9f71cabd089 server_cookie=3a3078051f6e4114 in_seq=0 out_seq=0 2024-03-16T21:07:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.996+0000 7feae9600640 10 client.27761 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feae9600640 1 -- 172.21.15.8:0/1257422761 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559e1a4777b0 con 0x559e1a8536e0 2024-03-16T21:07:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feae9600640 10 client.27761 handle_command_reply: tid=0 2024-03-16T21:07:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feb09226740 1 client.27761 shutdown 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feb09226740 1 -- 172.21.15.8:0/1257422761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 msgr2=0x559e1a7e29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feb09226740 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 0x559e1a7e29e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feaec0cb210 tx=0x7feaec009310 comp rx=0 tx=0).stop 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feb09226740 1 -- 172.21.15.8:0/1257422761 shutdown_connections 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feb09226740 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e1a7dd610 0x559e1a7e2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feb09226740 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559e1a7d4a30 0x559e1a7e29e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feb09226740 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x559e1a8536e0 0x559e1a855b00 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feb09226740 1 --2- 172.21.15.8:0/1257422761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559e1a7d4110 0x559e1a7e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feae9600640 0 client.27761 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feb09226740 1 -- 172.21.15.8:0/1257422761 >> 172.21.15.8:0/1257422761 conn(0x559e1a7ce840 msgr2=0x559e1a7cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feb09226740 1 -- 172.21.15.8:0/1257422761 shutdown_connections 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.997+0000 7feb09226740 1 -- 172.21.15.8:0/1257422761 wait complete. 2024-03-16T21:07:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb09226740 20 client.27761 trim_cache size 0 max 16384 2024-03-16T21:07:43.007 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:07:43.007 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2024-03-16T21:07:43.007 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "f859baa9-a3f7-46d0-aede-1dedfd8dd699", 2024-03-16T21:07:43.007 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2024-03-16T21:07:43.007 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:07:43.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 -- 172.21.15.8:0/621432617 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7feae40a1ba0 msgr2=0x7feae40a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7feae40a1ba0 0x7feae40a4060 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feaf802c6c0 tx=0x7feaf8005d80 comp rx=0 tx=0).stop 2024-03-16T21:07:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 -- 172.21.15.8:0/621432617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb000741e0 msgr2=0x7feb0019a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb000741e0 0x7feb0019a260 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7feaec00e9f0 tx=0x7feaec00edf0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 -- 172.21.15.8:0/621432617 shutdown_connections 2024-03-16T21:07:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7feae40a1ba0 0x7feae40a4060 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0010dc00 0x7feb0019e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb000741e0 0x7feb0019a260 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 --2- 172.21.15.8:0/621432617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb000738c0 0x7feb00199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 -- 172.21.15.8:0/621432617 >> 172.21.15.8:0/621432617 conn(0x7feb000fce90 msgr2=0x7feb000fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 -- 172.21.15.8:0/621432617 shutdown_connections 2024-03-16T21:07:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:42.998+0000 7feb05000640 1 -- 172.21.15.8:0/621432617 wait complete. 2024-03-16T21:07:43.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:07:43.024 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:07:43.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.245+0000 7f6f5d200640 1 -- 172.21.15.8:0/3572563839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f58102ee0 msgr2=0x7f6f5810b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.245+0000 7f6f5d200640 1 --2- 172.21.15.8:0/3572563839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f58102ee0 0x7f6f5810b3c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009900 tx=0x7f6f4402bcc0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.245+0000 7f6f5d200640 1 -- 172.21.15.8:0/3572563839 shutdown_connections 2024-03-16T21:07:43.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.245+0000 7f6f5d200640 1 --2- 172.21.15.8:0/3572563839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f5810b990 0x7f6f5810dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.245+0000 7f6f5d200640 1 --2- 172.21.15.8:0/3572563839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f58102ee0 0x7f6f5810b3c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.245+0000 7f6f5d200640 1 --2- 172.21.15.8:0/3572563839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f581025c0 0x7f6f581029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.245+0000 7f6f5d200640 1 -- 172.21.15.8:0/3572563839 >> 172.21.15.8:0/3572563839 conn(0x7f6f580fbd40 msgr2=0x7f6f580fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:43.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.245+0000 7f6f5d200640 1 -- 172.21.15.8:0/3572563839 shutdown_connections 2024-03-16T21:07:43.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.245+0000 7f6f5d200640 1 -- 172.21.15.8:0/3572563839 wait complete. 2024-03-16T21:07:43.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.247+0000 7f6f5d200640 1 Processor -- start 2024-03-16T21:07:43.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.247+0000 7f6f5d200640 1 -- start start 2024-03-16T21:07:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f5d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f581025c0 0x7f6f5819f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f5d200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f58102ee0 0x7f6f5819fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f5d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f5810b990 0x7f6f58199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f5d200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5819a0d0 con 0x7f6f5810b990 2024-03-16T21:07:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f5d200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5819a240 con 0x7f6f581025c0 2024-03-16T21:07:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f5d200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5819a400 con 0x7f6f58102ee0 2024-03-16T21:07:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f57400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f581025c0 0x7f6f5819f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f56a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f58102ee0 0x7f6f5819fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f57400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f581025c0 0x7f6f5819f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43508/0 (socket says 172.21.15.8:43508) 2024-03-16T21:07:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f57400640 1 -- 172.21.15.8:0/254926007 learned_addr learned my addr 172.21.15.8:0/254926007 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:43.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f57e00640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f5810b990 0x7f6f58199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f57400640 1 -- 172.21.15.8:0/254926007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f58102ee0 msgr2=0x7f6f5819fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f57400640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f58102ee0 0x7f6f5819fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f57400640 1 -- 172.21.15.8:0/254926007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f5810b990 msgr2=0x7f6f58199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f57400640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f5810b990 0x7f6f58199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.248+0000 7f6f57400640 1 -- 172.21.15.8:0/254926007 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44009560 con 0x7f6f581025c0 2024-03-16T21:07:43.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.249+0000 7f6f57400640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f581025c0 0x7f6f5819f8d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800d950 tx=0x7f6f4800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:43.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.249+0000 7f6f4fe00640 1 -- 172.21.15.8:0/254926007 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f48009a30 con 0x7f6f581025c0 2024-03-16T21:07:43.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.249+0000 7f6f5d200640 1 -- 172.21.15.8:0/254926007 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5819a6e0 con 0x7f6f581025c0 2024-03-16T21:07:43.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.249+0000 7f6f4fe00640 1 -- 172.21.15.8:0/254926007 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6f48009b90 con 0x7f6f581025c0 2024-03-16T21:07:43.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.249+0000 7f6f4fe00640 1 -- 172.21.15.8:0/254926007 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f48004a00 con 0x7f6f581025c0 2024-03-16T21:07:43.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.249+0000 7f6f5d200640 1 -- 172.21.15.8:0/254926007 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f581a6970 con 0x7f6f581025c0 2024-03-16T21:07:43.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.252+0000 7f6f61629740 1 Processor -- start 2024-03-16T21:07:43.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.252+0000 7f6f4fe00640 1 -- 172.21.15.8:0/254926007 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f6f48009d00 con 0x7f6f581025c0 2024-03-16T21:07:43.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.252+0000 7f6f61629740 1 -- start start 2024-03-16T21:07:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f61629740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82dd9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f61629740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 0x55cf82dda910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f61629740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82de3800 0x55cf82de5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f61629740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82d49150 con 0x55cf82ddb170 2024-03-16T21:07:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f61629740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82d46680 con 0x55cf82de3800 2024-03-16T21:07:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f61629740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82d41e60 con 0x55cf82dda490 2024-03-16T21:07:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f57400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 0x55cf82dda910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f57400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 0x55cf82dda910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:42034/0 (socket says 172.21.15.8:42034) 2024-03-16T21:07:43.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f57400640 1 -- 172.21.15.8:0/3343643185 learned_addr learned my addr 172.21.15.8:0/3343643185 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f57e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82dd9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f56a00640 1 --2- 172.21.15.8:0/3343643185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82de3800 0x55cf82de5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.253+0000 7f6f57400640 1 -- 172.21.15.8:0/3343643185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82de3800 msgr2=0x55cf82de5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.254+0000 7f6f57400640 1 --2- 172.21.15.8:0/3343643185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82de3800 0x55cf82de5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.254+0000 7f6f57400640 1 -- 172.21.15.8:0/3343643185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 msgr2=0x55cf82dd9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.254+0000 7f6f57400640 1 --2- 172.21.15.8:0/3343643185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82dd9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.254+0000 7f6f57400640 1 -- 172.21.15.8:0/3343643185 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf82cfb060 con 0x55cf82dda490 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.254+0000 7f6f56a00640 1 --2- 172.21.15.8:0/3343643185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82de3800 0x55cf82de5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.254+0000 7f6f57400640 1 --2- 172.21.15.8:0/3343643185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 0x55cf82dda910 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6f480ca850 tx=0x7f6f480d56f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=179581e852b1e08d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.254+0000 7f6f4fe00640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6f3c0a1c20 0x7f6f3c0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.254+0000 7f6f4cc00640 1 -- 172.21.15.8:0/3343643185 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f48096060 con 0x55cf82dda490 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.254+0000 7f6f4cc00640 1 -- 172.21.15.8:0/3343643185 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6f48095930 con 0x55cf82dda490 2024-03-16T21:07:43.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.254+0000 7f6f4cc00640 1 -- 172.21.15.8:0/3343643185 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480c44f0 con 0x55cf82dda490 2024-03-16T21:07:43.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.255+0000 7f6f4fe00640 1 -- 172.21.15.8:0/254926007 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6f480cd190 con 0x7f6f581025c0 2024-03-16T21:07:43.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.255+0000 7f6f57e00640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6f3c0a1c20 0x7f6f3c0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.255+0000 7f6f61629740 1 -- 172.21.15.8:0/3343643185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 msgr2=0x55cf82dda910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.255+0000 7f6f61629740 1 --2- 172.21.15.8:0/3343643185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 0x55cf82dda910 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6f480ca850 tx=0x7f6f480d56f0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.255+0000 7f6f61629740 1 -- 172.21.15.8:0/3343643185 shutdown_connections 2024-03-16T21:07:43.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.255+0000 7f6f61629740 1 --2- 172.21.15.8:0/3343643185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82de3800 0x55cf82de5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.255+0000 7f6f61629740 1 --2- 172.21.15.8:0/3343643185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 0x55cf82dda910 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.255+0000 7f6f61629740 1 --2- 172.21.15.8:0/3343643185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82dd9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.255+0000 7f6f61629740 1 -- 172.21.15.8:0/3343643185 >> 172.21.15.8:0/3343643185 conn(0x55cf82da15a0 msgr2=0x55cf82dd4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.256+0000 7f6f57e00640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6f3c0a1c20 0x7f6f3c0a40e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f50005fd0 tx=0x7f6f50009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.256+0000 7f6f61629740 1 -- 172.21.15.8:0/3343643185 shutdown_connections 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.256+0000 7f6f61629740 1 -- 172.21.15.8:0/3343643185 wait complete. 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.256+0000 7f6f61629740 1 -- start start 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.256+0000 7f6f61629740 1 Processor -- start 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f61629740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 0x55cf82de07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f61629740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82de0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f61629740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 0x55cf82de1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f61629740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82ce6ec0 con 0x55cf82ddb170 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f61629740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82ce6b60 con 0x55cf82dda490 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f61629740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82ab01c0 con 0x55cf82de3800 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f61629740 10 client.0 _ll_register_callbacks cb 0x55cf82cfa960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f57e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 0x55cf82de1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f57400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 0x55cf82de07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f57e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 0x55cf82de1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:42044/0 (socket says 172.21.15.8:42044) 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f56a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82de0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f57e00640 1 -- 172.21.15.8:0/1660160046 learned_addr learned my addr 172.21.15.8:0/1660160046 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f57400640 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 0x55cf82de07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43526/0 (socket says 172.21.15.8:43526) 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f57e00640 1 -- 172.21.15.8:0/1660160046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 msgr2=0x55cf82de07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f57e00640 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 0x55cf82de07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f57e00640 1 -- 172.21.15.8:0/1660160046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 msgr2=0x55cf82de0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f57e00640 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82de0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.257+0000 7f6f57e00640 1 -- 172.21.15.8:0/1660160046 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f581a6970 con 0x55cf82de3800 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.258+0000 7f6f57e00640 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 0x55cf82de1270 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6f5001f6d0 tx=0x7f6f50004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c5f1389da7ca93d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.258+0000 7f6f41600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.258+0000 7f6f41600640 1 -- 172.21.15.8:0/1660160046 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50016070 con 0x55cf82de3800 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.258+0000 7f6f61629740 1 -- 172.21.15.8:0/1660160046 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf82a417e0 con 0x55cf82de3800 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.258+0000 7f6f41600640 1 -- 172.21.15.8:0/1660160046 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6f50011890 con 0x55cf82de3800 2024-03-16T21:07:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.258+0000 7f6f41600640 1 -- 172.21.15.8:0/1660160046 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f50011a50 con 0x55cf82de3800 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.258+0000 7f6f61629740 10 client.27784 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.258+0000 7f6f61629740 1 -- 172.21.15.8:0/1660160046 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55cf82d404e0 con 0x55cf82de3800 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.259+0000 7f6f41600640 1 -- 172.21.15.8:0/1660160046 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55cf82a417e0 con 0x55cf82de3800 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.259+0000 7f6f41600640 1 -- 172.21.15.8:0/1660160046 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6f5001c430 con 0x55cf82de3800 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.259+0000 7f6f61629740 10 client.27784 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.259+0000 7f6f61629740 10 client.27784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.259+0000 7f6f61629740 20 client.27784 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.259+0000 7f6f61629740 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55cf82df3940 0x55cf82df5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.259+0000 7f6f61629740 4 client.27784 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.259+0000 7f6f61629740 1 -- 172.21.15.8:0/1660160046 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf82a7e720 con 0x55cf82df3940 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.259+0000 7f6f57400640 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55cf82df3940 0x55cf82df5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.260+0000 7f6f57400640 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55cf82df3940 0x55cf82df5d30 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7357bcc4bcf71e81 server_cookie=c577566525bb171 in_seq=0 out_seq=0 2024-03-16T21:07:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.260+0000 7f6f41600640 10 client.27784 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.260+0000 7f6f41600640 1 -- 172.21.15.8:0/1660160046 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55cf82a7e720 con 0x55cf82df3940 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.260+0000 7f6f41600640 10 client.27784 handle_command_reply: tid=0 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 1 client.27784 shutdown 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 1 -- 172.21.15.8:0/1660160046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 msgr2=0x55cf82de1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 0x55cf82de1270 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6f5001f6d0 tx=0x7f6f50004ab0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 1 -- 172.21.15.8:0/1660160046 shutdown_connections 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 0x55cf82de1270 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55cf82df3940 0x55cf82df5d30 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82de0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 1 --2- 172.21.15.8:0/1660160046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 0x55cf82de07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f41600640 0 client.27784 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 1 -- 172.21.15.8:0/1660160046 >> 172.21.15.8:0/1660160046 conn(0x55cf82da15a0 msgr2=0x55cf82dd6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 1 -- 172.21.15.8:0/1660160046 shutdown_connections 2024-03-16T21:07:43.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 1 -- 172.21.15.8:0/1660160046 wait complete. 2024-03-16T21:07:43.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.261+0000 7f6f61629740 20 client.27784 trim_cache size 0 max 16384 2024-03-16T21:07:43.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.279+0000 7f6f61629740 1 Processor -- start 2024-03-16T21:07:43.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.279+0000 7f6f61629740 1 -- start start 2024-03-16T21:07:43.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.279+0000 7f6f61629740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 0x55cf82dd3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.279+0000 7f6f61629740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82dd6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.279+0000 7f6f61629740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82de3800 0x55cf82dd6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f61629740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82a7e720 con 0x55cf82ddb170 2024-03-16T21:07:43.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f61629740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82a417e0 con 0x55cf82de3800 2024-03-16T21:07:43.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f61629740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82defe20 con 0x55cf82dda490 2024-03-16T21:07:43.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f56a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82dd6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f56a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82dd6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58728/0 (socket says 172.21.15.8:58728) 2024-03-16T21:07:43.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f56a00640 1 -- 172.21.15.8:0/4025837509 learned_addr learned my addr 172.21.15.8:0/4025837509 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:43.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f57e00640 1 --2- 172.21.15.8:0/4025837509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82de3800 0x55cf82dd6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f57400640 1 --2- 172.21.15.8:0/4025837509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 0x55cf82dd3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f56a00640 1 -- 172.21.15.8:0/4025837509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 msgr2=0x55cf82dd3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:43.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f56a00640 1 --2- 172.21.15.8:0/4025837509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 0x55cf82dd3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f56a00640 1 -- 172.21.15.8:0/4025837509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82de3800 msgr2=0x55cf82dd6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:43.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f56a00640 1 --2- 172.21.15.8:0/4025837509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82de3800 0x55cf82dd6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f56a00640 1 -- 172.21.15.8:0/4025837509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf82cdc950 con 0x55cf82ddb170 2024-03-16T21:07:43.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.280+0000 7f6f57400640 1 --2- 172.21.15.8:0/4025837509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 0x55cf82dd3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:43.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.281+0000 7f6f56a00640 1 --2- 172.21.15.8:0/4025837509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82dd6820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6f44000c00 tx=0x7f6f44004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f0195afc61939f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:43.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.281+0000 7f6f43e00640 1 -- 172.21.15.8:0/4025837509 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44004960 con 0x55cf82ddb170 2024-03-16T21:07:43.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.281+0000 7f6f43e00640 1 -- 172.21.15.8:0/4025837509 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6f44004ac0 con 0x55cf82ddb170 2024-03-16T21:07:43.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.281+0000 7f6f43e00640 1 -- 172.21.15.8:0/4025837509 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44005230 con 0x55cf82ddb170 2024-03-16T21:07:43.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.282+0000 7f6f61629740 1 -- 172.21.15.8:0/4025837509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 msgr2=0x55cf82dd6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.282+0000 7f6f61629740 1 --2- 172.21.15.8:0/4025837509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82dd6820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6f44000c00 tx=0x7f6f44004770 comp rx=0 tx=0).stop 2024-03-16T21:07:43.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.282+0000 7f6f61629740 1 -- 172.21.15.8:0/4025837509 shutdown_connections 2024-03-16T21:07:43.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.282+0000 7f6f61629740 1 --2- 172.21.15.8:0/4025837509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82de3800 0x55cf82dd6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.282+0000 7f6f61629740 1 --2- 172.21.15.8:0/4025837509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82dd6820 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.282+0000 7f6f61629740 1 --2- 172.21.15.8:0/4025837509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82dda490 0x55cf82dd3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.282+0000 7f6f61629740 1 -- 172.21.15.8:0/4025837509 >> 172.21.15.8:0/4025837509 conn(0x55cf82da15a0 msgr2=0x55cf82dd6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:43.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.282+0000 7f6f61629740 1 -- 172.21.15.8:0/4025837509 shutdown_connections 2024-03-16T21:07:43.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.282+0000 7f6f61629740 1 -- 172.21.15.8:0/4025837509 wait complete. 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f61629740 1 -- start start 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f61629740 1 Processor -- start 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f61629740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 0x55cf82de5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f61629740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82de6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f61629740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 0x55cf82de6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f61629740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82de7380 con 0x55cf82ddb170 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f61629740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82de74f0 con 0x55cf82dda490 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f61629740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf82e4f1e0 con 0x55cf82de3800 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f61629740 10 client.0 _ll_register_callbacks cb 0x7f6f5001f590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f57400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 0x55cf82de5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f57400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 0x55cf82de5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:43540/0 (socket says 172.21.15.8:43540) 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.283+0000 7f6f57400640 1 -- 172.21.15.8:0/1677477723 learned_addr learned my addr 172.21.15.8:0/1677477723 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f57e00640 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 0x55cf82de6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f56a00640 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82de6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f57e00640 1 -- 172.21.15.8:0/1677477723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 msgr2=0x55cf82de5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f57e00640 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 0x55cf82de5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f57e00640 1 -- 172.21.15.8:0/1677477723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 msgr2=0x55cf82de6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f57e00640 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82de6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f57e00640 1 -- 172.21.15.8:0/1677477723 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf82cfb060 con 0x55cf82de3800 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f57400640 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 0x55cf82de5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f57e00640 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 0x55cf82de6c80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009ee0 tx=0x7f6f50004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a2ed0fd667b7478 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f41600640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f41600640 1 -- 172.21.15.8:0/1677477723 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50011aa0 con 0x55cf82de3800 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f61629740 1 -- 172.21.15.8:0/1677477723 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6f48095930 con 0x55cf82de3800 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.284+0000 7f6f41600640 1 -- 172.21.15.8:0/1677477723 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6f50011c00 con 0x55cf82de3800 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.285+0000 7f6f41600640 1 -- 172.21.15.8:0/1677477723 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f50011de0 con 0x55cf82de3800 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.285+0000 7f6f61629740 10 client.27790 fetch_fsmap learned FSMap version 36 2024-03-16T21:07:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.285+0000 7f6f61629740 1 -- 172.21.15.8:0/1677477723 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f6f5810eab0 con 0x55cf82de3800 2024-03-16T21:07:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.285+0000 7f6f41600640 1 -- 172.21.15.8:0/1677477723 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6f48095930 con 0x55cf82de3800 2024-03-16T21:07:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.285+0000 7f6f41600640 1 -- 172.21.15.8:0/1677477723 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6f5003b5f0 con 0x55cf82de3800 2024-03-16T21:07:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.285+0000 7f6f61629740 10 client.27790 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:07:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.285+0000 7f6f61629740 10 client.27790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:07:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.285+0000 7f6f61629740 20 client.27790 populate_metadata read hostname 'smithi008' 2024-03-16T21:07:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.285+0000 7f6f61629740 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55cf82e50890 0x55cf82e52cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.285+0000 7f6f61629740 4 client.27790 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:07:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.286+0000 7f6f61629740 1 -- 172.21.15.8:0/1677477723 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cf82acd890 con 0x55cf82e50890 2024-03-16T21:07:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.286+0000 7f6f57400640 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55cf82e50890 0x55cf82e52cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.286+0000 7f6f57400640 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55cf82e50890 0x55cf82e52cb0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e90f7d474b994cb8 server_cookie=ef806103ecc41a1 in_seq=0 out_seq=0 2024-03-16T21:07:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.286+0000 7f6f41600640 10 client.27790 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.286+0000 7f6f41600640 1 -- 172.21.15.8:0/1677477723 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55cf82acd890 con 0x55cf82e50890 2024-03-16T21:07:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.286+0000 7f6f41600640 10 client.27790 handle_command_reply: tid=0 2024-03-16T21:07:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.286+0000 7f6f61629740 1 client.27790 shutdown 2024-03-16T21:07:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f61629740 1 -- 172.21.15.8:0/1677477723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 msgr2=0x55cf82de6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f61629740 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 0x55cf82de6c80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009ee0 tx=0x7f6f50004a40 comp rx=0 tx=0).stop 2024-03-16T21:07:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f61629740 1 -- 172.21.15.8:0/1677477723 shutdown_connections 2024-03-16T21:07:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f61629740 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cf82de3800 0x55cf82de6c80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f61629740 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55cf82e50890 0x55cf82e52cb0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f61629740 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf82ddb170 0x55cf82de6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f61629740 1 --2- 172.21.15.8:0/1677477723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf82dda490 0x55cf82de5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f61629740 1 -- 172.21.15.8:0/1677477723 >> 172.21.15.8:0/1677477723 conn(0x55cf82da15a0 msgr2=0x55cf82dd3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:43.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f41600640 0 client.27790 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:07:43.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f61629740 1 -- 172.21.15.8:0/1677477723 shutdown_connections 2024-03-16T21:07:43.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f61629740 1 -- 172.21.15.8:0/1677477723 wait complete. 2024-03-16T21:07:43.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.287+0000 7f6f61629740 20 client.27790 trim_cache size 0 max 16384 2024-03-16T21:07:43.297 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:07:43.297 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T21:07:43.297 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2024-03-16T21:07:43.298 INFO:teuthology.orchestra.run.smithi008.stdout: "f859baa9-a3f7-46d0-aede-1dedfd8dd699": { 2024-03-16T21:07:43.298 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2024-03-16T21:07:43.298 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "f859baa9-a3f7-46d0-aede-1dedfd8dd699", 2024-03-16T21:07:43.298 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2024-03-16T21:07:43.298 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:07:43.298 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:07:43.298 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 -- 172.21.15.8:0/254926007 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6f3c0a1c20 msgr2=0x7f6f3c0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6f3c0a1c20 0x7f6f3c0a40e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f50005fd0 tx=0x7f6f50009500 comp rx=0 tx=0).stop 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 -- 172.21.15.8:0/254926007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f581025c0 msgr2=0x7f6f5819f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f581025c0 0x7f6f5819f8d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800d950 tx=0x7f6f4800de10 comp rx=0 tx=0).stop 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 -- 172.21.15.8:0/254926007 shutdown_connections 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6f3c0a1c20 0x7f6f3c0a40e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f5810b990 0x7f6f58199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f58102ee0 0x7f6f5819fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 --2- 172.21.15.8:0/254926007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f581025c0 0x7f6f5819f8d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 -- 172.21.15.8:0/254926007 >> 172.21.15.8:0/254926007 conn(0x7f6f580fbd40 msgr2=0x7f6f5810dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 -- 172.21.15.8:0/254926007 shutdown_connections 2024-03-16T21:07:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:43.288+0000 7f6f5d200640 1 -- 172.21.15.8:0/254926007 wait complete. 2024-03-16T21:07:43.311 INFO:tasks.cephfs.filesystem:scrub status for tag:f859baa9-a3f7-46d0-aede-1dedfd8dd699 - {'path': '/', 'tag': 'f859baa9-a3f7-46d0-aede-1dedfd8dd699', 'options': 'recursive,force'} 2024-03-16T21:07:43.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:43 smithi186 ceph-mon[36391]: pgmap v305: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:07:43.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:43 smithi008 ceph-mon[31434]: pgmap v305: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:07:43.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:43 smithi170 ceph-mon[35947]: pgmap v305: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:07:44.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:44 smithi186 ceph-mon[36391]: scrub queued for path: / 2024-03-16T21:07:44.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:44 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:44.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:44 smithi186 ceph-mon[36391]: scrub summary: active paths [/] 2024-03-16T21:07:44.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:44 smithi186 ceph-mon[36391]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:44.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:44 smithi008 ceph-mon[31434]: scrub queued for path: / 2024-03-16T21:07:44.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:44 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:44.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:44 smithi008 ceph-mon[31434]: scrub summary: active paths [/] 2024-03-16T21:07:44.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:44 smithi008 ceph-mon[31434]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:44.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:44 smithi170 ceph-mon[35947]: scrub queued for path: / 2024-03-16T21:07:44.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:44 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:44.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:44 smithi170 ceph-mon[35947]: scrub summary: active paths [/] 2024-03-16T21:07:44.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:44 smithi170 ceph-mon[35947]: scrub summary: idle+waiting paths [/] 2024-03-16T21:07:45.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:45 smithi186 ceph-mon[36391]: pgmap v306: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:45.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:45 smithi008 ceph-mon[31434]: pgmap v306: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:45.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:45 smithi170 ceph-mon[35947]: pgmap v306: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:07:47.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:47 smithi186 ceph-mon[36391]: pgmap v307: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-16T21:07:47.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:47 smithi008 ceph-mon[31434]: pgmap v307: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-16T21:07:47.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:47 smithi170 ceph-mon[35947]: pgmap v307: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-16T21:07:48.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:48 smithi008 ceph-mon[31434]: scrub summary: idle 2024-03-16T21:07:48.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:48 smithi170 ceph-mon[35947]: scrub summary: idle 2024-03-16T21:07:48.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:48 smithi186 ceph-mon[36391]: scrub summary: idle 2024-03-16T21:07:49.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:49 smithi008 ceph-mon[31434]: pgmap v308: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-16T21:07:49.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:49 smithi170 ceph-mon[35947]: pgmap v308: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-16T21:07:49.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:49 smithi186 ceph-mon[36391]: pgmap v308: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-16T21:07:51.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:51 smithi008 ceph-mon[31434]: pgmap v309: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:07:51.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:51 smithi170 ceph-mon[35947]: pgmap v309: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:07:51.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:51 smithi186 ceph-mon[36391]: pgmap v309: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:07:52.868 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-03-16T21:07:53.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.093+0000 7f768f800640 1 -- 172.21.15.8:0/3810914297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76881036b0 msgr2=0x7f7688103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:53.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.093+0000 7f768f800640 1 --2- 172.21.15.8:0/3810914297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76881036b0 0x7f7688103b30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7674009900 tx=0x7f767402bc30 comp rx=0 tx=0).stop 2024-03-16T21:07:53.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.093+0000 7f768f800640 1 -- 172.21.15.8:0/3810914297 shutdown_connections 2024-03-16T21:07:53.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.093+0000 7f768f800640 1 --2- 172.21.15.8:0/3810914297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688104070 0x7f7688110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.093+0000 7f768f800640 1 --2- 172.21.15.8:0/3810914297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76881036b0 0x7f7688103b30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.093+0000 7f768f800640 1 --2- 172.21.15.8:0/3810914297 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76881096c0 0x7f7688109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.093+0000 7f768f800640 1 -- 172.21.15.8:0/3810914297 >> 172.21.15.8:0/3810914297 conn(0x7f76880ff1e0 msgr2=0x7f7688101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:53.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.093+0000 7f768f800640 1 -- 172.21.15.8:0/3810914297 shutdown_connections 2024-03-16T21:07:53.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.093+0000 7f768f800640 1 -- 172.21.15.8:0/3810914297 wait complete. 2024-03-16T21:07:53.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.094+0000 7f768f800640 1 Processor -- start 2024-03-16T21:07:53.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.095+0000 7f768f800640 1 -- start start 2024-03-16T21:07:53.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.095+0000 7f768f800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76881036b0 0x7f7688199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:53.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.095+0000 7f768f800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7688104070 0x7f768819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.095+0000 7f768f800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76881096c0 0x7f768819e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.095+0000 7f768f800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768819ec80 con 0x7f76881036b0 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.095+0000 7f768f800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768819edf0 con 0x7f7688104070 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.095+0000 7f768f800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768819efb0 con 0x7f76881096c0 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.095+0000 7f768d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76881096c0 0x7f768819e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.095+0000 7f7687e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7688104070 0x7f768819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.096+0000 7f768ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76881036b0 0x7f7688199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.096+0000 7f768d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76881096c0 0x7f768819e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:51240/0 (socket says 172.21.15.8:51240) 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.096+0000 7f768d800640 1 -- 172.21.15.8:0/3717579609 learned_addr learned my addr 172.21.15.8:0/3717579609 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.096+0000 7f768d800640 1 -- 172.21.15.8:0/3717579609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7688104070 msgr2=0x7f768819a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.096+0000 7f768d800640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7688104070 0x7f768819a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.096+0000 7f768d800640 1 -- 172.21.15.8:0/3717579609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76881036b0 msgr2=0x7f7688199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:53.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.096+0000 7f768d800640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76881036b0 0x7f7688199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.096+0000 7f768d800640 1 -- 172.21.15.8:0/3717579609 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7674009560 con 0x7f76881096c0 2024-03-16T21:07:53.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.096+0000 7f7687e00640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7688104070 0x7f768819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:53.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.096+0000 7f768d800640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76881096c0 0x7f768819e680 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f768000eb10 tx=0x7f768000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:53.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.096+0000 7f7685600640 1 -- 172.21.15.8:0/3717579609 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680004b20 con 0x7f76881096c0 2024-03-16T21:07:53.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.097+0000 7f768f800640 1 -- 172.21.15.8:0/3717579609 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768819f290 con 0x7f76881096c0 2024-03-16T21:07:53.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.097+0000 7f7685600640 1 -- 172.21.15.8:0/3717579609 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f7680004c80 con 0x7f76881096c0 2024-03-16T21:07:53.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.097+0000 7f7685600640 1 -- 172.21.15.8:0/3717579609 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680010760 con 0x7f76881096c0 2024-03-16T21:07:53.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.097+0000 7f768f800640 1 -- 172.21.15.8:0/3717579609 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76881a6b10 con 0x7f76881096c0 2024-03-16T21:07:53.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.098+0000 7f768f800640 1 -- 172.21.15.8:0/3717579609 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768804f250 con 0x7f76881096c0 2024-03-16T21:07:53.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.100+0000 7f7685600640 1 -- 172.21.15.8:0/3717579609 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f7680005020 con 0x7f76881096c0 2024-03-16T21:07:53.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.101+0000 7f7685600640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76700a1c40 0x7f76700a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:53.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.101+0000 7f7685600640 1 -- 172.21.15.8:0/3717579609 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7680014070 con 0x7f76881096c0 2024-03-16T21:07:53.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.101+0000 7f768ce00640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76700a1c40 0x7f76700a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:53.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.102+0000 7f768ce00640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76700a1c40 0x7f76700a4100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f767c009b50 tx=0x7f767c005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:53.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.105+0000 7f7685600640 1 -- 172.21.15.8:0/3717579609 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7680096c90 con 0x7f76881096c0 2024-03-16T21:07:53.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.334+0000 7f768f800640 1 -- 172.21.15.8:0/3717579609 --> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f76881139f0 con 0x7f76700a1c40 2024-03-16T21:07:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.350+0000 7f7685600640 1 -- 172.21.15.8:0/3717579609 <== mgr.15240 v2:172.21.15.8:6800/4227086558 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+350 (secure 0 0 0) 0x7f76881139f0 con 0x7f76700a1c40 2024-03-16T21:07:53.356 INFO:teuthology.orchestra.run.smithi008.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-03-16T00:00:00", "created": "2024-03-16T20:57:50", "first": "2024-03-16T20:58:00", "last": "2024-03-16T21:07:00", "last_pruned": "2024-03-16T21:07:00", "created_count": 10, "pruned_count": 3, "active": true} 2024-03-16T21:07:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 -- 172.21.15.8:0/3717579609 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76700a1c40 msgr2=0x7f76700a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76700a1c40 0x7f76700a4100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f767c009b50 tx=0x7f767c005f90 comp rx=0 tx=0).stop 2024-03-16T21:07:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 -- 172.21.15.8:0/3717579609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76881096c0 msgr2=0x7f768819e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76881096c0 0x7f768819e680 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f768000eb10 tx=0x7f768000c2d0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 -- 172.21.15.8:0/3717579609 shutdown_connections 2024-03-16T21:07:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f76700a1c40 0x7f76700a4100 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76881096c0 0x7f768819e680 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7688104070 0x7f768819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 --2- 172.21.15.8:0/3717579609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76881036b0 0x7f7688199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 -- 172.21.15.8:0/3717579609 >> 172.21.15.8:0/3717579609 conn(0x7f76880ff1e0 msgr2=0x7f76880ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 -- 172.21.15.8:0/3717579609 shutdown_connections 2024-03-16T21:07:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.353+0000 7f768f800640 1 -- 172.21.15.8:0/3717579609 wait complete. 2024-03-16T21:07:53.381 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-03-16T21:07:53.462 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:53 smithi008 ceph-mon[31434]: pgmap v310: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:07:53.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.592+0000 7fc61a200640 1 -- 172.21.15.8:0/3742762106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc614075a20 msgr2=0x7fc614075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:53.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.592+0000 7fc61a200640 1 --2- 172.21.15.8:0/3742762106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc614075a20 0x7fc614075e00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc608009930 tx=0x7fc60802bc30 comp rx=0 tx=0).stop 2024-03-16T21:07:53.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.592+0000 7fc61a200640 1 -- 172.21.15.8:0/3742762106 shutdown_connections 2024-03-16T21:07:53.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.592+0000 7fc61a200640 1 --2- 172.21.15.8:0/3742762106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc614112170 0x7fc614114560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.592+0000 7fc61a200640 1 --2- 172.21.15.8:0/3742762106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc614076340 0x7fc614111c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.592+0000 7fc61a200640 1 --2- 172.21.15.8:0/3742762106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc614075a20 0x7fc614075e00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.592+0000 7fc61a200640 1 -- 172.21.15.8:0/3742762106 >> 172.21.15.8:0/3742762106 conn(0x7fc6140ff000 msgr2=0x7fc614101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:53.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.592+0000 7fc61a200640 1 -- 172.21.15.8:0/3742762106 shutdown_connections 2024-03-16T21:07:53.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.592+0000 7fc61a200640 1 -- 172.21.15.8:0/3742762106 wait complete. 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.593+0000 7fc61a200640 1 Processor -- start 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.593+0000 7fc61a200640 1 -- start start 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.593+0000 7fc61a200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc614075a20 0x7fc61419e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc61a200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc614076340 0x7fc61419e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc61a200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc614112170 0x7fc6141a2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc61a200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6141a2f00 con 0x7fc614075a20 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc61a200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6141a3070 con 0x7fc614076340 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc61a200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6141a3230 con 0x7fc614112170 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc618e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc614075a20 0x7fc61419e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc618e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc614075a20 0x7fc61419e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57332/0 (socket says 172.21.15.8:57332) 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc619800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc614112170 0x7fc6141a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc613e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc614076340 0x7fc61419e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc618e00640 1 -- 172.21.15.8:0/3585033413 learned_addr learned my addr 172.21.15.8:0/3585033413 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:07:53.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc618e00640 1 -- 172.21.15.8:0/3585033413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc614112170 msgr2=0x7fc6141a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:53.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc618e00640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc614112170 0x7fc6141a2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc618e00640 1 -- 172.21.15.8:0/3585033413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc614076340 msgr2=0x7fc61419e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:53.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc618e00640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc614076340 0x7fc61419e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc618e00640 1 -- 172.21.15.8:0/3585033413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608009560 con 0x7fc614075a20 2024-03-16T21:07:53.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.594+0000 7fc613e00640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc614076340 0x7fc61419e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:07:53.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.595+0000 7fc618e00640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc614075a20 0x7fc61419e040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc608000c00 tx=0x7fc60802ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:53.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.595+0000 7fc611600640 1 -- 172.21.15.8:0/3585033413 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608004250 con 0x7fc614075a20 2024-03-16T21:07:53.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.595+0000 7fc611600640 1 -- 172.21.15.8:0/3585033413 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fc6080043b0 con 0x7fc614075a20 2024-03-16T21:07:53.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.595+0000 7fc611600640 1 -- 172.21.15.8:0/3585033413 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608003c50 con 0x7fc614075a20 2024-03-16T21:07:53.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.595+0000 7fc61a200640 1 -- 172.21.15.8:0/3585033413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6141a34b0 con 0x7fc614075a20 2024-03-16T21:07:53.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.595+0000 7fc61a200640 1 -- 172.21.15.8:0/3585033413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6141aad90 con 0x7fc614075a20 2024-03-16T21:07:53.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.596+0000 7fc61a200640 1 -- 172.21.15.8:0/3585033413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61404faa0 con 0x7fc614075a20 2024-03-16T21:07:53.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.598+0000 7fc611600640 1 -- 172.21.15.8:0/3585033413 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fc608004e10 con 0x7fc614075a20 2024-03-16T21:07:53.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.600+0000 7fc611600640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc5fc0a1b90 0x7fc5fc0a4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:07:53.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.600+0000 7fc611600640 1 -- 172.21.15.8:0/3585033413 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc6080efdd0 con 0x7fc614075a20 2024-03-16T21:07:53.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.600+0000 7fc613e00640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc5fc0a1b90 0x7fc5fc0a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:07:53.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.601+0000 7fc613e00640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc5fc0a1b90 0x7fc5fc0a4050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc614102a80 tx=0x7fc600005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:07:53.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.605+0000 7fc611600640 1 -- 172.21.15.8:0/3585033413 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc6080b8d50 con 0x7fc614075a20 2024-03-16T21:07:53.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:53 smithi170 ceph-mon[35947]: pgmap v310: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:07:53.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:53 smithi186 ceph-mon[36391]: pgmap v310: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-03-16T21:07:53.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.829+0000 7fc61a200640 1 -- 172.21.15.8:0/3585033413 --> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc614117be0 con 0x7fc5fc0a1b90 2024-03-16T21:07:53.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.845+0000 7fc611600640 1 -- 172.21.15.8:0/3585033413 <== mgr.15240 v2:172.21.15.8:6800/4227086558 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fc614117be0 con 0x7fc5fc0a1b90 2024-03-16T21:07:53.851 INFO:teuthology.orchestra.run.smithi008.stdout:/ 1m 6m3h 2024-03-16T21:07:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 -- 172.21.15.8:0/3585033413 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc5fc0a1b90 msgr2=0x7fc5fc0a4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc5fc0a1b90 0x7fc5fc0a4050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc614102a80 tx=0x7fc600005f90 comp rx=0 tx=0).stop 2024-03-16T21:07:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 -- 172.21.15.8:0/3585033413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc614075a20 msgr2=0x7fc61419e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:07:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc614075a20 0x7fc61419e040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc608000c00 tx=0x7fc60802ce50 comp rx=0 tx=0).stop 2024-03-16T21:07:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 -- 172.21.15.8:0/3585033413 shutdown_connections 2024-03-16T21:07:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fc5fc0a1b90 0x7fc5fc0a4050 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc614112170 0x7fc6141a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc614076340 0x7fc61419e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 --2- 172.21.15.8:0/3585033413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc614075a20 0x7fc61419e040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:07:53.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 -- 172.21.15.8:0/3585033413 >> 172.21.15.8:0/3585033413 conn(0x7fc6140ff000 msgr2=0x7fc6141013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:07:53.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 -- 172.21.15.8:0/3585033413 shutdown_connections 2024-03-16T21:07:53.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:07:53.848+0000 7fc61a200640 1 -- 172.21.15.8:0/3585033413 wait complete. 2024-03-16T21:07:53.874 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-03-16T21:07:53.885 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-03-16T21:07:55.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:55 smithi008 ceph-mon[31434]: from='client.27796 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T21:07:55.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:55 smithi008 ceph-mon[31434]: pgmap v311: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:07:55.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:55 smithi008 ceph-mon[31434]: from='client.17598 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T21:07:55.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:55 smithi170 ceph-mon[35947]: from='client.27796 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T21:07:55.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:55 smithi170 ceph-mon[35947]: pgmap v311: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:07:55.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:55 smithi170 ceph-mon[35947]: from='client.17598 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T21:07:55.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:55 smithi186 ceph-mon[36391]: from='client.27796 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T21:07:55.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:55 smithi186 ceph-mon[36391]: pgmap v311: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-03-16T21:07:55.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:55 smithi186 ceph-mon[36391]: from='client.17598 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T21:07:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:57 smithi008 ceph-mon[31434]: pgmap v312: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-16T21:07:57.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:57 smithi170 ceph-mon[35947]: pgmap v312: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-16T21:07:57.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:57 smithi186 ceph-mon[36391]: pgmap v312: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-16T21:07:58.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:07:58 smithi170 ceph-mon[35947]: pgmap v313: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-16T21:07:58.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:07:58 smithi186 ceph-mon[36391]: pgmap v313: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-16T21:07:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:07:58 smithi008 ceph-mon[31434]: pgmap v313: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-16T21:08:00.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:00 smithi170 ceph-mon[35947]: pgmap v314: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-03-16T21:08:00.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:00 smithi186 ceph-mon[36391]: pgmap v314: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-03-16T21:08:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:00 smithi008 ceph-mon[31434]: pgmap v314: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-03-16T21:08:02.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:02 smithi186 ceph-mon[36391]: pgmap v315: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-16T21:08:02.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:02 smithi008 ceph-mon[31434]: pgmap v315: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-16T21:08:03.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:02 smithi170 ceph-mon[35947]: pgmap v315: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-16T21:08:04.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:04 smithi186 ceph-mon[36391]: pgmap v316: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-03-16T21:08:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:04 smithi008 ceph-mon[31434]: pgmap v316: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-03-16T21:08:05.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:04 smithi170 ceph-mon[35947]: pgmap v316: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-03-16T21:08:06.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:06 smithi186 ceph-mon[36391]: pgmap v317: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-16T21:08:06.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:06 smithi008 ceph-mon[31434]: pgmap v317: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-16T21:08:07.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:06 smithi170 ceph-mon[35947]: pgmap v317: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-03-16T21:08:08.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:08 smithi186 ceph-mon[36391]: pgmap v318: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-03-16T21:08:08.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:08 smithi008 ceph-mon[31434]: pgmap v318: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-03-16T21:08:09.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:08 smithi170 ceph-mon[35947]: pgmap v318: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-03-16T21:08:09.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:09 smithi008 ceph-mon[31434]: osdmap e96: 12 total, 12 up, 12 in 2024-03-16T21:08:10.019 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:09 smithi170 ceph-mon[35947]: osdmap e96: 12 total, 12 up, 12 in 2024-03-16T21:08:10.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:09 smithi186 ceph-mon[36391]: osdmap e96: 12 total, 12 up, 12 in 2024-03-16T21:08:10.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:10 smithi008 ceph-mon[31434]: pgmap v320: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-03-16T21:08:11.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:10 smithi170 ceph-mon[35947]: pgmap v320: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-03-16T21:08:11.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:10 smithi186 ceph-mon[36391]: pgmap v320: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-03-16T21:08:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:12 smithi008 ceph-mon[31434]: pgmap v321: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-03-16T21:08:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:12 smithi008 ceph-mon[31434]: osdmap e97: 12 total, 12 up, 12 in 2024-03-16T21:08:13.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:12 smithi170 ceph-mon[35947]: pgmap v321: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-03-16T21:08:13.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:12 smithi170 ceph-mon[35947]: osdmap e97: 12 total, 12 up, 12 in 2024-03-16T21:08:13.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:12 smithi186 ceph-mon[36391]: pgmap v321: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-03-16T21:08:13.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:12 smithi186 ceph-mon[36391]: osdmap e97: 12 total, 12 up, 12 in 2024-03-16T21:08:13.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T21:08:13.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T21:08:13.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.529+0000 7f6c8fc00640 1 -- 172.21.15.8:0/494309864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88104050 msgr2=0x7f6c88110560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.529+0000 7f6c8fc00640 1 --2- 172.21.15.8:0/494309864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88104050 0x7f6c88110560 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009c10 tx=0x7f6c8002bef0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.529+0000 7f6c8fc00640 1 -- 172.21.15.8:0/494309864 shutdown_connections 2024-03-16T21:08:13.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.529+0000 7f6c8fc00640 1 --2- 172.21.15.8:0/494309864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88104050 0x7f6c88110560 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.529+0000 7f6c8fc00640 1 --2- 172.21.15.8:0/494309864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c88103690 0x7f6c88103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.529+0000 7f6c8fc00640 1 --2- 172.21.15.8:0/494309864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c881096a0 0x7f6c88109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.529+0000 7f6c8fc00640 1 -- 172.21.15.8:0/494309864 >> 172.21.15.8:0/494309864 conn(0x7f6c880ff1a0 msgr2=0x7f6c881015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:13.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.529+0000 7f6c8fc00640 1 -- 172.21.15.8:0/494309864 shutdown_connections 2024-03-16T21:08:13.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.529+0000 7f6c8fc00640 1 -- 172.21.15.8:0/494309864 wait complete. 2024-03-16T21:08:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.530+0000 7f6c8fc00640 1 Processor -- start 2024-03-16T21:08:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.530+0000 7f6c8fc00640 1 -- start start 2024-03-16T21:08:13.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.530+0000 7f6c8fc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c88103690 0x7f6c88199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8fc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88104050 0x7f6c8819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8fc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c881096a0 0x7f6c8819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8fc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8819ecb0 con 0x7f6c88103690 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8fc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8819ee20 con 0x7f6c881096a0 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8fc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8819efe0 con 0x7f6c88104050 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c88103690 0x7f6c88199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c87e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88104050 0x7f6c8819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c881096a0 0x7f6c8819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c88103690 0x7f6c88199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43176/0 (socket says 172.21.15.8:43176) 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8d200640 1 -- 172.21.15.8:0/3308611771 learned_addr learned my addr 172.21.15.8:0/3308611771 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8dc00640 1 -- 172.21.15.8:0/3308611771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88104050 msgr2=0x7f6c8819a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8dc00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88104050 0x7f6c8819a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8dc00640 1 -- 172.21.15.8:0/3308611771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c88103690 msgr2=0x7f6c88199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8dc00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c88103690 0x7f6c88199df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8dc00640 1 -- 172.21.15.8:0/3308611771 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c74009490 con 0x7f6c881096a0 2024-03-16T21:08:13.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c8d200640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c88103690 0x7f6c88199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:13.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.531+0000 7f6c87e00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88104050 0x7f6c8819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:13.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.532+0000 7f6c8dc00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c881096a0 0x7f6c8819e6b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6c8002c430 tx=0x7f6c80033700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:13.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.532+0000 7f6c85600640 1 -- 172.21.15.8:0/3308611771 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80003b80 con 0x7f6c881096a0 2024-03-16T21:08:13.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.532+0000 7f6c8fc00640 1 -- 172.21.15.8:0/3308611771 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c80009840 con 0x7f6c881096a0 2024-03-16T21:08:13.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.532+0000 7f6c85600640 1 -- 172.21.15.8:0/3308611771 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6c80003ce0 con 0x7f6c881096a0 2024-03-16T21:08:13.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.532+0000 7f6c85600640 1 -- 172.21.15.8:0/3308611771 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8003e8b0 con 0x7f6c881096a0 2024-03-16T21:08:13.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.532+0000 7f6c8fc00640 1 -- 172.21.15.8:0/3308611771 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c881a6960 con 0x7f6c881096a0 2024-03-16T21:08:13.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.535+0000 7f6c929b0740 1 Processor -- start 2024-03-16T21:08:13.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.535+0000 7f6c85600640 1 -- 172.21.15.8:0/3308611771 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f6c8003ea10 con 0x7f6c881096a0 2024-03-16T21:08:13.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.536+0000 7f6c929b0740 1 -- start start 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.536+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.536+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7b8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.536+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.536+0000 7f6c929b0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab727150 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.536+0000 7f6c929b0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab724680 con 0x55a7ab7b82c0 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.536+0000 7f6c929b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab71fe60 con 0x55a7ab7c1630 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.536+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.536+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7b8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32822/0 (socket says 172.21.15.8:32822) 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.536+0000 7f6c8d200640 1 -- 172.21.15.8:0/2902489321 learned_addr learned my addr 172.21.15.8:0/2902489321 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.536+0000 7f6c87e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c87e00640 1 --2- 172.21.15.8:0/2902489321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c8d200640 1 -- 172.21.15.8:0/2902489321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 msgr2=0x55a7ab7c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c8d200640 1 --2- 172.21.15.8:0/2902489321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7c3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c8d200640 1 -- 172.21.15.8:0/2902489321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b8fa0 msgr2=0x55a7ab7b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c8d200640 1 --2- 172.21.15.8:0/2902489321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c8d200640 1 -- 172.21.15.8:0/2902489321 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7ab6d9060 con 0x55a7ab7b82c0 2024-03-16T21:08:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c87e00640 1 --2- 172.21.15.8:0/2902489321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T21:08:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c8d200640 1 --2- 172.21.15.8:0/2902489321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7b8740 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c011540 tx=0x7f6c7c011a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcfc295f6a134745 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c85600640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c700a1ba0 0x7f6c700a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c85600640 1 -- 172.21.15.8:0/3308611771 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6c800f0460 con 0x7f6c881096a0 2024-03-16T21:08:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c7a000640 1 -- 172.21.15.8:0/2902489321 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00f640 con 0x55a7ab7b82c0 2024-03-16T21:08:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c7a000640 1 -- 172.21.15.8:0/2902489321 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6c7c00fca0 con 0x55a7ab7b82c0 2024-03-16T21:08:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c7a000640 1 -- 172.21.15.8:0/2902489321 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0183b0 con 0x55a7ab7b82c0 2024-03-16T21:08:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.537+0000 7f6c87e00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c700a1ba0 0x7f6c700a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.538+0000 7f6c929b0740 1 -- 172.21.15.8:0/2902489321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 msgr2=0x55a7ab7b8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.538+0000 7f6c87e00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c700a1ba0 0x7f6c700a4060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c740097e0 tx=0x7f6c74009770 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.538+0000 7f6c929b0740 1 --2- 172.21.15.8:0/2902489321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7b8740 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c011540 tx=0x7f6c7c011a00 comp rx=0 tx=0).stop 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.539+0000 7f6c929b0740 1 -- 172.21.15.8:0/2902489321 shutdown_connections 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.539+0000 7f6c929b0740 1 --2- 172.21.15.8:0/2902489321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.539+0000 7f6c929b0740 1 --2- 172.21.15.8:0/2902489321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7b8740 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.539+0000 7f6c929b0740 1 --2- 172.21.15.8:0/2902489321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.539+0000 7f6c929b0740 1 -- 172.21.15.8:0/2902489321 >> 172.21.15.8:0/2902489321 conn(0x55a7ab77f5a0 msgr2=0x55a7ab7b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.539+0000 7f6c929b0740 1 -- 172.21.15.8:0/2902489321 shutdown_connections 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.539+0000 7f6c929b0740 1 -- 172.21.15.8:0/2902489321 wait complete. 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.539+0000 7f6c929b0740 1 -- start start 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.540+0000 7f6c929b0740 1 Processor -- start 2024-03-16T21:08:13.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.540+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7be650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.540+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7beb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.540+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7bf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.540+0000 7f6c929b0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab6c4ec0 con 0x55a7ab7b82c0 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.540+0000 7f6c929b0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab6c4b60 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.540+0000 7f6c929b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab48e1c0 con 0x55a7ab7c1630 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.540+0000 7f6c929b0740 10 client.0 _ll_register_callbacks cb 0x55a7ab6d8960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c87e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7beb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c8dc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7bf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7be650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c87e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7beb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32836/0 (socket says 172.21.15.8:32836) 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c87e00640 1 -- 172.21.15.8:0/4259262616 learned_addr learned my addr 172.21.15.8:0/4259262616 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c87e00640 1 -- 172.21.15.8:0/4259262616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 msgr2=0x55a7ab7bf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c87e00640 1 --2- 172.21.15.8:0/4259262616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7bf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c87e00640 1 -- 172.21.15.8:0/4259262616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b82c0 msgr2=0x55a7ab7be650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c87e00640 1 --2- 172.21.15.8:0/4259262616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7be650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c87e00640 1 -- 172.21.15.8:0/4259262616 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c009d30 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c87e00640 1 --2- 172.21.15.8:0/4259262616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7beb90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400f980 tx=0x7f6c74004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b0b88f1f86a2bd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:13.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c6ea00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:08:13.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.541+0000 7f6c6ea00640 1 -- 172.21.15.8:0/4259262616 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74018070 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.542+0000 7f6c929b0740 1 -- 172.21.15.8:0/4259262616 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7ab41f7e0 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.542+0000 7f6c6ea00640 1 -- 172.21.15.8:0/4259262616 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6c74003d80 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.542+0000 7f6c6ea00640 1 -- 172.21.15.8:0/4259262616 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c7402a470 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.542+0000 7f6c929b0740 10 client.27803 fetch_fsmap learned FSMap version 36 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.542+0000 7f6c929b0740 1 -- 172.21.15.8:0/4259262616 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a7ab71e4e0 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.542+0000 7f6c6ea00640 1 -- 172.21.15.8:0/4259262616 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x55a7ab41f7e0 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.542+0000 7f6c6ea00640 1 -- 172.21.15.8:0/4259262616 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6c740338f0 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.542+0000 7f6c929b0740 10 client.27803 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.542+0000 7f6c929b0740 10 client.27803 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.543+0000 7f6c929b0740 20 client.27803 populate_metadata read hostname 'smithi008' 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.543+0000 7f6c929b0740 1 --2- 172.21.15.8:0/4259262616 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a7ab7d16c0 0x55a7ab7d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.543+0000 7f6c929b0740 4 client.27803 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.543+0000 7f6c929b0740 1 -- 172.21.15.8:0/4259262616 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7ab45c720 con 0x55a7ab7d16c0 2024-03-16T21:08:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.543+0000 7f6c8d200640 1 --2- 172.21.15.8:0/4259262616 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a7ab7d16c0 0x55a7ab7d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.543+0000 7f6c8d200640 1 --2- 172.21.15.8:0/4259262616 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a7ab7d16c0 0x55a7ab7d3b00 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46fdea1874318400 server_cookie=a56b39532f56c1dc in_seq=0 out_seq=0 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.543+0000 7f6c6ea00640 10 client.27803 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.544+0000 7f6c6ea00640 1 -- 172.21.15.8:0/4259262616 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a7ab45c720 con 0x55a7ab7d16c0 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.544+0000 7f6c6ea00640 10 client.27803 handle_command_reply: tid=0 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 1 client.27803 shutdown 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 1 -- 172.21.15.8:0/4259262616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b8fa0 msgr2=0x55a7ab7beb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 1 --2- 172.21.15.8:0/4259262616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7beb90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400f980 tx=0x7f6c74004730 comp rx=0 tx=0).stop 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 1 -- 172.21.15.8:0/4259262616 shutdown_connections 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 1 --2- 172.21.15.8:0/4259262616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7bf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 1 --2- 172.21.15.8:0/4259262616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7beb90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 1 --2- 172.21.15.8:0/4259262616 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a7ab7d16c0 0x55a7ab7d3b00 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 1 --2- 172.21.15.8:0/4259262616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7be650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c6ea00640 0 client.27803 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 1 -- 172.21.15.8:0/4259262616 >> 172.21.15.8:0/4259262616 conn(0x55a7ab77f5a0 msgr2=0x55a7ab7b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 1 -- 172.21.15.8:0/4259262616 shutdown_connections 2024-03-16T21:08:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 1 -- 172.21.15.8:0/4259262616 wait complete. 2024-03-16T21:08:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.545+0000 7f6c929b0740 20 client.27803 trim_cache size 0 max 16384 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c929b0740 1 Processor -- start 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c929b0740 1 -- start start 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7beef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c929b0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab7ae440 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c929b0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab7b7570 con 0x55a7ab7b82c0 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c929b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab7adcc0 con 0x55a7ab7c1630 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c87e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7beef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32850/0 (socket says 172.21.15.8:32850) 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.563+0000 7f6c8d200640 1 -- 172.21.15.8:0/2118928195 learned_addr learned my addr 172.21.15.8:0/2118928195 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.564+0000 7f6c8dc00640 1 --2- 172.21.15.8:0/2118928195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.564+0000 7f6c8d200640 1 -- 172.21.15.8:0/2118928195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 msgr2=0x55a7ab7cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.564+0000 7f6c8d200640 1 --2- 172.21.15.8:0/2118928195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.564+0000 7f6c8d200640 1 -- 172.21.15.8:0/2118928195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b8fa0 msgr2=0x55a7ab7beef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.564+0000 7f6c8d200640 1 --2- 172.21.15.8:0/2118928195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7beef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.564+0000 7f6c8d200640 1 -- 172.21.15.8:0/2118928195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7ab6ba950 con 0x55a7ab7b82c0 2024-03-16T21:08:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.564+0000 7f6c87e00640 1 --2- 172.21.15.8:0/2118928195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7beef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.564+0000 7f6c8d200640 1 --2- 172.21.15.8:0/2118928195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c0d80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c011540 tx=0x7f6c7c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de0f55dd8962e071 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:13.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.564+0000 7f6c79600640 1 -- 172.21.15.8:0/2118928195 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c019e40 con 0x55a7ab7b82c0 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.564+0000 7f6c79600640 1 -- 172.21.15.8:0/2118928195 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6c7c009b60 con 0x55a7ab7b82c0 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.564+0000 7f6c79600640 1 -- 172.21.15.8:0/2118928195 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00f930 con 0x55a7ab7b82c0 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.565+0000 7f6c929b0740 1 -- 172.21.15.8:0/2118928195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 msgr2=0x55a7ab7c0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.565+0000 7f6c929b0740 1 --2- 172.21.15.8:0/2118928195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c0d80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c011540 tx=0x7f6c7c000bc0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.565+0000 7f6c929b0740 1 -- 172.21.15.8:0/2118928195 shutdown_connections 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.565+0000 7f6c929b0740 1 --2- 172.21.15.8:0/2118928195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7c1630 0x55a7ab7cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.565+0000 7f6c929b0740 1 --2- 172.21.15.8:0/2118928195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7beef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.565+0000 7f6c929b0740 1 --2- 172.21.15.8:0/2118928195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c0d80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.565+0000 7f6c929b0740 1 -- 172.21.15.8:0/2118928195 >> 172.21.15.8:0/2118928195 conn(0x55a7ab77f5a0 msgr2=0x55a7ab7b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.565+0000 7f6c929b0740 1 -- 172.21.15.8:0/2118928195 shutdown_connections 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.565+0000 7f6c929b0740 1 -- 172.21.15.8:0/2118928195 wait complete. 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.566+0000 7f6c929b0740 1 -- start start 2024-03-16T21:08:13.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.566+0000 7f6c929b0740 1 Processor -- start 2024-03-16T21:08:13.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.566+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.566+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.566+0000 7f6c929b0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7c1630 0x55a7ab7c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.566+0000 7f6c929b0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab7c98c0 con 0x55a7ab7c1630 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.566+0000 7f6c929b0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab7c3120 con 0x55a7ab7b82c0 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.566+0000 7f6c929b0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7ab7c32e0 con 0x55a7ab7b8fa0 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.566+0000 7f6c929b0740 10 client.0 _ll_register_callbacks cb 0x7f6c74004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c8d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32864/0 (socket says 172.21.15.8:32864) 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c87e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c8d200640 1 -- 172.21.15.8:0/481678933 learned_addr learned my addr 172.21.15.8:0/481678933 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c8dc00640 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7c1630 0x55a7ab7c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c8d200640 1 -- 172.21.15.8:0/481678933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7b8fa0 msgr2=0x55a7ab7c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c8d200640 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c8d200640 1 -- 172.21.15.8:0/481678933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7c1630 msgr2=0x55a7ab7c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c8d200640 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7c1630 0x55a7ab7c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c8d200640 1 -- 172.21.15.8:0/481678933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7ab71e4e0 con 0x55a7ab7b82c0 2024-03-16T21:08:13.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c87e00640 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c8d200640 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c9010 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c01b040 tx=0x7f6c7c0197d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d30fa66084ace261 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.567+0000 7f6c6ea00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.568+0000 7f6c6ea00640 1 -- 172.21.15.8:0/481678933 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c029210 con 0x55a7ab7b82c0 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.568+0000 7f6c929b0740 1 -- 172.21.15.8:0/481678933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c7c00fca0 con 0x55a7ab7b82c0 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.568+0000 7f6c6ea00640 1 -- 172.21.15.8:0/481678933 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6c7c011040 con 0x55a7ab7b82c0 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.568+0000 7f6c6ea00640 1 -- 172.21.15.8:0/481678933 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c7c011200 con 0x55a7ab7b82c0 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.568+0000 7f6c929b0740 10 client.27809 fetch_fsmap learned FSMap version 36 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.568+0000 7f6c929b0740 1 -- 172.21.15.8:0/481678933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a7ab6d9060 con 0x55a7ab7b82c0 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.568+0000 7f6c6ea00640 1 -- 172.21.15.8:0/481678933 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6c7c00fca0 con 0x55a7ab7b82c0 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.568+0000 7f6c6ea00640 1 -- 172.21.15.8:0/481678933 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6c7c029870 con 0x55a7ab7b82c0 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.569+0000 7f6c929b0740 10 client.27809 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.569+0000 7f6c929b0740 10 client.27809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.569+0000 7f6c929b0740 20 client.27809 populate_metadata read hostname 'smithi008' 2024-03-16T21:08:13.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.569+0000 7f6c929b0740 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a7ab82e1a0 0x55a7ab8305c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.569+0000 7f6c929b0740 4 client.27809 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.569+0000 7f6c929b0740 1 -- 172.21.15.8:0/481678933 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a7ab4ab890 con 0x55a7ab82e1a0 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.569+0000 7f6c87e00640 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a7ab82e1a0 0x55a7ab8305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.569+0000 7f6c87e00640 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a7ab82e1a0 0x55a7ab8305c0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aee624ec537351d server_cookie=3cc1d8e0c20495a9 in_seq=0 out_seq=0 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c6ea00640 10 client.27809 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c6ea00640 1 -- 172.21.15.8:0/481678933 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a7ab4ab890 con 0x55a7ab82e1a0 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c6ea00640 10 client.27809 handle_command_reply: tid=0 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 1 client.27809 shutdown 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 1 -- 172.21.15.8:0/481678933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 msgr2=0x55a7ab7c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c9010 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c01b040 tx=0x7f6c7c0197d0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 1 -- 172.21.15.8:0/481678933 shutdown_connections 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x55a7ab82e1a0 0x55a7ab8305c0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7ab7c1630 0x55a7ab7c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a7ab7b8fa0 0x55a7ab7c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c6ea00640 0 client.27809 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:08:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 1 --2- 172.21.15.8:0/481678933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7ab7b82c0 0x55a7ab7c9010 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 1 -- 172.21.15.8:0/481678933 >> 172.21.15.8:0/481678933 conn(0x55a7ab77f5a0 msgr2=0x55a7ab7b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 1 -- 172.21.15.8:0/481678933 shutdown_connections 2024-03-16T21:08:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 1 -- 172.21.15.8:0/481678933 wait complete. 2024-03-16T21:08:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.570+0000 7f6c929b0740 20 client.27809 trim_cache size 0 max 16384 2024-03-16T21:08:13.580 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:08:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2024-03-16T21:08:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2024-03-16T21:08:13.580 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:08:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 -- 172.21.15.8:0/3308611771 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c700a1ba0 msgr2=0x7f6c700a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c700a1ba0 0x7f6c700a4060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c740097e0 tx=0x7f6c74009770 comp rx=0 tx=0).stop 2024-03-16T21:08:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 -- 172.21.15.8:0/3308611771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c881096a0 msgr2=0x7f6c8819e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c881096a0 0x7f6c8819e6b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6c8002c430 tx=0x7f6c80033700 comp rx=0 tx=0).stop 2024-03-16T21:08:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 -- 172.21.15.8:0/3308611771 shutdown_connections 2024-03-16T21:08:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f6c700a1ba0 0x7f6c700a4060 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c881096a0 0x7f6c8819e6b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88104050 0x7f6c8819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 --2- 172.21.15.8:0/3308611771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c88103690 0x7f6c88199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 -- 172.21.15.8:0/3308611771 >> 172.21.15.8:0/3308611771 conn(0x7f6c880ff1a0 msgr2=0x7f6c880ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 -- 172.21.15.8:0/3308611771 shutdown_connections 2024-03-16T21:08:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.571+0000 7f6c8fc00640 1 -- 172.21.15.8:0/3308611771 wait complete. 2024-03-16T21:08:13.592 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T21:08:13.593 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:08:13.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.777+0000 7f9792200640 1 -- 172.21.15.8:0/1036311687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978c104040 msgr2=0x7f978c110550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.777+0000 7f9792200640 1 --2- 172.21.15.8:0/1036311687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978c104040 0x7f978c110550 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9784009c10 tx=0x7f978402bee0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.777+0000 7f9792200640 1 -- 172.21.15.8:0/1036311687 shutdown_connections 2024-03-16T21:08:13.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.777+0000 7f9792200640 1 --2- 172.21.15.8:0/1036311687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978c104040 0x7f978c110550 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.777+0000 7f9792200640 1 --2- 172.21.15.8:0/1036311687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f978c103680 0x7f978c103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.777+0000 7f9792200640 1 --2- 172.21.15.8:0/1036311687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f978c109690 0x7f978c109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.777+0000 7f9792200640 1 -- 172.21.15.8:0/1036311687 >> 172.21.15.8:0/1036311687 conn(0x7f978c0ff150 msgr2=0x7f978c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:13.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.777+0000 7f9792200640 1 -- 172.21.15.8:0/1036311687 shutdown_connections 2024-03-16T21:08:13.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.777+0000 7f9792200640 1 -- 172.21.15.8:0/1036311687 wait complete. 2024-03-16T21:08:13.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.778+0000 7f9792200640 1 Processor -- start 2024-03-16T21:08:13.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.778+0000 7f9792200640 1 -- start start 2024-03-16T21:08:13.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.778+0000 7f9792200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f978c103680 0x7f978c199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.778+0000 7f9792200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978c104040 0x7f978c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.778+0000 7f9792200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f978c109690 0x7f978c19e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.778+0000 7f9792200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c19eca0 con 0x7f978c103680 2024-03-16T21:08:13.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.778+0000 7f9792200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c19ee10 con 0x7f978c109690 2024-03-16T21:08:13.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.778+0000 7f9792200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c19efd0 con 0x7f978c104040 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.779+0000 7f978aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978c104040 0x7f978c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.779+0000 7f978be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f978c109690 0x7f978c19e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.779+0000 7f978aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978c104040 0x7f978c19a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36614/0 (socket says 172.21.15.8:36614) 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.779+0000 7f978aa00640 1 -- 172.21.15.8:0/799050354 learned_addr learned my addr 172.21.15.8:0/799050354 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.779+0000 7f978b400640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f978c103680 0x7f978c199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.779+0000 7f978aa00640 1 -- 172.21.15.8:0/799050354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f978c109690 msgr2=0x7f978c19e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.779+0000 7f978aa00640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f978c109690 0x7f978c19e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.779+0000 7f978aa00640 1 -- 172.21.15.8:0/799050354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f978c103680 msgr2=0x7f978c199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.779+0000 7f978aa00640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f978c103680 0x7f978c199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.779+0000 7f978aa00640 1 -- 172.21.15.8:0/799050354 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9784009840 con 0x7f978c104040 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.779+0000 7f978aa00640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978c104040 0x7f978c19a370 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f977800e9f0 tx=0x7f977800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.780+0000 7f9783e00640 1 -- 172.21.15.8:0/799050354 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778009720 con 0x7f978c104040 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.780+0000 7f9783e00640 1 -- 172.21.15.8:0/799050354 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f977800cd80 con 0x7f978c104040 2024-03-16T21:08:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.780+0000 7f9792200640 1 -- 172.21.15.8:0/799050354 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c19f2b0 con 0x7f978c104040 2024-03-16T21:08:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.780+0000 7f9783e00640 1 -- 172.21.15.8:0/799050354 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778010690 con 0x7f978c104040 2024-03-16T21:08:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.780+0000 7f9792200640 1 -- 172.21.15.8:0/799050354 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978c1a6b30 con 0x7f978c104040 2024-03-16T21:08:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.781+0000 7f9792200640 1 -- 172.21.15.8:0/799050354 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978c068730 con 0x7f978c104040 2024-03-16T21:08:13.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.783+0000 7f9783e00640 1 -- 172.21.15.8:0/799050354 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f97780046c0 con 0x7f978c104040 2024-03-16T21:08:13.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.785+0000 7f9783e00640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f97700a1c20 0x7f97700a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:13.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.785+0000 7f9783e00640 1 -- 172.21.15.8:0/799050354 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9778014070 con 0x7f978c104040 2024-03-16T21:08:13.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.785+0000 7f978b400640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f97700a1c20 0x7f97700a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:13.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.786+0000 7f978b400640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f97700a1c20 0x7f97700a40e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f977c005fd0 tx=0x7f977c009260 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:13.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:13.788+0000 7f9783e00640 1 -- 172.21.15.8:0/799050354 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9778096a60 con 0x7f978c104040 2024-03-16T21:08:13.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:13 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:08:13.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:13 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:13.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:13 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:13.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:13 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:13.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:13 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:13.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:13 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.026+0000 7f9792200640 1 -- 172.21.15.8:0/799050354 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f978c19b130 con 0x7f978c104040 2024-03-16T21:08:14.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.027+0000 7f9783e00640 1 -- 172.21.15.8:0/799050354 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f977809a120 con 0x7f978c104040 2024-03-16T21:08:14.033 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:08:14.033 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:27.879028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:08:14.033 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-03-16T21:08:14.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 -- 172.21.15.8:0/799050354 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f97700a1c20 msgr2=0x7f97700a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f97700a1c20 0x7f97700a40e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f977c005fd0 tx=0x7f977c009260 comp rx=0 tx=0).stop 2024-03-16T21:08:14.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 -- 172.21.15.8:0/799050354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978c104040 msgr2=0x7f978c19a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978c104040 0x7f978c19a370 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f977800e9f0 tx=0x7f977800edf0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 -- 172.21.15.8:0/799050354 shutdown_connections 2024-03-16T21:08:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f97700a1c20 0x7f97700a40e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f978c109690 0x7f978c19e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978c104040 0x7f978c19a370 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 --2- 172.21.15.8:0/799050354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f978c103680 0x7f978c199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 -- 172.21.15.8:0/799050354 >> 172.21.15.8:0/799050354 conn(0x7f978c0ff150 msgr2=0x7f978c0ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 -- 172.21.15.8:0/799050354 shutdown_connections 2024-03-16T21:08:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.030+0000 7f9792200640 1 -- 172.21.15.8:0/799050354 wait complete. 2024-03-16T21:08:14.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:13 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:08:14.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:13 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:13 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:13 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:13 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.045 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:13 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.054 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:08:14.054 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T21:08:14.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:13 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T21:08:14.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:13 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:13 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:13 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:13 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:13 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.252+0000 7fda5f200640 1 -- 172.21.15.8:0/2168760085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda601015d0 msgr2=0x7fda601019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.252+0000 7fda5f200640 1 --2- 172.21.15.8:0/2168760085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda601015d0 0x7fda601019b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fda50009900 tx=0x7fda5002bc40 comp rx=0 tx=0).stop 2024-03-16T21:08:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.252+0000 7fda5f200640 1 -- 172.21.15.8:0/2168760085 shutdown_connections 2024-03-16T21:08:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.252+0000 7fda5f200640 1 --2- 172.21.15.8:0/2168760085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda601066a0 0x7fda6010e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.252+0000 7fda5f200640 1 --2- 172.21.15.8:0/2168760085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda60101f80 0x7fda60105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.252+0000 7fda5f200640 1 --2- 172.21.15.8:0/2168760085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda601015d0 0x7fda601019b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.252+0000 7fda5f200640 1 -- 172.21.15.8:0/2168760085 >> 172.21.15.8:0/2168760085 conn(0x7fda600fce90 msgr2=0x7fda600ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.252+0000 7fda5f200640 1 -- 172.21.15.8:0/2168760085 shutdown_connections 2024-03-16T21:08:14.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.252+0000 7fda5f200640 1 -- 172.21.15.8:0/2168760085 wait complete. 2024-03-16T21:08:14.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.253+0000 7fda5f200640 1 Processor -- start 2024-03-16T21:08:14.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.254+0000 7fda5f200640 1 -- start start 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.254+0000 7fda5f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda601015d0 0x7fda6019f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.254+0000 7fda5f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda601066a0 0x7fda6019fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.254+0000 7fda5f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda60199ac0 0x7fda60199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.254+0000 7fda5f200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6019a4b0 con 0x7fda60199ac0 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.254+0000 7fda5f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6019a620 con 0x7fda601066a0 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.254+0000 7fda5f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6019a7e0 con 0x7fda601015d0 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.254+0000 7fda5de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda601015d0 0x7fda6019f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.254+0000 7fda5de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda601015d0 0x7fda6019f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36622/0 (socket says 172.21.15.8:36622) 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.254+0000 7fda5de00640 1 -- 172.21.15.8:0/3223191277 learned_addr learned my addr 172.21.15.8:0/3223191277 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.254+0000 7fda5d400640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda601066a0 0x7fda6019fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda5e800640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda60199ac0 0x7fda60199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda5de00640 1 -- 172.21.15.8:0/3223191277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda601066a0 msgr2=0x7fda6019fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda5de00640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda601066a0 0x7fda6019fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda5de00640 1 -- 172.21.15.8:0/3223191277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda60199ac0 msgr2=0x7fda60199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda5de00640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda60199ac0 0x7fda60199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda5de00640 1 -- 172.21.15.8:0/3223191277 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50009560 con 0x7fda601015d0 2024-03-16T21:08:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda5d400640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda601066a0 0x7fda6019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda5e800640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda60199ac0 0x7fda60199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:08:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda5de00640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda601015d0 0x7fda6019f910 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fda50005940 tx=0x7fda5002ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda56a00640 1 -- 172.21.15.8:0/3223191277 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50004450 con 0x7fda601015d0 2024-03-16T21:08:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda56a00640 1 -- 172.21.15.8:0/3223191277 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fda50005310 con 0x7fda601015d0 2024-03-16T21:08:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.255+0000 7fda5f200640 1 -- 172.21.15.8:0/3223191277 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda601a67d0 con 0x7fda601015d0 2024-03-16T21:08:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.256+0000 7fda56a00640 1 -- 172.21.15.8:0/3223191277 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50003e60 con 0x7fda601015d0 2024-03-16T21:08:14.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.256+0000 7fda5f200640 1 -- 172.21.15.8:0/3223191277 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda601a6c80 con 0x7fda601015d0 2024-03-16T21:08:14.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda56a00640 1 -- 172.21.15.8:0/3223191277 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fda50005480 con 0x7fda601015d0 2024-03-16T21:08:14.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda6786a740 1 Processor -- start 2024-03-16T21:08:14.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda6786a740 1 -- start start 2024-03-16T21:08:14.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda6786a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2004df0 0x562fb20051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda6786a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 0x562fb200ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda6786a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb200e2f0 0x562fb20106e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda6786a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb1f73210 con 0x562fb2004df0 2024-03-16T21:08:14.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda6786a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb1f70740 con 0x562fb200e2f0 2024-03-16T21:08:14.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda6786a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb1f6bf20 con 0x562fb2005710 2024-03-16T21:08:14.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda5d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb200e2f0 0x562fb20106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda5e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2004df0 0x562fb20051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda5de00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 0x562fb200ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.259+0000 7fda5d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb200e2f0 0x562fb20106e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32904/0 (socket says 172.21.15.8:32904) 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.260+0000 7fda5d400640 1 -- 172.21.15.8:0/3130780106 learned_addr learned my addr 172.21.15.8:0/3130780106 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.260+0000 7fda5d400640 1 -- 172.21.15.8:0/3130780106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 msgr2=0x562fb200ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.260+0000 7fda5d400640 1 --2- 172.21.15.8:0/3130780106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 0x562fb200ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.260+0000 7fda5d400640 1 -- 172.21.15.8:0/3130780106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2004df0 msgr2=0x562fb20051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.260+0000 7fda5d400640 1 --2- 172.21.15.8:0/3130780106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2004df0 0x562fb20051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.260+0000 7fda5d400640 1 -- 172.21.15.8:0/3130780106 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fb1f2ddf0 con 0x562fb200e2f0 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.260+0000 7fda5d400640 1 --2- 172.21.15.8:0/3130780106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb200e2f0 0x562fb20106e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fda4c011470 tx=0x7fda4c011930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dddafcf2b0c0eb4d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.260+0000 7fda56a00640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fda440a1c20 0x7fda440a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.260+0000 7fda4b000640 1 -- 172.21.15.8:0/3130780106 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c004030 con 0x562fb200e2f0 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.261+0000 7fda4b000640 1 -- 172.21.15.8:0/3130780106 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fda4c004190 con 0x562fb200e2f0 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.261+0000 7fda4b000640 1 -- 172.21.15.8:0/3130780106 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00f980 con 0x562fb200e2f0 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.261+0000 7fda56a00640 1 -- 172.21.15.8:0/3223191277 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fda500ef7a0 con 0x7fda601015d0 2024-03-16T21:08:14.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.261+0000 7fda5e800640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fda440a1c20 0x7fda440a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.261+0000 7fda6786a740 1 -- 172.21.15.8:0/3130780106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb200e2f0 msgr2=0x562fb20106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.261+0000 7fda5e800640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fda440a1c20 0x7fda440a40e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda58005fd0 tx=0x7fda58009780 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.261+0000 7fda6786a740 1 --2- 172.21.15.8:0/3130780106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb200e2f0 0x562fb20106e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fda4c011470 tx=0x7fda4c011930 comp rx=0 tx=0).stop 2024-03-16T21:08:14.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.262+0000 7fda6786a740 1 -- 172.21.15.8:0/3130780106 shutdown_connections 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.262+0000 7fda6786a740 1 --2- 172.21.15.8:0/3130780106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb200e2f0 0x562fb20106e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.262+0000 7fda6786a740 1 --2- 172.21.15.8:0/3130780106 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 0x562fb200ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.262+0000 7fda6786a740 1 --2- 172.21.15.8:0/3130780106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2004df0 0x562fb20051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.262+0000 7fda6786a740 1 -- 172.21.15.8:0/3130780106 >> 172.21.15.8:0/3130780106 conn(0x562fb1fff520 msgr2=0x562fb1fff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.262+0000 7fda6786a740 1 -- 172.21.15.8:0/3130780106 shutdown_connections 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.262+0000 7fda6786a740 1 -- 172.21.15.8:0/3130780106 wait complete. 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.262+0000 7fda6786a740 1 -- start start 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.262+0000 7fda6786a740 1 Processor -- start 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda6786a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb200b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda6786a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 0x562fb200b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda6786a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb200bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda6786a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb1f11150 con 0x562fb2005710 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda6786a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb1f10df0 con 0x562fb2004df0 2024-03-16T21:08:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda6786a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb1cda1c0 con 0x562fb200e2f0 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda6786a740 10 client.0 _ll_register_callbacks cb 0x562fb1f602b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 0x562fb200b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb200bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb200b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 0x562fb200b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43244/0 (socket says 172.21.15.8:43244) 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5d400640 1 -- 172.21.15.8:0/3063799950 learned_addr learned my addr 172.21.15.8:0/3063799950 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5e800640 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb200bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36644/0 (socket says 172.21.15.8:36644) 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5e800640 1 -- 172.21.15.8:0/3063799950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 msgr2=0x562fb200b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5e800640 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb200b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5e800640 1 -- 172.21.15.8:0/3063799950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 msgr2=0x562fb200b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5e800640 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 0x562fb200b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5e800640 1 -- 172.21.15.8:0/3063799950 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4c009c40 con 0x562fb200e2f0 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.263+0000 7fda5de00640 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb200b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.264+0000 7fda5e800640 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb200bd90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fda58009fd0 tx=0x7fda58004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17ff959c3970af02 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.264+0000 7fda3f400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.264+0000 7fda3f400640 1 -- 172.21.15.8:0/3063799950 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58010e20 con 0x562fb200e2f0 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.264+0000 7fda6786a740 1 -- 172.21.15.8:0/3063799950 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562fb1c6b7e0 con 0x562fb200e2f0 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.264+0000 7fda3f400640 1 -- 172.21.15.8:0/3063799950 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fda58028400 con 0x562fb200e2f0 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.264+0000 7fda3f400640 1 -- 172.21.15.8:0/3063799950 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda580285c0 con 0x562fb200e2f0 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.264+0000 7fda6786a740 10 client.27835 fetch_fsmap learned FSMap version 36 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.264+0000 7fda6786a740 1 -- 172.21.15.8:0/3063799950 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562fb1f6a5a0 con 0x562fb200e2f0 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.265+0000 7fda3f400640 1 -- 172.21.15.8:0/3063799950 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x562fb1c6b7e0 con 0x562fb200e2f0 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.265+0000 7fda3f400640 1 -- 172.21.15.8:0/3063799950 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fda58026020 con 0x562fb200e2f0 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.265+0000 7fda6786a740 10 client.27835 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.265+0000 7fda6786a740 10 client.27835 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.265+0000 7fda6786a740 20 client.27835 populate_metadata read hostname 'smithi008' 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.265+0000 7fda6786a740 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x562fb201e3c0 0x562fb20207e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.265+0000 7fda6786a740 4 client.27835 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:08:14.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.265+0000 7fda6786a740 1 -- 172.21.15.8:0/3063799950 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562fb1ca8720 con 0x562fb201e3c0 2024-03-16T21:08:14.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.265+0000 7fda5de00640 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x562fb201e3c0 0x562fb20207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.266+0000 7fda5de00640 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x562fb201e3c0 0x562fb20207e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6a70f81a939efc96 server_cookie=e34fa3a375c5b310 in_seq=0 out_seq=0 2024-03-16T21:08:14.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.266+0000 7fda3f400640 10 client.27835 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:08:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.266+0000 7fda3f400640 1 -- 172.21.15.8:0/3063799950 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x562fb1ca8720 con 0x562fb201e3c0 2024-03-16T21:08:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.266+0000 7fda3f400640 10 client.27835 handle_command_reply: tid=0 2024-03-16T21:08:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 1 client.27835 shutdown 2024-03-16T21:08:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 1 -- 172.21.15.8:0/3063799950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 msgr2=0x562fb200bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb200bd90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fda58009fd0 tx=0x7fda58004a40 comp rx=0 tx=0).stop 2024-03-16T21:08:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 1 -- 172.21.15.8:0/3063799950 shutdown_connections 2024-03-16T21:08:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x562fb201e3c0 0x562fb20207e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb200bd90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda3f400640 0 client.27835 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:08:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 0x562fb200b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 1 --2- 172.21.15.8:0/3063799950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb200b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 1 -- 172.21.15.8:0/3063799950 >> 172.21.15.8:0/3063799950 conn(0x562fb1fff520 msgr2=0x562fb2001270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 1 -- 172.21.15.8:0/3063799950 shutdown_connections 2024-03-16T21:08:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 1 -- 172.21.15.8:0/3063799950 wait complete. 2024-03-16T21:08:14.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.267+0000 7fda6786a740 20 client.27835 trim_cache size 0 max 16384 2024-03-16T21:08:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.281+0000 7fda6786a740 1 Processor -- start 2024-03-16T21:08:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.281+0000 7fda6786a740 1 -- start start 2024-03-16T21:08:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.281+0000 7fda6786a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb1ffa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.281+0000 7fda6786a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 0x562fb20196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.281+0000 7fda6786a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb200e2f0 0x562fb2019be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.281+0000 7fda6786a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb201ae80 con 0x562fb200e2f0 2024-03-16T21:08:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.281+0000 7fda6786a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb200c7a0 con 0x562fb2004df0 2024-03-16T21:08:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.281+0000 7fda6786a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb201a120 con 0x562fb2005710 2024-03-16T21:08:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 0x562fb20196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb1ffa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5d400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 0x562fb20196a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36656/0 (socket says 172.21.15.8:36656) 2024-03-16T21:08:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5d400640 1 -- 172.21.15.8:0/2253178829 learned_addr learned my addr 172.21.15.8:0/2253178829 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5e800640 1 --2- 172.21.15.8:0/2253178829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb200e2f0 0x562fb2019be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5d400640 1 -- 172.21.15.8:0/2253178829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 msgr2=0x562fb1ffa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5d400640 1 --2- 172.21.15.8:0/2253178829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb1ffa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5d400640 1 -- 172.21.15.8:0/2253178829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb200e2f0 msgr2=0x562fb2019be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5d400640 1 --2- 172.21.15.8:0/2253178829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb200e2f0 0x562fb2019be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5d400640 1 -- 172.21.15.8:0/2253178829 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fb1f06ab0 con 0x562fb2005710 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5de00640 1 --2- 172.21.15.8:0/2253178829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb1ffa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.282+0000 7fda5e800640 1 --2- 172.21.15.8:0/2253178829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb200e2f0 0x562fb2019be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.283+0000 7fda5d400640 1 --2- 172.21.15.8:0/2253178829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 0x562fb20196a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fda4c011e30 tx=0x7fda4c003f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7fe725984143801 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.283+0000 7fda4a600640 1 -- 172.21.15.8:0/2253178829 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c003fd0 con 0x562fb2005710 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.283+0000 7fda4a600640 1 -- 172.21.15.8:0/2253178829 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fda4c005540 con 0x562fb2005710 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.283+0000 7fda4a600640 1 -- 172.21.15.8:0/2253178829 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00f8f0 con 0x562fb2005710 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.284+0000 7fda6786a740 1 -- 172.21.15.8:0/2253178829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 msgr2=0x562fb20196a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.284+0000 7fda6786a740 1 --2- 172.21.15.8:0/2253178829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 0x562fb20196a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fda4c011e30 tx=0x7fda4c003f60 comp rx=0 tx=0).stop 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.284+0000 7fda6786a740 1 -- 172.21.15.8:0/2253178829 shutdown_connections 2024-03-16T21:08:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.284+0000 7fda6786a740 1 --2- 172.21.15.8:0/2253178829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb200e2f0 0x562fb2019be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.284+0000 7fda6786a740 1 --2- 172.21.15.8:0/2253178829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb2005710 0x562fb20196a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.284+0000 7fda6786a740 1 --2- 172.21.15.8:0/2253178829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb1ffa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.284+0000 7fda6786a740 1 -- 172.21.15.8:0/2253178829 >> 172.21.15.8:0/2253178829 conn(0x562fb1fff520 msgr2=0x562fb1ffe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.284+0000 7fda6786a740 1 -- 172.21.15.8:0/2253178829 shutdown_connections 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.284+0000 7fda6786a740 1 -- 172.21.15.8:0/2253178829 wait complete. 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.284+0000 7fda6786a740 1 -- start start 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda6786a740 1 Processor -- start 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda6786a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb20157d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda6786a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 0x562fb2015d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda6786a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb20080b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda6786a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb20087b0 con 0x562fb2005710 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda6786a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb2008920 con 0x562fb2004df0 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda6786a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fb2008ae0 con 0x562fb200e2f0 2024-03-16T21:08:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda6786a740 10 client.0 _ll_register_callbacks cb 0x7fda58009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:08:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda5d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 0x562fb2015d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda5de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb20157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda5e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb20080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda5de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb20157d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32938/0 (socket says 172.21.15.8:32938) 2024-03-16T21:08:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda5d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 0x562fb2015d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43260/0 (socket says 172.21.15.8:43260) 2024-03-16T21:08:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda5de00640 1 -- 172.21.15.8:0/1536509191 learned_addr learned my addr 172.21.15.8:0/1536509191 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.285+0000 7fda5e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb20080b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36666/0 (socket says 172.21.15.8:36666) 2024-03-16T21:08:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda5e800640 1 -- 172.21.15.8:0/1536509191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 msgr2=0x562fb20157d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda5e800640 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb20157d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda5e800640 1 -- 172.21.15.8:0/1536509191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 msgr2=0x562fb2015d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda5e800640 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 0x562fb2015d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda5e800640 1 -- 172.21.15.8:0/1536509191 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda601a6c80 con 0x562fb200e2f0 2024-03-16T21:08:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda5de00640 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb20157d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda5e800640 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb20080b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fda58013d30 tx=0x7fda580108b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6b04ba8a5b07480 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda3f400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:08:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda3f400640 1 -- 172.21.15.8:0/1536509191 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58010c20 con 0x562fb200e2f0 2024-03-16T21:08:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda6786a740 1 -- 172.21.15.8:0/1536509191 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562fb1ffac30 con 0x562fb200e2f0 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda3f400640 1 -- 172.21.15.8:0/1536509191 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fda58010d80 con 0x562fb200e2f0 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda3f400640 1 -- 172.21.15.8:0/1536509191 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda58010f40 con 0x562fb200e2f0 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda6786a740 10 client.27841 fetch_fsmap learned FSMap version 36 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.286+0000 7fda6786a740 1 -- 172.21.15.8:0/1536509191 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562fb1f6a5a0 con 0x562fb200e2f0 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.287+0000 7fda3f400640 1 -- 172.21.15.8:0/1536509191 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fda58047020 con 0x562fb200e2f0 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.287+0000 7fda3f400640 1 -- 172.21.15.8:0/1536509191 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fda58026040 con 0x562fb200e2f0 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.287+0000 7fda6786a740 10 client.27841 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.287+0000 7fda6786a740 10 client.27841 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.287+0000 7fda6786a740 20 client.27841 populate_metadata read hostname 'smithi008' 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.287+0000 7fda6786a740 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x562fb207abe0 0x562fb207cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.287+0000 7fda6786a740 4 client.27841 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.287+0000 7fda6786a740 1 -- 172.21.15.8:0/1536509191 --> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fda4c004190 con 0x562fb207abe0 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.287+0000 7fda5de00640 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x562fb207abe0 0x562fb207cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda5de00640 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x562fb207abe0 0x562fb207cfd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4eb49280272b3054 server_cookie=3a082fcff6d600f3 in_seq=0 out_seq=0 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda3f400640 10 client.27841 ms_handle_connect on v2:172.21.15.170:6836/3144558039 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda3f400640 1 -- 172.21.15.8:0/1536509191 <== mds.2 v2:172.21.15.170:6836/3144558039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fda4c004190 con 0x562fb207abe0 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda3f400640 10 client.27841 handle_command_reply: tid=0 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 1 client.27841 shutdown 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 1 -- 172.21.15.8:0/1536509191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 msgr2=0x562fb20080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb20080b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fda58013d30 tx=0x7fda580108b0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 1 -- 172.21.15.8:0/1536509191 shutdown_connections 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.170:6836/3144558039,v1:172.21.15.170:6837/3144558039] conn(0x562fb207abe0 0x562fb207cfd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562fb200e2f0 0x562fb20080b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fb2005710 0x562fb2015d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 1 --2- 172.21.15.8:0/1536509191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562fb2004df0 0x562fb20157d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda3f400640 0 client.27841 ms_handle_reset on v2:172.21.15.170:6836/3144558039 2024-03-16T21:08:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 1 -- 172.21.15.8:0/1536509191 >> 172.21.15.8:0/1536509191 conn(0x562fb1fff520 msgr2=0x562fb2000900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 1 -- 172.21.15.8:0/1536509191 shutdown_connections 2024-03-16T21:08:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 1 -- 172.21.15.8:0/1536509191 wait complete. 2024-03-16T21:08:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.288+0000 7fda6786a740 20 client.27841 trim_cache size 0 max 16384 2024-03-16T21:08:14.299 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 -- 172.21.15.8:0/3223191277 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fda440a1c20 msgr2=0x7fda440a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fda440a1c20 0x7fda440a40e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda58005fd0 tx=0x7fda58009780 comp rx=0 tx=0).stop 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 -- 172.21.15.8:0/3223191277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda601015d0 msgr2=0x7fda6019f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda601015d0 0x7fda6019f910 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fda50005940 tx=0x7fda5002ccb0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 -- 172.21.15.8:0/3223191277 shutdown_connections 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fda440a1c20 0x7fda440a40e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda60199ac0 0x7fda60199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda601066a0 0x7fda6019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 --2- 172.21.15.8:0/3223191277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda601015d0 0x7fda6019f910 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 -- 172.21.15.8:0/3223191277 >> 172.21.15.8:0/3223191277 conn(0x7fda600fce90 msgr2=0x7fda600fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 -- 172.21.15.8:0/3223191277 shutdown_connections 2024-03-16T21:08:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.289+0000 7fda5f200640 1 -- 172.21.15.8:0/3223191277 wait complete. 2024-03-16T21:08:14.312 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:08:14.312 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T21:08:14.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.492+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3114991930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfbc1096a0 msgr2=0x7fcfbc109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.492+0000 7fcfc0a00640 1 --2- 172.21.15.8:0/3114991930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfbc1096a0 0x7fcfbc109a80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009900 tx=0x7fcfac02bc30 comp rx=0 tx=0).stop 2024-03-16T21:08:14.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.492+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3114991930 shutdown_connections 2024-03-16T21:08:14.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.492+0000 7fcfc0a00640 1 --2- 172.21.15.8:0/3114991930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc104050 0x7fcfbc110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.492+0000 7fcfc0a00640 1 --2- 172.21.15.8:0/3114991930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfbc103690 0x7fcfbc103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.492+0000 7fcfc0a00640 1 --2- 172.21.15.8:0/3114991930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfbc1096a0 0x7fcfbc109a80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.492+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3114991930 >> 172.21.15.8:0/3114991930 conn(0x7fcfbc0ff160 msgr2=0x7fcfbc101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.492+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3114991930 shutdown_connections 2024-03-16T21:08:14.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.492+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3114991930 wait complete. 2024-03-16T21:08:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.493+0000 7fcfc0a00640 1 Processor -- start 2024-03-16T21:08:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.493+0000 7fcfc0a00640 1 -- start start 2024-03-16T21:08:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.493+0000 7fcfc0a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfbc103690 0x7fcfbc199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.493+0000 7fcfc0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc104050 0x7fcfbc19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.493+0000 7fcfc0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfbc1096a0 0x7fcfbc19e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.493+0000 7fcfc0a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc19ec50 con 0x7fcfbc104050 2024-03-16T21:08:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfc0a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc19edc0 con 0x7fcfbc1096a0 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfc0a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc19ef80 con 0x7fcfbc103690 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfb9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfbc103690 0x7fcfbc199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfba800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfbc1096a0 0x7fcfbc19e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfba800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfbc1096a0 0x7fcfbc19e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32960/0 (socket says 172.21.15.8:32960) 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfb9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc104050 0x7fcfbc19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfb9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfbc103690 0x7fcfbc199d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36688/0 (socket says 172.21.15.8:36688) 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfba800640 1 -- 172.21.15.8:0/3989457281 learned_addr learned my addr 172.21.15.8:0/3989457281 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfba800640 1 -- 172.21.15.8:0/3989457281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfbc103690 msgr2=0x7fcfbc199d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfba800640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfbc103690 0x7fcfbc199d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfba800640 1 -- 172.21.15.8:0/3989457281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc104050 msgr2=0x7fcfbc19a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfba800640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc104050 0x7fcfbc19a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfba800640 1 -- 172.21.15.8:0/3989457281 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac009560 con 0x7fcfbc1096a0 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.494+0000 7fcfba800640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfbc1096a0 0x7fcfbc19e650 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400eb10 tx=0x7fcfb400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.495+0000 7fcfb2a00640 1 -- 172.21.15.8:0/3989457281 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4004b20 con 0x7fcfbc1096a0 2024-03-16T21:08:14.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.495+0000 7fcfb2a00640 1 -- 172.21.15.8:0/3989457281 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcfb4004c80 con 0x7fcfbc1096a0 2024-03-16T21:08:14.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.495+0000 7fcfb2a00640 1 -- 172.21.15.8:0/3989457281 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4010760 con 0x7fcfbc1096a0 2024-03-16T21:08:14.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.495+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3989457281 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc19f260 con 0x7fcfbc1096a0 2024-03-16T21:08:14.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.495+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3989457281 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc1a6ae0 con 0x7fcfbc1096a0 2024-03-16T21:08:14.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.498+0000 7fcfb2a00640 1 -- 172.21.15.8:0/3989457281 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fcfb4005020 con 0x7fcfbc1096a0 2024-03-16T21:08:14.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.498+0000 7fcfc382c740 1 Processor -- start 2024-03-16T21:08:14.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.498+0000 7fcfc382c740 1 -- start start 2024-03-16T21:08:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b710d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b7115c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 0x5654b7118530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfc382c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b707b210 con 0x5654b710d560 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfc382c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b7078740 con 0x5654b710cc40 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfc382c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b7073f20 con 0x5654b7116140 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfb9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b710d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfb9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b710d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32972/0 (socket says 172.21.15.8:32972) 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfb9400640 1 -- 172.21.15.8:0/755896248 learned_addr learned my addr 172.21.15.8:0/755896248 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfb9400640 1 --2- 172.21.15.8:0/755896248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 0x5654b7118530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/755896248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b7115c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfb9400640 1 -- 172.21.15.8:0/755896248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 msgr2=0x5654b7118530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfb9400640 1 --2- 172.21.15.8:0/755896248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 0x5654b7118530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfb9400640 1 -- 172.21.15.8:0/755896248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 msgr2=0x5654b7115c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfb9400640 1 --2- 172.21.15.8:0/755896248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b7115c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.499+0000 7fcfb9400640 1 -- 172.21.15.8:0/755896248 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654b7035df0 con 0x5654b710cc40 2024-03-16T21:08:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.500+0000 7fcfb2a00640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcfa00a1ba0 0x7fcfa00a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.500+0000 7fcfb9400640 1 --2- 172.21.15.8:0/755896248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b710d020 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80058c0 tx=0x7fcfa8005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=357ef5e46e87bbb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.500+0000 7fcfa7000640 1 -- 172.21.15.8:0/755896248 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8004030 con 0x5654b710cc40 2024-03-16T21:08:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.500+0000 7fcfb2a00640 1 -- 172.21.15.8:0/3989457281 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcfb4014070 con 0x7fcfbc1096a0 2024-03-16T21:08:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.500+0000 7fcfa7000640 1 -- 172.21.15.8:0/755896248 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcfa8005520 con 0x5654b710cc40 2024-03-16T21:08:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.500+0000 7fcfa7000640 1 -- 172.21.15.8:0/755896248 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8004d90 con 0x5654b710cc40 2024-03-16T21:08:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.500+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcfa00a1ba0 0x7fcfa00a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.501+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcfa00a1ba0 0x7fcfa00a4060 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009230 tx=0x7fcfac005fd0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.501+0000 7fcfc382c740 1 -- 172.21.15.8:0/755896248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 msgr2=0x5654b710d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.501+0000 7fcfc382c740 1 --2- 172.21.15.8:0/755896248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b710d020 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80058c0 tx=0x7fcfa8005850 comp rx=0 tx=0).stop 2024-03-16T21:08:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.501+0000 7fcfc382c740 1 -- 172.21.15.8:0/755896248 shutdown_connections 2024-03-16T21:08:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.501+0000 7fcfc382c740 1 --2- 172.21.15.8:0/755896248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 0x5654b7118530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.501+0000 7fcfc382c740 1 --2- 172.21.15.8:0/755896248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b7115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.501+0000 7fcfc382c740 1 --2- 172.21.15.8:0/755896248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b710d020 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.501+0000 7fcfc382c740 1 -- 172.21.15.8:0/755896248 >> 172.21.15.8:0/755896248 conn(0x5654b7107370 msgr2=0x5654b7107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.501+0000 7fcfc382c740 1 -- 172.21.15.8:0/755896248 shutdown_connections 2024-03-16T21:08:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.501+0000 7fcfc382c740 1 -- 172.21.15.8:0/755896248 wait complete. 2024-03-16T21:08:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.502+0000 7fcfc382c740 1 -- start start 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.502+0000 7fcfc382c740 1 Processor -- start 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b7113200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710d560 0x5654b7113740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b7116140 0x5654b7113c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfc382c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b7019150 con 0x5654b7116140 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfc382c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b7018df0 con 0x5654b710cc40 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfc382c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b6de21c0 con 0x5654b710d560 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfc382c740 10 client.0 _ll_register_callbacks cb 0x5654b70682b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfb9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b7113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfb9400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710d560 0x5654b7113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfb9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b7113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:32988/0 (socket says 172.21.15.8:32988) 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfb9e00640 1 -- 172.21.15.8:0/3135333684 learned_addr learned my addr 172.21.15.8:0/3135333684 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.503+0000 7fcfba800640 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b7116140 0x5654b7113c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcfb9e00640 1 -- 172.21.15.8:0/3135333684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710d560 msgr2=0x5654b7113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710d560 0x5654b7113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcfb9e00640 1 -- 172.21.15.8:0/3135333684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b7116140 msgr2=0x5654b7113c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b7116140 0x5654b7113c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcfb9e00640 1 -- 172.21.15.8:0/3135333684 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa8019040 con 0x5654b710cc40 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b7113200 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcfac035000 tx=0x7fcfac009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed25cb8664166dc5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcf9b400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcf9b400640 1 -- 172.21.15.8:0/3135333684 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac005220 con 0x5654b710cc40 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcf9b400640 1 -- 172.21.15.8:0/3135333684 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcfac044070 con 0x5654b710cc40 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcfc382c740 1 -- 172.21.15.8:0/3135333684 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654b6d737e0 con 0x5654b710cc40 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcf9b400640 1 -- 172.21.15.8:0/3135333684 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfac005380 con 0x5654b710cc40 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcfc382c740 10 client.27845 fetch_fsmap learned FSMap version 36 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.504+0000 7fcfc382c740 1 -- 172.21.15.8:0/3135333684 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5654b70725a0 con 0x5654b710cc40 2024-03-16T21:08:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.505+0000 7fcf9b400640 1 -- 172.21.15.8:0/3135333684 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x5654b6d737e0 con 0x5654b710cc40 2024-03-16T21:08:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.505+0000 7fcf9b400640 1 -- 172.21.15.8:0/3135333684 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fcfac04b570 con 0x5654b710cc40 2024-03-16T21:08:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.505+0000 7fcfc382c740 10 client.27845 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:08:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.505+0000 7fcfc382c740 10 client.27845 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:08:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.505+0000 7fcfc382c740 20 client.27845 populate_metadata read hostname 'smithi008' 2024-03-16T21:08:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.505+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5654b7126240 0x5654b7128660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.505+0000 7fcfc382c740 4 client.27845 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.505+0000 7fcfc382c740 1 -- 172.21.15.8:0/3135333684 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654b6db0720 con 0x5654b7126240 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.505+0000 7fcfb9400640 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5654b7126240 0x5654b7128660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.506+0000 7fcfb9400640 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5654b7126240 0x5654b7128660 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51ad2d76ba5463c7 server_cookie=d6fb0ad41b1f0a49 in_seq=0 out_seq=0 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.506+0000 7fcf9b400640 10 client.27845 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcf9b400640 1 -- 172.21.15.8:0/3135333684 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5654b6db0720 con 0x5654b7126240 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcf9b400640 10 client.27845 handle_command_reply: tid=0 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 1 client.27845 shutdown 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 1 -- 172.21.15.8:0/3135333684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 msgr2=0x5654b7113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b7113200 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcfac035000 tx=0x7fcfac009260 comp rx=0 tx=0).stop 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 1 -- 172.21.15.8:0/3135333684 shutdown_connections 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5654b7126240 0x5654b7128660 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b7116140 0x5654b7113c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710d560 0x5654b7113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcf9b400640 0 client.27845 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:08:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3135333684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b7113200 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 1 -- 172.21.15.8:0/3135333684 >> 172.21.15.8:0/3135333684 conn(0x5654b7107370 msgr2=0x5654b71090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 1 -- 172.21.15.8:0/3135333684 shutdown_connections 2024-03-16T21:08:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 1 -- 172.21.15.8:0/3135333684 wait complete. 2024-03-16T21:08:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.507+0000 7fcfc382c740 20 client.27845 trim_cache size 0 max 16384 2024-03-16T21:08:14.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfc382c740 1 Processor -- start 2024-03-16T21:08:14.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfc382c740 1 -- start start 2024-03-16T21:08:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710cc40 0x5654b7108d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b71092c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b7116140 0x5654b7113750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfc382c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b7125fe0 con 0x5654b710d560 2024-03-16T21:08:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfc382c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b7128ce0 con 0x5654b7116140 2024-03-16T21:08:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfc382c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b7111750 con 0x5654b710cc40 2024-03-16T21:08:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfb9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710cc40 0x5654b7108d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfba800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b7116140 0x5654b7113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfb9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710cc40 0x5654b7108d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36712/0 (socket says 172.21.15.8:36712) 2024-03-16T21:08:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.522+0000 7fcfb9e00640 1 -- 172.21.15.8:0/474474766 learned_addr learned my addr 172.21.15.8:0/474474766 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.523+0000 7fcfb9400640 1 --2- 172.21.15.8:0/474474766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b71092c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.523+0000 7fcfb9e00640 1 -- 172.21.15.8:0/474474766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b7116140 msgr2=0x5654b7113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.523+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/474474766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b7116140 0x5654b7113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.523+0000 7fcfb9e00640 1 -- 172.21.15.8:0/474474766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 msgr2=0x5654b71092c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.523+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/474474766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b71092c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.523+0000 7fcfb9e00640 1 -- 172.21.15.8:0/474474766 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654b700eab0 con 0x5654b710cc40 2024-03-16T21:08:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.523+0000 7fcfb9400640 1 --2- 172.21.15.8:0/474474766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b71092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:08:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.523+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/474474766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710cc40 0x5654b7108d80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcfac036040 tx=0x7fcfac02c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e1134ffbf1a1b8f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.523+0000 7fcfa6600640 1 -- 172.21.15.8:0/474474766 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac04bcc0 con 0x5654b710cc40 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.523+0000 7fcfa6600640 1 -- 172.21.15.8:0/474474766 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcfac042070 con 0x5654b710cc40 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.523+0000 7fcfa6600640 1 -- 172.21.15.8:0/474474766 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac003850 con 0x5654b710cc40 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.524+0000 7fcfc382c740 1 -- 172.21.15.8:0/474474766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710cc40 msgr2=0x5654b7108d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.524+0000 7fcfc382c740 1 --2- 172.21.15.8:0/474474766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710cc40 0x5654b7108d80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcfac036040 tx=0x7fcfac02c8b0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.524+0000 7fcfc382c740 1 -- 172.21.15.8:0/474474766 shutdown_connections 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.524+0000 7fcfc382c740 1 --2- 172.21.15.8:0/474474766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b7116140 0x5654b7113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.524+0000 7fcfc382c740 1 --2- 172.21.15.8:0/474474766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b71092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.524+0000 7fcfc382c740 1 --2- 172.21.15.8:0/474474766 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b710cc40 0x5654b7108d80 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.524+0000 7fcfc382c740 1 -- 172.21.15.8:0/474474766 >> 172.21.15.8:0/474474766 conn(0x5654b7107370 msgr2=0x5654b7108670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.524+0000 7fcfc382c740 1 -- 172.21.15.8:0/474474766 shutdown_connections 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.524+0000 7fcfc382c740 1 -- 172.21.15.8:0/474474766 wait complete. 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.525+0000 7fcfc382c740 1 -- start start 2024-03-16T21:08:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.525+0000 7fcfc382c740 1 Processor -- start 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.525+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b711db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.525+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b7119ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.525+0000 7fcfc382c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 0x5654b711a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.525+0000 7fcfc382c740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b711a960 con 0x5654b710d560 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.525+0000 7fcfc382c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b711aad0 con 0x5654b710cc40 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.525+0000 7fcfc382c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b711ac90 con 0x5654b7116140 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.525+0000 7fcfc382c740 10 client.0 _ll_register_callbacks cb 0x7fcfa8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.525+0000 7fcfb9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b711db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.525+0000 7fcfba800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 0x5654b711a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfb9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b7119ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfb9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b711db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:33002/0 (socket says 172.21.15.8:33002) 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfba800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 0x5654b711a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36716/0 (socket says 172.21.15.8:36716) 2024-03-16T21:08:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfb9e00640 1 -- 172.21.15.8:0/3521377660 learned_addr learned my addr 172.21.15.8:0/3521377660 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfba800640 1 -- 172.21.15.8:0/3521377660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 msgr2=0x5654b711db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfba800640 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b711db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfba800640 1 -- 172.21.15.8:0/3521377660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 msgr2=0x5654b7119ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfba800640 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b7119ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfba800640 1 -- 172.21.15.8:0/3521377660 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654b70725a0 con 0x5654b7116140 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b711db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfba800640 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 0x5654b711a420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40cb480 tx=0x7fcfb409a960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fa04c272b50a933 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcf9b400640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcf9b400640 1 -- 172.21.15.8:0/3521377660 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40cb900 con 0x5654b7116140 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcf9b400640 1 -- 172.21.15.8:0/3521377660 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcfb40b3290 con 0x5654b7116140 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.526+0000 7fcfc382c740 1 -- 172.21.15.8:0/3521377660 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfa8005520 con 0x5654b7116140 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcf9b400640 1 -- 172.21.15.8:0/3521377660 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfb40b3450 con 0x5654b7116140 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcfc382c740 10 client.27859 fetch_fsmap learned FSMap version 36 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcfc382c740 1 -- 172.21.15.8:0/3521377660 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5654b7034650 con 0x5654b7116140 2024-03-16T21:08:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcf9b400640 1 -- 172.21.15.8:0/3521377660 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fcfb407f080 con 0x5654b7116140 2024-03-16T21:08:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcf9b400640 1 -- 172.21.15.8:0/3521377660 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fcfb401f060 con 0x5654b7116140 2024-03-16T21:08:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcfc382c740 10 client.27859 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:08:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcfc382c740 10 client.27859 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-16T21:08:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcfc382c740 20 client.27859 populate_metadata read hostname 'smithi008' 2024-03-16T21:08:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5654b7183030 0x5654b7185450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcfc382c740 4 client.27859 mds_command: new command op to 24544 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:08:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcfc382c740 1 -- 172.21.15.8:0/3521377660 --> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5654b6dff890 con 0x5654b7183030 2024-03-16T21:08:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.527+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5654b7183030 0x5654b7185450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcf9b400640 10 client.27859 ms_handle_connect on v2:172.21.15.186:6838/1721589022 2024-03-16T21:08:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5654b7183030 0x5654b7185450 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=843f0ed0fed18e9c server_cookie=29a5c34adcda82b3 in_seq=0 out_seq=0 2024-03-16T21:08:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcf9b400640 1 -- 172.21.15.8:0/3521377660 <== mds.1 v2:172.21.15.186:6838/1721589022 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5654b6dff890 con 0x5654b7183030 2024-03-16T21:08:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcf9b400640 10 client.27859 handle_command_reply: tid=0 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcfc382c740 1 client.27859 shutdown 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcfc382c740 1 -- 172.21.15.8:0/3521377660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 msgr2=0x5654b711a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 0x5654b711a420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40cb480 tx=0x7fcfb409a960 comp rx=0 tx=0).stop 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcfc382c740 1 -- 172.21.15.8:0/3521377660 shutdown_connections 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.186:6838/1721589022,v1:172.21.15.186:6839/1721589022] conn(0x5654b7183030 0x5654b7185450 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5654b7116140 0x5654b711a420 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654b710d560 0x5654b7119ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcf9b400640 0 client.27859 ms_handle_reset on v2:172.21.15.186:6838/1721589022 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcfc382c740 1 --2- 172.21.15.8:0/3521377660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5654b710cc40 0x5654b711db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.528+0000 7fcfc382c740 1 -- 172.21.15.8:0/3521377660 >> 172.21.15.8:0/3521377660 conn(0x5654b7107370 msgr2=0x5654b7108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc382c740 1 -- 172.21.15.8:0/3521377660 shutdown_connections 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc382c740 1 -- 172.21.15.8:0/3521377660 wait complete. 2024-03-16T21:08:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc382c740 20 client.27859 trim_cache size 0 max 16384 2024-03-16T21:08:14.539 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3989457281 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcfa00a1ba0 msgr2=0x7fcfa00a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc0a00640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcfa00a1ba0 0x7fcfa00a4060 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009230 tx=0x7fcfac005fd0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3989457281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfbc1096a0 msgr2=0x7fcfbc19e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc0a00640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfbc1096a0 0x7fcfbc19e650 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400eb10 tx=0x7fcfb400c2d0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3989457281 shutdown_connections 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc0a00640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fcfa00a1ba0 0x7fcfa00a4060 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc0a00640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfbc1096a0 0x7fcfbc19e650 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc0a00640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc104050 0x7fcfbc19a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.529+0000 7fcfc0a00640 1 --2- 172.21.15.8:0/3989457281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfbc103690 0x7fcfbc199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.530+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3989457281 >> 172.21.15.8:0/3989457281 conn(0x7fcfbc0ff160 msgr2=0x7fcfbc0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.530+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3989457281 shutdown_connections 2024-03-16T21:08:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.530+0000 7fcfc0a00640 1 -- 172.21.15.8:0/3989457281 wait complete. 2024-03-16T21:08:14.551 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-16T21:08:14.551 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T21:08:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.736+0000 7f6559a00640 1 -- 172.21.15.8:0/1827356008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6554104050 msgr2=0x7f6554110560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.736+0000 7f6559a00640 1 --2- 172.21.15.8:0/1827356008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6554104050 0x7f6554110560 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f654c009cd0 tx=0x7f654c02c0f0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.736+0000 7f6559a00640 1 -- 172.21.15.8:0/1827356008 shutdown_connections 2024-03-16T21:08:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.736+0000 7f6559a00640 1 --2- 172.21.15.8:0/1827356008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6554104050 0x7f6554110560 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.736+0000 7f6559a00640 1 --2- 172.21.15.8:0/1827356008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6554103690 0x7f6554103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.736+0000 7f6559a00640 1 --2- 172.21.15.8:0/1827356008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65541096a0 0x7f6554109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.736+0000 7f6559a00640 1 -- 172.21.15.8:0/1827356008 >> 172.21.15.8:0/1827356008 conn(0x7f65540ff160 msgr2=0x7f6554101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.736+0000 7f6559a00640 1 -- 172.21.15.8:0/1827356008 shutdown_connections 2024-03-16T21:08:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.737+0000 7f6559a00640 1 -- 172.21.15.8:0/1827356008 wait complete. 2024-03-16T21:08:14.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.737+0000 7f6559a00640 1 Processor -- start 2024-03-16T21:08:14.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6559a00640 1 -- start start 2024-03-16T21:08:14.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6559a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6554103690 0x7f6554199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6559a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6554104050 0x7f655419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6559a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65541096a0 0x7f655419e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6559a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655419ecb0 con 0x7f6554104050 2024-03-16T21:08:14.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6559a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655419ee20 con 0x7f6554103690 2024-03-16T21:08:14.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6559a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655419efe0 con 0x7f65541096a0 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6552000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6554104050 0x7f655419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6553400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65541096a0 0x7f655419e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6552a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6554103690 0x7f6554199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6553400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65541096a0 0x7f655419e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36742/0 (socket says 172.21.15.8:36742) 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.738+0000 7f6553400640 1 -- 172.21.15.8:0/4129726489 learned_addr learned my addr 172.21.15.8:0/4129726489 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.739+0000 7f6552a00640 1 -- 172.21.15.8:0/4129726489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65541096a0 msgr2=0x7f655419e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.739+0000 7f6552a00640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65541096a0 0x7f655419e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.739+0000 7f6552a00640 1 -- 172.21.15.8:0/4129726489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6554104050 msgr2=0x7f655419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.739+0000 7f6552a00640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6554104050 0x7f655419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.739+0000 7f6552a00640 1 -- 172.21.15.8:0/4129726489 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c009900 con 0x7f6554103690 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.739+0000 7f6552a00640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6554103690 0x7f6554199df0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f654400e9f0 tx=0x7f654400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.739+0000 7f654b400640 1 -- 172.21.15.8:0/4129726489 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654400ccc0 con 0x7f6554103690 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.739+0000 7f6559a00640 1 -- 172.21.15.8:0/4129726489 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655419f2c0 con 0x7f6554103690 2024-03-16T21:08:14.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.739+0000 7f654b400640 1 -- 172.21.15.8:0/4129726489 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f654400ce20 con 0x7f6554103690 2024-03-16T21:08:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.739+0000 7f654b400640 1 -- 172.21.15.8:0/4129726489 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65440189c0 con 0x7f6554103690 2024-03-16T21:08:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.739+0000 7f6559a00640 1 -- 172.21.15.8:0/4129726489 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65541a6b40 con 0x7f6554103690 2024-03-16T21:08:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.742+0000 7f654b400640 1 -- 172.21.15.8:0/4129726489 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f6544018b40 con 0x7f6554103690 2024-03-16T21:08:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.742+0000 7f655c767740 1 Processor -- start 2024-03-16T21:08:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f655c767740 1 -- start start 2024-03-16T21:08:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f655c767740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef50020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f655c767740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef50560 0x560bfef58c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f655c767740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef59140 0x560bfef5b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f655c767740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfeebe210 con 0x560bfef59140 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f655c767740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfeebb740 con 0x560bfef50560 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f655c767740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfeeb6f20 con 0x560bfef4fc40 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f6553400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef50020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f6553400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef50020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36752/0 (socket says 172.21.15.8:36752) 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f6553400640 1 -- 172.21.15.8:0/1908464012 learned_addr learned my addr 172.21.15.8:0/1908464012 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f6552a00640 1 --2- 172.21.15.8:0/1908464012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef50560 0x560bfef58c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.743+0000 7f6552000640 1 --2- 172.21.15.8:0/1908464012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef59140 0x560bfef5b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f6553400640 1 -- 172.21.15.8:0/1908464012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef50560 msgr2=0x560bfef58c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f6553400640 1 --2- 172.21.15.8:0/1908464012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef50560 0x560bfef58c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f6553400640 1 -- 172.21.15.8:0/1908464012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef59140 msgr2=0x560bfef5b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f6553400640 1 --2- 172.21.15.8:0/1908464012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef59140 0x560bfef5b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f6553400640 1 -- 172.21.15.8:0/1908464012 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bfee78df0 con 0x560bfef4fc40 2024-03-16T21:08:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f654b400640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f65380a1c20 0x7f65380a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f6553400640 1 --2- 172.21.15.8:0/1908464012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef50020 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f654c037040 tx=0x7f654c0093e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0ec29abdd998054 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f654b400640 1 -- 172.21.15.8:0/4129726489 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6544014070 con 0x7f6554103690 2024-03-16T21:08:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f6552a00640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f65380a1c20 0x7f65380a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f653fe00640 1 -- 172.21.15.8:0/1908464012 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c032600 con 0x560bfef4fc40 2024-03-16T21:08:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f653fe00640 1 -- 172.21.15.8:0/1908464012 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f654c034ab0 con 0x560bfef4fc40 2024-03-16T21:08:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.744+0000 7f653fe00640 1 -- 172.21.15.8:0/1908464012 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c003bd0 con 0x560bfef4fc40 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.745+0000 7f655c767740 1 -- 172.21.15.8:0/1908464012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 msgr2=0x560bfef50020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.745+0000 7f6552a00640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f65380a1c20 0x7f65380a40e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x560bfef4f710 tx=0x7f65440d3530 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.745+0000 7f655c767740 1 --2- 172.21.15.8:0/1908464012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef50020 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f654c037040 tx=0x7f654c0093e0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.745+0000 7f655c767740 1 -- 172.21.15.8:0/1908464012 shutdown_connections 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.745+0000 7f655c767740 1 --2- 172.21.15.8:0/1908464012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef59140 0x560bfef5b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.745+0000 7f655c767740 1 --2- 172.21.15.8:0/1908464012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef50560 0x560bfef58c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.745+0000 7f655c767740 1 --2- 172.21.15.8:0/1908464012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef50020 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.745+0000 7f655c767740 1 -- 172.21.15.8:0/1908464012 >> 172.21.15.8:0/1908464012 conn(0x560bfef4a370 msgr2=0x560bfef4a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.745+0000 7f655c767740 1 -- 172.21.15.8:0/1908464012 shutdown_connections 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.745+0000 7f655c767740 1 -- 172.21.15.8:0/1908464012 wait complete. 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.746+0000 7f655c767740 1 -- start start 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.746+0000 7f655c767740 1 Processor -- start 2024-03-16T21:08:14.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.746+0000 7f655c767740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef56140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.746+0000 7f655c767740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 0x560bfef56680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.746+0000 7f655c767740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef56bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.746+0000 7f655c767740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfee5c150 con 0x560bfef50560 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.746+0000 7f655c767740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfee5bdf0 con 0x560bfef59140 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.746+0000 7f655c767740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfec251c0 con 0x560bfef4fc40 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f655c767740 10 client.0 _ll_register_callbacks cb 0x560bfeeab2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f6553400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef56bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f6552000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 0x560bfef56680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f6553400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef56bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:33042/0 (socket says 172.21.15.8:33042) 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f6553400640 1 -- 172.21.15.8:0/2424149430 learned_addr learned my addr 172.21.15.8:0/2424149430 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f6553400640 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef56140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f6552000640 1 -- 172.21.15.8:0/2424149430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 msgr2=0x560bfef56140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f6552000640 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef56140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f6552000640 1 -- 172.21.15.8:0/2424149430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 msgr2=0x560bfef56bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f6552000640 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef56bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f6552000640 1 -- 172.21.15.8:0/2424149430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6554110e60 con 0x560bfef50560 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.747+0000 7f6553400640 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef56140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.748+0000 7f6552000640 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 0x560bfef56680 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6554101720 tx=0x7f6540012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19b34d4a2e8b5e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.748+0000 7f653cc00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.748+0000 7f653cc00640 1 -- 172.21.15.8:0/2424149430 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540017070 con 0x560bfef50560 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.748+0000 7f653cc00640 1 -- 172.21.15.8:0/2424149430 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f654000f920 con 0x560bfef50560 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.748+0000 7f655c767740 1 -- 172.21.15.8:0/2424149430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560bfebb67e0 con 0x560bfef50560 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.748+0000 7f653cc00640 1 -- 172.21.15.8:0/2424149430 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f654000fae0 con 0x560bfef50560 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.748+0000 7f655c767740 10 client.17670 fetch_fsmap learned FSMap version 36 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.748+0000 7f655c767740 1 -- 172.21.15.8:0/2424149430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560bfeeb55a0 con 0x560bfef50560 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.748+0000 7f653cc00640 1 -- 172.21.15.8:0/2424149430 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f6540028080 con 0x560bfef50560 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.749+0000 7f653cc00640 1 -- 172.21.15.8:0/2424149430 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6540022030 con 0x560bfef50560 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.749+0000 7f655c767740 10 client.17670 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:08:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.749+0000 7f655c767740 10 client.17670 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.749+0000 7f655c767740 20 client.17670 populate_metadata read hostname 'smithi008' 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.749+0000 7f655c767740 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560bfef692e0 0x560bfef6b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.749+0000 7f655c767740 4 client.17670 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.749+0000 7f655c767740 1 -- 172.21.15.8:0/2424149430 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560bfebf3720 con 0x560bfef692e0 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.749+0000 7f6553400640 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560bfef692e0 0x560bfef6b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.750+0000 7f6553400640 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560bfef692e0 0x560bfef6b700 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7070a82026d5f1a server_cookie=757f41681542e0d4 in_seq=0 out_seq=0 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.750+0000 7f653cc00640 10 client.17670 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f653cc00640 1 -- 172.21.15.8:0/2424149430 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560bfebf3720 con 0x560bfef692e0 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f653cc00640 10 client.17670 handle_command_reply: tid=0 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 1 client.17670 shutdown 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 1 -- 172.21.15.8:0/2424149430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 msgr2=0x560bfef56680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 0x560bfef56680 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6554101720 tx=0x7f6540012b60 comp rx=0 tx=0).stop 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 1 -- 172.21.15.8:0/2424149430 shutdown_connections 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef56bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560bfef692e0 0x560bfef6b700 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 0x560bfef56680 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 1 --2- 172.21.15.8:0/2424149430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef56140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 1 -- 172.21.15.8:0/2424149430 >> 172.21.15.8:0/2424149430 conn(0x560bfef4a370 msgr2=0x560bfef4c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f653cc00640 0 client.17670 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:08:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 1 -- 172.21.15.8:0/2424149430 shutdown_connections 2024-03-16T21:08:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 1 -- 172.21.15.8:0/2424149430 wait complete. 2024-03-16T21:08:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.751+0000 7f655c767740 20 client.17670 trim_cache size 0 max 16384 2024-03-16T21:08:14.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.764+0000 7f655c767740 1 Processor -- start 2024-03-16T21:08:14.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f655c767740 1 -- start start 2024-03-16T21:08:14.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f655c767740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef58870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f655c767740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 0x560bfef64490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f655c767740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef649d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f655c767740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfef4f8a0 con 0x560bfef50560 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f655c767740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfef5b530 con 0x560bfef59140 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f655c767740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfef570a0 con 0x560bfef4fc40 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f6552000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 0x560bfef64490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f6552000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 0x560bfef64490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43342/0 (socket says 172.21.15.8:43342) 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f6552000640 1 -- 172.21.15.8:0/30861478 learned_addr learned my addr 172.21.15.8:0/30861478 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f6553400640 1 --2- 172.21.15.8:0/30861478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef58870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.765+0000 7f6553400640 1 --2- 172.21.15.8:0/30861478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.766+0000 7f6552000640 1 -- 172.21.15.8:0/30861478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 msgr2=0x560bfef58870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.766+0000 7f6552000640 1 --2- 172.21.15.8:0/30861478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef58870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.766+0000 7f6552000640 1 -- 172.21.15.8:0/30861478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 msgr2=0x560bfef649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.766+0000 7f6552000640 1 --2- 172.21.15.8:0/30861478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef649d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.766+0000 7f6552000640 1 -- 172.21.15.8:0/30861478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bfee51ab0 con 0x560bfef50560 2024-03-16T21:08:14.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.766+0000 7f6553400640 1 --2- 172.21.15.8:0/30861478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:08:14.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.766+0000 7f6552000640 1 --2- 172.21.15.8:0/30861478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 0x560bfef64490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6540010eb0 tx=0x7f6540005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b39ff17cc4ecb95 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.766+0000 7f653f400640 1 -- 172.21.15.8:0/30861478 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540017070 con 0x560bfef50560 2024-03-16T21:08:14.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.766+0000 7f653f400640 1 -- 172.21.15.8:0/30861478 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x560bfebb67e0 con 0x560bfef50560 2024-03-16T21:08:14.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.766+0000 7f653f400640 1 -- 172.21.15.8:0/30861478 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540010490 con 0x560bfef50560 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.767+0000 7f655c767740 1 -- 172.21.15.8:0/30861478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 msgr2=0x560bfef64490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.767+0000 7f655c767740 1 --2- 172.21.15.8:0/30861478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 0x560bfef64490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6540010eb0 tx=0x7f6540005850 comp rx=0 tx=0).stop 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.767+0000 7f655c767740 1 -- 172.21.15.8:0/30861478 shutdown_connections 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.767+0000 7f655c767740 1 --2- 172.21.15.8:0/30861478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.767+0000 7f655c767740 1 --2- 172.21.15.8:0/30861478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef50560 0x560bfef64490 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.767+0000 7f655c767740 1 --2- 172.21.15.8:0/30861478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef4fc40 0x560bfef58870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.767+0000 7f655c767740 1 -- 172.21.15.8:0/30861478 >> 172.21.15.8:0/30861478 conn(0x560bfef4a370 msgr2=0x560bfef56990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.767+0000 7f655c767740 1 -- 172.21.15.8:0/30861478 shutdown_connections 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.767+0000 7f655c767740 1 -- 172.21.15.8:0/30861478 wait complete. 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.767+0000 7f655c767740 1 -- start start 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f655c767740 1 Processor -- start 2024-03-16T21:08:14.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f655c767740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef4fc40 0x560bfef60a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f655c767740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef50560 0x560bfef5cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f655c767740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef5d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f655c767740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfef612e0 con 0x560bfef4fc40 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f655c767740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfef5d810 con 0x560bfef59140 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f655c767740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bfef5d9d0 con 0x560bfef50560 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f655c767740 10 client.0 _ll_register_callbacks cb 0x7f6540009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f6553400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef4fc40 0x560bfef60a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f6552000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef50560 0x560bfef5cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f6552000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef50560 0x560bfef5cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36776/0 (socket says 172.21.15.8:36776) 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f6552000640 1 -- 172.21.15.8:0/487816022 learned_addr learned my addr 172.21.15.8:0/487816022 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.768+0000 7f6553400640 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef5d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f6552000640 1 -- 172.21.15.8:0/487816022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 msgr2=0x560bfef5d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f6552000640 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef5d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f6552000640 1 -- 172.21.15.8:0/487816022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef4fc40 msgr2=0x560bfef60a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f6552000640 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef4fc40 0x560bfef60a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f6552000640 1 -- 172.21.15.8:0/487816022 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bfeeb55a0 con 0x560bfef50560 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f6552000640 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef50560 0x560bfef5cd90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6540011fe0 tx=0x7f6540005cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e42626d1f8e86add server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f653cc00640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f653cc00640 1 -- 172.21.15.8:0/487816022 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540017070 con 0x560bfef50560 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f655c767740 1 -- 172.21.15.8:0/487816022 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f654c034ab0 con 0x560bfef50560 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f653cc00640 1 -- 172.21.15.8:0/487816022 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6540005390 con 0x560bfef50560 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f653cc00640 1 -- 172.21.15.8:0/487816022 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6540005570 con 0x560bfef50560 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f655c767740 10 client.27877 fetch_fsmap learned FSMap version 36 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.769+0000 7f655c767740 1 -- 172.21.15.8:0/487816022 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560bfee77650 con 0x560bfef50560 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.770+0000 7f653cc00640 1 -- 172.21.15.8:0/487816022 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f654c034ab0 con 0x560bfef50560 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.770+0000 7f653cc00640 1 -- 172.21.15.8:0/487816022 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f65400039c0 con 0x560bfef50560 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.770+0000 7f655c767740 10 client.27877 fetch_fsmap finished waiting for FSMap version 36 2024-03-16T21:08:14.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.770+0000 7f655c767740 10 client.27877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.770+0000 7f655c767740 20 client.27877 populate_metadata read hostname 'smithi008' 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.770+0000 7f655c767740 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560bfefc5ba0 0x560bfefc7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.770+0000 7f655c767740 4 client.27877 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.770+0000 7f655c767740 1 -- 172.21.15.8:0/487816022 --> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560bfec42890 con 0x560bfefc5ba0 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.770+0000 7f6553400640 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560bfefc5ba0 0x560bfefc7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f6553400640 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560bfefc5ba0 0x560bfefc7fc0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71ed84baf995cc29 server_cookie=64bb8ced9755f4b9 in_seq=0 out_seq=0 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f653cc00640 10 client.27877 ms_handle_connect on v2:172.21.15.170:6838/600336743 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f653cc00640 1 -- 172.21.15.8:0/487816022 <== mds.0 v2:172.21.15.170:6838/600336743 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560bfec42890 con 0x560bfefc5ba0 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f653cc00640 10 client.27877 handle_command_reply: tid=0 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 1 client.27877 shutdown 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 1 -- 172.21.15.8:0/487816022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef50560 msgr2=0x560bfef5cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef50560 0x560bfef5cd90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6540011fe0 tx=0x7f6540005cc0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 1 -- 172.21.15.8:0/487816022 shutdown_connections 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bfef59140 0x560bfef5d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560bfef50560 0x560bfef5cd90 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.170:6838/600336743,v1:172.21.15.170:6839/600336743] conn(0x560bfefc5ba0 0x560bfefc7fc0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 1 --2- 172.21.15.8:0/487816022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bfef4fc40 0x560bfef60a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f653cc00640 0 client.27877 ms_handle_reset on v2:172.21.15.170:6838/600336743 2024-03-16T21:08:14.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 1 -- 172.21.15.8:0/487816022 >> 172.21.15.8:0/487816022 conn(0x560bfef4a370 msgr2=0x560bfef48be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 1 -- 172.21.15.8:0/487816022 shutdown_connections 2024-03-16T21:08:14.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 1 -- 172.21.15.8:0/487816022 wait complete. 2024-03-16T21:08:14.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.771+0000 7f655c767740 20 client.27877 trim_cache size 0 max 16384 2024-03-16T21:08:14.781 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2024-03-16T21:08:14.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 -- 172.21.15.8:0/4129726489 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f65380a1c20 msgr2=0x7f65380a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f65380a1c20 0x7f65380a40e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x560bfef4f710 tx=0x7f65440d3530 comp rx=0 tx=0).stop 2024-03-16T21:08:14.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 -- 172.21.15.8:0/4129726489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6554103690 msgr2=0x7f6554199df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:14.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6554103690 0x7f6554199df0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f654400e9f0 tx=0x7f654400eeb0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 -- 172.21.15.8:0/4129726489 shutdown_connections 2024-03-16T21:08:14.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f65380a1c20 0x7f65380a40e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65541096a0 0x7f655419e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6554104050 0x7f655419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 --2- 172.21.15.8:0/4129726489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6554103690 0x7f6554199df0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:14.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 -- 172.21.15.8:0/4129726489 >> 172.21.15.8:0/4129726489 conn(0x7f65540ff160 msgr2=0x7f65540ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:14.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 -- 172.21.15.8:0/4129726489 shutdown_connections 2024-03-16T21:08:14.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:14.772+0000 7f6559a00640 1 -- 172.21.15.8:0/4129726489 wait complete. 2024-03-16T21:08:14.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:14 smithi008 ceph-mon[31434]: pgmap v323: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 127 B/s wr, 5 op/s 2024-03-16T21:08:14.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:14 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:14.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:14 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/799050354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:08:15.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:14 smithi170 ceph-mon[35947]: pgmap v323: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 127 B/s wr, 5 op/s 2024-03-16T21:08:15.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:14 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:15.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:14 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/799050354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:08:15.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:14 smithi186 ceph-mon[36391]: pgmap v323: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 127 B/s wr, 5 op/s 2024-03-16T21:08:15.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:14 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:15.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:14 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/799050354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:08:15.794 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2024-03-16T21:08:15.794 INFO:tasks.fwd_scrub:done joining 2024-03-16T21:08:15.794 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-03-16T21:08:15.805 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T21:08:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.005+0000 7fa06d600640 1 -- 172.21.15.8:0/2740522359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa068107560 msgr2=0x7fa068107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.005+0000 7fa06d600640 1 --2- 172.21.15.8:0/2740522359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa068107560 0x7fa068107940 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa058009930 tx=0x7fa05802bc20 comp rx=0 tx=0).stop 2024-03-16T21:08:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.005+0000 7fa06d600640 1 -- 172.21.15.8:0/2740522359 shutdown_connections 2024-03-16T21:08:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.005+0000 7fa06d600640 1 --2- 172.21.15.8:0/2740522359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa068101e60 0x7fa06810e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.005+0000 7fa06d600640 1 --2- 172.21.15.8:0/2740522359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0681014a0 0x7fa068101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.005+0000 7fa06d600640 1 --2- 172.21.15.8:0/2740522359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa068107560 0x7fa068107940 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.005+0000 7fa06d600640 1 -- 172.21.15.8:0/2740522359 >> 172.21.15.8:0/2740522359 conn(0x7fa0680fcf90 msgr2=0x7fa0680ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.005+0000 7fa06d600640 1 -- 172.21.15.8:0/2740522359 shutdown_connections 2024-03-16T21:08:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.005+0000 7fa06d600640 1 -- 172.21.15.8:0/2740522359 wait complete. 2024-03-16T21:08:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.006+0000 7fa06d600640 1 Processor -- start 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.006+0000 7fa06d600640 1 -- start start 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa06d600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0681014a0 0x7fa068199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa06d600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa068101e60 0x7fa06819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa06d600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa068107560 0x7fa06819e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa06d600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06819ec80 con 0x7fa0681014a0 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa06d600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06819edf0 con 0x7fa068101e60 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa06d600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06819efb0 con 0x7fa068107560 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa066a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0681014a0 0x7fa068199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa066000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa068101e60 0x7fa06819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa066000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa068101e60 0x7fa06819a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:33072/0 (socket says 172.21.15.8:33072) 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa066000640 1 -- 172.21.15.8:0/3839854426 learned_addr learned my addr 172.21.15.8:0/3839854426 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa067400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa068107560 0x7fa06819e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa066a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0681014a0 0x7fa068199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43368/0 (socket says 172.21.15.8:43368) 2024-03-16T21:08:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa066000640 1 -- 172.21.15.8:0/3839854426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa068107560 msgr2=0x7fa06819e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa066000640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa068107560 0x7fa06819e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa066000640 1 -- 172.21.15.8:0/3839854426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0681014a0 msgr2=0x7fa068199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa066000640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0681014a0 0x7fa068199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.007+0000 7fa066000640 1 -- 172.21.15.8:0/3839854426 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa058009560 con 0x7fa068101e60 2024-03-16T21:08:16.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.008+0000 7fa066000640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa068101e60 0x7fa06819a300 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa05400e9f0 tx=0x7fa05400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:16.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.008+0000 7fa05f400640 1 -- 172.21.15.8:0/3839854426 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054009700 con 0x7fa068101e60 2024-03-16T21:08:16.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.008+0000 7fa06d600640 1 -- 172.21.15.8:0/3839854426 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06819f290 con 0x7fa068101e60 2024-03-16T21:08:16.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.008+0000 7fa05f400640 1 -- 172.21.15.8:0/3839854426 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa05400cd80 con 0x7fa068101e60 2024-03-16T21:08:16.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.008+0000 7fa05f400640 1 -- 172.21.15.8:0/3839854426 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540189c0 con 0x7fa068101e60 2024-03-16T21:08:16.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.008+0000 7fa06d600640 1 -- 172.21.15.8:0/3839854426 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0681a6b10 con 0x7fa068101e60 2024-03-16T21:08:16.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.009+0000 7fa06d600640 1 -- 172.21.15.8:0/3839854426 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa068068730 con 0x7fa068101e60 2024-03-16T21:08:16.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.012+0000 7fa05f400640 1 -- 172.21.15.8:0/3839854426 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fa054018b20 con 0x7fa068101e60 2024-03-16T21:08:16.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.013+0000 7fa05f400640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa04c0a1ba0 0x7fa04c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.013+0000 7fa05f400640 1 -- 172.21.15.8:0/3839854426 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa054014070 con 0x7fa068101e60 2024-03-16T21:08:16.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.014+0000 7fa066a00640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa04c0a1ba0 0x7fa04c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.014+0000 7fa066a00640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa04c0a1ba0 0x7fa04c0a4060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa058005ab0 tx=0x7fa058000bc0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:16.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.017+0000 7fa05f400640 1 -- 172.21.15.8:0/3839854426 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa054053280 con 0x7fa068101e60 2024-03-16T21:08:16.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.234+0000 7fa06d600640 1 -- 172.21.15.8:0/3839854426 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0681118a0 con 0x7fa068101e60 2024-03-16T21:08:16.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.236+0000 7fa05f400640 1 -- 172.21.15.8:0/3839854426 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+23043 (secure 0 0 0) 0x7fa054096ab0 con 0x7fa068101e60 2024-03-16T21:08:16.242 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:08:16.242 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":97,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T21:08:12.304597+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":16,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/1064583862":"2024-03-17T20:57:49.251162+0000","172.21.15.8:6800/1064583862":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/3780969288":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:0/2780502436":"2024-03-17T20:57:49.251162+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/4186367083":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3503977705":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":16,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T21:08:16.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 -- 172.21.15.8:0/3839854426 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa04c0a1ba0 msgr2=0x7fa04c0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa04c0a1ba0 0x7fa04c0a4060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa058005ab0 tx=0x7fa058000bc0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 -- 172.21.15.8:0/3839854426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa068101e60 msgr2=0x7fa06819a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa068101e60 0x7fa06819a300 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa05400e9f0 tx=0x7fa05400eeb0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 -- 172.21.15.8:0/3839854426 shutdown_connections 2024-03-16T21:08:16.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa04c0a1ba0 0x7fa04c0a4060 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa068107560 0x7fa06819e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa068101e60 0x7fa06819a300 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 --2- 172.21.15.8:0/3839854426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0681014a0 0x7fa068199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 -- 172.21.15.8:0/3839854426 >> 172.21.15.8:0/3839854426 conn(0x7fa0680fcf90 msgr2=0x7fa0680fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:16.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 -- 172.21.15.8:0/3839854426 shutdown_connections 2024-03-16T21:08:16.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.239+0000 7fa06d600640 1 -- 172.21.15.8:0/3839854426 wait complete. 2024-03-16T21:08:16.267 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T20:55:02.896774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T20:55:04.228958+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 16, 'snap_epoch': 96, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T21:08:16.268 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T21:08:16.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.472+0000 7f2550600640 1 -- 172.21.15.8:0/3602826719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f254810dd20 msgr2=0x7f2548110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.472+0000 7f2550600640 1 --2- 172.21.15.8:0/3602826719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f254810dd20 0x7f2548110130 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2540009ca0 tx=0x7f254002c180 comp rx=0 tx=0).stop 2024-03-16T21:08:16.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.472+0000 7f2550600640 1 -- 172.21.15.8:0/3602826719 shutdown_connections 2024-03-16T21:08:16.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.472+0000 7f2550600640 1 --2- 172.21.15.8:0/3602826719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f254810dd20 0x7f2548110130 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.472+0000 7f2550600640 1 --2- 172.21.15.8:0/3602826719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25480741e0 0x7f254810d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.472+0000 7f2550600640 1 --2- 172.21.15.8:0/3602826719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25480738c0 0x7f2548073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.472+0000 7f2550600640 1 -- 172.21.15.8:0/3602826719 >> 172.21.15.8:0/3602826719 conn(0x7f25480788f0 msgr2=0x7f2548078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:16.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.473+0000 7f2550600640 1 -- 172.21.15.8:0/3602826719 shutdown_connections 2024-03-16T21:08:16.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.473+0000 7f2550600640 1 -- 172.21.15.8:0/3602826719 wait complete. 2024-03-16T21:08:16.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f2550600640 1 Processor -- start 2024-03-16T21:08:16.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f2550600640 1 -- start start 2024-03-16T21:08:16.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f2550600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25480738c0 0x7f2548101440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f2550600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25480741e0 0x7f2548101980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f2550600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f254810dd20 0x7f2548101ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f2550600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25481aa480 con 0x7f25480738c0 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f2550600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25481aa5c0 con 0x7f25480741e0 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f2550600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25481aa700 con 0x7f254810dd20 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f254e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f254810dd20 0x7f2548101ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f254dc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25480738c0 0x7f2548101440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f254d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25480741e0 0x7f2548101980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f254e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f254810dd20 0x7f2548101ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36812/0 (socket says 172.21.15.8:36812) 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.474+0000 7f254e600640 1 -- 172.21.15.8:0/2916450249 learned_addr learned my addr 172.21.15.8:0/2916450249 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.475+0000 7f254e600640 1 -- 172.21.15.8:0/2916450249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25480741e0 msgr2=0x7f2548101980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.475+0000 7f254e600640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25480741e0 0x7f2548101980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.475+0000 7f254e600640 1 -- 172.21.15.8:0/2916450249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25480738c0 msgr2=0x7f2548101440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.475+0000 7f254e600640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25480738c0 0x7f2548101440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.475+0000 7f254e600640 1 -- 172.21.15.8:0/2916450249 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2540009900 con 0x7f254810dd20 2024-03-16T21:08:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.475+0000 7f254d200640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25480741e0 0x7f2548101980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.475+0000 7f254e600640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f254810dd20 0x7f2548101ec0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2540005e30 tx=0x7f2540034670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.476+0000 7f2546000640 1 -- 172.21.15.8:0/2916450249 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2540003b70 con 0x7f254810dd20 2024-03-16T21:08:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.476+0000 7f2546000640 1 -- 172.21.15.8:0/2916450249 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f2540003cd0 con 0x7f254810dd20 2024-03-16T21:08:16.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.476+0000 7f2546000640 1 -- 172.21.15.8:0/2916450249 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2540004720 con 0x7f254810dd20 2024-03-16T21:08:16.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.476+0000 7f2550600640 1 -- 172.21.15.8:0/2916450249 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25481aa950 con 0x7f254810dd20 2024-03-16T21:08:16.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.476+0000 7f2550600640 1 -- 172.21.15.8:0/2916450249 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25481aadb0 con 0x7f254810dd20 2024-03-16T21:08:16.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.477+0000 7f2550600640 1 -- 172.21.15.8:0/2916450249 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2548074f70 con 0x7f254810dd20 2024-03-16T21:08:16.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.479+0000 7f2546000640 1 -- 172.21.15.8:0/2916450249 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f254003b040 con 0x7f254810dd20 2024-03-16T21:08:16.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.480+0000 7f2546000640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f25300a1c20 0x7f25300a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.481+0000 7f2546000640 1 -- 172.21.15.8:0/2916450249 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f25400efe20 con 0x7f254810dd20 2024-03-16T21:08:16.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.481+0000 7f254dc00640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f25300a1c20 0x7f25300a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.481+0000 7f254dc00640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f25300a1c20 0x7f25300a40e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f253c009bd0 tx=0x7f253c005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:16.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.482+0000 7f2546000640 1 -- 172.21.15.8:0/2916450249 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f25400b8ec0 con 0x7f254810dd20 2024-03-16T21:08:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:16 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:16 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:16.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:16 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:16.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.689+0000 7f2550600640 1 -- 172.21.15.8:0/2916450249 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2548113900 con 0x7f254810dd20 2024-03-16T21:08:16.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.689+0000 7f2546000640 1 -- 172.21.15.8:0/2916450249 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25400390a0 con 0x7f254810dd20 2024-03-16T21:08:16.696 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T21:08:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 -- 172.21.15.8:0/2916450249 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f25300a1c20 msgr2=0x7f25300a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f25300a1c20 0x7f25300a40e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f253c009bd0 tx=0x7f253c005f90 comp rx=0 tx=0).stop 2024-03-16T21:08:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 -- 172.21.15.8:0/2916450249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f254810dd20 msgr2=0x7f2548101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f254810dd20 0x7f2548101ec0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2540005e30 tx=0x7f2540034670 comp rx=0 tx=0).stop 2024-03-16T21:08:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 -- 172.21.15.8:0/2916450249 shutdown_connections 2024-03-16T21:08:16.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f25300a1c20 0x7f25300a40e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f254810dd20 0x7f2548101ec0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25480741e0 0x7f2548101980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 --2- 172.21.15.8:0/2916450249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25480738c0 0x7f2548101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 -- 172.21.15.8:0/2916450249 >> 172.21.15.8:0/2916450249 conn(0x7f25480788f0 msgr2=0x7f25480ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:16.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 -- 172.21.15.8:0/2916450249 shutdown_connections 2024-03-16T21:08:16.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.692+0000 7f2550600640 1 -- 172.21.15.8:0/2916450249 wait complete. 2024-03-16T21:08:16.718 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T21:08:16.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.929+0000 7effb0a00640 1 -- 172.21.15.8:0/1779651711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effac100ab0 msgr2=0x7effac10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.929+0000 7effb0a00640 1 --2- 172.21.15.8:0/1779651711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effac100ab0 0x7effac10d770 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7eff98009900 tx=0x7eff9802bc30 comp rx=0 tx=0).stop 2024-03-16T21:08:16.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.929+0000 7effb0a00640 1 -- 172.21.15.8:0/1779651711 shutdown_connections 2024-03-16T21:08:16.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.929+0000 7effb0a00640 1 --2- 172.21.15.8:0/1779651711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac10dcb0 0x7effac1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.929+0000 7effb0a00640 1 --2- 172.21.15.8:0/1779651711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effac100ab0 0x7effac10d770 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.929+0000 7effb0a00640 1 --2- 172.21.15.8:0/1779651711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effac100100 0x7effac1004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.929+0000 7effb0a00640 1 -- 172.21.15.8:0/1779651711 >> 172.21.15.8:0/1779651711 conn(0x7effac0fbd40 msgr2=0x7effac0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:16.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.929+0000 7effb0a00640 1 -- 172.21.15.8:0/1779651711 shutdown_connections 2024-03-16T21:08:16.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.929+0000 7effb0a00640 1 -- 172.21.15.8:0/1779651711 wait complete. 2024-03-16T21:08:16.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.930+0000 7effb0a00640 1 Processor -- start 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.930+0000 7effb0a00640 1 -- start start 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effb0a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac100100 0x7effac199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effb0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effac100ab0 0x7effac19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effb0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effac10dcb0 0x7effac19e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effb0a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac19ec70 con 0x7effac100ab0 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effb0a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac19ede0 con 0x7effac10dcb0 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effb0a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac19efa0 con 0x7effac100100 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effaa800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac100100 0x7effac199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effaa800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac100100 0x7effac199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36830/0 (socket says 172.21.15.8:36830) 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effaa800640 1 -- 172.21.15.8:0/1946957324 learned_addr learned my addr 172.21.15.8:0/1946957324 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effab200640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effac10dcb0 0x7effac19e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effa9e00640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effac100ab0 0x7effac19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effaa800640 1 -- 172.21.15.8:0/1946957324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effac10dcb0 msgr2=0x7effac19e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effaa800640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effac10dcb0 0x7effac19e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effaa800640 1 -- 172.21.15.8:0/1946957324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effac100ab0 msgr2=0x7effac19a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:16.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effaa800640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effac100ab0 0x7effac19a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:16.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.931+0000 7effaa800640 1 -- 172.21.15.8:0/1946957324 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff98009560 con 0x7effac100100 2024-03-16T21:08:16.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.932+0000 7effaa800640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac100100 0x7effac199db0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00e9f0 tx=0x7eff9c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:16.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.932+0000 7effa3400640 1 -- 172.21.15.8:0/1946957324 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c009700 con 0x7effac100100 2024-03-16T21:08:16.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.932+0000 7effa3400640 1 -- 172.21.15.8:0/1946957324 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7eff9c00cd80 con 0x7effac100100 2024-03-16T21:08:16.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.932+0000 7effb0a00640 1 -- 172.21.15.8:0/1946957324 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac19f280 con 0x7effac100100 2024-03-16T21:08:16.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.932+0000 7effa3400640 1 -- 172.21.15.8:0/1946957324 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0189c0 con 0x7effac100100 2024-03-16T21:08:16.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.932+0000 7effb0a00640 1 -- 172.21.15.8:0/1946957324 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac1a6b00 con 0x7effac100100 2024-03-16T21:08:16.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.933+0000 7effb0a00640 1 -- 172.21.15.8:0/1946957324 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac068200 con 0x7effac100100 2024-03-16T21:08:16.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.935+0000 7effa3400640 1 -- 172.21.15.8:0/1946957324 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7eff9c018b20 con 0x7effac100100 2024-03-16T21:08:16.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.937+0000 7effa3400640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7eff900a1c20 0x7eff900a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:16.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.937+0000 7effa3400640 1 -- 172.21.15.8:0/1946957324 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7eff9c014070 con 0x7effac100100 2024-03-16T21:08:16.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.937+0000 7effa9e00640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7eff900a1c20 0x7eff900a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:16.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.938+0000 7effa9e00640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7eff900a1c20 0x7eff900a40e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff98006010 tx=0x7eff98000bc0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:16.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:16.940+0000 7effa3400640 1 -- 172.21.15.8:0/1946957324 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7eff9c053280 con 0x7effac100100 2024-03-16T21:08:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.144+0000 7effb0a00640 1 -- 172.21.15.8:0/1946957324 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7effac108e40 con 0x7effac100100 2024-03-16T21:08:17.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.145+0000 7effa3400640 1 -- 172.21.15.8:0/1946957324 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff9c096a30 con 0x7effac100100 2024-03-16T21:08:17.151 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-16T21:08:17.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 -- 172.21.15.8:0/1946957324 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7eff900a1c20 msgr2=0x7eff900a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7eff900a1c20 0x7eff900a40e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff98006010 tx=0x7eff98000bc0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 -- 172.21.15.8:0/1946957324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac100100 msgr2=0x7effac199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac100100 0x7effac199db0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00e9f0 tx=0x7eff9c00eeb0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 -- 172.21.15.8:0/1946957324 shutdown_connections 2024-03-16T21:08:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7eff900a1c20 0x7eff900a40e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effac10dcb0 0x7effac19e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effac100ab0 0x7effac19a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 --2- 172.21.15.8:0/1946957324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effac100100 0x7effac199db0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 -- 172.21.15.8:0/1946957324 >> 172.21.15.8:0/1946957324 conn(0x7effac0fbd40 msgr2=0x7effac10ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 -- 172.21.15.8:0/1946957324 shutdown_connections 2024-03-16T21:08:17.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.148+0000 7effb0a00640 1 -- 172.21.15.8:0/1946957324 wait complete. 2024-03-16T21:08:17.174 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T21:08:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.377+0000 7f3ecda00640 1 -- 172.21.15.8:0/3614661275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec8103590 msgr2=0x7f3ec8103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.377+0000 7f3ecda00640 1 --2- 172.21.15.8:0/3614661275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec8103590 0x7f3ec8103a10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009930 tx=0x7f3eb402bc30 comp rx=0 tx=0).stop 2024-03-16T21:08:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.377+0000 7f3ecda00640 1 -- 172.21.15.8:0/3614661275 shutdown_connections 2024-03-16T21:08:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.377+0000 7f3ecda00640 1 --2- 172.21.15.8:0/3614661275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec8103f50 0x7f3ec8110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.377+0000 7f3ecda00640 1 --2- 172.21.15.8:0/3614661275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec8103590 0x7f3ec8103a10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.377+0000 7f3ecda00640 1 --2- 172.21.15.8:0/3614661275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ec8109650 0x7f3ec8109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.377+0000 7f3ecda00640 1 -- 172.21.15.8:0/3614661275 >> 172.21.15.8:0/3614661275 conn(0x7f3ec80ff000 msgr2=0x7f3ec8101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.377+0000 7f3ecda00640 1 -- 172.21.15.8:0/3614661275 shutdown_connections 2024-03-16T21:08:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.377+0000 7f3ecda00640 1 -- 172.21.15.8:0/3614661275 wait complete. 2024-03-16T21:08:17.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.378+0000 7f3ecda00640 1 Processor -- start 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.378+0000 7f3ecda00640 1 -- start start 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ecda00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec8103590 0x7f3ec819f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ecda00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ec8103f50 0x7f3ec819fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ecda00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec8109650 0x7f3ec8199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ecda00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec819a0d0 con 0x7f3ec8103590 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ecda00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec819a240 con 0x7f3ec8109650 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ecda00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec819a400 con 0x7f3ec8103f50 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ec7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ec8103f50 0x7f3ec819fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ec7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec8103590 0x7f3ec819f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ec7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ec8103f50 0x7f3ec819fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36852/0 (socket says 172.21.15.8:36852) 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ec7400640 1 -- 172.21.15.8:0/2218452289 learned_addr learned my addr 172.21.15.8:0/2218452289 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:17.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ecd000640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec8109650 0x7f3ec8199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:17.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ec7400640 1 -- 172.21.15.8:0/2218452289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec8109650 msgr2=0x7f3ec8199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:17.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ec7400640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec8109650 0x7f3ec8199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ec7400640 1 -- 172.21.15.8:0/2218452289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec8103590 msgr2=0x7f3ec819f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:17.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ec7400640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec8103590 0x7f3ec819f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.379+0000 7f3ec7400640 1 -- 172.21.15.8:0/2218452289 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb4009560 con 0x7f3ec8103f50 2024-03-16T21:08:17.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.380+0000 7f3ec7400640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ec8103f50 0x7f3ec819fe10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4000c00 tx=0x7f3eb402cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:17.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.380+0000 7f3ec4c00640 1 -- 172.21.15.8:0/2218452289 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4004250 con 0x7f3ec8103f50 2024-03-16T21:08:17.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.380+0000 7f3ecda00640 1 -- 172.21.15.8:0/2218452289 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec819a680 con 0x7f3ec8103f50 2024-03-16T21:08:17.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.380+0000 7f3ec4c00640 1 -- 172.21.15.8:0/2218452289 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f3eb40043b0 con 0x7f3ec8103f50 2024-03-16T21:08:17.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.380+0000 7f3ec4c00640 1 -- 172.21.15.8:0/2218452289 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4003be0 con 0x7f3ec8103f50 2024-03-16T21:08:17.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.380+0000 7f3ecda00640 1 -- 172.21.15.8:0/2218452289 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec81a6970 con 0x7f3ec8103f50 2024-03-16T21:08:17.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.381+0000 7f3ecda00640 1 -- 172.21.15.8:0/2218452289 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec8104cb0 con 0x7f3ec8103f50 2024-03-16T21:08:17.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.383+0000 7f3ec4c00640 1 -- 172.21.15.8:0/2218452289 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f3eb4003d40 con 0x7f3ec8103f50 2024-03-16T21:08:17.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.384+0000 7f3ec4c00640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3eac0a1ba0 0x7f3eac0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:17.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.385+0000 7f3ec4c00640 1 -- 172.21.15.8:0/2218452289 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3eb40efcb0 con 0x7f3ec8103f50 2024-03-16T21:08:17.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.385+0000 7f3ec7e00640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3eac0a1ba0 0x7f3eac0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:17.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.385+0000 7f3ec7e00640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3eac0a1ba0 0x7f3eac0a4060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ec819abc0 tx=0x7f3eb8005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:17.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.388+0000 7f3ec4c00640 1 -- 172.21.15.8:0/2218452289 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3eb40b8c30 con 0x7f3ec8103f50 2024-03-16T21:08:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:17 smithi008 ceph-mon[31434]: pgmap v324: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T21:08:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:17 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi186 to 174.1M 2024-03-16T21:08:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:17 smithi008 ceph-mon[31434]: Unable to set osd_memory_target on smithi186 to 182634905: error parsing value: Value '182634905' is below minimum 939524096 2024-03-16T21:08:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:17 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi170 to 174.1M 2024-03-16T21:08:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:17 smithi008 ceph-mon[31434]: Unable to set osd_memory_target on smithi170 to 182637772: error parsing value: Value '182637772' is below minimum 939524096 2024-03-16T21:08:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:17 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3839854426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T21:08:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:17 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:17 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:17 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2916450249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T21:08:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:17 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1946957324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T21:08:17.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.589+0000 7f3ecda00640 1 -- 172.21.15.8:0/2218452289 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ec810ba40 con 0x7f3ec8103f50 2024-03-16T21:08:17.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.589+0000 7f3ec4c00640 1 -- 172.21.15.8:0/2218452289 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3eb40430a0 con 0x7f3ec8103f50 2024-03-16T21:08:17.596 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-16T21:08:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.592+0000 7f3ecda00640 1 -- 172.21.15.8:0/2218452289 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3eac0a1ba0 msgr2=0x7f3eac0a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.592+0000 7f3ecda00640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3eac0a1ba0 0x7f3eac0a4060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ec819abc0 tx=0x7f3eb8005f90 comp rx=0 tx=0).stop 2024-03-16T21:08:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.592+0000 7f3ecda00640 1 -- 172.21.15.8:0/2218452289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ec8103f50 msgr2=0x7f3ec819fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.592+0000 7f3ecda00640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ec8103f50 0x7f3ec819fe10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4000c00 tx=0x7f3eb402cc20 comp rx=0 tx=0).stop 2024-03-16T21:08:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.592+0000 7f3ecda00640 1 -- 172.21.15.8:0/2218452289 shutdown_connections 2024-03-16T21:08:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.592+0000 7f3ecda00640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f3eac0a1ba0 0x7f3eac0a4060 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.592+0000 7f3ecda00640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec8109650 0x7f3ec8199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.592+0000 7f3ecda00640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ec8103f50 0x7f3ec819fe10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.592+0000 7f3ecda00640 1 --2- 172.21.15.8:0/2218452289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec8103590 0x7f3ec819f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.592+0000 7f3ecda00640 1 -- 172.21.15.8:0/2218452289 >> 172.21.15.8:0/2218452289 conn(0x7f3ec80ff000 msgr2=0x7f3ec8100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:17.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.593+0000 7f3ecda00640 1 -- 172.21.15.8:0/2218452289 shutdown_connections 2024-03-16T21:08:17.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.593+0000 7f3ecda00640 1 -- 172.21.15.8:0/2218452289 wait complete. 2024-03-16T21:08:17.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:17 smithi170 ceph-mon[35947]: pgmap v324: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T21:08:17.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:17 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi186 to 174.1M 2024-03-16T21:08:17.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:17 smithi170 ceph-mon[35947]: Unable to set osd_memory_target on smithi186 to 182634905: error parsing value: Value '182634905' is below minimum 939524096 2024-03-16T21:08:17.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:17 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi170 to 174.1M 2024-03-16T21:08:17.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:17 smithi170 ceph-mon[35947]: Unable to set osd_memory_target on smithi170 to 182637772: error parsing value: Value '182637772' is below minimum 939524096 2024-03-16T21:08:17.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:17 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3839854426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T21:08:17.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:17 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:17.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:17 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:17.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:17 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2916450249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T21:08:17.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:17 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1946957324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T21:08:17.622 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-03-16T21:08:17.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:17 smithi186 ceph-mon[36391]: pgmap v324: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-16T21:08:17.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:17 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi186 to 174.1M 2024-03-16T21:08:17.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:17 smithi186 ceph-mon[36391]: Unable to set osd_memory_target on smithi186 to 182634905: error parsing value: Value '182634905' is below minimum 939524096 2024-03-16T21:08:17.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:17 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi170 to 174.1M 2024-03-16T21:08:17.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:17 smithi186 ceph-mon[36391]: Unable to set osd_memory_target on smithi170 to 182637772: error parsing value: Value '182637772' is below minimum 939524096 2024-03-16T21:08:17.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:17 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3839854426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T21:08:17.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:17 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:17.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:17 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:17.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:17 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2916450249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T21:08:17.645 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:17 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1946957324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T21:08:17.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.815+0000 7f8088800640 1 -- 172.21.15.8:0/2498488442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8080103680 msgr2=0x7f8080103b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:17.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.815+0000 7f8088800640 1 --2- 172.21.15.8:0/2498488442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8080103680 0x7f8080103b00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8070009890 tx=0x7f807002bb70 comp rx=0 tx=0).stop 2024-03-16T21:08:17.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.815+0000 7f8088800640 1 -- 172.21.15.8:0/2498488442 shutdown_connections 2024-03-16T21:08:17.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.815+0000 7f8088800640 1 --2- 172.21.15.8:0/2498488442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8080104040 0x7f8080110550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.815+0000 7f8088800640 1 --2- 172.21.15.8:0/2498488442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8080103680 0x7f8080103b00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.815+0000 7f8088800640 1 --2- 172.21.15.8:0/2498488442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8080109690 0x7f8080109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.815+0000 7f8088800640 1 -- 172.21.15.8:0/2498488442 >> 172.21.15.8:0/2498488442 conn(0x7f80800ff1b0 msgr2=0x7f80801015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:17.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.815+0000 7f8088800640 1 -- 172.21.15.8:0/2498488442 shutdown_connections 2024-03-16T21:08:17.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.815+0000 7f8088800640 1 -- 172.21.15.8:0/2498488442 wait complete. 2024-03-16T21:08:17.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.816+0000 7f8088800640 1 Processor -- start 2024-03-16T21:08:17.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8088800640 1 -- start start 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8088800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8080103680 0x7f8080199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8088800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8080104040 0x7f808019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8088800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8080109690 0x7f808019e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8088800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808019ed00 con 0x7f8080104040 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8088800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808019ee70 con 0x7f8080109690 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8088800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808019f030 con 0x7f8080103680 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8085e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8080103680 0x7f8080199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8085400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8080104040 0x7f808019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8085e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8080103680 0x7f8080199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:36884/0 (socket says 172.21.15.8:36884) 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8085e00640 1 -- 172.21.15.8:0/1994452535 learned_addr learned my addr 172.21.15.8:0/1994452535 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.817+0000 7f8086800640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8080109690 0x7f808019e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.818+0000 7f8085e00640 1 -- 172.21.15.8:0/1994452535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8080109690 msgr2=0x7f808019e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.818+0000 7f8085e00640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8080109690 0x7f808019e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.818+0000 7f8085e00640 1 -- 172.21.15.8:0/1994452535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8080104040 msgr2=0x7f808019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:17.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.818+0000 7f8085e00640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8080104040 0x7f808019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:17.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.818+0000 7f8085e00640 1 -- 172.21.15.8:0/1994452535 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c009900 con 0x7f8080103680 2024-03-16T21:08:17.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.818+0000 7f8085e00640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8080103680 0x7f8080199e40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f807400e9f0 tx=0x7f807400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:17.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.818+0000 7f807aa00640 1 -- 172.21.15.8:0/1994452535 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074009720 con 0x7f8080103680 2024-03-16T21:08:17.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.818+0000 7f807aa00640 1 -- 172.21.15.8:0/1994452535 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f807400cd80 con 0x7f8080103680 2024-03-16T21:08:17.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.818+0000 7f8088800640 1 -- 172.21.15.8:0/1994452535 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8070009490 con 0x7f8080103680 2024-03-16T21:08:17.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.818+0000 7f807aa00640 1 -- 172.21.15.8:0/1994452535 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074010690 con 0x7f8080103680 2024-03-16T21:08:17.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.818+0000 7f8088800640 1 -- 172.21.15.8:0/1994452535 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80801a69b0 con 0x7f8080103680 2024-03-16T21:08:17.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.820+0000 7f8088800640 1 -- 172.21.15.8:0/1994452535 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80800687a0 con 0x7f8080103680 2024-03-16T21:08:17.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.821+0000 7f807aa00640 1 -- 172.21.15.8:0/1994452535 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f80740046c0 con 0x7f8080103680 2024-03-16T21:08:17.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.824+0000 7f807aa00640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80680a1c20 0x7f80680a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:17.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.824+0000 7f807aa00640 1 -- 172.21.15.8:0/1994452535 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8074014070 con 0x7f8080103680 2024-03-16T21:08:17.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.824+0000 7f8085400640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80680a1c20 0x7f80680a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:17.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.825+0000 7f8085400640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80680a1c20 0x7f80680a40e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8070000c00 tx=0x7f8070005890 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:17.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:17.826+0000 7f807aa00640 1 -- 172.21.15.8:0/1994452535 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8074096990 con 0x7f8080103680 2024-03-16T21:08:18.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.079+0000 7f8088800640 1 -- 172.21.15.8:0/1994452535 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f808010bbf0 con 0x7f8080103680 2024-03-16T21:08:18.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.090+0000 7f807aa00640 1 -- 172.21.15.8:0/1994452535 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v27) v1 ==== 81+0+734991 (secure 0 0 0) 0x7f80740b8e60 con 0x7f8080103680 2024-03-16T21:08:18.102 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:08:18.102 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 27, 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "active_gid": 15240, 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "active_name": "x", 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "active_addrs": { 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6800", 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 4227086558 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.103 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6801", 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 4227086558 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "active_addr": "172.21.15.8:6801/4227086558", 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "active_change": "2024-03-16T20:57:49.251357+0000", 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "active_mgr_features": 4540701547738038271, 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "available": true, 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "standbys": [ 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "gid": 25363, 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "z", 2024-03-16T21:08:18.104 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr_features": 4540701547738038271, 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.105 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.106 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.107 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.108 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.109 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.110 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.111 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2024-03-16T21:08:18.112 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.113 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.114 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.115 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.116 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.117 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.118 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.119 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2024-03-16T21:08:18.120 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.121 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.122 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2024-03-16T21:08:18.123 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2024-03-16T21:08:18.124 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.125 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.126 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.127 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.128 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.129 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.130 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.131 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "read", 2024-03-16T21:08:18.132 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap", 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap-read" 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.134 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:18.135 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.136 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.137 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2024-03-16T21:08:18.139 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.140 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.141 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.142 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm_log_destination": { 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm_log_destination", 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.143 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "file", 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "file,syslog", 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "syslog" 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2024-03-16T21:08:18.144 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.145 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2024-03-16T21:08:18.146 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2024-03-16T21:08:18.147 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2024-03-16T21:08:18.148 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.149 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2024-03-16T21:08:18.150 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2024-03-16T21:08:18.151 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2024-03-16T21:08:18.152 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2024-03-16T21:08:18.153 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2024-03-16T21:08:18.154 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.155 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.156 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-16T21:08:18.157 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.158 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.159 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.160 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.162 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.163 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.164 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.165 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.166 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.167 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.168 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.169 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "hw_monitoring": { 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hw_monitoring", 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.170 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "inventory_list_all": { 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "inventory_list_all", 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.171 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.172 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.173 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.174 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.175 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.176 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.177 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-16T21:08:18.178 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.179 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.180 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.181 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.183 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "oob_default_addr": { 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "oob_default_addr", 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "169.254.1.1", 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.184 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.185 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.189 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2024-03-16T21:08:18.190 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.191 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.192 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.193 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.194 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.195 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.196 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.197 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.198 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.199 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.200 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.201 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.202 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.203 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.204 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.207 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2024-03-16T21:08:18.209 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.210 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.211 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.212 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.213 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.214 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.215 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.218 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.219 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.220 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-16T21:08:18.222 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.223 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.224 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.225 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.229 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-16T21:08:18.231 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-16T21:08:18.232 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.233 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-16T21:08:18.234 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.235 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.236 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.237 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.238 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2024-03-16T21:08:18.240 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-16T21:08:18.241 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-16T21:08:18.242 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.243 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.245 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2024-03-16T21:08:18.246 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.247 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.248 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.249 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.250 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.251 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.253 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.254 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.255 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2024-03-16T21:08:18.257 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.258 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2024-03-16T21:08:18.259 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2024-03-16T21:08:18.260 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2024-03-16T21:08:18.261 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.263 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.264 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.265 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.267 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.268 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.270 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:18.271 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2024-03-16T21:08:18.272 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.273 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.274 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.276 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.277 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.278 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2024-03-16T21:08:18.279 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.280 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.281 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.282 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.283 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.284 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.285 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.286 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.287 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2024-03-16T21:08:18.289 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.290 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.291 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:18.292 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.293 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2024-03-16T21:08:18.294 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.295 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.296 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.297 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.298 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.299 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2024-03-16T21:08:18.300 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.301 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.302 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.303 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.304 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2024-03-16T21:08:18.305 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.306 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.307 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.308 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.309 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.310 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.311 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.313 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.313 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.313 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.313 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2024-03-16T21:08:18.315 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.316 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.317 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.318 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.319 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.320 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.321 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.322 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.323 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.324 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.326 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.327 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.328 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.329 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.330 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.332 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.333 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.334 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.335 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.336 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.337 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.338 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.339 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.340 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.341 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.342 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.343 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.344 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.345 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.348 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.349 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.350 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.351 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.352 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.353 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2024-03-16T21:08:18.354 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.355 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.356 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.357 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.358 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.359 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.360 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.362 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.363 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.364 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.365 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.366 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.367 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.368 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.369 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.371 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.372 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.373 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.374 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.375 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2024-03-16T21:08:18.376 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.377 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.378 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.379 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.380 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.381 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.382 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.383 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.384 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.385 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.386 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.387 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2024-03-16T21:08:18.388 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2024-03-16T21:08:18.389 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.390 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2024-03-16T21:08:18.391 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.392 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.393 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.394 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.395 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2024-03-16T21:08:18.396 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2024-03-16T21:08:18.397 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2024-03-16T21:08:18.398 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.399 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.400 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.401 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.402 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.403 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.404 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.404 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.404 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.404 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.404 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.404 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.408 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.409 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.410 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.411 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.412 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.413 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.414 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.415 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.416 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.417 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.418 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.419 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.421 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.422 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.423 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.424 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.425 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.426 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.427 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.428 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.429 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.430 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.431 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2024-03-16T21:08:18.432 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2024-03-16T21:08:18.433 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2024-03-16T21:08:18.434 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.435 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.436 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.437 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.438 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.439 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.440 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2024-03-16T21:08:18.441 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.442 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.444 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.445 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.446 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.447 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.449 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.450 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.451 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.452 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.453 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.454 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.455 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.456 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.457 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2024-03-16T21:08:18.458 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.459 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.460 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.461 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.462 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.463 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.464 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.465 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-16T21:08:18.466 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-16T21:08:18.467 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-16T21:08:18.468 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.469 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.470 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.471 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.472 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2024-03-16T21:08:18.475 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.476 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.477 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.478 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.479 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.481 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.482 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.483 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.484 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.485 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.486 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.487 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.488 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.489 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.490 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.492 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.493 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.494 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.495 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.496 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.497 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "periodic_async_work": { 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "periodic_async_work", 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.498 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Periodically check for async work", 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.499 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.500 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.501 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.504 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.505 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.506 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.508 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.510 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.511 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "gid": 25364, 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "y", 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr_features": 4540701547738038271, 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.512 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.514 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.515 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.516 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.517 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.519 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.522 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2024-03-16T21:08:18.523 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2024-03-16T21:08:18.524 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.525 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.526 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.527 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T21:08:18.528 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.529 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.530 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-16T21:08:18.531 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2024-03-16T21:08:18.532 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2024-03-16T21:08:18.533 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-16T21:08:18.534 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.535 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.536 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.537 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.538 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.539 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.540 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "read", 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap", 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap-read" 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2024-03-16T21:08:18.541 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-16T21:08:18.542 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-16T21:08:18.543 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-16T21:08:18.544 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.545 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.546 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.547 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.548 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.549 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.550 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.551 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm_log_destination": { 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm_log_destination", 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.552 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "file", 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "file,syslog", 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "syslog" 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2024-03-16T21:08:18.553 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2024-03-16T21:08:18.554 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2024-03-16T21:08:18.555 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2024-03-16T21:08:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2024-03-16T21:08:18.557 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.558 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.559 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-16T21:08:18.560 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.561 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.562 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.563 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.564 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2024-03-16T21:08:18.565 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.566 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.567 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.568 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2024-03-16T21:08:18.569 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.570 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.571 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.572 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-16T21:08:18.573 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.574 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.575 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2024-03-16T21:08:18.576 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "hw_monitoring": { 2024-03-16T21:08:18.577 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hw_monitoring", 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "inventory_list_all": { 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "inventory_list_all", 2024-03-16T21:08:18.578 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.579 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.580 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.581 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.583 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.584 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.585 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.587 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2024-03-16T21:08:18.588 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.589 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.590 INFO:teuthology.orchestra.run.smithi008.stdout: "oob_default_addr": { 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "oob_default_addr", 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "169.254.1.1", 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2024-03-16T21:08:18.591 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2024-03-16T21:08:18.592 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2024-03-16T21:08:18.593 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2024-03-16T21:08:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.595 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.596 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.597 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.598 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.599 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.600 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2024-03-16T21:08:18.601 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.602 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.603 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.604 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.605 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.606 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.607 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.608 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2024-03-16T21:08:18.609 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.610 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.611 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.612 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.613 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.614 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-16T21:08:18.615 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.616 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.617 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.618 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.619 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.620 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.621 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.622 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.623 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.624 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2024-03-16T21:08:18.625 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.626 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.627 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.628 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.629 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.630 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.631 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.632 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.633 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.634 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.635 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.636 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.637 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.638 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.640 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.641 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.642 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.643 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.644 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.645 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.646 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.647 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.648 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.649 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.650 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.651 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.652 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2024-03-16T21:08:18.655 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.656 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.657 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.665 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.667 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.668 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.669 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.670 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.671 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.672 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.673 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.674 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.676 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.677 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.678 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2024-03-16T21:08:18.679 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.680 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.681 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.682 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.683 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.684 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.685 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.687 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2024-03-16T21:08:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:18.689 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.690 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-16T21:08:18.691 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.692 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.693 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.694 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.695 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.696 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.697 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.698 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2024-03-16T21:08:18.699 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.700 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.701 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2024-03-16T21:08:18.702 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2024-03-16T21:08:18.703 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2024-03-16T21:08:18.704 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.705 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.706 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.707 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.708 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.709 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.711 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.713 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.714 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.715 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.716 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.717 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.719 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.720 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.721 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.722 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.723 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2024-03-16T21:08:18.724 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.725 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.726 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.727 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.728 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.729 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.730 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.731 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.732 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.733 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.734 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.735 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.737 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.738 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.740 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.741 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.745 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.746 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.747 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.748 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.749 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.750 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.751 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.752 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.753 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.754 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.755 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.756 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.757 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2024-03-16T21:08:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.759 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.760 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.761 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.762 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.763 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.764 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.765 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.766 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.767 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.768 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2024-03-16T21:08:18.769 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.771 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.772 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.773 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:18.774 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.775 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.776 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2024-03-16T21:08:18.777 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.778 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.781 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.782 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.783 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.784 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.785 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.786 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.787 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.788 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.789 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.790 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.791 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2024-03-16T21:08:18.793 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2024-03-16T21:08:18.794 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.795 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.796 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.797 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.798 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.799 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.800 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.801 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.802 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.803 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.804 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.805 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.806 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.807 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.809 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.810 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.812 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.813 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.814 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.815 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.816 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.817 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.819 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.820 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.821 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.822 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.823 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.824 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.825 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.826 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.827 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.828 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.830 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.831 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.832 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.834 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.835 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.837 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.838 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.839 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.840 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.841 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.842 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.842 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.842 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2024-03-16T21:08:18.842 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2024-03-16T21:08:18.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.106+0000 7f8088800640 1 -- 172.21.15.8:0/1994452535 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80680a1c20 msgr2=0x7f80680a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:18.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.106+0000 7f8088800640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80680a1c20 0x7f80680a40e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8070000c00 tx=0x7f8070005890 comp rx=0 tx=0).stop 2024-03-16T21:08:18.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.107+0000 7f8088800640 1 -- 172.21.15.8:0/1994452535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8080103680 msgr2=0x7f8080199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:18.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.107+0000 7f8088800640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8080103680 0x7f8080199e40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f807400e9f0 tx=0x7f807400edf0 comp rx=0 tx=0).stop 2024-03-16T21:08:18.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.107+0000 7f8088800640 1 -- 172.21.15.8:0/1994452535 shutdown_connections 2024-03-16T21:08:18.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.107+0000 7f8088800640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f80680a1c20 0x7f80680a40e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:18.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.107+0000 7f8088800640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8080109690 0x7f808019e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:18.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.107+0000 7f8088800640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8080104040 0x7f808019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:18.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.107+0000 7f8088800640 1 --2- 172.21.15.8:0/1994452535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8080103680 0x7f8080199e40 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:18.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.107+0000 7f8088800640 1 -- 172.21.15.8:0/1994452535 >> 172.21.15.8:0/1994452535 conn(0x7f80800ff1b0 msgr2=0x7f80800ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:18.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.107+0000 7f8088800640 1 -- 172.21.15.8:0/1994452535 shutdown_connections 2024-03-16T21:08:18.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:18.107+0000 7f8088800640 1 -- 172.21.15.8:0/1994452535 wait complete. 2024-03-16T21:08:18.846 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:18 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2218452289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T21:08:18.846 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:18 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:18.846 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:18 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:18.846 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:18 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:18.846 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:18 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:18.846 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:18 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:08:18.846 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:18 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:08:18.846 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:18 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:18.846 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:18 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1994452535' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-16T21:08:18.846 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:18 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2218452289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T21:08:18.847 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:18 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:18.847 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:18 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:18.847 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:18 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:18.847 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:18 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:18.847 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:18 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:08:18.847 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:18 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:08:18.847 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:18 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:18.847 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:18 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1994452535' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-16T21:08:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.848 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.849 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.850 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.851 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.852 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.853 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.854 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.855 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.856 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2024-03-16T21:08:18.857 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.858 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.859 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.860 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.862 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.863 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.864 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.865 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.866 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.867 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.868 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:18.869 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.870 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.871 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.872 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.873 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.874 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.875 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-16T21:08:18.876 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-16T21:08:18.877 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.878 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.879 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.880 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.881 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.882 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.883 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.884 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.885 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.886 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.887 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.888 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.889 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.890 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.891 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.892 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.893 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.894 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.895 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.896 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.897 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.898 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.899 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.900 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.902 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.903 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.904 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.905 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.906 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.907 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-16T21:08:18.908 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "periodic_async_work": { 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "periodic_async_work", 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Periodically check for async work", 2024-03-16T21:08:18.909 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-16T21:08:18.910 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.911 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.913 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.914 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.915 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.916 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.917 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.918 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.919 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2024-03-16T21:08:18.920 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-16T21:08:18.921 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "modules": [ 2024-03-16T21:08:18.922 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "dashboard", 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "iostat", 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "nfs", 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "restful", 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "snap_schedule" 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:18.923 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.924 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.925 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.926 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.927 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.930 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.932 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.933 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.934 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.935 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.936 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.937 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.938 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.939 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.940 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.941 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.942 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.943 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2024-03-16T21:08:18.944 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.946 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.948 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.949 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.950 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.951 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.952 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "read", 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap", 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap-read" 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2024-03-16T21:08:18.953 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:18.954 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2024-03-16T21:08:18.955 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:18.956 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2024-03-16T21:08:18.957 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.959 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.963 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm_log_destination": { 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm_log_destination", 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "file", 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "file,syslog", 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "syslog" 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-16T21:08:18.964 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.965 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.966 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.967 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.968 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.969 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2024-03-16T21:08:18.971 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2024-03-16T21:08:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2024-03-16T21:08:18.973 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.974 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-16T21:08:18.975 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-16T21:08:18.976 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-16T21:08:18.977 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-03-16T21:08:18.978 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.979 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.980 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2024-03-16T21:08:18.981 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.982 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2024-03-16T21:08:18.984 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.985 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.986 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.987 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.988 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "hw_monitoring": { 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hw_monitoring", 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.989 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "inventory_list_all": { 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "inventory_list_all", 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.990 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.991 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:18.993 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:18.994 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.995 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2024-03-16T21:08:18.999 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2024-03-16T21:08:19.000 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.001 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "oob_default_addr": { 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "oob_default_addr", 2024-03-16T21:08:19.002 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "169.254.1.1", 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2024-03-16T21:08:19.003 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2024-03-16T21:08:19.004 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2024-03-16T21:08:19.005 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2024-03-16T21:08:19.008 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.009 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.010 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.011 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.012 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.013 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.014 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.015 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.016 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.017 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.018 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.020 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2024-03-16T21:08:19.021 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.022 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.023 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.025 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2024-03-16T21:08:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2024-03-16T21:08:19.028 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-16T21:08:19.029 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-16T21:08:19.030 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-16T21:08:19.031 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-16T21:08:19.032 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.033 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.034 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.035 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.036 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.037 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.038 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.039 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.040 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.041 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.042 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.043 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.044 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.045 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.046 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.047 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.048 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.050 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.051 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.052 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.053 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.054 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-16T21:08:19.056 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-16T21:08:19.057 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-16T21:08:19.058 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2024-03-16T21:08:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-16T21:08:19.060 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2024-03-16T21:08:19.061 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.062 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-16T21:08:19.063 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-16T21:08:19.064 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-16T21:08:19.065 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.069 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.070 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.071 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.072 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.073 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.074 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.075 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.076 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2024-03-16T21:08:19.077 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.078 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.079 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.080 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.081 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.082 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2024-03-16T21:08:19.083 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.084 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.085 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.086 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.087 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.088 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.089 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.090 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.091 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.092 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.094 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2024-03-16T21:08:19.095 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.096 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.097 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.098 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.099 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.100 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.101 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.102 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.103 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2024-03-16T21:08:19.104 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.105 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.106 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2024-03-16T21:08:19.107 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-16T21:08:19.108 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-16T21:08:19.109 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2024-03-16T21:08:19.110 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-16T21:08:19.111 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.112 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.113 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.114 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.115 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.116 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.117 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.118 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T21:08:19.119 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.120 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2024-03-16T21:08:19.121 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.122 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.123 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.124 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.125 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.126 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.127 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.128 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.129 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.130 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.131 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.132 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.133 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.134 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.136 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.138 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.139 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.140 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.141 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.142 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.143 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.144 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.146 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.147 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.148 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.149 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.150 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.151 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.152 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.153 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.154 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.155 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.156 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.157 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.158 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.159 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.160 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.161 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.162 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.163 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.164 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.165 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2024-03-16T21:08:19.166 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.167 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.168 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.169 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.170 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.171 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.172 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.173 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.174 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.175 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.176 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.177 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.178 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.179 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.180 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.181 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.182 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.183 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.184 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.185 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.186 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.187 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.189 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.190 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.191 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.192 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.193 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.194 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.195 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.196 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.197 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.198 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2024-03-16T21:08:19.199 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.200 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2024-03-16T21:08:19.201 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.202 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.203 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.204 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.205 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.206 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2024-03-16T21:08:19.207 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-16T21:08:19.208 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2024-03-16T21:08:19.209 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2024-03-16T21:08:19.210 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.211 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.213 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.214 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.216 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.217 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.218 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.219 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.220 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.222 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2024-03-16T21:08:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2024-03-16T21:08:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.224 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2024-03-16T21:08:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.225 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2024-03-16T21:08:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2024-03-16T21:08:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.226 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.227 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2024-03-16T21:08:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2024-03-16T21:08:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.228 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.229 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.230 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.233 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.234 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.235 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.236 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.237 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.238 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.239 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.240 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.241 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.242 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.243 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.244 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.245 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.246 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.247 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2024-03-16T21:08:19.248 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.249 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.250 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.251 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.252 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.254 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.255 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.256 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.257 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.258 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.259 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.260 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.261 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.262 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.263 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.265 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.266 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.267 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.268 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.269 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.270 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.271 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.272 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.273 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.276 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.277 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.278 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.279 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.280 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.281 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.282 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.283 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.284 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.285 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.286 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.287 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.288 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.289 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.290 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.291 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.292 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2024-03-16T21:08:19.293 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2024-03-16T21:08:19.294 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2024-03-16T21:08:19.295 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2024-03-16T21:08:19.296 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.297 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.298 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.299 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.300 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.301 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.302 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.303 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.304 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.305 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.306 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.307 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.308 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.309 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.310 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.311 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-16T21:08:19.312 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.313 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.314 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.315 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.316 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.317 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.318 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.319 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.321 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.322 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.323 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.324 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "periodic_async_work": { 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "periodic_async_work", 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Periodically check for async work", 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.325 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-16T21:08:19.326 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2024-03-16T21:08:19.327 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.328 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2024-03-16T21:08:19.329 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2024-03-16T21:08:19.330 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.331 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.332 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2024-03-16T21:08:19.333 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.334 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.335 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.336 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.337 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2024-03-16T21:08:19.338 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "services": { 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "dashboard": "https://172.21.15.8:8443/" 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "always_on_modules": { 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus": [ 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2024-03-16T21:08:19.339 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific": [ 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2024-03-16T21:08:19.340 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy": [ 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2024-03-16T21:08:19.341 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "reef": [ 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2024-03-16T21:08:19.342 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "squid": [ 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2024-03-16T21:08:19.343 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "last_failure_osd_epoch": 89, 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "active_clients": [ 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2936009938 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.344 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "libcephsqlite", 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 863828190 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2024-03-16T21:08:19.345 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3337262890 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2024-03-16T21:08:19.346 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3122407526 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2827522891 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:19.347 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2024-03-16T21:08:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2024-03-16T21:08:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-03-16T21:08:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2024-03-16T21:08:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2024-03-16T21:08:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3367383788 2024-03-16T21:08:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T21:08:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:19.348 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-03-16T21:08:19.348 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:08:19.354 DEBUG:tasks.check_counter:Getting stats from a 2024-03-16T21:08:19.354 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.a perf dump 2024-03-16T21:08:19.355 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:18 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2218452289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T21:08:19.355 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:18 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:19.355 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:18 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:19.355 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:18 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:19.355 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:18 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T21:08:19.355 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:18 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T21:08:19.355 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:18 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T21:08:19.355 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:18 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' 2024-03-16T21:08:19.355 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:18 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1994452535' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-16T21:08:19.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:19 smithi008 ceph-mon[31434]: pgmap v325: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-03-16T21:08:19.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:19 smithi008 ceph-mon[31434]: Adjusting osd_memory_target on smithi008 to 177.8M 2024-03-16T21:08:19.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:19 smithi008 ceph-mon[31434]: Unable to set osd_memory_target on smithi008 to 186497740: error parsing value: Value '186497740' is below minimum 939524096 2024-03-16T21:08:19.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:19 smithi170 ceph-mon[35947]: pgmap v325: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-03-16T21:08:19.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:19 smithi170 ceph-mon[35947]: Adjusting osd_memory_target on smithi008 to 177.8M 2024-03-16T21:08:19.619 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:19 smithi170 ceph-mon[35947]: Unable to set osd_memory_target on smithi008 to 186497740: error parsing value: Value '186497740' is below minimum 939524096 2024-03-16T21:08:19.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:19 smithi186 ceph-mon[36391]: pgmap v325: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-03-16T21:08:19.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:19 smithi186 ceph-mon[36391]: Adjusting osd_memory_target on smithi008 to 177.8M 2024-03-16T21:08:19.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:19 smithi186 ceph-mon[36391]: Unable to set osd_memory_target on smithi008 to 186497740: error parsing value: Value '186497740' is below minimum 939524096 2024-03-16T21:08:19.837 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T21:08:20.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:20 smithi008 ceph-mon[31434]: pgmap v326: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-03-16T21:08:20.618 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:20 smithi170 ceph-mon[35947]: pgmap v326: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-03-16T21:08:20.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:20 smithi186 ceph-mon[36391]: pgmap v326: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-03-16T21:08:22.208 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:08:22.208 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:22.208 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 228, 2024-03-16T21:08:22.208 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 216, 2024-03-16T21:08:22.208 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 1701408, 2024-03-16T21:08:22.208 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 129776, 2024-03-16T21:08:22.208 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2024-03-16T21:08:22.208 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2024-03-16T21:08:22.208 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.108769509, 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.036013925, 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.083580821, 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.010162697, 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 215, 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.020983332, 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000097596 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:22.209 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 1701408, 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 129776 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 2, 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 165, 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 320, 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 183808, 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 5, 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 3, 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.036036141, 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.024970906, 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.004998236, 2024-03-16T21:08:22.210 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 162, 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.037861678, 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000233714 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 183808 2024-03-16T21:08:22.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 4, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 4, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 2992, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 448, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.001751912, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000089607, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.001549409, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 3, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.001642576, 2024-03-16T21:08:22.212 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000547525 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 448 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2024-03-16T21:08:22.213 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:22.214 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:22.215 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 151039, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 32, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2024-03-16T21:08:22.216 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2024-03-16T21:08:22.217 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 230, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 1669268, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 230, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 230, 2024-03-16T21:08:22.218 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 1669268, 2024-03-16T21:08:22.219 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2024-03-16T21:08:22.219 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:22.219 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:22.219 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:22.219 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:22.219 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:22.219 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:08:22.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:22 smithi186 ceph-mon[36391]: pgmap v327: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:08:22.907 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:22 smithi008 ceph-mon[31434]: pgmap v327: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:08:23.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:22 smithi170 ceph-mon[35947]: pgmap v327: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-16T21:08:23.191 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-03-16T21:08:23.192 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-03-16T21:08:23.192 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-03-16T21:08:23.192 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-03-16T21:08:23.192 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-03-16T21:08:23.192 DEBUG:tasks.check_counter:Getting stats from d 2024-03-16T21:08:23.192 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.d perf dump 2024-03-16T21:08:23.630 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T21:08:24.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:24 smithi186 ceph-mon[36391]: pgmap v328: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 B/s wr, 5 op/s 2024-03-16T21:08:24.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:24 smithi008 ceph-mon[31434]: pgmap v328: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 B/s wr, 5 op/s 2024-03-16T21:08:25.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:24 smithi170 ceph-mon[35947]: pgmap v328: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 B/s wr, 5 op/s 2024-03-16T21:08:26.066 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:08:26.066 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:26.066 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 239, 2024-03-16T21:08:26.066 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 225, 2024-03-16T21:08:26.066 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 1706304, 2024-03-16T21:08:26.066 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 134592, 2024-03-16T21:08:26.066 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2024-03-16T21:08:26.066 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.124426357, 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.034762448, 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.118840423, 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.010035837, 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 225, 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.023077179, 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000102565 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:26.067 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 1706304, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 134592 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 2, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 171, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 320, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 184864, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 5, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 3, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.035735728, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.026047150, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.004089214, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:26.068 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 168, 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.029167617, 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000173616 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 184864 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 0, 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2, 2024-03-16T21:08:26.069 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 0, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 0, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.001093520, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000000000, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.000929174, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:26.070 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:26.071 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:26.072 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 149745, 2024-03-16T21:08:26.073 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 31, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2024-03-16T21:08:26.074 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 237, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 1670178, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 237, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2024-03-16T21:08:26.075 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2024-03-16T21:08:26.076 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 237, 2024-03-16T21:08:26.076 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 1670178, 2024-03-16T21:08:26.076 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2024-03-16T21:08:26.076 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:26.076 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:26.076 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:26.076 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:26.076 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:26.076 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:08:26.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:26 smithi186 ceph-mon[36391]: pgmap v329: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:08:26.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:26 smithi008 ceph-mon[31434]: pgmap v329: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:08:27.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:26 smithi170 ceph-mon[35947]: pgmap v329: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-16T21:08:27.185 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-03-16T21:08:27.186 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-03-16T21:08:27.186 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-03-16T21:08:27.186 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-03-16T21:08:27.186 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-03-16T21:08:27.186 DEBUG:tasks.check_counter:Getting stats from g 2024-03-16T21:08:27.186 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.g perf dump 2024-03-16T21:08:27.658 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T21:08:28.894 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:28 smithi008 ceph-mon[31434]: pgmap v330: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:28.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:28 smithi186 ceph-mon[36391]: pgmap v330: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:29.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:28 smithi170 ceph-mon[35947]: pgmap v330: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:30.259 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:08:30.259 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:30.259 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 231, 2024-03-16T21:08:30.259 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 219, 2024-03-16T21:08:30.259 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 1702224, 2024-03-16T21:08:30.259 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 131648, 2024-03-16T21:08:30.259 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2024-03-16T21:08:30.259 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2024-03-16T21:08:30.259 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.123941431, 2024-03-16T21:08:30.259 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.037526657, 2024-03-16T21:08:30.259 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.109990063, 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.010780255, 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 218, 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.021806663, 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000100030 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 1702224, 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 131648 2024-03-16T21:08:30.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 2, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 167, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 320, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 184160, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 5, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 3, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.034176659, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.023701243, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.004496996, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 164, 2024-03-16T21:08:30.261 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.030503750, 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000185998 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 184160 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 4, 2024-03-16T21:08:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 4, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 2992, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 448, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.001247848, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000060069, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.001177674, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 3, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.001512296, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000504098 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:30.263 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 448 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:30.264 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:30.265 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:30.266 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 148977, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 30, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:30.267 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:30.268 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 233, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 1669658, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 233, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 233, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 1669658, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:30.269 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:30.270 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:30.270 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:30.270 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:30.270 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:08:30.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:30 smithi186 ceph-mon[36391]: pgmap v331: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:30.999 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:30 smithi008 ceph-mon[31434]: pgmap v331: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:31.117 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-03-16T21:08:31.117 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-03-16T21:08:31.117 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-03-16T21:08:31.117 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-03-16T21:08:31.117 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-03-16T21:08:31.117 DEBUG:tasks.check_counter:Getting stats from j 2024-03-16T21:08:31.117 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.j perf dump 2024-03-16T21:08:31.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:30 smithi170 ceph-mon[35947]: pgmap v331: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:31.590 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T21:08:32.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:32 smithi008 ceph-mon[31434]: pgmap v332: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:08:33.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:32 smithi170 ceph-mon[35947]: pgmap v332: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:08:33.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:32 smithi186 ceph-mon[36391]: pgmap v332: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:08:33.961 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-03-16T21:08:33.961 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:33.961 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 242, 2024-03-16T21:08:33.961 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 228, 2024-03-16T21:08:33.961 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 1707120, 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 136464, 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.111709090, 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.026536424, 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.108154947, 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.010921102, 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 228, 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.024474351, 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000107343 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:33.962 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 1707120, 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 136464 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 2, 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 173, 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 320, 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 185216, 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 5, 2024-03-16T21:08:33.963 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 3, 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.039253603, 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.027575921, 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.005203811, 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 170, 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.034204589, 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000201203 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:33.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 185216 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 0, 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2, 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 0, 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 0, 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.001757489, 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000000000, 2024-03-16T21:08:33.965 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.001496778, 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-16T21:08:33.966 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:33.967 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:33.968 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 149745, 2024-03-16T21:08:33.969 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 31, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:33.970 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 240, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 1670568, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:33.971 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 240, 2024-03-16T21:08:33.972 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2024-03-16T21:08:33.972 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2024-03-16T21:08:33.972 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 240, 2024-03-16T21:08:33.972 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 1670568, 2024-03-16T21:08:33.972 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2024-03-16T21:08:33.972 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2024-03-16T21:08:33.972 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2024-03-16T21:08:33.972 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2024-03-16T21:08:33.972 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:33.972 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-03-16T21:08:33.972 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-03-16T21:08:34.854 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-03-16T21:08:34.854 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-03-16T21:08:34.854 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-03-16T21:08:34.854 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-03-16T21:08:34.854 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-03-16T21:08:34.854 DEBUG:tasks.check_counter:Getting stats from b 2024-03-16T21:08:34.855 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.b perf dump 2024-03-16T21:08:34.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:34 smithi008 ceph-mon[31434]: pgmap v333: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:35.106 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T21:08:35.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:34 smithi170 ceph-mon[35947]: pgmap v333: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:35.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:34 smithi186 ceph-mon[36391]: pgmap v333: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:36.865 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:36 smithi170 ceph-mon[35947]: pgmap v334: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:08:36.894 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 11500, 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 10477, 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 4500419, 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 57679112, 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 191, 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 7, 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 1.179953710, 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.487378918, 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.257238405, 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.396586614, 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:36.895 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 10478, 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 15.023161032, 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.001433781 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 4378, 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000591932, 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000135 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 42224, 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 1216 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 46352, 2024-03-16T21:08:36.896 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 79778, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 19234361, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 70970358, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 18, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 5, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 2.940138604, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 1.317292459, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 2.408713081, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.450969591, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 79776, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 12.014461670, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000150602 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:36.897 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 68861, 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.010532898, 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000152 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 14807088, 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 37075744 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 11581, 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 9300, 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 6675708, 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 18455826, 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 9, 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 8, 2024-03-16T21:08:36.898 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 1.043575403, 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.419908880, 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.297966851, 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.338613885, 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 9296, 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 10.914869787, 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.001174146 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 6350, 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000878536, 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000138 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.899 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 2139360, 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 264128 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 1, 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-MDSRank": { 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 5532, 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 28.026188412, 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.005066194 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.900 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-PurgeQueue": { 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 8956, 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 2.456669867, 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000274304 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "request": 17983, 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "reply": 17961, 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "reply_latency": { 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 17961, 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 128.634178666, 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.007161860 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.901 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_reply": 0, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "forward": 22, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_complete": 10, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_keys": 4, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_commit": 1261, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_split": 15, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_merge": 3, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes": 2628, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_top": 1698, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_bottom": 818, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pin_tail": 112, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pinned": 201, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_expired": 5646, 2024-03-16T21:08:36.902 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_with_caps": 2, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "caps": 2, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "subtrees": 3, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse": 18465, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_hit": 18413, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_forward": 0, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_discover": 0, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_dir_fetch": 0, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_remote_ino": 0, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_lock": 0, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "load_cent": 0, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "q": 0, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "exported": 30, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "exported_inodes": 5181, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "imported": 13, 2024-03-16T21:08:36.903 INFO:teuthology.orchestra.run.smithi170.stdout: "imported_inodes": 608, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_dir_fetch": 0, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_backtrace_fetch": 6119, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_peer_discover": 0, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rfiles": 4, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rbytes": 234, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rsnaps": 7, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_fetch": 6119, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_set_tag": 0, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_inotable_repaired": 0, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_inodes": 656, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_base_inodes": 20, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dirfrag_rstats": 636, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_file_inodes": 5463, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_inode_file_caps": 12, 2024-03-16T21:08:36.904 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_revoke": 1927, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_grant": 17091, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_trunc": 0, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps": 17079, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps_dirty": 10764, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_cap_release": 57, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "process_request_cap_release": 7771 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_cache": { 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update": 0, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update_receipt": 0, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_try_discover": 0, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_send_discover": 0, 2024-03-16T21:08:36.905 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_handle_discover": 36, 2024-03-16T21:08:36.906 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays": 105, 2024-03-16T21:08:36.906 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_delayed": 0, 2024-03-16T21:08:36.906 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_enqueuing": 0, 2024-03-16T21:08:36.906 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_created": 5903, 2024-03-16T21:08:36.906 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_enqueued": 5798, 2024-03-16T21:08:36.906 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_reintegrated": 0, 2024-03-16T21:08:36.907 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_migrated": 0, 2024-03-16T21:08:36.907 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_processing": 0, 2024-03-16T21:08:36.907 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_enqueued": 0, 2024-03-16T21:08:36.907 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_prioritized": 0, 2024-03-16T21:08:36.907 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_started": 0, 2024-03-16T21:08:36.907 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_completed": 0, 2024-03-16T21:08:36.907 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_enqueue_scrub": 20, 2024-03-16T21:08:36.908 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_exportdir": 32, 2024-03-16T21:08:36.908 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_flush": 0, 2024-03-16T21:08:36.908 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragmentdir": 18, 2024-03-16T21:08:36.908 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragstats": 0, 2024-03-16T21:08:36.908 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_inodestats": 0 2024-03-16T21:08:36.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.908 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_log": { 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "evlrg": 0, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "evadd": 40329, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "evex": 40160, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "evtrm": 40160, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "ev": 169, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "evexg": 0, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "evexd": 8440, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "segadd": 60, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "segex": 59, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "segtrm": 59, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "seg": 1, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "segmjr": 1, 2024-03-16T21:08:36.909 INFO:teuthology.orchestra.run.smithi170.stdout: "segexg": 0, 2024-03-16T21:08:36.910 INFO:teuthology.orchestra.run.smithi170.stdout: "segexd": 11, 2024-03-16T21:08:36.910 INFO:teuthology.orchestra.run.smithi170.stdout: "expos": 91656823, 2024-03-16T21:08:36.910 INFO:teuthology.orchestra.run.smithi170.stdout: "wrpos": 91905371, 2024-03-16T21:08:36.910 INFO:teuthology.orchestra.run.smithi170.stdout: "rdpos": 0, 2024-03-16T21:08:36.910 INFO:teuthology.orchestra.run.smithi170.stdout: "jlat": { 2024-03-16T21:08:36.910 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 946, 2024-03-16T21:08:36.910 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 85.640830344, 2024-03-16T21:08:36.910 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.090529418 2024-03-16T21:08:36.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.910 INFO:teuthology.orchestra.run.smithi170.stdout: "replayed": 0 2024-03-16T21:08:36.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_mem": { 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1144, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "ino+": 12022, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "ino-": 10878, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "dir": 149, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "dir+": 789, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "dir-": 640, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "dn": 2628, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "dn+": 15931, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "dn-": 13303, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "cap": 2, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "cap+": 10653, 2024-03-16T21:08:36.911 INFO:teuthology.orchestra.run.smithi170.stdout: "cap-": 10651, 2024-03-16T21:08:36.912 INFO:teuthology.orchestra.run.smithi170.stdout: "rss": 102080, 2024-03-16T21:08:36.912 INFO:teuthology.orchestra.run.smithi170.stdout: "heap": 231804 2024-03-16T21:08:36.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.912 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_server": { 2024-03-16T21:08:36.912 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_client_request": 19242, 2024-03-16T21:08:36.912 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_server_request": 17, 2024-03-16T21:08:36.912 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_request": 17983, 2024-03-16T21:08:36.912 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_session": 58, 2024-03-16T21:08:36.912 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_peer_request": 40, 2024-03-16T21:08:36.912 INFO:teuthology.orchestra.run.smithi170.stdout: "req_create_latency": { 2024-03-16T21:08:36.912 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 10025, 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 97.081273016, 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.009683917 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getattr_latency": { 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 132, 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.058610613, 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000444019 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getfilelock_latency": { 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.913 INFO:teuthology.orchestra.run.smithi170.stdout: "req_link_latency": { 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookup_latency": { 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 367, 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.228622713, 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000622950 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookuphash_latency": { 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupino_latency": { 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupname_latency": { 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupparent_latency": { 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.916 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupsnap_latency": { 2024-03-16T21:08:36.916 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.916 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.916 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.916 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lssnap_latency": { 2024-03-16T21:08:36.917 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 11, 2024-03-16T21:08:36.917 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.001735903, 2024-03-16T21:08:36.917 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000157809 2024-03-16T21:08:36.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.917 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mkdir_latency": { 2024-03-16T21:08:36.917 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 623, 2024-03-16T21:08:36.917 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 10.510238021, 2024-03-16T21:08:36.917 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.016870366 2024-03-16T21:08:36.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.917 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mknod_latency": { 2024-03-16T21:08:36.918 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.918 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.918 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.918 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mksnap_latency": { 2024-03-16T21:08:36.919 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 11, 2024-03-16T21:08:36.919 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 1.135724440, 2024-03-16T21:08:36.919 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.103247676 2024-03-16T21:08:36.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.919 INFO:teuthology.orchestra.run.smithi170.stdout: "req_open_latency": { 2024-03-16T21:08:36.919 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.920 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.920 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.920 INFO:teuthology.orchestra.run.smithi170.stdout: "req_readdir_latency": { 2024-03-16T21:08:36.920 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 873, 2024-03-16T21:08:36.920 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 1.602346027, 2024-03-16T21:08:36.921 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.001835447 2024-03-16T21:08:36.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.921 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rename_latency": { 2024-03-16T21:08:36.921 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 2, 2024-03-16T21:08:36.921 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.003523273, 2024-03-16T21:08:36.921 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.001761636 2024-03-16T21:08:36.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.922 INFO:teuthology.orchestra.run.smithi170.stdout: "req_renamesnap_latency": { 2024-03-16T21:08:36.922 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.922 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.922 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.923 INFO:teuthology.orchestra.run.smithi170.stdout: "req_snapdiff_latency": { 2024-03-16T21:08:36.923 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.923 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.923 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.925 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmdir_latency": { 2024-03-16T21:08:36.925 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 280, 2024-03-16T21:08:36.926 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 5.209881388, 2024-03-16T21:08:36.926 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.018606719 2024-03-16T21:08:36.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.926 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmsnap_latency": { 2024-03-16T21:08:36.926 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 4, 2024-03-16T21:08:36.927 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.015535684, 2024-03-16T21:08:36.927 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.003883921 2024-03-16T21:08:36.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.927 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmxattr_latency": { 2024-03-16T21:08:36.927 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.927 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.928 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.928 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setattr_latency": { 2024-03-16T21:08:36.928 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 3, 2024-03-16T21:08:36.928 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.223945511, 2024-03-16T21:08:36.928 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.074648503 2024-03-16T21:08:36.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.929 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setdirlayout_latency": { 2024-03-16T21:08:36.929 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.929 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setfilelock_latency": { 2024-03-16T21:08:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setlayout_latency": { 2024-03-16T21:08:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setxattr_latency": { 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 7, 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.016534391, 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.002362055 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: "req_symlink_latency": { 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: "req_unlink_latency": { 2024-03-16T21:08:36.931 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 5623, 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 12.546207686, 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.002231230 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_revoke_eviction": 0, 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_acquisition_throttle": 0, 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getvxattr_latency": { 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_sessions": { 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: "session_count": 2, 2024-03-16T21:08:36.932 INFO:teuthology.orchestra.run.smithi170.stdout: "session_add": 5, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "session_remove": 3, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_open": 2, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_stale": 0, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "total_load": 100, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "average_load": 50, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "avg_session_uptime": 648, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "mdthresh_evicted": 0 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 120, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 120, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:36.933 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:36.934 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:36.935 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 1162240, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 1455, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 1144, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 13, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-03-16T21:08:36.936 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 8032, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 167, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 4843419, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 78335, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:36.937 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: "objecter": { 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: "op_active": 0, 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: "op_laggy": 0, 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send": 25881, 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send_bytes": 105032685, 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: "op_resend": 37, 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: "op_reply": 25881, 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: "op_latency": { 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 25881, 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 2321.054131526, 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.089681779 2024-03-16T21:08:36.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "op_inflight": 0, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "oplen_avg": { 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 25881, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 49398 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "op": 25881, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "op_r": 6235, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "op_w": 19646, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "op_rmw": 0, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "op_pg": 0, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_stat": 549, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_create": 10727, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_read": 82, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_write": 1008, 2024-03-16T21:08:36.939 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writefull": 95, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writesame": 0, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_append": 0, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_zero": 0, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_truncate": 15, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_delete": 6436, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_mapext": 0, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_sparse_read": 0, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_clonerange": 0, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_getxattr": 6153, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_setxattr": 21454, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_cmpxattr": 0, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_rmxattr": 0, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_resetxattrs": 0, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_call": 0, 2024-03-16T21:08:36.940 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_watch": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_notify": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls_filter": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_other": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_active": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_send": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_resend": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_ping": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_active": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_send": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_resend": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_active": 0, 2024-03-16T21:08:36.941 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_send": 0, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_resend": 0, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_active": 0, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_send": 0, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_resend": 0, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "command_active": 0, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "command_send": 0, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "command_resend": 0, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "map_epoch": 97, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "map_full": 0, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "map_inc": 12, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_sessions": 12, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_open": 12, 2024-03-16T21:08:36.942 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_close": 0, 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_laggy": 0, 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_wr": 2626, 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_rd": 28, 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_del": 225 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "oft": { 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_objs": 1, 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_kv_pairs": 0, 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_updates": 0, 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_removes": 0 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "osd-slow-ops": { 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_ops_count": 0 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.943 INFO:teuthology.orchestra.run.smithi170.stdout: "purge_queue": { 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops": 0, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops_high_water": 40, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing": 0, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_high_water": 10, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed_ops": 5864, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed": 5798, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_item_in_journal": 0 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 69429, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 22356875, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:36.944 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 69429, 2024-03-16T21:08:36.945 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-03-16T21:08:36.945 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-03-16T21:08:36.945 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 69429, 2024-03-16T21:08:36.945 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 22356875, 2024-03-16T21:08:36.945 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:36.945 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.945 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.945 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.945 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:36.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.945 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_bytes": { 2024-03-16T21:08:36.946 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:36.946 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-03-16T21:08:36.946 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:36.946 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-03-16T21:08:36.946 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-03-16T21:08:36.946 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:36.946 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:36.946 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 25881, 2024-03-16T21:08:36.946 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 105626691, 2024-03-16T21:08:36.946 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 25881, 2024-03-16T21:08:36.946 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 105626691, 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_ops": { 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 1024, 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:36.947 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 25881, 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 25881, 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 25881, 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 25881, 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle": { 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:36.948 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 5798, 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 594182, 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 5798, 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 62, 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 594182, 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle-0x55d8a4c686e0": { 2024-03-16T21:08:36.949 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:36.950 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-03-16T21:08:36.950 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:36.950 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 40329, 2024-03-16T21:08:36.950 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 87711067, 2024-03-16T21:08:36.950 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:36.950 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 40329, 2024-03-16T21:08:36.950 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-03-16T21:08:36.950 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-03-16T21:08:36.950 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 946, 2024-03-16T21:08:36.950 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 87711067, 2024-03-16T21:08:36.950 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:36.951 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:36.951 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:36.951 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:36.951 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:36.951 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:36.951 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-03-16T21:08:36.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:36 smithi008 ceph-mon[31434]: pgmap v334: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:08:37.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:36 smithi186 ceph-mon[36391]: pgmap v334: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:08:37.692 INFO:tasks.check_counter:Daemon mds.b mds.exported=30 2024-03-16T21:08:37.692 INFO:tasks.check_counter:Daemon mds.b mds.imported=13 2024-03-16T21:08:37.692 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=7 2024-03-16T21:08:37.692 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-03-16T21:08:37.692 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-03-16T21:08:37.692 DEBUG:tasks.check_counter:Getting stats from e 2024-03-16T21:08:37.692 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.e perf dump 2024-03-16T21:08:37.985 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T21:08:38.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:38 smithi008 ceph-mon[31434]: pgmap v335: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:39.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:38 smithi170 ceph-mon[35947]: pgmap v335: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:39.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:38 smithi186 ceph-mon[36391]: pgmap v335: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:39.729 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-03-16T21:08:39.729 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:39.729 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 295, 2024-03-16T21:08:39.729 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 270, 2024-03-16T21:08:39.729 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 5979924, 2024-03-16T21:08:39.729 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 147498, 2024-03-16T21:08:39.729 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 6, 2024-03-16T21:08:39.729 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 2, 2024-03-16T21:08:39.729 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.044563513, 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.009813473, 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.041717654, 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.004582219, 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 269, 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.010142240, 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000037703 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.730 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 1777856, 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 138784 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 747, 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 916, 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 12769412, 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 767976, 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 9, 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 6, 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.063847048, 2024-03-16T21:08:39.731 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.018010663, 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.021185039, 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.019018141, 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 914, 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.051682851, 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000056545 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-03-16T21:08:39.732 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 537520 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 1646, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 1648, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 13516588, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 511964, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 5, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 4, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.105839007, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.030950806, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.031930458, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.034563900, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 1646, 2024-03-16T21:08:39.733 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.035875845, 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000021795 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 0 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 1, 2024-03-16T21:08:39.734 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-MDSRank": { 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 4062, 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.080057520, 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000019708 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-PurgeQueue": { 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.735 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: "request": 0, 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: "reply": 0, 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: "reply_latency": { 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_reply": 0, 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: "forward": 0, 2024-03-16T21:08:39.736 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_complete": 0, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_keys": 0, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_commit": 0, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_split": 0, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_merge": 0, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes": 5298, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_top": 0, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_bottom": 5298, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pin_tail": 0, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pinned": 5298, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_expired": 0, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_with_caps": 0, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "caps": 0, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "subtrees": 1, 2024-03-16T21:08:39.737 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_hit": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_forward": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_discover": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_dir_fetch": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_remote_ino": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_lock": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "load_cent": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "q": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "exported": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "exported_inodes": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "imported": 0, 2024-03-16T21:08:39.738 INFO:teuthology.orchestra.run.smithi170.stdout: "imported_inodes": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_dir_fetch": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_backtrace_fetch": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_peer_discover": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rfiles": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rbytes": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rsnaps": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_fetch": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_set_tag": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_inotable_repaired": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_inodes": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T21:08:39.739 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dirfrag_rstats": 0, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_file_inodes": 0, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_inode_file_caps": 0, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_revoke": 0, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_grant": 0, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_trunc": 0, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps": 0, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps_dirty": 0, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_cap_release": 0, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "process_request_cap_release": 0 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.740 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_cache": { 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update_receipt": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_try_discover": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_send_discover": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_handle_discover": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_delayed": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_enqueuing": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_created": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_enqueued": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_reintegrated": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_migrated": 0, 2024-03-16T21:08:39.741 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_processing": 0, 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_enqueued": 0, 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_prioritized": 0, 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_started": 0, 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_completed": 0, 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_exportdir": 0, 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_flush": 0, 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragmentdir": 0, 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragstats": 0, 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_inodestats": 0 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_log": { 2024-03-16T21:08:39.742 INFO:teuthology.orchestra.run.smithi170.stdout: "evlrg": 0, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "evadd": 0, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "evex": 0, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "evtrm": 0, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "ev": 12756, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "evexg": 0, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "evexd": 0, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "segadd": 0, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "segex": 0, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "segtrm": 0, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "seg": 19, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "segmjr": 3, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "segexg": 0, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "segexd": 0, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "expos": 4194304, 2024-03-16T21:08:39.743 INFO:teuthology.orchestra.run.smithi170.stdout: "wrpos": 33997201, 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "rdpos": 33997012, 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "jlat": { 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "replayed": 12756 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_mem": { 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 929, 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "ino+": 4930, 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "ino-": 4001, 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "dir": 87, 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "dir+": 253, 2024-03-16T21:08:39.744 INFO:teuthology.orchestra.run.smithi170.stdout: "dir-": 166, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "dn": 5298, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "dn+": 7801, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "dn-": 2503, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "cap": 0, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "cap+": 0, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "cap-": 0, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "rss": 59992, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "heap": 215420 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_server": { 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_client_request": 0, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_server_request": 0, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_request": 0, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_session": 0, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_peer_request": 0, 2024-03-16T21:08:39.745 INFO:teuthology.orchestra.run.smithi170.stdout: "req_create_latency": { 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getattr_latency": { 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getfilelock_latency": { 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "req_link_latency": { 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookup_latency": { 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookuphash_latency": { 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupino_latency": { 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupname_latency": { 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupparent_latency": { 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupsnap_latency": { 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lssnap_latency": { 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mkdir_latency": { 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.749 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.750 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.750 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mknod_latency": { 2024-03-16T21:08:39.750 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.750 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.750 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mksnap_latency": { 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "req_open_latency": { 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "req_readdir_latency": { 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rename_latency": { 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "req_renamesnap_latency": { 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "req_snapdiff_latency": { 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.752 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmdir_latency": { 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmsnap_latency": { 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmxattr_latency": { 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.753 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setattr_latency": { 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setdirlayout_latency": { 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setfilelock_latency": { 2024-03-16T21:08:39.754 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setlayout_latency": { 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setxattr_latency": { 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.755 INFO:teuthology.orchestra.run.smithi170.stdout: "req_symlink_latency": { 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "req_unlink_latency": { 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_revoke_eviction": 0, 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_acquisition_throttle": 0, 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getvxattr_latency": { 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.756 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_sessions": { 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: "session_count": 1, 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: "session_add": 4, 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: "session_remove": 3, 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_open": 3, 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_stale": 0, 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: "total_load": 0, 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: "average_load": 0, 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: "avg_session_uptime": 5406, 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: "mdthresh_evicted": 0 2024-03-16T21:08:39.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:39.758 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:39.759 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 250339, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 1037, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 0, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 0, 2024-03-16T21:08:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 8032, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 167, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 5985525, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 59097, 2024-03-16T21:08:39.761 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "objecter": { 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "op_active": 0, 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "op_laggy": 0, 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send": 2415, 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send_bytes": 21, 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "op_resend": 3, 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "op_reply": 2415, 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "op_latency": { 2024-03-16T21:08:39.762 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 2415, 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 2.951927154, 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.001222330 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "op_inflight": 0, 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "oplen_avg": { 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 2415, 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 2416 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "op": 2415, 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "op_r": 2415, 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "op_w": 0, 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "op_rmw": 0, 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "op_pg": 0, 2024-03-16T21:08:39.763 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_stat": 1556, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_create": 0, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_read": 857, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_write": 0, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writefull": 0, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writesame": 0, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_append": 0, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_zero": 0, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_truncate": 0, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_delete": 0, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_mapext": 0, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_sparse_read": 0, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_clonerange": 0, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_getxattr": 1, 2024-03-16T21:08:39.764 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_setxattr": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_cmpxattr": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_rmxattr": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_resetxattrs": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_call": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_watch": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_notify": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls_filter": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_other": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_active": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_send": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_resend": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_ping": 0, 2024-03-16T21:08:39.765 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_active": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_send": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_resend": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_active": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_send": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_resend": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_active": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_send": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_resend": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "command_active": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "command_send": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "command_resend": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "map_epoch": 97, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "map_full": 0, 2024-03-16T21:08:39.766 INFO:teuthology.orchestra.run.smithi170.stdout: "map_inc": 11, 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_sessions": 8, 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_open": 8, 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_close": 0, 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_laggy": 0, 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_wr": 0, 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_rd": 2, 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_del": 0 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "oft": { 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_objs": 0, 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_kv_pairs": 0, 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_updates": 0, 2024-03-16T21:08:39.767 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_removes": 0 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: "osd-slow-ops": { 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_ops_count": 0 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: "purge_queue": { 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops": 0, 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops_high_water": 0, 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing": 0, 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_high_water": 0, 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed_ops": 0, 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed": 0, 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_item_in_journal": 0 2024-03-16T21:08:39.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 2684, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 32007769, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 2684, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 2684, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 32007769, 2024-03-16T21:08:39.769 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_bytes": { 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-03-16T21:08:39.770 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 2415, 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 29803576, 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 2415, 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 29803576, 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_ops": { 2024-03-16T21:08:39.771 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 1024, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 2415, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 2415, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 2415, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 2415, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.772 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle": { 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-03-16T21:08:39.773 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 0, 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 0, 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle-0x5624012ca960": { 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-03-16T21:08:39.774 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 0, 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 0, 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:39.775 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-03-16T21:08:40.601 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-03-16T21:08:40.601 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-03-16T21:08:40.601 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-03-16T21:08:40.601 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-03-16T21:08:40.601 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-03-16T21:08:40.602 DEBUG:tasks.check_counter:Getting stats from h 2024-03-16T21:08:40.602 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.h perf dump 2024-03-16T21:08:40.865 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T21:08:40.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:40 smithi170 ceph-mon[35947]: pgmap v336: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:40.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:40 smithi008 ceph-mon[31434]: pgmap v336: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:41.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:40 smithi186 ceph-mon[36391]: pgmap v336: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:42.632 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-03-16T21:08:42.632 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:42.632 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 11821, 2024-03-16T21:08:42.632 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 23186, 2024-03-16T21:08:42.632 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 7209804, 2024-03-16T21:08:42.632 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 24609731, 2024-03-16T21:08:42.632 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 41, 2024-03-16T21:08:42.632 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 6, 2024-03-16T21:08:42.632 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.891486101, 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.430228541, 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.662774629, 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.035141912, 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 23188, 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 1.176964982, 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000050757 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 23773, 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.003856577, 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000162 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 3582608, 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 9474128 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 2727, 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 2684, 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 856800, 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 6274665, 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 18, 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 5, 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.197901180, 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.069170955, 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.059460455, 2024-03-16T21:08:42.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.057994349, 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 2684, 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.157429946, 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000058654 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 847, 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000111873, 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000132 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 2000, 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 144624 2024-03-16T21:08:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 2453, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 2568, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 2790858, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 9458985, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 16, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 8, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.278989745, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.132809620, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.089315174, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.061930522, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 2561, 2024-03-16T21:08:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.208061547, 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000081242 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 24, 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000002931, 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000122 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 1793488, 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 467360 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 1, 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-03-16T21:08:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-MDSRank": { 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 1185, 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 7.251652286, 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.006119537 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-PurgeQueue": { 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 5475, 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 1.005186846, 2024-03-16T21:08:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000183595 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "request": 4981, 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "reply": 4980, 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "reply_latency": { 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 4980, 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 10.777243589, 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.002164105 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_reply": 0, 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "forward": 1, 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_complete": 0, 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_keys": 0, 2024-03-16T21:08:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_commit": 20, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_split": 1, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_merge": 1, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes": 2042, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_top": 153, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_bottom": 67, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pin_tail": 1822, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pinned": 1822, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_expired": 1113, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_with_caps": 1, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "caps": 1, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "subtrees": 4, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse": 5629, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_hit": 5408, 2024-03-16T21:08:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_forward": 0, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_discover": 15, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_dir_fetch": 0, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_remote_ino": 0, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_lock": 0, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "load_cent": 0, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "q": 0, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "exported": 17, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "exported_inodes": 1108, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "imported": 17, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "imported_inodes": 2853, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_dir_fetch": 0, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_backtrace_fetch": 1358, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_peer_discover": 0, 2024-03-16T21:08:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rfiles": 4, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rbytes": 234, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rsnaps": 7, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_fetch": 1358, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_set_tag": 0, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_inotable_repaired": 0, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_inodes": 55, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dirfrag_rstats": 55, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_file_inodes": 1303, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_inode_file_caps": 0, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_revoke": 590, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_grant": 4761, 2024-03-16T21:08:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_trunc": 0, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps": 3737, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps_dirty": 1057, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_cap_release": 55, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "process_request_cap_release": 4116 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_cache": { 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update": 0, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update_receipt": 0, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_try_discover": 0, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_send_discover": 15, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_handle_discover": 10, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays": 55, 2024-03-16T21:08:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_delayed": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_enqueuing": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_created": 3534, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_enqueued": 3479, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_reintegrated": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_migrated": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_processing": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_enqueued": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_prioritized": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_started": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_completed": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_exportdir": 18, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_flush": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragmentdir": 2, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragstats": 0, 2024-03-16T21:08:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_inodestats": 0 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_log": { 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "evlrg": 0, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "evadd": 12756, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "evex": 0, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "evtrm": 0, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "ev": 12756, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "evexg": 0, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "evexd": 0, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "segadd": 19, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "segex": 0, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "segtrm": 0, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "seg": 19, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "segmjr": 3, 2024-03-16T21:08:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "segexg": 0, 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "segexd": 0, 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "expos": 4194304, 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "wrpos": 33997201, 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "rdpos": 0, 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "jlat": { 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 301, 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 10.913703487, 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.036258151 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "replayed": 0 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_mem": { 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 938, 2024-03-16T21:08:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "ino+": 4924, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "ino-": 3986, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "dir": 97, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "dir+": 247, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "dir-": 150, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "dn": 2042, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "dn+": 7766, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "dn-": 5724, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "cap": 1, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "cap+": 3550, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "cap-": 3549, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "rss": 82132, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "heap": 223612 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_server": { 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_client_request": 6069, 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_server_request": 11, 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_request": 4981, 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_session": 21, 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_peer_request": 45, 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "req_create_latency": { 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 921, 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 1.355138886, 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.001471377 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getattr_latency": { 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 2, 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000527160, 2024-03-16T21:08:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000263580 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getfilelock_latency": { 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "req_link_latency": { 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookup_latency": { 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 418, 2024-03-16T21:08:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.160053438, 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000382902 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookuphash_latency": { 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupino_latency": { 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 1, 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000135996, 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000135996 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupname_latency": { 2024-03-16T21:08:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupparent_latency": { 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupsnap_latency": { 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lssnap_latency": { 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mkdir_latency": { 2024-03-16T21:08:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mknod_latency": { 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mksnap_latency": { 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "req_open_latency": { 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "req_readdir_latency": { 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 104, 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.084663836, 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000814075 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rename_latency": { 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "req_renamesnap_latency": { 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "req_snapdiff_latency": { 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmdir_latency": { 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 153, 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 3.014036680, 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.019699586 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmsnap_latency": { 2024-03-16T21:08:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmxattr_latency": { 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setattr_latency": { 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setdirlayout_latency": { 2024-03-16T21:08:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setfilelock_latency": { 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setlayout_latency": { 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setxattr_latency": { 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "req_symlink_latency": { 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "req_unlink_latency": { 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 3381, 2024-03-16T21:08:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 6.162687593, 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.001822741 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_revoke_eviction": 0, 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_acquisition_throttle": 0, 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getvxattr_latency": { 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_sessions": { 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "session_count": 1, 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "session_add": 4, 2024-03-16T21:08:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "session_remove": 3, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_open": 1, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_stale": 0, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "total_load": 3576, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "average_load": 3576, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "avg_session_uptime": 646, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "mdthresh_evicted": 0 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 0, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 0, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 765259, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 1139, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 264, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 3, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 8032, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 167, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-03-16T21:08:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 3799914, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 54316, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "objecter": { 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "op_active": 0, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "op_laggy": 0, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send": 5408, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send_bytes": 30801941, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "op_resend": 33, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "op_reply": 5408, 2024-03-16T21:08:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "op_latency": { 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 5408, 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 22.909433612, 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.004236211 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "op_inflight": 0, 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "oplen_avg": { 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 5408, 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 5493 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "op": 5408, 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "op_r": 1417, 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "op_w": 3991, 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "op_rmw": 0, 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "op_pg": 0, 2024-03-16T21:08:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_stat": 0, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_create": 10, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_read": 59, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_write": 360, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writefull": 36, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writesame": 0, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_append": 0, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_zero": 0, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_truncate": 1, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_delete": 3522, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_mapext": 0, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_sparse_read": 0, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_clonerange": 0, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_getxattr": 1358, 2024-03-16T21:08:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_setxattr": 20, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_cmpxattr": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_rmxattr": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_resetxattrs": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_call": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_watch": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_notify": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls_filter": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_other": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_active": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_send": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_resend": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_ping": 0, 2024-03-16T21:08:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_active": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_send": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_resend": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_active": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_send": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_resend": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_active": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_send": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_resend": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "command_active": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "command_send": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "command_resend": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "map_epoch": 97, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "map_full": 0, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "map_inc": 11, 2024-03-16T21:08:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_sessions": 12, 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_open": 12, 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_close": 0, 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_laggy": 0, 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_wr": 103, 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_rd": 0, 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_del": 24 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "oft": { 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_objs": 1, 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_kv_pairs": 0, 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_updates": 0, 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_removes": 0 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osd-slow-ops": { 2024-03-16T21:08:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_ops_count": 0 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "purge_queue": { 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops": 0, 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops_high_water": 18, 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing": 0, 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_high_water": 10, 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed_ops": 3495, 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed": 3479, 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_item_in_journal": 0 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 16997, 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 8906929, 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 16997, 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 16997, 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 8906929, 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_bytes": { 2024-03-16T21:08:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 5408, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 31163760, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 5408, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 31163760, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_ops": { 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 1024, 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 5408, 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 5408, 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 5408, 2024-03-16T21:08:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 5408, 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle": { 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 3479, 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 361819, 2024-03-16T21:08:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 3479, 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 59, 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 361819, 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle-0x558410cd86e0": { 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 12756, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 29802897, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 12756, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 301, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 29802897, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:42.677 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-03-16T21:08:42.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:42 smithi170 ceph-mon[35947]: pgmap v337: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:08:42.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:42 smithi008 ceph-mon[31434]: pgmap v337: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:08:43.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:42 smithi186 ceph-mon[36391]: pgmap v337: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:08:43.446 INFO:tasks.check_counter:Daemon mds.h mds.exported=17 2024-03-16T21:08:43.446 INFO:tasks.check_counter:Daemon mds.h mds.imported=17 2024-03-16T21:08:43.446 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=7 2024-03-16T21:08:43.446 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-03-16T21:08:43.446 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-03-16T21:08:43.446 DEBUG:tasks.check_counter:Getting stats from k 2024-03-16T21:08:43.446 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.k perf dump 2024-03-16T21:08:43.730 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T21:08:44.945 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:44 smithi186 ceph-mon[36391]: pgmap v338: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:44.957 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:44 smithi170 ceph-mon[35947]: pgmap v338: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:44.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:44 smithi008 ceph-mon[31434]: pgmap v338: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:45.638 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-03-16T21:08:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 4, 2024-03-16T21:08:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 4, 2024-03-16T21:08:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 2992, 2024-03-16T21:08:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 448, 2024-03-16T21:08:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 4, 2024-03-16T21:08:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 0, 2024-03-16T21:08:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.001301133, 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.000043435, 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.000570308, 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 3, 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000770208, 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000256736 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-03-16T21:08:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 448 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 242, 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 230, 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 1705216, 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 138512, 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 2, 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 1, 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.037447846, 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.008862364, 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.036297655, 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.004134931, 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 229, 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.006863332, 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000029970 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 1705216, 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 138512 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 3, 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 178, 2024-03-16T21:08:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 480, 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 263568, 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 6, 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 3, 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.008373230, 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.004988189, 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.001814035, 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 174, 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.019993021, 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000114902 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 480, 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 263568 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 0, 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 0, 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 0, 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 148732, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 31, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 0, 2024-03-16T21:08:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 0, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 928, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 2, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-03-16T21:08:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 245, 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 1671115, 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 245, 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 245, 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 1671115, 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-03-16T21:08:45.648 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-03-16T21:08:46.333 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-03-16T21:08:46.333 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-03-16T21:08:46.333 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-03-16T21:08:46.333 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-03-16T21:08:46.333 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-03-16T21:08:46.333 DEBUG:tasks.check_counter:Getting stats from c 2024-03-16T21:08:46.334 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.c perf dump 2024-03-16T21:08:46.579 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T21:08:46.945 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:46 smithi008 ceph-mon[31434]: pgmap v339: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:08:46.962 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:46 smithi186 ceph-mon[36391]: pgmap v339: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:08:47.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:46 smithi170 ceph-mon[35947]: pgmap v339: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:08:48.397 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-03-16T21:08:48.397 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 1438, 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 1413, 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 27313281, 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 502818, 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 6, 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 2, 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.127721314, 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.030666791, 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.071865624, 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.030404705, 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:48.398 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1412, 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.039325064, 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000027850 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 1778016, 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 138944 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 1126, 2024-03-16T21:08:48.399 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 1295, 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 29283507, 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 811458, 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 8, 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 6, 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.071846644, 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.021402957, 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.025026128, 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.020527954, 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1293, 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.059088207, 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000045698 2024-03-16T21:08:48.400 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 463072 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 356, 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 358, 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 33646102, 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 110723, 2024-03-16T21:08:48.401 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 6, 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 5, 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.037298768, 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.007458117, 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.019354960, 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.008448125, 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 356, 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.011675273, 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000032795 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.402 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 0 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 1, 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-MDSRank": { 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-03-16T21:08:48.403 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 4377, 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.180664709, 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000041275 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-PurgeQueue": { 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": { 2024-03-16T21:08:48.404 INFO:teuthology.orchestra.run.smithi186.stdout: "request": 0, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "reply": 0, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "reply_latency": { 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_reply": 0, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "forward": 0, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_complete": 0, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_keys": 0, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_commit": 0, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_split": 0, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_merge": 0, 2024-03-16T21:08:48.405 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes": 8708, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_top": 5953, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_bottom": 2755, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pin_tail": 0, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pinned": 204, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_expired": 0, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_with_caps": 0, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "caps": 0, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "subtrees": 2, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse": 0, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_hit": 0, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_forward": 0, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_discover": 0, 2024-03-16T21:08:48.406 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_dir_fetch": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_remote_ino": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_lock": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "load_cent": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "q": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "exported": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "exported_inodes": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "imported": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "imported_inodes": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_dir_fetch": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_backtrace_fetch": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_peer_discover": 0, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rfiles": 4, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rbytes": 234, 2024-03-16T21:08:48.407 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rsnaps": 7, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_fetch": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_set_tag": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_inotable_repaired": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_inodes": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dirfrag_rstats": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_file_inodes": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_inode_file_caps": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_revoke": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_grant": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_trunc": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T21:08:48.408 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps": 0, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps_dirty": 0, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_cap_release": 0, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "process_request_cap_release": 0 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_cache": { 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update": 0, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update_receipt": 0, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_try_discover": 0, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_send_discover": 0, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_handle_discover": 0, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays": 0, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_delayed": 0, 2024-03-16T21:08:48.409 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_enqueuing": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_created": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_enqueued": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_reintegrated": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_migrated": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_processing": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_enqueued": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_prioritized": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_started": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_completed": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_exportdir": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_flush": 0, 2024-03-16T21:08:48.410 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragmentdir": 0, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragstats": 0, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_inodestats": 0 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_log": { 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "evlrg": 0, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "evadd": 0, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "evex": 0, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "evtrm": 0, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "ev": 40329, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "evexg": 0, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "evexd": 0, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "segadd": 0, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "segex": 0, 2024-03-16T21:08:48.411 INFO:teuthology.orchestra.run.smithi186.stdout: "segtrm": 0, 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "seg": 2, 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "segmjr": 14, 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "segexg": 0, 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "segexd": 0, 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "expos": 91656823, 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "wrpos": 91905371, 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "rdpos": 91905259, 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "jlat": { 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: "replayed": 40329 2024-03-16T21:08:48.412 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_mem": { 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "ino": 1280, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "ino+": 11911, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "ino-": 10631, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "dir": 148, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "dir+": 758, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "dir-": 610, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "dn": 8708, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "dn+": 15753, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "dn-": 7045, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "cap": 0, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "cap+": 0, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "cap-": 0, 2024-03-16T21:08:48.413 INFO:teuthology.orchestra.run.smithi186.stdout: "rss": 69352, 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: "heap": 215420 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_server": { 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_client_request": 0, 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_server_request": 0, 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_request": 0, 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_session": 0, 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_peer_request": 0, 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: "req_create_latency": { 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.414 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getattr_latency": { 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getfilelock_latency": { 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "req_link_latency": { 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.415 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookup_latency": { 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookuphash_latency": { 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupino_latency": { 2024-03-16T21:08:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupname_latency": { 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupparent_latency": { 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupsnap_latency": { 2024-03-16T21:08:48.418 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.418 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.418 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.418 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.418 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lssnap_latency": { 2024-03-16T21:08:48.418 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.418 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.418 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.418 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.418 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mkdir_latency": { 2024-03-16T21:08:48.418 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.419 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.419 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.419 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mknod_latency": { 2024-03-16T21:08:48.419 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.419 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.419 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mksnap_latency": { 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "req_open_latency": { 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "req_readdir_latency": { 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.420 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rename_latency": { 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: "req_renamesnap_latency": { 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: "req_snapdiff_latency": { 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.421 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmdir_latency": { 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmsnap_latency": { 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.422 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmxattr_latency": { 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setattr_latency": { 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setdirlayout_latency": { 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.423 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setfilelock_latency": { 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setlayout_latency": { 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setxattr_latency": { 2024-03-16T21:08:48.424 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: "req_symlink_latency": { 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: "req_unlink_latency": { 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.425 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_revoke_eviction": 0, 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_acquisition_throttle": 0, 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getvxattr_latency": { 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_sessions": { 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: "session_count": 2, 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: "session_add": 5, 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: "session_remove": 3, 2024-03-16T21:08:48.426 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_open": 4, 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_stale": 0, 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "total_load": 0, 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "average_load": 0, 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "avg_session_uptime": 3785, 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "mdthresh_evicted": 0 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:48.427 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:48.428 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:48.429 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 272869, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 1431, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 0, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 0, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 8032, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 167, 2024-03-16T21:08:48.430 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 9342469, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 98156, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "objecter": { 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "op_active": 0, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "op_laggy": 0, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send": 2646, 2024-03-16T21:08:48.431 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send_bytes": 26, 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "op_resend": 4, 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "op_reply": 2646, 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "op_latency": { 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 2646, 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 2.473952406, 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000934978 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "op_inflight": 0, 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "oplen_avg": { 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 2646, 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 2647 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "op": 2646, 2024-03-16T21:08:48.432 INFO:teuthology.orchestra.run.smithi186.stdout: "op_r": 2646, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "op_w": 0, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "op_rmw": 0, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "op_pg": 0, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_stat": 1683, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_create": 0, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_read": 960, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_write": 0, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writefull": 0, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writesame": 0, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_append": 0, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_zero": 0, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_truncate": 0, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_delete": 0, 2024-03-16T21:08:48.433 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_mapext": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_sparse_read": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_clonerange": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_getxattr": 2, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_setxattr": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_cmpxattr": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_rmxattr": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_resetxattrs": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_call": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_watch": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_notify": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls_filter": 0, 2024-03-16T21:08:48.434 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_other": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_active": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_send": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_resend": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_ping": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_active": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_send": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_resend": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_active": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_send": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_resend": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_active": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_send": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_resend": 0, 2024-03-16T21:08:48.435 INFO:teuthology.orchestra.run.smithi186.stdout: "command_active": 0, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "command_send": 0, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "command_resend": 0, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "map_epoch": 97, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "map_full": 0, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "map_inc": 11, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_sessions": 9, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_open": 9, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_close": 0, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_laggy": 0, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_wr": 0, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_rd": 2, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_del": 0 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "oft": { 2024-03-16T21:08:48.436 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_objs": 0, 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_kv_pairs": 0, 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_updates": 0, 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_removes": 0 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "osd-slow-ops": { 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_ops_count": 0 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "purge_queue": { 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops": 0, 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops_high_water": 0, 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing": 0, 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_high_water": 0, 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed_ops": 0, 2024-03-16T21:08:48.437 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed": 0, 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_item_in_journal": 0 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 2916, 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 89963809, 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 2916, 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-03-16T21:08:48.438 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 2916, 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 89963809, 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_bytes": { 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:48.439 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 2646, 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 87721146, 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 2646, 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 87721146, 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_ops": { 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:48.440 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 1024, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 2646, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 2646, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 2646, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 2646, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.441 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle": { 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-03-16T21:08:48.442 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle-0x562a39fe8960": { 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:48.443 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-03-16T21:08:48.444 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-03-16T21:08:48.444 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-03-16T21:08:48.444 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-03-16T21:08:48.444 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:48.444 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:48.444 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:48.444 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:48.444 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:48.444 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:48.444 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-03-16T21:08:48.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:48 smithi008 ceph-mon[31434]: pgmap v340: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:49.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:48 smithi170 ceph-mon[35947]: pgmap v340: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:49.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:48 smithi186 ceph-mon[36391]: pgmap v340: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:49.180 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-03-16T21:08:49.180 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-03-16T21:08:49.180 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=7 2024-03-16T21:08:49.181 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-03-16T21:08:49.181 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-03-16T21:08:49.181 DEBUG:tasks.check_counter:Getting stats from f 2024-03-16T21:08:49.181 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.f perf dump 2024-03-16T21:08:49.442 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T21:08:50.964 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:50 smithi186 ceph-mon[36391]: pgmap v341: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:50.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:50 smithi008 ceph-mon[31434]: pgmap v341: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:51.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:50 smithi170 ceph-mon[35947]: pgmap v341: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:51.217 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-03-16T21:08:51.217 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:51.217 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 1838, 2024-03-16T21:08:51.217 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 1838, 2024-03-16T21:08:51.217 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 14613692, 2024-03-16T21:08:51.217 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 570829, 2024-03-16T21:08:51.217 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 6, 2024-03-16T21:08:51.218 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 2, 2024-03-16T21:08:51.218 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.117851876, 2024-03-16T21:08:51.218 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.035431401, 2024-03-16T21:08:51.218 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.034413148, 2024-03-16T21:08:51.218 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.038431561, 2024-03-16T21:08:51.218 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:51.218 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1837, 2024-03-16T21:08:51.218 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.041822408, 2024-03-16T21:08:51.218 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000022766 2024-03-16T21:08:51.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.218 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:51.219 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.219 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.219 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.219 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-03-16T21:08:51.219 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 448 2024-03-16T21:08:51.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.219 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:51.219 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 314, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 289, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 5984350, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 154089, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 4, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 3, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.046146041, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.009838816, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.044133719, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.004890198, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 288, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.018140396, 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000062987 2024-03-16T21:08:51.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 1778400, 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 140032 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 491, 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 665, 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 120636, 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 694479, 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 8, 2024-03-16T21:08:51.221 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 5, 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.038992528, 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.013221357, 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.009019462, 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.012300022, 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 662, 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.045328963, 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000068472 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.222 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 542400 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 1, 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-MDSRank": { 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 3986, 2024-03-16T21:08:51.223 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.075673371, 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000018984 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-PurgeQueue": { 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": { 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "request": 0, 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "reply": 0, 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "reply_latency": { 2024-03-16T21:08:51.224 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_reply": 0, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "forward": 0, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_complete": 0, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_keys": 0, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_commit": 0, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_split": 0, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_merge": 0, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes": 6027, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_top": 0, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_bottom": 6027, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pin_tail": 0, 2024-03-16T21:08:51.225 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pinned": 6027, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_expired": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_with_caps": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "caps": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "subtrees": 1, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_hit": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_forward": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_discover": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_dir_fetch": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_remote_ino": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_lock": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "load_cent": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "q": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "exported": 0, 2024-03-16T21:08:51.226 INFO:teuthology.orchestra.run.smithi186.stdout: "exported_inodes": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "imported": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "imported_inodes": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_dir_fetch": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_backtrace_fetch": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_peer_discover": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rfiles": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rbytes": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rsnaps": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_fetch": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_set_tag": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_inotable_repaired": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_inodes": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T21:08:51.227 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dirfrag_rstats": 0, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_file_inodes": 0, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_inode_file_caps": 0, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_revoke": 0, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_grant": 0, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_trunc": 0, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps": 0, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps_dirty": 0, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_cap_release": 0, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "process_request_cap_release": 0 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_cache": { 2024-03-16T21:08:51.228 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update_receipt": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_try_discover": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_send_discover": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_handle_discover": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_delayed": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_enqueuing": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_created": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_enqueued": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_reintegrated": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_migrated": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_processing": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_enqueued": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_prioritized": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_started": 0, 2024-03-16T21:08:51.229 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_completed": 0, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_exportdir": 0, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_flush": 0, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragmentdir": 0, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragstats": 0, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_inodestats": 0 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_log": { 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "evlrg": 0, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "evadd": 0, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "evex": 0, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "evtrm": 0, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "ev": 7358, 2024-03-16T21:08:51.230 INFO:teuthology.orchestra.run.smithi186.stdout: "evexg": 0, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "evexd": 0, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "segadd": 0, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "segex": 0, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "segtrm": 0, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "seg": 10, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "segmjr": 2, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "segexg": 0, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "segexd": 0, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "expos": 4194304, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "wrpos": 22460947, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "rdpos": 22458859, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "jlat": { 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.231 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "replayed": 7358 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_mem": { 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "ino": 1867, 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "ino+": 4145, 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "ino-": 2278, 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "dir": 169, 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "dir+": 246, 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "dir-": 77, 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "dn": 6027, 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "dn+": 6949, 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "dn-": 922, 2024-03-16T21:08:51.232 INFO:teuthology.orchestra.run.smithi186.stdout: "cap": 0, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "cap+": 0, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "cap-": 0, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "rss": 60636, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "heap": 215420 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_server": { 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_client_request": 0, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_server_request": 0, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_request": 0, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_session": 0, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_peer_request": 0, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "req_create_latency": { 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getattr_latency": { 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getfilelock_latency": { 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "req_link_latency": { 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.234 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookup_latency": { 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookuphash_latency": { 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupino_latency": { 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupname_latency": { 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupparent_latency": { 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupsnap_latency": { 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.236 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lssnap_latency": { 2024-03-16T21:08:51.237 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.237 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.237 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.237 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mkdir_latency": { 2024-03-16T21:08:51.237 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.237 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.238 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.238 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mknod_latency": { 2024-03-16T21:08:51.238 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.238 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.238 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.238 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mksnap_latency": { 2024-03-16T21:08:51.238 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.238 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: "req_open_latency": { 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: "req_readdir_latency": { 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rename_latency": { 2024-03-16T21:08:51.239 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "req_renamesnap_latency": { 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "req_snapdiff_latency": { 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmdir_latency": { 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.240 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmsnap_latency": { 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmxattr_latency": { 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setattr_latency": { 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.241 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setdirlayout_latency": { 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setfilelock_latency": { 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setlayout_latency": { 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.242 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setxattr_latency": { 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "req_symlink_latency": { 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "req_unlink_latency": { 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.243 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_revoke_eviction": 0, 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_acquisition_throttle": 0, 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getvxattr_latency": { 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_sessions": { 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "session_count": 2, 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "session_add": 2, 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "session_remove": 0, 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_open": 2, 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_stale": 0, 2024-03-16T21:08:51.244 INFO:teuthology.orchestra.run.smithi186.stdout: "total_load": 0, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "average_load": 0, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "avg_session_uptime": 2222, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "mdthresh_evicted": 0 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:51.245 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:51.246 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:51.247 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 273318, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 2067, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 8032, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 167, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 8807525, 2024-03-16T21:08:51.248 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 118509, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "objecter": { 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "op_active": 0, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "op_laggy": 0, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send": 2368, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send_bytes": 21, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "op_resend": 3, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "op_reply": 2368, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "op_latency": { 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 2368, 2024-03-16T21:08:51.249 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 1.170977592, 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000494500 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "op_inflight": 0, 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "oplen_avg": { 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 2368, 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 2369 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "op": 2368, 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "op_r": 2368, 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "op_w": 0, 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "op_rmw": 0, 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "op_pg": 0, 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_stat": 1507, 2024-03-16T21:08:51.250 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_create": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_read": 859, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_write": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writefull": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writesame": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_append": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_zero": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_truncate": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_delete": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_mapext": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_sparse_read": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_clonerange": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_getxattr": 1, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_setxattr": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_cmpxattr": 0, 2024-03-16T21:08:51.251 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_rmxattr": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_resetxattrs": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_call": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_watch": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_notify": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls_filter": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_other": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_active": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_send": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_resend": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_ping": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_active": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_send": 0, 2024-03-16T21:08:51.252 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_resend": 0, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_active": 0, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_send": 0, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_resend": 0, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_active": 0, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_send": 0, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_resend": 0, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "command_active": 0, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "command_send": 0, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "command_resend": 0, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "map_epoch": 97, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "map_full": 0, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "map_inc": 11, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_sessions": 6, 2024-03-16T21:08:51.253 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_open": 6, 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_close": 0, 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_laggy": 0, 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_wr": 0, 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_rd": 2, 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_del": 0 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "oft": { 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_objs": 0, 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_kv_pairs": 0, 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_updates": 0, 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_removes": 0 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "osd-slow-ops": { 2024-03-16T21:08:51.254 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_ops_count": 0 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "purge_queue": { 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops": 0, 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops_high_water": 0, 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing": 0, 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_high_water": 0, 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed_ops": 0, 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed": 0, 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_item_in_journal": 0 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-03-16T21:08:51.255 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:51.256 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 2639, 2024-03-16T21:08:51.256 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 20464469, 2024-03-16T21:08:51.256 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:51.256 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 2639, 2024-03-16T21:08:51.256 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-03-16T21:08:51.256 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-03-16T21:08:51.256 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 2639, 2024-03-16T21:08:51.256 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 20464469, 2024-03-16T21:08:51.256 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:51.256 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_bytes": { 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:51.257 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 2368, 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 18266648, 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 2368, 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 18266648, 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_ops": { 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 1024, 2024-03-16T21:08:51.258 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 2368, 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 2368, 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 2368, 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 2368, 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.259 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle": { 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:51.260 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle-0x55e04926c960": { 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-03-16T21:08:51.261 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-03-16T21:08:51.262 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-03-16T21:08:51.262 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:51.262 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:51.262 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:51.262 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:51.262 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:51.262 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:51.262 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-03-16T21:08:51.904 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-03-16T21:08:51.904 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-03-16T21:08:51.904 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-03-16T21:08:51.904 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-03-16T21:08:51.905 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-03-16T21:08:51.905 DEBUG:tasks.check_counter:Getting stats from i 2024-03-16T21:08:51.905 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.i perf dump 2024-03-16T21:08:52.161 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T21:08:52.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:52 smithi186 ceph-mon[36391]: pgmap v342: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:08:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:52 smithi008 ceph-mon[31434]: pgmap v342: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:08:53.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:52 smithi170 ceph-mon[35947]: pgmap v342: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-16T21:08:53.928 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 3061, 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 4087, 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 3597317, 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 15778491, 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 10, 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 5, 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.222020963, 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.095293149, 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.094472294, 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.032071528, 2024-03-16T21:08:53.929 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 4085, 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.131457750, 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000032180 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 4890, 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000723039, 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000147 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 0 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.930 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 5780, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 12368, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 3877951, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 6444134, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 45, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 8, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.457982013, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.211349590, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.276632387, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.025074970, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 12367, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.224673103, 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000018167 2024-03-16T21:08:53.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 10119, 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.001629476, 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000161 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 3644576, 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 5766368 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 1567, 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 1736, 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 636212, 2024-03-16T21:08:53.932 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 5463502, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 18, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 6, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.147803742, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.061611697, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.036001682, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.039115040, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1734, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.089254826, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000051473 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 8, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000808, 2024-03-16T21:08:53.933 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000101 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 464704 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 1, 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-MDSRank": { 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1053, 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 3.275695275, 2024-03-16T21:08:53.934 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.003110821 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-PurgeQueue": { 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 3669, 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.365580016, 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000099640 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": { 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: "request": 2781, 2024-03-16T21:08:53.935 INFO:teuthology.orchestra.run.smithi186.stdout: "reply": 2777, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "reply_latency": { 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 2777, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 7.591729076, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.002733787 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_reply": 0, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "forward": 4, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_complete": 0, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_keys": 0, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_commit": 11, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_split": 0, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_merge": 0, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes": 3863, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_top": 1, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_bottom": 6, 2024-03-16T21:08:53.936 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pin_tail": 3856, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pinned": 3860, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_expired": 246, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_with_caps": 3, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "caps": 3, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "subtrees": 3, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse": 3006, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_hit": 2946, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_forward": 0, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_discover": 11, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_dir_fetch": 0, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_remote_ino": 0, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_lock": 0, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "load_cent": 1000, 2024-03-16T21:08:53.937 INFO:teuthology.orchestra.run.smithi186.stdout: "q": 1, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "exported": 6, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "exported_inodes": 262, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "imported": 23, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "imported_inodes": 3090, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_dir_fetch": 0, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_backtrace_fetch": 800, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_peer_discover": 0, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rfiles": 4, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rbytes": 234, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rsnaps": 7, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_fetch": 800, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_set_tag": 0, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T21:08:53.938 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_inotable_repaired": 0, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_inodes": 53, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dirfrag_rstats": 53, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_file_inodes": 747, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_inode_file_caps": 20, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_revoke": 575, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_grant": 2806, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_trunc": 0, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps": 1725, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps_dirty": 282, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_cap_release": 22, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "process_request_cap_release": 2582 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.939 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_cache": { 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update": 0, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update_receipt": 0, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_try_discover": 0, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_send_discover": 31, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_handle_discover": 0, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays": 152, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_delayed": 0, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_enqueuing": 0, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_created": 2324, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_enqueued": 2172, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_reintegrated": 0, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_migrated": 0, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_processing": 0, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_enqueued": 0, 2024-03-16T21:08:53.940 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_prioritized": 0, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_started": 0, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_completed": 0, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_exportdir": 6, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_flush": 0, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragmentdir": 0, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragstats": 0, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_inodestats": 0 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_log": { 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "evlrg": 0, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "evadd": 7358, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "evex": 0, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "evtrm": 0, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "ev": 7358, 2024-03-16T21:08:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: "evexg": 0, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "evexd": 0, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "segadd": 10, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "segex": 0, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "segtrm": 0, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "seg": 10, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "segmjr": 2, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "segexg": 0, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "segexd": 0, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "expos": 4194304, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "wrpos": 22460947, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "rdpos": 0, 2024-03-16T21:08:53.942 INFO:teuthology.orchestra.run.smithi186.stdout: "jlat": { 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 312, 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 1.783342874, 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.005715842 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "replayed": 0 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_mem": { 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "ino": 1876, 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "ino+": 4130, 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "ino-": 2254, 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "dir": 179, 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "dir+": 230, 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "dir-": 51, 2024-03-16T21:08:53.943 INFO:teuthology.orchestra.run.smithi186.stdout: "dn": 3863, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "dn+": 6909, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "dn-": 3046, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "cap": 3, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "cap+": 2330, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "cap-": 2327, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "rss": 78388, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "heap": 223612 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_server": { 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_client_request": 3560, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_server_request": 22, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_request": 2781, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_session": 18, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_peer_request": 88, 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "req_create_latency": { 2024-03-16T21:08:53.944 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 202, 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.146344023, 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000724475 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getattr_latency": { 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 4, 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.001835067, 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000458766 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getfilelock_latency": { 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "req_link_latency": { 2024-03-16T21:08:53.945 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookup_latency": { 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 165, 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.069315961, 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000420096 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookuphash_latency": { 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.946 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupino_latency": { 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1, 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000167402, 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000167402 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupname_latency": { 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupparent_latency": { 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupsnap_latency": { 2024-03-16T21:08:53.947 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.948 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.948 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.948 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.948 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lssnap_latency": { 2024-03-16T21:08:53.948 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.948 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.948 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.948 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.948 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mkdir_latency": { 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mknod_latency": { 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mksnap_latency": { 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "req_open_latency": { 2024-03-16T21:08:53.949 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: "req_readdir_latency": { 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 81, 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.071858829, 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000887146 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rename_latency": { 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.950 INFO:teuthology.orchestra.run.smithi186.stdout: "req_renamesnap_latency": { 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "req_snapdiff_latency": { 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmdir_latency": { 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 184, 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 4.355113797, 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.023669096 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmsnap_latency": { 2024-03-16T21:08:53.951 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmxattr_latency": { 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setattr_latency": { 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setdirlayout_latency": { 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.952 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setfilelock_latency": { 2024-03-16T21:08:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setlayout_latency": { 2024-03-16T21:08:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setxattr_latency": { 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "req_symlink_latency": { 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "req_unlink_latency": { 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 2140, 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 2.947093997, 2024-03-16T21:08:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001377146 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_revoke_eviction": 0, 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_acquisition_throttle": 0, 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getvxattr_latency": { 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_sessions": { 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: "session_count": 2, 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: "session_add": 2, 2024-03-16T21:08:53.955 INFO:teuthology.orchestra.run.smithi186.stdout: "session_remove": 0, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_open": 2, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_stale": 0, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "total_load": 2004, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "average_load": 1002, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "avg_session_uptime": 667, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "mdthresh_evicted": 0 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:53.956 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:53.957 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:53.958 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 1596663, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 2297, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 616, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 7, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 8032, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 167, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-03-16T21:08:53.959 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 7424650, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 123145, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "objecter": { 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "op_active": 0, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "op_laggy": 0, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send": 3475, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send_bytes": 18730737, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "op_resend": 28, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "op_reply": 3475, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "op_latency": { 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 3475, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 13.256743535, 2024-03-16T21:08:53.960 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.003814890 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "op_inflight": 0, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "oplen_avg": { 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 3475, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 3542 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "op": 3475, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "op_r": 841, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "op_w": 2634, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "op_rmw": 0, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "op_pg": 0, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_stat": 0, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_create": 10, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_read": 41, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_write": 353, 2024-03-16T21:08:53.961 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writefull": 30, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writesame": 0, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_append": 0, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_zero": 0, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_truncate": 0, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_delete": 2196, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_mapext": 0, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_sparse_read": 0, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_clonerange": 0, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_getxattr": 800, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_setxattr": 20, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_cmpxattr": 0, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_rmxattr": 0, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_resetxattrs": 0, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_call": 0, 2024-03-16T21:08:53.962 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_watch": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_notify": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls_filter": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_other": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_active": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_send": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_resend": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_ping": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_active": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_send": 0, 2024-03-16T21:08:53.963 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_resend": 0, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_active": 0, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_send": 0, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_resend": 0, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_active": 0, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_send": 0, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_resend": 0, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "command_active": 0, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "command_send": 0, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "command_resend": 0, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "map_epoch": 97, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "map_full": 0, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "map_inc": 11, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_sessions": 12, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_open": 12, 2024-03-16T21:08:53.964 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_close": 0, 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_laggy": 0, 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_wr": 72, 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_rd": 0, 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_del": 20 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "oft": { 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_objs": 1, 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_kv_pairs": 0, 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_updates": 0, 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_removes": 0 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "osd-slow-ops": { 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_ops_count": 0 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.965 INFO:teuthology.orchestra.run.smithi186.stdout: "purge_queue": { 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops": 0, 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops_high_water": 18, 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing": 0, 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_high_water": 10, 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed_ops": 2180, 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed": 2172, 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_item_in_journal": 0 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-03-16T21:08:53.966 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 10404, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 6952182, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 10404, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 10404, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 6952182, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.967 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_bytes": { 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 3475, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 18960853, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 3475, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 18960853, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.968 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_ops": { 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 1024, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 3475, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 3475, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 3475, 2024-03-16T21:08:53.969 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 3475, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle": { 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 2172, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 230116, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 2172, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-03-16T21:08:53.970 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 41, 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 230116, 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle-0x5576742b86e0": { 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 7358, 2024-03-16T21:08:53.971 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 18266643, 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 7358, 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 312, 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 18266643, 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:53.972 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-03-16T21:08:54.748 INFO:tasks.check_counter:Daemon mds.i mds.exported=6 2024-03-16T21:08:54.748 INFO:tasks.check_counter:Daemon mds.i mds.imported=23 2024-03-16T21:08:54.748 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=7 2024-03-16T21:08:54.748 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-03-16T21:08:54.748 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-03-16T21:08:54.748 DEBUG:tasks.check_counter:Getting stats from l 2024-03-16T21:08:54.749 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b shell --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 -- ceph daemon mds.l perf dump 2024-03-16T21:08:54.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:54 smithi008 ceph-mon[31434]: pgmap v343: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:55.002 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T21:08:55.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:54 smithi170 ceph-mon[35947]: pgmap v343: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:55.125 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:54 smithi186 ceph-mon[36391]: pgmap v343: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:08:56.764 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:56 smithi186 ceph-mon[36391]: pgmap v344: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:08:56.902 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 245, 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 233, 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 1706032, 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 140384, 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 4, 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 0, 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.040699181, 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.008973934, 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.038855181, 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.004039108, 2024-03-16T21:08:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 232, 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.008636918, 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000037228 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 1706032, 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 140384 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 2, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 179, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 320, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 186272, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 5, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 3, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.007854813, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.004693791, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.001577346, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 176, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.034618837, 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000196697 2024-03-16T21:08:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 186272 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 4, 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 4, 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 2992, 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 448, 2024-03-16T21:08:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 2, 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 1, 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.000598471, 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.000036956, 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.000565221, 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 3, 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000750821, 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000250273 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 448 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 0, 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-03-16T21:08:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T21:08:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T21:08:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 148692, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 30, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-03-16T21:08:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 928, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 2, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 247, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 1671478, 2024-03-16T21:08:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 247, 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 247, 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 1671478, 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-03-16T21:08:56.913 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-03-16T21:08:56.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:56 smithi008 ceph-mon[31434]: pgmap v344: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:08:57.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:56 smithi170 ceph-mon[35947]: pgmap v344: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-16T21:08:57.614 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-03-16T21:08:57.614 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-03-16T21:08:57.614 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-03-16T21:08:57.614 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-03-16T21:08:57.614 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-03-16T21:08:57.614 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-16T21:08:57.624 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-16T21:08:57.625 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T21:08:57.625 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T21:08:57.690 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-03-16T21:08:57.690 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T21:08:57.744 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T21:08:57.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.969+0000 7f583ae00640 1 -- 172.21.15.8:0/2128808166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5834068ff0 msgr2=0x7f583410e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:57.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.969+0000 7f583ae00640 1 --2- 172.21.15.8:0/2128808166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5834068ff0 0x7f583410e190 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f582c009900 tx=0x7f582c02bc40 comp rx=0 tx=0).stop 2024-03-16T21:08:57.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.969+0000 7f583ae00640 1 -- 172.21.15.8:0/2128808166 shutdown_connections 2024-03-16T21:08:57.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.969+0000 7f583ae00640 1 --2- 172.21.15.8:0/2128808166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5834068ff0 0x7f583410e190 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.969+0000 7f583ae00640 1 --2- 172.21.15.8:0/2128808166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5834068650 0x7f5834068ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.969+0000 7f583ae00640 1 --2- 172.21.15.8:0/2128808166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5834107380 0x7f5834107760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.969+0000 7f583ae00640 1 -- 172.21.15.8:0/2128808166 >> 172.21.15.8:0/2128808166 conn(0x7f5834075e00 msgr2=0x7f5834076210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.969+0000 7f583ae00640 1 -- 172.21.15.8:0/2128808166 shutdown_connections 2024-03-16T21:08:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.969+0000 7f583ae00640 1 -- 172.21.15.8:0/2128808166 wait complete. 2024-03-16T21:08:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.971+0000 7f583ae00640 1 Processor -- start 2024-03-16T21:08:57.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.971+0000 7f583ae00640 1 -- start start 2024-03-16T21:08:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.971+0000 7f583ae00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5834068650 0x7f583419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.971+0000 7f583ae00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5834068ff0 0x7f583419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.971+0000 7f583ae00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5834107380 0x7f5834199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.971+0000 7f583ae00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5834199fd0 con 0x7f5834068ff0 2024-03-16T21:08:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.971+0000 7f583ae00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583419a140 con 0x7f5834107380 2024-03-16T21:08:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.971+0000 7f583ae00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583419a300 con 0x7f5834068650 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.971+0000 7f5839a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5834068650 0x7f583419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.971+0000 7f5839000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5834068ff0 0x7f583419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.972+0000 7f583a400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5834107380 0x7f5834199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.972+0000 7f5839a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5834068650 0x7f583419f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56956/0 (socket says 172.21.15.8:56956) 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.972+0000 7f5839000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5834068ff0 0x7f583419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57946/0 (socket says 172.21.15.8:57946) 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.972+0000 7f5839a00640 1 -- 172.21.15.8:0/3496566909 learned_addr learned my addr 172.21.15.8:0/3496566909 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.972+0000 7f583a400640 1 -- 172.21.15.8:0/3496566909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5834068650 msgr2=0x7f583419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.972+0000 7f583a400640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5834068650 0x7f583419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.972+0000 7f583a400640 1 -- 172.21.15.8:0/3496566909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5834068ff0 msgr2=0x7f583419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.972+0000 7f583a400640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5834068ff0 0x7f583419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.972+0000 7f583a400640 1 -- 172.21.15.8:0/3496566909 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c009560 con 0x7f5834107380 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.972+0000 7f583a400640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5834107380 0x7f5834199980 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f582c036040 tx=0x7f582c02cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.972+0000 7f5832000640 1 -- 172.21.15.8:0/3496566909 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c02cd20 con 0x7f5834107380 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.973+0000 7f5832000640 1 -- 172.21.15.8:0/3496566909 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f582c004250 con 0x7f5834107380 2024-03-16T21:08:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.973+0000 7f583ae00640 1 -- 172.21.15.8:0/3496566909 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583419a580 con 0x7f5834107380 2024-03-16T21:08:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.973+0000 7f5832000640 1 -- 172.21.15.8:0/3496566909 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c003b50 con 0x7f5834107380 2024-03-16T21:08:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.973+0000 7f583ae00640 1 -- 172.21.15.8:0/3496566909 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58341a6870 con 0x7f5834107380 2024-03-16T21:08:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.974+0000 7f583ae00640 1 -- 172.21.15.8:0/3496566909 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5834068200 con 0x7f5834107380 2024-03-16T21:08:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.976+0000 7f5832000640 1 -- 172.21.15.8:0/3496566909 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f582c003cb0 con 0x7f5834107380 2024-03-16T21:08:57.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.977+0000 7f5832000640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f581c0a1c20 0x7f581c0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:57.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.977+0000 7f5832000640 1 -- 172.21.15.8:0/3496566909 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f582c0efb10 con 0x7f5834107380 2024-03-16T21:08:57.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.978+0000 7f5839a00640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f581c0a1c20 0x7f581c0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:57.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.978+0000 7f5839a00640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f581c0a1c20 0x7f581c0a40e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f583419aac0 tx=0x7f5828009500 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:57.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:57.981+0000 7f5832000640 1 -- 172.21.15.8:0/3496566909 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f582c0b8a90 con 0x7f5834107380 2024-03-16T21:08:58.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.186+0000 7f583ae00640 1 -- 172.21.15.8:0/3496566909 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5834111600 con 0x7f5834107380 2024-03-16T21:08:58.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.189+0000 7f5832000640 1 -- 172.21.15.8:0/3496566909 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+23043 (secure 0 0 0) 0x7f582c0bc150 con 0x7f5834107380 2024-03-16T21:08:58.195 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:08:58.195 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":97,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T21:08:12.304597+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":16,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/1064583862":"2024-03-17T20:57:49.251162+0000","172.21.15.8:6800/1064583862":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/3780969288":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:0/2780502436":"2024-03-17T20:57:49.251162+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/4186367083":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3503977705":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":16,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T21:08:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 -- 172.21.15.8:0/3496566909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f581c0a1c20 msgr2=0x7f581c0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f581c0a1c20 0x7f581c0a40e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f583419aac0 tx=0x7f5828009500 comp rx=0 tx=0).stop 2024-03-16T21:08:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 -- 172.21.15.8:0/3496566909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5834107380 msgr2=0x7f5834199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5834107380 0x7f5834199980 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f582c036040 tx=0x7f582c02cc30 comp rx=0 tx=0).stop 2024-03-16T21:08:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 -- 172.21.15.8:0/3496566909 shutdown_connections 2024-03-16T21:08:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f581c0a1c20 0x7f581c0a40e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5834107380 0x7f5834199980 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5834068ff0 0x7f583419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 --2- 172.21.15.8:0/3496566909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5834068650 0x7f583419f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 -- 172.21.15.8:0/3496566909 >> 172.21.15.8:0/3496566909 conn(0x7f5834075e00 msgr2=0x7f583410c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 -- 172.21.15.8:0/3496566909 shutdown_connections 2024-03-16T21:08:58.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.191+0000 7f583ae00640 1 -- 172.21.15.8:0/3496566909 wait complete. 2024-03-16T21:08:58.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T20:49:51.654925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T20:55:02.896774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T20:55:04.228958+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 16, 'snap_epoch': 96, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T21:08:58.218 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T21:08:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.439+0000 7f52b7600640 1 -- 172.21.15.8:0/3218939449 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52b0107500 msgr2=0x7f52b01078e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.439+0000 7f52b7600640 1 --2- 172.21.15.8:0/3218939449 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52b0107500 0x7f52b01078e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009930 tx=0x7f52a402bc20 comp rx=0 tx=0).stop 2024-03-16T21:08:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.439+0000 7f52b7600640 1 -- 172.21.15.8:0/3218939449 shutdown_connections 2024-03-16T21:08:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.439+0000 7f52b7600640 1 --2- 172.21.15.8:0/3218939449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52b0101e20 0x7f52b010e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.439+0000 7f52b7600640 1 --2- 172.21.15.8:0/3218939449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b0101460 0x7f52b01018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.439+0000 7f52b7600640 1 --2- 172.21.15.8:0/3218939449 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52b0107500 0x7f52b01078e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.439+0000 7f52b7600640 1 -- 172.21.15.8:0/3218939449 >> 172.21.15.8:0/3218939449 conn(0x7f52b00fcf50 msgr2=0x7f52b00ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:58.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.439+0000 7f52b7600640 1 -- 172.21.15.8:0/3218939449 shutdown_connections 2024-03-16T21:08:58.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.439+0000 7f52b7600640 1 -- 172.21.15.8:0/3218939449 wait complete. 2024-03-16T21:08:58.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.440+0000 7f52b7600640 1 Processor -- start 2024-03-16T21:08:58.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.440+0000 7f52b7600640 1 -- start start 2024-03-16T21:08:58.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b7600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52b0101460 0x7f52b0199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:58.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b7600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b0101e20 0x7f52b019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:58.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b7600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52b0107500 0x7f52b019e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:58.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b7600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b019ed10 con 0x7f52b0101460 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b7600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b019ee80 con 0x7f52b0101e20 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b7600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b019f040 con 0x7f52b0107500 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b5600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52b0107500 0x7f52b019e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52afe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b0101e20 0x7f52b019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b5600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52b0107500 0x7f52b019e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56980/0 (socket says 172.21.15.8:56980) 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b5600640 1 -- 172.21.15.8:0/2238705461 learned_addr learned my addr 172.21.15.8:0/2238705461 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52afe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b0101e20 0x7f52b019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41924/0 (socket says 172.21.15.8:41924) 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b4c00640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52b0101460 0x7f52b0199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b5600640 1 -- 172.21.15.8:0/2238705461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b0101e20 msgr2=0x7f52b019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b5600640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b0101e20 0x7f52b019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b5600640 1 -- 172.21.15.8:0/2238705461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52b0101460 msgr2=0x7f52b0199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b5600640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52b0101460 0x7f52b0199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b5600640 1 -- 172.21.15.8:0/2238705461 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a4009560 con 0x7f52b0107500 2024-03-16T21:08:58.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52b4c00640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52b0101460 0x7f52b0199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:08:58.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.441+0000 7f52afe00640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b0101e20 0x7f52b019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:58.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.442+0000 7f52b5600640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52b0107500 0x7f52b019e710 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f52a800eb10 tx=0x7f52a800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:58.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.442+0000 7f52ad600640 1 -- 172.21.15.8:0/2238705461 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a8004b20 con 0x7f52b0107500 2024-03-16T21:08:58.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.442+0000 7f52ad600640 1 -- 172.21.15.8:0/2238705461 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f52a8004c80 con 0x7f52b0107500 2024-03-16T21:08:58.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.442+0000 7f52ad600640 1 -- 172.21.15.8:0/2238705461 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a8010760 con 0x7f52b0107500 2024-03-16T21:08:58.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.442+0000 7f52b7600640 1 -- 172.21.15.8:0/2238705461 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b019f320 con 0x7f52b0107500 2024-03-16T21:08:58.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.442+0000 7f52b7600640 1 -- 172.21.15.8:0/2238705461 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b01a6ba0 con 0x7f52b0107500 2024-03-16T21:08:58.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.443+0000 7f52b7600640 1 -- 172.21.15.8:0/2238705461 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b0068730 con 0x7f52b0107500 2024-03-16T21:08:58.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.445+0000 7f52ad600640 1 -- 172.21.15.8:0/2238705461 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f52a80108e0 con 0x7f52b0107500 2024-03-16T21:08:58.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.447+0000 7f52ad600640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f52980a1c20 0x7f52980a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:58.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.447+0000 7f52ad600640 1 -- 172.21.15.8:0/2238705461 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f52a8014070 con 0x7f52b0107500 2024-03-16T21:08:58.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.447+0000 7f52b4c00640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f52980a1c20 0x7f52980a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:58.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.448+0000 7f52b4c00640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f52980a1c20 0x7f52980a40e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f52a4006010 tx=0x7f52a40046e0 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:58.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.449+0000 7f52ad600640 1 -- 172.21.15.8:0/2238705461 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f52a8096be0 con 0x7f52b0107500 2024-03-16T21:08:58.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.651+0000 7f52b7600640 1 -- 172.21.15.8:0/2238705461 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52b01117f0 con 0x7f52b0107500 2024-03-16T21:08:58.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.651+0000 7f52ad600640 1 -- 172.21.15.8:0/2238705461 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52a809a2a0 con 0x7f52b0107500 2024-03-16T21:08:58.658 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.654+0000 7f52b7600640 1 -- 172.21.15.8:0/2238705461 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f52980a1c20 msgr2=0x7f52980a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.654+0000 7f52b7600640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f52980a1c20 0x7f52980a40e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f52a4006010 tx=0x7f52a40046e0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.654+0000 7f52b7600640 1 -- 172.21.15.8:0/2238705461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52b0107500 msgr2=0x7f52b019e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.654+0000 7f52b7600640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52b0107500 0x7f52b019e710 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f52a800eb10 tx=0x7f52a800c2d0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.654+0000 7f52b7600640 1 -- 172.21.15.8:0/2238705461 shutdown_connections 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.654+0000 7f52b7600640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f52980a1c20 0x7f52980a40e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.654+0000 7f52b7600640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52b0107500 0x7f52b019e710 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.654+0000 7f52b7600640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b0101e20 0x7f52b019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.654+0000 7f52b7600640 1 --2- 172.21.15.8:0/2238705461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52b0101460 0x7f52b0199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.654+0000 7f52b7600640 1 -- 172.21.15.8:0/2238705461 >> 172.21.15.8:0/2238705461 conn(0x7f52b00fcf50 msgr2=0x7f52b00fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.654+0000 7f52b7600640 1 -- 172.21.15.8:0/2238705461 shutdown_connections 2024-03-16T21:08:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.655+0000 7f52b7600640 1 -- 172.21.15.8:0/2238705461 wait complete. 2024-03-16T21:08:58.679 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T21:08:58.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.898+0000 7f5203e00640 1 -- 172.21.15.8:0/2647052443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52041004c0 msgr2=0x7f52041008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:58.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.898+0000 7f5203e00640 1 --2- 172.21.15.8:0/2647052443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52041004c0 0x7f52041008a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009930 tx=0x7f51f402bc20 comp rx=0 tx=0).stop 2024-03-16T21:08:58.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.898+0000 7f5203e00640 1 -- 172.21.15.8:0/2647052443 shutdown_connections 2024-03-16T21:08:58.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.898+0000 7f5203e00640 1 --2- 172.21.15.8:0/2647052443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5204105590 0x7f520410d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.898+0000 7f5203e00640 1 --2- 172.21.15.8:0/2647052443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5204100e70 0x7f5204104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.898+0000 7f5203e00640 1 --2- 172.21.15.8:0/2647052443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52041004c0 0x7f52041008a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.898+0000 7f5203e00640 1 -- 172.21.15.8:0/2647052443 >> 172.21.15.8:0/2647052443 conn(0x7f52040fbd40 msgr2=0x7f52040fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:58.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.898+0000 7f5203e00640 1 -- 172.21.15.8:0/2647052443 shutdown_connections 2024-03-16T21:08:58.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.898+0000 7f5203e00640 1 -- 172.21.15.8:0/2647052443 wait complete. 2024-03-16T21:08:58.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.899+0000 7f5203e00640 1 Processor -- start 2024-03-16T21:08:58.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.899+0000 7f5203e00640 1 -- start start 2024-03-16T21:08:58.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.899+0000 7f5203e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52041004c0 0x7f520419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:58.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.899+0000 7f5203e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5204105590 0x7f520419fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:58.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.899+0000 7f5203e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5204199ae0 0x7f5204199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:58.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.899+0000 7f5203e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520419a4d0 con 0x7f5204199ae0 2024-03-16T21:08:58.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5203e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520419a640 con 0x7f52041004c0 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5203e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520419a800 con 0x7f5204105590 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5202a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52041004c0 0x7f520419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5202a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52041004c0 0x7f520419f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41936/0 (socket says 172.21.15.8:41936) 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5202a00640 1 -- 172.21.15.8:0/1130720791 learned_addr learned my addr 172.21.15.8:0/1130720791 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5202000640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5204105590 0x7f520419fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5203400640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5204199ae0 0x7f5204199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5202a00640 1 -- 172.21.15.8:0/1130720791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5204105590 msgr2=0x7f520419fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5202a00640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5204105590 0x7f520419fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5202a00640 1 -- 172.21.15.8:0/1130720791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5204199ae0 msgr2=0x7f5204199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5202a00640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5204199ae0 0x7f5204199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5202a00640 1 -- 172.21.15.8:0/1130720791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f4009560 con 0x7f52041004c0 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5203400640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5204199ae0 0x7f5204199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.900+0000 7f5202a00640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52041004c0 0x7f520419f930 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f51f4005ab0 tx=0x7f51f402ce40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:58.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.901+0000 7f51fb400640 1 -- 172.21.15.8:0/1130720791 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f40042d0 con 0x7f52041004c0 2024-03-16T21:08:58.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.901+0000 7f51fb400640 1 -- 172.21.15.8:0/1130720791 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f51f4004430 con 0x7f52041004c0 2024-03-16T21:08:58.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.901+0000 7f5203e00640 1 -- 172.21.15.8:0/1130720791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52041a67f0 con 0x7f52041004c0 2024-03-16T21:08:58.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.901+0000 7f51fb400640 1 -- 172.21.15.8:0/1130720791 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4003d30 con 0x7f52041004c0 2024-03-16T21:08:58.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.901+0000 7f5203e00640 1 -- 172.21.15.8:0/1130720791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52041a6ca0 con 0x7f52041004c0 2024-03-16T21:08:58.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.902+0000 7f5203e00640 1 -- 172.21.15.8:0/1130720791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5204068200 con 0x7f52041004c0 2024-03-16T21:08:58.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.904+0000 7f51fb400640 1 -- 172.21.15.8:0/1130720791 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f51f4004e10 con 0x7f52041004c0 2024-03-16T21:08:58.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.905+0000 7f51fb400640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f51e80a1ba0 0x7f51e80a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:58.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.905+0000 7f51fb400640 1 -- 172.21.15.8:0/1130720791 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f51f40efde0 con 0x7f52041004c0 2024-03-16T21:08:58.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.905+0000 7f5202000640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f51e80a1ba0 0x7f51e80a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:58.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.906+0000 7f5202000640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f51e80a1ba0 0x7f51e80a4060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5204068f40 tx=0x7f51f000b410 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:58.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:58.909+0000 7f51fb400640 1 -- 172.21.15.8:0/1130720791 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f51f40b8df0 con 0x7f52041004c0 2024-03-16T21:08:58.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:58 smithi008 ceph-mon[31434]: pgmap v345: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:58.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:58 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3496566909' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T21:08:58.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:58 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2238705461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T21:08:59.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:58 smithi170 ceph-mon[35947]: pgmap v345: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:59.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:58 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3496566909' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T21:08:59.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:58 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2238705461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T21:08:59.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.114+0000 7f5203e00640 1 -- 172.21.15.8:0/1130720791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5204103590 con 0x7f52041004c0 2024-03-16T21:08:59.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.115+0000 7f51fb400640 1 -- 172.21.15.8:0/1130720791 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51f40bc4b0 con 0x7f52041004c0 2024-03-16T21:08:59.121 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-03-16T21:08:59.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 -- 172.21.15.8:0/1130720791 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f51e80a1ba0 msgr2=0x7f51e80a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:59.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f51e80a1ba0 0x7f51e80a4060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5204068f40 tx=0x7f51f000b410 comp rx=0 tx=0).stop 2024-03-16T21:08:59.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 -- 172.21.15.8:0/1130720791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52041004c0 msgr2=0x7f520419f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:59.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52041004c0 0x7f520419f930 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f51f4005ab0 tx=0x7f51f402ce40 comp rx=0 tx=0).stop 2024-03-16T21:08:59.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 -- 172.21.15.8:0/1130720791 shutdown_connections 2024-03-16T21:08:59.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f51e80a1ba0 0x7f51e80a4060 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5204199ae0 0x7f5204199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5204105590 0x7f520419fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 --2- 172.21.15.8:0/1130720791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52041004c0 0x7f520419f930 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 -- 172.21.15.8:0/1130720791 >> 172.21.15.8:0/1130720791 conn(0x7f52040fbd40 msgr2=0x7f520410bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:59.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 -- 172.21.15.8:0/1130720791 shutdown_connections 2024-03-16T21:08:59.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.118+0000 7f5203e00640 1 -- 172.21.15.8:0/1130720791 wait complete. 2024-03-16T21:08:59.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:58 smithi186 ceph-mon[36391]: pgmap v345: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-16T21:08:59.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:58 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3496566909' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T21:08:59.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:58 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2238705461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T21:08:59.145 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T21:08:59.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.375+0000 7f82c3200640 1 -- 172.21.15.8:0/3045903765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82bc109650 msgr2=0x7f82bc109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:59.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.375+0000 7f82c3200640 1 --2- 172.21.15.8:0/3045903765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82bc109650 0x7f82bc109a30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009900 tx=0x7f82b002bc50 comp rx=0 tx=0).stop 2024-03-16T21:08:59.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.375+0000 7f82c3200640 1 -- 172.21.15.8:0/3045903765 shutdown_connections 2024-03-16T21:08:59.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.375+0000 7f82c3200640 1 --2- 172.21.15.8:0/3045903765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82bc103f50 0x7f82bc110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.375+0000 7f82c3200640 1 --2- 172.21.15.8:0/3045903765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82bc103590 0x7f82bc103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.375+0000 7f82c3200640 1 --2- 172.21.15.8:0/3045903765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82bc109650 0x7f82bc109a30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.375+0000 7f82c3200640 1 -- 172.21.15.8:0/3045903765 >> 172.21.15.8:0/3045903765 conn(0x7f82bc0ff000 msgr2=0x7f82bc101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:59.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.375+0000 7f82c3200640 1 -- 172.21.15.8:0/3045903765 shutdown_connections 2024-03-16T21:08:59.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.375+0000 7f82c3200640 1 -- 172.21.15.8:0/3045903765 wait complete. 2024-03-16T21:08:59.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.376+0000 7f82c3200640 1 Processor -- start 2024-03-16T21:08:59.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.376+0000 7f82c3200640 1 -- start start 2024-03-16T21:08:59.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.376+0000 7f82c3200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82bc103590 0x7f82bc199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:59.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.376+0000 7f82c3200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82bc103f50 0x7f82bc19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:59.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.376+0000 7f82c3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82bc109650 0x7f82bc19e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:59.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.376+0000 7f82c3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc19ede0 con 0x7f82bc109650 2024-03-16T21:08:59.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.376+0000 7f82c3200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc19ef50 con 0x7f82bc103f50 2024-03-16T21:08:59.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.376+0000 7f82c3200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc19f110 con 0x7f82bc103590 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82bc109650 0x7f82bc19e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82bc103f50 0x7f82bc19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82bc103f50 0x7f82bc19a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41952/0 (socket says 172.21.15.8:41952) 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c1400640 1 -- 172.21.15.8:0/4277913514 learned_addr learned my addr 172.21.15.8:0/4277913514 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82bc109650 0x7f82bc19e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58000/0 (socket says 172.21.15.8:58000) 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c1e00640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82bc103590 0x7f82bc199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c1400640 1 -- 172.21.15.8:0/4277913514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82bc103590 msgr2=0x7f82bc199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c1400640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82bc103590 0x7f82bc199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c1400640 1 -- 172.21.15.8:0/4277913514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82bc109650 msgr2=0x7f82bc19e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c1400640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82bc109650 0x7f82bc19e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c1400640 1 -- 172.21.15.8:0/4277913514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac009490 con 0x7f82bc103f50 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c1e00640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82bc103590 0x7f82bc199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.377+0000 7f82c2800640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82bc109650 0x7f82bc19e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.378+0000 7f82c1400640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82bc103f50 0x7f82bc19a460 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00ea60 tx=0x7f82ac00ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:59.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.378+0000 7f82b6a00640 1 -- 172.21.15.8:0/4277913514 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac00cd20 con 0x7f82bc103f50 2024-03-16T21:08:59.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.378+0000 7f82c3200640 1 -- 172.21.15.8:0/4277913514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b8009840 con 0x7f82bc103f50 2024-03-16T21:08:59.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.378+0000 7f82b6a00640 1 -- 172.21.15.8:0/4277913514 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f82ac00ce80 con 0x7f82bc103f50 2024-03-16T21:08:59.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.378+0000 7f82b6a00640 1 -- 172.21.15.8:0/4277913514 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac010690 con 0x7f82bc103f50 2024-03-16T21:08:59.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.378+0000 7f82c3200640 1 -- 172.21.15.8:0/4277913514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b0009560 con 0x7f82bc103f50 2024-03-16T21:08:59.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.379+0000 7f82c3200640 1 -- 172.21.15.8:0/4277913514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc068650 con 0x7f82bc103f50 2024-03-16T21:08:59.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.382+0000 7f82b6a00640 1 -- 172.21.15.8:0/4277913514 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f82ac0038a0 con 0x7f82bc103f50 2024-03-16T21:08:59.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.383+0000 7f82b6a00640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82a40a1ba0 0x7f82a40a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:59.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.383+0000 7f82b6a00640 1 -- 172.21.15.8:0/4277913514 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f82ac014070 con 0x7f82bc103f50 2024-03-16T21:08:59.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.383+0000 7f82c1e00640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82a40a1ba0 0x7f82a40a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:59.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.384+0000 7f82c1e00640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82a40a1ba0 0x7f82a40a4060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f82b0006010 tx=0x7f82b002cf90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:59.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.387+0000 7f82b6a00640 1 -- 172.21.15.8:0/4277913514 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f82ac096c00 con 0x7f82bc103f50 2024-03-16T21:08:59.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.589+0000 7f82c3200640 1 -- 172.21.15.8:0/4277913514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82bc10ba60 con 0x7f82bc103f50 2024-03-16T21:08:59.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.590+0000 7f82b6a00640 1 -- 172.21.15.8:0/4277913514 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7f82ac09a2c0 con 0x7f82bc103f50 2024-03-16T21:08:59.596 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-03-16T21:08:59.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 -- 172.21.15.8:0/4277913514 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82a40a1ba0 msgr2=0x7f82a40a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:59.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82a40a1ba0 0x7f82a40a4060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f82b0006010 tx=0x7f82b002cf90 comp rx=0 tx=0).stop 2024-03-16T21:08:59.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 -- 172.21.15.8:0/4277913514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82bc103f50 msgr2=0x7f82bc19a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:59.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82bc103f50 0x7f82bc19a460 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00ea60 tx=0x7f82ac00ee60 comp rx=0 tx=0).stop 2024-03-16T21:08:59.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 -- 172.21.15.8:0/4277913514 shutdown_connections 2024-03-16T21:08:59.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f82a40a1ba0 0x7f82a40a4060 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82bc109650 0x7f82bc19e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82bc103f50 0x7f82bc19a460 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 --2- 172.21.15.8:0/4277913514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82bc103590 0x7f82bc199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 -- 172.21.15.8:0/4277913514 >> 172.21.15.8:0/4277913514 conn(0x7f82bc0ff000 msgr2=0x7f82bc100900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:59.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 -- 172.21.15.8:0/4277913514 shutdown_connections 2024-03-16T21:08:59.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.593+0000 7f82c3200640 1 -- 172.21.15.8:0/4277913514 wait complete. 2024-03-16T21:08:59.618 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T21:08:59.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.834+0000 7fa73e400640 1 -- 172.21.15.8:0/2535323053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738100100 msgr2=0x7fa7381004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:59.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.834+0000 7fa73e400640 1 --2- 172.21.15.8:0/2535323053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738100100 0x7fa7381004e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa728009900 tx=0x7fa72802bc50 comp rx=0 tx=0).stop 2024-03-16T21:08:59.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.834+0000 7fa73e400640 1 -- 172.21.15.8:0/2535323053 shutdown_connections 2024-03-16T21:08:59.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.834+0000 7fa73e400640 1 --2- 172.21.15.8:0/2535323053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa73810dcb0 0x7fa7381100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.834+0000 7fa73e400640 1 --2- 172.21.15.8:0/2535323053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738100ab0 0x7fa73810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.834+0000 7fa73e400640 1 --2- 172.21.15.8:0/2535323053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738100100 0x7fa7381004e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.834+0000 7fa73e400640 1 -- 172.21.15.8:0/2535323053 >> 172.21.15.8:0/2535323053 conn(0x7fa7380fbd40 msgr2=0x7fa7380fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:08:59.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.834+0000 7fa73e400640 1 -- 172.21.15.8:0/2535323053 shutdown_connections 2024-03-16T21:08:59.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.834+0000 7fa73e400640 1 -- 172.21.15.8:0/2535323053 wait complete. 2024-03-16T21:08:59.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.835+0000 7fa73e400640 1 Processor -- start 2024-03-16T21:08:59.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.835+0000 7fa73e400640 1 -- start start 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73e400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738100100 0x7fa73819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73e400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738100ab0 0x7fa73819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73e400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa73810dcb0 0x7fa738199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73e400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73819a160 con 0x7fa738100ab0 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73e400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73819a2d0 con 0x7fa73810dcb0 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73e400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73819a490 con 0x7fa738100100 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73d000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738100100 0x7fa73819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73d000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738100100 0x7fa73819f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57030/0 (socket says 172.21.15.8:57030) 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73d000640 1 -- 172.21.15.8:0/1615091953 learned_addr learned my addr 172.21.15.8:0/1615091953 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa72fe00640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738100ab0 0x7fa73819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73da00640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa73810dcb0 0x7fa738199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73d000640 1 -- 172.21.15.8:0/1615091953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa73810dcb0 msgr2=0x7fa738199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:59.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73d000640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa73810dcb0 0x7fa738199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73d000640 1 -- 172.21.15.8:0/1615091953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738100ab0 msgr2=0x7fa73819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:08:59.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73d000640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738100ab0 0x7fa73819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:08:59.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.836+0000 7fa73d000640 1 -- 172.21.15.8:0/1615091953 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa730009840 con 0x7fa738100100 2024-03-16T21:08:59.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.837+0000 7fa73d000640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738100100 0x7fa73819f910 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa72802efd0 tx=0x7fa72802cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.837+0000 7fa736000640 1 -- 172.21.15.8:0/1615091953 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728004450 con 0x7fa738100100 2024-03-16T21:08:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.837+0000 7fa736000640 1 -- 172.21.15.8:0/1615091953 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fa728005310 con 0x7fa738100100 2024-03-16T21:08:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.837+0000 7fa736000640 1 -- 172.21.15.8:0/1615091953 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728003de0 con 0x7fa738100100 2024-03-16T21:08:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.837+0000 7fa73e400640 1 -- 172.21.15.8:0/1615091953 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa728009560 con 0x7fa738100100 2024-03-16T21:08:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.837+0000 7fa73e400640 1 -- 172.21.15.8:0/1615091953 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7381a67d0 con 0x7fa738100100 2024-03-16T21:08:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.838+0000 7fa73e400640 1 -- 172.21.15.8:0/1615091953 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa738068200 con 0x7fa738100100 2024-03-16T21:08:59.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.840+0000 7fa736000640 1 -- 172.21.15.8:0/1615091953 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fa728005480 con 0x7fa738100100 2024-03-16T21:08:59.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.841+0000 7fa736000640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa71c0a1c20 0x7fa71c0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:08:59.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.842+0000 7fa736000640 1 -- 172.21.15.8:0/1615091953 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa7280ef6e0 con 0x7fa738100100 2024-03-16T21:08:59.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.842+0000 7fa72fe00640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa71c0a1c20 0x7fa71c0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:08:59.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.843+0000 7fa72fe00640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa71c0a1c20 0x7fa71c0a40e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa7380ff2e0 tx=0x7fa72000b410 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:08:59.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:08:59.845+0000 7fa736000640 1 -- 172.21.15.8:0/1615091953 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa7280b8660 con 0x7fa738100100 2024-03-16T21:08:59.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:59 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1130720791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T21:08:59.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:08:59 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/4277913514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T21:09:00.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.064+0000 7fa73e400640 1 -- 172.21.15.8:0/1615091953 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa73819aff0 con 0x7fa738100100 2024-03-16T21:09:00.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.065+0000 7fa736000640 1 -- 172.21.15.8:0/1615091953 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v97) v1 ==== 81+0+927 (secure 0 0 0) 0x7fa7280bbd20 con 0x7fa738100100 2024-03-16T21:09:00.071 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/1064583862 2024-03-17T20:57:49.251162+0000 2024-03-16T21:09:00.071 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/1064583862 2024-03-17T20:57:49.251162+0000 2024-03-16T21:09:00.071 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3780969288 2024-03-17T20:57:49.251162+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/1600768944 2024-03-17T20:47:02.935893+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/1972090527 2024-03-17T20:47:02.935893+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2780502436 2024-03-17T20:57:49.251162+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/1972090527 2024-03-17T20:47:02.935893+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2888433195 2024-03-17T20:46:27.714707+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/834453818 2024-03-17T20:46:27.714707+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/4186367083 2024-03-17T20:57:49.251162+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2989623051 2024-03-17T20:46:27.714707+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3139410089 2024-03-17T20:47:02.935893+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2888433195 2024-03-17T20:46:27.714707+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/304832415 2024-03-17T20:46:27.714707+0000 2024-03-16T21:09:00.072 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3503977705 2024-03-17T20:57:49.251162+0000 2024-03-16T21:09:00.073 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/695532571 2024-03-17T20:47:02.935893+0000 2024-03-16T21:09:00.073 INFO:teuthology.orchestra.run.smithi008.stderr:listed 16 entries 2024-03-16T21:09:00.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 -- 172.21.15.8:0/1615091953 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa71c0a1c20 msgr2=0x7fa71c0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:00.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa71c0a1c20 0x7fa71c0a40e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa7380ff2e0 tx=0x7fa72000b410 comp rx=0 tx=0).stop 2024-03-16T21:09:00.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 -- 172.21.15.8:0/1615091953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738100100 msgr2=0x7fa73819f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:00.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738100100 0x7fa73819f910 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa72802efd0 tx=0x7fa72802cce0 comp rx=0 tx=0).stop 2024-03-16T21:09:00.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 -- 172.21.15.8:0/1615091953 shutdown_connections 2024-03-16T21:09:00.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fa71c0a1c20 0x7fa71c0a40e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:00.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa73810dcb0 0x7fa738199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:00.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa738100ab0 0x7fa73819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:00.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 --2- 172.21.15.8:0/1615091953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa738100100 0x7fa73819f910 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:00.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 -- 172.21.15.8:0/1615091953 >> 172.21.15.8:0/1615091953 conn(0x7fa7380fbd40 msgr2=0x7fa73810ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:00.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 -- 172.21.15.8:0/1615091953 shutdown_connections 2024-03-16T21:09:00.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.068+0000 7fa73e400640 1 -- 172.21.15.8:0/1615091953 wait complete. 2024-03-16T21:09:00.092 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-16T21:09:00.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:09:00.093 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-16T21:09:00.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:59 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1130720791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T21:09:00.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:08:59 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/4277913514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T21:09:00.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:59 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1130720791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T21:09:00.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:08:59 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/4277913514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T21:09:00.243 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2024-03-16T21:09:00.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:09:00.244 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-16T21:09:00.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:09:00.351 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-03-16T21:09:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T21:09:00.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:09:00.403 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T21:09:00.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T21:09:00.473 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2024-03-16T21:09:00.591 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-16T21:09:00.604 INFO:tasks.cephadm:Teardown begin 2024-03-16T21:09:00.604 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T21:09:00.604 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:09:00.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.797+0000 7fd043e00640 1 -- 172.21.15.8:0/1909017492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0440ff9e0 msgr2=0x7fd0440ffdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:00.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.797+0000 7fd043e00640 1 --2- 172.21.15.8:0/1909017492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0440ff9e0 0x7fd0440ffdc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd034009900 tx=0x7fd03402bc50 comp rx=0 tx=0).stop 2024-03-16T21:09:00.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.797+0000 7fd043e00640 1 -- 172.21.15.8:0/1909017492 shutdown_connections 2024-03-16T21:09:00.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.797+0000 7fd043e00640 1 --2- 172.21.15.8:0/1909017492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0441046c0 0x7fd044104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:00.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.797+0000 7fd043e00640 1 --2- 172.21.15.8:0/1909017492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd044100300 0x7fd044104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:00.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.797+0000 7fd043e00640 1 --2- 172.21.15.8:0/1909017492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0440ff9e0 0x7fd0440ffdc0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:00.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.797+0000 7fd043e00640 1 -- 172.21.15.8:0/1909017492 >> 172.21.15.8:0/1909017492 conn(0x7fd044075060 msgr2=0x7fd044075470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:00.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.797+0000 7fd043e00640 1 -- 172.21.15.8:0/1909017492 shutdown_connections 2024-03-16T21:09:00.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.797+0000 7fd043e00640 1 -- 172.21.15.8:0/1909017492 wait complete. 2024-03-16T21:09:00.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.798+0000 7fd043e00640 1 Processor -- start 2024-03-16T21:09:00.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd043e00640 1 -- start start 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd043e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0440ff9e0 0x7fd04419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd043e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd044100300 0x7fd04419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd043e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0441046c0 0x7fd0441999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd043e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04419a020 con 0x7fd0441046c0 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd043e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04419a190 con 0x7fd0440ff9e0 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd043e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04419a350 con 0x7fd044100300 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd042000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd044100300 0x7fd04419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd042a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0440ff9e0 0x7fd04419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd042a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0440ff9e0 0x7fd04419f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:41988/0 (socket says 172.21.15.8:41988) 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd042a00640 1 -- 172.21.15.8:0/3355574300 learned_addr learned my addr 172.21.15.8:0/3355574300 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.799+0000 7fd043400640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0441046c0 0x7fd0441999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:00.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.800+0000 7fd042a00640 1 -- 172.21.15.8:0/3355574300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd044100300 msgr2=0x7fd04419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.800+0000 7fd042a00640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd044100300 0x7fd04419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.800+0000 7fd042a00640 1 -- 172.21.15.8:0/3355574300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0441046c0 msgr2=0x7fd0441999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.800+0000 7fd042a00640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0441046c0 0x7fd0441999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.800+0000 7fd042a00640 1 -- 172.21.15.8:0/3355574300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034009560 con 0x7fd0440ff9e0 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.800+0000 7fd043400640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0441046c0 0x7fd0441999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.800+0000 7fd042000640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd044100300 0x7fd04419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.800+0000 7fd042a00640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0440ff9e0 0x7fd04419f820 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd034005940 tx=0x7fd03402ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.800+0000 7fd048a00640 1 -- 172.21.15.8:0/3355574300 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034004450 con 0x7fd0440ff9e0 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.801+0000 7fd048a00640 1 -- 172.21.15.8:0/3355574300 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fd034005310 con 0x7fd0440ff9e0 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.801+0000 7fd043e00640 1 -- 172.21.15.8:0/3355574300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04419a5d0 con 0x7fd0440ff9e0 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.801+0000 7fd048a00640 1 -- 172.21.15.8:0/3355574300 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034003e60 con 0x7fd0440ff9e0 2024-03-16T21:09:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.801+0000 7fd043e00640 1 -- 172.21.15.8:0/3355574300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0441a68c0 con 0x7fd0440ff9e0 2024-03-16T21:09:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.802+0000 7fd043e00640 1 -- 172.21.15.8:0/3355574300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd044068650 con 0x7fd0440ff9e0 2024-03-16T21:09:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.803+0000 7fd048a00640 1 -- 172.21.15.8:0/3355574300 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fd034005480 con 0x7fd0440ff9e0 2024-03-16T21:09:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.805+0000 7fd048a00640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd0280a1ba0 0x7fd0280a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.805+0000 7fd048a00640 1 -- 172.21.15.8:0/3355574300 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd0340ef790 con 0x7fd0440ff9e0 2024-03-16T21:09:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.805+0000 7fd042000640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd0280a1ba0 0x7fd0280a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:00.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.806+0000 7fd042000640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd0280a1ba0 0x7fd0280a4060 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd0440757f0 tx=0x7fd030005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:00.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:00.811+0000 7fd048a00640 1 -- 172.21.15.8:0/3355574300 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd0340b8710 con 0x7fd0440ff9e0 2024-03-16T21:09:00.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:00 smithi008 ceph-mon[31434]: pgmap v346: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:09:00.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:00 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1615091953' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-16T21:09:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.096+0000 7fd043e00640 1 -- 172.21.15.8:0/3355574300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0441027d0 con 0x7fd0440ff9e0 2024-03-16T21:09:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.097+0000 7fd048a00640 1 -- 172.21.15.8:0/3355574300 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11387 (secure 0 0 0) 0x7fd0340bbdd0 con 0x7fd0440ff9e0 2024-03-16T21:09:01.104 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:09:01.104 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:27.879028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:09:01.104 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-03-16T21:09:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.100+0000 7fd043e00640 1 -- 172.21.15.8:0/3355574300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd0280a1ba0 msgr2=0x7fd0280a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.100+0000 7fd043e00640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd0280a1ba0 0x7fd0280a4060 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd0440757f0 tx=0x7fd030005f90 comp rx=0 tx=0).stop 2024-03-16T21:09:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.100+0000 7fd043e00640 1 -- 172.21.15.8:0/3355574300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0440ff9e0 msgr2=0x7fd04419f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.100+0000 7fd043e00640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0440ff9e0 0x7fd04419f820 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd034005940 tx=0x7fd03402ccc0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.100+0000 7fd043e00640 1 -- 172.21.15.8:0/3355574300 shutdown_connections 2024-03-16T21:09:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.100+0000 7fd043e00640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fd0280a1ba0 0x7fd0280a4060 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.100+0000 7fd043e00640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0441046c0 0x7fd0441999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.100+0000 7fd043e00640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd044100300 0x7fd04419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.100+0000 7fd043e00640 1 --2- 172.21.15.8:0/3355574300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0440ff9e0 0x7fd04419f820 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.100+0000 7fd043e00640 1 -- 172.21.15.8:0/3355574300 >> 172.21.15.8:0/3355574300 conn(0x7fd044075060 msgr2=0x7fd04410c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.100+0000 7fd043e00640 1 -- 172.21.15.8:0/3355574300 shutdown_connections 2024-03-16T21:09:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.101+0000 7fd043e00640 1 -- 172.21.15.8:0/3355574300 wait complete. 2024-03-16T21:09:01.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:00 smithi170 ceph-mon[35947]: pgmap v346: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:09:01.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:00 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1615091953' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-16T21:09:01.124 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T21:09:01.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:00 smithi186 ceph-mon[36391]: pgmap v346: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-16T21:09:01.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:00 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1615091953' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-16T21:09:01.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.339+0000 7f41ff600640 1 -- 172.21.15.8:0/4259833865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41f8107560 msgr2=0x7f41f8107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:01.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.339+0000 7f41ff600640 1 --2- 172.21.15.8:0/4259833865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41f8107560 0x7f41f8107940 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009cd0 tx=0x7f41e802c0e0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.339+0000 7f41ff600640 1 -- 172.21.15.8:0/4259833865 shutdown_connections 2024-03-16T21:09:01.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.339+0000 7f41ff600640 1 --2- 172.21.15.8:0/4259833865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f8101e60 0x7f41f810e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.339+0000 7f41ff600640 1 --2- 172.21.15.8:0/4259833865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f81014a0 0x7f41f8101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.339+0000 7f41ff600640 1 --2- 172.21.15.8:0/4259833865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41f8107560 0x7f41f8107940 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.339+0000 7f41ff600640 1 -- 172.21.15.8:0/4259833865 >> 172.21.15.8:0/4259833865 conn(0x7f41f80fcf90 msgr2=0x7f41f80ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:01.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.339+0000 7f41ff600640 1 -- 172.21.15.8:0/4259833865 shutdown_connections 2024-03-16T21:09:01.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.340+0000 7f41ff600640 1 -- 172.21.15.8:0/4259833865 wait complete. 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.340+0000 7f41ff600640 1 Processor -- start 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41ff600640 1 -- start start 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41ff600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41f81014a0 0x7f41f80737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41ff600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f8101e60 0x7f41f8073d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41ff600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f8107560 0x7f41f8074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41ff600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f81a5f50 con 0x7f41f8107560 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41ff600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f81a60c0 con 0x7f41f81014a0 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41ff600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f81a6280 con 0x7f41f8101e60 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41fcc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41f81014a0 0x7f41f80737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41fcc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41f81014a0 0x7f41f80737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42000/0 (socket says 172.21.15.8:42000) 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41fcc00640 1 -- 172.21.15.8:0/2181405525 learned_addr learned my addr 172.21.15.8:0/2181405525 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41fd600640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f8107560 0x7f41f8074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:01.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.341+0000 7f41f7e00640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f8101e60 0x7f41f8073d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.342+0000 7f41fcc00640 1 -- 172.21.15.8:0/2181405525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f8101e60 msgr2=0x7f41f8073d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.342+0000 7f41fcc00640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f8101e60 0x7f41f8073d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.342+0000 7f41fcc00640 1 -- 172.21.15.8:0/2181405525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f8107560 msgr2=0x7f41f8074270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.342+0000 7f41fcc00640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f8107560 0x7f41f8074270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.342+0000 7f41fcc00640 1 -- 172.21.15.8:0/2181405525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e8009900 con 0x7f41f81014a0 2024-03-16T21:09:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.342+0000 7f41fcc00640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41f81014a0 0x7f41f80737f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f41e8004af0 tx=0x7f41e8034670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.342+0000 7f41f5600640 1 -- 172.21.15.8:0/2181405525 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8032bc0 con 0x7f41f81014a0 2024-03-16T21:09:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.342+0000 7f41f5600640 1 -- 172.21.15.8:0/2181405525 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f41e8003e70 con 0x7f41f81014a0 2024-03-16T21:09:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.342+0000 7f41f5600640 1 -- 172.21.15.8:0/2181405525 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e80048a0 con 0x7f41f81014a0 2024-03-16T21:09:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.342+0000 7f41ff600640 1 -- 172.21.15.8:0/2181405525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f81a6500 con 0x7f41f81014a0 2024-03-16T21:09:01.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.343+0000 7f41ff600640 1 -- 172.21.15.8:0/2181405525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f81a6960 con 0x7f41f81014a0 2024-03-16T21:09:01.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.344+0000 7f41ff600640 1 -- 172.21.15.8:0/2181405525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f8068730 con 0x7f41f81014a0 2024-03-16T21:09:01.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.346+0000 7f41f5600640 1 -- 172.21.15.8:0/2181405525 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f41e800a040 con 0x7f41f81014a0 2024-03-16T21:09:01.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.347+0000 7f41f5600640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41dc0a1c20 0x7f41dc0a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:01.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.347+0000 7f41f5600640 1 -- 172.21.15.8:0/2181405525 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f41e80efff0 con 0x7f41f81014a0 2024-03-16T21:09:01.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.347+0000 7f41f7e00640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41dc0a1c20 0x7f41dc0a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:01.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.348+0000 7f41f7e00640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41dc0a1c20 0x7f41dc0a40e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f41f8075280 tx=0x7f41e400b410 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:01.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.349+0000 7f41f5600640 1 -- 172.21.15.8:0/2181405525 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f41e80b8fb0 con 0x7f41f81014a0 2024-03-16T21:09:01.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.593+0000 7f41ff600640 1 -- 172.21.15.8:0/2181405525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41f8074d20 con 0x7f41f81014a0 2024-03-16T21:09:01.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.594+0000 7f41f5600640 1 -- 172.21.15.8:0/2181405525 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f41e80bc670 con 0x7f41f81014a0 2024-03-16T21:09:01.600 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:09:01.600 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3869749427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3869749427},{"type":"v1","addr":"172.21.15.8:6837","nonce":3869749427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14448,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/4078077734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":4078077734},{"type":"v1","addr":"172.21.15.8:6839","nonce":4078077734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14460,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/1961952474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":1961952474},{"type":"v1","addr":"172.21.15.8:6841","nonce":1961952474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1283670519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1283670519},{"type":"v1","addr":"172.21.15.186:6833","nonce":1283670519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/636279364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":636279364},{"type":"v1","addr":"172.21.15.170:6833","nonce":636279364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1887028715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1887028715},{"type":"v1","addr":"172.21.15.8:6835","nonce":1887028715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T20:55:04.725491+0000","modified":"2024-03-16T21:03:27.879028+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24544,"mds_2":24536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24509":{"gid":24509,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6835/335822502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":335822502},{"type":"v1","addr":"172.21.15.170:6835","nonce":335822502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24511":{"gid":24511,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3505833451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3505833451},{"type":"v1","addr":"172.21.15.186:6835","nonce":3505833451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/1748602428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1748602428},{"type":"v1","addr":"172.21.15.186:6837","nonce":1748602428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24536":{"gid":24536,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.170:6837/3144558039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":3144558039},{"type":"v1","addr":"172.21.15.170:6837","nonce":3144558039}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24544":{"gid":24544,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.186:6839/1721589022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1721589022},{"type":"v1","addr":"172.21.15.186:6839","nonce":1721589022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6839/600336743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":600336743},{"type":"v1","addr":"172.21.15.170:6839","nonce":600336743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24536,24544,24593]},"id":1}]} 2024-03-16T21:09:01.601 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-03-16T21:09:01.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 -- 172.21.15.8:0/2181405525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41dc0a1c20 msgr2=0x7f41dc0a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:01.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41dc0a1c20 0x7f41dc0a40e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f41f8075280 tx=0x7f41e400b410 comp rx=0 tx=0).stop 2024-03-16T21:09:01.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 -- 172.21.15.8:0/2181405525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41f81014a0 msgr2=0x7f41f80737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:01.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41f81014a0 0x7f41f80737f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f41e8004af0 tx=0x7f41e8034670 comp rx=0 tx=0).stop 2024-03-16T21:09:01.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 -- 172.21.15.8:0/2181405525 shutdown_connections 2024-03-16T21:09:01.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f41dc0a1c20 0x7f41dc0a40e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f8107560 0x7f41f8074270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f8101e60 0x7f41f8073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 --2- 172.21.15.8:0/2181405525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41f81014a0 0x7f41f80737f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 -- 172.21.15.8:0/2181405525 >> 172.21.15.8:0/2181405525 conn(0x7f41f80fcf90 msgr2=0x7f41f80fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:01.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 -- 172.21.15.8:0/2181405525 shutdown_connections 2024-03-16T21:09:01.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.597+0000 7f41ff600640 1 -- 172.21.15.8:0/2181405525 wait complete. 2024-03-16T21:09:01.622 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T21:09:01.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.828+0000 7faed9c00640 1 -- 172.21.15.8:0/555113239 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faed4103ea0 msgr2=0x7faed4110360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:01.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.828+0000 7faed9c00640 1 --2- 172.21.15.8:0/555113239 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faed4103ea0 0x7faed4110360 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7faecc009cd0 tx=0x7faecc02c0e0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.828+0000 7faed9c00640 1 -- 172.21.15.8:0/555113239 shutdown_connections 2024-03-16T21:09:01.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.828+0000 7faed9c00640 1 --2- 172.21.15.8:0/555113239 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faed4103ea0 0x7faed4110360 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.828+0000 7faed9c00640 1 --2- 172.21.15.8:0/555113239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed41034e0 0x7faed4103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.828+0000 7faed9c00640 1 --2- 172.21.15.8:0/555113239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed41095a0 0x7faed4109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.828+0000 7faed9c00640 1 -- 172.21.15.8:0/555113239 >> 172.21.15.8:0/555113239 conn(0x7faed40fef90 msgr2=0x7faed41013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:01.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.828+0000 7faed9c00640 1 -- 172.21.15.8:0/555113239 shutdown_connections 2024-03-16T21:09:01.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.828+0000 7faed9c00640 1 -- 172.21.15.8:0/555113239 wait complete. 2024-03-16T21:09:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.829+0000 7faed9c00640 1 Processor -- start 2024-03-16T21:09:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.829+0000 7faed9c00640 1 -- start start 2024-03-16T21:09:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faed41034e0 0x7faed419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed4103ea0 0x7faed419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed41095a0 0x7faed4199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed419a050 con 0x7faed4103ea0 2024-03-16T21:09:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed419a1c0 con 0x7faed41095a0 2024-03-16T21:09:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed419a380 con 0x7faed41034e0 2024-03-16T21:09:01.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed41095a0 0x7faed4199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faed41034e0 0x7faed419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faecbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed4103ea0 0x7faed419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed41095a0 0x7faed4199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42018/0 (socket says 172.21.15.8:42018) 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9200640 1 -- 172.21.15.8:0/2118394475 learned_addr learned my addr 172.21.15.8:0/2118394475 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9200640 1 -- 172.21.15.8:0/2118394475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faed41034e0 msgr2=0x7faed419f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9200640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faed41034e0 0x7faed419f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9200640 1 -- 172.21.15.8:0/2118394475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed4103ea0 msgr2=0x7faed419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9200640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed4103ea0 0x7faed419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.830+0000 7faed9200640 1 -- 172.21.15.8:0/2118394475 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009900 con 0x7faed41095a0 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.831+0000 7faed9200640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed41095a0 0x7faed4199a00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7faecc005e30 tx=0x7faecc034670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.831+0000 7faed1600640 1 -- 172.21.15.8:0/2118394475 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc034e20 con 0x7faed41095a0 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.831+0000 7faed1600640 1 -- 172.21.15.8:0/2118394475 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7faecc003e70 con 0x7faed41095a0 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.831+0000 7faed9c00640 1 -- 172.21.15.8:0/2118394475 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed419a600 con 0x7faed41095a0 2024-03-16T21:09:01.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.831+0000 7faed1600640 1 -- 172.21.15.8:0/2118394475 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc004860 con 0x7faed41095a0 2024-03-16T21:09:01.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.831+0000 7faed9c00640 1 -- 172.21.15.8:0/2118394475 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed41a68f0 con 0x7faed41095a0 2024-03-16T21:09:01.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.832+0000 7faed9c00640 1 -- 172.21.15.8:0/2118394475 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed4068650 con 0x7faed41095a0 2024-03-16T21:09:01.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.834+0000 7faed1600640 1 -- 172.21.15.8:0/2118394475 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7faecc00a040 con 0x7faed41095a0 2024-03-16T21:09:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.835+0000 7faed1600640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faeb80a1ba0 0x7faeb80a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.835+0000 7faed1600640 1 -- 172.21.15.8:0/2118394475 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7faecc0f0060 con 0x7faed41095a0 2024-03-16T21:09:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.835+0000 7faed3e00640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faeb80a1ba0 0x7faeb80a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.836+0000 7faed3e00640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faeb80a1ba0 0x7faeb80a4060 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faed419ab40 tx=0x7faec400b390 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:01.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:01.843+0000 7faed1600640 1 -- 172.21.15.8:0/2118394475 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7faecc0b8fe0 con 0x7faed41095a0 2024-03-16T21:09:01.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:01 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3355574300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:09:01.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:01 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2181405525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:09:02.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.046+0000 7faed9c00640 1 -- 172.21.15.8:0/2118394475 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faed410b9b0 con 0x7faed41095a0 2024-03-16T21:09:02.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.048+0000 7faed1600640 1 -- 172.21.15.8:0/2118394475 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+23043 (secure 0 0 0) 0x7faecc0bc6a0 con 0x7faed41095a0 2024-03-16T21:09:02.054 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-03-16T21:09:02.054 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":97,"fsid":"05d64692-e3d6-11ee-95c9-87774f69a715","created":"2024-03-16T20:45:54.335480+0000","modified":"2024-03-16T21:08:12.304597+0000","last_up_change":"2024-03-16T20:54:06.392030+0000","last_in_change":"2024-03-16T20:53:46.098522+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T20:49:51.654925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T20:55:02.896774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T20:55:04.228958+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":16,"snap_epoch":96,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14eef491-9b9d-4dc1-8779-a2f28a5dbdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6803","nonce":3522564859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6805","nonce":3522564859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6809","nonce":3522564859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":3522564859},{"type":"v1","addr":"172.21.15.8:6807","nonce":3522564859}]},"public_addr":"172.21.15.8:6803/3522564859","cluster_addr":"172.21.15.8:6805/3522564859","heartbeat_back_addr":"172.21.15.8:6809/3522564859","heartbeat_front_addr":"172.21.15.8:6807/3522564859","state":["exists","up"]},{"osd":1,"uuid":"5827deaa-3a3a-46d6-93c8-f03d6d586e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6801","nonce":1357795520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6803","nonce":1357795520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6807","nonce":1357795520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1357795520},{"type":"v1","addr":"172.21.15.170:6805","nonce":1357795520}]},"public_addr":"172.21.15.170:6801/1357795520","cluster_addr":"172.21.15.170:6803/1357795520","heartbeat_back_addr":"172.21.15.170:6807/1357795520","heartbeat_front_addr":"172.21.15.170:6805/1357795520","state":["exists","up"]},{"osd":2,"uuid":"b803123f-d2da-4341-97ed-4b13fb96b49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6801","nonce":1176857805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6803","nonce":1176857805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6807","nonce":1176857805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1176857805},{"type":"v1","addr":"172.21.15.186:6805","nonce":1176857805}]},"public_addr":"172.21.15.186:6801/1176857805","cluster_addr":"172.21.15.186:6803/1176857805","heartbeat_back_addr":"172.21.15.186:6807/1176857805","heartbeat_front_addr":"172.21.15.186:6805/1176857805","state":["exists","up"]},{"osd":3,"uuid":"1a9ec3bc-a405-4fae-a263-63f34412c469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6811","nonce":3279202487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6813","nonce":3279202487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6817","nonce":3279202487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":3279202487},{"type":"v1","addr":"172.21.15.8:6815","nonce":3279202487}]},"public_addr":"172.21.15.8:6811/3279202487","cluster_addr":"172.21.15.8:6813/3279202487","heartbeat_back_addr":"172.21.15.8:6817/3279202487","heartbeat_front_addr":"172.21.15.8:6815/3279202487","state":["exists","up"]},{"osd":4,"uuid":"a59cbe06-70e2-4289-99c5-6ac77a7e5998","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6809","nonce":1263992677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6811","nonce":1263992677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6815","nonce":1263992677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1263992677},{"type":"v1","addr":"172.21.15.170:6813","nonce":1263992677}]},"public_addr":"172.21.15.170:6809/1263992677","cluster_addr":"172.21.15.170:6811/1263992677","heartbeat_back_addr":"172.21.15.170:6815/1263992677","heartbeat_front_addr":"172.21.15.170:6813/1263992677","state":["exists","up"]},{"osd":5,"uuid":"94656aa4-e7a0-41c4-b17d-b05fbd63e4e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6809","nonce":1795818577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6811","nonce":1795818577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6815","nonce":1795818577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1795818577},{"type":"v1","addr":"172.21.15.186:6813","nonce":1795818577}]},"public_addr":"172.21.15.186:6809/1795818577","cluster_addr":"172.21.15.186:6811/1795818577","heartbeat_back_addr":"172.21.15.186:6815/1795818577","heartbeat_front_addr":"172.21.15.186:6813/1795818577","state":["exists","up"]},{"osd":6,"uuid":"da2851d1-b95b-4035-9555-f159a9fcc4e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6819","nonce":53202181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6821","nonce":53202181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6825","nonce":53202181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":53202181},{"type":"v1","addr":"172.21.15.8:6823","nonce":53202181}]},"public_addr":"172.21.15.8:6819/53202181","cluster_addr":"172.21.15.8:6821/53202181","heartbeat_back_addr":"172.21.15.8:6825/53202181","heartbeat_front_addr":"172.21.15.8:6823/53202181","state":["exists","up"]},{"osd":7,"uuid":"d9718fcd-5f0e-47da-8821-547c22b2de7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6817","nonce":1049528716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6819","nonce":1049528716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6823","nonce":1049528716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1049528716},{"type":"v1","addr":"172.21.15.170:6821","nonce":1049528716}]},"public_addr":"172.21.15.170:6817/1049528716","cluster_addr":"172.21.15.170:6819/1049528716","heartbeat_back_addr":"172.21.15.170:6823/1049528716","heartbeat_front_addr":"172.21.15.170:6821/1049528716","state":["exists","up"]},{"osd":8,"uuid":"f98927f9-bb43-4c80-af77-f319bc786d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6817","nonce":1658595318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6819","nonce":1658595318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6823","nonce":1658595318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1658595318},{"type":"v1","addr":"172.21.15.186:6821","nonce":1658595318}]},"public_addr":"172.21.15.186:6817/1658595318","cluster_addr":"172.21.15.186:6819/1658595318","heartbeat_back_addr":"172.21.15.186:6823/1658595318","heartbeat_front_addr":"172.21.15.186:6821/1658595318","state":["exists","up"]},{"osd":9,"uuid":"35ed0aeb-5dd5-4354-bf28-f5043871c2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6827","nonce":882658660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6829","nonce":882658660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6833","nonce":882658660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":882658660},{"type":"v1","addr":"172.21.15.8:6831","nonce":882658660}]},"public_addr":"172.21.15.8:6827/882658660","cluster_addr":"172.21.15.8:6829/882658660","heartbeat_back_addr":"172.21.15.8:6833/882658660","heartbeat_front_addr":"172.21.15.8:6831/882658660","state":["exists","up"]},{"osd":10,"uuid":"7b004246-9f25-40a6-b58b-7dec13df8703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6825","nonce":1955752152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6827","nonce":1955752152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6831","nonce":1955752152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1955752152},{"type":"v1","addr":"172.21.15.170:6829","nonce":1955752152}]},"public_addr":"172.21.15.170:6825/1955752152","cluster_addr":"172.21.15.170:6827/1955752152","heartbeat_back_addr":"172.21.15.170:6831/1955752152","heartbeat_front_addr":"172.21.15.170:6829/1955752152","state":["exists","up"]},{"osd":11,"uuid":"9d7c8c33-46e9-4e59-baef-f28b12a298b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6825","nonce":367869423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6827","nonce":367869423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6831","nonce":367869423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":367869423},{"type":"v1","addr":"172.21.15.186:6829","nonce":367869423}]},"public_addr":"172.21.15.186:6825/367869423","cluster_addr":"172.21.15.186:6827/367869423","heartbeat_back_addr":"172.21.15.186:6831/367869423","heartbeat_front_addr":"172.21.15.186:6829/367869423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:48:58.603163+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:23.965777+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:49:47.675484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:20.610257+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:50:46.597367+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:11.330462+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:51:45.506271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:12.002308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:52:37.142518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:11.324695+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:53:38.456529+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T20:54:04.426794+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/1064583862":"2024-03-17T20:57:49.251162+0000","172.21.15.8:6800/1064583862":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/3780969288":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/1600768944":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:0/2780502436":"2024-03-17T20:57:49.251162+0000","172.21.15.8:6800/1972090527":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6800/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/834453818":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/4186367083":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/2989623051":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3139410089":"2024-03-17T20:47:02.935893+0000","172.21.15.8:6801/2888433195":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/304832415":"2024-03-17T20:46:27.714707+0000","172.21.15.8:0/3503977705":"2024-03-17T20:57:49.251162+0000","172.21.15.8:0/695532571":"2024-03-17T20:47:02.935893+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":16,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T21:09:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.050+0000 7faed9c00640 1 -- 172.21.15.8:0/2118394475 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faeb80a1ba0 msgr2=0x7faeb80a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.050+0000 7faed9c00640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faeb80a1ba0 0x7faeb80a4060 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faed419ab40 tx=0x7faec400b390 comp rx=0 tx=0).stop 2024-03-16T21:09:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.050+0000 7faed9c00640 1 -- 172.21.15.8:0/2118394475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed41095a0 msgr2=0x7faed4199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.050+0000 7faed9c00640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed41095a0 0x7faed4199a00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7faecc005e30 tx=0x7faecc034670 comp rx=0 tx=0).stop 2024-03-16T21:09:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.050+0000 7faed9c00640 1 -- 172.21.15.8:0/2118394475 shutdown_connections 2024-03-16T21:09:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.050+0000 7faed9c00640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7faeb80a1ba0 0x7faeb80a4060 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.050+0000 7faed9c00640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed41095a0 0x7faed4199a00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.050+0000 7faed9c00640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed4103ea0 0x7faed419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.050+0000 7faed9c00640 1 --2- 172.21.15.8:0/2118394475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faed41034e0 0x7faed419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.051+0000 7faed9c00640 1 -- 172.21.15.8:0/2118394475 >> 172.21.15.8:0/2118394475 conn(0x7faed40fef90 msgr2=0x7faed41006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:02.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.051+0000 7faed9c00640 1 -- 172.21.15.8:0/2118394475 shutdown_connections 2024-03-16T21:09:02.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.051+0000 7faed9c00640 1 -- 172.21.15.8:0/2118394475 wait complete. 2024-03-16T21:09:02.077 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-16T21:09:02.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:01 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3355574300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:09:02.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:01 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2181405525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:09:02.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:01 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3355574300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:09:02.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:01 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2181405525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T21:09:02.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.298+0000 7f03f7400640 1 -- 172.21.15.8:0/4268719260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03f0075a20 msgr2=0x7f03f0075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.298+0000 7f03f7400640 1 --2- 172.21.15.8:0/4268719260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03f0075a20 0x7f03f0075e00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009cd0 tx=0x7f03e002c0e0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.298+0000 7f03f7400640 1 -- 172.21.15.8:0/4268719260 shutdown_connections 2024-03-16T21:09:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.298+0000 7f03f7400640 1 --2- 172.21.15.8:0/4268719260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03f0112330 0x7f03f0114720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.298+0000 7f03f7400640 1 --2- 172.21.15.8:0/4268719260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0076340 0x7f03f0111df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.298+0000 7f03f7400640 1 --2- 172.21.15.8:0/4268719260 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03f0075a20 0x7f03f0075e00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.298+0000 7f03f7400640 1 -- 172.21.15.8:0/4268719260 >> 172.21.15.8:0/4268719260 conn(0x7f03f00ff160 msgr2=0x7f03f0101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.298+0000 7f03f7400640 1 -- 172.21.15.8:0/4268719260 shutdown_connections 2024-03-16T21:09:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.298+0000 7f03f7400640 1 -- 172.21.15.8:0/4268719260 wait complete. 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.299+0000 7f03f7400640 1 Processor -- start 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.299+0000 7f03f7400640 1 -- start start 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f7400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03f0075a20 0x7f03f019e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03f0076340 0x7f03f019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0112330 0x7f03f01a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f7400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01a3250 con 0x7f03f0076340 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f7400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01a33c0 con 0x7f03f0112330 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f7400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01a3580 con 0x7f03f0075a20 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f4a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03f0075a20 0x7f03f019e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0112330 0x7f03f01a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f4a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03f0075a20 0x7f03f019e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57080/0 (socket says 172.21.15.8:57080) 2024-03-16T21:09:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f4a00640 1 -- 172.21.15.8:0/3174762483 learned_addr learned my addr 172.21.15.8:0/3174762483 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:09:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0112330 0x7f03f01a2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.8:42024/0 (socket says 172.21.15.8:42024) 2024-03-16T21:09:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03e7e00640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03f0076340 0x7f03f019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.300+0000 7f03f4a00640 1 -- 172.21.15.8:0/3174762483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0112330 msgr2=0x7f03f01a2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.301+0000 7f03f4a00640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0112330 0x7f03f01a2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.301+0000 7f03f4a00640 1 -- 172.21.15.8:0/3174762483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03f0076340 msgr2=0x7f03f019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.301+0000 7f03f4a00640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03f0076340 0x7f03f019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.301+0000 7f03f4a00640 1 -- 172.21.15.8:0/3174762483 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0009900 con 0x7f03f0075a20 2024-03-16T21:09:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.301+0000 7f03f5400640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0112330 0x7f03f01a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:09:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.301+0000 7f03f4a00640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03f0075a20 0x7f03f019e390 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f03e0004af0 tx=0x7f03e0034670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.301+0000 7f03ee000640 1 -- 172.21.15.8:0/3174762483 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0032bc0 con 0x7f03f0075a20 2024-03-16T21:09:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.301+0000 7f03ee000640 1 -- 172.21.15.8:0/3174762483 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f03e0003e70 con 0x7f03f0075a20 2024-03-16T21:09:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.301+0000 7f03f7400640 1 -- 172.21.15.8:0/3174762483 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f01a3800 con 0x7f03f0075a20 2024-03-16T21:09:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.301+0000 7f03ee000640 1 -- 172.21.15.8:0/3174762483 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00048a0 con 0x7f03f0075a20 2024-03-16T21:09:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.301+0000 7f03f7400640 1 -- 172.21.15.8:0/3174762483 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f01a3ad0 con 0x7f03f0075a20 2024-03-16T21:09:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.302+0000 7f03f7400640 1 -- 172.21.15.8:0/3174762483 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f0068730 con 0x7f03f0075a20 2024-03-16T21:09:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.304+0000 7f03ee000640 1 -- 172.21.15.8:0/3174762483 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f03e000a040 con 0x7f03f0075a20 2024-03-16T21:09:02.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.306+0000 7f03ee000640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f03d40a1ba0 0x7f03d40a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:02.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.306+0000 7f03ee000640 1 -- 172.21.15.8:0/3174762483 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f03e00f0070 con 0x7f03f0075a20 2024-03-16T21:09:02.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.306+0000 7f03e7e00640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f03d40a1ba0 0x7f03d40a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:02.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.307+0000 7f03e7e00640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f03d40a1ba0 0x7f03d40a4060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f03f0101630 tx=0x7f03d8005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:02.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.308+0000 7f03ee000640 1 -- 172.21.15.8:0/3174762483 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f03e00b8ff0 con 0x7f03f0075a20 2024-03-16T21:09:02.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.551+0000 7f03f7400640 1 -- 172.21.15.8:0/3174762483 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f03f010d4c0 con 0x7f03f0075a20 2024-03-16T21:09:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.560+0000 7f03ee000640 1 -- 172.21.15.8:0/3174762483 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7f03e00bc6b0 con 0x7f03f0075a20 2024-03-16T21:09:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T21:09:02.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 -- 172.21.15.8:0/3174762483 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f03d40a1ba0 msgr2=0x7f03d40a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:02.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f03d40a1ba0 0x7f03d40a4060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f03f0101630 tx=0x7f03d8005f90 comp rx=0 tx=0).stop 2024-03-16T21:09:02.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 -- 172.21.15.8:0/3174762483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03f0075a20 msgr2=0x7f03f019e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:02.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03f0075a20 0x7f03f019e390 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f03e0004af0 tx=0x7f03e0034670 comp rx=0 tx=0).stop 2024-03-16T21:09:02.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 -- 172.21.15.8:0/3174762483 shutdown_connections 2024-03-16T21:09:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f03d40a1ba0 0x7f03d40a4060 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0112330 0x7f03f01a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03f0076340 0x7f03f019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 --2- 172.21.15.8:0/3174762483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03f0075a20 0x7f03f019e390 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 -- 172.21.15.8:0/3174762483 >> 172.21.15.8:0/3174762483 conn(0x7f03f00ff160 msgr2=0x7f03f0113ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 -- 172.21.15.8:0/3174762483 shutdown_connections 2024-03-16T21:09:02.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.563+0000 7f03f7400640 1 -- 172.21.15.8:0/3174762483 wait complete. 2024-03-16T21:09:02.589 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-16T21:09:02.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.800+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1519439985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d84075a20 msgr2=0x7f1d84075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:02.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.800+0000 7f1d8aa00640 1 --2- 172.21.15.8:0/1519439985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d84075a20 0x7f1d84075e00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009ca0 tx=0x7f1d7402c100 comp rx=0 tx=0).stop 2024-03-16T21:09:02.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.800+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1519439985 shutdown_connections 2024-03-16T21:09:02.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.800+0000 7f1d8aa00640 1 --2- 172.21.15.8:0/1519439985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d84112330 0x7f1d84114720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.800+0000 7f1d8aa00640 1 --2- 172.21.15.8:0/1519439985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d84076340 0x7f1d84111df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.800+0000 7f1d8aa00640 1 --2- 172.21.15.8:0/1519439985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d84075a20 0x7f1d84075e00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.800+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1519439985 >> 172.21.15.8:0/1519439985 conn(0x7f1d840ff140 msgr2=0x7f1d84101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:02.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.800+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1519439985 shutdown_connections 2024-03-16T21:09:02.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.800+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1519439985 wait complete. 2024-03-16T21:09:02.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.801+0000 7f1d8aa00640 1 Processor -- start 2024-03-16T21:09:02.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.801+0000 7f1d8aa00640 1 -- start start 2024-03-16T21:09:02.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.801+0000 7f1d8aa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d84075a20 0x7f1d8419e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:02.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.801+0000 7f1d8aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d84076340 0x7f1d8419e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.801+0000 7f1d8aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d84112330 0x7f1d841a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.801+0000 7f1d8aa00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d841a3130 con 0x7f1d84112330 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.801+0000 7f1d8aa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d841a32a0 con 0x7f1d84076340 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.801+0000 7f1d8aa00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d841a3460 con 0x7f1d84075a20 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d83e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d84075a20 0x7f1d8419e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d88a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d84112330 0x7f1d841a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d83e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d84075a20 0x7f1d8419e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57102/0 (socket says 172.21.15.8:57102) 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d83e00640 1 -- 172.21.15.8:0/1907630176 learned_addr learned my addr 172.21.15.8:0/1907630176 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d83400640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d84076340 0x7f1d8419e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d83e00640 1 -- 172.21.15.8:0/1907630176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d84076340 msgr2=0x7f1d8419e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d83e00640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d84076340 0x7f1d8419e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d83e00640 1 -- 172.21.15.8:0/1907630176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d84112330 msgr2=0x7f1d841a2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:02.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d83e00640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d84112330 0x7f1d841a2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d83e00640 1 -- 172.21.15.8:0/1907630176 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74009900 con 0x7f1d84075a20 2024-03-16T21:09:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d88a00640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d84112330 0x7f1d841a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:09:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.802+0000 7f1d83e00640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d84075a20 0x7f1d8419e270 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1d74005e30 tx=0x7f1d74032a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.803+0000 7f1d80c00640 1 -- 172.21.15.8:0/1907630176 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74034850 con 0x7f1d84075a20 2024-03-16T21:09:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.803+0000 7f1d80c00640 1 -- 172.21.15.8:0/1907630176 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f1d74032600 con 0x7f1d84075a20 2024-03-16T21:09:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.803+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1907630176 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d841a36e0 con 0x7f1d84075a20 2024-03-16T21:09:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.803+0000 7f1d80c00640 1 -- 172.21.15.8:0/1907630176 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74004810 con 0x7f1d84075a20 2024-03-16T21:09:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.803+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1907630176 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d841a39b0 con 0x7f1d84075a20 2024-03-16T21:09:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.804+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1907630176 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d840682e0 con 0x7f1d84075a20 2024-03-16T21:09:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.806+0000 7f1d80c00640 1 -- 172.21.15.8:0/1907630176 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f1d7403b040 con 0x7f1d84075a20 2024-03-16T21:09:02.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.807+0000 7f1d80c00640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1d680a1ba0 0x7f1d680a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:02.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.807+0000 7f1d80c00640 1 -- 172.21.15.8:0/1907630176 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8727+0+0 (secure 0 0 0) 0x7f1d740f01d0 con 0x7f1d84075a20 2024-03-16T21:09:02.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.807+0000 7f1d83400640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1d680a1ba0 0x7f1d680a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:02.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.808+0000 7f1d83400640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1d680a1ba0 0x7f1d680a4060 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d841027a0 tx=0x7f1d6c005f90 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:02.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:02.811+0000 7f1d80c00640 1 -- 172.21.15.8:0/1907630176 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1d740b9080 con 0x7f1d84075a20 2024-03-16T21:09:02.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mon[35947]: pgmap v347: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-03-16T21:09:02.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/2118394475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T21:09:02.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/3174762483' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-16T21:09:02.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-16T21:09:02.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mon[35947]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-16T21:09:02.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mon[35947]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T21:09:02.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-16T21:09:02.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mon[35947]: osdmap e98: 12 total, 12 up, 12 in 2024-03-16T21:09:02.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mon[35947]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-03-16T21:09:02.869 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b[66248]: ignoring --setuser ceph since I am not root 2024-03-16T21:09:02.869 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b[66248]: ignoring --setgroup ceph since I am not root 2024-03-16T21:09:02.869 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mds[66252]: -- 172.21.15.170:0/3895013460 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561f2f9f61a0 con 0x561f2f9cc800 2024-03-16T21:09:02.869 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b[66248]: starting mds.b at 2024-03-16T21:09:02.869 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e[65619]: ignoring --setuser ceph since I am not root 2024-03-16T21:09:02.869 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e[65619]: ignoring --setgroup ceph since I am not root 2024-03-16T21:09:02.869 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mds[65623]: -- 172.21.15.170:0/433928585 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557d5d1a81a0 con 0x557d5d17e800 2024-03-16T21:09:02.869 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e[65619]: starting mds.e at 2024-03-16T21:09:02.870 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h[65940]: ignoring --setuser ceph since I am not root 2024-03-16T21:09:02.870 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h[65940]: ignoring --setgroup ceph since I am not root 2024-03-16T21:09:02.870 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-mds[65944]: -- 172.21.15.170:0/3359045567 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555fb4fae1a0 con 0x555fb4f84800 2024-03-16T21:09:02.870 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:09:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h[65940]: starting mds.h at 2024-03-16T21:09:02.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mon[36391]: pgmap v347: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-03-16T21:09:02.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/2118394475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T21:09:02.894 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/3174762483' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-16T21:09:02.895 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-16T21:09:02.895 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mon[36391]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-16T21:09:02.895 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mon[36391]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T21:09:02.895 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-16T21:09:02.895 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mon[36391]: osdmap e98: 12 total, 12 up, 12 in 2024-03-16T21:09:02.895 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mon[36391]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-03-16T21:09:02.895 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c[67578]: ignoring --setuser ceph since I am not root 2024-03-16T21:09:02.895 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c[67578]: ignoring --setgroup ceph since I am not root 2024-03-16T21:09:02.895 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mds[67582]: -- 172.21.15.186:0/2164804839 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5594f95a01a0 con 0x5594f9577000 2024-03-16T21:09:02.895 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c[67578]: starting mds.c at 2024-03-16T21:09:02.896 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f[67253]: ignoring --setuser ceph since I am not root 2024-03-16T21:09:02.896 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f[67253]: ignoring --setgroup ceph since I am not root 2024-03-16T21:09:02.896 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mds[67257]: -- 172.21.15.186:0/663313016 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5638ea0ae1a0 con 0x5638ea084800 2024-03-16T21:09:02.896 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f[67253]: starting mds.f at 2024-03-16T21:09:02.896 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i[67886]: ignoring --setuser ceph since I am not root 2024-03-16T21:09:02.896 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i[67886]: ignoring --setgroup ceph since I am not root 2024-03-16T21:09:02.896 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-mds[67890]: -- 172.21.15.186:0/2454104613 <== mon.2 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d236bf01a0 con 0x55d236bc6800 2024-03-16T21:09:02.896 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 21:09:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i[67886]: starting mds.i at 2024-03-16T21:09:02.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:02 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a[31430]: 2024-03-16T21:09:02.553+0000 7f8d21000700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T21:09:02.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:02 smithi008 ceph-mon[31434]: pgmap v347: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-03-16T21:09:02.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:02 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/2118394475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T21:09:02.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:02 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/3174762483' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-16T21:09:02.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:02 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-16T21:09:02.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:02 smithi008 ceph-mon[31434]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-16T21:09:02.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:02 smithi008 ceph-mon[31434]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T21:09:02.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:02 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-16T21:09:02.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:02 smithi008 ceph-mon[31434]: osdmap e98: 12 total, 12 up, 12 in 2024-03-16T21:09:02.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:02 smithi008 ceph-mon[31434]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-03-16T21:09:03.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.059+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1907630176 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1d8410d520 con 0x7f1d84075a20 2024-03-16T21:09:03.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.562+0000 7f1d80c00640 1 -- 172.21.15.8:0/1907630176 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1d740bc740 con 0x7f1d84075a20 2024-03-16T21:09:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.567+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1907630176 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1d680a1ba0 msgr2=0x7f1d680a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.567+0000 7f1d8aa00640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1d680a1ba0 0x7f1d680a4060 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d841027a0 tx=0x7f1d6c005f90 comp rx=0 tx=0).stop 2024-03-16T21:09:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.567+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1907630176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d84075a20 msgr2=0x7f1d8419e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.567+0000 7f1d8aa00640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d84075a20 0x7f1d8419e270 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1d74005e30 tx=0x7f1d74032a60 comp rx=0 tx=0).stop 2024-03-16T21:09:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.568+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1907630176 shutdown_connections 2024-03-16T21:09:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.568+0000 7f1d8aa00640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f1d680a1ba0 0x7f1d680a4060 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.568+0000 7f1d8aa00640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d84112330 0x7f1d841a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.568+0000 7f1d8aa00640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d84076340 0x7f1d8419e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.568+0000 7f1d8aa00640 1 --2- 172.21.15.8:0/1907630176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d84075a20 0x7f1d8419e270 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.568+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1907630176 >> 172.21.15.8:0/1907630176 conn(0x7f1d840ff140 msgr2=0x7f1d84101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.568+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1907630176 shutdown_connections 2024-03-16T21:09:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.568+0000 7f1d8aa00640 1 -- 172.21.15.8:0/1907630176 wait complete. 2024-03-16T21:09:03.598 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-16T21:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.819+0000 7fef31a00640 1 -- 172.21.15.8:0/4071482794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef2c100100 msgr2=0x7fef2c1004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.819+0000 7fef31a00640 1 --2- 172.21.15.8:0/4071482794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef2c100100 0x7fef2c1004e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fef14009900 tx=0x7fef1402bc40 comp rx=0 tx=0).stop 2024-03-16T21:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.820+0000 7fef31a00640 1 -- 172.21.15.8:0/4071482794 shutdown_connections 2024-03-16T21:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.820+0000 7fef31a00640 1 --2- 172.21.15.8:0/4071482794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef2c10dcb0 0x7fef2c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.820+0000 7fef31a00640 1 --2- 172.21.15.8:0/4071482794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef2c100ab0 0x7fef2c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.820+0000 7fef31a00640 1 --2- 172.21.15.8:0/4071482794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef2c100100 0x7fef2c1004e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.820+0000 7fef31a00640 1 -- 172.21.15.8:0/4071482794 >> 172.21.15.8:0/4071482794 conn(0x7fef2c0fbd40 msgr2=0x7fef2c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.820+0000 7fef31a00640 1 -- 172.21.15.8:0/4071482794 shutdown_connections 2024-03-16T21:09:03.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.820+0000 7fef31a00640 1 -- 172.21.15.8:0/4071482794 wait complete. 2024-03-16T21:09:03.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.821+0000 7fef31a00640 1 Processor -- start 2024-03-16T21:09:03.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.821+0000 7fef31a00640 1 -- start start 2024-03-16T21:09:03.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.821+0000 7fef31a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef2c100100 0x7fef2c199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:03.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.821+0000 7fef31a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef2c100ab0 0x7fef2c19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:03.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.821+0000 7fef31a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef2c10dcb0 0x7fef2c19e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:03.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.821+0000 7fef31a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c19ebf0 con 0x7fef2c10dcb0 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.821+0000 7fef31a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c19ed60 con 0x7fef2c100100 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.821+0000 7fef31a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c19ef20 con 0x7fef2c100ab0 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.822+0000 7fef31000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef2c10dcb0 0x7fef2c19e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.822+0000 7fef31000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef2c10dcb0 0x7fef2c19e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58124/0 (socket says 172.21.15.8:58124) 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.822+0000 7fef31000640 1 -- 172.21.15.8:0/296999919 learned_addr learned my addr 172.21.15.8:0/296999919 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.822+0000 7fef2be00640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef2c100100 0x7fef2c199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.822+0000 7fef2b400640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef2c100ab0 0x7fef2c19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.822+0000 7fef31000640 1 -- 172.21.15.8:0/296999919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef2c100ab0 msgr2=0x7fef2c19a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.822+0000 7fef31000640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef2c100ab0 0x7fef2c19a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.822+0000 7fef31000640 1 -- 172.21.15.8:0/296999919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef2c100100 msgr2=0x7fef2c199d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.822+0000 7fef31000640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef2c100100 0x7fef2c199d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.822+0000 7fef31000640 1 -- 172.21.15.8:0/296999919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009490 con 0x7fef2c10dcb0 2024-03-16T21:09:03.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.822+0000 7fef31000640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef2c10dcb0 0x7fef2c19e5f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fef2400eb40 tx=0x7fef2400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:03.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.823+0000 7fef28c00640 1 -- 172.21.15.8:0/296999919 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24004b20 con 0x7fef2c10dcb0 2024-03-16T21:09:03.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.823+0000 7fef31a00640 1 -- 172.21.15.8:0/296999919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef14009560 con 0x7fef2c10dcb0 2024-03-16T21:09:03.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.823+0000 7fef28c00640 1 -- 172.21.15.8:0/296999919 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7fef24004c80 con 0x7fef2c10dcb0 2024-03-16T21:09:03.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.823+0000 7fef28c00640 1 -- 172.21.15.8:0/296999919 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24010830 con 0x7fef2c10dcb0 2024-03-16T21:09:03.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.823+0000 7fef31a00640 1 -- 172.21.15.8:0/296999919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c1a68a0 con 0x7fef2c10dcb0 2024-03-16T21:09:03.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.824+0000 7fef31a00640 1 -- 172.21.15.8:0/296999919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c068200 con 0x7fef2c10dcb0 2024-03-16T21:09:03.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.827+0000 7fef28c00640 1 -- 172.21.15.8:0/296999919 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7fef24005020 con 0x7fef2c10dcb0 2024-03-16T21:09:03.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.830+0000 7fef28c00640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fef100a1c20 0x7fef100a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:03.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.830+0000 7fef28c00640 1 -- 172.21.15.8:0/296999919 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8727+0+0 (secure 0 0 0) 0x7fef24014070 con 0x7fef2c10dcb0 2024-03-16T21:09:03.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.830+0000 7fef2be00640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fef100a1c20 0x7fef100a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:03.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.830+0000 7fef2be00640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fef100a1c20 0x7fef100a40e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fef14006010 tx=0x7fef14005e40 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:03.835+0000 7fef28c00640 1 -- 172.21.15.8:0/296999919 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fef24096d30 con 0x7fef2c10dcb0 2024-03-16T21:09:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1907630176' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T21:09:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T21:09:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-16T21:09:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-16T21:09:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: Cluster is now healthy 2024-03-16T21:09:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-16T21:09:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.186:6835/2780930521,v1:172.21.15.186:6837/2780930521] up:boot 2024-03-16T21:09:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.170:6834/1551571198,v1:172.21.15.170:6836/1551571198] up:boot 2024-03-16T21:09:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.186:6834/2900716530,v1:172.21.15.186:6836/2900716530] up:boot 2024-03-16T21:09:03.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.170:6838/2978991770,v1:172.21.15.170:6839/2978991770] up:boot 2024-03-16T21:09:03.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.186:6838/739772351,v1:172.21.15.186:6839/739772351] up:boot 2024-03-16T21:09:03.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: mds.? [v2:172.21.15.170:6835/135745311,v1:172.21.15.170:6837/135745311] up:boot 2024-03-16T21:09:03.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: fsmap 12 up:standby 2024-03-16T21:09:03.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T21:09:03.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T21:09:03.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T21:09:03.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T21:09:03.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T21:09:03.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:03 smithi008 ceph-mon[31434]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T21:09:04.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.036+0000 7fef31a00640 1 -- 172.21.15.8:0/296999919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef2c108e70 con 0x7fef2c10dcb0 2024-03-16T21:09:04.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1907630176' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T21:09:04.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T21:09:04.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-16T21:09:04.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-16T21:09:04.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: Cluster is now healthy 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.186:6835/2780930521,v1:172.21.15.186:6837/2780930521] up:boot 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.170:6834/1551571198,v1:172.21.15.170:6836/1551571198] up:boot 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.186:6834/2900716530,v1:172.21.15.186:6836/2900716530] up:boot 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.170:6838/2978991770,v1:172.21.15.170:6839/2978991770] up:boot 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.186:6838/739772351,v1:172.21.15.186:6839/739772351] up:boot 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: mds.? [v2:172.21.15.170:6835/135745311,v1:172.21.15.170:6837/135745311] up:boot 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: fsmap 12 up:standby 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T21:09:04.119 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:03 smithi170 ceph-mon[35947]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T21:09:04.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1907630176' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T21:09:04.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T21:09:04.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-16T21:09:04.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-16T21:09:04.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: Cluster is now healthy 2024-03-16T21:09:04.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-16T21:09:04.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.186:6835/2780930521,v1:172.21.15.186:6837/2780930521] up:boot 2024-03-16T21:09:04.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.170:6834/1551571198,v1:172.21.15.170:6836/1551571198] up:boot 2024-03-16T21:09:04.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.186:6834/2900716530,v1:172.21.15.186:6836/2900716530] up:boot 2024-03-16T21:09:04.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.170:6838/2978991770,v1:172.21.15.170:6839/2978991770] up:boot 2024-03-16T21:09:04.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.186:6838/739772351,v1:172.21.15.186:6839/739772351] up:boot 2024-03-16T21:09:04.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: mds.? [v2:172.21.15.170:6835/135745311,v1:172.21.15.170:6837/135745311] up:boot 2024-03-16T21:09:04.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: fsmap 12 up:standby 2024-03-16T21:09:04.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T21:09:04.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T21:09:04.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T21:09:04.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T21:09:04.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T21:09:04.145 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:03 smithi186 ceph-mon[36391]: from='mgr.15240 172.21.15.8:0/385418420' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T21:09:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.733+0000 7fef28c00640 1 -- 172.21.15.8:0/296999919 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) v1 ==== 181+0+0 (secure 0 0 0) 0x7fef240052d0 con 0x7fef2c10dcb0 2024-03-16T21:09:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' removed 2024-03-16T21:09:04.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.738+0000 7fef31a00640 1 -- 172.21.15.8:0/296999919 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fef100a1c20 msgr2=0x7fef100a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:04.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.738+0000 7fef31a00640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fef100a1c20 0x7fef100a40e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fef14006010 tx=0x7fef14005e40 comp rx=0 tx=0).stop 2024-03-16T21:09:04.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.738+0000 7fef31a00640 1 -- 172.21.15.8:0/296999919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef2c10dcb0 msgr2=0x7fef2c19e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:04.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.738+0000 7fef31a00640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef2c10dcb0 0x7fef2c19e5f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fef2400eb40 tx=0x7fef2400c2d0 comp rx=0 tx=0).stop 2024-03-16T21:09:04.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.739+0000 7fef31a00640 1 -- 172.21.15.8:0/296999919 shutdown_connections 2024-03-16T21:09:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.739+0000 7fef31a00640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7fef100a1c20 0x7fef100a40e0 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fef14006010 tx=0x7fef14005e40 comp rx=0 tx=0).stop 2024-03-16T21:09:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.739+0000 7fef31a00640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef2c10dcb0 0x7fef2c19e5f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.739+0000 7fef31a00640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef2c100ab0 0x7fef2c19a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.739+0000 7fef31a00640 1 --2- 172.21.15.8:0/296999919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef2c100100 0x7fef2c199d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.739+0000 7fef31a00640 1 -- 172.21.15.8:0/296999919 >> 172.21.15.8:0/296999919 conn(0x7fef2c0fbd40 msgr2=0x7fef2c10eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.740+0000 7fef31a00640 1 -- 172.21.15.8:0/296999919 shutdown_connections 2024-03-16T21:09:04.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.740+0000 7fef31a00640 1 -- 172.21.15.8:0/296999919 wait complete. 2024-03-16T21:09:04.771 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-16T21:09:04.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.984+0000 7f9842400640 1 -- 172.21.15.8:0/3069169782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f983c10daa0 msgr2=0x7f983c10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:04.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.984+0000 7f9842400640 1 --2- 172.21.15.8:0/3069169782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f983c10daa0 0x7f983c10de80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f982c009930 tx=0x7f982c02bc20 comp rx=0 tx=0).stop 2024-03-16T21:09:04.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.984+0000 7f9842400640 1 -- 172.21.15.8:0/3069169782 shutdown_connections 2024-03-16T21:09:04.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.984+0000 7f9842400640 1 --2- 172.21.15.8:0/3069169782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983c108450 0x7f983c114960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:04.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.984+0000 7f9842400640 1 --2- 172.21.15.8:0/3069169782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983c107a90 0x7f983c107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:04.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.984+0000 7f9842400640 1 --2- 172.21.15.8:0/3069169782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f983c10daa0 0x7f983c10de80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:04.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.984+0000 7f9842400640 1 -- 172.21.15.8:0/3069169782 >> 172.21.15.8:0/3069169782 conn(0x7f983c075a30 msgr2=0x7f983c077e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:04.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.984+0000 7f9842400640 1 -- 172.21.15.8:0/3069169782 shutdown_connections 2024-03-16T21:09:04.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.984+0000 7f9842400640 1 -- 172.21.15.8:0/3069169782 wait complete. 2024-03-16T21:09:04.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.985+0000 7f9842400640 1 Processor -- start 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.985+0000 7f9842400640 1 -- start start 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.986+0000 7f9842400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f983c107a90 0x7f983c19e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.986+0000 7f9842400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983c108450 0x7f983c19e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.986+0000 7f9842400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983c10daa0 0x7f983c1a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.986+0000 7f9842400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c1a3180 con 0x7f983c107a90 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.986+0000 7f9842400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c1a32f0 con 0x7f983c108450 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.986+0000 7f9842400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c1a34b0 con 0x7f983c10daa0 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.986+0000 7f9833e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983c108450 0x7f983c19e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.986+0000 7f983be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983c10daa0 0x7f983c1a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.986+0000 7f983be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983c10daa0 0x7f983c1a2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:57154/0 (socket says 172.21.15.8:57154) 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.986+0000 7f983be00640 1 -- 172.21.15.8:0/1428699531 learned_addr learned my addr 172.21.15.8:0/1428699531 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.987+0000 7f983b400640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f983c107a90 0x7f983c19e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:04.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.987+0000 7f983be00640 1 -- 172.21.15.8:0/1428699531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983c108450 msgr2=0x7f983c19e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.987+0000 7f983be00640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983c108450 0x7f983c19e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.987+0000 7f983be00640 1 -- 172.21.15.8:0/1428699531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f983c107a90 msgr2=0x7f983c19e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.987+0000 7f983be00640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f983c107a90 0x7f983c19e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.987+0000 7f983be00640 1 -- 172.21.15.8:0/1428699531 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c009560 con 0x7f983c10daa0 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.987+0000 7f9833e00640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983c108450 0x7f983c19e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.987+0000 7f983b400640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f983c107a90 0x7f983c19e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.987+0000 7f983be00640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983c10daa0 0x7f983c1a2b80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f983400eb10 tx=0x7f983400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.988+0000 7f9838c00640 1 -- 172.21.15.8:0/1428699531 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9834004b20 con 0x7f983c10daa0 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.988+0000 7f9838c00640 1 -- 172.21.15.8:0/1428699531 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(28 keys) v1 ==== 1174+0+0 (secure 0 0 0) 0x7f9834004c80 con 0x7f983c10daa0 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.988+0000 7f9838c00640 1 -- 172.21.15.8:0/1428699531 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9834010760 con 0x7f983c10daa0 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.988+0000 7f9842400640 1 -- 172.21.15.8:0/1428699531 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c1a3790 con 0x7f983c10daa0 2024-03-16T21:09:04.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.988+0000 7f9842400640 1 -- 172.21.15.8:0/1428699531 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c1ab010 con 0x7f983c10daa0 2024-03-16T21:09:04.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.989+0000 7f9842400640 1 -- 172.21.15.8:0/1428699531 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c068730 con 0x7f983c10daa0 2024-03-16T21:09:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:04 smithi008 ceph-mon[31434]: pgmap v349: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-03-16T21:09:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:04 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/296999919' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T21:09:04.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.991+0000 7f9838c00640 1 -- 172.21.15.8:0/1428699531 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 27) v1 ==== 136409+0+0 (secure 0 0 0) 0x7f98340108c0 con 0x7f983c10daa0 2024-03-16T21:09:04.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.992+0000 7f9838c00640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f98200a1c20 0x7f98200a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T21:09:04.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.993+0000 7f9838c00640 1 -- 172.21.15.8:0/1428699531 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8231+0+0 (secure 0 0 0) 0x7f9834014070 con 0x7f983c10daa0 2024-03-16T21:09:04.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.993+0000 7f983b400640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f98200a1c20 0x7f98200a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T21:09:04.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.993+0000 7f983b400640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f98200a1c20 0x7f98200a40e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f982c009900 tx=0x7f982c005a20 comp rx=0 tx=0).ready entity=mgr.15240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T21:09:05.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:04.995+0000 7f9838c00640 1 -- 172.21.15.8:0/1428699531 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9834096d30 con 0x7f983c10daa0 2024-03-16T21:09:05.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:04 smithi170 ceph-mon[35947]: pgmap v349: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-03-16T21:09:05.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:04 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/296999919' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T21:09:05.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:04 smithi186 ceph-mon[36391]: pgmap v349: 97 pgs: 97 active+clean; 52 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-03-16T21:09:05.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:04 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/296999919' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T21:09:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.198+0000 7f9842400640 1 -- 172.21.15.8:0/1428699531 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f983c110090 con 0x7f983c10daa0 2024-03-16T21:09:05.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.752+0000 7f9838c00640 1 -- 172.21.15.8:0/1428699531 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) v1 ==== 169+0+0 (secure 0 0 0) 0x7f983c110090 con 0x7f983c10daa0 2024-03-16T21:09:05.760 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' removed 2024-03-16T21:09:05.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.759+0000 7f9842400640 1 -- 172.21.15.8:0/1428699531 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f98200a1c20 msgr2=0x7f98200a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:05.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.759+0000 7f9842400640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f98200a1c20 0x7f98200a40e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f982c009900 tx=0x7f982c005a20 comp rx=0 tx=0).stop 2024-03-16T21:09:05.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.759+0000 7f9842400640 1 -- 172.21.15.8:0/1428699531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983c10daa0 msgr2=0x7f983c1a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T21:09:05.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.759+0000 7f9842400640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983c10daa0 0x7f983c1a2b80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f983400eb10 tx=0x7f983400c2d0 comp rx=0 tx=0).stop 2024-03-16T21:09:05.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.760+0000 7f9842400640 1 -- 172.21.15.8:0/1428699531 shutdown_connections 2024-03-16T21:09:05.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.760+0000 7f9842400640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.8:6800/4227086558,v1:172.21.15.8:6801/4227086558] conn(0x7f98200a1c20 0x7f98200a40e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:05.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.760+0000 7f9842400640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f983c10daa0 0x7f983c1a2b80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:05.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.760+0000 7f9842400640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983c108450 0x7f983c19e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:05.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.760+0000 7f9842400640 1 --2- 172.21.15.8:0/1428699531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f983c107a90 0x7f983c19e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T21:09:05.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.760+0000 7f9842400640 1 -- 172.21.15.8:0/1428699531 >> 172.21.15.8:0/1428699531 conn(0x7f983c075a30 msgr2=0x7f983c075ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T21:09:05.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.762+0000 7f9842400640 1 -- 172.21.15.8:0/1428699531 shutdown_connections 2024-03-16T21:09:05.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-03-16T21:09:05.762+0000 7f9842400640 1 -- 172.21.15.8:0/1428699531 wait complete. 2024-03-16T21:09:05.803 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T21:09:05.890 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T21:09:05.932 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T21:09:05.970 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-16T21:09:05.971 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-16T21:09:06.024 DEBUG:teuthology.orchestra.run.smithi170:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-16T21:09:06.040 DEBUG:teuthology.orchestra.run.smithi186:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-16T21:09:06.057 INFO:tasks.cephadm:Stopping all daemons... 2024-03-16T21:09:06.057 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-16T21:09:06.057 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.a 2024-03-16T21:09:06.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:05 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/296999919' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-16T21:09:06.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:05 smithi170 ceph-mon[35947]: osdmap e99: 12 total, 12 up, 12 in 2024-03-16T21:09:06.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:05 smithi170 ceph-mon[35947]: from='client.? 172.21.15.8:0/1428699531' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T21:09:06.118 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:05 smithi170 ceph-mon[35947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T21:09:06.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:05 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/296999919' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-16T21:09:06.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:05 smithi186 ceph-mon[36391]: osdmap e99: 12 total, 12 up, 12 in 2024-03-16T21:09:06.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:05 smithi186 ceph-mon[36391]: from='client.? 172.21.15.8:0/1428699531' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T21:09:06.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:05 smithi186 ceph-mon[36391]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T21:09:06.151 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:05 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/296999919' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-16T21:09:06.151 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:05 smithi008 ceph-mon[31434]: osdmap e99: 12 total, 12 up, 12 in 2024-03-16T21:09:06.151 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:05 smithi008 ceph-mon[31434]: from='client.? 172.21.15.8:0/1428699531' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T21:09:06.151 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:05 smithi008 ceph-mon[31434]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T21:09:06.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:06 smithi008 systemd[1]: Stopping Ceph mon.a for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:06.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a[31430]: 2024-03-16T21:09:06.661+0000 7f8d27e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:09:06.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a[31430]: 2024-03-16T21:09:06.661+0000 7f8d27e00700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-16T21:09:06.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:06 smithi008 podman[99259]: 2024-03-16 21:09:06.702337198 +0000 UTC m=+0.178710000 container died a5a6050aac3f2f396d1958e5df30220474b102e80be67d394c8a5509bd3e2662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-16T21:09:07.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:07 smithi008 podman[99259]: 2024-03-16 21:09:07.189253866 +0000 UTC m=+0.665626716 container cleanup a5a6050aac3f2f396d1958e5df30220474b102e80be67d394c8a5509bd3e2662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.license=GPLv2) 2024-03-16T21:09:07.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:07 smithi008 bash[99259]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a 2024-03-16T21:09:07.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Mar 16 21:09:07 smithi008 podman[99273]: 2024-03-16 21:09:07.432229653 +0000 UTC m=+0.716776224 container remove a5a6050aac3f2f396d1958e5df30220474b102e80be67d394c8a5509bd3e2662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2) 2024-03-16T21:09:07.913 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.a.service' 2024-03-16T21:09:08.059 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:09:08.059 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-16T21:09:08.060 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-03-16T21:09:08.060 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.b 2024-03-16T21:09:08.368 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:08 smithi170 systemd[1]: Stopping Ceph mon.b for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:08.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:08 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-b[35943]: 2024-03-16T21:09:08.368+0000 7f2d0c490700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:09:08.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:08 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-b[35943]: 2024-03-16T21:09:08.368+0000 7f2d0c490700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-16T21:09:08.868 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:08 smithi170 podman[72173]: 2024-03-16 21:09:08.60335259 +0000 UTC m=+0.352172499 container died 233ed24b031b62ee9e2a81a1338b3355120c0b073bca6aa7fe4f3d3cefa12fc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-16T21:09:09.250 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:08 smithi170 podman[72173]: 2024-03-16 21:09:08.98591624 +0000 UTC m=+0.734736142 container cleanup 233ed24b031b62ee9e2a81a1338b3355120c0b073bca6aa7fe4f3d3cefa12fc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-b, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-03-16T21:09:09.250 INFO:journalctl@ceph.mon.b.smithi170.stdout:Mar 16 21:09:08 smithi170 bash[72173]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-b 2024-03-16T21:09:09.412 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.b.service' 2024-03-16T21:09:09.478 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:09:09.478 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-03-16T21:09:09.479 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-03-16T21:09:09.479 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.c 2024-03-16T21:09:09.809 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:09 smithi186 systemd[1]: Stopping Ceph mon.c for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:10.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:09 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-c[36387]: 2024-03-16T21:09:09.803+0000 7f81ac3ce700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:09:10.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:09 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-c[36387]: 2024-03-16T21:09:09.803+0000 7f81ac3ce700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-16T21:09:10.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:10 smithi186 podman[73945]: 2024-03-16 21:09:10.048686659 +0000 UTC m=+0.372309060 container died b5ace1e8043133bd506862b36b67385c1aa439c8fe4ee26e4084d932a1a4d6a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-16T21:09:10.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:10 smithi186 podman[73945]: 2024-03-16 21:09:10.463893641 +0000 UTC m=+0.787516041 container cleanup b5ace1e8043133bd506862b36b67385c1aa439c8fe4ee26e4084d932a1a4d6a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-c, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2) 2024-03-16T21:09:10.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:Mar 16 21:09:10 smithi186 bash[73945]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mon-c 2024-03-16T21:09:10.899 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mon.c.service' 2024-03-16T21:09:10.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:09:10.946 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-03-16T21:09:10.946 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-16T21:09:10.946 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.x 2024-03-16T21:09:11.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 21:09:11 smithi008 systemd[1]: Stopping Ceph mgr.x for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:11.957 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 21:09:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T21:09:11.492+0000 7fbfb7600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:09:11.958 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 21:09:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x[31662]: 2024-03-16T21:09:11.492+0000 7fbfb7600700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-16T21:09:11.958 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 21:09:11 smithi008 podman[99382]: 2024-03-16 21:09:11.588914502 +0000 UTC m=+0.232605656 container died 679081db66a6b90aee0cadb21fab22976b400f42f8963f3f8f0113a4a794c2c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, org.label-schema.build-date=20240307, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-03-16T21:09:12.245 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 21:09:12 smithi008 podman[99382]: 2024-03-16 21:09:12.11118318 +0000 UTC m=+0.754874266 container cleanup 679081db66a6b90aee0cadb21fab22976b400f42f8963f3f8f0113a4a794c2c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-16T21:09:12.246 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 21:09:12 smithi008 bash[99382]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x 2024-03-16T21:09:12.745 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Mar 16 21:09:12 smithi008 podman[99396]: 2024-03-16 21:09:12.355120134 +0000 UTC m=+0.748719523 container remove 679081db66a6b90aee0cadb21fab22976b400f42f8963f3f8f0113a4a794c2c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T21:09:12.876 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.x.service' 2024-03-16T21:09:13.008 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:09:13.008 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-16T21:09:13.008 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-03-16T21:09:13.008 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.y 2024-03-16T21:09:13.158 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 21:09:13 smithi170 systemd[1]: Stopping Ceph mgr.y for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:13.618 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 21:09:13 smithi170 podman[72297]: 2024-03-16 21:09:13.336321803 +0000 UTC m=+0.136020235 container died f659b6a51d81542d23664dc061710611322eaca3c2c04a023ae89985e07c0ca0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-16T21:09:14.014 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 21:09:13 smithi170 podman[72297]: 2024-03-16 21:09:13.732681791 +0000 UTC m=+0.532380221 container cleanup f659b6a51d81542d23664dc061710611322eaca3c2c04a023ae89985e07c0ca0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:09:14.014 INFO:journalctl@ceph.mgr.y.smithi170.stdout:Mar 16 21:09:13 smithi170 bash[72297]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-y 2024-03-16T21:09:14.159 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.y.service' 2024-03-16T21:09:14.198 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:09:14.198 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-03-16T21:09:14.198 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-03-16T21:09:14.198 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.z 2024-03-16T21:09:14.511 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 21:09:14 smithi186 systemd[1]: Stopping Ceph mgr.z for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:14.779 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 21:09:14 smithi186 podman[74068]: 2024-03-16 21:09:14.506800931 +0000 UTC m=+0.115385561 container died de40adc41fd049ff5435599c39726b6251772ea639226e9f2dd7757a6ccb33de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-16T21:09:15.144 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 21:09:14 smithi186 podman[74068]: 2024-03-16 21:09:14.912549683 +0000 UTC m=+0.521134311 container cleanup de40adc41fd049ff5435599c39726b6251772ea639226e9f2dd7757a6ccb33de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T21:09:15.144 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Mar 16 21:09:14 smithi186 bash[74068]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mgr-z 2024-03-16T21:09:15.305 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mgr.z.service' 2024-03-16T21:09:15.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:09:15.345 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-03-16T21:09:15.345 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-16T21:09:15.346 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.0 2024-03-16T21:09:15.745 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:15 smithi008 systemd[1]: Stopping Ceph osd.0 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:16.496 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:15 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0[46460]: 2024-03-16T21:09:15.999+0000 7fa7d0400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:09:16.496 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:15 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0[46460]: 2024-03-16T21:09:15.999+0000 7fa7d0400700 -1 osd.0 100 *** Got signal Terminated *** 2024-03-16T21:09:16.496 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:15 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0[46460]: 2024-03-16T21:09:15.999+0000 7fa7d0400700 -1 osd.0 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:09:21.746 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:21 smithi008 podman[99503]: 2024-03-16 21:09:21.410432538 +0000 UTC m=+5.591128446 container died 04593d1a72bf7ca95e94846abc63ad0a5c0b79cb3c857f1da7eb5e99a403245f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-16T21:09:22.300 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:22 smithi008 podman[99503]: 2024-03-16 21:09:22.04273658 +0000 UTC m=+6.223432525 container cleanup 04593d1a72bf7ca95e94846abc63ad0a5c0b79cb3c857f1da7eb5e99a403245f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307) 2024-03-16T21:09:22.300 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:22 smithi008 bash[99503]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0 2024-03-16T21:09:22.745 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:22 smithi008 podman[99524]: 2024-03-16 21:09:22.294219042 +0000 UTC m=+0.867384187 container remove 04593d1a72bf7ca95e94846abc63ad0a5c0b79cb3c857f1da7eb5e99a403245f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T21:09:23.496 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:23 smithi008 podman[99614]: 2024-03-16 21:09:23.067096546 +0000 UTC m=+0.041076060 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:09:23.496 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:23 smithi008 podman[99614]: 2024-03-16 21:09:23.228832927 +0000 UTC m=+0.202812465 container create 754add42d2b7d74e00b8452ef21d4e0cc6791188c0b92b7c1877d287fba0c94b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=) 2024-03-16T21:09:23.837 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:23 smithi008 podman[99614]: 2024-03-16 21:09:23.725513171 +0000 UTC m=+0.699492759 container init 754add42d2b7d74e00b8452ef21d4e0cc6791188c0b92b7c1877d287fba0c94b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-03-16T21:09:23.837 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:23 smithi008 podman[99614]: 2024-03-16 21:09:23.737408975 +0000 UTC m=+0.711388516 container start 754add42d2b7d74e00b8452ef21d4e0cc6791188c0b92b7c1877d287fba0c94b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-16T21:09:24.193 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:23 smithi008 podman[99614]: 2024-03-16 21:09:23.831945083 +0000 UTC m=+0.805924596 container attach 754add42d2b7d74e00b8452ef21d4e0cc6791188c0b92b7c1877d287fba0c94b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0-deactivate, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:09:24.495 INFO:journalctl@ceph.osd.0.smithi008.stdout:Mar 16 21:09:24 smithi008 podman[99614]: 2024-03-16 21:09:24.188680798 +0000 UTC m=+1.162660389 container died 754add42d2b7d74e00b8452ef21d4e0cc6791188c0b92b7c1877d287fba0c94b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:09:24.919 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.0.service' 2024-03-16T21:09:25.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:09:25.054 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-16T21:09:25.054 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-16T21:09:25.054 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.1 2024-03-16T21:09:25.369 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:25 smithi170 systemd[1]: Stopping Ceph osd.1 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:25.868 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:25 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1[40578]: 2024-03-16T21:09:25.427+0000 7f2d50fdd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:09:25.868 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:25 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1[40578]: 2024-03-16T21:09:25.427+0000 7f2d50fdd700 -1 osd.1 100 *** Got signal Terminated *** 2024-03-16T21:09:25.868 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:25 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1[40578]: 2024-03-16T21:09:25.427+0000 7f2d50fdd700 -1 osd.1 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:09:31.118 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:30 smithi170 podman[72429]: 2024-03-16 21:09:30.830451641 +0000 UTC m=+5.581386660 container died 78ebb06dee68d65fa53243834a03b87fcd79388287c8848a6c05b8684dab073a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:09:31.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:31 smithi170 podman[72429]: 2024-03-16 21:09:31.204278146 +0000 UTC m=+5.955213172 container cleanup 78ebb06dee68d65fa53243834a03b87fcd79388287c8848a6c05b8684dab073a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-16T21:09:31.493 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:31 smithi170 bash[72429]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1 2024-03-16T21:09:31.824 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:31 smithi170 podman[72446]: 2024-03-16 21:09:31.488935809 +0000 UTC m=+0.658679063 container remove 78ebb06dee68d65fa53243834a03b87fcd79388287c8848a6c05b8684dab073a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-16T21:09:32.098 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:31 smithi170 podman[72537]: 2024-03-16 21:09:31.722628417 +0000 UTC m=+0.017902905 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:09:32.098 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:31 smithi170 podman[72537]: 2024-03-16 21:09:31.831762955 +0000 UTC m=+0.127037422 container create 2b36a9804d7c29975f072e77a095882041570215c9b4cea8342d9039666d5f74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-16T21:09:32.098 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:32 smithi170 podman[72537]: 2024-03-16 21:09:32.093708779 +0000 UTC m=+0.388983255 container init 2b36a9804d7c29975f072e77a095882041570215c9b4cea8342d9039666d5f74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2) 2024-03-16T21:09:32.368 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:32 smithi170 podman[72537]: 2024-03-16 21:09:32.096955964 +0000 UTC m=+0.392230433 container start 2b36a9804d7c29975f072e77a095882041570215c9b4cea8342d9039666d5f74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-16T21:09:32.368 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:32 smithi170 podman[72537]: 2024-03-16 21:09:32.184742231 +0000 UTC m=+0.480016715 container attach 2b36a9804d7c29975f072e77a095882041570215c9b4cea8342d9039666d5f74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T21:09:32.684 INFO:journalctl@ceph.osd.1.smithi170.stdout:Mar 16 21:09:32 smithi170 podman[72537]: 2024-03-16 21:09:32.381526085 +0000 UTC m=+0.676800562 container died 2b36a9804d7c29975f072e77a095882041570215c9b4cea8342d9039666d5f74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307) 2024-03-16T21:09:33.015 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.1.service' 2024-03-16T21:09:33.057 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:09:33.057 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-16T21:09:33.057 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-16T21:09:33.057 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.2 2024-03-16T21:09:33.393 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:33 smithi186 systemd[1]: Stopping Ceph osd.2 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:33.893 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:33 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2[41745]: 2024-03-16T21:09:33.388+0000 7f6550bff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:09:33.894 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:33 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2[41745]: 2024-03-16T21:09:33.388+0000 7f6550bff700 -1 osd.2 100 *** Got signal Terminated *** 2024-03-16T21:09:33.894 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:33 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2[41745]: 2024-03-16T21:09:33.388+0000 7f6550bff700 -1 osd.2 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:09:39.144 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:38 smithi186 podman[74202]: 2024-03-16 21:09:38.836808936 +0000 UTC m=+5.583331740 container died f8e81faa3e39d2eaf3de57f086c4a7a99a3a7d4a6db6330d38bda55f4b3070ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-16T21:09:39.490 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:39 smithi186 podman[74202]: 2024-03-16 21:09:39.242234581 +0000 UTC m=+5.988757382 container cleanup f8e81faa3e39d2eaf3de57f086c4a7a99a3a7d4a6db6330d38bda55f4b3070ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-03-16T21:09:39.490 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:39 smithi186 bash[74202]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2 2024-03-16T21:09:39.816 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:39 smithi186 podman[74222]: 2024-03-16 21:09:39.48551955 +0000 UTC m=+0.643049190 container remove f8e81faa3e39d2eaf3de57f086c4a7a99a3a7d4a6db6330d38bda55f4b3070ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5) 2024-03-16T21:09:40.103 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:39 smithi186 podman[74314]: 2024-03-16 21:09:39.714672002 +0000 UTC m=+0.018096775 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:09:40.103 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:39 smithi186 podman[74314]: 2024-03-16 21:09:39.828321184 +0000 UTC m=+0.131745960 container create c53a3cf149c995b65430e721d6bb734a40738355ebe931473b1fa846d5d97d83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-03-16T21:09:40.103 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:40 smithi186 podman[74314]: 2024-03-16 21:09:40.098502596 +0000 UTC m=+0.401927363 container init c53a3cf149c995b65430e721d6bb734a40738355ebe931473b1fa846d5d97d83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-16T21:09:40.393 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:40 smithi186 podman[74314]: 2024-03-16 21:09:40.101904573 +0000 UTC m=+0.405329335 container start c53a3cf149c995b65430e721d6bb734a40738355ebe931473b1fa846d5d97d83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-16T21:09:40.394 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:40 smithi186 podman[74314]: 2024-03-16 21:09:40.197802086 +0000 UTC m=+0.501226870 container attach c53a3cf149c995b65430e721d6bb734a40738355ebe931473b1fa846d5d97d83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-16T21:09:40.755 INFO:journalctl@ceph.osd.2.smithi186.stdout:Mar 16 21:09:40 smithi186 podman[74314]: 2024-03-16 21:09:40.391541696 +0000 UTC m=+0.694966452 container died c53a3cf149c995b65430e721d6bb734a40738355ebe931473b1fa846d5d97d83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-2-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-03-16T21:09:41.048 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.2.service' 2024-03-16T21:09:41.089 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:09:41.090 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-16T21:09:41.090 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-16T21:09:41.090 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.3 2024-03-16T21:09:41.466 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:41 smithi008 systemd[1]: Stopping Ceph osd.3 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:41.746 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:41 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3[52961]: 2024-03-16T21:09:41.687+0000 7fe549a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:09:41.746 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:41 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3[52961]: 2024-03-16T21:09:41.687+0000 7fe549a00700 -1 osd.3 100 *** Got signal Terminated *** 2024-03-16T21:09:41.746 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:41 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3[52961]: 2024-03-16T21:09:41.687+0000 7fe549a00700 -1 osd.3 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:09:42.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:41.883+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:42.160 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:42 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:42.012+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:43.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:42 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:42.871+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:43.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:43 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:43.044+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:43.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:43 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:43.295+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:44.045 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:43.824+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:44.045 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:43.760+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:44.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:44 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:44.051+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:44.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:44.343+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:44.996 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:44 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:44.673+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:45.144 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:44.807+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:45.144 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:44.779+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:45.495 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:45 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3[52961]: 2024-03-16T21:09:45.009+0000 7fe545200700 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.566591+0000 front 2024-03-16T21:09:19.566458+0000 (oldest deadline 2024-03-16T21:09:44.266508+0000) 2024-03-16T21:09:45.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:45 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:45.015+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:45.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:45 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:45.301+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:45.988 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:45 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:45.637+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:46.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:45 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:45.794+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:46.144 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:45 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:45.771+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:46.245 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:46 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3[52961]: 2024-03-16T21:09:46.002+0000 7fe545200700 -1 osd.3 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.566591+0000 front 2024-03-16T21:09:19.566458+0000 (oldest deadline 2024-03-16T21:09:44.266508+0000) 2024-03-16T21:09:46.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:45 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:45.982+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:46.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:46 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:46.287+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:46.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:46 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:46.630+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:47.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:46.762+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:47.144 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:46.730+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:47.495 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:47 smithi008 podman[99720]: 2024-03-16 21:09:47.22034541 +0000 UTC m=+5.690504391 container died 145b13ba78ecabc876a1832393d1ed6902e0f57592f6d0c421c91d68a130d7f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-16T21:09:47.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:46 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:46.998+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:47.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:47 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:47.298+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:47.995 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:47 smithi008 podman[99720]: 2024-03-16 21:09:47.72278304 +0000 UTC m=+6.192941957 container cleanup 145b13ba78ecabc876a1832393d1ed6902e0f57592f6d0c421c91d68a130d7f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T21:09:47.995 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:47 smithi008 bash[99720]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3 2024-03-16T21:09:47.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:47 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:47.590+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:48.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:47 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:47.756+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:48.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:47 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:47.704+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:48.495 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:48 smithi008 podman[99750]: 2024-03-16 21:09:48.182816184 +0000 UTC m=+0.951002550 container remove 145b13ba78ecabc876a1832393d1ed6902e0f57592f6d0c421c91d68a130d7f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T21:09:48.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:48 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:48.042+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:48.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:48 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:48.334+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:48.994 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:48 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:48.620+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:49.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:48 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:48.733+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:49.144 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:48 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:48.729+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:49.388 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:49.008+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:49.388 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:49 smithi008 podman[99837]: 2024-03-16 21:09:49.048414865 +0000 UTC m=+0.038907217 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:09:49.388 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:49 smithi008 podman[99837]: 2024-03-16 21:09:49.165173434 +0000 UTC m=+0.155665823 container create 4dbf198be50dcff7f1cbc00841238f322965e1c93ac98d6196707884195ea8d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:09:49.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:49 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:49.330+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:49.745 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:49 smithi008 podman[99837]: 2024-03-16 21:09:49.502738743 +0000 UTC m=+0.493231138 container init 4dbf198be50dcff7f1cbc00841238f322965e1c93ac98d6196707884195ea8d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-16T21:09:49.745 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:49 smithi008 podman[99837]: 2024-03-16 21:09:49.514665926 +0000 UTC m=+0.505158289 container start 4dbf198be50dcff7f1cbc00841238f322965e1c93ac98d6196707884195ea8d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.build-date=20240307) 2024-03-16T21:09:49.745 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:49 smithi008 podman[99837]: 2024-03-16 21:09:49.609900013 +0000 UTC m=+0.600392409 container attach 4dbf198be50dcff7f1cbc00841238f322965e1c93ac98d6196707884195ea8d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-16T21:09:49.746 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:49 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:49.607+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:50.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:49.758+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:50.144 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:49.755+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:50.245 INFO:journalctl@ceph.osd.3.smithi008.stdout:Mar 16 21:09:49 smithi008 podman[99837]: 2024-03-16 21:09:49.965638367 +0000 UTC m=+0.956130753 container died 4dbf198be50dcff7f1cbc00841238f322965e1c93ac98d6196707884195ea8d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T21:09:50.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:50 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:50.054+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:50.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:50 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:50.286+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:50.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:50 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:50.575+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:50.900 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.3.service' 2024-03-16T21:09:51.032 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:09:51.033 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-16T21:09:51.033 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-16T21:09:51.033 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.4 2024-03-16T21:09:51.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:50 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:50.759+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:51.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:50 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:50.792+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:51.330 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:51 smithi170 systemd[1]: Stopping Ceph osd.4 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:51.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:51 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:51.095+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:51.603 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:51 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:51.325+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:51.603 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:09:51 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:09:51.569+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:09:51.604 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:51 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4[47132]: 2024-03-16T21:09:51.332+0000 7f1266fee700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:09:51.604 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:51 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4[47132]: 2024-03-16T21:09:51.332+0000 7f1266fee700 -1 osd.4 100 *** Got signal Terminated *** 2024-03-16T21:09:51.604 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:51 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4[47132]: 2024-03-16T21:09:51.332+0000 7f1266fee700 -1 osd.4 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:09:51.867 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:51 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4[47132]: 2024-03-16T21:09:51.598+0000 7f12635e2700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.998732+0000 front 2024-03-16T21:09:29.998762+0000 (oldest deadline 2024-03-16T21:09:51.098894+0000) 2024-03-16T21:09:51.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:51 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:51.538+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:52.144 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:51 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:51.750+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:52.144 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:51 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:51.746+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:52.144 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:51 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:51.746+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:09:52.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:52 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:52.070+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:52.606 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:52 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:52.293+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:52.868 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:52 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4[47132]: 2024-03-16T21:09:52.601+0000 7f12635e2700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.998732+0000 front 2024-03-16T21:09:29.998762+0000 (oldest deadline 2024-03-16T21:09:51.098894+0000) 2024-03-16T21:09:52.868 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:09:52 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:09:52.612+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:09:52.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:52 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:52.506+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:53.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:52 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:52.753+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:53.144 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:52 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:52.761+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:53.144 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:52 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:52.761+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:09:53.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:53 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:53.040+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:53.611 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:53 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:53.340+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:53.767 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:53.707+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:53.767 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:09:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:09:53.474+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:09:53.868 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:53 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4[47132]: 2024-03-16T21:09:53.606+0000 7f12635e2700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.998732+0000 front 2024-03-16T21:09:29.998762+0000 (oldest deadline 2024-03-16T21:09:51.098894+0000) 2024-03-16T21:09:53.868 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:09:53 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:09:53.644+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:09:53.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:53 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:53.506+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:53.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:53 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:53.506+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:09:54.108 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:53.762+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:54.108 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:53.762+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:09:54.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:54 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:54.046+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:54.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:54 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:54.298+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:54.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:54 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:54.298+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:09:54.809 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:09:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:09:54.495+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:09:54.810 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:54.720+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:54.810 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:54.720+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:09:54.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:54 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:54.491+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:54.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:54 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:54.491+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:09:55.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:09:54 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:09:54.651+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:09:55.118 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:54 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4[47132]: 2024-03-16T21:09:54.627+0000 7f12635e2700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.998732+0000 front 2024-03-16T21:09:29.998762+0000 (oldest deadline 2024-03-16T21:09:51.098894+0000) 2024-03-16T21:09:55.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:54.804+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:55.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:54.804+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:09:55.463 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:55 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:55.075+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:55.463 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:55 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:55.075+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:09:55.618 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:55 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4[47132]: 2024-03-16T21:09:55.588+0000 7f12635e2700 -1 osd.4 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.998732+0000 front 2024-03-16T21:09:29.998762+0000 (oldest deadline 2024-03-16T21:09:51.098894+0000) 2024-03-16T21:09:55.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:55 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:55.338+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:55.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:55 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:55.338+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:09:55.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:55 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:55.457+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:55.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:55 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:55.457+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:09:55.763 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:09:55 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:09:55.492+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:09:55.763 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:55 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:55.687+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:55.763 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:55 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:55.687+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:09:56.117 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:09:55 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:09:55.628+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:09:56.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:55 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:55.758+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:56.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:55 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:55.758+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:09:56.432 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:56 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:56.043+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:56.432 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:56 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:56.043+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:09:56.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:56 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:56.295+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:56.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:56 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:56.295+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:09:56.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:56 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:56.426+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:56.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:56 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:56.426+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:09:56.787 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:56 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:56.645+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:56.787 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:56 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:56.645+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:09:56.787 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:09:56 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:09:56.497+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:09:57.021 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:56 smithi170 podman[72655]: 2024-03-16 21:09:56.756922252 +0000 UTC m=+5.530541212 container died 5fb7a0258a4074887416b066aa24af9fcf8a2b99b66fb73aaade339c941f5164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5) 2024-03-16T21:09:57.021 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:09:56 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:09:56.674+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:09:57.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:56 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:56.782+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:57.144 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:56 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:56.782+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:09:57.289 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:57 smithi170 podman[72655]: 2024-03-16 21:09:57.09904177 +0000 UTC m=+5.872660723 container cleanup 5fb7a0258a4074887416b066aa24af9fcf8a2b99b66fb73aaade339c941f5164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-16T21:09:57.290 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:57 smithi170 bash[72655]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4 2024-03-16T21:09:57.402 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:57 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:57.073+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:57.402 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:57 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:57.073+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:09:57.618 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:57 smithi170 podman[72672]: 2024-03-16 21:09:57.317114893 +0000 UTC m=+0.557896252 container remove 5fb7a0258a4074887416b066aa24af9fcf8a2b99b66fb73aaade339c941f5164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T21:09:57.619 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:57 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:57.284+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:57.619 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:57 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:57.284+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:09:57.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:57 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:57.396+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:57.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:57 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:57.396+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:09:57.893 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:57 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:57.760+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:57.893 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:57 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:57.760+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:09:57.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:09:57 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:09:57.535+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:09:57.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:57 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:57.659+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:57.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:57 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:57.659+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:09:57.896 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:09:57 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:09:57.630+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:09:57.896 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:57 smithi170 podman[72765]: 2024-03-16 21:09:57.613446812 +0000 UTC m=+0.017652224 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:09:57.896 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:57 smithi170 podman[72765]: 2024-03-16 21:09:57.734546923 +0000 UTC m=+0.138752327 container create 079928e07b2dabf7fb17159241b76ab390f3d78fb646f745488ab4f94a421441 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-16T21:09:58.349 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:58 smithi170 podman[72765]: 2024-03-16 21:09:58.059946043 +0000 UTC m=+0.464151446 container init 079928e07b2dabf7fb17159241b76ab390f3d78fb646f745488ab4f94a421441 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:09:58.349 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:58 smithi170 podman[72765]: 2024-03-16 21:09:58.06338136 +0000 UTC m=+0.467586765 container start 079928e07b2dabf7fb17159241b76ab390f3d78fb646f745488ab4f94a421441 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-16T21:09:58.349 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:58 smithi170 podman[72765]: 2024-03-16 21:09:58.154151576 +0000 UTC m=+0.558356988 container attach 079928e07b2dabf7fb17159241b76ab390f3d78fb646f745488ab4f94a421441 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-03-16T21:09:58.349 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:58 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:58.274+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:58.349 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:58 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:58.274+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:09:58.353 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:58 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:58.030+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:58.353 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:58 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:58.030+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:09:58.618 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:09:58 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:09:58.583+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:09:58.618 INFO:journalctl@ceph.osd.4.smithi170.stdout:Mar 16 21:09:58 smithi170 podman[72765]: 2024-03-16 21:09:58.344800499 +0000 UTC m=+0.749005920 container died 079928e07b2dabf7fb17159241b76ab390f3d78fb646f745488ab4f94a421441 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-4-deactivate, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-16T21:09:58.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:58 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:58.347+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:58.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:58 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:58.347+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:09:58.806 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:09:58 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:09:58.540+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:09:58.806 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:58 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:58.652+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:58.806 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:58 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:58.652+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:09:58.993 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.4.service' 2024-03-16T21:09:59.036 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:09:59.036 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-16T21:09:59.036 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-16T21:09:59.036 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.5 2024-03-16T21:09:59.066 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:58 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:58.801+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:59.066 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:58 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:58.801+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:09:59.359 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:59 smithi186 systemd[1]: Stopping Ceph osd.5 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:09:59.368 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:59 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:59.059+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:09:59.368 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:09:59 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:09:59.059+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:09:59.601 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:59 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:59.228+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:09:59.602 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:09:59 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:09:59.228+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:09:59.612 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:09:59 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:09:59.507+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:09:59.612 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:59 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:59.354+0000 7ff9e3d24700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:09:59.612 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:59 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:59.354+0000 7ff9e3d24700 -1 osd.5 100 *** Got signal Terminated *** 2024-03-16T21:09:59.612 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:59 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:59.354+0000 7ff9e3d24700 -1 osd.5 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:09:59.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:59 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:59.362+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:09:59.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:09:59 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:09:59.362+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:09:59.868 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:09:59 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:09:59.595+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:09:59.893 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:59 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:59.825+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:09:59.893 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:59 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:59.825+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:09:59.893 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:09:59 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:09:59.825+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:37.512085+0000 front 2024-03-16T21:09:37.512058+0000 (oldest deadline 2024-03-16T21:09:59.712638+0000) 2024-03-16T21:09:59.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:59 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:59.607+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:09:59.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:09:59 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:09:59.607+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:00.411 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:00.017+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:00.411 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:00.017+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:00.411 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:00.017+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:00.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:00 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:00.252+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:00.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:00 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:00.252+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:00.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:00.405+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:00.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:00.405+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:00.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:00 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:00.405+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:00.851 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:00 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:00.604+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:00.852 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:00 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:00.604+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:00.852 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:00 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:00.604+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:00.852 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:00 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:00.509+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:00.852 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:00 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:00.509+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:01.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:00 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:00.635+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:01.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:00 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:00.846+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:10:01.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:00 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:00.846+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:10:01.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:00 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:00.846+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:37.512085+0000 front 2024-03-16T21:09:37.512058+0000 (oldest deadline 2024-03-16T21:09:59.712638+0000) 2024-03-16T21:10:01.403 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:01.027+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:01.403 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:01.027+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:01.403 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:01.027+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:01.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:01 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:01.240+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:01.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:01 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:01.240+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:01.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:01.397+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:01.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:01.397+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:01.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:01.397+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:01.836 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:01 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:01.490+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:01.836 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:01 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:01.490+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:01.837 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:01 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:01.614+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:01.837 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:01 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:01.614+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:01.837 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:01 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:01.614+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:02.117 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:01 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:01.654+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:02.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:01 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:01.654+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:02.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:01 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:01.831+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:10:02.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:01 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:01.831+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:10:02.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:01 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:01.831+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:37.512085+0000 front 2024-03-16T21:09:37.512058+0000 (oldest deadline 2024-03-16T21:09:59.712638+0000) 2024-03-16T21:10:02.375 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:01.996+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:02.375 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:01.996+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:02.375 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:01.996+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:02.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:02.290+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:02.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:02.290+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:02.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:02 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:02.369+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:02.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:02 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:02.369+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:02.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:02 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:02.369+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:02.825 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:02.458+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:02.825 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:02.458+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:02.826 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:02.644+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:02.826 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:02.644+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:02.826 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:02.644+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:03.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:02.675+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:03.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:02 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:02.675+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:03.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:02.820+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:10:03.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:02.820+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:10:03.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:02 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:02.820+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:37.512085+0000 front 2024-03-16T21:09:37.512058+0000 (oldest deadline 2024-03-16T21:09:59.712638+0000) 2024-03-16T21:10:03.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:02 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:02.963+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:03.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:02 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:02.963+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:03.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:02 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:02.963+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:03.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:03 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:03.307+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:03.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:03 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:03.307+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:03.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:03 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:03.399+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:03.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:03 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:03.399+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:03.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:03 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:03.399+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:03.804 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:03 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:03.662+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:03.804 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:03 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:03.662+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:03.805 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:03 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:03.662+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:03.805 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:03 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:03.471+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:03.805 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:03 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:03.471+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:04.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:03 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:03.725+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:04.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:03 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:03.725+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:04.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:03 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:03.799+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:17.307931+0000 front 2024-03-16T21:09:17.308069+0000 (oldest deadline 2024-03-16T21:09:43.207872+0000) 2024-03-16T21:10:04.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:03 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:03.799+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.508991+0000 front 2024-03-16T21:09:25.509020+0000 (oldest deadline 2024-03-16T21:09:51.409185+0000) 2024-03-16T21:10:04.143 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:03 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5[48296]: 2024-03-16T21:10:03.799+0000 7ff9e0318700 -1 osd.5 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:37.512085+0000 front 2024-03-16T21:09:37.512058+0000 (oldest deadline 2024-03-16T21:09:59.712638+0000) 2024-03-16T21:10:04.397 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:04 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:04.013+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:04.397 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:04 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:04.013+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:04.397 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:04 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:04.013+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:04.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:04 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:04.286+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:04.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:04 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:04.286+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:04.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:04 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:04.286+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:04.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:04 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:04.391+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:04.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:04 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:04.391+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:04.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:04 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:04.391+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:04.816 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:04 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:04.621+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:04.816 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:04 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:04.621+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:04.816 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:04 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:04.621+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:04.816 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:04 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:04.465+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:04.816 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:04 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:04.465+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:05.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:04 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:04.724+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:05.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:04 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:04.724+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:05.124 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:04 smithi186 podman[74431]: 2024-03-16 21:10:04.810546261 +0000 UTC m=+5.578041940 container died 36da19455887f7e79eb1a8de59b121e1491f245a7e49db1f40f5c2c31f5d23e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T21:10:05.393 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:05 smithi186 podman[74431]: 2024-03-16 21:10:05.221505075 +0000 UTC m=+5.989000746 container cleanup 36da19455887f7e79eb1a8de59b121e1491f245a7e49db1f40f5c2c31f5d23e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T21:10:05.393 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:05 smithi186 bash[74431]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5 2024-03-16T21:10:05.394 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:04 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:04.992+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:05.394 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:04 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:04.992+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:05.394 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:04 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:04.992+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:05.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:05 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:05.326+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:05.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:05 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:05.326+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:05.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:05 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:05.326+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:05.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:05 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:05.389+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:05.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:05 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:05.389+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:05.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:05 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:05.389+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:05.894 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:05 smithi186 podman[74449]: 2024-03-16 21:10:05.472942067 +0000 UTC m=+0.662439152 container remove 36da19455887f7e79eb1a8de59b121e1491f245a7e49db1f40f5c2c31f5d23e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD) 2024-03-16T21:10:05.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:05 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:05.455+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:05.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:05 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:05.455+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:05.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:05 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:05.598+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:05.895 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:05 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:05.598+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:05.895 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:05 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:05.598+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:06.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:05 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:05.745+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:06.161 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:05 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:05.745+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:06.181 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:05 smithi186 podman[74540]: 2024-03-16 21:10:05.797569776 +0000 UTC m=+0.018153103 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:10:06.181 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:05 smithi186 podman[74540]: 2024-03-16 21:10:05.92409797 +0000 UTC m=+0.144681278 container create 435a9c54526dd9c945566ee72e8fa7fb7e60b1c2a651d3b7220a41bc89928978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, ceph=True, org.label-schema.license=GPLv2) 2024-03-16T21:10:06.181 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:06 smithi186 podman[74540]: 2024-03-16 21:10:06.176866894 +0000 UTC m=+0.397450211 container init 435a9c54526dd9c945566ee72e8fa7fb7e60b1c2a651d3b7220a41bc89928978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5-deactivate, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240307, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-16T21:10:06.431 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:06.003+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:06.431 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:06.003+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:06.431 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:06.003+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:06.480 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:06 smithi186 podman[74540]: 2024-03-16 21:10:06.180186469 +0000 UTC m=+0.400769786 container start 435a9c54526dd9c945566ee72e8fa7fb7e60b1c2a651d3b7220a41bc89928978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-16T21:10:06.480 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:06 smithi186 podman[74540]: 2024-03-16 21:10:06.285090566 +0000 UTC m=+0.505673889 container attach 435a9c54526dd9c945566ee72e8fa7fb7e60b1c2a651d3b7220a41bc89928978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-16T21:10:06.619 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:06 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:06.281+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:06.619 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:06 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:06.281+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:06.619 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:06 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:06.281+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:06.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:06.424+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:06.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:06.424+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:06.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:06.424+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:06.867 INFO:journalctl@ceph.osd.5.smithi186.stdout:Mar 16 21:10:06 smithi186 podman[74540]: 2024-03-16 21:10:06.476424218 +0000 UTC m=+0.697007518 container died 435a9c54526dd9c945566ee72e8fa7fb7e60b1c2a651d3b7220a41bc89928978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-16T21:10:06.868 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:06 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:06.590+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:06.868 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:06 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:06.590+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:06.868 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:06 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:06.590+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:06.868 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:06 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:06.485+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:06.868 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:06 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:06.485+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:07.117 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:06 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:06.750+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:07.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:06 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:06.750+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:07.206 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.5.service' 2024-03-16T21:10:07.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:06.988+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:07.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:06.988+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:07.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:06.988+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:07.295 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:10:07.295 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-16T21:10:07.296 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-16T21:10:07.296 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.6 2024-03-16T21:10:07.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:07 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:07.328+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:07.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:07 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:07.328+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:07.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:07 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:07.328+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:07.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:07 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:07.378+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:07.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:07 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:07.378+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:07.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:07 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:07.378+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:07.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:07 smithi008 systemd[1]: Stopping Ceph osd.6 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:10:07.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:07 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:07.466+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:07.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:07 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:07.466+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:07.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:07 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:07.564+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:07.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:07 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:07.564+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:07.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:07 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:07.564+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:08.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:07 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:07.772+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:08.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:07 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:07.772+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:08.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:07 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:07.772+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:08.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:08 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:08.036+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:08.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:08 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:08.036+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:08.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:08 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:08.036+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:08.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:07 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:07.866+0000 7f36cfe00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:10:08.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:07 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:07.866+0000 7f36cfe00700 -1 osd.6 100 *** Got signal Terminated *** 2024-03-16T21:10:08.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:07 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:07.866+0000 7f36cfe00700 -1 osd.6 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:10:08.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:08 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:08.328+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:08.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:08 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:08.328+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:08.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:08 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:08.328+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:08.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:08 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:08.382+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:08.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:08 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:08.382+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:08.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:08 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:08.382+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:08.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:08 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:08.513+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:08.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:08 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:08.513+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:08.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:08 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:08.517+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:08.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:08 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:08.517+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:08.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:08 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:08.517+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:09.117 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:08 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:08.823+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:09.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:08 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:08.823+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:09.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:08 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:08.823+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:09.341 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:09 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:09.077+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:09.341 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:09 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:09.077+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:09.341 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:09 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:09.077+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:09.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:09 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:09.289+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:09.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:09 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:09.290+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:09.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:09 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:09.290+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:09.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:09 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:09.335+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:09.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:09 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:09.335+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:09.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:09 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:09.335+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:09.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:09 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:09.521+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:09.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:09 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:09.521+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:09.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:09 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:09.490+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:09.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:09 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:09.490+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:09.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:09 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:09.490+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:10.117 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:09 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:09.817+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:10.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:09 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:09.817+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:10.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:09 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:09.817+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:10.365 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:10.088+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:10.365 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:10.088+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:10.365 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:10.088+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:10.365 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:10.088+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:10.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:10 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:10.241+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:10.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:10 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:10.241+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:10.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:10 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:10.241+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:10.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:10 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:10.241+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:10.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:10.359+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:10.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:10.359+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:10.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:10 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:10.359+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:10.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:10 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:10.526+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:10.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:10 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:10.526+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:10.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:10 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:10.526+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:10.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:10 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:10.490+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:10.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:10 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:10.490+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:10.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:10 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:10.490+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:11.117 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:10 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:10.857+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:11.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:10 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:10.857+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:11.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:10 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:10.857+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:11.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:11.132+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:11.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:11.132+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:11.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:11.132+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:11.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:11.132+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:11.495 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:11.372+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:11.496 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:11.372+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:11.496 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:11.372+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:11.496 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:11.372+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:43.033213+0000 front 2024-03-16T21:09:43.033163+0000 (oldest deadline 2024-03-16T21:10:10.634569+0000) 2024-03-16T21:10:11.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:11 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:11.222+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:11.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:11 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:11.222+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:11.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:11 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:11.222+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:11.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:11 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:11.222+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:11.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:11 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:11.506+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:11.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:11 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:11.506+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:11.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:11 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:11.506+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:11.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:11 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:11.515+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:11.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:11 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:11.515+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:11.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:11 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:11.515+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:12.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:11 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:11.831+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:12.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:11 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:11.831+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:12.118 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:11 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:11.831+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:12.495 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:12.337+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.225657+0000 front 2024-03-16T21:09:19.224892+0000 (oldest deadline 2024-03-16T21:09:44.525129+0000) 2024-03-16T21:10:12.495 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:12.337+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.928742+0000 front 2024-03-16T21:09:27.928682+0000 (oldest deadline 2024-03-16T21:09:52.628940+0000) 2024-03-16T21:10:12.495 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:12.337+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.330293+0000 front 2024-03-16T21:09:34.330359+0000 (oldest deadline 2024-03-16T21:09:59.630509+0000) 2024-03-16T21:10:12.495 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6[59518]: 2024-03-16T21:10:12.337+0000 7f36cb600700 -1 osd.6 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:43.033213+0000 front 2024-03-16T21:09:43.033163+0000 (oldest deadline 2024-03-16T21:10:10.634569+0000) 2024-03-16T21:10:12.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:12.092+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:12.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:12.092+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:12.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:12.092+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:12.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:12 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:12.092+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:12.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:12 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:12.219+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:12.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:12 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:12.219+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:12.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:12 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:12.219+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:12.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:12 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:12.219+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:12.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:12 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:12.543+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:12.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:12 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:12.543+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:12.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:12 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:12.543+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:12.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:12 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:12.543+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:12.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:12 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:12.543+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:12.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:12 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:12.543+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:12.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:12 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:12.543+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:13.209 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:13 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:13.103+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:13.209 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:13 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:13.103+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:13.209 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:13 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:13.103+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:13.209 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:13 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:13.103+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:13.244 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:12 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:12.878+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:13.244 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:12 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:12.878+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:13.244 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:12 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:12.878+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:13.495 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:13 smithi008 podman[99943]: 2024-03-16 21:10:13.337361964 +0000 UTC m=+5.606282907 container died e7830618fb93fa91508660bd872313fa8d3fc28c37efcf806190667fa7cec51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-16T21:10:13.524 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:13 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:13.239+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:13.524 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:13 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:13.239+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:13.524 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:13 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:13.239+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:13.524 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:13 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:13.239+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:13.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:13 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:13.559+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:13.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:13 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:13.559+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:13.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:13 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:13.559+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:13.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:13 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:13.545+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:13.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:13 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:13.545+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:13.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:13 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:13.545+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:13.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:13 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:13.545+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:14.118 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:13 smithi008 podman[99943]: 2024-03-16 21:10:13.85015774 +0000 UTC m=+6.119078686 container cleanup e7830618fb93fa91508660bd872313fa8d3fc28c37efcf806190667fa7cec51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T21:10:14.118 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:13 smithi008 bash[99943]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6 2024-03-16T21:10:14.219 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:13 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:13.917+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:14.219 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:13 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:13.917+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:14.219 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:13 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:13.917+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:14.495 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:14 smithi008 podman[99972]: 2024-03-16 21:10:14.168194214 +0000 UTC m=+0.815121601 container remove e7830618fb93fa91508660bd872313fa8d3fc28c37efcf806190667fa7cec51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD) 2024-03-16T21:10:14.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:14 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:14.111+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:14.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:14 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:14.111+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:14.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:14 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:14.111+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:14.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:14 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:14.111+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:14.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:14 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:14.213+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:14.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:14 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:14.213+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:14.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:14 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:14.213+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:14.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:14 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:14.213+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:14.795 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:14 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:14.571+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:14.795 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:14 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:14.571+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:14.795 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:14 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:14.571+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:14.795 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:14 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:14.536+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:14.795 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:14 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:14.536+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:14.795 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:14 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:14.536+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:14.795 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:14 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:14.536+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:15.111 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:14 smithi008 podman[100059]: 2024-03-16 21:10:14.691251411 +0000 UTC m=+0.041387186 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:10:15.111 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:14 smithi008 podman[100059]: 2024-03-16 21:10:14.935995693 +0000 UTC m=+0.286131506 container create fc8b272616f754256cf5dfef082b176f32baffda9bf61cd7e287d96848407593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T21:10:15.207 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:14 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:14.913+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:15.207 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:14 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:14.913+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:15.207 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:14 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:14.913+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:15.368 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:15 smithi008 podman[100059]: 2024-03-16 21:10:15.264905682 +0000 UTC m=+0.615041502 container init fc8b272616f754256cf5dfef082b176f32baffda9bf61cd7e287d96848407593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T21:10:15.369 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:15 smithi008 podman[100059]: 2024-03-16 21:10:15.27618855 +0000 UTC m=+0.626324361 container start fc8b272616f754256cf5dfef082b176f32baffda9bf61cd7e287d96848407593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-16T21:10:15.369 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:15 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:15.104+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:15.369 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:15 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:15.104+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:15.369 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:15 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:15.104+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:15.369 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:15 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:15.104+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:15.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:15 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:15.202+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:15.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:15 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:15.202+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:15.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:15 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:15.202+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:15.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:15 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:15.202+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:15.731 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:15 smithi008 podman[100059]: 2024-03-16 21:10:15.363958599 +0000 UTC m=+0.714094392 container attach fc8b272616f754256cf5dfef082b176f32baffda9bf61cd7e287d96848407593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6-deactivate, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True) 2024-03-16T21:10:15.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:15 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:15.619+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:15.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:15 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:15.619+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:15.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:15 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:15.619+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:15.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:15 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:15.573+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:15.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:15 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:15.573+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:15.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:15 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:15.573+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:15.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:15 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:15.573+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:15.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Mar 16 21:10:15 smithi008 podman[100059]: 2024-03-16 21:10:15.726980513 +0000 UTC m=+1.077116304 container died fc8b272616f754256cf5dfef082b176f32baffda9bf61cd7e287d96848407593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-6-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-16T21:10:16.224 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:15 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:15.920+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:16.224 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:15 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:15.920+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:16.224 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:15 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:15.920+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:16.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:16 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:16.094+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:16.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:16 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:16.094+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:16.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:16 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:16.094+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:16.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:16 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:16.094+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:16.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:16 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:16.219+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:16.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:16 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:16.219+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:16.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:16 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:16.219+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:16.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:16 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:16.219+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:16.648 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.6.service' 2024-03-16T21:10:16.781 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:10:16.781 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-16T21:10:16.781 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-16T21:10:16.781 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.7 2024-03-16T21:10:16.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:16 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:16.603+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:16.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:16 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:16.603+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:16.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:16 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:16.603+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:16.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:16 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:16.576+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:16.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:16 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:16.576+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:16.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:16 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:16.576+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:16.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:16 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:16.576+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:17.106 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:16 smithi170 systemd[1]: Stopping Ceph osd.7 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:10:17.106 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:16 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:16.905+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:17.106 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:16 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:16.905+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:17.106 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:16 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:16.905+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:17.367 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:17.100+0000 7f690a812700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:10:17.368 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:17.100+0000 7f690a812700 -1 osd.7 100 *** Got signal Terminated *** 2024-03-16T21:10:17.368 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:17.100+0000 7f690a812700 -1 osd.7 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:10:17.368 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:17.174+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:17.368 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:17.174+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:17.368 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:17.174+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:17.368 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:17.174+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:17.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:17 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:17.079+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:17.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:17 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:17.079+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:17.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:17 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:17.079+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:17.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:17 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:17.079+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:17.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:17 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:17.645+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:17.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:17 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:17.645+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:17.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:17 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:17.645+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:17.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:17 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:17.615+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:17.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:17 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:17.615+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:17.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:17 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:17.615+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:17.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:17 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:17.615+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:18.195 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:17.882+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:18.196 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:17.882+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:18.196 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:17.882+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:18.196 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:17.882+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.526410+0000 front 2024-03-16T21:09:53.526493+0000 (oldest deadline 2024-03-16T21:10:17.626551+0000) 2024-03-16T21:10:18.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:18 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:18.059+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:18.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:18 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:18.059+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:18.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:18 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:18.059+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:18.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:18 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:18.059+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:18.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:18 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:18.191+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:18.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:18 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:18.191+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:18.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:18 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:18.191+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:18.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:18 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:18.191+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:18.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:18 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:18.619+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:18.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:18 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:18.619+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:18.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:18 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:18.619+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:18.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:18 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:18.619+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:18.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:18 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:18.636+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:18.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:18 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:18.636+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:18.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:18 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:18.636+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:18.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:18 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:18.636+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:18.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:18 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:18.636+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:19.173 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:18 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:18.917+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:19.173 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:18 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:18.917+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:19.173 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:18 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:18.917+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:19.173 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:18 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:18.917+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.526410+0000 front 2024-03-16T21:09:53.526493+0000 (oldest deadline 2024-03-16T21:10:17.626551+0000) 2024-03-16T21:10:19.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:19 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:19.058+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:19.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:19 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:19.058+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:19.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:19 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:19.058+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:19.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:19 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:19.058+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:19.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:19 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:19.167+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:19.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:19 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:19.167+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:19.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:19 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:19.167+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:19.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:19 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:19.167+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:19.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:19 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:19.167+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:19.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:19 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:19.644+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:19.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:19 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:19.644+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:19.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:19 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:19.644+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:19.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:19 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:19.644+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:19.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:19 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:19.609+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:19.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:19 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:19.609+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:19.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:19 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:19.609+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:19.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:19 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:19.609+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:19.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:19 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:19.609+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:20.193 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:19 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:19.877+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:20.193 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:19 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:19.877+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:20.193 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:19 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:19.877+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:20.193 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:19 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:19.877+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.526410+0000 front 2024-03-16T21:09:53.526493+0000 (oldest deadline 2024-03-16T21:10:17.626551+0000) 2024-03-16T21:10:20.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:20 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:20.100+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:20.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:20 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:20.100+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:20.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:20 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:20.100+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:20.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:20 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:20.100+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:20.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:20 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:20.100+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:20.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:20 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:20.188+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:20.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:20 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:20.188+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:20.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:20 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:20.188+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:20.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:20 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:20.188+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:20.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:20 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:20.188+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:20.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:20 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:20.688+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:20.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:20 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:20.688+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:20.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:20 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:20.688+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:20.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:20 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:20.688+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:20.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:20 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:20.585+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:20.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:20 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:20.585+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:20.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:20 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:20.585+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:20.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:20 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:20.585+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:20.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:20 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:20.585+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:21.216 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:20 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:20.896+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:21.216 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:20 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:20.896+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:21.216 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:20 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:20.896+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:21.216 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:20 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:20.896+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.526410+0000 front 2024-03-16T21:09:53.526493+0000 (oldest deadline 2024-03-16T21:10:17.626551+0000) 2024-03-16T21:10:21.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:21 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:21.132+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:21.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:21 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:21.132+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:21.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:21 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:21.132+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:21.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:21 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:21.132+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:21.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:21 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:21.132+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:21.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:21 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:21.211+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:21.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:21 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:21.211+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:21.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:21 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:21.211+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:21.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:21 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:21.211+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:21.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:21 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:21.211+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:21.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:21 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:21.670+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:21.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:21 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:21.670+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:21.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:21 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:21.670+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:21.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:21 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:21.670+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:21.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:21 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:21.561+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:21.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:21 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:21.561+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:21.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:21 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:21.561+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:21.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:21 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:21.561+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:21.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:21 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:21.561+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:22.368 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:21 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:21.936+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.522194+0000 front 2024-03-16T21:09:28.522218+0000 (oldest deadline 2024-03-16T21:09:51.422360+0000) 2024-03-16T21:10:22.368 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:21 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:21.936+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:32.523321+0000 front 2024-03-16T21:09:32.523348+0000 (oldest deadline 2024-03-16T21:10:01.323983+0000) 2024-03-16T21:10:22.368 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:21 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:21.936+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:42.425288+0000 front 2024-03-16T21:09:42.425162+0000 (oldest deadline 2024-03-16T21:10:07.725111+0000) 2024-03-16T21:10:22.368 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:21 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7[53897]: 2024-03-16T21:10:21.936+0000 7f6902dfe700 -1 osd.7 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.526410+0000 front 2024-03-16T21:09:53.526493+0000 (oldest deadline 2024-03-16T21:10:17.626551+0000) 2024-03-16T21:10:22.368 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:22 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:22.167+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:22.368 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:22 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:22.167+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:22.369 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:22 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:22.167+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:22.369 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:22 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:22.167+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:22.369 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:22 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:22.167+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:22.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:22 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:22.097+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:22.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:22 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:22.097+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:22.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:22 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:22.097+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:22.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:22 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:22.097+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:22.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:22 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:22.097+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:22.867 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:22 smithi170 podman[72885]: 2024-03-16 21:10:22.597964726 +0000 UTC m=+5.623519481 container died 7e664bf77c934a5c0f5804b332064e6ca44958ccd94b51db1ceea6fae3297137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-16T21:10:22.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:22 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:22.688+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:22.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:22 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:22.688+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:22.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:22 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:22.688+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:22.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:22 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:22.688+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:22.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:22 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:22.559+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:22.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:22 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:22.559+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:22.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:22 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:22.559+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:22.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:22 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:22.559+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:22.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:22 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:22.559+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:23.173 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:22 smithi170 podman[72885]: 2024-03-16 21:10:22.95996255 +0000 UTC m=+5.985517293 container cleanup 7e664bf77c934a5c0f5804b332064e6ca44958ccd94b51db1ceea6fae3297137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-16T21:10:23.174 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:22 smithi170 bash[72885]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7 2024-03-16T21:10:23.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:23 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:23.100+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:23.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:23 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:23.100+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:23.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:23 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:23.100+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:23.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:23 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:23.100+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:23.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:23 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:23.100+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:23.570 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:23 smithi170 podman[72906]: 2024-03-16 21:10:23.169540807 +0000 UTC m=+0.570159179 container remove 7e664bf77c934a5c0f5804b332064e6ca44958ccd94b51db1ceea6fae3297137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:10:23.570 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:23 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:23.215+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:23.570 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:23 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:23.215+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:23.570 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:23 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:23.215+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:23.570 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:23 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:23.215+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:23.570 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:23 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:23.215+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:23.844 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:23 smithi170 podman[72996]: 2024-03-16 21:10:23.468869725 +0000 UTC m=+0.017294312 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:10:23.844 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:23 smithi170 podman[72996]: 2024-03-16 21:10:23.587024891 +0000 UTC m=+0.135449469 container create d990136cc422611dffa03544b3a6dd6652c2407485b923ca94c3ab1c835a3627 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-03-16T21:10:23.845 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:23 smithi170 podman[72996]: 2024-03-16 21:10:23.77264083 +0000 UTC m=+0.321065411 container init d990136cc422611dffa03544b3a6dd6652c2407485b923ca94c3ab1c835a3627 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7-deactivate, ceph=True, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-16T21:10:23.845 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:23 smithi170 podman[72996]: 2024-03-16 21:10:23.775863718 +0000 UTC m=+0.324288306 container start d990136cc422611dffa03544b3a6dd6652c2407485b923ca94c3ab1c835a3627 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-16T21:10:23.845 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:23 smithi170 podman[72996]: 2024-03-16 21:10:23.839249541 +0000 UTC m=+0.387674148 container attach d990136cc422611dffa03544b3a6dd6652c2407485b923ca94c3ab1c835a3627 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307) 2024-03-16T21:10:23.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:23 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:23.683+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:23.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:23 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:23.683+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:23.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:23 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:23.683+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:23.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:23 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:23.683+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:23.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:23 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:23.539+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:23.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:23 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:23.539+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:23.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:23 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:23.539+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:23.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:23 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:23.539+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:23.895 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:23 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:23.539+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:24.094 INFO:journalctl@ceph.osd.7.smithi170.stdout:Mar 16 21:10:24 smithi170 podman[72996]: 2024-03-16 21:10:24.06673264 +0000 UTC m=+0.615157236 container died d990136cc422611dffa03544b3a6dd6652c2407485b923ca94c3ab1c835a3627 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-16T21:10:24.356 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:24 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:24.247+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:24.356 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:24 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:24.247+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:24.356 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:24 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:24.247+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:24.356 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:24 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:24.247+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:24.356 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:24 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:24.247+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:24.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:24 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:24.147+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:24.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:24 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:24.147+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:24.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:24 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:24.147+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:24.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:24 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:24.147+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:24.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:24 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:24.147+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:24.661 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.7.service' 2024-03-16T21:10:24.701 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:10:24.701 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-16T21:10:24.701 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-03-16T21:10:24.702 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.8 2024-03-16T21:10:24.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:24 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:24.662+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:24.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:24 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:24.662+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:24.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:24 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:24.662+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:24.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:24 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:24.662+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:24.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:24 smithi186 systemd[1]: Stopping Ceph osd.8 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:10:24.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:24 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:24.514+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:24.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:24 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:24.514+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:24.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:24 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:24.514+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:24.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:24 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:24.514+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:24.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:24 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:24.514+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:25.393 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:25.017+0000 7f61f2e25700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:10:25.393 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:25.017+0000 7f61f2e25700 -1 osd.8 100 *** Got signal Terminated *** 2024-03-16T21:10:25.394 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:25.017+0000 7f61f2e25700 -1 osd.8 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:10:25.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:25 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:25.148+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:25.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:25 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:25.148+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:25.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:25 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:25.148+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:25.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:25 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:25.148+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:25.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:25 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:25.148+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:25.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:25 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:25.222+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:25.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:25 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:25.222+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:25.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:25 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:25.222+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:25.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:25 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:25.222+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:25.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:25 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:25.222+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:25.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:25.633+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:25.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:25.633+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:25.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:25.633+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:25.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:25.633+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:25.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:25.481+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:25.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:25.481+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:25.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:25.481+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:25.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:25.481+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:25.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:25.481+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:25.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:25 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:25.481+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:26.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:26 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:26.146+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:26.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:26 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:26.146+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:26.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:26 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:26.146+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:26.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:26 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:26.146+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:26.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:26 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:26.146+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:26.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:26 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:26.146+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:26.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:26 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:26.262+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:26.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:26 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:26.262+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:26.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:26 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:26.262+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:26.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:26 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:26.262+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:26.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:26 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:26.262+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:26.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:26.457+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:26.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:26.457+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:26.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:26.457+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:26.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:26.457+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:26.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:26.457+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:26.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:26.457+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:26.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:26.608+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:26.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:26.608+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:26.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:26.608+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:26.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:26.608+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:26.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:26 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:26.608+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.053401+0000 front 2024-03-16T21:10:03.053433+0000 (oldest deadline 2024-03-16T21:10:26.553555+0000) 2024-03-16T21:10:27.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:27 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:27.158+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:27.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:27 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:27.158+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:27.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:27 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:27.158+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:27.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:27 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:27.158+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:27.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:27 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:27.158+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:27.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:27 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:27.158+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:27.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:27 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:27.272+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:27.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:27 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:27.272+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:27.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:27 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:27.272+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:27.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:27 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:27.272+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:27.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:27 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:27.272+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:27.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:27.632+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:27.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:27.632+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:27.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:27.632+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:27.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:27.632+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:27.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:27.632+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.053401+0000 front 2024-03-16T21:10:03.053433+0000 (oldest deadline 2024-03-16T21:10:26.553555+0000) 2024-03-16T21:10:27.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:27.423+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:27.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:27.423+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:27.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:27.423+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:27.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:27.423+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:27.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:27.423+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:27.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:27 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:27.423+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:28.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:28 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:28.157+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:28.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:28 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:28.157+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:28.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:28 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:28.157+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:28.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:28 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:28.157+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:28.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:28 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:28.157+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:28.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:28 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:28.157+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:28.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:28 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:28.295+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:28.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:28 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:28.295+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:28.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:28 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:28.295+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:28.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:28 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:28.295+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:28.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:28 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:28.295+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:28.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:28.639+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:28.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:28.639+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:28.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:28.639+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:28.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:28.639+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:28.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:28.639+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.053401+0000 front 2024-03-16T21:10:03.053433+0000 (oldest deadline 2024-03-16T21:10:26.553555+0000) 2024-03-16T21:10:28.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:28.456+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:28.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:28.456+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:28.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:28.456+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:28.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:28.456+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:28.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:28.456+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:28.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:28 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:28.456+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:29.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:29 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:29.184+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:29.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:29 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:29.184+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:29.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:29 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:29.184+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:29.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:29 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:29.184+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:29.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:29 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:29.184+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:29.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:29 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:29.184+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:29.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:29 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:29.258+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:29.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:29 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:29.258+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:29.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:29 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:29.258+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:29.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:29 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:29.258+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:29.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:29 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:29.258+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:29.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:29 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:29.258+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:29.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:29.620+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:27.647211+0000 front 2024-03-16T21:09:27.647166+0000 (oldest deadline 2024-03-16T21:09:53.447949+0000) 2024-03-16T21:10:29.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:29.620+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:36.849437+0000 front 2024-03-16T21:09:36.849577+0000 (oldest deadline 2024-03-16T21:10:00.349665+0000) 2024-03-16T21:10:29.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:29.620+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.351288+0000 front 2024-03-16T21:09:44.351367+0000 (oldest deadline 2024-03-16T21:10:10.251129+0000) 2024-03-16T21:10:29.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:29.620+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:53.752068+0000 front 2024-03-16T21:09:53.752050+0000 (oldest deadline 2024-03-16T21:10:17.852101+0000) 2024-03-16T21:10:29.894 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8[55306]: 2024-03-16T21:10:29.620+0000 7f61eb411700 -1 osd.8 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.053401+0000 front 2024-03-16T21:10:03.053433+0000 (oldest deadline 2024-03-16T21:10:26.553555+0000) 2024-03-16T21:10:29.895 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:29.486+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:29.895 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:29.486+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:29.895 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:29.486+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:29.895 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:29.486+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:29.895 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:29.486+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:29.896 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:29 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:29.486+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:30.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:30 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:30.226+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:30.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:30 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:30.226+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:30.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:30 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:30.226+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:30.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:30 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:30.226+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:30.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:30 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:30.226+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:30.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:30 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:30.226+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:30.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:30 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:30.257+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:30.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:30 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:30.257+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:30.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:30 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:30.257+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:30.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:30 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:30.257+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:30.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:30 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:30.257+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:30.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:30 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:30.257+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:30.713 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:30 smithi186 podman[74657]: 2024-03-16 21:10:30.43358582 +0000 UTC m=+5.537393550 container died de4d7cce7dd6c8d818a4497cdc3fc63cef808866f95820e4311c16ee3ae646fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-16T21:10:30.714 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:30 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:30.472+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:30.714 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:30 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:30.472+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:30.714 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:30 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:30.472+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:30.714 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:30 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:30.472+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:30.714 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:30 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:30.472+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:30.714 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:30 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:30.472+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:31.089 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:30 smithi186 podman[74657]: 2024-03-16 21:10:30.816977644 +0000 UTC m=+5.920785363 container cleanup de4d7cce7dd6c8d818a4497cdc3fc63cef808866f95820e4311c16ee3ae646fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:10:31.089 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:30 smithi186 bash[74657]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8 2024-03-16T21:10:31.389 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:31 smithi186 podman[74674]: 2024-03-16 21:10:31.084938705 +0000 UTC m=+0.650629197 container remove de4d7cce7dd6c8d818a4497cdc3fc63cef808866f95820e4311c16ee3ae646fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-16T21:10:31.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:31 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:31.189+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:31.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:31 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:31.189+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:31.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:31 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:31.189+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:31.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:31 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:31.189+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:31.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:31 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:31.189+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:31.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:31 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:31.189+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:31.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:31 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:31.253+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:31.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:31 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:31.253+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:31.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:31 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:31.253+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:31.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:31 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:31.253+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:31.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:31 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:31.253+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:31.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:31 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:31.253+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:31.642 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:31 smithi186 podman[74765]: 2024-03-16 21:10:31.287813513 +0000 UTC m=+0.017684416 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:10:31.643 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:31 smithi186 podman[74765]: 2024-03-16 21:10:31.393827401 +0000 UTC m=+0.123698294 container create 6824717101aa31d253360584d17ad14f93c5861d6e9151162be6bbb5de177011 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-16T21:10:31.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:31 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:31.429+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:31.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:31 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:31.429+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:31.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:31 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:31.429+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:31.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:31 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:31.429+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:31.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:31 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:31.429+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:31.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:31 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:31.429+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:31.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:31 smithi186 podman[74765]: 2024-03-16 21:10:31.638508873 +0000 UTC m=+0.368379765 container init 6824717101aa31d253360584d17ad14f93c5861d6e9151162be6bbb5de177011 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-16T21:10:31.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:31 smithi186 podman[74765]: 2024-03-16 21:10:31.642066774 +0000 UTC m=+0.371937667 container start 6824717101aa31d253360584d17ad14f93c5861d6e9151162be6bbb5de177011 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-16T21:10:31.893 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:31 smithi186 podman[74765]: 2024-03-16 21:10:31.705174577 +0000 UTC m=+0.435045487 container attach 6824717101aa31d253360584d17ad14f93c5861d6e9151162be6bbb5de177011 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T21:10:32.393 INFO:journalctl@ceph.osd.8.smithi186.stdout:Mar 16 21:10:31 smithi186 podman[74765]: 2024-03-16 21:10:31.942353161 +0000 UTC m=+0.672224056 container died 6824717101aa31d253360584d17ad14f93c5861d6e9151162be6bbb5de177011 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, org.label-schema.build-date=20240307) 2024-03-16T21:10:32.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:32 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:32.218+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:32.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:32 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:32.218+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:32.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:32 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:32.218+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:32.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:32 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:32.218+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:32.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:32 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:32.218+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:32.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:32 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:32.218+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:32.541 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.8.service' 2024-03-16T21:10:32.583 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:10:32.583 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-03-16T21:10:32.583 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-03-16T21:10:32.583 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.9 2024-03-16T21:10:32.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:32 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:32.256+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:32.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:32 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:32.256+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:32.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:32 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:32.256+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:32.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:32 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:32.256+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:32.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:32 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:32.256+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:32.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:32 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:32.256+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:32.794 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:32 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:32.388+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:32.794 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:32 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:32.388+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:32.794 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:32 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:32.388+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:32.794 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:32 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:32.388+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:32.794 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:32 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:32.388+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:32.794 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:32 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:32.388+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:32.994 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:32 smithi008 systemd[1]: Stopping Ceph osd.9 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:10:33.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:33 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:33.135+0000 7fe249a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:10:33.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:33 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:33.135+0000 7fe249a00700 -1 osd.9 100 *** Got signal Terminated *** 2024-03-16T21:10:33.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:33 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:33.135+0000 7fe249a00700 -1 osd.9 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:10:33.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:33 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:33.257+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:33.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:33 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:33.257+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:33.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:33 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:33.257+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:33.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:33 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:33.257+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:33.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:33 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:33.257+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:33.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:33 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:33.257+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:33.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:33 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:33.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:33.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:33 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:33.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:33.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:33 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:33.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:33.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:33 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:33.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:33.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:33 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:33.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:33.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:33 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:33.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:33.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:33 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:33.359+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:33.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:33 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:33.359+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:33.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:33 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:33.359+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:33.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:33 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:33.359+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:33.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:33 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:33.359+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:33.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:33 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:33.359+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:34.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:34.234+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:34.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:34.234+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:34.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:34.234+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:34.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:34.234+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:34.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:34.234+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:34.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:34.234+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:34.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:34 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:34.234+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:08.866526+0000 front 2024-03-16T21:10:08.866760+0000 (oldest deadline 2024-03-16T21:10:33.566096+0000) 2024-03-16T21:10:34.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:34 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:34.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:34.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:34 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:34.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:34.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:34 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:34.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:34.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:34 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:34.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:34.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:34 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:34.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:34.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:34 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:34.235+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:34.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:34 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:34.390+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:34.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:34 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:34.390+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:34.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:34 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:34.390+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:34.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:34 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:34.390+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:34.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:34 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:34.390+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:34.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:34 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:34.390+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:35.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:35 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:35.207+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:35.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:35 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:35.207+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:35.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:35 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:35.207+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:35.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:35 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:35.207+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:35.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:35 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:35.207+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:35.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:35 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:35.207+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:35.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:35 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:35.352+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:35.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:35 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:35.352+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:35.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:35 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:35.352+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:35.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:35 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:35.352+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:35.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:35 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:35.352+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:35.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:35 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:35.352+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:35 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:35.244+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:35 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:35.245+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:35 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:35.245+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:35 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:35.245+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:35 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:35.245+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:35 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:35.245+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:35 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:35.245+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:08.866526+0000 front 2024-03-16T21:10:08.866760+0000 (oldest deadline 2024-03-16T21:10:33.566096+0000) 2024-03-16T21:10:36.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:36 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:36.177+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:36.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:36 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:36.177+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:36.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:36 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:36.177+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:36.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:36 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:36.177+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:36.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:36 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:36.177+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:36.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:36 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:36.177+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:36.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:36 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:36.321+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:36.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:36 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:36.321+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:36.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:36 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:36.321+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:36.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:36 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:36.321+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:36.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:36 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:36.321+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:36.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:36 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:36.321+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:36.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:36 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:36.278+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:36.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:36 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:36.278+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:36.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:36 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:36.278+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:36.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:36 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:36.278+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:36.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:36 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:36.278+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:36.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:36 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:36.278+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:36.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:36 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:36.278+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:08.866526+0000 front 2024-03-16T21:10:08.866760+0000 (oldest deadline 2024-03-16T21:10:33.566096+0000) 2024-03-16T21:10:37.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:37 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:37.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:37.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:37 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:37.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:37.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:37 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:37.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:37.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:37 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:37.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:37.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:37 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:37.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:37.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:37 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:37.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:37.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:37 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:37.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:37.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:37 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:37.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:37.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:37 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:37.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:37.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:37 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:37.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:37.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:37 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:37.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:37.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:37 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:37.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:37.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:37 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:37.255+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:19.647062+0000 front 2024-03-16T21:09:19.647931+0000 (oldest deadline 2024-03-16T21:09:41.947117+0000) 2024-03-16T21:10:37.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:37 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:37.255+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:28.349894+0000 front 2024-03-16T21:09:28.349827+0000 (oldest deadline 2024-03-16T21:09:54.250070+0000) 2024-03-16T21:10:37.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:37 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:37.255+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:38.253306+0000 front 2024-03-16T21:09:38.253444+0000 (oldest deadline 2024-03-16T21:09:59.953582+0000) 2024-03-16T21:10:37.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:37 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:37.255+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:41.655664+0000 front 2024-03-16T21:09:41.655955+0000 (oldest deadline 2024-03-16T21:10:09.256197+0000) 2024-03-16T21:10:37.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:37 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:37.255+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:54.460021+0000 front 2024-03-16T21:09:54.460286+0000 (oldest deadline 2024-03-16T21:10:19.760230+0000) 2024-03-16T21:10:37.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:37 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:37.255+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:04.264258+0000 front 2024-03-16T21:10:04.264171+0000 (oldest deadline 2024-03-16T21:10:25.364409+0000) 2024-03-16T21:10:37.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:37 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9[66134]: 2024-03-16T21:10:37.255+0000 7fe240200700 -1 osd.9 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:08.866526+0000 front 2024-03-16T21:10:08.866760+0000 (oldest deadline 2024-03-16T21:10:33.566096+0000) 2024-03-16T21:10:38.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:38 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:38.216+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:38.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:38 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:38.216+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:38.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:38 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:38.216+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:38.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:38 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:38.216+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:38.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:38 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:38.216+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:38.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:38 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:38.216+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:38.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:38 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:38.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:38.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:38 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:38.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:38.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:38 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:38.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:38.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:38 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:38.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:38.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:38 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:38.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:38.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:38 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:38.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:38.840 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:38 smithi008 podman[100163]: 2024-03-16 21:10:38.547798637 +0000 UTC m=+5.524784954 container died 7d789410520ba0f753820daca284f2f6aa592fe0d70314c981e8baab0d0c3691 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:10:39.126 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:38 smithi008 podman[100163]: 2024-03-16 21:10:38.953848621 +0000 UTC m=+5.930834968 container cleanup 7d789410520ba0f753820daca284f2f6aa592fe0d70314c981e8baab0d0c3691 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T21:10:39.126 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:38 smithi008 bash[100163]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9 2024-03-16T21:10:39.494 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:39 smithi008 podman[100182]: 2024-03-16 21:10:39.121370605 +0000 UTC m=+0.561489557 container remove 7d789410520ba0f753820daca284f2f6aa592fe0d70314c981e8baab0d0c3691 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_CLEAN=True) 2024-03-16T21:10:39.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:39 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:39.266+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:39.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:39 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:39.266+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:39.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:39 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:39.266+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:39.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:39 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:39.266+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:39.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:39 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:39.266+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:39.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:39 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:39.266+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:39.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:39 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:39.266+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:10.410386+0000 front 2024-03-16T21:10:10.410337+0000 (oldest deadline 2024-03-16T21:10:39.210616+0000) 2024-03-16T21:10:39.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:39 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:39.324+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:39.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:39 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:39.324+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:39.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:39 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:39.324+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:39.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:39 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:39.324+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:39.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:39 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:39.324+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:39.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:39 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:39.324+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:40.227 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:39 smithi008 podman[100270]: 2024-03-16 21:10:39.930693429 +0000 UTC m=+0.120342693 container create 6e5e3ffc2f4227c0ee765d75971c80815838bb0e67cf382e8f25405f88f3204c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:10:40.228 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:39 smithi008 podman[100270]: 2024-03-16 21:10:39.847731591 +0000 UTC m=+0.037380827 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:10:40.228 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:40 smithi008 podman[100270]: 2024-03-16 21:10:40.222639247 +0000 UTC m=+0.412288524 container init 6e5e3ffc2f4227c0ee765d75971c80815838bb0e67cf382e8f25405f88f3204c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T21:10:40.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:40 smithi008 podman[100270]: 2024-03-16 21:10:40.233782804 +0000 UTC m=+0.423432046 container start 6e5e3ffc2f4227c0ee765d75971c80815838bb0e67cf382e8f25405f88f3204c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True) 2024-03-16T21:10:40.495 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:40 smithi008 podman[100270]: 2024-03-16 21:10:40.316337855 +0000 UTC m=+0.505987108 container attach 6e5e3ffc2f4227c0ee765d75971c80815838bb0e67cf382e8f25405f88f3204c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-16T21:10:40.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:40 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:40.240+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:40.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:40 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:40.240+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:40.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:40 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:40.240+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:40.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:40 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:40.240+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:40.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:40 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:40.240+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:40.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:40 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:40.240+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:40.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:40 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:40.240+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:10.410386+0000 front 2024-03-16T21:10:10.410337+0000 (oldest deadline 2024-03-16T21:10:39.210616+0000) 2024-03-16T21:10:40.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:40 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:40.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:40.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:40 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:40.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:40.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:40 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:40.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:40.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:40 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:40.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:40.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:40 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:40.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:40.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:40 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:40.338+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:40.994 INFO:journalctl@ceph.osd.9.smithi008.stdout:Mar 16 21:10:40 smithi008 podman[100270]: 2024-03-16 21:10:40.680151948 +0000 UTC m=+0.869801189 container died 6e5e3ffc2f4227c0ee765d75971c80815838bb0e67cf382e8f25405f88f3204c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-9-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:10:41.427 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.9.service' 2024-03-16T21:10:41.538 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:10:41.538 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-03-16T21:10:41.538 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-03-16T21:10:41.539 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.10 2024-03-16T21:10:41.568 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:41.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:41.568 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:41.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:41.568 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:41.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:41.568 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:41.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:41.568 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:41.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:41.568 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:41.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:41.568 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:41.223+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:10.410386+0000 front 2024-03-16T21:10:10.410337+0000 (oldest deadline 2024-03-16T21:10:39.210616+0000) 2024-03-16T21:10:41.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:41.384+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:41.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:41.384+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:41.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:41.384+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:41.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:41.384+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:41.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:41.384+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:41.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:41 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:41.384+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:41.849 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:41 smithi170 systemd[1]: Stopping Ceph osd.10 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:10:41.849 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:41.843+0000 7f45a7899700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:10:41.849 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:41.843+0000 7f45a7899700 -1 osd.10 100 *** Got signal Terminated *** 2024-03-16T21:10:41.849 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:41 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:41.843+0000 7f45a7899700 -1 osd.10 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:10:42.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:42.261+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:42.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:42.261+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:42.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:42.261+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:42.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:42.261+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:42.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:42.261+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:42.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:42.261+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:42.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:42 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:42.261+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:10.410386+0000 front 2024-03-16T21:10:10.410337+0000 (oldest deadline 2024-03-16T21:10:39.210616+0000) 2024-03-16T21:10:42.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:42 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:42.356+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:42.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:42 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:42.356+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:42.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:42 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:42.356+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:42.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:42 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:42.356+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:42.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:42 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:42.356+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:42.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:42 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:42.356+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:43.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:43 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:43.277+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:43.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:43 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:43.277+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:43.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:43 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:43.277+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:43.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:43 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:43.277+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:43.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:43 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:43.277+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:43.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:43 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:43.277+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:43.619 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:43 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:43.277+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:10.410386+0000 front 2024-03-16T21:10:10.410337+0000 (oldest deadline 2024-03-16T21:10:39.210616+0000) 2024-03-16T21:10:43.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:43.308+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:43.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:43.308+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:43.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:43.308+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:43.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:43.308+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:43.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:43.308+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:43.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:43.308+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:44.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:44.294+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:44.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:44.294+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:44.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:44.294+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:44.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:44.294+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:44.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:44.294+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:44.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:44.294+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:44.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:44 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:44.295+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:10.410386+0000 front 2024-03-16T21:10:10.410337+0000 (oldest deadline 2024-03-16T21:10:39.210616+0000) 2024-03-16T21:10:44.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:44.339+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:44.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:44.339+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:44.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:44.339+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:44.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:44.339+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:44.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:44.339+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:44.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:44.339+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:44.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:44 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:44.339+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6820 osd.7 since back 2024-03-16T21:10:18.366943+0000 front 2024-03-16T21:10:18.366903+0000 (oldest deadline 2024-03-16T21:10:44.266710+0000) 2024-03-16T21:10:45.417 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:45 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:45.365+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:45.417 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:45 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:45.365+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:45.418 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:45 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:45.365+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:45.418 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:45 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:45.365+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:45.418 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:45 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:45.365+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:45.418 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:45 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:45.365+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:45.418 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:45 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:45.365+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6820 osd.7 since back 2024-03-16T21:10:18.366943+0000 front 2024-03-16T21:10:18.366903+0000 (oldest deadline 2024-03-16T21:10:44.266710+0000) 2024-03-16T21:10:45.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:45 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:45.255+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:45.617 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:45 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:45.255+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:45.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:45 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:45.255+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:45.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:45 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:45.255+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:45.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:45 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:45.255+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:45.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:45 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:45.255+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:45.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:45 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:45.255+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:10.410386+0000 front 2024-03-16T21:10:10.410337+0000 (oldest deadline 2024-03-16T21:10:39.210616+0000) 2024-03-16T21:10:46.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:46 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:46.274+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:16.603424+0000 front 2024-03-16T21:09:16.603530+0000 (oldest deadline 2024-03-16T21:09:42.503132+0000) 2024-03-16T21:10:46.618 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:46 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:46.274+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:25.304934+0000 front 2024-03-16T21:09:25.304969+0000 (oldest deadline 2024-03-16T21:09:53.505618+0000) 2024-03-16T21:10:46.619 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:46 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:46.274+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:33.506209+0000 front 2024-03-16T21:09:33.506176+0000 (oldest deadline 2024-03-16T21:10:03.506694+0000) 2024-03-16T21:10:46.619 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:46 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:46.274+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:44.007858+0000 front 2024-03-16T21:09:44.008136+0000 (oldest deadline 2024-03-16T21:10:09.307671+0000) 2024-03-16T21:10:46.619 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:46 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:46.274+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:52.808289+0000 front 2024-03-16T21:09:52.808310+0000 (oldest deadline 2024-03-16T21:10:18.708360+0000) 2024-03-16T21:10:46.619 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:46 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:46.274+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.409598+0000 front 2024-03-16T21:10:03.409412+0000 (oldest deadline 2024-03-16T21:10:28.709255+0000) 2024-03-16T21:10:46.619 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:46 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10[60821]: 2024-03-16T21:10:46.274+0000 7f45a3e8d700 -1 osd.10 100 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2024-03-16T21:10:10.410386+0000 front 2024-03-16T21:10:10.410337+0000 (oldest deadline 2024-03-16T21:10:39.210616+0000) 2024-03-16T21:10:46.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:46.391+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:46.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:46.391+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:46.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:46.391+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:46.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:46.391+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:46.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:46.391+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:46.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:46.391+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:46.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:46 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:46.391+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6820 osd.7 since back 2024-03-16T21:10:18.366943+0000 front 2024-03-16T21:10:18.366903+0000 (oldest deadline 2024-03-16T21:10:44.266710+0000) 2024-03-16T21:10:47.649 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:47 smithi170 podman[73104]: 2024-03-16 21:10:47.378324841 +0000 UTC m=+5.649851513 container died a5cd0efa625034f42e70f6c445c27379186621bc950b0e05e0ac207c62398bff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:10:47.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:47 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:47.403+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:47.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:47 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:47.403+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:47.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:47 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:47.403+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:47.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:47 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:47.403+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:47.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:47 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:47.403+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:47.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:47 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:47.403+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:47.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:47 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:47.403+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6820 osd.7 since back 2024-03-16T21:10:18.366943+0000 front 2024-03-16T21:10:18.366903+0000 (oldest deadline 2024-03-16T21:10:44.266710+0000) 2024-03-16T21:10:47.908 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:47 smithi170 podman[73104]: 2024-03-16 21:10:47.71094528 +0000 UTC m=+5.982471942 container cleanup a5cd0efa625034f42e70f6c445c27379186621bc950b0e05e0ac207c62398bff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-03-16T21:10:47.908 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:47 smithi170 bash[73104]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10 2024-03-16T21:10:48.309 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:47 smithi170 podman[73133]: 2024-03-16 21:10:47.904335912 +0000 UTC m=+0.521167115 container remove a5cd0efa625034f42e70f6c445c27379186621bc950b0e05e0ac207c62398bff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T21:10:48.586 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:48 smithi170 podman[73223]: 2024-03-16 21:10:48.305265835 +0000 UTC m=+0.101135033 container create 0bce2b556c5f21c30445216f7049e3eb463154d48eb63981ae4b8f2f8befa4c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:10:48.586 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:48 smithi170 podman[73223]: 2024-03-16 21:10:48.221926012 +0000 UTC m=+0.017795219 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:10:48.587 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:48 smithi170 podman[73223]: 2024-03-16 21:10:48.507492825 +0000 UTC m=+0.303362038 container init 0bce2b556c5f21c30445216f7049e3eb463154d48eb63981ae4b8f2f8befa4c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T21:10:48.587 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:48 smithi170 podman[73223]: 2024-03-16 21:10:48.510717085 +0000 UTC m=+0.306586279 container start 0bce2b556c5f21c30445216f7049e3eb463154d48eb63981ae4b8f2f8befa4c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10-deactivate, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-16T21:10:48.587 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:48 smithi170 podman[73223]: 2024-03-16 21:10:48.582349392 +0000 UTC m=+0.378218582 container attach 0bce2b556c5f21c30445216f7049e3eb463154d48eb63981ae4b8f2f8befa4c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-16T21:10:48.868 INFO:journalctl@ceph.osd.10.smithi170.stdout:Mar 16 21:10:48 smithi170 podman[73223]: 2024-03-16 21:10:48.796359176 +0000 UTC m=+0.592228377 container died 0bce2b556c5f21c30445216f7049e3eb463154d48eb63981ae4b8f2f8befa4c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-10-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-16T21:10:48.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:48 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:48.405+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:48.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:48 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:48.405+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:48.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:48 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:48.405+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:48.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:48 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:48.405+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:48.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:48 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:48.405+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:48.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:48 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:48.405+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:48.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:48 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:48.405+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6820 osd.7 since back 2024-03-16T21:10:18.366943+0000 front 2024-03-16T21:10:18.366903+0000 (oldest deadline 2024-03-16T21:10:44.266710+0000) 2024-03-16T21:10:49.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.10.service' 2024-03-16T21:10:49.483 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:10:49.483 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-03-16T21:10:49.483 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-03-16T21:10:49.483 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.11 2024-03-16T21:10:49.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:49.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:49.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:49.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:49.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:49.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:49.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:49.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:49.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:49.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:49.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:49.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:49.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:49.362+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6820 osd.7 since back 2024-03-16T21:10:18.366943+0000 front 2024-03-16T21:10:18.366903+0000 (oldest deadline 2024-03-16T21:10:44.266710+0000) 2024-03-16T21:10:49.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:49 smithi186 systemd[1]: Stopping Ceph osd.11 for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:10:50.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:49.769+0000 7fc8fd136700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:10:50.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:49.769+0000 7fc8fd136700 -1 osd.11 100 *** Got signal Terminated *** 2024-03-16T21:10:50.143 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:49 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:49.769+0000 7fc8fd136700 -1 osd.11 100 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T21:10:50.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:50 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:50.373+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:50.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:50 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:50.373+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:50.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:50 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:50.373+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:50.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:50 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:50.373+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:50.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:50 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:50.373+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:50.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:50 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:50.373+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:50.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:50 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:50.373+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6820 osd.7 since back 2024-03-16T21:10:18.366943+0000 front 2024-03-16T21:10:18.366903+0000 (oldest deadline 2024-03-16T21:10:44.266710+0000) 2024-03-16T21:10:51.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:51 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:51.415+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:51.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:51 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:51.415+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:51.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:51 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:51.415+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:51.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:51 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:51.415+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:51.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:51 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:51.415+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:51.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:51 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:51.415+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:51.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:51 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:51.415+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6820 osd.7 since back 2024-03-16T21:10:18.366943+0000 front 2024-03-16T21:10:18.366903+0000 (oldest deadline 2024-03-16T21:10:44.266710+0000) 2024-03-16T21:10:52.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:52 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:52.414+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:52.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:52 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:52.414+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:52.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:52 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:52.414+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:52.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:52 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:52.414+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:52.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:52 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:52.414+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:52.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:52 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:52.414+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:52.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:52 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:52.414+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6820 osd.7 since back 2024-03-16T21:10:18.366943+0000 front 2024-03-16T21:10:18.366903+0000 (oldest deadline 2024-03-16T21:10:44.266710+0000) 2024-03-16T21:10:53.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:53.381+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:53.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:53.381+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:53.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:53.381+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:53.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:53.381+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:53.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:53.381+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:53.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:53.381+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:53.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:53.381+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6820 osd.7 since back 2024-03-16T21:10:18.366943+0000 front 2024-03-16T21:10:18.366903+0000 (oldest deadline 2024-03-16T21:10:44.266710+0000) 2024-03-16T21:10:53.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:53 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:53.381+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6820 osd.8 since back 2024-03-16T21:10:27.767461+0000 front 2024-03-16T21:10:27.767426+0000 (oldest deadline 2024-03-16T21:10:52.467536+0000) 2024-03-16T21:10:54.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:54.421+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2024-03-16T21:09:15.957046+0000 front 2024-03-16T21:09:15.957154+0000 (oldest deadline 2024-03-16T21:09:41.856886+0000) 2024-03-16T21:10:54.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:54.421+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6804 osd.1 since back 2024-03-16T21:09:29.959447+0000 front 2024-03-16T21:09:29.959503+0000 (oldest deadline 2024-03-16T21:09:54.659506+0000) 2024-03-16T21:10:54.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:54.421+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2024-03-16T21:09:34.659851+0000 front 2024-03-16T21:09:34.659872+0000 (oldest deadline 2024-03-16T21:10:00.560056+0000) 2024-03-16T21:10:54.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:54.421+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2024-03-16T21:09:46.262412+0000 front 2024-03-16T21:09:46.262459+0000 (oldest deadline 2024-03-16T21:10:12.162243+0000) 2024-03-16T21:10:54.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:54.421+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6812 osd.4 since back 2024-03-16T21:09:55.663524+0000 front 2024-03-16T21:09:55.663557+0000 (oldest deadline 2024-03-16T21:10:17.963395+0000) 2024-03-16T21:10:54.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:54.421+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2024-03-16T21:10:03.164795+0000 front 2024-03-16T21:10:03.164772+0000 (oldest deadline 2024-03-16T21:10:25.464865+0000) 2024-03-16T21:10:54.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:54.421+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.170:6820 osd.7 since back 2024-03-16T21:10:18.366943+0000 front 2024-03-16T21:10:18.366903+0000 (oldest deadline 2024-03-16T21:10:44.266710+0000) 2024-03-16T21:10:54.894 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:54 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11[62381]: 2024-03-16T21:10:54.421+0000 7fc8f972a700 -1 osd.11 100 heartbeat_check: no reply from 172.21.15.186:6820 osd.8 since back 2024-03-16T21:10:27.767461+0000 front 2024-03-16T21:10:27.767426+0000 (oldest deadline 2024-03-16T21:10:52.467536+0000) 2024-03-16T21:10:55.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:55 smithi186 podman[74894]: 2024-03-16 21:10:55.268767946 +0000 UTC m=+5.595059943 container died 4403b6346617ba4689bc95556be44d9642a6501c861bc9c77b3cae37473e3f4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-03-16T21:10:55.643 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:55 smithi186 podman[74894]: 2024-03-16 21:10:55.494191128 +0000 UTC m=+5.820483116 container cleanup 4403b6346617ba4689bc95556be44d9642a6501c861bc9c77b3cae37473e3f4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240307) 2024-03-16T21:10:55.644 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:55 smithi186 bash[74894]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11 2024-03-16T21:10:56.116 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:55 smithi186 podman[74911]: 2024-03-16 21:10:55.703661383 +0000 UTC m=+0.432990528 container remove 4403b6346617ba4689bc95556be44d9642a6501c861bc9c77b3cae37473e3f4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T21:10:56.393 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:56 smithi186 podman[74998]: 2024-03-16 21:10:56.015622128 +0000 UTC m=+0.017767048 image pull 80ec0d3daaba7a52b05a2c1e9fce2fdb808f0661f4843706a56e0840fed82af0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3 2024-03-16T21:10:56.393 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:56 smithi186 podman[74998]: 2024-03-16 21:10:56.112776367 +0000 UTC m=+0.114921285 container create 1ca14c55bebad2dc593225b280a9be42956bbd2d57bc79874ddbc392e373dd95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-16T21:10:56.393 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:56 smithi186 podman[74998]: 2024-03-16 21:10:56.348284925 +0000 UTC m=+0.350429857 container init 1ca14c55bebad2dc593225b280a9be42956bbd2d57bc79874ddbc392e373dd95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-16T21:10:56.394 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:56 smithi186 podman[74998]: 2024-03-16 21:10:56.351549381 +0000 UTC m=+0.353694306 container start 1ca14c55bebad2dc593225b280a9be42956bbd2d57bc79874ddbc392e373dd95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=) 2024-03-16T21:10:56.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:56 smithi186 podman[74998]: 2024-03-16 21:10:56.448517897 +0000 UTC m=+0.450662826 container attach 1ca14c55bebad2dc593225b280a9be42956bbd2d57bc79874ddbc392e373dd95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True) 2024-03-16T21:10:56.893 INFO:journalctl@ceph.osd.11.smithi186.stdout:Mar 16 21:10:56 smithi186 podman[74998]: 2024-03-16 21:10:56.649061369 +0000 UTC m=+0.651206287 container died 1ca14c55bebad2dc593225b280a9be42956bbd2d57bc79874ddbc392e373dd95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307) 2024-03-16T21:10:57.246 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@osd.11.service' 2024-03-16T21:10:57.288 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:10:57.288 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-03-16T21:10:57.288 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-03-16T21:10:57.288 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.a 2024-03-16T21:10:57.744 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 21:10:57 smithi008 systemd[1]: Stopping Ceph mds.a for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:10:58.245 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 21:10:57 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-a[73072]: 2024-03-16T21:10:57.887+0000 7f0cade00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:10:58.245 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 21:10:57 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-a[73072]: 2024-03-16T21:10:57.887+0000 7f0cade00700 -1 mds.a *** got signal Terminated *** 2024-03-16T21:10:59.432 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 21:10:59 smithi008 podman[100387]: 2024-03-16 21:10:59.135825886 +0000 UTC m=+1.378466810 container died 32c086b5946c528c7488d0b6a04ea91af446202b32b837d8e75768234fa7ee21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5) 2024-03-16T21:10:59.745 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 21:10:59 smithi008 podman[100387]: 2024-03-16 21:10:59.588462399 +0000 UTC m=+1.831103340 container cleanup 32c086b5946c528c7488d0b6a04ea91af446202b32b837d8e75768234fa7ee21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-03-16T21:10:59.745 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 21:10:59 smithi008 bash[100387]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-a 2024-03-16T21:11:00.244 INFO:journalctl@ceph.mds.a.smithi008.stdout:Mar 16 21:10:59 smithi008 podman[100401]: 2024-03-16 21:10:59.831595741 +0000 UTC m=+0.673164136 container remove 32c086b5946c528c7488d0b6a04ea91af446202b32b837d8e75768234fa7ee21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=) 2024-03-16T21:11:00.387 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.a.service' 2024-03-16T21:11:00.511 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:00.512 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-03-16T21:11:00.512 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-03-16T21:11:00.512 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.d 2024-03-16T21:11:00.994 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 21:11:00 smithi008 systemd[1]: Stopping Ceph mds.d for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:11:01.495 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 21:11:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-d[72101]: 2024-03-16T21:11:01.167+0000 7f68e0a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:11:01.495 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 21:11:01 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-d[72101]: 2024-03-16T21:11:01.167+0000 7f68e0a00700 -1 mds.d *** got signal Terminated *** 2024-03-16T21:11:04.543 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 21:11:04 smithi008 podman[100507]: 2024-03-16 21:11:04.244557596 +0000 UTC m=+3.209761109 container died e439fb0ee71462744f2e7858889b9ef63e5278eedb89f2cc24d446776fc65189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-d, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T21:11:04.970 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 21:11:04 smithi008 podman[100507]: 2024-03-16 21:11:04.651183392 +0000 UTC m=+3.616386905 container cleanup e439fb0ee71462744f2e7858889b9ef63e5278eedb89f2cc24d446776fc65189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-d, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS) 2024-03-16T21:11:04.970 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 21:11:04 smithi008 bash[100507]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-d 2024-03-16T21:11:05.244 INFO:journalctl@ceph.mds.d.smithi008.stdout:Mar 16 21:11:04 smithi008 podman[100520]: 2024-03-16 21:11:04.962935607 +0000 UTC m=+0.700191277 container remove e439fb0ee71462744f2e7858889b9ef63e5278eedb89f2cc24d446776fc65189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-d, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T21:11:05.299 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.d.service' 2024-03-16T21:11:05.424 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:05.424 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-03-16T21:11:05.424 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-03-16T21:11:05.424 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.g 2024-03-16T21:11:05.994 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 21:11:05 smithi008 systemd[1]: Stopping Ceph mds.g for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:11:06.494 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 21:11:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-g[72728]: 2024-03-16T21:11:06.019+0000 7f9274400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:11:06.495 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 21:11:06 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-g[72728]: 2024-03-16T21:11:06.019+0000 7f9274400700 -1 mds.g *** got signal Terminated *** 2024-03-16T21:11:10.300 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 21:11:10 smithi008 podman[100626]: 2024-03-16 21:11:10.039516373 +0000 UTC m=+4.133732249 container died 5bf90d69e465e865f743c20852334eded33d3ed9c2e7019d33563ceddf29690e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-g, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T21:11:10.652 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 21:11:10 smithi008 podman[100626]: 2024-03-16 21:11:10.446216826 +0000 UTC m=+4.540432725 container cleanup 5bf90d69e465e865f743c20852334eded33d3ed9c2e7019d33563ceddf29690e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-g, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, io.buildah.version=1.33.5) 2024-03-16T21:11:10.652 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 21:11:10 smithi008 bash[100626]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-g 2024-03-16T21:11:10.994 INFO:journalctl@ceph.mds.g.smithi008.stdout:Mar 16 21:11:10 smithi008 podman[100640]: 2024-03-16 21:11:10.647182945 +0000 UTC m=+0.591416662 container remove 5bf90d69e465e865f743c20852334eded33d3ed9c2e7019d33563ceddf29690e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-03-16T21:11:11.184 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.g.service' 2024-03-16T21:11:11.310 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:11.311 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-03-16T21:11:11.311 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-03-16T21:11:11.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.j 2024-03-16T21:11:11.744 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 21:11:11 smithi008 systemd[1]: Stopping Ceph mds.j for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:11:12.245 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 21:11:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-j[71743]: 2024-03-16T21:11:11.915+0000 7fcf20a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:11:12.245 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 21:11:11 smithi008 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-j[71743]: 2024-03-16T21:11:11.915+0000 7fcf20a00700 -1 mds.j *** got signal Terminated *** 2024-03-16T21:11:16.245 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 21:11:15 smithi008 podman[100745]: 2024-03-16 21:11:15.936166678 +0000 UTC m=+4.146630327 container died b241a9c722e56464ccde2b94c0c1584da9616e77d1acdae0b4975519837a9b2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-j, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T21:11:16.555 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 21:11:16 smithi008 podman[100745]: 2024-03-16 21:11:16.358362641 +0000 UTC m=+4.568826345 container cleanup b241a9c722e56464ccde2b94c0c1584da9616e77d1acdae0b4975519837a9b2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-j, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-03-16T21:11:16.556 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 21:11:16 smithi008 bash[100745]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-j 2024-03-16T21:11:16.994 INFO:journalctl@ceph.mds.j.smithi008.stdout:Mar 16 21:11:16 smithi008 podman[100772]: 2024-03-16 21:11:16.550679439 +0000 UTC m=+0.600247625 container remove b241a9c722e56464ccde2b94c0c1584da9616e77d1acdae0b4975519837a9b2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-16T21:11:17.093 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.j.service' 2024-03-16T21:11:17.220 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:17.220 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-03-16T21:11:17.221 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-03-16T21:11:17.221 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.b 2024-03-16T21:11:17.509 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 21:11:17 smithi170 systemd[1]: Stopping Ceph mds.b for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:11:17.867 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 21:11:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b[66248]: 2024-03-16T21:11:17.504+0000 7fbc6a27a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:11:17.869 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 21:11:17 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b[66248]: 2024-03-16T21:11:17.504+0000 7fbc6a27a700 -1 mds.b *** got signal Terminated *** 2024-03-16T21:11:18.786 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 21:11:18 smithi170 podman[73329]: 2024-03-16 21:11:18.630957202 +0000 UTC m=+1.222244844 container died 693a35867200e383b5b83b2a03642783379b256fe78c71d3bc25dd0f37a903ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b, ceph=True, org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-03-16T21:11:19.117 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 21:11:18 smithi170 podman[73329]: 2024-03-16 21:11:18.929674091 +0000 UTC m=+1.520961724 container cleanup 693a35867200e383b5b83b2a03642783379b256fe78c71d3bc25dd0f37a903ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-16T21:11:19.117 INFO:journalctl@ceph.mds.b.smithi170.stdout:Mar 16 21:11:18 smithi170 bash[73329]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-b 2024-03-16T21:11:19.275 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.b.service' 2024-03-16T21:11:19.313 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:19.313 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-03-16T21:11:19.313 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-03-16T21:11:19.314 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.e 2024-03-16T21:11:19.617 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 21:11:19 smithi170 systemd[1]: Stopping Ceph mds.e for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:11:20.117 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 21:11:19 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e[65619]: 2024-03-16T21:11:19.691+0000 7fd2d2624700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:11:20.117 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 21:11:19 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e[65619]: 2024-03-16T21:11:19.691+0000 7fd2d2624700 -1 mds.e *** got signal Terminated *** 2024-03-16T21:11:22.897 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 21:11:22 smithi170 podman[73459]: 2024-03-16 21:11:22.632170811 +0000 UTC m=+3.059325048 container died 5df377e9316f5d730b9493fbae1ee8d90bd3d7c0545a3f0d97ec43648fadad08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-squid-aba3c1d, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:11:23.180 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 21:11:22 smithi170 podman[73459]: 2024-03-16 21:11:22.966809414 +0000 UTC m=+3.393963644 container cleanup 5df377e9316f5d730b9493fbae1ee8d90bd3d7c0545a3f0d97ec43648fadad08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307) 2024-03-16T21:11:23.180 INFO:journalctl@ceph.mds.e.smithi170.stdout:Mar 16 21:11:22 smithi170 bash[73459]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-e 2024-03-16T21:11:23.390 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.e.service' 2024-03-16T21:11:23.427 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:23.427 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-03-16T21:11:23.428 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-03-16T21:11:23.428 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.h 2024-03-16T21:11:23.741 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:11:23 smithi170 systemd[1]: Stopping Ceph mds.h for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:11:24.117 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:11:23 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h[65940]: 2024-03-16T21:11:23.736+0000 7fe5fa2d5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:11:24.117 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:11:23 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h[65940]: 2024-03-16T21:11:23.736+0000 7fe5fa2d5700 -1 mds.h *** got signal Terminated *** 2024-03-16T21:11:26.897 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:11:26 smithi170 podman[73580]: 2024-03-16 21:11:26.636888855 +0000 UTC m=+3.000867402 container died d4ad7e0332a297fc5b0a88228fb6a0c533ca6dbfa964d9710c5c3519f9b34331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-03-16T21:11:26.897 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:11:26 smithi170 podman[73580]: 2024-03-16 21:11:26.878194192 +0000 UTC m=+3.242172741 container cleanup d4ad7e0332a297fc5b0a88228fb6a0c533ca6dbfa964d9710c5c3519f9b34331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, maintainer=Guillaume Abrioux ) 2024-03-16T21:11:26.897 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:11:26 smithi170 bash[73580]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h 2024-03-16T21:11:27.300 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.h.service' 2024-03-16T21:11:27.323 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:11:27 smithi170 podman[73595]: 2024-03-16 21:11:27.045971074 +0000 UTC m=+0.410901219 container remove d4ad7e0332a297fc5b0a88228fb6a0c533ca6dbfa964d9710c5c3519f9b34331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-h, GIT_CLEAN=True, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T21:11:27.323 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:11:27 smithi170 systemd[1]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.h.service: Deactivated successfully. 2024-03-16T21:11:27.323 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:11:27 smithi170 systemd[1]: Stopped Ceph mds.h for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T21:11:27.324 INFO:journalctl@ceph.mds.h.smithi170.stdout:Mar 16 21:11:27 smithi170 systemd[1]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.h.service: Consumed 4min 45.596s CPU time. 2024-03-16T21:11:27.335 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:27.335 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-03-16T21:11:27.335 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-03-16T21:11:27.335 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.k 2024-03-16T21:11:27.617 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 21:11:27 smithi170 systemd[1]: Stopping Ceph mds.k for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:11:28.117 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 21:11:27 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-k[65300]: 2024-03-16T21:11:27.656+0000 7fd563b56700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:11:28.117 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 21:11:27 smithi170 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-k[65300]: 2024-03-16T21:11:27.656+0000 7fd563b56700 -1 mds.k *** got signal Terminated *** 2024-03-16T21:11:31.995 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 21:11:31 smithi170 podman[73700]: 2024-03-16 21:11:31.672304185 +0000 UTC m=+4.128872084 container died 07752b1516c46d4fdc70d4ccf6dd7f18d5cca64ba2d9c386c8fd70a8748d31d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-k, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240307, ceph=True) 2024-03-16T21:11:32.367 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 21:11:31 smithi170 podman[73700]: 2024-03-16 21:11:31.991611063 +0000 UTC m=+4.448178947 container cleanup 07752b1516c46d4fdc70d4ccf6dd7f18d5cca64ba2d9c386c8fd70a8748d31d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-03-16T21:11:32.367 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 21:11:31 smithi170 bash[73700]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-k 2024-03-16T21:11:32.367 INFO:journalctl@ceph.mds.k.smithi170.stdout:Mar 16 21:11:32 smithi170 podman[73714]: 2024-03-16 21:11:32.175750839 +0000 UTC m=+0.507259967 container remove 07752b1516c46d4fdc70d4ccf6dd7f18d5cca64ba2d9c386c8fd70a8748d31d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-k, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS) 2024-03-16T21:11:32.416 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.k.service' 2024-03-16T21:11:32.450 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:32.450 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-03-16T21:11:32.450 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-03-16T21:11:32.450 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.c 2024-03-16T21:11:32.739 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 21:11:32 smithi186 systemd[1]: Stopping Ceph mds.c for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:11:33.143 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 21:11:32 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c[67578]: 2024-03-16T21:11:32.733+0000 7f6fe1d37700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:11:33.143 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 21:11:32 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c[67578]: 2024-03-16T21:11:32.733+0000 7f6fe1d37700 -1 mds.c *** got signal Terminated *** 2024-03-16T21:11:34.888 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 21:11:34 smithi186 podman[75103]: 2024-03-16 21:11:34.621748214 +0000 UTC m=+1.979011935 container died 54671af5a324e2baa2e257d91e5b99c1caf26d522f5181d40117d928763bc3c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True) 2024-03-16T21:11:35.143 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 21:11:34 smithi186 podman[75103]: 2024-03-16 21:11:34.984283675 +0000 UTC m=+2.341547390 container cleanup 54671af5a324e2baa2e257d91e5b99c1caf26d522f5181d40117d928763bc3c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T21:11:35.143 INFO:journalctl@ceph.mds.c.smithi186.stdout:Mar 16 21:11:34 smithi186 bash[75103]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-c 2024-03-16T21:11:35.392 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.c.service' 2024-03-16T21:11:35.434 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:35.434 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-03-16T21:11:35.434 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-03-16T21:11:35.434 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.f 2024-03-16T21:11:35.760 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 21:11:35 smithi186 systemd[1]: Stopping Ceph mds.f for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:11:36.143 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 21:11:35 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f[67253]: 2024-03-16T21:11:35.754+0000 7f5c8c2b3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:11:36.143 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 21:11:35 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f[67253]: 2024-03-16T21:11:35.754+0000 7f5c8c2b3700 -1 mds.f *** got signal Terminated *** 2024-03-16T21:11:38.876 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 21:11:38 smithi186 podman[75235]: 2024-03-16 21:11:38.621131759 +0000 UTC m=+2.961895959 container died e33f94b835df830442a67e177e99c5be458dd346ecacd4529a31d750c74e4df0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T21:11:39.143 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 21:11:38 smithi186 podman[75235]: 2024-03-16 21:11:38.930129523 +0000 UTC m=+3.270893724 container cleanup e33f94b835df830442a67e177e99c5be458dd346ecacd4529a31d750c74e4df0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-03-16T21:11:39.143 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 21:11:38 smithi186 bash[75235]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f 2024-03-16T21:11:39.143 INFO:journalctl@ceph.mds.f.smithi186.stdout:Mar 16 21:11:39 smithi186 podman[75249]: 2024-03-16 21:11:39.106257691 +0000 UTC m=+0.477228235 container remove e33f94b835df830442a67e177e99c5be458dd346ecacd4529a31d750c74e4df0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-f, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-16T21:11:39.362 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.f.service' 2024-03-16T21:11:39.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:39.398 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-03-16T21:11:39.398 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-03-16T21:11:39.398 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.i 2024-03-16T21:11:39.643 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 21:11:39 smithi186 systemd[1]: Stopping Ceph mds.i for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:11:40.143 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 21:11:39 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i[67886]: 2024-03-16T21:11:39.733+0000 7fe361d76700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:11:40.143 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 21:11:39 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i[67886]: 2024-03-16T21:11:39.733+0000 7fe361d76700 -1 mds.i *** got signal Terminated *** 2024-03-16T21:11:42.893 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 21:11:42 smithi186 podman[75357]: 2024-03-16 21:11:42.621560568 +0000 UTC m=+3.013927553 container died d621d4c7b2006ca0d657b468743e59b718e317f4a7d468340708c7606799549b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.build-date=20240307) 2024-03-16T21:11:43.246 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 21:11:43 smithi186 podman[75357]: 2024-03-16 21:11:43.025217812 +0000 UTC m=+3.417584798 container cleanup d621d4c7b2006ca0d657b468743e59b718e317f4a7d468340708c7606799549b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2) 2024-03-16T21:11:43.247 INFO:journalctl@ceph.mds.i.smithi186.stdout:Mar 16 21:11:43 smithi186 bash[75357]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-i 2024-03-16T21:11:43.378 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.i.service' 2024-03-16T21:11:43.413 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:43.413 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-03-16T21:11:43.413 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-03-16T21:11:43.413 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.l 2024-03-16T21:11:43.893 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 21:11:43 smithi186 systemd[1]: Stopping Ceph mds.l for 05d64692-e3d6-11ee-95c9-87774f69a715... 2024-03-16T21:11:43.893 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 21:11:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-l[66942]: 2024-03-16T21:11:43.720+0000 7f4d2ad3e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T21:11:43.893 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 21:11:43 smithi186 ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-l[66942]: 2024-03-16T21:11:43.720+0000 7f4d2ad3e700 -1 mds.l *** got signal Terminated *** 2024-03-16T21:11:45.393 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 21:11:45 smithi186 podman[75477]: 2024-03-16 21:11:45.213595423 +0000 UTC m=+1.585597246 container died a8ffc766bf6f53513e1052ac9b358dd843dd75acadbca8b39a0803ce5163efdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-l, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-squid-aba3c1d, CEPH_POINT_RELEASE=, ceph=True) 2024-03-16T21:11:45.659 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 21:11:45 smithi186 podman[75477]: 2024-03-16 21:11:45.47918168 +0000 UTC m=+1.851183547 container cleanup a8ffc766bf6f53513e1052ac9b358dd843dd75acadbca8b39a0803ce5163efdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-l, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-squid-aba3c1d) 2024-03-16T21:11:45.659 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 21:11:45 smithi186 bash[75477]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-l 2024-03-16T21:11:45.909 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.l.service' 2024-03-16T21:11:45.932 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 21:11:45 smithi186 podman[75491]: 2024-03-16 21:11:45.654979975 +0000 UTC m=+0.445135055 container remove a8ffc766bf6f53513e1052ac9b358dd843dd75acadbca8b39a0803ce5163efdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:264d2baad1e15edc24e723089ae314893f176dbcd8c8990ddeaead799c48d2b3, name=ceph-05d64692-e3d6-11ee-95c9-87774f69a715-mds-l, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-squid-aba3c1d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T21:11:45.932 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 21:11:45 smithi186 systemd[1]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.l.service: Deactivated successfully. 2024-03-16T21:11:45.932 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 21:11:45 smithi186 systemd[1]: Stopped Ceph mds.l for 05d64692-e3d6-11ee-95c9-87774f69a715. 2024-03-16T21:11:45.932 INFO:journalctl@ceph.mds.l.smithi186.stdout:Mar 16 21:11:45 smithi186 systemd[1]: ceph-05d64692-e3d6-11ee-95c9-87774f69a715@mds.l.service: Consumed 1.012s CPU time. 2024-03-16T21:11:45.942 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T21:11:45.943 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-03-16T21:11:45.943 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 --force --keep-logs 2024-03-16T21:11:46.286 INFO:teuthology.orchestra.run.smithi008.stdout:Deleting cluster with fsid: 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T21:11:51.512 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 --force --keep-logs 2024-03-16T21:11:51.701 INFO:teuthology.orchestra.run.smithi170.stdout:Deleting cluster with fsid: 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T21:11:54.235 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 --force --keep-logs 2024-03-16T21:11:54.428 INFO:teuthology.orchestra.run.smithi186.stdout:Deleting cluster with fsid: 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T21:11:56.904 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T21:11:57.016 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T21:11:57.051 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T21:11:57.080 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-16T21:11:57.082 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/crash to /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166/remote/smithi008/crash 2024-03-16T21:11:57.082 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/crash -- . 2024-03-16T21:11:57.182 INFO:teuthology.orchestra.run.smithi008.stderr:tar: /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/crash: Cannot open: No such file or directory 2024-03-16T21:11:57.183 INFO:teuthology.orchestra.run.smithi008.stderr:tar: Error is not recoverable: exiting now 2024-03-16T21:11:57.187 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/crash to /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166/remote/smithi170/crash 2024-03-16T21:11:57.188 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/crash -- . 2024-03-16T21:11:57.228 INFO:teuthology.orchestra.run.smithi170.stderr:tar: /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/crash: Cannot open: No such file or directory 2024-03-16T21:11:57.228 INFO:teuthology.orchestra.run.smithi170.stderr:tar: Error is not recoverable: exiting now 2024-03-16T21:11:57.230 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/crash to /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166/remote/smithi186/crash 2024-03-16T21:11:57.231 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/crash -- . 2024-03-16T21:11:57.276 INFO:teuthology.orchestra.run.smithi186.stderr:tar: /var/lib/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/crash: Cannot open: No such file or directory 2024-03-16T21:11:57.276 INFO:teuthology.orchestra.run.smithi186.stderr:tar: Error is not recoverable: exiting now 2024-03-16T21:11:57.277 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-16T21:11:57.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-03-16T21:11:57.385 INFO:teuthology.orchestra.run.smithi008.stdout:2024-03-16T20:48:12.535124+0000 mon.a (mon.0) 190 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-16T21:11:57.386 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-16T21:11:57.386 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[SEC\]' /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-03-16T21:11:57.475 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]' /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-03-16T21:11:57.560 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[WRN\]' /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-03-16T21:11:57.645 INFO:teuthology.orchestra.run.smithi008.stdout:2024-03-16T20:48:12.535124+0000 mon.a (mon.0) 190 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-16T21:11:57.646 INFO:tasks.cephadm:Compressing logs... 2024-03-16T21:11:57.646 DEBUG:teuthology.orchestra.run.smithi008:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-16T21:11:57.651 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-16T21:11:57.653 DEBUG:teuthology.orchestra.run.smithi186:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-16T21:11:57.680 INFO:teuthology.orchestra.run.smithi186.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-16T21:11:57.681 INFO:teuthology.orchestra.run.smithi186.stderr:: No such file or directory 2024-03-16T21:11:57.681 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.l.log 2024-03-16T21:11:57.681 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.audit.log 2024-03-16T21:11:57.684 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.i.log 2024-03-16T21:11:57.684 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.11.log 2024-03-16T21:11:57.684 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mgr.z.log 2024-03-16T21:11:57.684 INFO:teuthology.orchestra.run.smithi186.stderr: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-16T21:11:57.684 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.8.log 2024-03-16T21:11:57.684 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.5.log 2024-03-16T21:11:57.684 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.f.log 2024-03-16T21:11:57.684 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.cephadm.log 2024-03-16T21:11:57.684 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.f.log: 90.1% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.audit.log.gz 2024-03-16T21:11:57.694 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log 2024-03-16T21:11:57.694 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.cephadm.log: 83.5% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.cephadm.log.gz 2024-03-16T21:11:57.694 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.2.log 2024-03-16T21:11:57.694 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log: 94.6% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.l.log.gz 2024-03-16T21:11:57.694 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.c.log 2024-03-16T21:11:57.694 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.2.log: 87.2% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log.gz 2024-03-16T21:11:57.694 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-volume.log 2024-03-16T21:11:57.694 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.c.log: 91.9% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mgr.z.log.gz 2024-03-16T21:11:57.694 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mon.c.log 2024-03-16T21:11:57.695 INFO:teuthology.orchestra.run.smithi170.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-16T21:11:57.695 INFO:teuthology.orchestra.run.smithi170.stderr:: No such file or directory 2024-03-16T21:11:57.695 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.10.log 2024-03-16T21:11:57.695 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.audit.log 2024-03-16T21:11:57.695 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.b.log 2024-03-16T21:11:57.695 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.4.log 2024-03-16T21:11:57.696 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.1.log 2024-03-16T21:11:57.696 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.b.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-16T21:11:57.696 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.k.log 2024-03-16T21:11:57.696 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.h.log 2024-03-16T21:11:57.696 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.7.log 2024-03-16T21:11:57.696 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.e.log 2024-03-16T21:11:57.696 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.7.log: 90.1% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.audit.log.gz 2024-03-16T21:11:57.696 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mgr.y.log 2024-03-16T21:11:57.696 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.e.log: 94.4% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.k.log.gz 2024-03-16T21:11:57.696 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.cephadm.log 2024-03-16T21:11:57.700 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mgr.y.log: 91.9% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mgr.y.log.gz 2024-03-16T21:11:57.702 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log 2024-03-16T21:11:57.702 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.cephadm.log: 83.6% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.cephadm.log.gz 2024-03-16T21:11:57.703 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-volume.log 2024-03-16T21:11:57.705 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log: 87.2% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log.gz 2024-03-16T21:11:57.706 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mon.b.log 2024-03-16T21:11:57.707 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-volume.log: 90.9% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-volume.log.gz 2024-03-16T21:11:57.719 INFO:teuthology.orchestra.run.smithi008.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-16T21:11:57.720 INFO:teuthology.orchestra.run.smithi008.stderr:: No such file or directory 2024-03-16T21:11:57.720 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-volume.log: /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-volume.log.gz 2024-03-16T21:11:57.721 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.6.log 2024-03-16T21:11:57.722 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mon.a.log 2024-03-16T21:11:57.723 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.audit.log 2024-03-16T21:11:57.724 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.6.log: /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.g.log 2024-03-16T21:11:57.725 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.j.log 2024-03-16T21:11:57.727 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.3.log 2024-03-16T21:11:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mgr.x.log 2024-03-16T21:11:57.729 INFO:teuthology.orchestra.run.smithi008.stderr: 89.9% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.audit.log.gz 2024-03-16T21:11:57.729 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.3.log: 93.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-16T21:11:57.730 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.0.log 2024-03-16T21:11:57.731 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.cephadm.log 2024-03-16T21:11:57.732 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.0.log: 94.4% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.g.log.gz 2024-03-16T21:11:57.732 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log 2024-03-16T21:11:57.734 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.cephadm.log: 83.8% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.cephadm.log.gz 2024-03-16T21:11:57.735 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-volume.log 2024-03-16T21:11:57.736 INFO:teuthology.orchestra.run.smithi008.stderr: 94.4% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.j.log.gz 2024-03-16T21:11:57.737 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.9.log 2024-03-16T21:11:57.739 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-volume.log: 87.1%gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.d.log 2024-03-16T21:11:57.739 INFO:teuthology.orchestra.run.smithi008.stderr: -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph.log.gz 2024-03-16T21:11:57.749 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.9.log: /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.a.log 2024-03-16T21:11:57.749 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.a.log: 94.4% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.d.log.gz 2024-03-16T21:11:57.752 INFO:teuthology.orchestra.run.smithi008.stderr: 90.8% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-volume.log.gz 2024-03-16T21:11:57.762 INFO:teuthology.orchestra.run.smithi008.stderr: 94.3% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.a.log.gz 2024-03-16T21:11:58.062 INFO:teuthology.orchestra.run.smithi008.stderr: 89.9% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mgr.x.log.gz 2024-03-16T21:11:58.246 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mon.c.log: 91.8% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mon.c.log.gz 2024-03-16T21:11:58.267 INFO:teuthology.orchestra.run.smithi170.stderr: 91.8% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mon.b.log.gz 2024-03-16T21:11:58.390 INFO:teuthology.orchestra.run.smithi186.stderr: 95.2% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.f.log.gz 2024-03-16T21:11:58.773 INFO:teuthology.orchestra.run.smithi170.stderr: 95.2% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.e.log.gz 2024-03-16T21:11:59.102 INFO:teuthology.orchestra.run.smithi008.stderr: 90.3% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mon.a.log.gz 2024-03-16T21:11:59.997 INFO:teuthology.orchestra.run.smithi186.stderr: 95.4% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.c.log.gz 2024-03-16T21:12:01.358 INFO:teuthology.orchestra.run.smithi008.stderr: 92.2% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.9.log.gz 2024-03-16T21:12:01.929 INFO:teuthology.orchestra.run.smithi186.stderr: 91.6% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.5.log.gz 2024-03-16T21:12:01.963 INFO:teuthology.orchestra.run.smithi008.stderr: 91.5% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.6.log.gz 2024-03-16T21:12:02.448 INFO:teuthology.orchestra.run.smithi170.stderr: 92.0% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.1.log.gz 2024-03-16T21:12:02.452 INFO:teuthology.orchestra.run.smithi170.stderr: 91.8% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.4.log.gz 2024-03-16T21:12:02.494 INFO:teuthology.orchestra.run.smithi186.stderr: 92.0% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.8.log.gz 2024-03-16T21:12:02.518 INFO:teuthology.orchestra.run.smithi008.stderr: 91.5% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.0.log.gz 2024-03-16T21:12:02.584 INFO:teuthology.orchestra.run.smithi008.stderr: 91.5% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.3.log.gz 2024-03-16T21:12:02.587 INFO:teuthology.orchestra.run.smithi008.stderr: 2024-03-16T21:12:02.587 INFO:teuthology.orchestra.run.smithi008.stderr:real 0m4.903s 2024-03-16T21:12:02.587 INFO:teuthology.orchestra.run.smithi008.stderr:user 0m17.950s 2024-03-16T21:12:02.588 INFO:teuthology.orchestra.run.smithi008.stderr:sys 0m1.420s 2024-03-16T21:12:02.836 INFO:teuthology.orchestra.run.smithi186.stderr: 91.7% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.11.log.gz 2024-03-16T21:12:02.944 INFO:teuthology.orchestra.run.smithi170.stderr: 91.7% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.10.log.gz 2024-03-16T21:12:03.165 INFO:teuthology.orchestra.run.smithi186.stderr: 93.5% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.i.log.gz 2024-03-16T21:12:03.243 INFO:teuthology.orchestra.run.smithi186.stderr: 91.9% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.2.log.gz 2024-03-16T21:12:03.244 INFO:teuthology.orchestra.run.smithi186.stderr: 2024-03-16T21:12:03.245 INFO:teuthology.orchestra.run.smithi186.stderr:real 0m5.577s 2024-03-16T21:12:03.245 INFO:teuthology.orchestra.run.smithi186.stderr:user 0m27.954s 2024-03-16T21:12:03.245 INFO:teuthology.orchestra.run.smithi186.stderr:sys 0m0.858s 2024-03-16T21:12:03.926 INFO:teuthology.orchestra.run.smithi170.stderr: 92.0% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-osd.7.log.gz 2024-03-16T21:12:06.372 INFO:teuthology.orchestra.run.smithi170.stderr: 93.3% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.h.log.gz 2024-03-16T21:12:20.854 INFO:teuthology.orchestra.run.smithi170.stderr: 93.2% -- replaced with /var/log/ceph/05d64692-e3d6-11ee-95c9-87774f69a715/ceph-mds.b.log.gz 2024-03-16T21:12:20.856 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-03-16T21:12:20.856 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m23.188s 2024-03-16T21:12:20.856 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m52.885s 2024-03-16T21:12:20.856 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m1.603s 2024-03-16T21:12:20.856 INFO:tasks.cephadm:Archiving logs... 2024-03-16T21:12:20.856 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166/remote/smithi008/log 2024-03-16T21:12:20.857 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-16T21:12:23.946 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166/remote/smithi170/log 2024-03-16T21:12:23.947 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-16T21:12:31.736 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166/remote/smithi186/log 2024-03-16T21:12:31.738 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-16T21:12:35.740 INFO:tasks.cephadm:Removing cluster... 2024-03-16T21:12:35.740 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 --force 2024-03-16T21:12:36.081 INFO:teuthology.orchestra.run.smithi008.stdout:Deleting cluster with fsid: 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T21:12:36.763 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 --force 2024-03-16T21:12:36.954 INFO:teuthology.orchestra.run.smithi170.stdout:Deleting cluster with fsid: 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T21:12:37.262 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 05d64692-e3d6-11ee-95c9-87774f69a715 --force 2024-03-16T21:12:37.456 INFO:teuthology.orchestra.run.smithi186.stdout:Deleting cluster with fsid: 05d64692-e3d6-11ee-95c9-87774f69a715 2024-03-16T21:12:37.743 INFO:tasks.cephadm:Removing cephadm ... 2024-03-16T21:12:37.743 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-16T21:12:37.806 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-16T21:12:37.821 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-16T21:12:37.837 INFO:tasks.cephadm:Teardown complete 2024-03-16T21:12:37.837 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-16T21:12:37.850 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-16T21:12:37.851 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-16T21:12:37.858 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-16T21:12:37.864 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-16T21:12:38.029 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-16T21:12:38.040 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-16T21:12:38.040 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T21:12:38.048 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T21:12:38.050 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T21:12:38.061 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-03-16T21:12:38.063 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-03-16T21:12:38.066 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T21:12:38.066 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-03-16T21:12:38.066 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 57 +741us[ +809us] +/- 95ms 2024-03-16T21:12:38.066 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 -1985us[-1917us] +/- 76ms 2024-03-16T21:12:38.066 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +1741us[+1809us] +/- 90ms 2024-03-16T21:12:38.066 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T21:12:38.067 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T21:12:38.067 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-03-16T21:12:38.067 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 54 +741us[ +791us] +/- 95ms 2024-03-16T21:12:38.067 INFO:teuthology.orchestra.run.smithi186.stdout:^* hv02.front.sepia.ceph.com 3 6 377 52 -2004us[-1953us] +/- 76ms 2024-03-16T21:12:38.067 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +1712us[+1712us] +/- 90ms 2024-03-16T21:12:38.067 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T21:12:38.098 INFO:teuthology.orchestra.run.smithi008.stderr:bash: line 1: ntpq: command not found 2024-03-16T21:12:38.108 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T21:12:38.108 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2024-03-16T21:12:38.108 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 49 +714us[ +714us] +/- 95ms 2024-03-16T21:12:38.108 INFO:teuthology.orchestra.run.smithi008.stdout:^* hv02.front.sepia.ceph.com 3 6 377 50 -2037us[-2039us] +/- 76ms 2024-03-16T21:12:38.108 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +1691us[+1691us] +/- 90ms 2024-03-16T21:12:38.108 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T21:12:38.110 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-16T21:12:38.122 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-16T21:12:38.122 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-16T21:12:38.215 DEBUG:teuthology.orchestra.run.smithi008:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-16T21:12:38.475 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-16T21:12:38.548 DEBUG:teuthology.orchestra.run.smithi186:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-16T21:12:38.621 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-16T21:12:38.730 INFO:teuthology.orchestra.run.smithi008.stdout:type=AVC msg=audit(1710621392.829:198): avc: denied { checkpoint_restore } for pid=1236 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-03-16T21:12:38.731 DEBUG:teuthology.task.selinux:ubuntu@smithi008.front.sepia.ceph.com has 1 denials 2024-03-16T21:12:38.732 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-16T21:12:38.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T21:12:38.763 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-16T21:12:38.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T21:12:38.793 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi008.front.sepia.ceph.com: ['type=AVC msg=audit(1710621392.829:198): avc: denied { checkpoint_restore } for pid=1236 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-16T21:12:38.794 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-16T21:12:38.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-16T21:12:38.848 INFO:teuthology.task.internal:Duration was 2169.169194 seconds 2024-03-16T21:12:38.848 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-16T21:12:38.908 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-16T21:12:38.908 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-16T21:12:38.916 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-16T21:12:38.919 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-16T21:12:38.959 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T21:12:38.962 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T21:12:39.087 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T21:12:39.578 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-16T21:12:39.578 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2024-03-16T21:12:39.578 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-16T21:12:39.647 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-03-16T21:12:39.647 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-16T21:12:39.669 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2024-03-16T21:12:39.669 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-16T21:12:39.693 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-16T21:12:39.694 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-16T21:12:39.701 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-16T21:12:39.712 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-16T21:12:39.790 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-16T21:12:39.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-16T21:12:39.795 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-16T21:12:39.798 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-16T21:12:40.303 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-16T21:12:40.314 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-16T21:12:40.314 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-16T21:12:40.420 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-16T21:12:40.448 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-16T21:12:40.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-16T21:12:40.490 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-16T21:12:40.498 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-16T21:12:40.500 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-16T21:12:40.523 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-03-16T21:12:40.541 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2024-03-16T21:12:40.606 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2024-03-16T21:12:40.665 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-16T21:12:40.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T21:12:40.715 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-16T21:12:40.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T21:12:40.729 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-16T21:12:40.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T21:12:40.743 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-16T21:12:40.755 INFO:teuthology.task.internal:Transferring archived files... 2024-03-16T21:12:40.755 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166/remote/smithi008 2024-03-16T21:12:40.756 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-16T21:12:40.876 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166/remote/smithi170 2024-03-16T21:12:40.876 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-16T21:12:40.914 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166/remote/smithi186 2024-03-16T21:12:40.914 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-16T21:12:40.955 INFO:teuthology.task.internal:Removing archive directory... 2024-03-16T21:12:40.955 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-16T21:12:40.963 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-16T21:12:40.965 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-16T21:12:41.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-16T21:12:41.027 INFO:teuthology.task.internal:Not uploading archives. 2024-03-16T21:12:41.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-16T21:12:41.074 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-16T21:12:41.074 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-16T21:12:41.082 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-16T21:12:41.084 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-16T21:12:41.096 INFO:teuthology.orchestra.run.smithi170.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 16 21:12 /home/ubuntu/cephtest 2024-03-16T21:12:41.098 INFO:teuthology.orchestra.run.smithi186.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 16 21:12 /home/ubuntu/cephtest 2024-03-16T21:12:41.134 INFO:teuthology.orchestra.run.smithi008.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 16 21:12 /home/ubuntu/cephtest 2024-03-16T21:12:41.137 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-16T21:12:41.149 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-16T21:12:41.202 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi008.front.sepia.ceph.com: ['type=AVC msg=audit(1710621392.829:198): avc: denied { checkpoint_restore } for pid=1236 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-16T21:12:41.202 INFO:teuthology.nuke:Checking targets against current locks 2024-03-16T21:12:41.227 DEBUG:teuthology.nuke:shortname: smithi008 2024-03-16T21:12:41.228 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-16T21:12:41.254 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 20:27:33.995424', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCfTDvUVl/BtfiyDIkFB+3Fi9KEx93wUnd1OxusXCyTVLARbfqZ0/Q2G5YupuUUH7naljI/v5p2iqgpnSDJzX7U='} 2024-03-16T21:12:41.258 DEBUG:teuthology.nuke:shortname: smithi170 2024-03-16T21:12:41.258 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-16T21:12:41.286 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 20:27:33.992055', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+5G+wNhTBmhRscoNwteZ6y57PF040mNwl59LqY8Axit6/FJUV2aAcYHBQLvLVkbkmP0U2KjgySvrAVN4nzgIc='} 2024-03-16T21:12:41.287 DEBUG:teuthology.nuke:shortname: smithi186 2024-03-16T21:12:41.287 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-16T21:12:41.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602166', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 20:27:33.993978', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWGlPi7AvL0WRTNEN/i5gMbeKwyCuYHHvuMHHBoR66bzyAxHwCoBrmsG9afusaKCPiPAN5SDgo/zb0jfOwzj8c='} 2024-03-16T21:12:41.319 INFO:teuthology.orchestra.console.smithi008:Power off 2024-03-16T21:12:41.319 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T21:12:41.341 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2024-03-16T21:12:41.341 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T21:12:41.360 INFO:teuthology.orchestra.console.smithi170:Power off 2024-03-16T21:12:41.360 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T21:12:41.370 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-03-16T21:12:41.381 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2024-03-16T21:12:41.381 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T21:12:41.396 INFO:teuthology.orchestra.console.smithi186:Power off 2024-03-16T21:12:41.397 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T21:12:41.405 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-03-16T21:12:41.418 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2024-03-16T21:12:41.418 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T21:12:41.441 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-03-16T21:12:45.371 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T21:12:45.406 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T21:12:45.442 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T21:12:45.480 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-03-16T21:12:45.516 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-03-16T21:12:45.553 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-03-16T21:12:49.482 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T21:12:49.517 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T21:12:49.554 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T21:12:49.593 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-03-16T21:12:49.629 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-03-16T21:12:49.668 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-03-16T21:12:49.693 INFO:teuthology.orchestra.console.smithi008:Power off completed 2024-03-16T21:12:49.730 INFO:teuthology.orchestra.console.smithi170:Power off completed 2024-03-16T21:12:53.670 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T21:12:53.780 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2024-03-16T21:12:53.881 INFO:teuthology.orchestra.console.smithi186:Power off completed 2024-03-16T21:12:53.986 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 3845b7ac715a3ff198582638d199a90e30e254da description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} duration: 2169.169194459915 failure_reason: '"2024-03-16T20:48:12.535124+0000 mon.a (mon.0) 190 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log' flavor: default owner: scheduled_leonidus@teuthology status: fail success: false 2024-03-16T21:12:53.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T21:12:54.076 INFO:teuthology.run:FAIL